2024-05-08T17:52:23.947 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T17:52:23.947 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi --archive /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697867 --description rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} --owner scheduled_ivancich@teuthology -- /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697867/orig.config.yaml 2024-05-08T17:52:23.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T17:52:24.129 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697867 branch: wip-eric-testing-1 description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} email: ivancich@redhat.com first_in_suite: false job_id: '7697867' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-eric-testing-1 ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 rgw: frontend: beast s3tests: force-branch: ceph-master thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-eric-testing-1 sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 owner: scheduled_ivancich@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 831 sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 sleep_before_teardown: 0 subset: 1/50 suite: rgw suite_branch: wip-eric-testing-1 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_27d371685027569bcfa4efc661d3d3186f3a1776/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 targets: smithi080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGQ3GXQX3GFRg3i/psuo5EsS07t3W5sMGwUSrF/8Udlgl7zHHGTsiUtO98dxwJup1a8om37nIDTgAqud9JlZyTE= smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB2rUIbiGp+OlfzT8NrIZnyDbM1u1jFidN/e8Qicex/bT84KBzFI/b48e7X/bvhhi1fUW26zrxD1FddetJJ1AKU= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_multipart_upload.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_17:43:43 tube: smithi user: ivancich verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T17:52:24.129 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_27d371685027569bcfa4efc661d3d3186f3a1776/qa; will attempt to use it 2024-05-08T17:52:24.129 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_27d371685027569bcfa4efc661d3d3186f3a1776/qa/tasks 2024-05-08T17:52:24.130 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T17:52:24.131 INFO:teuthology.task.internal:Checking packages... 2024-05-08T17:52:24.152 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '27d371685027569bcfa4efc661d3d3186f3a1776' 2024-05-08T17:52:24.152 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T17:52:24.153 INFO:teuthology.packaging:ref: None 2024-05-08T17:52:24.153 INFO:teuthology.packaging:tag: None 2024-05-08T17:52:24.153 INFO:teuthology.packaging:branch: wip-eric-testing-1 2024-05-08T17:52:24.153 INFO:teuthology.packaging:sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T17:52:24.153 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-eric-testing-1 2024-05-08T17:52:24.405 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3525-g27d37168-1jammy 2024-05-08T17:52:24.407 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T17:52:24.414 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T17:52:24.414 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T17:52:24.424 INFO:teuthology.task.internal:Saving configuration 2024-05-08T17:52:24.438 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T17:52:24.444 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T17:52:24.469 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697867', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 17:46:28.222430', 'locked_by': 'scheduled_ivancich@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICqx4pZO8sFDGDXkeWJZR4AByU7WHB/I1EpozNXHelEW'} 2024-05-08T17:52:24.490 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697867', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 17:46:28.224103', 'locked_by': 'scheduled_ivancich@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBSIfaazygEOHP6B4WHtxV0lbDM4Wgwml0gcaFIvuh0T'} 2024-05-08T17:52:24.490 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T17:52:24.496 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-05-08T17:52:24.496 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-05-08T17:52:24.496 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T17:52:24.571 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fea41d7a0d0>, signals=[15]) 2024-05-08T17:52:24.571 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T17:52:24.578 INFO:teuthology.task.internal:Opening connections... 2024-05-08T17:52:24.578 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T17:52:24.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:52:24.658 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T17:52:24.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:52:24.734 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T17:52:24.742 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-05-08T17:52:24.747 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-05-08T17:52:24.748 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-05-08T17:52:24.792 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-08T17:52:24.792 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Ubuntu" 2024-05-08T17:52:24.792 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="22.04" 2024-05-08T17:52:24.792 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-08T17:52:24.792 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_CODENAME=jammy 2024-05-08T17:52:24.792 INFO:teuthology.orchestra.run.smithi080.stdout:ID=ubuntu 2024-05-08T17:52:24.792 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE=debian 2024-05-08T17:52:24.793 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-08T17:52:24.793 INFO:teuthology.orchestra.run.smithi080.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-08T17:52:24.793 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-08T17:52:24.793 INFO:teuthology.orchestra.run.smithi080.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-08T17:52:24.793 INFO:teuthology.orchestra.run.smithi080.stdout:UBUNTU_CODENAME=jammy 2024-05-08T17:52:24.793 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-05-08T17:52:24.813 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-05-08T17:52:24.818 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-05-08T17:52:24.819 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-05-08T17:52:24.865 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-08T17:52:24.865 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Ubuntu" 2024-05-08T17:52:24.866 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="22.04" 2024-05-08T17:52:24.866 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-08T17:52:24.866 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_CODENAME=jammy 2024-05-08T17:52:24.866 INFO:teuthology.orchestra.run.smithi115.stdout:ID=ubuntu 2024-05-08T17:52:24.866 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE=debian 2024-05-08T17:52:24.866 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-08T17:52:24.866 INFO:teuthology.orchestra.run.smithi115.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-08T17:52:24.866 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-08T17:52:24.866 INFO:teuthology.orchestra.run.smithi115.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-08T17:52:24.866 INFO:teuthology.orchestra.run.smithi115.stdout:UBUNTU_CODENAME=jammy 2024-05-08T17:52:24.866 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-05-08T17:52:24.888 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T17:52:24.897 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T17:52:24.902 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T17:52:24.902 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2024-05-08T17:52:24.904 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2024-05-08T17:52:24.913 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T17:52:24.919 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T17:52:24.919 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2024-05-08T17:52:24.950 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2024-05-08T17:52:25.010 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T17:52:25.062 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T17:52:25.077 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-08T17:52:25.077 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-08T17:52:25.078 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T17:52:25.078 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T17:52:25.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T17:52:25.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T17:52:25.083 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-05-08T17:52:25.084 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-05-08T17:52:25.129 INFO:teuthology.orchestra.run.smithi080.stdout:5.15.0-56-generic 2024-05-08T17:52:25.129 INFO:teuthology.task.kernel:Running kernel on smithi080: 5.15.0-56-generic 2024-05-08T17:52:25.130 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get clean 2024-05-08T17:52:25.131 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-56-generic 2024-05-08T17:52:25.131 INFO:teuthology.task.kernel:Running kernel on smithi115: 5.15.0-56-generic 2024-05-08T17:52:25.131 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get clean 2024-05-08T17:52:25.257 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get update 2024-05-08T17:52:25.265 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get update 2024-05-08T17:52:25.400 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T17:52:25.416 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T17:52:25.416 INFO:teuthology.orchestra.run.smithi080.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-08T17:52:25.416 INFO:teuthology.orchestra.run.smithi080.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-08T17:52:25.426 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-08T17:52:25.506 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-08T17:52:25.508 INFO:teuthology.orchestra.run.smithi080.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-08T17:52:25.634 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-08T17:52:25.649 INFO:teuthology.orchestra.run.smithi080.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,421 kB] 2024-05-08T17:52:25.734 INFO:teuthology.orchestra.run.smithi080.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-08T17:52:25.774 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-08T17:52:25.788 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-08T17:52:25.793 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-08T17:52:25.793 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-08T17:52:25.794 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-08T17:52:25.808 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [458 kB] 2024-05-08T17:52:25.823 INFO:teuthology.orchestra.run.smithi115.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-08T17:52:25.830 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [246 kB] 2024-05-08T17:52:25.838 INFO:teuthology.orchestra.run.smithi080.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-08T17:52:25.839 INFO:teuthology.orchestra.run.smithi080.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-08T17:52:25.854 INFO:teuthology.orchestra.run.smithi115.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-08T17:52:25.863 INFO:teuthology.orchestra.run.smithi115.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T17:52:25.863 INFO:teuthology.orchestra.run.smithi115.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-08T17:52:25.883 INFO:teuthology.orchestra.run.smithi115.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-08T17:52:25.886 INFO:teuthology.orchestra.run.smithi080.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-08T17:52:25.893 INFO:teuthology.orchestra.run.smithi115.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-08T17:52:25.895 INFO:teuthology.orchestra.run.smithi080.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-08T17:52:25.897 INFO:teuthology.orchestra.run.smithi080.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-08T17:52:25.897 INFO:teuthology.orchestra.run.smithi115.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-08T17:52:25.898 INFO:teuthology.orchestra.run.smithi115.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-08T17:52:25.898 INFO:teuthology.orchestra.run.smithi115.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-08T17:52:25.906 INFO:teuthology.orchestra.run.smithi080.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T17:52:25.906 INFO:teuthology.orchestra.run.smithi080.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-08T17:52:25.920 INFO:teuthology.orchestra.run.smithi115.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-08T17:52:25.921 INFO:teuthology.orchestra.run.smithi080.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-08T17:52:25.923 INFO:teuthology.orchestra.run.smithi115.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-08T17:52:25.923 INFO:teuthology.orchestra.run.smithi115.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-08T17:52:25.924 INFO:teuthology.orchestra.run.smithi115.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-08T17:52:25.925 INFO:teuthology.orchestra.run.smithi115.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-08T17:52:25.930 INFO:teuthology.orchestra.run.smithi080.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-08T17:52:25.943 INFO:teuthology.orchestra.run.smithi115.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-08T17:52:25.944 INFO:teuthology.orchestra.run.smithi115.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-08T17:52:25.944 INFO:teuthology.orchestra.run.smithi115.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-08T17:52:25.945 INFO:teuthology.orchestra.run.smithi115.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-08T17:52:25.945 INFO:teuthology.orchestra.run.smithi115.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-08T17:52:25.953 INFO:teuthology.orchestra.run.smithi080.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-08T17:52:25.954 INFO:teuthology.orchestra.run.smithi080.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-08T17:52:25.954 INFO:teuthology.orchestra.run.smithi080.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-08T17:52:25.954 INFO:teuthology.orchestra.run.smithi080.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-08T17:52:25.955 INFO:teuthology.orchestra.run.smithi080.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-08T17:52:25.967 INFO:teuthology.orchestra.run.smithi080.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-08T17:52:25.973 INFO:teuthology.orchestra.run.smithi080.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-08T17:52:25.973 INFO:teuthology.orchestra.run.smithi080.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-08T17:52:25.974 INFO:teuthology.orchestra.run.smithi080.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-08T17:52:26.003 INFO:teuthology.orchestra.run.smithi080.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-08T17:52:26.008 INFO:teuthology.orchestra.run.smithi080.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T17:52:26.009 INFO:teuthology.orchestra.run.smithi080.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-08T17:52:26.015 INFO:teuthology.orchestra.run.smithi080.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-08T17:52:26.027 INFO:teuthology.orchestra.run.smithi080.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-08T17:52:26.030 INFO:teuthology.orchestra.run.smithi080.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-08T17:52:26.030 INFO:teuthology.orchestra.run.smithi080.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-08T17:52:26.030 INFO:teuthology.orchestra.run.smithi080.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-08T17:52:26.030 INFO:teuthology.orchestra.run.smithi080.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-08T17:52:26.048 INFO:teuthology.orchestra.run.smithi080.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-08T17:52:26.048 INFO:teuthology.orchestra.run.smithi080.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-08T17:52:26.049 INFO:teuthology.orchestra.run.smithi080.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-08T17:52:26.049 INFO:teuthology.orchestra.run.smithi080.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-08T17:52:26.068 INFO:teuthology.orchestra.run.smithi080.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-08T17:52:26.069 INFO:teuthology.orchestra.run.smithi080.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-08T17:52:26.069 INFO:teuthology.orchestra.run.smithi080.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-08T17:52:26.069 INFO:teuthology.orchestra.run.smithi080.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-08T17:52:26.069 INFO:teuthology.orchestra.run.smithi080.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-08T17:52:26.256 INFO:teuthology.orchestra.run.smithi115.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,421 kB] 2024-05-08T17:52:26.739 INFO:teuthology.orchestra.run.smithi115.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [458 kB] 2024-05-08T17:52:26.781 INFO:teuthology.orchestra.run.smithi115.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [246 kB] 2024-05-08T17:52:26.806 INFO:teuthology.orchestra.run.smithi115.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-08T17:52:26.807 INFO:teuthology.orchestra.run.smithi115.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-08T17:52:26.946 INFO:teuthology.orchestra.run.smithi115.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-08T17:52:26.946 INFO:teuthology.orchestra.run.smithi115.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-08T17:52:26.967 INFO:teuthology.orchestra.run.smithi115.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T17:52:26.967 INFO:teuthology.orchestra.run.smithi115.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-08T17:52:27.003 INFO:teuthology.orchestra.run.smithi115.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-08T17:52:27.297 INFO:teuthology.orchestra.run.smithi115.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-08T17:52:27.988 INFO:teuthology.orchestra.run.smithi115.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-08T17:52:27.997 INFO:teuthology.orchestra.run.smithi115.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-08T17:52:27.999 INFO:teuthology.orchestra.run.smithi115.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-08T17:52:28.026 INFO:teuthology.orchestra.run.smithi115.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-08T17:52:28.031 INFO:teuthology.orchestra.run.smithi115.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-08T17:52:31.489 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 13.4 MB in 2s (6,990 kB/s) 2024-05-08T17:52:32.423 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 13.4 MB in 3s (4,952 kB/s) 2024-05-08T17:52:32.917 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-05-08T17:52:32.935 DEBUG:teuthology.orchestra.run.smithi080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T17:52:32.986 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-05-08T17:52:33.163 INFO:teuthology.orchestra.run.smithi080.stdout:Building dependency tree... 2024-05-08T17:52:33.163 INFO:teuthology.orchestra.run.smithi080.stdout:Reading state information... 2024-05-08T17:52:33.320 INFO:teuthology.orchestra.run.smithi080.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T17:52:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T17:52:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T17:52:33.320 INFO:teuthology.orchestra.run.smithi080.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T17:52:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-08T17:52:33.321 INFO:teuthology.orchestra.run.smithi080.stdout: python2.7-minimal 2024-05-08T17:52:33.321 INFO:teuthology.orchestra.run.smithi080.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T17:52:33.322 INFO:teuthology.orchestra.run.smithi080.stdout:The following additional packages will be installed: 2024-05-08T17:52:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T17:52:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-08T17:52:33.322 INFO:teuthology.orchestra.run.smithi080.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-08T17:52:33.323 INFO:teuthology.orchestra.run.smithi080.stdout:Suggested packages: 2024-05-08T17:52:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-08T17:52:33.323 INFO:teuthology.orchestra.run.smithi080.stdout:Recommended packages: 2024-05-08T17:52:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: thermald 2024-05-08T17:52:33.379 INFO:teuthology.orchestra.run.smithi080.stdout:The following NEW packages will be installed: 2024-05-08T17:52:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T17:52:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-08T17:52:33.379 INFO:teuthology.orchestra.run.smithi080.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-08T17:52:33.381 INFO:teuthology.orchestra.run.smithi080.stdout:The following packages will be upgraded: 2024-05-08T17:52:33.381 INFO:teuthology.orchestra.run.smithi080.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-08T17:52:33.560 INFO:teuthology.orchestra.run.smithi080.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T17:52:33.560 INFO:teuthology.orchestra.run.smithi080.stdout:Need to get 113 MB of archives. 2024-05-08T17:52:33.560 INFO:teuthology.orchestra.run.smithi080.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-08T17:52:33.560 INFO:teuthology.orchestra.run.smithi080.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-08T17:52:33.805 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-05-08T17:52:33.822 DEBUG:teuthology.orchestra.run.smithi115:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T17:52:33.884 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-05-08T17:52:34.087 INFO:teuthology.orchestra.run.smithi115.stdout:Building dependency tree... 2024-05-08T17:52:34.088 INFO:teuthology.orchestra.run.smithi115.stdout:Reading state information... 2024-05-08T17:52:34.267 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T17:52:34.267 INFO:teuthology.orchestra.run.smithi115.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T17:52:34.267 INFO:teuthology.orchestra.run.smithi115.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T17:52:34.268 INFO:teuthology.orchestra.run.smithi115.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T17:52:34.268 INFO:teuthology.orchestra.run.smithi115.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-08T17:52:34.268 INFO:teuthology.orchestra.run.smithi115.stdout: python2.7-minimal 2024-05-08T17:52:34.268 INFO:teuthology.orchestra.run.smithi115.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T17:52:34.269 INFO:teuthology.orchestra.run.smithi115.stdout:The following additional packages will be installed: 2024-05-08T17:52:34.269 INFO:teuthology.orchestra.run.smithi115.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T17:52:34.269 INFO:teuthology.orchestra.run.smithi115.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-08T17:52:34.269 INFO:teuthology.orchestra.run.smithi115.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-08T17:52:34.271 INFO:teuthology.orchestra.run.smithi115.stdout:Suggested packages: 2024-05-08T17:52:34.271 INFO:teuthology.orchestra.run.smithi115.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-08T17:52:34.271 INFO:teuthology.orchestra.run.smithi115.stdout:Recommended packages: 2024-05-08T17:52:34.271 INFO:teuthology.orchestra.run.smithi115.stdout: thermald 2024-05-08T17:52:34.331 INFO:teuthology.orchestra.run.smithi115.stdout:The following NEW packages will be installed: 2024-05-08T17:52:34.331 INFO:teuthology.orchestra.run.smithi115.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T17:52:34.331 INFO:teuthology.orchestra.run.smithi115.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-08T17:52:34.332 INFO:teuthology.orchestra.run.smithi115.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-08T17:52:34.333 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages will be upgraded: 2024-05-08T17:52:34.334 INFO:teuthology.orchestra.run.smithi115.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-08T17:52:34.392 INFO:teuthology.orchestra.run.smithi115.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T17:52:34.393 INFO:teuthology.orchestra.run.smithi115.stdout:Need to get 113 MB of archives. 2024-05-08T17:52:34.393 INFO:teuthology.orchestra.run.smithi115.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-08T17:52:34.393 INFO:teuthology.orchestra.run.smithi115.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-08T17:52:34.909 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-08T17:52:35.013 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-08T17:52:35.033 INFO:teuthology.orchestra.run.smithi080.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-08T17:52:35.365 INFO:teuthology.orchestra.run.smithi080.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-08T17:52:35.959 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-08T17:52:35.959 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-08T17:52:35.960 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-08T17:52:36.100 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-08T17:52:36.124 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-08T17:52:36.500 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 113 MB in 2s (63.6 MB/s) 2024-05-08T17:52:36.692 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-08T17:52:37.537 INFO:teuthology.orchestra.run.smithi080.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-08T17:52:37.537 INFO:teuthology.orchestra.run.smithi080.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-08T17:52:37.537 INFO:teuthology.orchestra.run.smithi080.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-08T17:52:37.901 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-08T17:52:37.981 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-08T17:52:38.380 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 113 MB in 5s (24.7 MB/s) 2024-05-08T17:52:38.554 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-08T17:52:38.731 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-08T17:52:38.735 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:52:38.831 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:52:40.618 INFO:teuthology.orchestra.run.smithi080.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-08T17:52:40.623 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:52:40.684 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:52:41.116 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-08T17:52:41.137 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:52:41.378 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:52:41.960 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-08T17:52:41.981 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:52:42.010 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:52:42.994 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-08T17:52:43.015 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:52:43.118 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:52:43.597 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-08T17:52:43.618 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:52:43.655 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:52:48.370 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T17:52:48.487 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T17:52:48.844 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T17:52:48.974 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T17:52:49.243 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-08T17:52:49.266 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-08T17:52:49.310 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T17:52:50.579 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T17:52:50.706 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T17:52:51.031 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T17:52:51.143 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T17:52:51.463 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-08T17:52:51.485 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-08T17:52:51.529 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T17:52:54.604 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-08T17:52:54.641 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:52:54.679 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:52:56.955 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-08T17:52:56.992 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:52:57.030 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:52:57.917 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T17:52:58.038 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T17:52:58.380 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T17:52:58.501 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:52:58.628 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-08T17:52:58.764 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:52:59.668 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T17:52:59.791 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T17:53:00.083 INFO:teuthology.orchestra.run.smithi115.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-08T17:53:00.083 INFO:teuthology.orchestra.run.smithi115.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-08T17:53:00.084 INFO:teuthology.orchestra.run.smithi115.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-08T17:53:00.084 INFO:teuthology.orchestra.run.smithi115.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-08T17:53:00.149 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T17:53:00.241 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:53:00.270 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:53:00.388 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-08T17:53:00.508 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:53:01.849 INFO:teuthology.orchestra.run.smithi080.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-08T17:53:01.849 INFO:teuthology.orchestra.run.smithi080.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-08T17:53:01.850 INFO:teuthology.orchestra.run.smithi080.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-08T17:53:01.850 INFO:teuthology.orchestra.run.smithi080.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-08T17:53:01.942 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:53:02.018 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:53:03.352 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-08T17:53:03.428 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:53:03.477 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-08T17:53:03.587 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:53:03.638 INFO:teuthology.orchestra.run.smithi115.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-08T17:53:03.638 INFO:teuthology.orchestra.run.smithi115.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-08T17:53:05.388 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-08T17:53:05.514 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-08T17:53:05.640 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:53:05.707 INFO:teuthology.orchestra.run.smithi080.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-08T17:53:05.707 INFO:teuthology.orchestra.run.smithi080.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-08T17:53:17.864 INFO:teuthology.orchestra.run.smithi115.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-08T17:53:17.865 INFO:teuthology.orchestra.run.smithi115.stdout:Sourcing file `/etc/default/grub' 2024-05-08T17:53:17.883 INFO:teuthology.orchestra.run.smithi115.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T17:53:17.906 INFO:teuthology.orchestra.run.smithi115.stdout:Generating grub configuration file ... 2024-05-08T17:53:18.244 INFO:teuthology.orchestra.run.smithi115.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T17:53:18.263 INFO:teuthology.orchestra.run.smithi115.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T17:53:18.547 INFO:teuthology.orchestra.run.smithi115.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T17:53:18.553 INFO:teuthology.orchestra.run.smithi115.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T17:53:18.625 INFO:teuthology.orchestra.run.smithi115.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T17:53:18.631 INFO:teuthology.orchestra.run.smithi115.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T17:53:18.775 INFO:teuthology.orchestra.run.smithi115.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T17:53:18.775 INFO:teuthology.orchestra.run.smithi115.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T17:53:18.775 INFO:teuthology.orchestra.run.smithi115.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T17:53:18.817 INFO:teuthology.orchestra.run.smithi115.stdout:done 2024-05-08T17:53:19.264 DEBUG:teuthology.orchestra.run.smithi115:> dpkg -s linux-image-generic 2024-05-08T17:53:19.291 INFO:teuthology.orchestra.run.smithi115.stdout:Package: linux-image-generic 2024-05-08T17:53:19.292 INFO:teuthology.orchestra.run.smithi115.stdout:Status: install ok installed 2024-05-08T17:53:19.292 INFO:teuthology.orchestra.run.smithi115.stdout:Priority: optional 2024-05-08T17:53:19.292 INFO:teuthology.orchestra.run.smithi115.stdout:Section: kernel 2024-05-08T17:53:19.292 INFO:teuthology.orchestra.run.smithi115.stdout:Installed-Size: 21 2024-05-08T17:53:19.292 INFO:teuthology.orchestra.run.smithi115.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T17:53:19.292 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: amd64 2024-05-08T17:53:19.292 INFO:teuthology.orchestra.run.smithi115.stdout:Source: linux-meta 2024-05-08T17:53:19.292 INFO:teuthology.orchestra.run.smithi115.stdout:Version: 5.15.0.106.106 2024-05-08T17:53:19.292 INFO:teuthology.orchestra.run.smithi115.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T17:53:19.292 INFO:teuthology.orchestra.run.smithi115.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T17:53:19.292 INFO:teuthology.orchestra.run.smithi115.stdout:Recommends: thermald 2024-05-08T17:53:19.292 INFO:teuthology.orchestra.run.smithi115.stdout:Description: Generic Linux kernel image 2024-05-08T17:53:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: This package will always depend on the latest generic kernel image 2024-05-08T17:53:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: available. 2024-05-08T17:53:19.293 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-08T17:53:19.293 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T17:53:19.293 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T17:53:19.293 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-08T17:53:19.293 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi115.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T17:53:19.293 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get clean 2024-05-08T17:53:19.464 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get update 2024-05-08T17:53:19.586 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T17:53:19.586 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T17:53:19.602 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T17:53:19.623 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T17:53:19.832 INFO:teuthology.orchestra.run.smithi080.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-08T17:53:19.832 INFO:teuthology.orchestra.run.smithi080.stdout:Sourcing file `/etc/default/grub' 2024-05-08T17:53:19.849 INFO:teuthology.orchestra.run.smithi080.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T17:53:19.867 INFO:teuthology.orchestra.run.smithi080.stdout:Generating grub configuration file ... 2024-05-08T17:53:20.144 INFO:teuthology.orchestra.run.smithi080.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T17:53:20.157 INFO:teuthology.orchestra.run.smithi080.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T17:53:20.509 INFO:teuthology.orchestra.run.smithi080.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T17:53:20.514 INFO:teuthology.orchestra.run.smithi080.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T17:53:20.590 INFO:teuthology.orchestra.run.smithi080.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T17:53:20.595 INFO:teuthology.orchestra.run.smithi080.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T17:53:20.751 INFO:teuthology.orchestra.run.smithi080.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T17:53:20.751 INFO:teuthology.orchestra.run.smithi080.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T17:53:20.752 INFO:teuthology.orchestra.run.smithi080.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T17:53:20.794 INFO:teuthology.orchestra.run.smithi080.stdout:done 2024-05-08T17:53:20.952 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-05-08T17:53:20.968 DEBUG:teuthology.orchestra.run.smithi115:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T17:53:21.027 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-05-08T17:53:21.230 INFO:teuthology.orchestra.run.smithi115.stdout:Building dependency tree... 2024-05-08T17:53:21.230 INFO:teuthology.orchestra.run.smithi115.stdout:Reading state information... 2024-05-08T17:53:21.264 DEBUG:teuthology.orchestra.run.smithi080:> dpkg -s linux-image-generic 2024-05-08T17:53:21.284 INFO:teuthology.orchestra.run.smithi080.stdout:Package: linux-image-generic 2024-05-08T17:53:21.284 INFO:teuthology.orchestra.run.smithi080.stdout:Status: install ok installed 2024-05-08T17:53:21.284 INFO:teuthology.orchestra.run.smithi080.stdout:Priority: optional 2024-05-08T17:53:21.284 INFO:teuthology.orchestra.run.smithi080.stdout:Section: kernel 2024-05-08T17:53:21.284 INFO:teuthology.orchestra.run.smithi080.stdout:Installed-Size: 21 2024-05-08T17:53:21.284 INFO:teuthology.orchestra.run.smithi080.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T17:53:21.284 INFO:teuthology.orchestra.run.smithi080.stdout:Architecture: amd64 2024-05-08T17:53:21.284 INFO:teuthology.orchestra.run.smithi080.stdout:Source: linux-meta 2024-05-08T17:53:21.284 INFO:teuthology.orchestra.run.smithi080.stdout:Version: 5.15.0.106.106 2024-05-08T17:53:21.284 INFO:teuthology.orchestra.run.smithi080.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T17:53:21.284 INFO:teuthology.orchestra.run.smithi080.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T17:53:21.284 INFO:teuthology.orchestra.run.smithi080.stdout:Recommends: thermald 2024-05-08T17:53:21.285 INFO:teuthology.orchestra.run.smithi080.stdout:Description: Generic Linux kernel image 2024-05-08T17:53:21.285 INFO:teuthology.orchestra.run.smithi080.stdout: This package will always depend on the latest generic kernel image 2024-05-08T17:53:21.285 INFO:teuthology.orchestra.run.smithi080.stdout: available. 2024-05-08T17:53:21.285 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-08T17:53:21.285 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T17:53:21.285 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T17:53:21.285 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-08T17:53:21.285 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi080.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T17:53:21.285 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get clean 2024-05-08T17:53:21.404 INFO:teuthology.orchestra.run.smithi115.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-08T17:53:21.404 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T17:53:21.405 INFO:teuthology.orchestra.run.smithi115.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T17:53:21.405 INFO:teuthology.orchestra.run.smithi115.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T17:53:21.405 INFO:teuthology.orchestra.run.smithi115.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T17:53:21.405 INFO:teuthology.orchestra.run.smithi115.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T17:53:21.405 INFO:teuthology.orchestra.run.smithi115.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T17:53:21.405 INFO:teuthology.orchestra.run.smithi115.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T17:53:21.444 INFO:teuthology.orchestra.run.smithi115.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T17:53:21.446 DEBUG:teuthology.orchestra.run.smithi115:> dpkg -s linux-image-generic 2024-05-08T17:53:21.462 INFO:teuthology.orchestra.run.smithi115.stdout:Package: linux-image-generic 2024-05-08T17:53:21.462 INFO:teuthology.orchestra.run.smithi115.stdout:Status: install ok installed 2024-05-08T17:53:21.462 INFO:teuthology.orchestra.run.smithi115.stdout:Priority: optional 2024-05-08T17:53:21.462 INFO:teuthology.orchestra.run.smithi115.stdout:Section: kernel 2024-05-08T17:53:21.462 INFO:teuthology.orchestra.run.smithi115.stdout:Installed-Size: 21 2024-05-08T17:53:21.462 INFO:teuthology.orchestra.run.smithi115.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T17:53:21.462 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: amd64 2024-05-08T17:53:21.462 INFO:teuthology.orchestra.run.smithi115.stdout:Source: linux-meta 2024-05-08T17:53:21.463 INFO:teuthology.orchestra.run.smithi115.stdout:Version: 5.15.0.106.106 2024-05-08T17:53:21.463 INFO:teuthology.orchestra.run.smithi115.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T17:53:21.463 INFO:teuthology.orchestra.run.smithi115.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T17:53:21.463 INFO:teuthology.orchestra.run.smithi115.stdout:Recommends: thermald 2024-05-08T17:53:21.463 INFO:teuthology.orchestra.run.smithi115.stdout:Description: Generic Linux kernel image 2024-05-08T17:53:21.463 INFO:teuthology.orchestra.run.smithi115.stdout: This package will always depend on the latest generic kernel image 2024-05-08T17:53:21.463 INFO:teuthology.orchestra.run.smithi115.stdout: available. 2024-05-08T17:53:21.463 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-05-08T17:53:21.471 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get update 2024-05-08T17:53:21.508 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.cejfuuRWfe 2024-05-08T17:53:21.509 DEBUG:teuthology.orchestra.run.smithi115:> sudo cp /boot/grub/grub.cfg /tmp/tmp.cejfuuRWfe 2024-05-08T17:53:21.574 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.cejfuuRWfe 2024-05-08T17:53:21.663 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T17:53:21.695 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.cejfuuRWfe is 10KB 2024-05-08T17:53:21.707 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.cejfuuRWfe 2024-05-08T17:53:21.712 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-08T17:53:21.744 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T17:53:21.764 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T17:53:21.764 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-08T17:53:21.764 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-08T17:53:21.826 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T17:53:21.830 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-08T17:53:21.830 DEBUG:teuthology.orchestra.run.smithi115:> sudo update-grub 2024-05-08T17:53:21.911 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T17:53:23.035 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-05-08T17:53:23.043 INFO:teuthology.orchestra.run.smithi115.stderr:Sourcing file `/etc/default/grub' 2024-05-08T17:53:23.044 INFO:teuthology.orchestra.run.smithi115.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T17:53:23.046 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2024-05-08T17:53:23.053 DEBUG:teuthology.orchestra.run.smithi080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T17:53:23.114 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-05-08T17:53:23.286 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T17:53:23.292 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T17:53:23.315 INFO:teuthology.orchestra.run.smithi080.stdout:Building dependency tree... 2024-05-08T17:53:23.315 INFO:teuthology.orchestra.run.smithi080.stdout:Reading state information... 2024-05-08T17:53:23.493 INFO:teuthology.orchestra.run.smithi080.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-08T17:53:23.493 INFO:teuthology.orchestra.run.smithi080.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T17:53:23.493 INFO:teuthology.orchestra.run.smithi080.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T17:53:23.493 INFO:teuthology.orchestra.run.smithi080.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T17:53:23.493 INFO:teuthology.orchestra.run.smithi080.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T17:53:23.494 INFO:teuthology.orchestra.run.smithi080.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T17:53:23.494 INFO:teuthology.orchestra.run.smithi080.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T17:53:23.494 INFO:teuthology.orchestra.run.smithi080.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T17:53:23.528 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T17:53:23.533 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T17:53:23.534 INFO:teuthology.orchestra.run.smithi080.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T17:53:23.536 DEBUG:teuthology.orchestra.run.smithi080:> dpkg -s linux-image-generic 2024-05-08T17:53:23.552 INFO:teuthology.orchestra.run.smithi080.stdout:Package: linux-image-generic 2024-05-08T17:53:23.552 INFO:teuthology.orchestra.run.smithi080.stdout:Status: install ok installed 2024-05-08T17:53:23.552 INFO:teuthology.orchestra.run.smithi080.stdout:Priority: optional 2024-05-08T17:53:23.552 INFO:teuthology.orchestra.run.smithi080.stdout:Section: kernel 2024-05-08T17:53:23.552 INFO:teuthology.orchestra.run.smithi080.stdout:Installed-Size: 21 2024-05-08T17:53:23.552 INFO:teuthology.orchestra.run.smithi080.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T17:53:23.552 INFO:teuthology.orchestra.run.smithi080.stdout:Architecture: amd64 2024-05-08T17:53:23.552 INFO:teuthology.orchestra.run.smithi080.stdout:Source: linux-meta 2024-05-08T17:53:23.552 INFO:teuthology.orchestra.run.smithi080.stdout:Version: 5.15.0.106.106 2024-05-08T17:53:23.552 INFO:teuthology.orchestra.run.smithi080.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T17:53:23.552 INFO:teuthology.orchestra.run.smithi080.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T17:53:23.552 INFO:teuthology.orchestra.run.smithi080.stdout:Recommends: thermald 2024-05-08T17:53:23.552 INFO:teuthology.orchestra.run.smithi080.stdout:Description: Generic Linux kernel image 2024-05-08T17:53:23.553 INFO:teuthology.orchestra.run.smithi080.stdout: This package will always depend on the latest generic kernel image 2024-05-08T17:53:23.553 INFO:teuthology.orchestra.run.smithi080.stdout: available. 2024-05-08T17:53:23.553 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-05-08T17:53:23.575 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T17:53:23.580 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T17:53:23.600 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.mJgXDcIMjt 2024-05-08T17:53:23.600 DEBUG:teuthology.orchestra.run.smithi080:> sudo cp /boot/grub/grub.cfg /tmp/tmp.mJgXDcIMjt 2024-05-08T17:53:23.655 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.mJgXDcIMjt 2024-05-08T17:53:23.696 INFO:teuthology.orchestra.run.smithi115.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T17:53:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T17:53:23.697 INFO:teuthology.orchestra.run.smithi115.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T17:53:23.710 INFO:teuthology.orchestra.run.smithi115.stderr:done 2024-05-08T17:53:23.713 DEBUG:teuthology.orchestra.run.smithi115:> sudo shutdown -r now 2024-05-08T17:53:23.776 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.mJgXDcIMjt is 10KB 2024-05-08T17:53:23.789 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.mJgXDcIMjt 2024-05-08T17:53:23.794 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-08T17:53:23.851 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T17:53:23.852 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-08T17:53:23.852 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-08T17:53:23.915 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-08T17:53:23.915 DEBUG:teuthology.orchestra.run.smithi080:> sudo update-grub 2024-05-08T17:53:25.131 INFO:teuthology.orchestra.run.smithi080.stderr:Sourcing file `/etc/default/grub' 2024-05-08T17:53:25.132 INFO:teuthology.orchestra.run.smithi080.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T17:53:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:Generating grub configuration file ... 2024-05-08T17:53:25.318 INFO:teuthology.orchestra.run.smithi080.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T17:53:25.323 INFO:teuthology.orchestra.run.smithi080.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T17:53:25.562 INFO:teuthology.orchestra.run.smithi080.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T17:53:25.568 INFO:teuthology.orchestra.run.smithi080.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T17:53:25.611 INFO:teuthology.orchestra.run.smithi080.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T17:53:25.616 INFO:teuthology.orchestra.run.smithi080.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T17:53:25.742 INFO:teuthology.orchestra.run.smithi080.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T17:53:25.742 INFO:teuthology.orchestra.run.smithi080.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T17:53:25.742 INFO:teuthology.orchestra.run.smithi080.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T17:53:25.758 INFO:teuthology.orchestra.run.smithi080.stderr:done 2024-05-08T17:53:25.771 DEBUG:teuthology.orchestra.run.smithi080:> sudo shutdown -r now 2024-05-08T17:53:53.742 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-08T17:53:53.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-08T17:53:53.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:53:55.774 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-08T17:53:55.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-08T17:53:55.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:54:12.127 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-05-08T17:54:14.174 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-05-08T17:54:21.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-08T17:54:21.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:54:23.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-08T17:54:23.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:54:24.190 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-05-08T17:54:26.238 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-05-08T17:54:36.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-08T17:54:36.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:54:38.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-08T17:54:38.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:54:54.622 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-05-08T17:54:56.670 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-05-08T17:55:09.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-08T17:55:09.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:55:10.609 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-05-08T17:55:11.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-08T17:55:11.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:55:11.900 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-05-08T17:55:12.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-08T17:55:12.483 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-106-generic"... 2024-05-08T17:55:12.483 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-05-08T17:55:12.529 INFO:teuthology.orchestra.run.smithi080.stdout:5.15.0-106-generic 2024-05-08T17:55:12.530 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-08T17:55:12.530 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T17:55:12.530 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-08T17:55:13.531 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-08T17:55:13.531 DEBUG:teuthology.orchestra.run.smithi080:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T17:55:13.845 INFO:teuthology.orchestra.run.smithi080.stdout:ttyS1 2024-05-08T17:55:13.875 DEBUG:teuthology.parallel:result is None 2024-05-08T17:55:28.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-08T17:55:28.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:55:28.903 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-05-08T17:55:29.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-08T17:55:29.432 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-106-generic"... 2024-05-08T17:55:29.433 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-05-08T17:55:29.479 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-106-generic 2024-05-08T17:55:29.479 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-08T17:55:29.479 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T17:55:29.479 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-08T17:55:30.480 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-08T17:55:30.480 DEBUG:teuthology.orchestra.run.smithi115:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T17:55:30.844 INFO:teuthology.orchestra.run.smithi115.stdout:ttyS1 2024-05-08T17:55:30.876 DEBUG:teuthology.parallel:result is None 2024-05-08T17:55:30.877 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T17:55:30.883 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T17:55:30.883 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T17:55:30.886 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T17:55:30.891 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T17:55:30.897 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T17:55:30.906 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T17:55:30.906 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T17:55:30.934 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T17:55:30.986 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T17:55:30.992 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T17:55:30.993 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T17:55:30.995 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T17:55:31.014 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:55:31.023 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:55:31.036 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:55:31.044 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:55:31.046 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T17:55:31.053 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T17:55:31.053 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T17:55:31.071 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T17:55:31.098 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T17:55:31.108 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T17:55:31.108 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T17:55:31.126 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T17:55:31.147 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T17:55:31.177 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T17:55:31.226 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T17:55:31.226 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T17:55:31.284 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T17:55:31.290 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T17:55:31.335 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T17:55:31.335 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T17:55:31.402 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2024-05-08T17:55:31.407 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2024-05-08T17:55:31.488 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T17:55:31.495 INFO:teuthology.task.internal:Starting timer... 2024-05-08T17:55:31.496 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T17:55:31.507 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T17:55:31.585 DEBUG:teuthology.task.selinux:Excluding smithi080: OS 'ubuntu' does not support SELinux 2024-05-08T17:55:31.585 DEBUG:teuthology.task.selinux:Excluding smithi115: OS 'ubuntu' does not support SELinux 2024-05-08T17:55:31.586 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T17:55:31.586 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-08T17:55:31.586 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T17:55:31.586 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T17:55:31.595 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T17:55:31.620 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T17:55:31.621 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi080.front.sepia.ceph.com,smithi115.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T18:03:52.146 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi080.front.sepia.ceph.com'), Remote(name='ubuntu@smithi115.front.sepia.ceph.com')] 2024-05-08T18:03:52.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-08T18:03:52.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:03:52.232 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-05-08T18:03:52.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-08T18:03:52.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-08T18:03:52.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:03:52.387 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-05-08T18:03:52.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-08T18:03:52.466 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T18:03:52.478 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T18:03:52.478 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T18:03:52.478 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:03:52.481 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T18:03:52.481 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:03:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-08T18:03:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: Command line: ntpd -gq 2024-05-08T18:03:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: ---------------------------------------------------- 2024-05-08T18:03:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: ntp-4 is maintained by Network Time Foundation, 2024-05-08T18:03:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-08T18:03:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: corporation. Support and training for ntp-4 are 2024-05-08T18:03:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: available at https://www.nwtime.org/support 2024-05-08T18:03:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: ---------------------------------------------------- 2024-05-08T18:03:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: proto: precision = 0.045 usec (-24) 2024-05-08T18:03:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: basedate set to 2022-02-04 2024-05-08T18:03:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: gps base set to 2022-02-06 (week 2196) 2024-05-08T18:03:52.508 INFO:teuthology.orchestra.run.smithi080.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T18:03:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T18:03:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: restrict ::: KOD does nothing without LIMITED. 2024-05-08T18:03:52.508 INFO:teuthology.orchestra.run.smithi080.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-08T18:03:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: Listen and drop on 0 v6wildcard [::]:123 2024-05-08T18:03:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-08T18:03:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: Listen normally on 2 lo 127.0.0.1:123 2024-05-08T18:03:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: Listen normally on 3 enp3s0f1 172.21.15.80:123 2024-05-08T18:03:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: Listen normally on 4 lo [::1]:123 2024-05-08T18:03:52.510 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cba9%5]:123 2024-05-08T18:03:52.510 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:03:52 ntpd[17263]: Listening on routing socket on fd #22 for interface updates 2024-05-08T18:03:52.537 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-08T18:03:52.537 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: Command line: ntpd -gq 2024-05-08T18:03:52.537 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: ---------------------------------------------------- 2024-05-08T18:03:52.537 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: ntp-4 is maintained by Network Time Foundation, 2024-05-08T18:03:52.537 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-08T18:03:52.537 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: corporation. Support and training for ntp-4 are 2024-05-08T18:03:52.537 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: available at https://www.nwtime.org/support 2024-05-08T18:03:52.537 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: ---------------------------------------------------- 2024-05-08T18:03:52.538 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: proto: precision = 0.059 usec (-24) 2024-05-08T18:03:52.538 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: basedate set to 2022-02-04 2024-05-08T18:03:52.538 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: gps base set to 2022-02-06 (week 2196) 2024-05-08T18:03:52.538 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T18:03:52.538 INFO:teuthology.orchestra.run.smithi115.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T18:03:52.539 INFO:teuthology.orchestra.run.smithi115.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-08T18:03:52.539 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: restrict ::: KOD does nothing without LIMITED. 2024-05-08T18:03:52.540 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: Listen and drop on 0 v6wildcard [::]:123 2024-05-08T18:03:52.540 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-08T18:03:52.540 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: Listen normally on 2 lo 127.0.0.1:123 2024-05-08T18:03:52.540 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: Listen normally on 3 enp3s0f1 172.21.15.115:123 2024-05-08T18:03:52.540 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: Listen normally on 4 lo [::1]:123 2024-05-08T18:03:52.540 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce8f%5]:123 2024-05-08T18:03:52.540 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:03:52 ntpd[17266]: Listening on routing socket on fd #22 for interface updates 2024-05-08T18:03:54.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:54 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:54.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:54 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:54.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:54 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:54.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:54 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:54.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:54 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:03:54.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:54 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:03:54.538 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:54 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:54.538 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:54 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:54.538 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:54 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:54.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:54 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:54.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:54 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:54.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:54 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:54.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:54 ntpd[17266]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:03:54.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:54 ntpd[17266]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:03:54.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:54 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:54.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:54 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:54.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:54 ntpd[17266]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:03:54.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:54 ntpd[17266]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:03:55.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:55 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:55.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:55 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:55.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:55 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:55.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:55 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:55.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:55 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:55.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:55 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:55.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:55 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:03:55.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:55 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:03:56.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:56 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:56.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:56 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:56.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:56 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:56.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:56 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:56.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:56 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:56.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:56 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:56.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:56 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:03:56.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:56 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:03:56.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:56 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:56.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:56 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:56.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:56 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:03:56.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:56 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:03:56.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:56.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:56.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:56.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:56.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:56.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:56.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:56.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:56.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:03:56.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:03:56.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:56.540 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:56.540 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:03:56.540 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:03:56.540 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:56.540 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:56.540 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:03:56.540 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:56 ntpd[17266]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:03:57.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:57 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:57.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:57 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:57.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:57 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:57.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:57 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:57.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:57 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:03:57.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:57 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:03:57.537 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:57 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:57.537 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:57 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:58.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:58 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:58.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:58 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:58.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:58 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:58.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:58 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:58.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:58 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:58.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:58 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:58.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:58 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:03:58.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:58 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:03:58.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:58 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:58.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:58 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:58.509 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:58 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:03:58.509 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:58 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:03:58.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:58.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:58.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:58.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:58.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:58.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:58.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:58.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:58.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:03:58.540 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:03:58.540 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:58.540 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:58.540 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:03:58.540 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:03:58.540 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:58.540 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:58.540 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:03:58.540 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:03:58 ntpd[17266]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:03:59.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:59 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:59.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:59 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:59.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:59 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:03:59.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:59 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:03:59.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:59 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:03:59.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:03:59 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:04:00.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:04:00 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:04:00.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:04:00 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:04:00.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:04:00 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:04:00.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:04:00 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:04:00.507 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:04:00 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:04:00.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:04:00 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:04:00.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:04:00 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:04:00.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:04:00 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:04:00.508 INFO:teuthology.orchestra.run.smithi080.stdout: 8 May 18:04:00 ntpd[17263]: ntpd: time slew -0.001114 s 2024-05-08T18:04:00.508 INFO:teuthology.orchestra.run.smithi080.stdout:ntpd: time slew -0.001114s 2024-05-08T18:04:00.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:04:00 ntpd[17263]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-08T18:04:00.508 INFO:teuthology.orchestra.run.smithi080.stderr: 8 May 18:04:00 ntpd[17263]: can't open /var/log/ntpstats/loopstats.20240508: Permission denied 2024-05-08T18:04:00.538 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:04:00 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:04:00.538 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:04:00 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:04:00.538 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:04:00 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:04:00.538 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:04:00 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:04:00.538 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:04:00 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:04:00.538 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:04:00 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:04:00.538 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:04:00 ntpd[17266]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:04:00.538 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:04:00 ntpd[17266]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:04:00.538 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:04:00 ntpd[17266]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:04:00.538 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:04:00 ntpd[17266]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:04:00.539 INFO:teuthology.orchestra.run.smithi115.stdout: 8 May 18:04:00 ntpd[17266]: ntpd: time slew -0.003722 s 2024-05-08T18:04:00.539 INFO:teuthology.orchestra.run.smithi115.stdout:ntpd: time slew -0.003722s 2024-05-08T18:04:00.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:04:00 ntpd[17266]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-08T18:04:00.539 INFO:teuthology.orchestra.run.smithi115.stderr: 8 May 18:04:00 ntpd[17266]: can't open /var/log/ntpstats/loopstats.20240508: Permission denied 2024-05-08T18:04:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T18:04:00.556 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================== 2024-05-08T18:04:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:04:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:04:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:04:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:04:00.684 INFO:teuthology.orchestra.run.smithi115.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T18:04:00.684 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================== 2024-05-08T18:04:00.684 INFO:teuthology.orchestra.run.smithi115.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:04:00.684 INFO:teuthology.orchestra.run.smithi115.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:04:00.685 INFO:teuthology.orchestra.run.smithi115.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:04:00.685 INFO:teuthology.orchestra.run.smithi115.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:04:00.685 INFO:teuthology.run_tasks:Running task install... 2024-05-08T18:04:00.695 DEBUG:teuthology.task.install:project ceph 2024-05-08T18:04:00.695 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}} 2024-05-08T18:04:00.695 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'} 2024-05-08T18:04:00.695 INFO:teuthology.task.install:Using flavor: default 2024-05-08T18:04:00.701 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T18:04:00.701 INFO:teuthology.task.install:extra packages: [] 2024-05-08T18:04:00.702 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-key list | grep Ceph 2024-05-08T18:04:00.703 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-key list | grep Ceph 2024-05-08T18:04:00.768 INFO:teuthology.orchestra.run.smithi080.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-08T18:04:00.786 INFO:teuthology.orchestra.run.smithi115.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-08T18:04:00.802 INFO:teuthology.orchestra.run.smithi080.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-08T18:04:00.803 INFO:teuthology.orchestra.run.smithi080.stdout:uid [ unknown] Ceph.com (release key) 2024-05-08T18:04:00.803 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-08T18:04:00.803 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:04:00.817 INFO:teuthology.orchestra.run.smithi115.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-08T18:04:00.817 INFO:teuthology.orchestra.run.smithi115.stdout:uid [ unknown] Ceph.com (release key) 2024-05-08T18:04:00.817 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-08T18:04:00.817 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:04:00.944 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default/ 2024-05-08T18:04:00.944 INFO:teuthology.task.install.deb:Package version is 19.0.0-3525-g27d37168-1jammy 2024-05-08T18:04:00.957 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default/ 2024-05-08T18:04:00.957 INFO:teuthology.task.install.deb:Package version is 19.0.0-3525-g27d37168-1jammy 2024-05-08T18:04:01.236 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:04:01.236 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-08T18:04:01.250 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get update 2024-05-08T18:04:01.354 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:04:01.354 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-08T18:04:01.368 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get update 2024-05-08T18:04:01.470 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T18:04:01.470 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T18:04:01.500 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T18:04:01.538 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T18:04:01.583 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T18:04:01.642 INFO:teuthology.orchestra.run.smithi115.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy InRelease 2024-05-08T18:04:01.666 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T18:04:01.708 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-08T18:04:01.749 INFO:teuthology.orchestra.run.smithi080.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-08T18:04:01.765 INFO:teuthology.orchestra.run.smithi080.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy InRelease 2024-05-08T18:04:01.774 INFO:teuthology.orchestra.run.smithi115.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-08T18:04:01.831 INFO:teuthology.orchestra.run.smithi080.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-08T18:04:01.840 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-05-08T18:04:01.901 INFO:teuthology.orchestra.run.smithi080.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-08T18:04:01.917 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-05-08T18:04:01.963 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-05-08T18:04:02.010 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 29.3 kB in 1s (52.2 kB/s) 2024-05-08T18:04:02.040 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-05-08T18:04:02.100 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T18:04:02.251 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 148 kB in 1s (211 kB/s) 2024-05-08T18:04:02.994 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-05-08T18:04:03.010 DEBUG:teuthology.orchestra.run.smithi115:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3525-g27d37168-1jammy cephadm=19.0.0-3525-g27d37168-1jammy ceph-mds=19.0.0-3525-g27d37168-1jammy ceph-mgr=19.0.0-3525-g27d37168-1jammy ceph-common=19.0.0-3525-g27d37168-1jammy ceph-fuse=19.0.0-3525-g27d37168-1jammy ceph-test=19.0.0-3525-g27d37168-1jammy ceph-volume=19.0.0-3525-g27d37168-1jammy radosgw=19.0.0-3525-g27d37168-1jammy python3-rados=19.0.0-3525-g27d37168-1jammy python3-rgw=19.0.0-3525-g27d37168-1jammy python3-cephfs=19.0.0-3525-g27d37168-1jammy python3-rbd=19.0.0-3525-g27d37168-1jammy libcephfs2=19.0.0-3525-g27d37168-1jammy libcephfs-dev=19.0.0-3525-g27d37168-1jammy librados2=19.0.0-3525-g27d37168-1jammy librbd1=19.0.0-3525-g27d37168-1jammy rbd-fuse=19.0.0-3525-g27d37168-1jammy 2024-05-08T18:04:03.062 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-05-08T18:04:03.218 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-05-08T18:04:03.235 DEBUG:teuthology.orchestra.run.smithi080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3525-g27d37168-1jammy cephadm=19.0.0-3525-g27d37168-1jammy ceph-mds=19.0.0-3525-g27d37168-1jammy ceph-mgr=19.0.0-3525-g27d37168-1jammy ceph-common=19.0.0-3525-g27d37168-1jammy ceph-fuse=19.0.0-3525-g27d37168-1jammy ceph-test=19.0.0-3525-g27d37168-1jammy ceph-volume=19.0.0-3525-g27d37168-1jammy radosgw=19.0.0-3525-g27d37168-1jammy python3-rados=19.0.0-3525-g27d37168-1jammy python3-rgw=19.0.0-3525-g27d37168-1jammy python3-cephfs=19.0.0-3525-g27d37168-1jammy python3-rbd=19.0.0-3525-g27d37168-1jammy libcephfs2=19.0.0-3525-g27d37168-1jammy libcephfs-dev=19.0.0-3525-g27d37168-1jammy librados2=19.0.0-3525-g27d37168-1jammy librbd1=19.0.0-3525-g27d37168-1jammy rbd-fuse=19.0.0-3525-g27d37168-1jammy 2024-05-08T18:04:03.238 INFO:teuthology.orchestra.run.smithi115.stdout:Building dependency tree... 2024-05-08T18:04:03.239 INFO:teuthology.orchestra.run.smithi115.stdout:Reading state information... 2024-05-08T18:04:03.295 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-05-08T18:04:03.410 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T18:04:03.410 INFO:teuthology.orchestra.run.smithi115.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T18:04:03.410 INFO:teuthology.orchestra.run.smithi115.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T18:04:03.410 INFO:teuthology.orchestra.run.smithi115.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T18:04:03.410 INFO:teuthology.orchestra.run.smithi115.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T18:04:03.411 INFO:teuthology.orchestra.run.smithi115.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T18:04:03.411 INFO:teuthology.orchestra.run.smithi115.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T18:04:03.411 INFO:teuthology.orchestra.run.smithi115.stdout:The following additional packages will be installed: 2024-05-08T18:04:03.411 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-08T18:04:03.411 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-08T18:04:03.412 INFO:teuthology.orchestra.run.smithi115.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-08T18:04:03.412 INFO:teuthology.orchestra.run.smithi115.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-08T18:04:03.413 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-08T18:04:03.413 INFO:teuthology.orchestra.run.smithi115.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-08T18:04:03.413 INFO:teuthology.orchestra.run.smithi115.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-08T18:04:03.413 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-08T18:04:03.413 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-08T18:04:03.413 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-08T18:04:03.413 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-08T18:04:03.413 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-08T18:04:03.413 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-08T18:04:03.413 INFO:teuthology.orchestra.run.smithi115.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-08T18:04:03.413 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-08T18:04:03.413 INFO:teuthology.orchestra.run.smithi115.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-08T18:04:03.414 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-08T18:04:03.414 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-08T18:04:03.414 INFO:teuthology.orchestra.run.smithi115.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-08T18:04:03.414 INFO:teuthology.orchestra.run.smithi115.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-08T18:04:03.414 INFO:teuthology.orchestra.run.smithi115.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-08T18:04:03.414 INFO:teuthology.orchestra.run.smithi115.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-08T18:04:03.414 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-08T18:04:03.414 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet zip 2024-05-08T18:04:03.414 INFO:teuthology.orchestra.run.smithi115.stdout:Suggested packages: 2024-05-08T18:04:03.415 INFO:teuthology.orchestra.run.smithi115.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-08T18:04:03.415 INFO:teuthology.orchestra.run.smithi115.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-08T18:04:03.415 INFO:teuthology.orchestra.run.smithi115.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-08T18:04:03.415 INFO:teuthology.orchestra.run.smithi115.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-08T18:04:03.415 INFO:teuthology.orchestra.run.smithi115.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-08T18:04:03.415 INFO:teuthology.orchestra.run.smithi115.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-08T18:04:03.415 INFO:teuthology.orchestra.run.smithi115.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-08T18:04:03.415 INFO:teuthology.orchestra.run.smithi115.stdout:Recommended packages: 2024-05-08T18:04:03.415 INFO:teuthology.orchestra.run.smithi115.stdout: btrfs-tools 2024-05-08T18:04:03.496 INFO:teuthology.orchestra.run.smithi080.stdout:Building dependency tree... 2024-05-08T18:04:03.496 INFO:teuthology.orchestra.run.smithi080.stdout:Reading state information... 2024-05-08T18:04:03.513 INFO:teuthology.orchestra.run.smithi115.stdout:The following NEW packages will be installed: 2024-05-08T18:04:03.514 INFO:teuthology.orchestra.run.smithi115.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-08T18:04:03.514 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-08T18:04:03.514 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-08T18:04:03.514 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-08T18:04:03.514 INFO:teuthology.orchestra.run.smithi115.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-08T18:04:03.514 INFO:teuthology.orchestra.run.smithi115.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-08T18:04:03.515 INFO:teuthology.orchestra.run.smithi115.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-08T18:04:03.515 INFO:teuthology.orchestra.run.smithi115.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-08T18:04:03.515 INFO:teuthology.orchestra.run.smithi115.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-08T18:04:03.515 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-08T18:04:03.515 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-08T18:04:03.515 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-08T18:04:03.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-08T18:04:03.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-08T18:04:03.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-08T18:04:03.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-08T18:04:03.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-08T18:04:03.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-08T18:04:03.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-08T18:04:03.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-08T18:04:03.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-08T18:04:03.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-08T18:04:03.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-08T18:04:03.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-08T18:04:03.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-08T18:04:03.516 INFO:teuthology.orchestra.run.smithi115.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-08T18:04:03.693 INFO:teuthology.orchestra.run.smithi080.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T18:04:03.693 INFO:teuthology.orchestra.run.smithi080.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T18:04:03.693 INFO:teuthology.orchestra.run.smithi080.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T18:04:03.693 INFO:teuthology.orchestra.run.smithi080.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T18:04:03.694 INFO:teuthology.orchestra.run.smithi080.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T18:04:03.694 INFO:teuthology.orchestra.run.smithi080.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T18:04:03.694 INFO:teuthology.orchestra.run.smithi080.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T18:04:03.695 INFO:teuthology.orchestra.run.smithi080.stdout:The following additional packages will be installed: 2024-05-08T18:04:03.695 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-08T18:04:03.695 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-08T18:04:03.695 INFO:teuthology.orchestra.run.smithi080.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-08T18:04:03.695 INFO:teuthology.orchestra.run.smithi080.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-08T18:04:03.696 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-08T18:04:03.696 INFO:teuthology.orchestra.run.smithi080.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-08T18:04:03.696 INFO:teuthology.orchestra.run.smithi080.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-08T18:04:03.696 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-08T18:04:03.696 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-08T18:04:03.697 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-08T18:04:03.697 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-08T18:04:03.697 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-08T18:04:03.697 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-08T18:04:03.697 INFO:teuthology.orchestra.run.smithi080.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-08T18:04:03.697 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-08T18:04:03.697 INFO:teuthology.orchestra.run.smithi080.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-08T18:04:03.697 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-08T18:04:03.697 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-08T18:04:03.697 INFO:teuthology.orchestra.run.smithi080.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-08T18:04:03.697 INFO:teuthology.orchestra.run.smithi080.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-08T18:04:03.697 INFO:teuthology.orchestra.run.smithi080.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-08T18:04:03.697 INFO:teuthology.orchestra.run.smithi080.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-08T18:04:03.698 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-08T18:04:03.698 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet zip 2024-05-08T18:04:03.698 INFO:teuthology.orchestra.run.smithi080.stdout:Suggested packages: 2024-05-08T18:04:03.698 INFO:teuthology.orchestra.run.smithi080.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-08T18:04:03.698 INFO:teuthology.orchestra.run.smithi080.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-08T18:04:03.698 INFO:teuthology.orchestra.run.smithi080.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-08T18:04:03.698 INFO:teuthology.orchestra.run.smithi080.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-08T18:04:03.698 INFO:teuthology.orchestra.run.smithi080.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-08T18:04:03.699 INFO:teuthology.orchestra.run.smithi080.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-08T18:04:03.699 INFO:teuthology.orchestra.run.smithi080.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-08T18:04:03.699 INFO:teuthology.orchestra.run.smithi080.stdout:Recommended packages: 2024-05-08T18:04:03.699 INFO:teuthology.orchestra.run.smithi080.stdout: btrfs-tools 2024-05-08T18:04:03.800 INFO:teuthology.orchestra.run.smithi080.stdout:The following NEW packages will be installed: 2024-05-08T18:04:03.800 INFO:teuthology.orchestra.run.smithi080.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-08T18:04:03.800 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-08T18:04:03.800 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-08T18:04:03.800 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-08T18:04:03.800 INFO:teuthology.orchestra.run.smithi080.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-08T18:04:03.801 INFO:teuthology.orchestra.run.smithi080.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-08T18:04:03.801 INFO:teuthology.orchestra.run.smithi080.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-08T18:04:03.801 INFO:teuthology.orchestra.run.smithi080.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-08T18:04:03.801 INFO:teuthology.orchestra.run.smithi080.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-08T18:04:03.801 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-08T18:04:03.801 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-08T18:04:03.801 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-08T18:04:03.801 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-08T18:04:03.801 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-08T18:04:03.801 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-08T18:04:03.801 INFO:teuthology.orchestra.run.smithi080.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-08T18:04:03.801 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-08T18:04:03.801 INFO:teuthology.orchestra.run.smithi080.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-08T18:04:03.801 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-08T18:04:03.802 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-08T18:04:03.802 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-08T18:04:03.802 INFO:teuthology.orchestra.run.smithi080.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-08T18:04:03.802 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-08T18:04:03.802 INFO:teuthology.orchestra.run.smithi080.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-08T18:04:03.802 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-08T18:04:03.802 INFO:teuthology.orchestra.run.smithi080.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-08T18:04:03.890 INFO:teuthology.orchestra.run.smithi080.stdout:0 upgraded, 118 newly installed, 0 to remove and 303 not upgraded. 2024-05-08T18:04:03.890 INFO:teuthology.orchestra.run.smithi080.stdout:Need to get 181 MB of archives. 2024-05-08T18:04:03.890 INFO:teuthology.orchestra.run.smithi080.stdout:After this operation, 829 MB of additional disk space will be used. 2024-05-08T18:04:03.891 INFO:teuthology.orchestra.run.smithi080.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-08T18:04:04.040 INFO:teuthology.orchestra.run.smithi115.stdout:0 upgraded, 118 newly installed, 0 to remove and 303 not upgraded. 2024-05-08T18:04:04.040 INFO:teuthology.orchestra.run.smithi115.stdout:Need to get 181 MB of archives. 2024-05-08T18:04:04.041 INFO:teuthology.orchestra.run.smithi115.stdout:After this operation, 829 MB of additional disk space will be used. 2024-05-08T18:04:04.041 INFO:teuthology.orchestra.run.smithi115.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3525-g27d37168-1jammy [3,555 kB] 2024-05-08T18:04:04.056 INFO:teuthology.orchestra.run.smithi080.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-08T18:04:04.060 INFO:teuthology.orchestra.run.smithi080.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-08T18:04:04.084 INFO:teuthology.orchestra.run.smithi080.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-08T18:04:04.149 INFO:teuthology.orchestra.run.smithi080.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3525-g27d37168-1jammy [3,555 kB] 2024-05-08T18:04:04.199 INFO:teuthology.orchestra.run.smithi080.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-08T18:04:04.207 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-08T18:04:04.224 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-08T18:04:04.230 INFO:teuthology.orchestra.run.smithi080.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-08T18:04:04.231 INFO:teuthology.orchestra.run.smithi080.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-08T18:04:04.232 INFO:teuthology.orchestra.run.smithi080.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-08T18:04:04.245 INFO:teuthology.orchestra.run.smithi080.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-08T18:04:04.250 INFO:teuthology.orchestra.run.smithi080.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-08T18:04:04.253 INFO:teuthology.orchestra.run.smithi080.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-08T18:04:04.255 INFO:teuthology.orchestra.run.smithi080.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-08T18:04:04.288 INFO:teuthology.orchestra.run.smithi080.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-08T18:04:04.292 INFO:teuthology.orchestra.run.smithi080.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-08T18:04:04.296 INFO:teuthology.orchestra.run.smithi080.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-08T18:04:04.299 INFO:teuthology.orchestra.run.smithi080.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-08T18:04:04.300 INFO:teuthology.orchestra.run.smithi080.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-08T18:04:04.300 INFO:teuthology.orchestra.run.smithi080.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-08T18:04:04.309 INFO:teuthology.orchestra.run.smithi080.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-08T18:04:04.310 INFO:teuthology.orchestra.run.smithi080.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-08T18:04:04.310 INFO:teuthology.orchestra.run.smithi080.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-08T18:04:04.311 INFO:teuthology.orchestra.run.smithi080.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-08T18:04:04.330 INFO:teuthology.orchestra.run.smithi080.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-08T18:04:04.331 INFO:teuthology.orchestra.run.smithi080.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-08T18:04:04.331 INFO:teuthology.orchestra.run.smithi080.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-08T18:04:04.336 INFO:teuthology.orchestra.run.smithi080.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-08T18:04:04.337 INFO:teuthology.orchestra.run.smithi080.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-08T18:04:04.337 INFO:teuthology.orchestra.run.smithi080.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-08T18:04:04.351 INFO:teuthology.orchestra.run.smithi080.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-08T18:04:04.353 INFO:teuthology.orchestra.run.smithi080.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-08T18:04:04.353 INFO:teuthology.orchestra.run.smithi080.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-08T18:04:04.354 INFO:teuthology.orchestra.run.smithi080.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-08T18:04:04.372 INFO:teuthology.orchestra.run.smithi080.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-08T18:04:04.373 INFO:teuthology.orchestra.run.smithi080.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-08T18:04:04.374 INFO:teuthology.orchestra.run.smithi080.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-08T18:04:04.383 INFO:teuthology.orchestra.run.smithi080.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-08T18:04:04.383 INFO:teuthology.orchestra.run.smithi080.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-08T18:04:04.385 INFO:teuthology.orchestra.run.smithi080.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-08T18:04:04.394 INFO:teuthology.orchestra.run.smithi080.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-08T18:04:04.396 INFO:teuthology.orchestra.run.smithi080.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-08T18:04:04.399 INFO:teuthology.orchestra.run.smithi080.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-08T18:04:04.400 INFO:teuthology.orchestra.run.smithi080.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-08T18:04:04.416 INFO:teuthology.orchestra.run.smithi080.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-08T18:04:04.417 INFO:teuthology.orchestra.run.smithi080.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-08T18:04:04.422 INFO:teuthology.orchestra.run.smithi080.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-08T18:04:04.423 INFO:teuthology.orchestra.run.smithi080.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-08T18:04:04.424 INFO:teuthology.orchestra.run.smithi080.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-08T18:04:04.428 INFO:teuthology.orchestra.run.smithi080.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-08T18:04:04.553 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-08T18:04:04.576 INFO:teuthology.orchestra.run.smithi080.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-08T18:04:04.578 INFO:teuthology.orchestra.run.smithi080.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-08T18:04:04.580 INFO:teuthology.orchestra.run.smithi080.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-08T18:04:04.580 INFO:teuthology.orchestra.run.smithi080.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-08T18:04:04.582 INFO:teuthology.orchestra.run.smithi080.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-08T18:04:04.609 INFO:teuthology.orchestra.run.smithi080.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-08T18:04:04.612 INFO:teuthology.orchestra.run.smithi080.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-08T18:04:04.612 INFO:teuthology.orchestra.run.smithi080.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-08T18:04:04.629 INFO:teuthology.orchestra.run.smithi080.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-08T18:04:04.629 INFO:teuthology.orchestra.run.smithi080.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-08T18:04:04.630 INFO:teuthology.orchestra.run.smithi080.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-08T18:04:04.630 INFO:teuthology.orchestra.run.smithi080.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-08T18:04:04.631 INFO:teuthology.orchestra.run.smithi080.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-08T18:04:04.631 INFO:teuthology.orchestra.run.smithi080.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-08T18:04:04.646 INFO:teuthology.orchestra.run.smithi080.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-08T18:04:04.646 INFO:teuthology.orchestra.run.smithi080.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-08T18:04:04.650 INFO:teuthology.orchestra.run.smithi080.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-08T18:04:04.668 INFO:teuthology.orchestra.run.smithi080.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-08T18:04:04.669 INFO:teuthology.orchestra.run.smithi080.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-08T18:04:04.670 INFO:teuthology.orchestra.run.smithi080.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-08T18:04:04.673 INFO:teuthology.orchestra.run.smithi080.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-08T18:04:04.675 INFO:teuthology.orchestra.run.smithi080.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-08T18:04:04.676 INFO:teuthology.orchestra.run.smithi080.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-08T18:04:04.677 INFO:teuthology.orchestra.run.smithi080.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-08T18:04:04.688 INFO:teuthology.orchestra.run.smithi080.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-08T18:04:04.689 INFO:teuthology.orchestra.run.smithi080.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-08T18:04:04.692 INFO:teuthology.orchestra.run.smithi080.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-08T18:04:04.709 INFO:teuthology.orchestra.run.smithi080.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-08T18:04:04.709 INFO:teuthology.orchestra.run.smithi080.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-08T18:04:04.710 INFO:teuthology.orchestra.run.smithi080.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-08T18:04:04.711 INFO:teuthology.orchestra.run.smithi080.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-08T18:04:04.712 INFO:teuthology.orchestra.run.smithi080.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-08T18:04:04.718 INFO:teuthology.orchestra.run.smithi080.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-08T18:04:04.719 INFO:teuthology.orchestra.run.smithi080.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-08T18:04:04.729 INFO:teuthology.orchestra.run.smithi080.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-08T18:04:04.732 INFO:teuthology.orchestra.run.smithi080.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-08T18:04:04.732 INFO:teuthology.orchestra.run.smithi080.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-08T18:04:04.976 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-08T18:04:04.991 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-08T18:04:05.077 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-08T18:04:05.318 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-08T18:04:05.329 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-08T18:04:05.359 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-08T18:04:05.368 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-08T18:04:05.369 INFO:teuthology.orchestra.run.smithi115.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-08T18:04:05.371 INFO:teuthology.orchestra.run.smithi115.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-08T18:04:05.392 INFO:teuthology.orchestra.run.smithi115.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-08T18:04:05.559 INFO:teuthology.orchestra.run.smithi115.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-08T18:04:05.591 INFO:teuthology.orchestra.run.smithi080.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3525-g27d37168-1jammy [3,223 kB] 2024-05-08T18:04:05.968 INFO:teuthology.orchestra.run.smithi115.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-08T18:04:06.008 INFO:teuthology.orchestra.run.smithi115.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-08T18:04:06.010 INFO:teuthology.orchestra.run.smithi115.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-08T18:04:06.084 INFO:teuthology.orchestra.run.smithi115.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-08T18:04:06.138 INFO:teuthology.orchestra.run.smithi115.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-08T18:04:06.161 INFO:teuthology.orchestra.run.smithi115.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-08T18:04:06.167 INFO:teuthology.orchestra.run.smithi115.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-08T18:04:06.168 INFO:teuthology.orchestra.run.smithi115.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-08T18:04:06.179 INFO:teuthology.orchestra.run.smithi115.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-08T18:04:06.180 INFO:teuthology.orchestra.run.smithi115.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-08T18:04:06.246 INFO:teuthology.orchestra.run.smithi080.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3525-g27d37168-1jammy [712 kB] 2024-05-08T18:04:06.273 INFO:teuthology.orchestra.run.smithi115.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3525-g27d37168-1jammy [3,223 kB] 2024-05-08T18:04:06.352 INFO:teuthology.orchestra.run.smithi115.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-08T18:04:06.445 INFO:teuthology.orchestra.run.smithi115.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-08T18:04:06.475 INFO:teuthology.orchestra.run.smithi115.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-08T18:04:06.482 INFO:teuthology.orchestra.run.smithi080.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3525-g27d37168-1jammy [356 kB] 2024-05-08T18:04:06.489 INFO:teuthology.orchestra.run.smithi080.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3525-g27d37168-1jammy [32.8 kB] 2024-05-08T18:04:06.490 INFO:teuthology.orchestra.run.smithi080.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3525-g27d37168-1jammy [180 kB] 2024-05-08T18:04:06.493 INFO:teuthology.orchestra.run.smithi115.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-08T18:04:06.506 INFO:teuthology.orchestra.run.smithi080.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3525-g27d37168-1jammy [67.4 kB] 2024-05-08T18:04:06.507 INFO:teuthology.orchestra.run.smithi080.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3525-g27d37168-1jammy [330 kB] 2024-05-08T18:04:06.536 INFO:teuthology.orchestra.run.smithi115.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-08T18:04:06.554 INFO:teuthology.orchestra.run.smithi080.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3525-g27d37168-1jammy [6,900 kB] 2024-05-08T18:04:06.755 INFO:teuthology.orchestra.run.smithi115.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-08T18:04:06.772 INFO:teuthology.orchestra.run.smithi115.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-08T18:04:06.787 INFO:teuthology.orchestra.run.smithi115.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-08T18:04:06.804 INFO:teuthology.orchestra.run.smithi115.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-08T18:04:06.837 INFO:teuthology.orchestra.run.smithi115.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-08T18:04:06.842 INFO:teuthology.orchestra.run.smithi115.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-08T18:04:07.016 INFO:teuthology.orchestra.run.smithi115.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-08T18:04:07.086 INFO:teuthology.orchestra.run.smithi115.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3525-g27d37168-1jammy [712 kB] 2024-05-08T18:04:07.187 INFO:teuthology.orchestra.run.smithi115.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3525-g27d37168-1jammy [356 kB] 2024-05-08T18:04:07.255 INFO:teuthology.orchestra.run.smithi115.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3525-g27d37168-1jammy [32.8 kB] 2024-05-08T18:04:07.255 INFO:teuthology.orchestra.run.smithi115.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3525-g27d37168-1jammy [180 kB] 2024-05-08T18:04:07.271 INFO:teuthology.orchestra.run.smithi115.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3525-g27d37168-1jammy [67.4 kB] 2024-05-08T18:04:07.308 INFO:teuthology.orchestra.run.smithi115.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3525-g27d37168-1jammy [330 kB] 2024-05-08T18:04:07.336 INFO:teuthology.orchestra.run.smithi115.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3525-g27d37168-1jammy [6,900 kB] 2024-05-08T18:04:07.403 INFO:teuthology.orchestra.run.smithi115.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-08T18:04:07.446 INFO:teuthology.orchestra.run.smithi115.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-08T18:04:07.459 INFO:teuthology.orchestra.run.smithi115.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-08T18:04:07.685 INFO:teuthology.orchestra.run.smithi080.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3525-g27d37168-1jammy [112 kB] 2024-05-08T18:04:07.689 INFO:teuthology.orchestra.run.smithi080.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3525-g27d37168-1jammy [466 kB] 2024-05-08T18:04:07.745 INFO:teuthology.orchestra.run.smithi115.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-08T18:04:07.747 INFO:teuthology.orchestra.run.smithi115.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-08T18:04:07.749 INFO:teuthology.orchestra.run.smithi080.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3525-g27d37168-1jammy [25.8 MB] 2024-05-08T18:04:07.760 INFO:teuthology.orchestra.run.smithi115.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-08T18:04:07.773 INFO:teuthology.orchestra.run.smithi115.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-08T18:04:07.819 INFO:teuthology.orchestra.run.smithi115.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-08T18:04:07.868 INFO:teuthology.orchestra.run.smithi115.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-08T18:04:07.876 INFO:teuthology.orchestra.run.smithi115.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-08T18:04:08.066 INFO:teuthology.orchestra.run.smithi115.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-08T18:04:08.256 INFO:teuthology.orchestra.run.smithi115.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3525-g27d37168-1jammy [112 kB] 2024-05-08T18:04:08.259 INFO:teuthology.orchestra.run.smithi115.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3525-g27d37168-1jammy [466 kB] 2024-05-08T18:04:08.297 INFO:teuthology.orchestra.run.smithi115.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3525-g27d37168-1jammy [25.8 MB] 2024-05-08T18:04:08.370 INFO:teuthology.orchestra.run.smithi115.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-08T18:04:08.562 INFO:teuthology.orchestra.run.smithi115.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-08T18:04:08.580 INFO:teuthology.orchestra.run.smithi115.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-08T18:04:08.612 INFO:teuthology.orchestra.run.smithi115.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-08T18:04:08.740 INFO:teuthology.orchestra.run.smithi115.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-08T18:04:09.805 INFO:teuthology.orchestra.run.smithi115.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-08T18:04:09.821 INFO:teuthology.orchestra.run.smithi115.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-08T18:04:09.845 INFO:teuthology.orchestra.run.smithi115.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-08T18:04:09.848 INFO:teuthology.orchestra.run.smithi115.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-08T18:04:09.868 INFO:teuthology.orchestra.run.smithi115.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-08T18:04:10.674 INFO:teuthology.orchestra.run.smithi115.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-08T18:04:10.744 INFO:teuthology.orchestra.run.smithi115.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3525-g27d37168-1jammy [5,095 kB] 2024-05-08T18:04:11.113 INFO:teuthology.orchestra.run.smithi115.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3525-g27d37168-1jammy [244 kB] 2024-05-08T18:04:11.145 INFO:teuthology.orchestra.run.smithi115.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3525-g27d37168-1jammy [124 kB] 2024-05-08T18:04:11.152 INFO:teuthology.orchestra.run.smithi115.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3525-g27d37168-1jammy [1,544 kB] 2024-05-08T18:04:11.282 INFO:teuthology.orchestra.run.smithi115.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3525-g27d37168-1jammy [6,259 kB] 2024-05-08T18:04:11.837 INFO:teuthology.orchestra.run.smithi115.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-08T18:04:11.837 INFO:teuthology.orchestra.run.smithi115.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3525-g27d37168-1jammy [22.8 MB] 2024-05-08T18:04:11.853 INFO:teuthology.orchestra.run.smithi115.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-08T18:04:12.496 INFO:teuthology.orchestra.run.smithi115.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-08T18:04:12.497 INFO:teuthology.orchestra.run.smithi115.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-08T18:04:12.502 INFO:teuthology.orchestra.run.smithi115.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-08T18:04:12.511 INFO:teuthology.orchestra.run.smithi115.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-08T18:04:12.513 INFO:teuthology.orchestra.run.smithi115.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-08T18:04:12.520 INFO:teuthology.orchestra.run.smithi115.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-08T18:04:12.523 INFO:teuthology.orchestra.run.smithi115.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-08T18:04:12.566 INFO:teuthology.orchestra.run.smithi080.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3525-g27d37168-1jammy [5,095 kB] 2024-05-08T18:04:13.394 INFO:teuthology.orchestra.run.smithi080.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3525-g27d37168-1jammy [244 kB] 2024-05-08T18:04:13.453 INFO:teuthology.orchestra.run.smithi080.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3525-g27d37168-1jammy [124 kB] 2024-05-08T18:04:13.461 INFO:teuthology.orchestra.run.smithi080.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3525-g27d37168-1jammy [1,544 kB] 2024-05-08T18:04:13.668 INFO:teuthology.orchestra.run.smithi115.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-08T18:04:13.749 INFO:teuthology.orchestra.run.smithi080.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3525-g27d37168-1jammy [6,259 kB] 2024-05-08T18:04:13.855 INFO:teuthology.orchestra.run.smithi115.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-08T18:04:14.189 INFO:teuthology.orchestra.run.smithi115.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3525-g27d37168-1jammy [14.0 kB] 2024-05-08T18:04:14.189 INFO:teuthology.orchestra.run.smithi115.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3525-g27d37168-1jammy [870 kB] 2024-05-08T18:04:14.206 INFO:teuthology.orchestra.run.smithi115.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3525-g27d37168-1jammy [2,438 kB] 2024-05-08T18:04:14.269 INFO:teuthology.orchestra.run.smithi115.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-08T18:04:14.342 INFO:teuthology.orchestra.run.smithi115.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-08T18:04:14.366 INFO:teuthology.orchestra.run.smithi115.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-08T18:04:14.378 INFO:teuthology.orchestra.run.smithi115.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3525-g27d37168-1jammy [792 kB] 2024-05-08T18:04:14.437 INFO:teuthology.orchestra.run.smithi115.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3525-g27d37168-1jammy [148 kB] 2024-05-08T18:04:14.453 INFO:teuthology.orchestra.run.smithi080.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3525-g27d37168-1jammy [22.8 MB] 2024-05-08T18:04:14.464 INFO:teuthology.orchestra.run.smithi115.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3525-g27d37168-1jammy [2,279 kB] 2024-05-08T18:04:14.474 INFO:teuthology.orchestra.run.smithi115.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-08T18:04:14.531 INFO:teuthology.orchestra.run.smithi115.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-08T18:04:14.541 INFO:teuthology.orchestra.run.smithi115.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-08T18:04:14.546 INFO:teuthology.orchestra.run.smithi115.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-08T18:04:14.599 INFO:teuthology.orchestra.run.smithi115.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-08T18:04:14.603 INFO:teuthology.orchestra.run.smithi115.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-08T18:04:14.629 INFO:teuthology.orchestra.run.smithi115.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-08T18:04:14.645 INFO:teuthology.orchestra.run.smithi115.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3525-g27d37168-1jammy [8,625 kB] 2024-05-08T18:04:14.795 INFO:teuthology.orchestra.run.smithi115.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-08T18:04:15.070 INFO:teuthology.orchestra.run.smithi115.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-08T18:04:15.092 INFO:teuthology.orchestra.run.smithi115.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-08T18:04:15.245 INFO:teuthology.orchestra.run.smithi115.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-08T18:04:15.277 INFO:teuthology.orchestra.run.smithi115.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-08T18:04:15.474 INFO:teuthology.orchestra.run.smithi115.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-08T18:04:15.477 INFO:teuthology.orchestra.run.smithi115.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-08T18:04:15.479 INFO:teuthology.orchestra.run.smithi115.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-08T18:04:15.506 INFO:teuthology.orchestra.run.smithi115.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3525-g27d37168-1jammy [14.2 kB] 2024-05-08T18:04:15.507 INFO:teuthology.orchestra.run.smithi115.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3525-g27d37168-1jammy [51.7 MB] 2024-05-08T18:04:15.516 INFO:teuthology.orchestra.run.smithi115.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-08T18:04:15.524 INFO:teuthology.orchestra.run.smithi115.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-08T18:04:16.156 INFO:teuthology.orchestra.run.smithi080.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3525-g27d37168-1jammy [14.0 kB] 2024-05-08T18:04:16.157 INFO:teuthology.orchestra.run.smithi080.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3525-g27d37168-1jammy [870 kB] 2024-05-08T18:04:16.178 INFO:teuthology.orchestra.run.smithi080.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3525-g27d37168-1jammy [2,438 kB] 2024-05-08T18:04:16.301 INFO:teuthology.orchestra.run.smithi080.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3525-g27d37168-1jammy [792 kB] 2024-05-08T18:04:16.343 INFO:teuthology.orchestra.run.smithi080.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3525-g27d37168-1jammy [148 kB] 2024-05-08T18:04:16.349 INFO:teuthology.orchestra.run.smithi080.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3525-g27d37168-1jammy [2,279 kB] 2024-05-08T18:04:16.462 INFO:teuthology.orchestra.run.smithi080.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3525-g27d37168-1jammy [8,625 kB] 2024-05-08T18:04:16.907 INFO:teuthology.orchestra.run.smithi080.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3525-g27d37168-1jammy [14.2 kB] 2024-05-08T18:04:16.907 INFO:teuthology.orchestra.run.smithi080.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3525-g27d37168-1jammy [51.7 MB] 2024-05-08T18:04:20.924 INFO:teuthology.orchestra.run.smithi080.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3525-g27d37168-1jammy [124 kB] 2024-05-08T18:04:20.926 INFO:teuthology.orchestra.run.smithi080.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3525-g27d37168-1jammy [38.9 kB] 2024-05-08T18:04:20.927 INFO:teuthology.orchestra.run.smithi080.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3525-g27d37168-1jammy [13.7 MB] 2024-05-08T18:04:22.681 INFO:teuthology.orchestra.run.smithi080.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3525-g27d37168-1jammy [91.2 kB] 2024-05-08T18:04:23.239 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 181 MB in 19s (9,599 kB/s) 2024-05-08T18:04:23.408 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-08T18:04:23.508 INFO:teuthology.orchestra.run.smithi080.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-08T18:04:23.513 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-08T18:04:23.598 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T18:04:23.944 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-08T18:04:23.970 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-08T18:04:24.010 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T18:04:24.355 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-08T18:04:24.381 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-08T18:04:24.422 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T18:04:24.809 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-08T18:04:24.835 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:04:24.876 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:04:25.304 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-08T18:04:25.330 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:04:25.371 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:04:25.732 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-08T18:04:25.758 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:04:25.799 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:04:26.127 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-08T18:04:26.153 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-08T18:04:26.377 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T18:04:26.705 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package librados2. 2024-05-08T18:04:26.731 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../007-librados2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:26.771 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librados2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:27.241 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package librbd1. 2024-05-08T18:04:27.267 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../008-librbd1_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:27.307 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librbd1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:27.761 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libcephfs2. 2024-05-08T18:04:27.787 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:27.827 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libcephfs2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:28.088 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-rados. 2024-05-08T18:04:28.103 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:28.138 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-rados (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:28.482 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-08T18:04:28.508 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:04:28.549 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-ceph-argparse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:28.785 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-cephfs. 2024-05-08T18:04:28.800 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:28.843 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-cephfs (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:29.163 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-08T18:04:29.189 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:04:29.229 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:29.532 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-08T18:04:29.559 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-08T18:04:29.599 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T18:04:29.894 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-prettytable. 2024-05-08T18:04:29.920 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-08T18:04:29.958 INFO:teuthology.orchestra.run.smithi115.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3525-g27d37168-1jammy [124 kB] 2024-05-08T18:04:29.960 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-08T18:04:29.961 INFO:teuthology.orchestra.run.smithi115.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3525-g27d37168-1jammy [38.9 kB] 2024-05-08T18:04:29.961 INFO:teuthology.orchestra.run.smithi115.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3525-g27d37168-1jammy [13.7 MB] 2024-05-08T18:04:30.230 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-rbd. 2024-05-08T18:04:30.245 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:30.288 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-rbd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:30.616 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-08T18:04:30.642 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-08T18:04:30.682 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T18:04:30.944 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-08T18:04:30.958 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-08T18:04:30.993 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-08T18:04:31.288 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-08T18:04:31.314 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-08T18:04:31.355 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-08T18:04:31.717 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package lua5.1. 2024-05-08T18:04:31.743 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-08T18:04:31.783 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-08T18:04:32.095 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package lua-any. 2024-05-08T18:04:32.110 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-08T18:04:32.153 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-08T18:04:32.389 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package zip. 2024-05-08T18:04:32.404 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-08T18:04:32.447 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking zip (3.0-12build2) ... 2024-05-08T18:04:32.767 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package unzip. 2024-05-08T18:04:32.793 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-08T18:04:32.834 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-08T18:04:33.230 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package luarocks. 2024-05-08T18:04:33.255 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-08T18:04:33.296 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-08T18:04:33.662 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package librgw2. 2024-05-08T18:04:33.685 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../025-librgw2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:33.721 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librgw2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:33.952 INFO:teuthology.orchestra.run.smithi115.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3525-g27d37168-1jammy [91.2 kB] 2024-05-08T18:04:34.315 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-rgw. 2024-05-08T18:04:34.341 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:34.381 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-rgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:34.511 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 181 MB in 30s (5,954 kB/s) 2024-05-08T18:04:34.669 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-08T18:04:34.726 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-08T18:04:34.752 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-08T18:04:34.769 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-08T18:04:34.775 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-08T18:04:34.792 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T18:04:34.868 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T18:04:35.104 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libradosstriper1. 2024-05-08T18:04:35.132 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:35.170 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libradosstriper1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:35.238 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-08T18:04:35.265 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-08T18:04:35.304 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T18:04:35.574 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-common. 2024-05-08T18:04:35.600 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:35.640 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:35.649 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-08T18:04:35.676 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-08T18:04:35.715 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T18:04:36.119 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-08T18:04:36.146 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:04:36.186 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:04:36.564 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-08T18:04:36.591 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:04:37.081 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:04:37.717 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-08T18:04:37.744 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:04:37.784 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:04:38.071 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-base. 2024-05-08T18:04:38.098 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:38.137 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-08T18:04:38.147 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-base (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:38.164 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-08T18:04:38.204 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T18:04:38.523 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librados2. 2024-05-08T18:04:38.549 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../007-librados2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:38.581 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librados2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:38.784 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-08T18:04:38.811 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-08T18:04:38.850 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-08T18:04:39.018 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librbd1. 2024-05-08T18:04:39.043 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../008-librbd1_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:39.093 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librbd1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:39.154 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-cheroot. 2024-05-08T18:04:39.180 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-08T18:04:39.220 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T18:04:39.549 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-08T18:04:39.575 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-08T18:04:39.615 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-08T18:04:39.704 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libcephfs2. 2024-05-08T18:04:39.730 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:39.770 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libcephfs2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:39.960 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-08T18:04:39.986 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-08T18:04:40.035 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-08T18:04:40.056 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rados. 2024-05-08T18:04:40.071 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:40.114 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rados (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:40.371 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-08T18:04:40.392 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-08T18:04:40.398 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-08T18:04:40.418 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:04:40.437 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-08T18:04:40.458 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-ceph-argparse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:40.711 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cephfs. 2024-05-08T18:04:40.738 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:40.740 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-tempora. 2024-05-08T18:04:40.767 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-08T18:04:40.778 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cephfs (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:40.807 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-08T18:04:41.106 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-08T18:04:41.132 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:04:41.143 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-portend. 2024-05-08T18:04:41.170 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-08T18:04:41.172 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:41.218 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-08T18:04:41.476 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-08T18:04:41.501 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-08T18:04:41.542 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T18:04:41.605 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-08T18:04:41.632 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-08T18:04:41.671 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-08T18:04:41.862 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-prettytable. 2024-05-08T18:04:41.888 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-08T18:04:41.928 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-08T18:04:41.974 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-08T18:04:42.001 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-08T18:04:42.041 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-08T18:04:42.172 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rbd. 2024-05-08T18:04:42.188 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:42.222 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rbd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:42.470 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-natsort. 2024-05-08T18:04:42.497 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-08T18:04:42.536 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-08T18:04:42.550 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-08T18:04:42.577 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-08T18:04:42.617 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T18:04:42.856 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-logutils. 2024-05-08T18:04:42.861 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-08T18:04:42.877 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-08T18:04:42.883 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-08T18:04:42.911 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-08T18:04:42.923 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-08T18:04:43.214 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-08T18:04:43.226 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-08T18:04:43.241 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-08T18:04:43.252 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-08T18:04:43.281 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-08T18:04:43.292 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-08T18:04:43.579 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-mako. 2024-05-08T18:04:43.605 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-08T18:04:43.609 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package lua5.1. 2024-05-08T18:04:43.636 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-08T18:04:43.637 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T18:04:43.676 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-08T18:04:43.957 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-08T18:04:43.970 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package lua-any. 2024-05-08T18:04:43.983 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-08T18:04:43.986 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-08T18:04:44.020 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-08T18:04:44.023 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-08T18:04:44.273 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package zip. 2024-05-08T18:04:44.299 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-08T18:04:44.310 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-08T18:04:44.337 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-08T18:04:44.340 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking zip (3.0-12build2) ... 2024-05-08T18:04:44.385 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-08T18:04:44.660 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package unzip. 2024-05-08T18:04:44.687 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-08T18:04:44.687 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-webob. 2024-05-08T18:04:44.714 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-08T18:04:44.726 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-08T18:04:44.754 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-08T18:04:45.107 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-waitress. 2024-05-08T18:04:45.134 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-08T18:04:45.177 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T18:04:45.280 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package luarocks. 2024-05-08T18:04:45.307 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-08T18:04:45.346 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-08T18:04:45.485 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-tempita. 2024-05-08T18:04:45.512 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-08T18:04:45.552 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T18:04:45.663 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librgw2. 2024-05-08T18:04:45.690 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../025-librgw2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:45.729 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librgw2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:45.813 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-paste. 2024-05-08T18:04:45.829 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-08T18:04:45.871 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T18:04:46.175 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-08T18:04:46.190 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-08T18:04:46.224 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T18:04:46.282 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rgw. 2024-05-08T18:04:46.297 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:46.340 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:46.519 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-08T18:04:46.546 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-08T18:04:46.586 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-08T18:04:46.693 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-08T18:04:46.720 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-08T18:04:46.760 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T18:04:46.889 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-webtest. 2024-05-08T18:04:46.916 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-08T18:04:46.956 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-08T18:04:47.038 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libradosstriper1. 2024-05-08T18:04:47.064 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:47.096 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libradosstriper1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:47.467 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pecan. 2024-05-08T18:04:47.494 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-08T18:04:47.508 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-common. 2024-05-08T18:04:47.533 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T18:04:47.534 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:47.574 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:47.905 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-certifi. 2024-05-08T18:04:47.932 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-08T18:04:47.972 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-08T18:04:48.308 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-idna. 2024-05-08T18:04:48.335 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-08T18:04:48.375 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-08T18:04:48.678 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-urllib3. 2024-05-08T18:04:48.693 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-08T18:04:48.728 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T18:04:48.971 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-base. 2024-05-08T18:04:48.998 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:49.031 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-requests. 2024-05-08T18:04:49.047 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-base (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:49.058 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-08T18:04:49.089 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T18:04:49.342 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-08T18:04:49.369 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-08T18:04:49.408 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T18:04:49.609 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-08T18:04:49.635 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-08T18:04:49.675 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-08T18:04:49.704 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-08T18:04:49.719 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:04:49.753 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:50.112 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cheroot. 2024-05-08T18:04:50.138 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-08T18:04:50.150 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-08T18:04:50.170 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T18:04:50.177 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:50.216 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:50.456 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-08T18:04:50.471 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-08T18:04:50.506 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-08T18:04:50.511 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-08T18:04:50.539 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-08T18:04:50.578 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-08T18:04:50.792 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-08T18:04:50.818 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-08T18:04:50.847 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-openssl. 2024-05-08T18:04:50.850 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-08T18:04:50.874 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-08T18:04:50.905 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-08T18:04:51.162 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-08T18:04:51.190 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-08T18:04:51.228 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-08T18:04:51.250 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr. 2024-05-08T18:04:51.277 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:51.317 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:51.531 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-tempora. 2024-05-08T18:04:51.558 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-08T18:04:51.598 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-08T18:04:51.754 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mon. 2024-05-08T18:04:51.782 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:51.820 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mon (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:51.910 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-portend. 2024-05-08T18:04:51.936 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-08T18:04:51.978 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-08T18:04:52.256 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-08T18:04:52.282 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-08T18:04:52.322 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-08T18:04:52.374 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-osd. 2024-05-08T18:04:52.401 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:52.432 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-osd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:52.575 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-08T18:04:52.601 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-08T18:04:52.642 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-08T18:04:53.012 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-natsort. 2024-05-08T18:04:53.038 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-08T18:04:53.078 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-08T18:04:53.390 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-logutils. 2024-05-08T18:04:53.416 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-08T18:04:53.456 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-08T18:04:53.519 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph. 2024-05-08T18:04:53.535 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../066-ceph_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:53.577 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:53.742 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-08T18:04:53.769 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-08T18:04:53.809 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-08T18:04:53.897 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-fuse. 2024-05-08T18:04:53.923 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:53.963 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:54.053 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-mako. 2024-05-08T18:04:54.080 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-08T18:04:54.120 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T18:04:54.291 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mds. 2024-05-08T18:04:54.318 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:54.349 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mds (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:54.440 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-08T18:04:54.466 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-08T18:04:54.506 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-08T18:04:54.753 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package cephadm. 2024-05-08T18:04:54.780 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../069-cephadm_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:04:54.809 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-08T18:04:54.819 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:54.835 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-08T18:04:54.875 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-08T18:04:55.139 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-08T18:04:55.165 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-08T18:04:55.203 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-webob. 2024-05-08T18:04:55.205 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-08T18:04:55.229 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-08T18:04:55.278 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-08T18:04:55.541 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-08T18:04:55.568 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T18:04:55.589 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-waitress. 2024-05-08T18:04:55.604 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-08T18:04:55.607 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T18:04:55.642 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T18:04:55.900 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-tempita. 2024-05-08T18:04:55.926 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-08T18:04:55.958 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T18:04:56.244 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-paste. 2024-05-08T18:04:56.271 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-08T18:04:56.311 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T18:04:56.588 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-babel. 2024-05-08T18:04:56.614 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-08T18:04:56.615 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T18:04:56.629 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-08T18:04:56.654 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T18:04:56.664 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T18:04:57.067 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-08T18:04:57.093 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-08T18:04:57.133 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jinja2. 2024-05-08T18:04:57.133 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-08T18:04:57.159 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-08T18:04:57.199 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T18:04:57.436 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-webtest. 2024-05-08T18:04:57.463 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-08T18:04:57.503 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-08T18:04:57.528 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-08T18:04:57.554 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:04:57.594 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:57.822 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pecan. 2024-05-08T18:04:57.849 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-08T18:04:57.889 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T18:04:58.122 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-08T18:04:58.149 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-08T18:04:58.230 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-08T18:04:58.252 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-certifi. 2024-05-08T18:04:58.278 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-08T18:04:58.318 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-08T18:04:58.533 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-routes. 2024-05-08T18:04:58.560 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-08T18:04:58.600 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T18:04:58.630 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-idna. 2024-05-08T18:04:58.656 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-08T18:04:58.687 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-08T18:04:58.937 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-08T18:04:58.963 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:04:58.974 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-urllib3. 2024-05-08T18:04:59.000 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-08T18:04:59.003 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:04:59.040 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T18:04:59.318 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-requests. 2024-05-08T18:04:59.345 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-08T18:04:59.385 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T18:04:59.696 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-08T18:04:59.723 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-08T18:04:59.762 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T18:05:00.024 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-08T18:05:00.039 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:05:00.082 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:00.316 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-08T18:05:00.332 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-08T18:05:00.375 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T18:05:00.612 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-08T18:05:00.639 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:05:00.687 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:00.889 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-joblib. 2024-05-08T18:05:00.915 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-08T18:05:00.955 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T18:05:00.973 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-08T18:05:01.000 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-08T18:05:01.039 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-08T18:05:01.275 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-08T18:05:01.291 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-08T18:05:01.317 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-openssl. 2024-05-08T18:05:01.333 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-08T18:05:01.345 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-08T18:05:01.384 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-08T18:05:01.678 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-sklearn. 2024-05-08T18:05:01.694 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-08T18:05:01.745 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T18:05:01.753 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr. 2024-05-08T18:05:01.780 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:05:01.828 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:02.231 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mon. 2024-05-08T18:05:02.258 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:05:02.298 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mon (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:02.412 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-08T18:05:02.440 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:05:02.564 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:02.835 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-osd. 2024-05-08T18:05:02.861 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:05:02.892 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-osd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:03.535 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-cachetools. 2024-05-08T18:05:03.562 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-08T18:05:03.601 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-08T18:05:03.904 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-08T18:05:03.931 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-08T18:05:03.962 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph. 2024-05-08T18:05:03.970 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-08T18:05:03.978 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../066-ceph_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:05:04.020 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:04.274 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-08T18:05:04.289 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-08T18:05:04.324 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T18:05:04.340 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-fuse. 2024-05-08T18:05:04.367 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:05:04.406 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:04.593 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-rsa. 2024-05-08T18:05:04.617 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-08T18:05:04.652 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-08T18:05:04.743 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mds. 2024-05-08T18:05:04.769 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:05:04.801 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mds (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:04.981 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-google-auth. 2024-05-08T18:05:05.008 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-08T18:05:05.047 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-08T18:05:05.196 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package cephadm. 2024-05-08T18:05:05.223 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../069-cephadm_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:05:05.262 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:05.367 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-08T18:05:05.395 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-08T18:05:05.434 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T18:05:05.581 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-08T18:05:05.608 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-08T18:05:05.647 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-08T18:05:05.745 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-websocket. 2024-05-08T18:05:05.773 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-08T18:05:05.812 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-08T18:05:05.992 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-08T18:05:06.007 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T18:05:06.050 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T18:05:06.090 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-08T18:05:06.106 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-08T18:05:06.140 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T18:05:06.846 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-08T18:05:06.862 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:05:06.904 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:07.072 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-babel. 2024-05-08T18:05:07.087 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T18:05:07.121 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T18:05:07.240 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-08T18:05:07.268 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-08T18:05:07.307 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T18:05:07.399 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jinja2. 2024-05-08T18:05:07.415 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-08T18:05:07.449 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T18:05:07.710 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-08T18:05:07.737 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T18:05:07.743 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-08T18:05:07.759 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:05:07.785 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T18:05:07.793 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:08.063 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package jq. 2024-05-08T18:05:08.079 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T18:05:08.121 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-08T18:05:08.122 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-08T18:05:08.149 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-08T18:05:08.180 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-08T18:05:08.499 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-routes. 2024-05-08T18:05:08.526 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-08T18:05:08.566 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T18:05:08.624 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package socat. 2024-05-08T18:05:08.651 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-08T18:05:08.690 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-08T18:05:08.885 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-08T18:05:08.912 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:05:08.952 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:09.002 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package xmlstarlet. 2024-05-08T18:05:09.018 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-08T18:05:09.060 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-08T18:05:09.423 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-test. 2024-05-08T18:05:09.439 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:05:09.481 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-test (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:10.190 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-08T18:05:10.206 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-08T18:05:10.248 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T18:05:10.902 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-joblib. 2024-05-08T18:05:10.929 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-08T18:05:10.960 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T18:05:11.305 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-08T18:05:11.321 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-08T18:05:11.363 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-08T18:05:11.716 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-sklearn. 2024-05-08T18:05:11.743 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-08T18:05:11.782 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T18:05:11.827 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-volume. 2024-05-08T18:05:11.854 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:05:11.885 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-volume (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:12.173 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-08T18:05:12.189 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:05:12.222 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libcephfs-dev (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:12.499 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-08T18:05:12.509 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-08T18:05:12.526 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:05:12.536 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-08T18:05:12.575 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-08T18:05:12.650 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:12.914 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-08T18:05:12.941 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-08T18:05:12.980 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-08T18:05:13.309 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package nvme-cli. 2024-05-08T18:05:13.336 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-08T18:05:13.375 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T18:05:13.662 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cachetools. 2024-05-08T18:05:13.678 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-08T18:05:13.712 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-08T18:05:13.765 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package pkg-config. 2024-05-08T18:05:13.792 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-08T18:05:13.822 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-08T18:05:13.965 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-08T18:05:13.993 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-08T18:05:14.031 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-08T18:05:14.084 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-08T18:05:14.111 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-08T18:05:14.150 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-08T18:05:14.352 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-08T18:05:14.379 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-08T18:05:14.418 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T18:05:14.579 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-08T18:05:14.606 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-08T18:05:14.645 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-08T18:05:14.738 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rsa. 2024-05-08T18:05:14.757 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-08T18:05:14.798 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-08T18:05:14.965 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pastescript. 2024-05-08T18:05:14.992 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-08T18:05:15.031 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-08T18:05:15.141 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-google-auth. 2024-05-08T18:05:15.168 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-08T18:05:15.210 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-08T18:05:15.351 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pluggy. 2024-05-08T18:05:15.379 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-08T18:05:15.418 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-08T18:05:15.527 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-08T18:05:15.554 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-08T18:05:15.594 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T18:05:15.696 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-psutil. 2024-05-08T18:05:15.712 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-08T18:05:15.754 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-08T18:05:15.863 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-websocket. 2024-05-08T18:05:15.891 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-08T18:05:15.921 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-08T18:05:16.082 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-py. 2024-05-08T18:05:16.110 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-08T18:05:16.149 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-08T18:05:16.258 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-08T18:05:16.285 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-08T18:05:16.324 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T18:05:16.469 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pygments. 2024-05-08T18:05:16.496 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-08T18:05:16.535 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T18:05:16.955 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-08T18:05:16.971 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:05:16.990 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-08T18:05:17.013 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:17.017 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-08T18:05:17.056 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-08T18:05:17.332 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-08T18:05:17.359 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-toml. 2024-05-08T18:05:17.359 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-08T18:05:17.386 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-08T18:05:17.398 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T18:05:17.425 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-08T18:05:17.687 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pytest. 2024-05-08T18:05:17.714 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-08T18:05:17.726 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-08T18:05:17.753 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T18:05:17.754 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T18:05:17.793 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T18:05:18.004 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package jq. 2024-05-08T18:05:18.019 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T18:05:18.062 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-08T18:05:18.124 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-simplejson. 2024-05-08T18:05:18.152 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-08T18:05:18.198 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-08T18:05:18.332 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package socat. 2024-05-08T18:05:18.359 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-08T18:05:18.398 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-08T18:05:18.509 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-08T18:05:18.538 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-08T18:05:18.584 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-08T18:05:18.693 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package xmlstarlet. 2024-05-08T18:05:18.708 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-08T18:05:18.742 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-08T18:05:19.113 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-test. 2024-05-08T18:05:19.141 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:05:19.180 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-test (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:19.530 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package radosgw. 2024-05-08T18:05:19.558 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../116-radosgw_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:05:19.588 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking radosgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:20.408 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package rbd-fuse. 2024-05-08T18:05:20.436 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:05:20.474 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking rbd-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:20.779 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-08T18:05:21.022 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T18:05:21.148 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T18:05:21.408 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-08T18:05:21.659 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-volume. 2024-05-08T18:05:21.686 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:05:21.725 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-volume (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:21.739 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-08T18:05:22.038 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-08T18:05:22.066 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:05:22.104 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libcephfs-dev (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:22.144 INFO:teuthology.orchestra.run.smithi080.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-08T18:05:22.208 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:22.390 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-08T18:05:22.418 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-08T18:05:22.448 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-08T18:05:22.716 INFO:teuthology.orchestra.run.smithi080.stdout:Adding system user cephadm....done 2024-05-08T18:05:22.769 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-08T18:05:22.797 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-08T18:05:22.836 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-08T18:05:22.839 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T18:05:23.124 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-08T18:05:23.215 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package nvme-cli. 2024-05-08T18:05:23.242 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-08T18:05:23.281 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T18:05:23.400 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-08T18:05:23.527 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-08T18:05:23.686 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package pkg-config. 2024-05-08T18:05:23.713 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-08T18:05:23.761 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-08T18:05:23.786 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-08T18:05:23.988 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-08T18:05:24.006 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-08T18:05:24.038 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-08T18:05:24.046 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T18:05:24.155 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-08T18:05:24.449 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T18:05:24.475 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-08T18:05:24.502 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-08T18:05:24.541 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-08T18:05:24.802 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pastescript. 2024-05-08T18:05:24.826 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-08T18:05:24.830 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-08T18:05:24.860 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-08T18:05:25.077 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-08T18:05:25.180 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pluggy. 2024-05-08T18:05:25.208 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-08T18:05:25.246 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-08T18:05:25.353 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-08T18:05:25.558 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-psutil. 2024-05-08T18:05:25.585 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-08T18:05:25.588 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-08T18:05:25.624 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-08T18:05:25.831 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-08T18:05:25.952 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-py. 2024-05-08T18:05:25.979 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-08T18:05:26.018 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-08T18:05:26.091 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-08T18:05:26.313 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pygments. 2024-05-08T18:05:26.330 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-08T18:05:26.341 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-ceph-argparse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:26.371 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T18:05:26.584 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T18:05:26.710 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-08T18:05:26.784 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-08T18:05:26.811 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-08T18:05:26.842 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-08T18:05:26.844 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-08T18:05:26.962 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-08T18:05:27.170 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-toml. 2024-05-08T18:05:27.197 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-08T18:05:27.205 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-08T18:05:27.253 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-08T18:05:27.556 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pytest. 2024-05-08T18:05:27.583 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-08T18:05:27.620 INFO:teuthology.orchestra.run.smithi080.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-08T18:05:27.622 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T18:05:27.653 INFO:teuthology.orchestra.run.smithi080.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-08T18:05:27.733 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T18:05:27.834 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-08T18:05:27.959 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-simplejson. 2024-05-08T18:05:27.986 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-08T18:05:28.025 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-08T18:05:28.177 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T18:05:28.303 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-08T18:05:28.315 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-08T18:05:28.342 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-08T18:05:28.394 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-08T18:05:28.571 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T18:05:28.822 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-08T18:05:29.132 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up zip (3.0-12build2) ... 2024-05-08T18:05:29.173 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package radosgw. 2024-05-08T18:05:29.201 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../116-radosgw_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:05:29.239 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking radosgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:29.241 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T18:05:29.893 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T18:05:30.042 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package rbd-fuse. 2024-05-08T18:05:30.070 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:05:30.109 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking rbd-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:30.161 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T18:05:30.287 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-08T18:05:30.413 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T18:05:30.414 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-08T18:05:30.649 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T18:05:30.697 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-08T18:05:30.775 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T18:05:31.036 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-08T18:05:31.074 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-08T18:05:31.316 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T18:05:31.349 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-08T18:05:31.685 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T18:05:31.773 INFO:teuthology.orchestra.run.smithi115.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-08T18:05:31.827 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:31.986 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T18:05:32.312 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-08T18:05:32.360 INFO:teuthology.orchestra.run.smithi115.stdout:Adding system user cephadm....done 2024-05-08T18:05:32.516 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T18:05:32.564 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-08T18:05:32.690 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:32.784 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-08T18:05:33.008 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-idna (3.3-1) ... 2024-05-08T18:05:33.018 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-08T18:05:33.144 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-08T18:05:33.317 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T18:05:33.404 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-08T18:05:33.647 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T18:05:33.773 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-08T18:05:34.083 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T18:05:34.435 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-08T18:05:34.498 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-08T18:05:34.686 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-08T18:05:34.758 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:05:34.901 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-08T18:05:34.988 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-08T18:05:35.160 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T18:05:35.231 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-08T18:05:35.295 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-08T18:05:35.396 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T18:05:35.482 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-08T18:05:35.672 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-08T18:05:35.741 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-08T18:05:35.923 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-08T18:05:35.992 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-ceph-argparse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:36.174 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:05:36.243 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T18:05:36.300 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-08T18:05:36.369 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-08T18:05:36.487 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-08T18:05:36.596 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-08T18:05:36.601 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-08T18:05:36.831 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-08T18:05:36.870 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-08T18:05:37.121 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-08T18:05:37.209 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-08T18:05:37.237 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-08T18:05:37.300 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T18:05:37.355 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-08T18:05:37.401 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-08T18:05:37.598 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-08T18:05:37.752 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T18:05:37.866 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T18:05:37.870 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-08T18:05:37.992 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-08T18:05:38.121 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T18:05:38.276 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T18:05:38.381 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-08T18:05:38.402 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T18:05:38.674 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up zip (3.0-12build2) ... 2024-05-08T18:05:38.695 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-08T18:05:38.799 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T18:05:38.996 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-08T18:05:39.231 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-08T18:05:39.348 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-08T18:05:39.449 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T18:05:39.459 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T18:05:39.522 INFO:teuthology.orchestra.run.smithi080.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-08T18:05:39.711 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T18:05:39.751 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T18:05:39.862 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-08T18:05:39.886 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T18:05:39.988 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T18:05:40.270 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-08T18:05:40.280 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-08T18:05:40.513 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-08T18:05:40.639 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-08T18:05:40.665 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-08T18:05:40.890 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:05:40.916 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T18:05:40.992 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T18:05:41.284 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T18:05:41.301 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T18:05:41.560 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T18:05:41.602 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T18:05:41.887 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-08T18:05:41.895 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-08T18:05:42.013 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-08T18:05:42.130 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-08T18:05:42.256 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:42.280 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-08T18:05:42.548 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-idna (3.3-1) ... 2024-05-08T18:05:42.565 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T18:05:42.858 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T18:05:42.918 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-08T18:05:43.304 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-08T18:05:43.572 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T18:05:43.899 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T18:05:44.025 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librados2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:44.072 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-08T18:05:44.151 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:44.303 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-08T18:05:44.332 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:05:44.466 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-08T18:05:44.639 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libcephfs2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:44.717 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T18:05:44.777 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libradosstriper1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:44.835 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-08T18:05:44.883 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-08T18:05:44.978 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T18:05:45.143 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librbd1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:45.271 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-08T18:05:45.277 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-modules-core (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:45.403 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:45.530 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-08T18:05:45.615 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T18:05:45.615 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T18:05:45.781 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:05:45.907 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-08T18:05:46.105 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libcephfs-dev (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:46.208 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-08T18:05:46.231 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-rados (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:46.357 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librgw2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:46.451 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-08T18:05:46.483 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T18:05:46.710 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-08T18:05:46.962 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-08T18:05:47.238 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-08T18:05:47.497 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T18:05:47.623 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-08T18:05:47.722 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-rbd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:47.840 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up rbd-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:47.899 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T18:05:47.949 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-rgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:48.025 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T18:05:48.050 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-cephfs (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:48.210 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:48.327 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-08T18:05:48.628 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-08T18:05:48.753 INFO:teuthology.orchestra.run.smithi080.stdout:Adding group ceph....done 2024-05-08T18:05:48.862 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-08T18:05:48.988 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-08T18:05:49.113 INFO:teuthology.orchestra.run.smithi080.stdout:Adding system user ceph....done 2024-05-08T18:05:49.114 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T18:05:49.203 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-08T18:05:49.281 INFO:teuthology.orchestra.run.smithi080.stdout:Setting system user ceph properties....done 2024-05-08T18:05:49.296 INFO:teuthology.orchestra.run.smithi080.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-08T18:05:49.430 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-08T18:05:49.474 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T18:05:49.600 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T18:05:49.734 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-08T18:05:50.001 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-08T18:05:50.220 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-test (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:50.269 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-08T18:05:50.346 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up radosgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:50.370 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-08T18:05:50.613 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:05:50.739 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T18:05:50.834 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:05:50.834 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:05:51.057 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T18:05:51.306 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-base (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:51.374 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T18:05:51.642 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-08T18:05:51.669 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-08T18:05:51.768 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-08T18:05:52.028 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-08T18:05:52.141 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mds (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:52.373 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T18:05:52.374 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T18:05:52.504 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T18:05:52.835 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:52.865 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-08T18:05:53.052 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T18:05:53.052 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T18:05:53.233 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-08T18:05:53.502 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T18:05:53.561 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-osd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:53.829 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T18:05:53.835 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T18:05:53.835 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T18:05:53.972 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librados2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:54.098 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:54.224 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-08T18:05:54.297 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:54.423 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:54.560 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libcephfs2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:54.582 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mon (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:54.678 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libradosstriper1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:54.787 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-08T18:05:54.794 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T18:05:54.794 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T18:05:55.064 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librbd1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:55.182 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-modules-core (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:55.233 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:55.283 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:55.376 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:55.480 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T18:05:55.480 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T18:05:55.511 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-dashboard (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:55.662 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-volume (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:55.976 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libcephfs-dev (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:55.998 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-08T18:05:56.102 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rados (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:56.233 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-08T18:05:56.262 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librgw2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:56.360 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-08T18:05:56.396 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T18:05:57.562 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-08T18:05:57.621 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rbd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:57.747 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up rbd-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:57.865 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:57.966 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cephfs (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:58.067 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:05:58.239 INFO:teuthology.orchestra.run.smithi080.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-08T18:05:58.245 DEBUG:teuthology.parallel:result is None 2024-05-08T18:05:58.622 INFO:teuthology.orchestra.run.smithi115.stdout:Adding group ceph....done 2024-05-08T18:05:58.994 INFO:teuthology.orchestra.run.smithi115.stdout:Adding system user ceph....done 2024-05-08T18:05:59.163 INFO:teuthology.orchestra.run.smithi115.stdout:Setting system user ceph properties....done 2024-05-08T18:05:59.179 INFO:teuthology.orchestra.run.smithi115.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-08T18:05:59.320 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-08T18:05:59.674 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-08T18:06:00.151 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-test (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:00.277 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up radosgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:00.761 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:06:00.761 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:06:01.212 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-base (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:01.553 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-08T18:06:02.039 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mds (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:02.258 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T18:06:02.258 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T18:06:02.749 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:02.966 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T18:06:02.966 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T18:06:03.450 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-osd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:03.714 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T18:06:03.715 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T18:06:04.185 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:04.312 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:04.454 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mon (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:04.649 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T18:06:04.649 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T18:06:05.122 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:05.273 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:05.399 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-dashboard (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:05.550 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-volume (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:05.903 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-08T18:06:06.003 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-08T18:06:06.155 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-08T18:06:06.847 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-08T18:06:07.494 INFO:teuthology.orchestra.run.smithi115.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-08T18:06:07.499 DEBUG:teuthology.parallel:result is None 2024-05-08T18:06:07.499 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:06:07.720 DEBUG:teuthology.orchestra.run.smithi080:> dpkg-query -W -f '${Version}' ceph 2024-05-08T18:06:07.739 INFO:teuthology.orchestra.run.smithi080.stdout:19.0.0-3525-g27d37168-1jammy 2024-05-08T18:06:07.739 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3525-g27d37168-1jammy 2024-05-08T18:06:07.739 INFO:teuthology.task.install:The correct ceph version 19.0.0-3525-g27d37168-1jammy is installed. 2024-05-08T18:06:07.741 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:06:07.876 DEBUG:teuthology.orchestra.run.smithi115:> dpkg-query -W -f '${Version}' ceph 2024-05-08T18:06:07.895 INFO:teuthology.orchestra.run.smithi115.stdout:19.0.0-3525-g27d37168-1jammy 2024-05-08T18:06:07.895 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3525-g27d37168-1jammy 2024-05-08T18:06:07.895 INFO:teuthology.task.install:The correct ceph version 19.0.0-3525-g27d37168-1jammy is installed. 2024-05-08T18:06:07.897 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T18:06:07.897 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:07.897 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T18:06:07.911 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:07.911 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T18:06:07.952 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T18:06:07.952 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:07.952 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T18:06:07.965 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T18:06:08.020 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:08.020 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T18:06:08.034 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T18:06:08.090 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T18:06:08.091 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:08.091 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T18:06:08.104 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T18:06:08.160 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:08.160 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T18:06:08.173 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T18:06:08.226 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T18:06:08.226 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:08.226 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T18:06:08.238 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T18:06:08.291 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:08.291 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T18:06:08.304 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T18:06:08.358 INFO:teuthology.run_tasks:Running task ceph... 2024-05-08T18:06:08.445 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-08T18:06:08.446 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /var/log/ceph 2024-05-08T18:06:08.450 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /var/log/ceph 2024-05-08T18:06:08.462 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-08T18:06:08.463 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T18:06:08.502 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T18:06:08.517 INFO:tasks.ceph:Creating extra log directories... 2024-05-08T18:06:08.518 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T18:06:08.558 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T18:06:08.581 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-08T18:06:08.581 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-08T18:06:08.581 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697867', 'branch': 'wip-eric-testing-1', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload}', 'email': 'ivancich@redhat.com', 'first_in_suite': False, 'job_id': '7697867', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-eric-testing-1'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-eric-testing-1', 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}}, 'owner': 'scheduled_ivancich@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 831, 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776', 'sleep_before_teardown': 0, 'subset': '1/50', 'suite': 'rgw', 'suite_branch': 'wip-eric-testing-1', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_27d371685027569bcfa4efc661d3d3186f3a1776/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '27d371685027569bcfa4efc661d3d3186f3a1776', 'targets': {'smithi080.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGQ3GXQX3GFRg3i/psuo5EsS07t3W5sMGwUSrF/8Udlgl7zHHGTsiUtO98dxwJup1a8om37nIDTgAqud9JlZyTE=', 'smithi115.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB2rUIbiGp+OlfzT8NrIZnyDbM1u1jFidN/e8Qicex/bT84KBzFI/b48e7X/bvhhi1fUW26zrxD1FddetJJ1AKU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_multipart_upload.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_17:43:43', 'tube': 'smithi', 'user': 'ivancich', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-08T18:06:08.582 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T18:06:08.614 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T18:06:08.619 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T18:06:08.662 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T18:06:08.675 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:08.675 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T18:06:08.721 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T18:06:08.721 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 2024-05-08T18:06:08.769 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T18:06:08.769 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:06:08.769 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-05-08T18:06:08.769 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:06:08.769 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-08 17:59:31.556841199 +0000 2024-05-08T18:06:08.769 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-08 17:59:31.296843518 +0000 2024-05-08T18:06:08.769 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-08 17:59:31.296843518 +0000 2024-05-08T18:06:08.769 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-05-08T18:06:08.769 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T18:06:08.823 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-08T18:06:08.823 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-08T18:06:08.823 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000447346 s, 1.1 MB/s 2024-05-08T18:06:08.824 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T18:06:08.875 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 2024-05-08T18:06:08.921 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T18:06:08.921 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:06:08.921 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-05-08T18:06:08.921 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:06:08.921 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-08 17:59:32.044836845 +0000 2024-05-08T18:06:08.921 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-08 17:59:31.768839307 +0000 2024-05-08T18:06:08.922 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-08 17:59:31.768839307 +0000 2024-05-08T18:06:08.922 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-05-08T18:06:08.922 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T18:06:08.975 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-08T18:06:08.975 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-08T18:06:08.975 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000443473 s, 1.2 MB/s 2024-05-08T18:06:08.977 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T18:06:09.026 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 2024-05-08T18:06:09.072 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T18:06:09.072 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:06:09.072 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-05-08T18:06:09.073 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:06:09.073 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-08 17:59:32.544832384 +0000 2024-05-08T18:06:09.073 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-08 17:59:32.288834669 +0000 2024-05-08T18:06:09.073 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-08 17:59:32.288834669 +0000 2024-05-08T18:06:09.073 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-05-08T18:06:09.073 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T18:06:09.126 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-08T18:06:09.126 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-08T18:06:09.127 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000426032 s, 1.2 MB/s 2024-05-08T18:06:09.128 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T18:06:09.178 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 2024-05-08T18:06:09.228 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T18:06:09.228 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:06:09.229 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-05-08T18:06:09.229 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:06:09.229 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-08 17:59:33.060827782 +0000 2024-05-08T18:06:09.229 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-08 17:59:32.760830458 +0000 2024-05-08T18:06:09.229 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-08 17:59:32.760830458 +0000 2024-05-08T18:06:09.229 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-05-08T18:06:09.229 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T18:06:09.282 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-08T18:06:09.283 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-08T18:06:09.283 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000394343 s, 1.3 MB/s 2024-05-08T18:06:09.284 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T18:06:09.334 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T18:06:09.334 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:09.335 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T18:06:09.340 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T18:06:09.340 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2024-05-08T18:06:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T18:06:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:06:09.387 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-05-08T18:06:09.388 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:06:09.388 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-05-08 17:59:31.543408014 +0000 2024-05-08T18:06:09.388 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-08 17:59:31.271410442 +0000 2024-05-08T18:06:09.388 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-08 17:59:31.271410442 +0000 2024-05-08T18:06:09.388 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2024-05-08T18:06:09.388 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T18:06:09.442 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-05-08T18:06:09.442 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-05-08T18:06:09.442 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.00044395 s, 1.2 MB/s 2024-05-08T18:06:09.443 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T18:06:09.492 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2024-05-08T18:06:09.543 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T18:06:09.543 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:06:09.543 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-05-08T18:06:09.543 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:06:09.543 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-05-08 17:59:32.067403333 +0000 2024-05-08T18:06:09.543 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-08 17:59:31.803405691 +0000 2024-05-08T18:06:09.543 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-08 17:59:31.803405691 +0000 2024-05-08T18:06:09.543 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2024-05-08T18:06:09.543 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T18:06:09.598 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-05-08T18:06:09.598 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-05-08T18:06:09.598 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000349734 s, 1.5 MB/s 2024-05-08T18:06:09.599 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T18:06:09.648 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2024-05-08T18:06:09.695 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T18:06:09.695 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:06:09.695 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-05-08T18:06:09.695 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:06:09.695 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-05-08 17:59:32.695397724 +0000 2024-05-08T18:06:09.695 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-08 17:59:32.323401047 +0000 2024-05-08T18:06:09.695 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-08 17:59:32.323401047 +0000 2024-05-08T18:06:09.695 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2024-05-08T18:06:09.695 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T18:06:09.749 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-05-08T18:06:09.749 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-05-08T18:06:09.749 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000380405 s, 1.3 MB/s 2024-05-08T18:06:09.751 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T18:06:09.800 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2024-05-08T18:06:09.847 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T18:06:09.847 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:06:09.847 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-05-08T18:06:09.847 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:06:09.847 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-05-08 17:59:33.183393365 +0000 2024-05-08T18:06:09.847 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-08 17:59:32.935395580 +0000 2024-05-08T18:06:09.848 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-08 17:59:32.935395580 +0000 2024-05-08T18:06:09.848 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2024-05-08T18:06:09.848 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T18:06:09.901 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-05-08T18:06:09.902 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-05-08T18:06:09.902 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000341196 s, 1.5 MB/s 2024-05-08T18:06:09.903 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T18:06:09.952 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T18:06:09.953 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T18:06:09.953 INFO:tasks.ceph:Generating config... 2024-05-08T18:06:09.954 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-05-08T18:06:09.954 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-08T18:06:09.954 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-08T18:06:09.954 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-08T18:06:09.954 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-08T18:06:09.955 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-08T18:06:09.955 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-08T18:06:09.955 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-08T18:06:09.955 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-08T18:06:09.955 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-08T18:06:09.955 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-08T18:06:09.955 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-08T18:06:09.955 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-08T18:06:09.955 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-08T18:06:09.955 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-08T18:06:09.955 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-08T18:06:09.956 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-08T18:06:09.956 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-08T18:06:09.956 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-08T18:06:09.956 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-08T18:06:09.956 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-08T18:06:09.956 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-08T18:06:09.956 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-08T18:06:09.956 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-05-08T18:06:09.956 INFO:tasks.ceph:Setting up mon.a... 2024-05-08T18:06:09.956 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-08T18:06:09.990 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.keyring 2024-05-08T18:06:10.005 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-08T18:06:10.087 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T18:06:10.139 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.80'), ('mon.c', '[v2:172.21.15.80:3301,v1:172.21.15.80:6790]'), ('mon.b', '172.21.15.115')] 2024-05-08T18:06:10.140 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.80,[v2:172.21.15.80:3301,v1:172.21.15.80:6790],172.21.15.115'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-05-08T18:06:10.140 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:10.140 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T18:06:10.189 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.80 --addv c '[v2:172.21.15.80:3301,v1:172.21.15.80:6790]' --add b 172.21.15.115 --print /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:06:10.275 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:06:10.275 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: generated fsid 0d8284a2-bb69-4df9-9f45-9ef5b469ca40 2024-05-08T18:06:10.275 INFO:teuthology.orchestra.run.smithi080.stdout:setting min_mon_release = quincy 2024-05-08T18:06:10.275 INFO:teuthology.orchestra.run.smithi080.stdout:epoch 0 2024-05-08T18:06:10.275 INFO:teuthology.orchestra.run.smithi080.stdout:fsid 0d8284a2-bb69-4df9-9f45-9ef5b469ca40 2024-05-08T18:06:10.275 INFO:teuthology.orchestra.run.smithi080.stdout:last_changed 2024-05-08T18:06:10.279001+0000 2024-05-08T18:06:10.275 INFO:teuthology.orchestra.run.smithi080.stdout:created 2024-05-08T18:06:10.279001+0000 2024-05-08T18:06:10.275 INFO:teuthology.orchestra.run.smithi080.stdout:min_mon_release 17 (quincy) 2024-05-08T18:06:10.275 INFO:teuthology.orchestra.run.smithi080.stdout:election_strategy: 1 2024-05-08T18:06:10.275 INFO:teuthology.orchestra.run.smithi080.stdout:0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-05-08T18:06:10.275 INFO:teuthology.orchestra.run.smithi080.stdout:1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2024-05-08T18:06:10.275 INFO:teuthology.orchestra.run.smithi080.stdout:2: [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] mon.c 2024-05-08T18:06:10.276 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-08T18:06:10.277 DEBUG:teuthology.orchestra.run.smithi080:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T18:06:10.325 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0d8284a2-bb69-4df9-9f45-9ef5b469ca40... 2024-05-08T18:06:10.326 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T18:06:10.369 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T18:06:10.399 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2024-05-08T18:06:10.400 INFO:teuthology.orchestra.run.smithi080.stdout: chdir = "" 2024-05-08T18:06:10.400 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T18:06:10.400 INFO:teuthology.orchestra.run.smithi080.stdout: auth supported = cephx 2024-05-08T18:06:10.400 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.400 INFO:teuthology.orchestra.run.smithi080.stdout: filestore xattr use omap = true 2024-05-08T18:06:10.400 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.400 INFO:teuthology.orchestra.run.smithi080.stdout: mon clock drift allowed = 1.000 2024-05-08T18:06:10.400 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.400 INFO:teuthology.orchestra.run.smithi080.stdout: osd crush chooseleaf type = 0 2024-05-08T18:06:10.400 INFO:teuthology.orchestra.run.smithi080.stdout: auth debug = true 2024-05-08T18:06:10.400 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.400 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on old message = true 2024-05-08T18:06:10.400 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on bug = true 2024-05-08T18:06:10.400 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.401 INFO:teuthology.orchestra.run.smithi080.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T18:06:10.401 INFO:teuthology.orchestra.run.smithi080.stdout: mon pg warn max object skew = 0 2024-05-08T18:06:10.401 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.401 INFO:teuthology.orchestra.run.smithi080.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T18:06:10.401 INFO:teuthology.orchestra.run.smithi080.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T18:06:10.401 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.401 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default size = 2 2024-05-08T18:06:10.401 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.401 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow primary affinity = true 2024-05-08T18:06:10.401 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow pg remap = true 2024-05-08T18:06:10.401 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on legacy crush tunables = false 2024-05-08T18:06:10.401 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on crush straw calc version zero = false 2024-05-08T18:06:10.401 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on no sortbitwise = false 2024-05-08T18:06:10.401 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on osd down out interval zero = false 2024-05-08T18:06:10.402 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on too few osds = false 2024-05-08T18:06:10.402 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T18:06:10.402 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T18:06:10.402 INFO:teuthology.orchestra.run.smithi080.stdout: mon_allow_pool_size_one = true 2024-05-08T18:06:10.402 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.402 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T18:06:10.402 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.402 INFO:teuthology.orchestra.run.smithi080.stdout: osd default data pool replay window = 5 2024-05-08T18:06:10.402 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.402 INFO:teuthology.orchestra.run.smithi080.stdout: mon allow pool delete = true 2024-05-08T18:06:10.402 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.402 INFO:teuthology.orchestra.run.smithi080.stdout: mon cluster log file level = debug 2024-05-08T18:06:10.402 INFO:teuthology.orchestra.run.smithi080.stdout: debug asserts on shutdown = true 2024-05-08T18:06:10.403 INFO:teuthology.orchestra.run.smithi080.stdout: mon health detail to clog = false 2024-05-08T18:06:10.403 INFO:teuthology.orchestra.run.smithi080.stdout: mon host = "172.21.15.80,[v2:172.21.15.80:3301,v1:172.21.15.80:6790],172.21.15.115" 2024-05-08T18:06:10.403 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = 0d8284a2-bb69-4df9-9f45-9ef5b469ca40 2024-05-08T18:06:10.403 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.403 INFO:teuthology.orchestra.run.smithi080.stdout:[osd] 2024-05-08T18:06:10.403 INFO:teuthology.orchestra.run.smithi080.stdout: osd journal size = 100 2024-05-08T18:06:10.403 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.403 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub load threshold = 5.0 2024-05-08T18:06:10.403 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub max interval = 600 2024-05-08T18:06:10.403 INFO:teuthology.orchestra.run.smithi080.stdout: osd mclock profile = high_recovery_ops 2024-05-08T18:06:10.403 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.403 INFO:teuthology.orchestra.run.smithi080.stdout: osd recover clone overlap = true 2024-05-08T18:06:10.403 INFO:teuthology.orchestra.run.smithi080.stdout: osd recovery max chunk = 1048576 2024-05-08T18:06:10.403 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.404 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug shutdown = true 2024-05-08T18:06:10.404 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug op order = true 2024-05-08T18:06:10.404 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug verify stray on activate = true 2024-05-08T18:06:10.404 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug trim objects = true 2024-05-08T18:06:10.404 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.404 INFO:teuthology.orchestra.run.smithi080.stdout: osd open classes on start = true 2024-05-08T18:06:10.404 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug pg log writeout = true 2024-05-08T18:06:10.404 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.404 INFO:teuthology.orchestra.run.smithi080.stdout: osd deep scrub update digest min age = 30 2024-05-08T18:06:10.404 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.404 INFO:teuthology.orchestra.run.smithi080.stdout: osd map max advance = 10 2024-05-08T18:06:10.405 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.405 INFO:teuthology.orchestra.run.smithi080.stdout: journal zero on create = true 2024-05-08T18:06:10.405 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.405 INFO:teuthology.orchestra.run.smithi080.stdout: filestore ondisk finisher threads = 3 2024-05-08T18:06:10.405 INFO:teuthology.orchestra.run.smithi080.stdout: filestore apply finisher threads = 3 2024-05-08T18:06:10.405 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.405 INFO:teuthology.orchestra.run.smithi080.stdout: bdev debug aio = true 2024-05-08T18:06:10.405 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug misdirected ops = true 2024-05-08T18:06:10.405 INFO:teuthology.orchestra.run.smithi080.stdout: bdev async discard = True 2024-05-08T18:06:10.405 INFO:teuthology.orchestra.run.smithi080.stdout: bdev enable discard = True 2024-05-08T18:06:10.405 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore allocator = bitmap 2024-05-08T18:06:10.405 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore block size = 96636764160 2024-05-08T18:06:10.406 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore fsck on mount = True 2024-05-08T18:06:10.406 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluefs = 1/20 2024-05-08T18:06:10.406 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluestore = 1/20 2024-05-08T18:06:10.406 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-08T18:06:10.406 INFO:teuthology.orchestra.run.smithi080.stdout: debug osd = 20 2024-05-08T18:06:10.406 INFO:teuthology.orchestra.run.smithi080.stdout: debug rocksdb = 4/10 2024-05-08T18:06:10.406 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T18:06:10.406 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd full ratio = 0.9 2024-05-08T18:06:10.406 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd nearfull ratio = 0.8 2024-05-08T18:06:10.406 INFO:teuthology.orchestra.run.smithi080.stdout: osd blocked scrub grace period = 3600 2024-05-08T18:06:10.406 INFO:teuthology.orchestra.run.smithi080.stdout: osd failsafe full ratio = 0.95 2024-05-08T18:06:10.406 INFO:teuthology.orchestra.run.smithi080.stdout: osd max markdown count = 1000 2024-05-08T18:06:10.406 INFO:teuthology.orchestra.run.smithi080.stdout: osd objectstore = bluestore 2024-05-08T18:06:10.407 INFO:teuthology.orchestra.run.smithi080.stdout: osd shutdown pgref assert = True 2024-05-08T18:06:10.407 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.407 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr] 2024-05-08T18:06:10.407 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-08T18:06:10.407 INFO:teuthology.orchestra.run.smithi080.stdout: debug mgr = 20 2024-05-08T18:06:10.407 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-05-08T18:06:10.407 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-05-08T18:06:10.407 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:06:10.407 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:06:10.407 INFO:teuthology.orchestra.run.smithi080.stdout: mgr/telemetry/nag = false 2024-05-08T18:06:10.407 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.407 INFO:teuthology.orchestra.run.smithi080.stdout:[mon] 2024-05-08T18:06:10.407 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-08T18:06:10.407 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-05-08T18:06:10.408 INFO:teuthology.orchestra.run.smithi080.stdout: debug paxos = 20 2024-05-08T18:06:10.408 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-05-08T18:06:10.408 INFO:teuthology.orchestra.run.smithi080.stdout: mon data avail warn = 5 2024-05-08T18:06:10.408 INFO:teuthology.orchestra.run.smithi080.stdout: mon mgr mkfs grace = 240 2024-05-08T18:06:10.408 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:06:10.408 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd reporter subtree level = osd 2024-05-08T18:06:10.408 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd prime pg temp = true 2024-05-08T18:06:10.408 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:06:10.408 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.408 INFO:teuthology.orchestra.run.smithi080.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T18:06:10.408 INFO:teuthology.orchestra.run.smithi080.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T18:06:10.408 INFO:teuthology.orchestra.run.smithi080.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T18:06:10.408 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.408 INFO:teuthology.orchestra.run.smithi080.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T18:06:10.408 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T18:06:10.409 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T18:06:10.409 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.409 INFO:teuthology.orchestra.run.smithi080.stdout: # 1m isn't quite enough 2024-05-08T18:06:10.409 INFO:teuthology.orchestra.run.smithi080.stdout: mon_down_mkfs_grace = 2m 2024-05-08T18:06:10.409 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.409 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_filestore_osds = false 2024-05-08T18:06:10.409 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:10.409 INFO:teuthology.orchestra.run.smithi080.stdout:[client] 2024-05-08T18:06:10.409 INFO:teuthology.orchestra.run.smithi080.stdout: rgw cache enabled = true 2024-05-08T18:06:10.409 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable ops log = true 2024-05-08T18:06:10.409 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable usage log = true 2024-05-08T18:06:10.409 INFO:teuthology.orchestra.run.smithi080.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T18:06:10.409 INFO:teuthology.orchestra.run.smithi080.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T18:06:10.409 INFO:teuthology.orchestra.run.smithi080.stdout: rgw relaxed s3 bucket names = True 2024-05-08T18:06:10.409 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.a] 2024-05-08T18:06:10.410 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.c] 2024-05-08T18:06:10.410 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.b] 2024-05-08T18:06:10.411 INFO:teuthology.orchestra.run.smithi115.stdout:[global] 2024-05-08T18:06:10.411 INFO:teuthology.orchestra.run.smithi115.stdout: chdir = "" 2024-05-08T18:06:10.411 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T18:06:10.411 INFO:teuthology.orchestra.run.smithi115.stdout: auth supported = cephx 2024-05-08T18:06:10.411 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: filestore xattr use omap = true 2024-05-08T18:06:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: mon clock drift allowed = 1.000 2024-05-08T18:06:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: osd crush chooseleaf type = 0 2024-05-08T18:06:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: auth debug = true 2024-05-08T18:06:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on old message = true 2024-05-08T18:06:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on bug = true 2024-05-08T18:06:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T18:06:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: mon pg warn max object skew = 0 2024-05-08T18:06:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T18:06:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T18:06:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default size = 2 2024-05-08T18:06:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow primary affinity = true 2024-05-08T18:06:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow pg remap = true 2024-05-08T18:06:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on legacy crush tunables = false 2024-05-08T18:06:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on crush straw calc version zero = false 2024-05-08T18:06:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on no sortbitwise = false 2024-05-08T18:06:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on osd down out interval zero = false 2024-05-08T18:06:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on too few osds = false 2024-05-08T18:06:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T18:06:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T18:06:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: mon_allow_pool_size_one = true 2024-05-08T18:06:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T18:06:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: osd default data pool replay window = 5 2024-05-08T18:06:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: mon allow pool delete = true 2024-05-08T18:06:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: mon cluster log file level = debug 2024-05-08T18:06:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: debug asserts on shutdown = true 2024-05-08T18:06:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: mon health detail to clog = false 2024-05-08T18:06:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: mon host = "172.21.15.80,[v2:172.21.15.80:3301,v1:172.21.15.80:6790],172.21.15.115" 2024-05-08T18:06:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: fsid = 0d8284a2-bb69-4df9-9f45-9ef5b469ca40 2024-05-08T18:06:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.414 INFO:teuthology.orchestra.run.smithi115.stdout:[osd] 2024-05-08T18:06:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: osd journal size = 100 2024-05-08T18:06:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub load threshold = 5.0 2024-05-08T18:06:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub max interval = 600 2024-05-08T18:06:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: osd mclock profile = high_recovery_ops 2024-05-08T18:06:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: osd recover clone overlap = true 2024-05-08T18:06:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: osd recovery max chunk = 1048576 2024-05-08T18:06:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug shutdown = true 2024-05-08T18:06:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug op order = true 2024-05-08T18:06:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug verify stray on activate = true 2024-05-08T18:06:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug trim objects = true 2024-05-08T18:06:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: osd open classes on start = true 2024-05-08T18:06:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug pg log writeout = true 2024-05-08T18:06:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: osd deep scrub update digest min age = 30 2024-05-08T18:06:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: osd map max advance = 10 2024-05-08T18:06:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: journal zero on create = true 2024-05-08T18:06:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: filestore ondisk finisher threads = 3 2024-05-08T18:06:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: filestore apply finisher threads = 3 2024-05-08T18:06:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: bdev debug aio = true 2024-05-08T18:06:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug misdirected ops = true 2024-05-08T18:06:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: bdev async discard = True 2024-05-08T18:06:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: bdev enable discard = True 2024-05-08T18:06:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore allocator = bitmap 2024-05-08T18:06:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore block size = 96636764160 2024-05-08T18:06:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore fsck on mount = True 2024-05-08T18:06:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluefs = 1/20 2024-05-08T18:06:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluestore = 1/20 2024-05-08T18:06:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-08T18:06:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: debug osd = 20 2024-05-08T18:06:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: debug rocksdb = 4/10 2024-05-08T18:06:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T18:06:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd full ratio = 0.9 2024-05-08T18:06:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd nearfull ratio = 0.8 2024-05-08T18:06:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: osd blocked scrub grace period = 3600 2024-05-08T18:06:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: osd failsafe full ratio = 0.95 2024-05-08T18:06:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: osd max markdown count = 1000 2024-05-08T18:06:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: osd objectstore = bluestore 2024-05-08T18:06:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: osd shutdown pgref assert = True 2024-05-08T18:06:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.419 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr] 2024-05-08T18:06:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-08T18:06:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: debug mgr = 20 2024-05-08T18:06:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2024-05-08T18:06:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2024-05-08T18:06:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:06:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:06:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: mgr/telemetry/nag = false 2024-05-08T18:06:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.419 INFO:teuthology.orchestra.run.smithi115.stdout:[mon] 2024-05-08T18:06:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-08T18:06:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2024-05-08T18:06:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: debug paxos = 20 2024-05-08T18:06:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2024-05-08T18:06:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: mon data avail warn = 5 2024-05-08T18:06:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: mon mgr mkfs grace = 240 2024-05-08T18:06:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:06:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd reporter subtree level = osd 2024-05-08T18:06:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd prime pg temp = true 2024-05-08T18:06:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:06:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T18:06:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T18:06:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T18:06:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T18:06:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T18:06:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T18:06:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: # 1m isn't quite enough 2024-05-08T18:06:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: mon_down_mkfs_grace = 2m 2024-05-08T18:06:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_filestore_osds = false 2024-05-08T18:06:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-08T18:06:10.421 INFO:teuthology.orchestra.run.smithi115.stdout:[client] 2024-05-08T18:06:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: rgw cache enabled = true 2024-05-08T18:06:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable ops log = true 2024-05-08T18:06:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable usage log = true 2024-05-08T18:06:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T18:06:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T18:06:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: rgw relaxed s3 bucket names = True 2024-05-08T18:06:10.421 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.a] 2024-05-08T18:06:10.421 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.c] 2024-05-08T18:06:10.422 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.b] 2024-05-08T18:06:10.422 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-08T18:06:10.422 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-08T18:06:10.503 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-08T18:06:10.503 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:10.503 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-08T18:06:10.510 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:10.510 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-08T18:06:10.560 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T18:06:10.560 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:10.560 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T18:06:10.560 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T18:06:10.629 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:10.630 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:06:10.677 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T18:06:10.677 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:10.677 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T18:06:10.677 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T18:06:10.699 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:10.699 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:06:10.748 INFO:tasks.ceph:Setting up mon nodes... 2024-05-08T18:06:10.748 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-08T18:06:10.748 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T18:06:10.791 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T18:06:10.794 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T18:06:10.837 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T18:06:10.856 INFO:tasks.ceph:Setting up mds nodes... 2024-05-08T18:06:10.856 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-08T18:06:10.856 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T18:06:10.892 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-08T18:06:10.906 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-08T18:06:10.942 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-08T18:06:10.952 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-08T18:06:10.953 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T18:06:10.953 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-08T18:06:10.965 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T18:06:10.965 INFO:tasks.ceph:role: osd.0 2024-05-08T18:06:10.965 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T18:06:10.965 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T18:06:11.028 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:06:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:06:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:06:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:06:11.028 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:06:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:06:11.028 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:06:11.028 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:06:11.028 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:06:11.028 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:06:11.516 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-08T18:06:11.518 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-08T18:06:11.518 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-08T18:06:11.656 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-08T18:06:11.666 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:06:11.667 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:06:11.667 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-08T18:06:11.724 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T18:06:11.724 INFO:tasks.ceph:role: osd.1 2024-05-08T18:06:11.724 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T18:06:11.724 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T18:06:11.789 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:06:11.789 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:06:11.789 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:06:11.789 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:06:11.789 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:06:11.789 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:06:11.790 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:06:11.790 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:06:11.790 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:06:11.790 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:06:12.216 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-08T18:06:12.218 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-08T18:06:12.218 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-08T18:06:12.281 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-08T18:06:12.334 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:06:12.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:06:12.335 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-08T18:06:12.392 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T18:06:12.392 INFO:tasks.ceph:role: osd.2 2024-05-08T18:06:12.392 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T18:06:12.392 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T18:06:12.455 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:06:12.455 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:06:12.456 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:06:12.456 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:06:12.456 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:06:12.456 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:06:12.456 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:06:12.456 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:06:12.456 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:06:12.456 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:06:12.923 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-08T18:06:12.924 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-08T18:06:12.924 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-08T18:06:13.008 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-08T18:06:13.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:06:13.065 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:06:13.065 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-08T18:06:13.118 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T18:06:13.119 INFO:tasks.ceph:role: osd.3 2024-05-08T18:06:13.119 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T18:06:13.119 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T18:06:13.180 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:06:13.180 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:06:13.180 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:06:13.180 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:06:13.180 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:06:13.180 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:06:13.180 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:06:13.180 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:06:13.180 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:06:13.180 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:06:13.672 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-08T18:06:13.674 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-08T18:06:13.674 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-08T18:06:13.812 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-08T18:06:13.823 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:06:13.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:06:13.824 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:06:13.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:13.934+0000 7f0710ced7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-08T18:06:13.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:13.934+0000 7f0710ced7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-08T18:06:13.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:13.934+0000 7f0710ced7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T18:06:13.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:13.934+0000 7f0710ced7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T18:06:13.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:13.934+0000 7f0710ced7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T18:06:13.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:13.942+0000 7f0710ced7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-08T18:06:16.916 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-08T18:06:16.930 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:06:17.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:17.010+0000 7fb5580ab7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-08T18:06:17.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:17.010+0000 7fb5580ab7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-08T18:06:17.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:17.010+0000 7fb5580ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T18:06:17.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:17.010+0000 7fb5580ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T18:06:17.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:17.010+0000 7fb5580ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T18:06:17.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:17.010+0000 7fb5580ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-08T18:06:19.997 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-08T18:06:20.053 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:06:20.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:20.138+0000 7fe8c96fe7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-08T18:06:20.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:20.138+0000 7fe8c96fe7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-08T18:06:20.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:20.138+0000 7fe8c96fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T18:06:20.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:20.138+0000 7fe8c96fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T18:06:20.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:20.138+0000 7fe8c96fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T18:06:20.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:20.138+0000 7fe8c96fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-08T18:06:23.115 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-08T18:06:23.169 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:06:23.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:23.250+0000 7fac643707c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-08T18:06:23.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:23.250+0000 7fac643707c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-08T18:06:23.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:23.250+0000 7fac643707c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T18:06:23.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:23.250+0000 7fac643707c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T18:06:23.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:23.250+0000 7fac643707c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T18:06:23.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T18:06:23.250+0000 7fac643707c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-08T18:06:26.223 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-08T18:06:26.276 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-08T18:06:26.291 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T18:06:26.291 INFO:tasks.ceph:role: osd.4 2024-05-08T18:06:26.291 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T18:06:26.291 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T18:06:26.353 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:06:26.354 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:06:26.354 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:06:26.354 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:06:26.354 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:06:26.354 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:06:26.354 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:06:26.354 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:06:26.354 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:06:26.355 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:06:26.819 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-05-08T18:06:26.821 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-05-08T18:06:26.821 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-08T18:06:26.919 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-08T18:06:26.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:06:26.930 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:06:26.930 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-08T18:06:26.986 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T18:06:26.986 INFO:tasks.ceph:role: osd.5 2024-05-08T18:06:26.986 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T18:06:26.986 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T18:06:27.051 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:06:27.051 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:06:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:06:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:06:27.052 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:06:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:06:27.052 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:06:27.052 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:06:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:06:27.052 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:06:27.515 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-05-08T18:06:27.517 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-05-08T18:06:27.517 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-08T18:06:27.652 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-08T18:06:27.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:06:27.664 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:06:27.664 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-08T18:06:27.719 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T18:06:27.719 INFO:tasks.ceph:role: osd.6 2024-05-08T18:06:27.719 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T18:06:27.719 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T18:06:27.783 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:06:27.783 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:06:27.783 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:06:27.783 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:06:27.784 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:06:27.784 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:06:27.784 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:06:27.784 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:06:27.784 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:06:27.784 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:06:28.266 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-05-08T18:06:28.269 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-05-08T18:06:28.269 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-08T18:06:28.411 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-08T18:06:28.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:06:28.423 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:06:28.423 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-08T18:06:28.479 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T18:06:28.479 INFO:tasks.ceph:role: osd.7 2024-05-08T18:06:28.480 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T18:06:28.480 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T18:06:28.542 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:06:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:06:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:06:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:06:28.543 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:06:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:06:28.543 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:06:28.543 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:06:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:06:28.543 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:06:28.969 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-05-08T18:06:28.971 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-05-08T18:06:28.971 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-08T18:06:29.072 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-08T18:06:29.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:06:29.082 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:06:29.082 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:06:29.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:29.189+0000 7fab276847c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-08T18:06:29.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:29.193+0000 7fab276847c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-08T18:06:29.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:29.193+0000 7fab276847c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T18:06:29.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:29.193+0000 7fab276847c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T18:06:29.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:29.193+0000 7fab276847c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T18:06:29.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:29.201+0000 7fab276847c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-08T18:06:32.176 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-08T18:06:32.191 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:06:32.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:32.273+0000 7f6f816277c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-08T18:06:32.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:32.273+0000 7f6f816277c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-08T18:06:32.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:32.273+0000 7f6f816277c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T18:06:32.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:32.273+0000 7f6f816277c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T18:06:32.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:32.273+0000 7f6f816277c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T18:06:32.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:32.277+0000 7f6f816277c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-08T18:06:35.253 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-08T18:06:35.308 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:06:35.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:35.389+0000 7ff530c627c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-08T18:06:35.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:35.389+0000 7ff530c627c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-08T18:06:35.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:35.389+0000 7ff530c627c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T18:06:35.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:35.389+0000 7ff530c627c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T18:06:35.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:35.389+0000 7ff530c627c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T18:06:35.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:35.389+0000 7ff530c627c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-08T18:06:38.364 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-08T18:06:38.418 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:06:38.500 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:38.501+0000 7f15154cf7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-08T18:06:38.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:38.501+0000 7f15154cf7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-08T18:06:38.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:38.501+0000 7f15154cf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T18:06:38.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:38.501+0000 7f15154cf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T18:06:38.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:38.501+0000 7f15154cf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T18:06:38.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-08T18:06:38.501+0000 7f15154cf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-08T18:06:41.493 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-08T18:06:41.548 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-08T18:06:41.548 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:41.548 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-08T18:06:41.562 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:41.562 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-08T18:06:41.615 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:41.615 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-08T18:06:41.671 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:41.671 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-08T18:06:41.723 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:41.723 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-08T18:06:41.775 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:41.775 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-08T18:06:41.788 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:41.788 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-08T18:06:41.841 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:41.842 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-08T18:06:41.894 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:41.894 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-08T18:06:41.949 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:41.950 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-08T18:06:42.005 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:42.005 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-08T18:06:42.011 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:42.011 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-08T18:06:42.051 INFO:tasks.ceph:Adding keys to all mons... 2024-05-08T18:06:42.051 DEBUG:teuthology.orchestra.run.smithi080:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T18:06:42.053 DEBUG:teuthology.orchestra.run.smithi115:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T18:06:42.097 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.y] 2024-05-08T18:06:42.097 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQASvztmUtZpLxAAwPe95huEksoIvMKeEDYhJQ== 2024-05-08T18:06:42.097 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.0] 2024-05-08T18:06:42.097 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQAVvztmxsnONxAApv60cet17uh3pH3auK9Vzg== 2024-05-08T18:06:42.097 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.1] 2024-05-08T18:06:42.097 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQAZvztmCVTcABAAHAHZFwTX8VvPYZ7OJZxpIQ== 2024-05-08T18:06:42.097 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.2] 2024-05-08T18:06:42.097 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQAcvztm4dddCBAA5qPwh/Bu7X1hunBEMDV+Kg== 2024-05-08T18:06:42.097 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.3] 2024-05-08T18:06:42.097 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQAfvztmC1cbDxAAxkdyWAcYjdOwRJQ32hgStQ== 2024-05-08T18:06:42.098 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.x] 2024-05-08T18:06:42.098 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQASvztm/3ceMhAAqZMhmzzO5z/hXbK7E0FhFA== 2024-05-08T18:06:42.098 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.4] 2024-05-08T18:06:42.098 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQAlvztmO46NCxAAwIW9PokmX26qMZ0ug3v9rQ== 2024-05-08T18:06:42.098 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.5] 2024-05-08T18:06:42.098 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQAovztm7jmDEBAAwZvQkD3WG9cEgV7gaG7JWQ== 2024-05-08T18:06:42.098 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.6] 2024-05-08T18:06:42.098 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQArvztmsuloFxAADD3/qSUOQ7LPwE3rnlDg3Q== 2024-05-08T18:06:42.098 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.7] 2024-05-08T18:06:42.098 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQAuvztmZZ8SHhAAFJlMwsnmDINImTkYtZOQPA== 2024-05-08T18:06:42.098 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-05-08T18:06:42.098 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQASvztmP/53NRAAIatl/st3QObZoOXjGkQNSA== 2024-05-08T18:06:42.098 INFO:teuthology.orchestra.run.smithi080.stdout:[client.1] 2024-05-08T18:06:42.098 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQASvztmNWBrOBAA5HVo/oQTdtSlYfoBYITYjQ== 2024-05-08T18:06:42.104 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.y] 2024-05-08T18:06:42.104 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQASvztmUtZpLxAAwPe95huEksoIvMKeEDYhJQ== 2024-05-08T18:06:42.104 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.0] 2024-05-08T18:06:42.104 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAVvztmxsnONxAApv60cet17uh3pH3auK9Vzg== 2024-05-08T18:06:42.104 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.1] 2024-05-08T18:06:42.104 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAZvztmCVTcABAAHAHZFwTX8VvPYZ7OJZxpIQ== 2024-05-08T18:06:42.104 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.2] 2024-05-08T18:06:42.104 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAcvztm4dddCBAA5qPwh/Bu7X1hunBEMDV+Kg== 2024-05-08T18:06:42.105 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.3] 2024-05-08T18:06:42.105 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAfvztmC1cbDxAAxkdyWAcYjdOwRJQ32hgStQ== 2024-05-08T18:06:42.105 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.x] 2024-05-08T18:06:42.105 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQASvztm/3ceMhAAqZMhmzzO5z/hXbK7E0FhFA== 2024-05-08T18:06:42.105 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.4] 2024-05-08T18:06:42.105 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAlvztmO46NCxAAwIW9PokmX26qMZ0ug3v9rQ== 2024-05-08T18:06:42.105 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.5] 2024-05-08T18:06:42.105 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAovztm7jmDEBAAwZvQkD3WG9cEgV7gaG7JWQ== 2024-05-08T18:06:42.105 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.6] 2024-05-08T18:06:42.105 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQArvztmsuloFxAADD3/qSUOQ7LPwE3rnlDg3Q== 2024-05-08T18:06:42.105 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.7] 2024-05-08T18:06:42.105 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAuvztmZZ8SHhAAFJlMwsnmDINImTkYtZOQPA== 2024-05-08T18:06:42.105 INFO:teuthology.orchestra.run.smithi115.stdout:[client.0] 2024-05-08T18:06:42.105 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQASvztmP/53NRAAIatl/st3QObZoOXjGkQNSA== 2024-05-08T18:06:42.106 INFO:teuthology.orchestra.run.smithi115.stdout:[client.1] 2024-05-08T18:06:42.106 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQASvztmNWBrOBAA5HVo/oQTdtSlYfoBYITYjQ== 2024-05-08T18:06:42.106 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T18:06:42.145 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T18:06:42.195 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:06:42.197 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:06:42.238 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:06:42.281 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:06:42.320 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:06:42.362 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:06:42.403 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:06:42.449 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:06:42.489 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T18:06:42.537 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T18:06:42.580 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:06:42.583 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:06:42.658 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:06:42.665 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:06:42.746 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:06:42.749 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:06:42.834 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:06:42.837 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:06:42.923 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T18:06:42.925 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T18:06:43.011 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T18:06:43.013 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T18:06:43.056 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-08T18:06:43.056 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-08T18:06:43.108 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T18:06:43.200 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-08T18:06:43.210 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-08T18:06:43.261 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T18:06:43.349 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-08T18:06:43.359 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-08T18:06:43.374 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T18:06:43.468 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-08T18:06:43.479 DEBUG:teuthology.orchestra.run.smithi080:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:06:43.481 DEBUG:teuthology.orchestra.run.smithi115:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:06:43.526 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-08T18:06:43.526 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T18:06:43.527 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T18:06:43.529 INFO:tasks.ceph.mon.a:Started 2024-05-08T18:06:43.529 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T18:06:43.529 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T18:06:43.532 INFO:tasks.ceph.mon.c:Started 2024-05-08T18:06:43.532 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T18:06:43.532 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T18:06:43.571 INFO:tasks.ceph.mon.b:Started 2024-05-08T18:06:43.571 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-08T18:06:43.572 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-08T18:06:43.572 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-08T18:06:43.574 INFO:tasks.ceph.mgr.y:Started 2024-05-08T18:06:43.574 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-08T18:06:43.574 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-08T18:06:43.577 INFO:tasks.ceph.mgr.x:Started 2024-05-08T18:06:43.577 INFO:tasks.ceph:Setting crush tunables to default 2024-05-08T18:06:43.577 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd crush tunables default 2024-05-08T18:06:49.057 INFO:teuthology.orchestra.run.smithi080.stderr:adjusted tunables profile to default 2024-05-08T18:06:49.076 INFO:tasks.ceph:check_enable_crimson: False 2024-05-08T18:06:49.076 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-08T18:06:49.077 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:49.077 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-08T18:06:49.087 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:49.087 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-08T18:06:49.143 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:49.143 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-08T18:06:49.195 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:06:49.195 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-08T18:06:49.201 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:49.201+0000 7fa778a47180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T18:06:49.212 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:49.212 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-08T18:06:49.227 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:49.227 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-08T18:06:49.286 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:49.286 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-08T18:06:49.342 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-08T18:06:49.342 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-08T18:06:49.397 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new e14e7bbc-18b8-4961-bcde-109f22cc52e6 0 2024-05-08T18:06:49.717 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:49.717+0000 7fa778a47180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T18:06:49.924 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:49.925+0000 7fa778a47180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T18:06:49.966 INFO:teuthology.orchestra.run.smithi115.stdout:0 2024-05-08T18:06:49.985 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new d4ce30c2-52b8-45a3-8a34-b0addc8311dd 1 2024-05-08T18:06:50.110 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:50.113+0000 7f734cd9d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T18:06:50.194 INFO:teuthology.orchestra.run.smithi115.stdout:1 2024-05-08T18:06:50.212 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 0049cbe1-578f-4202-a572-2328d79f0496 2 2024-05-08T18:06:50.420 INFO:teuthology.orchestra.run.smithi115.stdout:2 2024-05-08T18:06:50.438 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 3ec754a0-b0ca-4d44-bce0-7c380245ec0a 3 2024-05-08T18:06:50.486 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:50.485+0000 7fa778a47180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T18:06:50.539 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:50.537+0000 7fa778a47180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T18:06:50.592 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:50.593+0000 7fa778a47180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T18:06:50.614 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:50.617+0000 7f734cd9d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T18:06:50.640 INFO:teuthology.orchestra.run.smithi115.stdout:3 2024-05-08T18:06:50.657 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d 4 2024-05-08T18:06:50.669 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:50.669+0000 7fa778a47180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T18:06:50.721 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:50.721+0000 7fa778a47180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T18:06:50.798 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:50.797+0000 7fa778a47180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T18:06:50.841 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:50.841+0000 7f734cd9d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T18:06:50.850 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:50.849+0000 7fa778a47180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T18:06:50.860 INFO:teuthology.orchestra.run.smithi115.stdout:4 2024-05-08T18:06:50.877 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 3dc618ad-e40d-418e-844c-57572043f866 5 2024-05-08T18:06:51.002 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:51.001+0000 7fa778a47180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T18:06:51.063 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:51.061+0000 7fa778a47180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T18:06:51.079 INFO:teuthology.orchestra.run.smithi115.stdout:5 2024-05-08T18:06:51.096 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 1f8172c6-5d27-4542-80a6-1c630dddf752 6 2024-05-08T18:06:51.302 INFO:teuthology.orchestra.run.smithi115.stdout:6 2024-05-08T18:06:51.318 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new e4146a73-11ca-4499-afa7-23e23d70a662 7 2024-05-08T18:06:51.419 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:51.421+0000 7f734cd9d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T18:06:51.487 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:51.489+0000 7f734cd9d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T18:06:51.529 INFO:teuthology.orchestra.run.smithi115.stdout:7 2024-05-08T18:06:51.545 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:51.545+0000 7f734cd9d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T18:06:51.546 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-08T18:06:51.546 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-08T18:06:51.548 INFO:tasks.ceph.osd.0:Started 2024-05-08T18:06:51.549 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-08T18:06:51.549 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-08T18:06:51.551 INFO:tasks.ceph.osd.1:Started 2024-05-08T18:06:51.551 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-08T18:06:51.552 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-08T18:06:51.554 INFO:tasks.ceph.osd.2:Started 2024-05-08T18:06:51.554 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-08T18:06:51.554 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-08T18:06:51.557 INFO:tasks.ceph.osd.3:Started 2024-05-08T18:06:51.557 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-08T18:06:51.557 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-08T18:06:51.560 INFO:tasks.ceph.osd.4:Started 2024-05-08T18:06:51.560 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-08T18:06:51.560 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-08T18:06:51.563 INFO:tasks.ceph.osd.5:Started 2024-05-08T18:06:51.563 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-08T18:06:51.563 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-08T18:06:51.566 INFO:tasks.ceph.osd.6:Started 2024-05-08T18:06:51.566 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-08T18:06:51.566 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-08T18:06:51.568 INFO:tasks.ceph.osd.7:Started 2024-05-08T18:06:51.569 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:06:51.648 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:51.649+0000 7f734cd9d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T18:06:51.704 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:51.705+0000 7f734cd9d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T18:06:51.739 INFO:tasks.ceph.mgr.y.smithi080.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-08T18:06:51.739 INFO:tasks.ceph.mgr.y.smithi080.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-08T18:06:51.739 INFO:tasks.ceph.mgr.y.smithi080.stderr: from numpy import show_config as show_numpy_config 2024-05-08T18:06:51.762 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:06:51.762 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"fsid":"0d8284a2-bb69-4df9-9f45-9ef5b469ca40","created":"2024-05-08T18:06:48.916680+0000","modified":"2024-05-08T18:06:51.530709+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T18:06:51.530709+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e14e7bbc-18b8-4961-bcde-109f22cc52e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d4ce30c2-52b8-45a3-8a34-b0addc8311dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0049cbe1-578f-4202-a572-2328d79f0496","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ec754a0-b0ca-4d44-bce0-7c380245ec0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3dc618ad-e40d-418e-844c-57572043f866","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1f8172c6-5d27-4542-80a6-1c630dddf752","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e4146a73-11ca-4499-afa7-23e23d70a662","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:06:51.780 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-08T18:06:51.781 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-08T18:06:51.784 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:51.785+0000 7f734cd9d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T18:06:51.784 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:51.785+0000 7fa778a47180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T18:06:51.836 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:51.837+0000 7f734cd9d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T18:06:51.929 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:51.929+0000 7fa778a47180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T18:06:51.986 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:51.985+0000 7f734cd9d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T18:06:52.047 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:52.049+0000 7f734cd9d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T18:06:52.113 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:52.113+0000 7fa778a47180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T18:06:52.182 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:52.181+0000 7fa778a47180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T18:06:52.193 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:06:52.193+0000 7f48cbafc7c0 -1 Falling back to public interface 2024-05-08T18:06:52.194 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:06:52.193+0000 7f55e7ffc7c0 -1 Falling back to public interface 2024-05-08T18:06:52.194 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:06:52.193+0000 7f8e75e807c0 -1 Falling back to public interface 2024-05-08T18:06:52.195 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:06:52.197+0000 7f17ce93a7c0 -1 Falling back to public interface 2024-05-08T18:06:52.207 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:06:52.209+0000 7efd7b0917c0 -1 Falling back to public interface 2024-05-08T18:06:52.208 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:06:52.209+0000 7f2d7ddc47c0 -1 Falling back to public interface 2024-05-08T18:06:52.218 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:06:52.221+0000 7fc68524e7c0 -1 Falling back to public interface 2024-05-08T18:06:52.219 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:06:52.221+0000 7fd4bd3997c0 -1 Falling back to public interface 2024-05-08T18:06:52.331 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:52.329+0000 7fa778a47180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T18:06:52.586 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T18:06:52.637 INFO:tasks.ceph.mgr.x.smithi115.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-08T18:06:52.638 INFO:tasks.ceph.mgr.x.smithi115.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-08T18:06:52.638 INFO:tasks.ceph.mgr.x.smithi115.stderr: from numpy import show_config as show_numpy_config 2024-05-08T18:06:52.697 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:52.697+0000 7f734cd9d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T18:06:52.761 INFO:teuthology.misc.health.smithi080.stdout: 2024-05-08T18:06:52.761 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":10,"fsid":"0d8284a2-bb69-4df9-9f45-9ef5b469ca40","created":"2024-05-08T18:06:48.916680+0000","modified":"2024-05-08T18:06:51.530709+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T18:06:51.530709+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e14e7bbc-18b8-4961-bcde-109f22cc52e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d4ce30c2-52b8-45a3-8a34-b0addc8311dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0049cbe1-578f-4202-a572-2328d79f0496","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ec754a0-b0ca-4d44-bce0-7c380245ec0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3dc618ad-e40d-418e-844c-57572043f866","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1f8172c6-5d27-4542-80a6-1c630dddf752","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e4146a73-11ca-4499-afa7-23e23d70a662","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:06:52.776 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T18:06:52.870 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:52.873+0000 7f734cd9d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T18:06:52.945 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:52.945+0000 7fa778a47180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T18:06:53.020 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:53.021+0000 7fa778a47180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T18:06:53.057 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:53.057+0000 7f734cd9d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T18:06:53.127 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:53.129+0000 7f734cd9d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T18:06:53.201 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:53.201+0000 7fa778a47180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T18:06:53.275 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:53.273+0000 7fa778a47180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T18:06:53.275 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:53.277+0000 7f734cd9d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T18:06:53.561 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:53.561+0000 7fa778a47180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T18:06:53.623 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:53.621+0000 7fa778a47180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T18:06:53.949 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:53.949+0000 7f734cd9d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T18:06:54.024 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:54.025+0000 7f734cd9d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T18:06:54.205 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:54.205+0000 7f734cd9d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T18:06:54.278 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:54.281+0000 7f734cd9d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T18:06:54.565 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:54.565+0000 7f734cd9d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T18:06:54.626 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-08T18:06:54.629+0000 7f734cd9d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T18:06:54.659 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:54.657+0000 7fa71f590640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-08T18:06:54.659 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T18:06:54.661+0000 7fa71f590640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-08T18:06:55.742 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:06:55.741+0000 7f8e75e807c0 -1 osd.3 0 log_to_monitors true 2024-05-08T18:06:55.840 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:06:55.841+0000 7f48cbafc7c0 -1 osd.1 0 log_to_monitors true 2024-05-08T18:06:55.934 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:06:55.933+0000 7f55e7ffc7c0 -1 osd.0 0 log_to_monitors true 2024-05-08T18:06:56.068 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:06:56.069+0000 7f17ce93a7c0 -1 osd.6 0 log_to_monitors true 2024-05-08T18:06:56.087 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:06:56.089+0000 7efd7b0917c0 -1 osd.7 0 log_to_monitors true 2024-05-08T18:06:56.112 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:06:56.113+0000 7fc68524e7c0 -1 osd.4 0 log_to_monitors true 2024-05-08T18:06:56.117 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:06:56.117+0000 7f2d7ddc47c0 -1 osd.2 0 log_to_monitors true 2024-05-08T18:06:56.145 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:06:56.145+0000 7fd4bd3997c0 -1 osd.5 0 log_to_monitors true 2024-05-08T18:06:59.582 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T18:06:59.769 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:06:59.769+0000 7efd7703a640 -1 osd.7 0 waiting for initial osdmap 2024-05-08T18:06:59.775 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:06:59.777+0000 7fd4b9342640 -1 osd.5 0 waiting for initial osdmap 2024-05-08T18:06:59.799 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:06:59.801+0000 7efd6ee6e640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:06:59.814 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:06:59.817+0000 7fd4b1176640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:06:59.848 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:06:59.849+0000 7fc6811f7640 -1 osd.4 0 waiting for initial osdmap 2024-05-08T18:06:59.865 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:06:59.865+0000 7f17cb0f5640 -1 osd.6 0 waiting for initial osdmap 2024-05-08T18:06:59.875 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:06:59.877+0000 7fc67902b640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:06:59.886 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:06:59.889+0000 7f17c2717640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:06:59.940 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:06:59.941+0000 7f48c7aa5640 -1 osd.1 0 waiting for initial osdmap 2024-05-08T18:06:59.964 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:06:59.965+0000 7f2d79d6d640 -1 osd.2 0 waiting for initial osdmap 2024-05-08T18:06:59.968 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:06:59.969+0000 7f48bf8d9640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:06:59.978 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:06:59.977+0000 7f55e3fa5640 -1 osd.0 0 waiting for initial osdmap 2024-05-08T18:06:59.980 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:06:59.981+0000 7f2d71ba1640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:07:00.006 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:00.005+0000 7f55dbdd9640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:07:00.032 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:00.033+0000 7f8e7263b640 -1 osd.3 0 waiting for initial osdmap 2024-05-08T18:07:00.040 INFO:teuthology.misc.health.smithi080.stdout: 2024-05-08T18:07:00.040 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":12,"fsid":"0d8284a2-bb69-4df9-9f45-9ef5b469ca40","created":"2024-05-08T18:06:48.916680+0000","modified":"2024-05-08T18:06:57.682048+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T18:06:51.530709+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e14e7bbc-18b8-4961-bcde-109f22cc52e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d4ce30c2-52b8-45a3-8a34-b0addc8311dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0049cbe1-578f-4202-a572-2328d79f0496","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ec754a0-b0ca-4d44-bce0-7c380245ec0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3dc618ad-e40d-418e-844c-57572043f866","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1f8172c6-5d27-4542-80a6-1c630dddf752","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e4146a73-11ca-4499-afa7-23e23d70a662","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:07:00.056 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T18:07:00.060 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:00.061+0000 7f8e69c5d640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:07:06.864 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T18:07:07.155 INFO:teuthology.misc.health.smithi080.stdout: 2024-05-08T18:07:07.155 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":16,"fsid":"0d8284a2-bb69-4df9-9f45-9ef5b469ca40","created":"2024-05-08T18:06:48.916680+0000","modified":"2024-05-08T18:07:03.954252+0000","last_up_change":"2024-05-08T18:07:00.796481+0000","last_in_change":"2024-05-08T18:06:51.530709+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:07:01.699859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e14e7bbc-18b8-4961-bcde-109f22cc52e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6812","nonce":3565382691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6817","nonce":3565382691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6823","nonce":3565382691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6821","nonce":3565382691}]},"public_addr":"172.21.15.80:6812/3565382691","cluster_addr":"172.21.15.80:6817/3565382691","heartbeat_back_addr":"172.21.15.80:6823/3565382691","heartbeat_front_addr":"172.21.15.80:6821/3565382691","state":["exists","up"]},{"osd":1,"uuid":"d4ce30c2-52b8-45a3-8a34-b0addc8311dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6801","nonce":3922502534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6803","nonce":3922502534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6807","nonce":3922502534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6805","nonce":3922502534}]},"public_addr":"172.21.15.80:6801/3922502534","cluster_addr":"172.21.15.80:6803/3922502534","heartbeat_back_addr":"172.21.15.80:6807/3922502534","heartbeat_front_addr":"172.21.15.80:6805/3922502534","state":["exists","up"]},{"osd":2,"uuid":"0049cbe1-578f-4202-a572-2328d79f0496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6825","nonce":3474282780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6827","nonce":3474282780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6831","nonce":3474282780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6829","nonce":3474282780}]},"public_addr":"172.21.15.80:6825/3474282780","cluster_addr":"172.21.15.80:6827/3474282780","heartbeat_back_addr":"172.21.15.80:6831/3474282780","heartbeat_front_addr":"172.21.15.80:6829/3474282780","state":["exists","up"]},{"osd":3,"uuid":"3ec754a0-b0ca-4d44-bce0-7c380245ec0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6810","nonce":3525633066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6813","nonce":3525633066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6820","nonce":3525633066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6816","nonce":3525633066}]},"public_addr":"172.21.15.80:6810/3525633066","cluster_addr":"172.21.15.80:6813/3525633066","heartbeat_back_addr":"172.21.15.80:6820/3525633066","heartbeat_front_addr":"172.21.15.80:6816/3525633066","state":["exists","up"]},{"osd":4,"uuid":"1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6817","nonce":4103080494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6821","nonce":4103080494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6827","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6829","nonce":4103080494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6825","nonce":4103080494}]},"public_addr":"172.21.15.115:6817/4103080494","cluster_addr":"172.21.15.115:6821/4103080494","heartbeat_back_addr":"172.21.15.115:6829/4103080494","heartbeat_front_addr":"172.21.15.115:6825/4103080494","state":["exists","up"]},{"osd":5,"uuid":"3dc618ad-e40d-418e-844c-57572043f866","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6820","nonce":87947085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6824","nonce":87947085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6831","nonce":87947085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6828","nonce":87947085}]},"public_addr":"172.21.15.115:6820/87947085","cluster_addr":"172.21.15.115:6824/87947085","heartbeat_back_addr":"172.21.15.115:6831/87947085","heartbeat_front_addr":"172.21.15.115:6828/87947085","state":["exists","up"]},{"osd":6,"uuid":"1f8172c6-5d27-4542-80a6-1c630dddf752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6801","nonce":2090404725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6803","nonce":2090404725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6807","nonce":2090404725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6805","nonce":2090404725}]},"public_addr":"172.21.15.115:6801/2090404725","cluster_addr":"172.21.15.115:6803/2090404725","heartbeat_back_addr":"172.21.15.115:6807/2090404725","heartbeat_front_addr":"172.21.15.115:6805/2090404725","state":["exists","up"]},{"osd":7,"uuid":"e4146a73-11ca-4499-afa7-23e23d70a662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6809","nonce":133828553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6811","nonce":133828553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6815","nonce":133828553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6813","nonce":133828553}]},"public_addr":"172.21.15.115:6809/133828553","cluster_addr":"172.21.15.115:6811/133828553","heartbeat_back_addr":"172.21.15.115:6815/133828553","heartbeat_front_addr":"172.21.15.115:6813/133828553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.936317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.814583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.168294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.751445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.091268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.113133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.054822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.057214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:07:07.170 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-08T18:07:07.171 INFO:tasks.ceph:Creating RBD pool 2024-05-08T18:07:07.171 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-08T18:07:08.410 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'rbd' created 2024-05-08T18:07:08.433 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-08T18:07:09.411 INFO:teuthology.orchestra.run.smithi080.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-08T18:07:09.440 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-08T18:07:09.440 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T18:07:09.440 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-08T18:07:09.441 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-08T18:07:09.441 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-08T18:07:09.783 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:07:09.799 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":6,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":251797614},{"type":"v1","addr":"172.21.15.80:6833","nonce":251797614}]},"active_addr":"172.21.15.80:6833/251797614","active_change":"2024-05-08T18:06:53.646012+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":2052045840}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":3468971994}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":4053199289}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":1744443961}]}]} 2024-05-08T18:07:09.806 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-08T18:07:09.806 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T18:07:09.806 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:07:10.106 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:07:10.106 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":18,"fsid":"0d8284a2-bb69-4df9-9f45-9ef5b469ca40","created":"2024-05-08T18:06:48.916680+0000","modified":"2024-05-08T18:07:09.407834+0000","last_up_change":"2024-05-08T18:07:00.796481+0000","last_in_change":"2024-05-08T18:06:51.530709+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:07:01.699859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:07:07.479756+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e14e7bbc-18b8-4961-bcde-109f22cc52e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6812","nonce":3565382691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6817","nonce":3565382691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6823","nonce":3565382691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6821","nonce":3565382691}]},"public_addr":"172.21.15.80:6812/3565382691","cluster_addr":"172.21.15.80:6817/3565382691","heartbeat_back_addr":"172.21.15.80:6823/3565382691","heartbeat_front_addr":"172.21.15.80:6821/3565382691","state":["exists","up"]},{"osd":1,"uuid":"d4ce30c2-52b8-45a3-8a34-b0addc8311dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6801","nonce":3922502534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6803","nonce":3922502534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6807","nonce":3922502534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6805","nonce":3922502534}]},"public_addr":"172.21.15.80:6801/3922502534","cluster_addr":"172.21.15.80:6803/3922502534","heartbeat_back_addr":"172.21.15.80:6807/3922502534","heartbeat_front_addr":"172.21.15.80:6805/3922502534","state":["exists","up"]},{"osd":2,"uuid":"0049cbe1-578f-4202-a572-2328d79f0496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6825","nonce":3474282780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6827","nonce":3474282780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6831","nonce":3474282780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6829","nonce":3474282780}]},"public_addr":"172.21.15.80:6825/3474282780","cluster_addr":"172.21.15.80:6827/3474282780","heartbeat_back_addr":"172.21.15.80:6831/3474282780","heartbeat_front_addr":"172.21.15.80:6829/3474282780","state":["exists","up"]},{"osd":3,"uuid":"3ec754a0-b0ca-4d44-bce0-7c380245ec0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6810","nonce":3525633066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6813","nonce":3525633066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6820","nonce":3525633066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6816","nonce":3525633066}]},"public_addr":"172.21.15.80:6810/3525633066","cluster_addr":"172.21.15.80:6813/3525633066","heartbeat_back_addr":"172.21.15.80:6820/3525633066","heartbeat_front_addr":"172.21.15.80:6816/3525633066","state":["exists","up"]},{"osd":4,"uuid":"1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6817","nonce":4103080494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6821","nonce":4103080494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6827","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6829","nonce":4103080494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6825","nonce":4103080494}]},"public_addr":"172.21.15.115:6817/4103080494","cluster_addr":"172.21.15.115:6821/4103080494","heartbeat_back_addr":"172.21.15.115:6829/4103080494","heartbeat_front_addr":"172.21.15.115:6825/4103080494","state":["exists","up"]},{"osd":5,"uuid":"3dc618ad-e40d-418e-844c-57572043f866","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6820","nonce":87947085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6824","nonce":87947085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6831","nonce":87947085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6828","nonce":87947085}]},"public_addr":"172.21.15.115:6820/87947085","cluster_addr":"172.21.15.115:6824/87947085","heartbeat_back_addr":"172.21.15.115:6831/87947085","heartbeat_front_addr":"172.21.15.115:6828/87947085","state":["exists","up"]},{"osd":6,"uuid":"1f8172c6-5d27-4542-80a6-1c630dddf752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6801","nonce":2090404725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6803","nonce":2090404725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6807","nonce":2090404725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6805","nonce":2090404725}]},"public_addr":"172.21.15.115:6801/2090404725","cluster_addr":"172.21.15.115:6803/2090404725","heartbeat_back_addr":"172.21.15.115:6807/2090404725","heartbeat_front_addr":"172.21.15.115:6805/2090404725","state":["exists","up"]},{"osd":7,"uuid":"e4146a73-11ca-4499-afa7-23e23d70a662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6809","nonce":133828553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6811","nonce":133828553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6815","nonce":133828553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6813","nonce":133828553}]},"public_addr":"172.21.15.115:6809/133828553","cluster_addr":"172.21.15.115:6811/133828553","heartbeat_back_addr":"172.21.15.115:6815/133828553","heartbeat_front_addr":"172.21.15.115:6813/133828553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.936317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.814583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.168294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.751445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.091268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.113133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.054822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.057214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:07:10.124 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T18:07:10.124 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:07:10.403 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:07:10.403 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":18,"fsid":"0d8284a2-bb69-4df9-9f45-9ef5b469ca40","created":"2024-05-08T18:06:48.916680+0000","modified":"2024-05-08T18:07:09.407834+0000","last_up_change":"2024-05-08T18:07:00.796481+0000","last_in_change":"2024-05-08T18:06:51.530709+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:07:01.699859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:07:07.479756+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e14e7bbc-18b8-4961-bcde-109f22cc52e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6812","nonce":3565382691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6817","nonce":3565382691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6823","nonce":3565382691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6821","nonce":3565382691}]},"public_addr":"172.21.15.80:6812/3565382691","cluster_addr":"172.21.15.80:6817/3565382691","heartbeat_back_addr":"172.21.15.80:6823/3565382691","heartbeat_front_addr":"172.21.15.80:6821/3565382691","state":["exists","up"]},{"osd":1,"uuid":"d4ce30c2-52b8-45a3-8a34-b0addc8311dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6801","nonce":3922502534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6803","nonce":3922502534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6807","nonce":3922502534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6805","nonce":3922502534}]},"public_addr":"172.21.15.80:6801/3922502534","cluster_addr":"172.21.15.80:6803/3922502534","heartbeat_back_addr":"172.21.15.80:6807/3922502534","heartbeat_front_addr":"172.21.15.80:6805/3922502534","state":["exists","up"]},{"osd":2,"uuid":"0049cbe1-578f-4202-a572-2328d79f0496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6825","nonce":3474282780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6827","nonce":3474282780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6831","nonce":3474282780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6829","nonce":3474282780}]},"public_addr":"172.21.15.80:6825/3474282780","cluster_addr":"172.21.15.80:6827/3474282780","heartbeat_back_addr":"172.21.15.80:6831/3474282780","heartbeat_front_addr":"172.21.15.80:6829/3474282780","state":["exists","up"]},{"osd":3,"uuid":"3ec754a0-b0ca-4d44-bce0-7c380245ec0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6810","nonce":3525633066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6813","nonce":3525633066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6820","nonce":3525633066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6816","nonce":3525633066}]},"public_addr":"172.21.15.80:6810/3525633066","cluster_addr":"172.21.15.80:6813/3525633066","heartbeat_back_addr":"172.21.15.80:6820/3525633066","heartbeat_front_addr":"172.21.15.80:6816/3525633066","state":["exists","up"]},{"osd":4,"uuid":"1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6817","nonce":4103080494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6821","nonce":4103080494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6827","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6829","nonce":4103080494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6825","nonce":4103080494}]},"public_addr":"172.21.15.115:6817/4103080494","cluster_addr":"172.21.15.115:6821/4103080494","heartbeat_back_addr":"172.21.15.115:6829/4103080494","heartbeat_front_addr":"172.21.15.115:6825/4103080494","state":["exists","up"]},{"osd":5,"uuid":"3dc618ad-e40d-418e-844c-57572043f866","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6820","nonce":87947085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6824","nonce":87947085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6831","nonce":87947085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6828","nonce":87947085}]},"public_addr":"172.21.15.115:6820/87947085","cluster_addr":"172.21.15.115:6824/87947085","heartbeat_back_addr":"172.21.15.115:6831/87947085","heartbeat_front_addr":"172.21.15.115:6828/87947085","state":["exists","up"]},{"osd":6,"uuid":"1f8172c6-5d27-4542-80a6-1c630dddf752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6801","nonce":2090404725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6803","nonce":2090404725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6807","nonce":2090404725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6805","nonce":2090404725}]},"public_addr":"172.21.15.115:6801/2090404725","cluster_addr":"172.21.15.115:6803/2090404725","heartbeat_back_addr":"172.21.15.115:6807/2090404725","heartbeat_front_addr":"172.21.15.115:6805/2090404725","state":["exists","up"]},{"osd":7,"uuid":"e4146a73-11ca-4499-afa7-23e23d70a662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6809","nonce":133828553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6811","nonce":133828553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6815","nonce":133828553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6813","nonce":133828553}]},"public_addr":"172.21.15.115:6809/133828553","cluster_addr":"172.21.15.115:6811/133828553","heartbeat_back_addr":"172.21.15.115:6815/133828553","heartbeat_front_addr":"172.21.15.115:6813/133828553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.936317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.814583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.168294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.751445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.091268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.113133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.054822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.057214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:07:10.422 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T18:07:10.422 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T18:07:10.423 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T18:07:10.423 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T18:07:10.423 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-08T18:07:10.424 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-08T18:07:10.424 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-08T18:07:10.425 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-08T18:07:10.662 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2024-05-08T18:07:10.663 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T18:07:10.673 INFO:teuthology.orchestra.run.smithi080.stdout:55834574852 2024-05-08T18:07:10.674 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T18:07:10.675 INFO:teuthology.orchestra.run.smithi080.stdout:55834574851 2024-05-08T18:07:10.675 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T18:07:10.688 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2024-05-08T18:07:10.688 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T18:07:10.690 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2024-05-08T18:07:10.691 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T18:07:10.699 INFO:teuthology.orchestra.run.smithi080.stdout:55834574852 2024-05-08T18:07:10.699 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T18:07:10.705 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2024-05-08T18:07:10.705 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T18:07:10.710 INFO:teuthology.orchestra.run.smithi080.stdout:55834574851 2024-05-08T18:07:10.710 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T18:07:11.193 INFO:teuthology.orchestra.run.smithi080.stdout:55834574852 2024-05-08T18:07:11.199 INFO:teuthology.orchestra.run.smithi080.stdout:55834574852 2024-05-08T18:07:11.205 INFO:teuthology.orchestra.run.smithi080.stdout:55834574852 2024-05-08T18:07:11.211 INFO:teuthology.orchestra.run.smithi080.stdout:55834574850 2024-05-08T18:07:11.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-05-08T18:07:11.225 INFO:teuthology.orchestra.run.smithi080.stdout:55834574851 2024-05-08T18:07:11.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-05-08T18:07:11.238 INFO:teuthology.orchestra.run.smithi080.stdout:55834574851 2024-05-08T18:07:11.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.7 2024-05-08T18:07:11.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-05-08T18:07:11.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.3 2024-05-08T18:07:11.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2024-05-08T18:07:11.268 INFO:teuthology.orchestra.run.smithi080.stdout:55834574852 2024-05-08T18:07:11.268 INFO:teuthology.orchestra.run.smithi080.stdout:55834574850 2024-05-08T18:07:11.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.5 2024-05-08T18:07:11.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-05-08T18:07:12.222 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T18:07:12.238 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T18:07:12.244 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T18:07:12.248 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T18:07:12.248 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T18:07:12.264 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T18:07:12.288 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T18:07:12.288 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T18:07:12.757 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2024-05-08T18:07:12.777 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2024-05-08T18:07:12.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-05-08T18:07:12.779 DEBUG:teuthology.parallel:result is None 2024-05-08T18:07:12.789 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2024-05-08T18:07:12.800 INFO:teuthology.orchestra.run.smithi080.stdout:55834574851 2024-05-08T18:07:12.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-05-08T18:07:12.804 DEBUG:teuthology.parallel:result is None 2024-05-08T18:07:12.811 INFO:teuthology.orchestra.run.smithi080.stdout:55834574852 2024-05-08T18:07:12.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-05-08T18:07:12.817 DEBUG:teuthology.parallel:result is None 2024-05-08T18:07:12.820 INFO:teuthology.orchestra.run.smithi080.stdout:55834574852 2024-05-08T18:07:12.826 INFO:teuthology.orchestra.run.smithi080.stdout:55834574851 2024-05-08T18:07:12.829 INFO:teuthology.orchestra.run.smithi080.stdout:55834574853 2024-05-08T18:07:12.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.7 2024-05-08T18:07:12.831 DEBUG:teuthology.parallel:result is None 2024-05-08T18:07:12.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-05-08T18:07:12.835 DEBUG:teuthology.parallel:result is None 2024-05-08T18:07:12.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2024-05-08T18:07:12.845 DEBUG:teuthology.parallel:result is None 2024-05-08T18:07:12.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.5 2024-05-08T18:07:12.854 DEBUG:teuthology.parallel:result is None 2024-05-08T18:07:12.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-05-08T18:07:12.857 DEBUG:teuthology.parallel:result is None 2024-05-08T18:07:12.857 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T18:07:12.857 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:07:13.164 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:07:13.165 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:07:13.180 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-05-08T18:07:11.657623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218760,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755960,"statfs":{"total":773094113280,"available":772870103040,"internally_reserved":0,"allocated":2629632,"data_stored":1639264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001190"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.437444+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:07:09.437444+0000","last_peered":"2024-05-08T18:07:09.437444+0000","last_clean":"2024-05-08T18:07:09.437444+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:07:09.437444+0000","last_undegraded":"2024-05-08T18:07:09.437444+0000","last_fullsized":"2024-05-08T18:07:09.437444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:55.431327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.434528+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:07:09.434528+0000","last_peered":"2024-05-08T18:07:09.434528+0000","last_clean":"2024-05-08T18:07:09.434528+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:07:09.434528+0000","last_undegraded":"2024-05-08T18:07:09.434528+0000","last_fullsized":"2024-05-08T18:07:09.434528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:55.431327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.437267+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:07:09.437267+0000","last_peered":"2024-05-08T18:07:09.437267+0000","last_clean":"2024-05-08T18:07:09.437267+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:07:09.437267+0000","last_undegraded":"2024-05-08T18:07:09.437267+0000","last_fullsized":"2024-05-08T18:07:09.437267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.439953+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:07:09.439953+0000","last_peered":"2024-05-08T18:07:09.439953+0000","last_clean":"2024-05-08T18:07:09.439953+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:07:09.439953+0000","last_undegraded":"2024-05-08T18:07:09.439953+0000","last_fullsized":"2024-05-08T18:07:09.439953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.432765+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:07:09.432765+0000","last_peered":"2024-05-08T18:07:09.432765+0000","last_clean":"2024-05-08T18:07:09.432765+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:07:09.432765+0000","last_undegraded":"2024-05-08T18:07:09.432765+0000","last_fullsized":"2024-05-08T18:07:09.432765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:38.583164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.431634+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:07:09.431634+0000","last_peered":"2024-05-08T18:07:09.431634+0000","last_clean":"2024-05-08T18:07:09.431634+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:07:09.431634+0000","last_undegraded":"2024-05-08T18:07:09.431634+0000","last_fullsized":"2024-05-08T18:07:09.431634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:55.431327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.433593+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:07:09.433593+0000","last_peered":"2024-05-08T18:07:09.433593+0000","last_clean":"2024-05-08T18:07:09.433593+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:07:09.433593+0000","last_undegraded":"2024-05-08T18:07:09.433593+0000","last_fullsized":"2024-05-08T18:07:09.433593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.433461+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:07:09.433461+0000","last_peered":"2024-05-08T18:07:09.433461+0000","last_clean":"2024-05-08T18:07:09.433461+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:07:09.433461+0000","last_undegraded":"2024-05-08T18:07:09.433461+0000","last_fullsized":"2024-05-08T18:07:09.433461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:55.431327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":106,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.424712+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:07:09.424712+0000","last_peered":"2024-05-08T18:07:09.424712+0000","last_clean":"2024-05-08T18:07:09.424712+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:07:09.424712+0000","last_undegraded":"2024-05-08T18:07:09.424712+0000","last_fullsized":"2024-05-08T18:07:09.424712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:07:13.181 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:07:13.459 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:07:13.460 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:07:13.476 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-05-08T18:07:11.657623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218760,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755960,"statfs":{"total":773094113280,"available":772870103040,"internally_reserved":0,"allocated":2629632,"data_stored":1639264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001190"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.437444+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:07:09.437444+0000","last_peered":"2024-05-08T18:07:09.437444+0000","last_clean":"2024-05-08T18:07:09.437444+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:07:09.437444+0000","last_undegraded":"2024-05-08T18:07:09.437444+0000","last_fullsized":"2024-05-08T18:07:09.437444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:55.431327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.434528+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:07:09.434528+0000","last_peered":"2024-05-08T18:07:09.434528+0000","last_clean":"2024-05-08T18:07:09.434528+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:07:09.434528+0000","last_undegraded":"2024-05-08T18:07:09.434528+0000","last_fullsized":"2024-05-08T18:07:09.434528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:55.431327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.437267+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:07:09.437267+0000","last_peered":"2024-05-08T18:07:09.437267+0000","last_clean":"2024-05-08T18:07:09.437267+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:07:09.437267+0000","last_undegraded":"2024-05-08T18:07:09.437267+0000","last_fullsized":"2024-05-08T18:07:09.437267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.439953+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:07:09.439953+0000","last_peered":"2024-05-08T18:07:09.439953+0000","last_clean":"2024-05-08T18:07:09.439953+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:07:09.439953+0000","last_undegraded":"2024-05-08T18:07:09.439953+0000","last_fullsized":"2024-05-08T18:07:09.439953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.432765+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:07:09.432765+0000","last_peered":"2024-05-08T18:07:09.432765+0000","last_clean":"2024-05-08T18:07:09.432765+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:07:09.432765+0000","last_undegraded":"2024-05-08T18:07:09.432765+0000","last_fullsized":"2024-05-08T18:07:09.432765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:38.583164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.431634+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:07:09.431634+0000","last_peered":"2024-05-08T18:07:09.431634+0000","last_clean":"2024-05-08T18:07:09.431634+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:07:09.431634+0000","last_undegraded":"2024-05-08T18:07:09.431634+0000","last_fullsized":"2024-05-08T18:07:09.431634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:55.431327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.433593+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:07:09.433593+0000","last_peered":"2024-05-08T18:07:09.433593+0000","last_clean":"2024-05-08T18:07:09.433593+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:07:09.433593+0000","last_undegraded":"2024-05-08T18:07:09.433593+0000","last_fullsized":"2024-05-08T18:07:09.433593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.433461+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:07:09.433461+0000","last_peered":"2024-05-08T18:07:09.433461+0000","last_clean":"2024-05-08T18:07:09.433461+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:07:09.433461+0000","last_undegraded":"2024-05-08T18:07:09.433461+0000","last_fullsized":"2024-05-08T18:07:09.433461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:55.431327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":106,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T18:07:09.424712+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:07:09.424712+0000","last_peered":"2024-05-08T18:07:09.424712+0000","last_clean":"2024-05-08T18:07:09.424712+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:07:09.424712+0000","last_undegraded":"2024-05-08T18:07:09.424712+0000","last_fullsized":"2024-05-08T18:07:09.424712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:07:13.477 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T18:07:13.477 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T18:07:13.477 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-08T18:07:13.477 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-08T18:07:13.782 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:07:13.782 INFO:teuthology.orchestra.run.smithi080.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T18:07:13.799 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-08T18:07:13.800 INFO:teuthology.run_tasks:Running task rgw... 2024-05-08T18:07:13.818 DEBUG:tasks.rgw:config is {'client.0': None} 2024-05-08T18:07:13.818 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-05-08T18:07:13.819 INFO:tasks.rgw:Creating data pools 2024-05-08T18:07:13.819 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-05-08T18:07:13.819 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-05-08T18:07:14.445 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'default.rgw.buckets.data' created 2024-05-08T18:07:14.476 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-05-08T18:07:15.460 INFO:teuthology.orchestra.run.smithi080.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-05-08T18:07:15.504 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-05-08T18:07:16.475 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'default.rgw.buckets.index' created 2024-05-08T18:07:16.510 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-05-08T18:07:17.478 INFO:teuthology.orchestra.run.smithi080.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-05-08T18:07:17.520 DEBUG:tasks.rgw:Pools created 2024-05-08T18:07:17.520 INFO:tasks.rgw:Starting rgw... 2024-05-08T18:07:17.520 INFO:tasks.rgw:rgw client.0 config is {} 2024-05-08T18:07:17.521 INFO:tasks.rgw:Using beast as radosgw frontend 2024-05-08T18:07:17.521 DEBUG:teuthology.orchestra.run.smithi080:> sudo echo -n http://smithi080.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-05-08T18:07:17.533 INFO:teuthology.orchestra.run.smithi080.stdout:http://smithi080.front.sepia.ceph.com:80 2024-05-08T18:07:17.534 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-05-08T18:07:17.586 INFO:tasks.rgw.client.0:Restarting daemon 2024-05-08T18:07:17.586 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-05-08T18:07:17.628 INFO:tasks.rgw.client.0:Started 2024-05-08T18:07:17.629 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi080.front.sepia.ceph.com:80/ 2024-05-08T18:07:17.629 DEBUG:teuthology.orchestra.run.smithi080:> curl http://smithi080.front.sepia.ceph.com:80/ 2024-05-08T18:07:17.721 INFO:teuthology.orchestra.run.smithi080.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:07:17.721 INFO:teuthology.orchestra.run.smithi080.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:07:17.721 INFO:teuthology.orchestra.run.smithi080.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:07:17.721 INFO:teuthology.orchestra.run.smithi080.stderr:curl: (7) Failed to connect to smithi080.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-08T18:07:17.722 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:07:18.723 DEBUG:teuthology.orchestra.run.smithi080:> curl http://smithi080.front.sepia.ceph.com:80/ 2024-05-08T18:07:18.734 INFO:teuthology.orchestra.run.smithi080.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:07:18.734 INFO:teuthology.orchestra.run.smithi080.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:07:18.734 INFO:teuthology.orchestra.run.smithi080.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:07:18.734 INFO:teuthology.orchestra.run.smithi080.stderr:curl: (7) Failed to connect to smithi080.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-08T18:07:18.735 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:07:20.736 DEBUG:teuthology.orchestra.run.smithi080:> curl http://smithi080.front.sepia.ceph.com:80/ 2024-05-08T18:07:20.748 INFO:teuthology.orchestra.run.smithi080.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:07:20.748 INFO:teuthology.orchestra.run.smithi080.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:07:20.748 INFO:teuthology.orchestra.run.smithi080.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:07:20.748 INFO:teuthology.orchestra.run.smithi080.stderr:curl: (7) Failed to connect to smithi080.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-08T18:07:20.749 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:07:24.750 DEBUG:teuthology.orchestra.run.smithi080:> curl http://smithi080.front.sepia.ceph.com:80/ 2024-05-08T18:07:24.762 INFO:teuthology.orchestra.run.smithi080.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:07:24.762 INFO:teuthology.orchestra.run.smithi080.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:07:24.762 INFO:teuthology.orchestra.run.smithi080.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:07:24.762 INFO:teuthology.orchestra.run.smithi080.stderr:curl: (7) Failed to connect to smithi080.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-08T18:07:24.763 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:07:32.764 DEBUG:teuthology.orchestra.run.smithi080:> curl http://smithi080.front.sepia.ceph.com:80/ 2024-05-08T18:07:32.775 INFO:teuthology.orchestra.run.smithi080.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:07:32.775 INFO:teuthology.orchestra.run.smithi080.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:07:32.779 INFO:teuthology.orchestra.run.smithi080.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 52809 0 --:--:-- --:--:-- --:--:-- 62333 2024-05-08T18:07:32.779 INFO:teuthology.orchestra.run.smithi080.stdout:anonymous 2024-05-08T18:07:32.780 INFO:teuthology.run_tasks:Running task thrashosds... 2024-05-08T18:07:32.792 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-05-08T18:07:32.792 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-eric-testing-1'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-eric-testing-1', 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}} 2024-05-08T18:07:32.792 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-05-08T18:07:32.793 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-05-08T18:07:33.165 INFO:tasks.thrashosds:Beginning thrashosds... 2024-05-08T18:07:33.165 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T18:07:33.166 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:07:33.514 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:07:33.520 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:07:33.529 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-05-08T18:07:31.664869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595573,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":135,"num_read_kb":60,"num_write":176,"num_write_kb":1667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":478,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220128,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754592,"statfs":{"total":773094113280,"available":772868702208,"internally_reserved":0,"allocated":4038656,"data_stored":2399594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3592,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":65,"num_read_kb":1,"num_write":65,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.131181"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590934+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:07:26.590934+0000","last_peered":"2024-05-08T18:07:26.590934+0000","last_clean":"2024-05-08T18:07:26.590934+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:07:26.590934+0000","last_undegraded":"2024-05-08T18:07:26.590934+0000","last_fullsized":"2024-05-08T18:07:26.590934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.598333+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:07:26.598333+0000","last_peered":"2024-05-08T18:07:26.598333+0000","last_clean":"2024-05-08T18:07:26.598333+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:07:26.598333+0000","last_undegraded":"2024-05-08T18:07:26.598333+0000","last_fullsized":"2024-05-08T18:07:26.598333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594662+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:07:26.594662+0000","last_peered":"2024-05-08T18:07:26.594662+0000","last_clean":"2024-05-08T18:07:26.594662+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:07:26.594662+0000","last_undegraded":"2024-05-08T18:07:26.594662+0000","last_fullsized":"2024-05-08T18:07:26.594662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589208+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:07:26.589208+0000","last_peered":"2024-05-08T18:07:26.589208+0000","last_clean":"2024-05-08T18:07:26.589208+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:07:26.589208+0000","last_undegraded":"2024-05-08T18:07:26.589208+0000","last_fullsized":"2024-05-08T18:07:26.589208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610165+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:07:26.610165+0000","last_peered":"2024-05-08T18:07:26.610165+0000","last_clean":"2024-05-08T18:07:26.610165+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:07:26.610165+0000","last_undegraded":"2024-05-08T18:07:26.610165+0000","last_fullsized":"2024-05-08T18:07:26.610165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567215+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:07:26.567215+0000","last_peered":"2024-05-08T18:07:26.567215+0000","last_clean":"2024-05-08T18:07:26.567215+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:07:26.567215+0000","last_undegraded":"2024-05-08T18:07:26.567215+0000","last_fullsized":"2024-05-08T18:07:26.567215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.601132+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:07:26.601132+0000","last_peered":"2024-05-08T18:07:26.601132+0000","last_clean":"2024-05-08T18:07:26.601132+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:07:26.601132+0000","last_undegraded":"2024-05-08T18:07:26.601132+0000","last_fullsized":"2024-05-08T18:07:26.601132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609423+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:07:26.609423+0000","last_peered":"2024-05-08T18:07:26.609423+0000","last_clean":"2024-05-08T18:07:26.609423+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:07:26.609423+0000","last_undegraded":"2024-05-08T18:07:26.609423+0000","last_fullsized":"2024-05-08T18:07:26.609423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589901+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:07:26.589901+0000","last_peered":"2024-05-08T18:07:26.589901+0000","last_clean":"2024-05-08T18:07:26.589901+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:07:26.589901+0000","last_undegraded":"2024-05-08T18:07:26.589901+0000","last_fullsized":"2024-05-08T18:07:26.589901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604286+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:07:26.604286+0000","last_peered":"2024-05-08T18:07:26.604286+0000","last_clean":"2024-05-08T18:07:26.604286+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:07:26.604286+0000","last_undegraded":"2024-05-08T18:07:26.604286+0000","last_fullsized":"2024-05-08T18:07:26.604286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.598981+0000","last_change":"2024-05-08T18:07:15.502659+0000","last_active":"2024-05-08T18:07:26.598981+0000","last_peered":"2024-05-08T18:07:26.598981+0000","last_clean":"2024-05-08T18:07:26.598981+0000","last_became_active":"2024-05-08T18:07:15.501947+0000","last_became_peered":"2024-05-08T18:07:15.501947+0000","last_unstale":"2024-05-08T18:07:26.598981+0000","last_undegraded":"2024-05-08T18:07:26.598981+0000","last_fullsized":"2024-05-08T18:07:26.598981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568605+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:07:26.568605+0000","last_peered":"2024-05-08T18:07:26.568605+0000","last_clean":"2024-05-08T18:07:26.568605+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:07:26.568605+0000","last_undegraded":"2024-05-08T18:07:26.568605+0000","last_fullsized":"2024-05-08T18:07:26.568605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589539+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:07:26.589539+0000","last_peered":"2024-05-08T18:07:26.589539+0000","last_clean":"2024-05-08T18:07:26.589539+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:07:26.589539+0000","last_undegraded":"2024-05-08T18:07:26.589539+0000","last_fullsized":"2024-05-08T18:07:26.589539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599871+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:07:26.599871+0000","last_peered":"2024-05-08T18:07:26.599871+0000","last_clean":"2024-05-08T18:07:26.599871+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:07:26.599871+0000","last_undegraded":"2024-05-08T18:07:26.599871+0000","last_fullsized":"2024-05-08T18:07:26.599871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.575539+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:07:26.575539+0000","last_peered":"2024-05-08T18:07:26.575539+0000","last_clean":"2024-05-08T18:07:26.575539+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:07:26.575539+0000","last_undegraded":"2024-05-08T18:07:26.575539+0000","last_fullsized":"2024-05-08T18:07:26.575539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573072+0000","last_change":"2024-05-08T18:07:17.508968+0000","last_active":"2024-05-08T18:07:26.573072+0000","last_peered":"2024-05-08T18:07:26.573072+0000","last_clean":"2024-05-08T18:07:26.573072+0000","last_became_active":"2024-05-08T18:07:17.508588+0000","last_became_peered":"2024-05-08T18:07:17.508588+0000","last_unstale":"2024-05-08T18:07:26.573072+0000","last_undegraded":"2024-05-08T18:07:26.573072+0000","last_fullsized":"2024-05-08T18:07:26.573072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:08.890984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.566810+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:07:26.566810+0000","last_peered":"2024-05-08T18:07:26.566810+0000","last_clean":"2024-05-08T18:07:26.566810+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:07:26.566810+0000","last_undegraded":"2024-05-08T18:07:26.566810+0000","last_fullsized":"2024-05-08T18:07:26.566810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.591007+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:07:26.591007+0000","last_peered":"2024-05-08T18:07:26.591007+0000","last_clean":"2024-05-08T18:07:26.591007+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:07:26.591007+0000","last_undegraded":"2024-05-08T18:07:26.591007+0000","last_fullsized":"2024-05-08T18:07:26.591007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589332+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:07:26.589332+0000","last_peered":"2024-05-08T18:07:26.589332+0000","last_clean":"2024-05-08T18:07:26.589332+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:07:26.589332+0000","last_undegraded":"2024-05-08T18:07:26.589332+0000","last_fullsized":"2024-05-08T18:07:26.589332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.605242+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:07:26.605242+0000","last_peered":"2024-05-08T18:07:26.605242+0000","last_clean":"2024-05-08T18:07:26.605242+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:07:26.605242+0000","last_undegraded":"2024-05-08T18:07:26.605242+0000","last_fullsized":"2024-05-08T18:07:26.605242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599849+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:07:26.599849+0000","last_peered":"2024-05-08T18:07:26.599849+0000","last_clean":"2024-05-08T18:07:26.599849+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:07:26.599849+0000","last_undegraded":"2024-05-08T18:07:26.599849+0000","last_fullsized":"2024-05-08T18:07:26.599849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.605100+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:07:26.605100+0000","last_peered":"2024-05-08T18:07:26.605100+0000","last_clean":"2024-05-08T18:07:26.605100+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:07:26.605100+0000","last_undegraded":"2024-05-08T18:07:26.605100+0000","last_fullsized":"2024-05-08T18:07:26.605100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571248+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:07:26.571248+0000","last_peered":"2024-05-08T18:07:26.571248+0000","last_clean":"2024-05-08T18:07:26.571248+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:07:26.571248+0000","last_undegraded":"2024-05-08T18:07:26.571248+0000","last_fullsized":"2024-05-08T18:07:26.571248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568244+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:07:26.568244+0000","last_peered":"2024-05-08T18:07:26.568244+0000","last_clean":"2024-05-08T18:07:26.568244+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:07:26.568244+0000","last_undegraded":"2024-05-08T18:07:26.568244+0000","last_fullsized":"2024-05-08T18:07:26.568244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573188+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:07:26.573188+0000","last_peered":"2024-05-08T18:07:26.573188+0000","last_clean":"2024-05-08T18:07:26.573188+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:07:26.573188+0000","last_undegraded":"2024-05-08T18:07:26.573188+0000","last_fullsized":"2024-05-08T18:07:26.573188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573854+0000","last_change":"2024-05-08T18:07:15.480500+0000","last_active":"2024-05-08T18:07:26.573854+0000","last_peered":"2024-05-08T18:07:26.573854+0000","last_clean":"2024-05-08T18:07:26.573854+0000","last_became_active":"2024-05-08T18:07:15.480192+0000","last_became_peered":"2024-05-08T18:07:15.480192+0000","last_unstale":"2024-05-08T18:07:26.573854+0000","last_undegraded":"2024-05-08T18:07:26.573854+0000","last_fullsized":"2024-05-08T18:07:26.573854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568732+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:07:26.568732+0000","last_peered":"2024-05-08T18:07:26.568732+0000","last_clean":"2024-05-08T18:07:26.568732+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:07:26.568732+0000","last_undegraded":"2024-05-08T18:07:26.568732+0000","last_fullsized":"2024-05-08T18:07:26.568732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610351+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:07:26.610351+0000","last_peered":"2024-05-08T18:07:26.610351+0000","last_clean":"2024-05-08T18:07:26.610351+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:07:26.610351+0000","last_undegraded":"2024-05-08T18:07:26.610351+0000","last_fullsized":"2024-05-08T18:07:26.610351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.566467+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:07:26.566467+0000","last_peered":"2024-05-08T18:07:26.566467+0000","last_clean":"2024-05-08T18:07:26.566467+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:07:26.566467+0000","last_undegraded":"2024-05-08T18:07:26.566467+0000","last_fullsized":"2024-05-08T18:07:26.566467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.575270+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:07:26.575270+0000","last_peered":"2024-05-08T18:07:26.575270+0000","last_clean":"2024-05-08T18:07:26.575270+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:07:26.575270+0000","last_undegraded":"2024-05-08T18:07:26.575270+0000","last_fullsized":"2024-05-08T18:07:26.575270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590041+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:07:26.590041+0000","last_peered":"2024-05-08T18:07:26.590041+0000","last_clean":"2024-05-08T18:07:26.590041+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:07:26.590041+0000","last_undegraded":"2024-05-08T18:07:26.590041+0000","last_fullsized":"2024-05-08T18:07:26.590041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599490+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:07:26.599490+0000","last_peered":"2024-05-08T18:07:26.599490+0000","last_clean":"2024-05-08T18:07:26.599490+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:07:26.599490+0000","last_undegraded":"2024-05-08T18:07:26.599490+0000","last_fullsized":"2024-05-08T18:07:26.599490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610578+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:07:26.610578+0000","last_peered":"2024-05-08T18:07:26.610578+0000","last_clean":"2024-05-08T18:07:26.610578+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:07:26.610578+0000","last_undegraded":"2024-05-08T18:07:26.610578+0000","last_fullsized":"2024-05-08T18:07:26.610578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590796+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:07:26.590796+0000","last_peered":"2024-05-08T18:07:26.590796+0000","last_clean":"2024-05-08T18:07:26.590796+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:07:26.590796+0000","last_undegraded":"2024-05-08T18:07:26.590796+0000","last_fullsized":"2024-05-08T18:07:26.590796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.598441+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:07:26.598441+0000","last_peered":"2024-05-08T18:07:26.598441+0000","last_clean":"2024-05-08T18:07:26.598441+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:07:26.598441+0000","last_undegraded":"2024-05-08T18:07:26.598441+0000","last_fullsized":"2024-05-08T18:07:26.598441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600076+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:07:26.600076+0000","last_peered":"2024-05-08T18:07:26.600076+0000","last_clean":"2024-05-08T18:07:26.600076+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:07:26.600076+0000","last_undegraded":"2024-05-08T18:07:26.600076+0000","last_fullsized":"2024-05-08T18:07:26.600076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610592+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:07:26.610592+0000","last_peered":"2024-05-08T18:07:26.610592+0000","last_clean":"2024-05-08T18:07:26.610592+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:07:26.610592+0000","last_undegraded":"2024-05-08T18:07:26.610592+0000","last_fullsized":"2024-05-08T18:07:26.610592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.574692+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:07:26.574692+0000","last_peered":"2024-05-08T18:07:26.574692+0000","last_clean":"2024-05-08T18:07:26.574692+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:07:26.574692+0000","last_undegraded":"2024-05-08T18:07:26.574692+0000","last_fullsized":"2024-05-08T18:07:26.574692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568962+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:07:26.568962+0000","last_peered":"2024-05-08T18:07:26.568962+0000","last_clean":"2024-05-08T18:07:26.568962+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:07:26.568962+0000","last_undegraded":"2024-05-08T18:07:26.568962+0000","last_fullsized":"2024-05-08T18:07:26.568962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568758+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:07:26.568758+0000","last_peered":"2024-05-08T18:07:26.568758+0000","last_clean":"2024-05-08T18:07:26.568758+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:07:26.568758+0000","last_undegraded":"2024-05-08T18:07:26.568758+0000","last_fullsized":"2024-05-08T18:07:26.568758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609151+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:07:26.609151+0000","last_peered":"2024-05-08T18:07:26.609151+0000","last_clean":"2024-05-08T18:07:26.609151+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:07:26.609151+0000","last_undegraded":"2024-05-08T18:07:26.609151+0000","last_fullsized":"2024-05-08T18:07:26.609151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.611521+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:07:26.611521+0000","last_peered":"2024-05-08T18:07:26.611521+0000","last_clean":"2024-05-08T18:07:26.611521+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:07:26.611521+0000","last_undegraded":"2024-05-08T18:07:26.611521+0000","last_fullsized":"2024-05-08T18:07:26.611521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589592+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:07:26.589592+0000","last_peered":"2024-05-08T18:07:26.589592+0000","last_clean":"2024-05-08T18:07:26.589592+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:07:26.589592+0000","last_undegraded":"2024-05-08T18:07:26.589592+0000","last_fullsized":"2024-05-08T18:07:26.589592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.578015+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:07:26.578015+0000","last_peered":"2024-05-08T18:07:26.578015+0000","last_clean":"2024-05-08T18:07:26.578015+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:07:26.578015+0000","last_undegraded":"2024-05-08T18:07:26.578015+0000","last_fullsized":"2024-05-08T18:07:26.578015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.572622+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:07:26.572622+0000","last_peered":"2024-05-08T18:07:26.572622+0000","last_clean":"2024-05-08T18:07:26.572622+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:07:26.572622+0000","last_undegraded":"2024-05-08T18:07:26.572622+0000","last_fullsized":"2024-05-08T18:07:26.572622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590202+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:07:26.590202+0000","last_peered":"2024-05-08T18:07:26.590202+0000","last_clean":"2024-05-08T18:07:26.590202+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:07:26.590202+0000","last_undegraded":"2024-05-08T18:07:26.590202+0000","last_fullsized":"2024-05-08T18:07:26.590202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567420+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:07:26.567420+0000","last_peered":"2024-05-08T18:07:26.567420+0000","last_clean":"2024-05-08T18:07:26.567420+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:07:26.567420+0000","last_undegraded":"2024-05-08T18:07:26.567420+0000","last_fullsized":"2024-05-08T18:07:26.567420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.577222+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:07:26.577222+0000","last_peered":"2024-05-08T18:07:26.577222+0000","last_clean":"2024-05-08T18:07:26.577222+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:07:26.577222+0000","last_undegraded":"2024-05-08T18:07:26.577222+0000","last_fullsized":"2024-05-08T18:07:26.577222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.603616+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:07:26.603616+0000","last_peered":"2024-05-08T18:07:26.603616+0000","last_clean":"2024-05-08T18:07:26.603616+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:07:26.603616+0000","last_undegraded":"2024-05-08T18:07:26.603616+0000","last_fullsized":"2024-05-08T18:07:26.603616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599785+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:07:26.599785+0000","last_peered":"2024-05-08T18:07:26.599785+0000","last_clean":"2024-05-08T18:07:26.599785+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:07:26.599785+0000","last_undegraded":"2024-05-08T18:07:26.599785+0000","last_fullsized":"2024-05-08T18:07:26.599785+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590398+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:07:26.590398+0000","last_peered":"2024-05-08T18:07:26.590398+0000","last_clean":"2024-05-08T18:07:26.590398+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:07:26.590398+0000","last_undegraded":"2024-05-08T18:07:26.590398+0000","last_fullsized":"2024-05-08T18:07:26.590398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.574202+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:07:26.574202+0000","last_peered":"2024-05-08T18:07:26.574202+0000","last_clean":"2024-05-08T18:07:26.574202+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:07:26.574202+0000","last_undegraded":"2024-05-08T18:07:26.574202+0000","last_fullsized":"2024-05-08T18:07:26.574202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.598816+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:07:26.598816+0000","last_peered":"2024-05-08T18:07:26.598816+0000","last_clean":"2024-05-08T18:07:26.598816+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:07:26.598816+0000","last_undegraded":"2024-05-08T18:07:26.598816+0000","last_fullsized":"2024-05-08T18:07:26.598816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.591197+0000","last_change":"2024-05-08T18:07:15.515622+0000","last_active":"2024-05-08T18:07:26.591197+0000","last_peered":"2024-05-08T18:07:26.591197+0000","last_clean":"2024-05-08T18:07:26.591197+0000","last_became_active":"2024-05-08T18:07:15.515050+0000","last_became_peered":"2024-05-08T18:07:15.515050+0000","last_unstale":"2024-05-08T18:07:26.591197+0000","last_undegraded":"2024-05-08T18:07:26.591197+0000","last_fullsized":"2024-05-08T18:07:26.591197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.588781+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:07:26.588781+0000","last_peered":"2024-05-08T18:07:26.588781+0000","last_clean":"2024-05-08T18:07:26.588781+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:07:26.588781+0000","last_undegraded":"2024-05-08T18:07:26.588781+0000","last_fullsized":"2024-05-08T18:07:26.588781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.598394+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:07:26.598394+0000","last_peered":"2024-05-08T18:07:26.598394+0000","last_clean":"2024-05-08T18:07:26.598394+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:07:26.598394+0000","last_undegraded":"2024-05-08T18:07:26.598394+0000","last_fullsized":"2024-05-08T18:07:26.598394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593647+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:07:26.593647+0000","last_peered":"2024-05-08T18:07:26.593647+0000","last_clean":"2024-05-08T18:07:26.593647+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:07:26.593647+0000","last_undegraded":"2024-05-08T18:07:26.593647+0000","last_fullsized":"2024-05-08T18:07:26.593647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.601037+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:07:26.601037+0000","last_peered":"2024-05-08T18:07:26.601037+0000","last_clean":"2024-05-08T18:07:26.601037+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:07:26.601037+0000","last_undegraded":"2024-05-08T18:07:26.601037+0000","last_fullsized":"2024-05-08T18:07:26.601037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567012+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:07:26.567012+0000","last_peered":"2024-05-08T18:07:26.567012+0000","last_clean":"2024-05-08T18:07:26.567012+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:07:26.567012+0000","last_undegraded":"2024-05-08T18:07:26.567012+0000","last_fullsized":"2024-05-08T18:07:26.567012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.591072+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:07:26.591072+0000","last_peered":"2024-05-08T18:07:26.591072+0000","last_clean":"2024-05-08T18:07:26.591072+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:07:26.591072+0000","last_undegraded":"2024-05-08T18:07:26.591072+0000","last_fullsized":"2024-05-08T18:07:26.591072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.570307+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:07:26.570307+0000","last_peered":"2024-05-08T18:07:26.570307+0000","last_clean":"2024-05-08T18:07:26.570307+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:07:26.570307+0000","last_undegraded":"2024-05-08T18:07:26.570307+0000","last_fullsized":"2024-05-08T18:07:26.570307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.576400+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:07:26.576400+0000","last_peered":"2024-05-08T18:07:26.576400+0000","last_clean":"2024-05-08T18:07:26.576400+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:07:26.576400+0000","last_undegraded":"2024-05-08T18:07:26.576400+0000","last_fullsized":"2024-05-08T18:07:26.576400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571650+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:07:26.571650+0000","last_peered":"2024-05-08T18:07:26.571650+0000","last_clean":"2024-05-08T18:07:26.571650+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:07:26.571650+0000","last_undegraded":"2024-05-08T18:07:26.571650+0000","last_fullsized":"2024-05-08T18:07:26.571650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604368+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:07:26.604368+0000","last_peered":"2024-05-08T18:07:26.604368+0000","last_clean":"2024-05-08T18:07:26.604368+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:07:26.604368+0000","last_undegraded":"2024-05-08T18:07:26.604368+0000","last_fullsized":"2024-05-08T18:07:26.604368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604481+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:07:26.604481+0000","last_peered":"2024-05-08T18:07:26.604481+0000","last_clean":"2024-05-08T18:07:26.604481+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:07:26.604481+0000","last_undegraded":"2024-05-08T18:07:26.604481+0000","last_fullsized":"2024-05-08T18:07:26.604481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590999+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:07:26.590999+0000","last_peered":"2024-05-08T18:07:26.590999+0000","last_clean":"2024-05-08T18:07:26.590999+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:07:26.590999+0000","last_undegraded":"2024-05-08T18:07:26.590999+0000","last_fullsized":"2024-05-08T18:07:26.590999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571984+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:07:26.571984+0000","last_peered":"2024-05-08T18:07:26.571984+0000","last_clean":"2024-05-08T18:07:26.571984+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:07:26.571984+0000","last_undegraded":"2024-05-08T18:07:26.571984+0000","last_fullsized":"2024-05-08T18:07:26.571984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589127+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:07:26.589127+0000","last_peered":"2024-05-08T18:07:26.589127+0000","last_clean":"2024-05-08T18:07:26.589127+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:07:26.589127+0000","last_undegraded":"2024-05-08T18:07:26.589127+0000","last_fullsized":"2024-05-08T18:07:26.589127+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.608560+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:07:26.608560+0000","last_peered":"2024-05-08T18:07:26.608560+0000","last_clean":"2024-05-08T18:07:26.608560+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:07:26.608560+0000","last_undegraded":"2024-05-08T18:07:26.608560+0000","last_fullsized":"2024-05-08T18:07:26.608560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610809+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:07:26.610809+0000","last_peered":"2024-05-08T18:07:26.610809+0000","last_clean":"2024-05-08T18:07:26.610809+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:07:26.610809+0000","last_undegraded":"2024-05-08T18:07:26.610809+0000","last_fullsized":"2024-05-08T18:07:26.610809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610465+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:07:26.610465+0000","last_peered":"2024-05-08T18:07:26.610465+0000","last_clean":"2024-05-08T18:07:26.610465+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:07:26.610465+0000","last_undegraded":"2024-05-08T18:07:26.610465+0000","last_fullsized":"2024-05-08T18:07:26.610465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.601413+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:07:26.601413+0000","last_peered":"2024-05-08T18:07:26.601413+0000","last_clean":"2024-05-08T18:07:26.601413+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:07:26.601413+0000","last_undegraded":"2024-05-08T18:07:26.601413+0000","last_fullsized":"2024-05-08T18:07:26.601413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.570889+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:07:26.570889+0000","last_peered":"2024-05-08T18:07:26.570889+0000","last_clean":"2024-05-08T18:07:26.570889+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:07:26.570889+0000","last_undegraded":"2024-05-08T18:07:26.570889+0000","last_fullsized":"2024-05-08T18:07:26.570889+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.613178+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:07:26.613178+0000","last_peered":"2024-05-08T18:07:26.613178+0000","last_clean":"2024-05-08T18:07:26.613178+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:07:26.613178+0000","last_undegraded":"2024-05-08T18:07:26.613178+0000","last_fullsized":"2024-05-08T18:07:26.613178+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.570228+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:07:26.570228+0000","last_peered":"2024-05-08T18:07:26.570228+0000","last_clean":"2024-05-08T18:07:26.570228+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:07:26.570228+0000","last_undegraded":"2024-05-08T18:07:26.570228+0000","last_fullsized":"2024-05-08T18:07:26.570228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594310+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:07:26.594310+0000","last_peered":"2024-05-08T18:07:26.594310+0000","last_clean":"2024-05-08T18:07:26.594310+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:07:26.594310+0000","last_undegraded":"2024-05-08T18:07:26.594310+0000","last_fullsized":"2024-05-08T18:07:26.594310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568783+0000","last_change":"2024-05-08T18:07:17.495459+0000","last_active":"2024-05-08T18:07:26.568783+0000","last_peered":"2024-05-08T18:07:26.568783+0000","last_clean":"2024-05-08T18:07:26.568783+0000","last_became_active":"2024-05-08T18:07:17.494659+0000","last_became_peered":"2024-05-08T18:07:17.494659+0000","last_unstale":"2024-05-08T18:07:26.568783+0000","last_undegraded":"2024-05-08T18:07:26.568783+0000","last_fullsized":"2024-05-08T18:07:26.568783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573594+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:07:26.573594+0000","last_peered":"2024-05-08T18:07:26.573594+0000","last_clean":"2024-05-08T18:07:26.573594+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:07:26.573594+0000","last_undegraded":"2024-05-08T18:07:26.573594+0000","last_fullsized":"2024-05-08T18:07:26.573594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571180+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:07:26.571180+0000","last_peered":"2024-05-08T18:07:26.571180+0000","last_clean":"2024-05-08T18:07:26.571180+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:07:26.571180+0000","last_undegraded":"2024-05-08T18:07:26.571180+0000","last_fullsized":"2024-05-08T18:07:26.571180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568903+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:07:26.568903+0000","last_peered":"2024-05-08T18:07:26.568903+0000","last_clean":"2024-05-08T18:07:26.568903+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:07:26.568903+0000","last_undegraded":"2024-05-08T18:07:26.568903+0000","last_fullsized":"2024-05-08T18:07:26.568903+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610856+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:07:26.610856+0000","last_peered":"2024-05-08T18:07:26.610856+0000","last_clean":"2024-05-08T18:07:26.610856+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:07:26.610856+0000","last_undegraded":"2024-05-08T18:07:26.610856+0000","last_fullsized":"2024-05-08T18:07:26.610856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571482+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:07:26.571482+0000","last_peered":"2024-05-08T18:07:26.571482+0000","last_clean":"2024-05-08T18:07:26.571482+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:07:26.571482+0000","last_undegraded":"2024-05-08T18:07:26.571482+0000","last_fullsized":"2024-05-08T18:07:26.571482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568898+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:07:26.568898+0000","last_peered":"2024-05-08T18:07:26.568898+0000","last_clean":"2024-05-08T18:07:26.568898+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:07:26.568898+0000","last_undegraded":"2024-05-08T18:07:26.568898+0000","last_fullsized":"2024-05-08T18:07:26.568898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604772+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:07:26.604772+0000","last_peered":"2024-05-08T18:07:26.604772+0000","last_clean":"2024-05-08T18:07:26.604772+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:07:26.604772+0000","last_undegraded":"2024-05-08T18:07:26.604772+0000","last_fullsized":"2024-05-08T18:07:26.604772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593386+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:07:26.593386+0000","last_peered":"2024-05-08T18:07:26.593386+0000","last_clean":"2024-05-08T18:07:26.593386+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:07:26.593386+0000","last_undegraded":"2024-05-08T18:07:26.593386+0000","last_fullsized":"2024-05-08T18:07:26.593386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.572628+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:07:26.572628+0000","last_peered":"2024-05-08T18:07:26.572628+0000","last_clean":"2024-05-08T18:07:26.572628+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:07:26.572628+0000","last_undegraded":"2024-05-08T18:07:26.572628+0000","last_fullsized":"2024-05-08T18:07:26.572628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.572605+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:07:26.572605+0000","last_peered":"2024-05-08T18:07:26.572605+0000","last_clean":"2024-05-08T18:07:26.572605+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:07:26.572605+0000","last_undegraded":"2024-05-08T18:07:26.572605+0000","last_fullsized":"2024-05-08T18:07:26.572605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593153+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:07:26.593153+0000","last_peered":"2024-05-08T18:07:26.593153+0000","last_clean":"2024-05-08T18:07:26.593153+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:07:26.593153+0000","last_undegraded":"2024-05-08T18:07:26.593153+0000","last_fullsized":"2024-05-08T18:07:26.593153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.569475+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:07:26.569475+0000","last_peered":"2024-05-08T18:07:26.569475+0000","last_clean":"2024-05-08T18:07:26.569475+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:07:26.569475+0000","last_undegraded":"2024-05-08T18:07:26.569475+0000","last_fullsized":"2024-05-08T18:07:26.569475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567619+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:07:26.567619+0000","last_peered":"2024-05-08T18:07:26.567619+0000","last_clean":"2024-05-08T18:07:26.567619+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:07:26.567619+0000","last_undegraded":"2024-05-08T18:07:26.567619+0000","last_fullsized":"2024-05-08T18:07:26.567619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599176+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:07:26.599176+0000","last_peered":"2024-05-08T18:07:26.599176+0000","last_clean":"2024-05-08T18:07:26.599176+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:07:26.599176+0000","last_undegraded":"2024-05-08T18:07:26.599176+0000","last_fullsized":"2024-05-08T18:07:26.599176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573857+0000","last_change":"2024-05-08T18:07:21.533056+0000","last_active":"2024-05-08T18:07:26.573857+0000","last_peered":"2024-05-08T18:07:26.573857+0000","last_clean":"2024-05-08T18:07:26.573857+0000","last_became_active":"2024-05-08T18:07:21.532184+0000","last_became_peered":"2024-05-08T18:07:21.532184+0000","last_unstale":"2024-05-08T18:07:26.573857+0000","last_undegraded":"2024-05-08T18:07:26.573857+0000","last_fullsized":"2024-05-08T18:07:26.573857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:50.629014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604714+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:07:26.604714+0000","last_peered":"2024-05-08T18:07:26.604714+0000","last_clean":"2024-05-08T18:07:26.604714+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:07:26.604714+0000","last_undegraded":"2024-05-08T18:07:26.604714+0000","last_fullsized":"2024-05-08T18:07:26.604714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567441+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:07:26.567441+0000","last_peered":"2024-05-08T18:07:26.567441+0000","last_clean":"2024-05-08T18:07:26.567441+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:07:26.567441+0000","last_undegraded":"2024-05-08T18:07:26.567441+0000","last_fullsized":"2024-05-08T18:07:26.567441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594495+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:07:26.594495+0000","last_peered":"2024-05-08T18:07:26.594495+0000","last_clean":"2024-05-08T18:07:26.594495+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:07:26.594495+0000","last_undegraded":"2024-05-08T18:07:26.594495+0000","last_fullsized":"2024-05-08T18:07:26.594495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.575981+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:07:26.575981+0000","last_peered":"2024-05-08T18:07:26.575981+0000","last_clean":"2024-05-08T18:07:26.575981+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:07:26.575981+0000","last_undegraded":"2024-05-08T18:07:26.575981+0000","last_fullsized":"2024-05-08T18:07:26.575981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.569214+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:07:26.569214+0000","last_peered":"2024-05-08T18:07:26.569214+0000","last_clean":"2024-05-08T18:07:26.569214+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:07:26.569214+0000","last_undegraded":"2024-05-08T18:07:26.569214+0000","last_fullsized":"2024-05-08T18:07:26.569214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599314+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:07:26.599314+0000","last_peered":"2024-05-08T18:07:26.599314+0000","last_clean":"2024-05-08T18:07:26.599314+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:07:26.599314+0000","last_undegraded":"2024-05-08T18:07:26.599314+0000","last_fullsized":"2024-05-08T18:07:26.599314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604827+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:07:26.604827+0000","last_peered":"2024-05-08T18:07:26.604827+0000","last_clean":"2024-05-08T18:07:26.604827+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:07:26.604827+0000","last_undegraded":"2024-05-08T18:07:26.604827+0000","last_fullsized":"2024-05-08T18:07:26.604827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593259+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:07:26.593259+0000","last_peered":"2024-05-08T18:07:26.593259+0000","last_clean":"2024-05-08T18:07:26.593259+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:07:26.593259+0000","last_undegraded":"2024-05-08T18:07:26.593259+0000","last_fullsized":"2024-05-08T18:07:26.593259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604865+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:07:26.604865+0000","last_peered":"2024-05-08T18:07:26.604865+0000","last_clean":"2024-05-08T18:07:26.604865+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:07:26.604865+0000","last_undegraded":"2024-05-08T18:07:26.604865+0000","last_fullsized":"2024-05-08T18:07:26.604865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589228+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:07:26.589228+0000","last_peered":"2024-05-08T18:07:26.589228+0000","last_clean":"2024-05-08T18:07:26.589228+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:07:26.589228+0000","last_undegraded":"2024-05-08T18:07:26.589228+0000","last_fullsized":"2024-05-08T18:07:26.589228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600608+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:07:26.600608+0000","last_peered":"2024-05-08T18:07:26.600608+0000","last_clean":"2024-05-08T18:07:26.600608+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:07:26.600608+0000","last_undegraded":"2024-05-08T18:07:26.600608+0000","last_fullsized":"2024-05-08T18:07:26.600608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573343+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:07:26.573343+0000","last_peered":"2024-05-08T18:07:26.573343+0000","last_clean":"2024-05-08T18:07:26.573343+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:07:26.573343+0000","last_undegraded":"2024-05-08T18:07:26.573343+0000","last_fullsized":"2024-05-08T18:07:26.573343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589833+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:07:26.589833+0000","last_peered":"2024-05-08T18:07:26.589833+0000","last_clean":"2024-05-08T18:07:26.589833+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:07:26.589833+0000","last_undegraded":"2024-05-08T18:07:26.589833+0000","last_fullsized":"2024-05-08T18:07:26.589833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.667463+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:07:26.667463+0000","last_peered":"2024-05-08T18:07:26.667463+0000","last_clean":"2024-05-08T18:07:26.667463+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:07:26.667463+0000","last_undegraded":"2024-05-08T18:07:26.667463+0000","last_fullsized":"2024-05-08T18:07:26.667463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610862+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:07:26.610862+0000","last_peered":"2024-05-08T18:07:26.610862+0000","last_clean":"2024-05-08T18:07:26.610862+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:07:26.610862+0000","last_undegraded":"2024-05-08T18:07:26.610862+0000","last_fullsized":"2024-05-08T18:07:26.610862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.603538+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:07:26.603538+0000","last_peered":"2024-05-08T18:07:26.603538+0000","last_clean":"2024-05-08T18:07:26.603538+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:07:26.603538+0000","last_undegraded":"2024-05-08T18:07:26.603538+0000","last_fullsized":"2024-05-08T18:07:26.603538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.611242+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:07:26.611242+0000","last_peered":"2024-05-08T18:07:26.611242+0000","last_clean":"2024-05-08T18:07:26.611242+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:07:26.611242+0000","last_undegraded":"2024-05-08T18:07:26.611242+0000","last_fullsized":"2024-05-08T18:07:26.611242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.588936+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:07:26.588936+0000","last_peered":"2024-05-08T18:07:26.588936+0000","last_clean":"2024-05-08T18:07:26.588936+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:07:26.588936+0000","last_undegraded":"2024-05-08T18:07:26.588936+0000","last_fullsized":"2024-05-08T18:07:26.588936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.608986+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:07:26.608986+0000","last_peered":"2024-05-08T18:07:26.608986+0000","last_clean":"2024-05-08T18:07:26.608986+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:07:26.608986+0000","last_undegraded":"2024-05-08T18:07:26.608986+0000","last_fullsized":"2024-05-08T18:07:26.608986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.601328+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:07:26.601328+0000","last_peered":"2024-05-08T18:07:26.601328+0000","last_clean":"2024-05-08T18:07:26.601328+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:07:26.601328+0000","last_undegraded":"2024-05-08T18:07:26.601328+0000","last_fullsized":"2024-05-08T18:07:26.601328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.645103+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:07:26.645103+0000","last_peered":"2024-05-08T18:07:26.645103+0000","last_clean":"2024-05-08T18:07:26.645103+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:07:26.645103+0000","last_undegraded":"2024-05-08T18:07:26.645103+0000","last_fullsized":"2024-05-08T18:07:26.645103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590296+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:07:26.590296+0000","last_peered":"2024-05-08T18:07:26.590296+0000","last_clean":"2024-05-08T18:07:26.590296+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:07:26.590296+0000","last_undegraded":"2024-05-08T18:07:26.590296+0000","last_fullsized":"2024-05-08T18:07:26.590296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593460+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:07:26.593460+0000","last_peered":"2024-05-08T18:07:26.593460+0000","last_clean":"2024-05-08T18:07:26.593460+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:07:26.593460+0000","last_undegraded":"2024-05-08T18:07:26.593460+0000","last_fullsized":"2024-05-08T18:07:26.593460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594609+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:07:26.594609+0000","last_peered":"2024-05-08T18:07:26.594609+0000","last_clean":"2024-05-08T18:07:26.594609+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:07:26.594609+0000","last_undegraded":"2024-05-08T18:07:26.594609+0000","last_fullsized":"2024-05-08T18:07:26.594609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.570685+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:07:26.570685+0000","last_peered":"2024-05-08T18:07:26.570685+0000","last_clean":"2024-05-08T18:07:26.570685+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:07:26.570685+0000","last_undegraded":"2024-05-08T18:07:26.570685+0000","last_fullsized":"2024-05-08T18:07:26.570685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.592782+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:07:26.592782+0000","last_peered":"2024-05-08T18:07:26.592782+0000","last_clean":"2024-05-08T18:07:26.592782+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:07:26.592782+0000","last_undegraded":"2024-05-08T18:07:26.592782+0000","last_fullsized":"2024-05-08T18:07:26.592782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.572892+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:07:26.572892+0000","last_peered":"2024-05-08T18:07:26.572892+0000","last_clean":"2024-05-08T18:07:26.572892+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:07:26.572892+0000","last_undegraded":"2024-05-08T18:07:26.572892+0000","last_fullsized":"2024-05-08T18:07:26.572892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590535+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:07:26.590535+0000","last_peered":"2024-05-08T18:07:26.590535+0000","last_clean":"2024-05-08T18:07:26.590535+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:07:26.590535+0000","last_undegraded":"2024-05-08T18:07:26.590535+0000","last_fullsized":"2024-05-08T18:07:26.590535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609622+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:07:26.609622+0000","last_peered":"2024-05-08T18:07:26.609622+0000","last_clean":"2024-05-08T18:07:26.609622+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:07:26.609622+0000","last_undegraded":"2024-05-08T18:07:26.609622+0000","last_fullsized":"2024-05-08T18:07:26.609622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.574350+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:07:26.574350+0000","last_peered":"2024-05-08T18:07:26.574350+0000","last_clean":"2024-05-08T18:07:26.574350+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:07:26.574350+0000","last_undegraded":"2024-05-08T18:07:26.574350+0000","last_fullsized":"2024-05-08T18:07:26.574350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593866+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:07:26.593866+0000","last_peered":"2024-05-08T18:07:26.593866+0000","last_clean":"2024-05-08T18:07:26.593866+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:07:26.593866+0000","last_undegraded":"2024-05-08T18:07:26.593866+0000","last_fullsized":"2024-05-08T18:07:26.593866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600568+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:07:26.600568+0000","last_peered":"2024-05-08T18:07:26.600568+0000","last_clean":"2024-05-08T18:07:26.600568+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:07:26.600568+0000","last_undegraded":"2024-05-08T18:07:26.600568+0000","last_fullsized":"2024-05-08T18:07:26.600568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568082+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:07:26.568082+0000","last_peered":"2024-05-08T18:07:26.568082+0000","last_clean":"2024-05-08T18:07:26.568082+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:07:26.568082+0000","last_undegraded":"2024-05-08T18:07:26.568082+0000","last_fullsized":"2024-05-08T18:07:26.568082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609855+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:07:26.609855+0000","last_peered":"2024-05-08T18:07:26.609855+0000","last_clean":"2024-05-08T18:07:26.609855+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:07:26.609855+0000","last_undegraded":"2024-05-08T18:07:26.609855+0000","last_fullsized":"2024-05-08T18:07:26.609855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.576570+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:07:26.576570+0000","last_peered":"2024-05-08T18:07:26.576570+0000","last_clean":"2024-05-08T18:07:26.576570+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:07:26.576570+0000","last_undegraded":"2024-05-08T18:07:26.576570+0000","last_fullsized":"2024-05-08T18:07:26.576570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.605264+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:07:26.605264+0000","last_peered":"2024-05-08T18:07:26.605264+0000","last_clean":"2024-05-08T18:07:26.605264+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:07:26.605264+0000","last_undegraded":"2024-05-08T18:07:26.605264+0000","last_fullsized":"2024-05-08T18:07:26.605264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.598201+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:07:26.598201+0000","last_peered":"2024-05-08T18:07:26.598201+0000","last_clean":"2024-05-08T18:07:26.598201+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:07:26.598201+0000","last_undegraded":"2024-05-08T18:07:26.598201+0000","last_fullsized":"2024-05-08T18:07:26.598201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593399+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:07:26.593399+0000","last_peered":"2024-05-08T18:07:26.593399+0000","last_clean":"2024-05-08T18:07:26.593399+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:07:26.593399+0000","last_undegraded":"2024-05-08T18:07:26.593399+0000","last_fullsized":"2024-05-08T18:07:26.593399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600589+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:07:26.600589+0000","last_peered":"2024-05-08T18:07:26.600589+0000","last_clean":"2024-05-08T18:07:26.600589+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:07:26.600589+0000","last_undegraded":"2024-05-08T18:07:26.600589+0000","last_fullsized":"2024-05-08T18:07:26.600589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594321+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:07:26.594321+0000","last_peered":"2024-05-08T18:07:26.594321+0000","last_clean":"2024-05-08T18:07:26.594321+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:07:26.594321+0000","last_undegraded":"2024-05-08T18:07:26.594321+0000","last_fullsized":"2024-05-08T18:07:26.594321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609679+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:07:26.609679+0000","last_peered":"2024-05-08T18:07:26.609679+0000","last_clean":"2024-05-08T18:07:26.609679+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:07:26.609679+0000","last_undegraded":"2024-05-08T18:07:26.609679+0000","last_fullsized":"2024-05-08T18:07:26.609679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.641388+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:07:26.641388+0000","last_peered":"2024-05-08T18:07:26.641388+0000","last_clean":"2024-05-08T18:07:26.641388+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:07:26.641388+0000","last_undegraded":"2024-05-08T18:07:26.641388+0000","last_fullsized":"2024-05-08T18:07:26.641388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.566533+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:07:26.566533+0000","last_peered":"2024-05-08T18:07:26.566533+0000","last_clean":"2024-05-08T18:07:26.566533+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:07:26.566533+0000","last_undegraded":"2024-05-08T18:07:26.566533+0000","last_fullsized":"2024-05-08T18:07:26.566533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610300+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:07:26.610300+0000","last_peered":"2024-05-08T18:07:26.610300+0000","last_clean":"2024-05-08T18:07:26.610300+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:07:26.610300+0000","last_undegraded":"2024-05-08T18:07:26.610300+0000","last_fullsized":"2024-05-08T18:07:26.610300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610476+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:07:26.610476+0000","last_peered":"2024-05-08T18:07:26.610476+0000","last_clean":"2024-05-08T18:07:26.610476+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:07:26.610476+0000","last_undegraded":"2024-05-08T18:07:26.610476+0000","last_fullsized":"2024-05-08T18:07:26.610476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593998+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:07:26.593998+0000","last_peered":"2024-05-08T18:07:26.593998+0000","last_clean":"2024-05-08T18:07:26.593998+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:07:26.593998+0000","last_undegraded":"2024-05-08T18:07:26.593998+0000","last_fullsized":"2024-05-08T18:07:26.593998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.591263+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:07:26.591263+0000","last_peered":"2024-05-08T18:07:26.591263+0000","last_clean":"2024-05-08T18:07:26.591263+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:07:26.591263+0000","last_undegraded":"2024-05-08T18:07:26.591263+0000","last_fullsized":"2024-05-08T18:07:26.591263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604172+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:07:26.604172+0000","last_peered":"2024-05-08T18:07:26.604172+0000","last_clean":"2024-05-08T18:07:26.604172+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:07:26.604172+0000","last_undegraded":"2024-05-08T18:07:26.604172+0000","last_fullsized":"2024-05-08T18:07:26.604172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.592391+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:07:26.592391+0000","last_peered":"2024-05-08T18:07:26.592391+0000","last_clean":"2024-05-08T18:07:26.592391+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:07:26.592391+0000","last_undegraded":"2024-05-08T18:07:26.592391+0000","last_fullsized":"2024-05-08T18:07:26.592391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.598643+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:07:26.598643+0000","last_peered":"2024-05-08T18:07:26.598643+0000","last_clean":"2024-05-08T18:07:26.598643+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:07:26.598643+0000","last_undegraded":"2024-05-08T18:07:26.598643+0000","last_fullsized":"2024-05-08T18:07:26.598643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.577761+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:07:26.577761+0000","last_peered":"2024-05-08T18:07:26.577761+0000","last_clean":"2024-05-08T18:07:26.577761+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:07:26.577761+0000","last_undegraded":"2024-05-08T18:07:26.577761+0000","last_fullsized":"2024-05-08T18:07:26.577761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.574931+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:07:26.574931+0000","last_peered":"2024-05-08T18:07:26.574931+0000","last_clean":"2024-05-08T18:07:26.574931+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:07:26.574931+0000","last_undegraded":"2024-05-08T18:07:26.574931+0000","last_fullsized":"2024-05-08T18:07:26.574931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.576983+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:07:26.576983+0000","last_peered":"2024-05-08T18:07:26.576983+0000","last_clean":"2024-05-08T18:07:26.576983+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:07:26.576983+0000","last_undegraded":"2024-05-08T18:07:26.576983+0000","last_fullsized":"2024-05-08T18:07:26.576983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594715+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:07:26.594715+0000","last_peered":"2024-05-08T18:07:26.594715+0000","last_clean":"2024-05-08T18:07:26.594715+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:07:26.594715+0000","last_undegraded":"2024-05-08T18:07:26.594715+0000","last_fullsized":"2024-05-08T18:07:26.594715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.566681+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:07:26.566681+0000","last_peered":"2024-05-08T18:07:26.566681+0000","last_clean":"2024-05-08T18:07:26.566681+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:07:26.566681+0000","last_undegraded":"2024-05-08T18:07:26.566681+0000","last_fullsized":"2024-05-08T18:07:26.566681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567509+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:07:26.567509+0000","last_peered":"2024-05-08T18:07:26.567509+0000","last_clean":"2024-05-08T18:07:26.567509+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:07:26.567509+0000","last_undegraded":"2024-05-08T18:07:26.567509+0000","last_fullsized":"2024-05-08T18:07:26.567509+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.575367+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:07:26.575367+0000","last_peered":"2024-05-08T18:07:26.575367+0000","last_clean":"2024-05-08T18:07:26.575367+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:07:26.575367+0000","last_undegraded":"2024-05-08T18:07:26.575367+0000","last_fullsized":"2024-05-08T18:07:26.575367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609694+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:07:26.609694+0000","last_peered":"2024-05-08T18:07:26.609694+0000","last_clean":"2024-05-08T18:07:26.609694+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:07:26.609694+0000","last_undegraded":"2024-05-08T18:07:26.609694+0000","last_fullsized":"2024-05-08T18:07:26.609694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567088+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:07:26.567088+0000","last_peered":"2024-05-08T18:07:26.567088+0000","last_clean":"2024-05-08T18:07:26.567088+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:07:26.567088+0000","last_undegraded":"2024-05-08T18:07:26.567088+0000","last_fullsized":"2024-05-08T18:07:26.567088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.611552+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:07:26.611552+0000","last_peered":"2024-05-08T18:07:26.611552+0000","last_clean":"2024-05-08T18:07:26.611552+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:07:26.611552+0000","last_undegraded":"2024-05-08T18:07:26.611552+0000","last_fullsized":"2024-05-08T18:07:26.611552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.605625+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:07:26.605625+0000","last_peered":"2024-05-08T18:07:26.605625+0000","last_clean":"2024-05-08T18:07:26.605625+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:07:26.605625+0000","last_undegraded":"2024-05-08T18:07:26.605625+0000","last_fullsized":"2024-05-08T18:07:26.605625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.572012+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:07:26.572012+0000","last_peered":"2024-05-08T18:07:26.572012+0000","last_clean":"2024-05-08T18:07:26.572012+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:07:26.572012+0000","last_undegraded":"2024-05-08T18:07:26.572012+0000","last_fullsized":"2024-05-08T18:07:26.572012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.629324+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:07:26.629324+0000","last_peered":"2024-05-08T18:07:26.629324+0000","last_clean":"2024-05-08T18:07:26.629324+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:07:26.629324+0000","last_undegraded":"2024-05-08T18:07:26.629324+0000","last_fullsized":"2024-05-08T18:07:26.629324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571901+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:07:26.571901+0000","last_peered":"2024-05-08T18:07:26.571901+0000","last_clean":"2024-05-08T18:07:26.571901+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:07:26.571901+0000","last_undegraded":"2024-05-08T18:07:26.571901+0000","last_fullsized":"2024-05-08T18:07:26.571901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599364+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:07:26.599364+0000","last_peered":"2024-05-08T18:07:26.599364+0000","last_clean":"2024-05-08T18:07:26.599364+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:07:26.599364+0000","last_undegraded":"2024-05-08T18:07:26.599364+0000","last_fullsized":"2024-05-08T18:07:26.599364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.611025+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:07:26.611025+0000","last_peered":"2024-05-08T18:07:26.611025+0000","last_clean":"2024-05-08T18:07:26.611025+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:07:26.611025+0000","last_undegraded":"2024-05-08T18:07:26.611025+0000","last_fullsized":"2024-05-08T18:07:26.611025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567680+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:07:26.567680+0000","last_peered":"2024-05-08T18:07:26.567680+0000","last_clean":"2024-05-08T18:07:26.567680+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:07:26.567680+0000","last_undegraded":"2024-05-08T18:07:26.567680+0000","last_fullsized":"2024-05-08T18:07:26.567680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567367+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:07:26.567367+0000","last_peered":"2024-05-08T18:07:26.567367+0000","last_clean":"2024-05-08T18:07:26.567367+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:07:26.567367+0000","last_undegraded":"2024-05-08T18:07:26.567367+0000","last_fullsized":"2024-05-08T18:07:26.567367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593605+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:07:26.593605+0000","last_peered":"2024-05-08T18:07:26.593605+0000","last_clean":"2024-05-08T18:07:26.593605+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:07:26.593605+0000","last_undegraded":"2024-05-08T18:07:26.593605+0000","last_fullsized":"2024-05-08T18:07:26.593605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571348+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:07:26.571348+0000","last_peered":"2024-05-08T18:07:26.571348+0000","last_clean":"2024-05-08T18:07:26.571348+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:07:26.571348+0000","last_undegraded":"2024-05-08T18:07:26.571348+0000","last_fullsized":"2024-05-08T18:07:26.571348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571741+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:07:26.571741+0000","last_peered":"2024-05-08T18:07:26.571741+0000","last_clean":"2024-05-08T18:07:26.571741+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:07:26.571741+0000","last_undegraded":"2024-05-08T18:07:26.571741+0000","last_fullsized":"2024-05-08T18:07:26.571741+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573842+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:07:26.573842+0000","last_peered":"2024-05-08T18:07:26.573842+0000","last_clean":"2024-05-08T18:07:26.573842+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:07:26.573842+0000","last_undegraded":"2024-05-08T18:07:26.573842+0000","last_fullsized":"2024-05-08T18:07:26.573842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593135+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:07:26.593135+0000","last_peered":"2024-05-08T18:07:26.593135+0000","last_clean":"2024-05-08T18:07:26.593135+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:07:26.593135+0000","last_undegraded":"2024-05-08T18:07:26.593135+0000","last_fullsized":"2024-05-08T18:07:26.593135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590978+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:07:26.590978+0000","last_peered":"2024-05-08T18:07:26.590978+0000","last_clean":"2024-05-08T18:07:26.590978+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:07:26.590978+0000","last_undegraded":"2024-05-08T18:07:26.590978+0000","last_fullsized":"2024-05-08T18:07:26.590978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573979+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:07:26.573979+0000","last_peered":"2024-05-08T18:07:26.573979+0000","last_clean":"2024-05-08T18:07:26.573979+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:07:26.573979+0000","last_undegraded":"2024-05-08T18:07:26.573979+0000","last_fullsized":"2024-05-08T18:07:26.573979+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.608762+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:07:26.608762+0000","last_peered":"2024-05-08T18:07:26.608762+0000","last_clean":"2024-05-08T18:07:26.608762+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:07:26.608762+0000","last_undegraded":"2024-05-08T18:07:26.608762+0000","last_fullsized":"2024-05-08T18:07:26.608762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589191+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:07:26.589191+0000","last_peered":"2024-05-08T18:07:26.589191+0000","last_clean":"2024-05-08T18:07:26.589191+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:07:26.589191+0000","last_undegraded":"2024-05-08T18:07:26.589191+0000","last_fullsized":"2024-05-08T18:07:26.589191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609671+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:07:26.609671+0000","last_peered":"2024-05-08T18:07:26.609671+0000","last_clean":"2024-05-08T18:07:26.609671+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:07:26.609671+0000","last_undegraded":"2024-05-08T18:07:26.609671+0000","last_fullsized":"2024-05-08T18:07:26.609671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.572384+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:07:26.572384+0000","last_peered":"2024-05-08T18:07:26.572384+0000","last_clean":"2024-05-08T18:07:26.572384+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:07:26.572384+0000","last_undegraded":"2024-05-08T18:07:26.572384+0000","last_fullsized":"2024-05-08T18:07:26.572384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600303+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:07:26.600303+0000","last_peered":"2024-05-08T18:07:26.600303+0000","last_clean":"2024-05-08T18:07:26.600303+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:07:26.600303+0000","last_undegraded":"2024-05-08T18:07:26.600303+0000","last_fullsized":"2024-05-08T18:07:26.600303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.588306+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:07:26.588306+0000","last_peered":"2024-05-08T18:07:26.588306+0000","last_clean":"2024-05-08T18:07:26.588306+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:07:26.588306+0000","last_undegraded":"2024-05-08T18:07:26.588306+0000","last_fullsized":"2024-05-08T18:07:26.588306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573849+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:07:26.573849+0000","last_peered":"2024-05-08T18:07:26.573849+0000","last_clean":"2024-05-08T18:07:26.573849+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:07:26.573849+0000","last_undegraded":"2024-05-08T18:07:26.573849+0000","last_fullsized":"2024-05-08T18:07:26.573849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604162+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:07:26.604162+0000","last_peered":"2024-05-08T18:07:26.604162+0000","last_clean":"2024-05-08T18:07:26.604162+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:07:26.604162+0000","last_undegraded":"2024-05-08T18:07:26.604162+0000","last_fullsized":"2024-05-08T18:07:26.604162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600705+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:07:26.600705+0000","last_peered":"2024-05-08T18:07:26.600705+0000","last_clean":"2024-05-08T18:07:26.600705+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:07:26.600705+0000","last_undegraded":"2024-05-08T18:07:26.600705+0000","last_fullsized":"2024-05-08T18:07:26.600705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.575310+0000","last_change":"2024-05-08T18:07:17.504030+0000","last_active":"2024-05-08T18:07:26.575310+0000","last_peered":"2024-05-08T18:07:26.575310+0000","last_clean":"2024-05-08T18:07:26.575310+0000","last_became_active":"2024-05-08T18:07:17.497558+0000","last_became_peered":"2024-05-08T18:07:17.497558+0000","last_unstale":"2024-05-08T18:07:26.575310+0000","last_undegraded":"2024-05-08T18:07:26.575310+0000","last_fullsized":"2024-05-08T18:07:26.575310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.611297+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:07:26.611297+0000","last_peered":"2024-05-08T18:07:26.611297+0000","last_clean":"2024-05-08T18:07:26.611297+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:07:26.611297+0000","last_undegraded":"2024-05-08T18:07:26.611297+0000","last_fullsized":"2024-05-08T18:07:26.611297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604116+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:07:26.604116+0000","last_peered":"2024-05-08T18:07:26.604116+0000","last_clean":"2024-05-08T18:07:26.604116+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:07:26.604116+0000","last_undegraded":"2024-05-08T18:07:26.604116+0000","last_fullsized":"2024-05-08T18:07:26.604116+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589796+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:07:26.589796+0000","last_peered":"2024-05-08T18:07:26.589796+0000","last_clean":"2024-05-08T18:07:26.589796+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:07:26.589796+0000","last_undegraded":"2024-05-08T18:07:26.589796+0000","last_fullsized":"2024-05-08T18:07:26.589796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609101+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:07:26.609101+0000","last_peered":"2024-05-08T18:07:26.609101+0000","last_clean":"2024-05-08T18:07:26.609101+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:07:26.609101+0000","last_undegraded":"2024-05-08T18:07:26.609101+0000","last_fullsized":"2024-05-08T18:07:26.609101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.605402+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:07:26.605402+0000","last_peered":"2024-05-08T18:07:26.605402+0000","last_clean":"2024-05-08T18:07:26.605402+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:07:26.605402+0000","last_undegraded":"2024-05-08T18:07:26.605402+0000","last_fullsized":"2024-05-08T18:07:26.605402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.575769+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:07:26.575769+0000","last_peered":"2024-05-08T18:07:26.575769+0000","last_clean":"2024-05-08T18:07:26.575769+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:07:26.575769+0000","last_undegraded":"2024-05-08T18:07:26.575769+0000","last_fullsized":"2024-05-08T18:07:26.575769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610963+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:07:26.610963+0000","last_peered":"2024-05-08T18:07:26.610963+0000","last_clean":"2024-05-08T18:07:26.610963+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:07:26.610963+0000","last_undegraded":"2024-05-08T18:07:26.610963+0000","last_fullsized":"2024-05-08T18:07:26.610963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.620428+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:07:26.620428+0000","last_peered":"2024-05-08T18:07:26.620428+0000","last_clean":"2024-05-08T18:07:26.620428+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:07:26.620428+0000","last_undegraded":"2024-05-08T18:07:26.620428+0000","last_fullsized":"2024-05-08T18:07:26.620428+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600995+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:07:26.600995+0000","last_peered":"2024-05-08T18:07:26.600995+0000","last_clean":"2024-05-08T18:07:26.600995+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:07:26.600995+0000","last_undegraded":"2024-05-08T18:07:26.600995+0000","last_fullsized":"2024-05-08T18:07:26.600995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573570+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:07:26.573570+0000","last_peered":"2024-05-08T18:07:26.573570+0000","last_clean":"2024-05-08T18:07:26.573570+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:07:26.573570+0000","last_undegraded":"2024-05-08T18:07:26.573570+0000","last_fullsized":"2024-05-08T18:07:26.573570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.611177+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:07:26.611177+0000","last_peered":"2024-05-08T18:07:26.611177+0000","last_clean":"2024-05-08T18:07:26.611177+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:07:26.611177+0000","last_undegraded":"2024-05-08T18:07:26.611177+0000","last_fullsized":"2024-05-08T18:07:26.611177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593421+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:07:26.593421+0000","last_peered":"2024-05-08T18:07:26.593421+0000","last_clean":"2024-05-08T18:07:26.593421+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:07:26.593421+0000","last_undegraded":"2024-05-08T18:07:26.593421+0000","last_fullsized":"2024-05-08T18:07:26.593421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.605148+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:07:26.605148+0000","last_peered":"2024-05-08T18:07:26.605148+0000","last_clean":"2024-05-08T18:07:26.605148+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:07:26.605148+0000","last_undegraded":"2024-05-08T18:07:26.605148+0000","last_fullsized":"2024-05-08T18:07:26.605148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589617+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:07:26.589617+0000","last_peered":"2024-05-08T18:07:26.589617+0000","last_clean":"2024-05-08T18:07:26.589617+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:07:26.589617+0000","last_undegraded":"2024-05-08T18:07:26.589617+0000","last_fullsized":"2024-05-08T18:07:26.589617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593957+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:07:26.593957+0000","last_peered":"2024-05-08T18:07:26.593957+0000","last_clean":"2024-05-08T18:07:26.593957+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:07:26.593957+0000","last_undegraded":"2024-05-08T18:07:26.593957+0000","last_fullsized":"2024-05-08T18:07:26.593957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604005+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:07:26.604005+0000","last_peered":"2024-05-08T18:07:26.604005+0000","last_clean":"2024-05-08T18:07:26.604005+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:07:26.604005+0000","last_undegraded":"2024-05-08T18:07:26.604005+0000","last_fullsized":"2024-05-08T18:07:26.604005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.574391+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:07:26.574391+0000","last_peered":"2024-05-08T18:07:26.574391+0000","last_clean":"2024-05-08T18:07:26.574391+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:07:26.574391+0000","last_undegraded":"2024-05-08T18:07:26.574391+0000","last_fullsized":"2024-05-08T18:07:26.574391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567887+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:07:26.567887+0000","last_peered":"2024-05-08T18:07:26.567887+0000","last_clean":"2024-05-08T18:07:26.567887+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:07:26.567887+0000","last_undegraded":"2024-05-08T18:07:26.567887+0000","last_fullsized":"2024-05-08T18:07:26.567887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.569250+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:07:26.569250+0000","last_peered":"2024-05-08T18:07:26.569250+0000","last_clean":"2024-05-08T18:07:26.569250+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:07:26.569250+0000","last_undegraded":"2024-05-08T18:07:26.569250+0000","last_fullsized":"2024-05-08T18:07:26.569250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.577952+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:07:26.577952+0000","last_peered":"2024-05-08T18:07:26.577952+0000","last_clean":"2024-05-08T18:07:26.577952+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:07:26.577952+0000","last_undegraded":"2024-05-08T18:07:26.577952+0000","last_fullsized":"2024-05-08T18:07:26.577952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593893+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:07:26.593893+0000","last_peered":"2024-05-08T18:07:26.593893+0000","last_clean":"2024-05-08T18:07:26.593893+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:07:26.593893+0000","last_undegraded":"2024-05-08T18:07:26.593893+0000","last_fullsized":"2024-05-08T18:07:26.593893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.598706+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:07:26.598706+0000","last_peered":"2024-05-08T18:07:26.598706+0000","last_clean":"2024-05-08T18:07:26.598706+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:07:26.598706+0000","last_undegraded":"2024-05-08T18:07:26.598706+0000","last_fullsized":"2024-05-08T18:07:26.598706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573423+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:07:26.573423+0000","last_peered":"2024-05-08T18:07:26.573423+0000","last_clean":"2024-05-08T18:07:26.573423+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:07:26.573423+0000","last_undegraded":"2024-05-08T18:07:26.573423+0000","last_fullsized":"2024-05-08T18:07:26.573423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609242+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:07:26.609242+0000","last_peered":"2024-05-08T18:07:26.609242+0000","last_clean":"2024-05-08T18:07:26.609242+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:07:26.609242+0000","last_undegraded":"2024-05-08T18:07:26.609242+0000","last_fullsized":"2024-05-08T18:07:26.609242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594855+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:07:26.594855+0000","last_peered":"2024-05-08T18:07:26.594855+0000","last_clean":"2024-05-08T18:07:26.594855+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:07:26.594855+0000","last_undegraded":"2024-05-08T18:07:26.594855+0000","last_fullsized":"2024-05-08T18:07:26.594855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568901+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:07:26.568901+0000","last_peered":"2024-05-08T18:07:26.568901+0000","last_clean":"2024-05-08T18:07:26.568901+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:07:26.568901+0000","last_undegraded":"2024-05-08T18:07:26.568901+0000","last_fullsized":"2024-05-08T18:07:26.568901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.605022+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:07:26.605022+0000","last_peered":"2024-05-08T18:07:26.605022+0000","last_clean":"2024-05-08T18:07:26.605022+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:07:26.605022+0000","last_undegraded":"2024-05-08T18:07:26.605022+0000","last_fullsized":"2024-05-08T18:07:26.605022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.588607+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:07:26.588607+0000","last_peered":"2024-05-08T18:07:26.588607+0000","last_clean":"2024-05-08T18:07:26.588607+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:07:26.588607+0000","last_undegraded":"2024-05-08T18:07:26.588607+0000","last_fullsized":"2024-05-08T18:07:26.588607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567603+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:07:26.567603+0000","last_peered":"2024-05-08T18:07:26.567603+0000","last_clean":"2024-05-08T18:07:26.567603+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:07:26.567603+0000","last_undegraded":"2024-05-08T18:07:26.567603+0000","last_fullsized":"2024-05-08T18:07:26.567603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.601215+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:07:26.601215+0000","last_peered":"2024-05-08T18:07:26.601215+0000","last_clean":"2024-05-08T18:07:26.601215+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:07:26.601215+0000","last_undegraded":"2024-05-08T18:07:26.601215+0000","last_fullsized":"2024-05-08T18:07:26.601215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.588990+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:07:26.588990+0000","last_peered":"2024-05-08T18:07:26.588990+0000","last_clean":"2024-05-08T18:07:26.588990+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:07:26.588990+0000","last_undegraded":"2024-05-08T18:07:26.588990+0000","last_fullsized":"2024-05-08T18:07:26.588990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"31'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.598797+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:07:26.598797+0000","last_peered":"2024-05-08T18:07:26.598797+0000","last_clean":"2024-05-08T18:07:26.598797+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:07:26.598797+0000","last_undegraded":"2024-05-08T18:07:26.598797+0000","last_fullsized":"2024-05-08T18:07:26.598797+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.608226+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:07:26.608226+0000","last_peered":"2024-05-08T18:07:26.608226+0000","last_clean":"2024-05-08T18:07:26.608226+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:07:26.608226+0000","last_undegraded":"2024-05-08T18:07:26.608226+0000","last_fullsized":"2024-05-08T18:07:26.608226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.591435+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:07:26.591435+0000","last_peered":"2024-05-08T18:07:26.591435+0000","last_clean":"2024-05-08T18:07:26.591435+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:07:26.591435+0000","last_undegraded":"2024-05-08T18:07:26.591435+0000","last_fullsized":"2024-05-08T18:07:26.591435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567585+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:07:26.567585+0000","last_peered":"2024-05-08T18:07:26.567585+0000","last_clean":"2024-05-08T18:07:26.567585+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:07:26.567585+0000","last_undegraded":"2024-05-08T18:07:26.567585+0000","last_fullsized":"2024-05-08T18:07:26.567585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600337+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:07:26.600337+0000","last_peered":"2024-05-08T18:07:26.600337+0000","last_clean":"2024-05-08T18:07:26.600337+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:07:26.600337+0000","last_undegraded":"2024-05-08T18:07:26.600337+0000","last_fullsized":"2024-05-08T18:07:26.600337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599095+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:07:26.599095+0000","last_peered":"2024-05-08T18:07:26.599095+0000","last_clean":"2024-05-08T18:07:26.599095+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:07:26.599095+0000","last_undegraded":"2024-05-08T18:07:26.599095+0000","last_fullsized":"2024-05-08T18:07:26.599095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"31'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.608105+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:07:26.608105+0000","last_peered":"2024-05-08T18:07:26.608105+0000","last_clean":"2024-05-08T18:07:26.608105+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:07:26.608105+0000","last_undegraded":"2024-05-08T18:07:26.608105+0000","last_fullsized":"2024-05-08T18:07:26.608105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.603553+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:07:26.603553+0000","last_peered":"2024-05-08T18:07:26.603553+0000","last_clean":"2024-05-08T18:07:26.603553+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:07:26.603553+0000","last_undegraded":"2024-05-08T18:07:26.603553+0000","last_fullsized":"2024-05-08T18:07:26.603553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.576617+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:07:26.576617+0000","last_peered":"2024-05-08T18:07:26.576617+0000","last_clean":"2024-05-08T18:07:26.576617+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:07:26.576617+0000","last_undegraded":"2024-05-08T18:07:26.576617+0000","last_fullsized":"2024-05-08T18:07:26.576617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.572534+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:07:26.572534+0000","last_peered":"2024-05-08T18:07:26.572534+0000","last_clean":"2024-05-08T18:07:26.572534+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:07:26.572534+0000","last_undegraded":"2024-05-08T18:07:26.572534+0000","last_fullsized":"2024-05-08T18:07:26.572534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.576916+0000","last_change":"2024-05-08T18:07:15.488647+0000","last_active":"2024-05-08T18:07:26.576916+0000","last_peered":"2024-05-08T18:07:26.576916+0000","last_clean":"2024-05-08T18:07:26.576916+0000","last_became_active":"2024-05-08T18:07:15.487842+0000","last_became_peered":"2024-05-08T18:07:15.487842+0000","last_unstale":"2024-05-08T18:07:26.576916+0000","last_undegraded":"2024-05-08T18:07:26.576916+0000","last_fullsized":"2024-05-08T18:07:26.576916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.566280+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:07:26.566280+0000","last_peered":"2024-05-08T18:07:26.566280+0000","last_clean":"2024-05-08T18:07:26.566280+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:07:26.566280+0000","last_undegraded":"2024-05-08T18:07:26.566280+0000","last_fullsized":"2024-05-08T18:07:26.566280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.575004+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:07:26.575004+0000","last_peered":"2024-05-08T18:07:26.575004+0000","last_clean":"2024-05-08T18:07:26.575004+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:07:26.575004+0000","last_undegraded":"2024-05-08T18:07:26.575004+0000","last_fullsized":"2024-05-08T18:07:26.575004+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.566791+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:07:26.566791+0000","last_peered":"2024-05-08T18:07:26.566791+0000","last_clean":"2024-05-08T18:07:26.566791+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:07:26.566791+0000","last_undegraded":"2024-05-08T18:07:26.566791+0000","last_fullsized":"2024-05-08T18:07:26.566791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590635+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:07:26.590635+0000","last_peered":"2024-05-08T18:07:26.590635+0000","last_clean":"2024-05-08T18:07:26.590635+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:07:26.590635+0000","last_undegraded":"2024-05-08T18:07:26.590635+0000","last_fullsized":"2024-05-08T18:07:26.590635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.566895+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:07:26.566895+0000","last_peered":"2024-05-08T18:07:26.566895+0000","last_clean":"2024-05-08T18:07:26.566895+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:07:26.566895+0000","last_undegraded":"2024-05-08T18:07:26.566895+0000","last_fullsized":"2024-05-08T18:07:26.566895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.611207+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:07:26.611207+0000","last_peered":"2024-05-08T18:07:26.611207+0000","last_clean":"2024-05-08T18:07:26.611207+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:07:26.611207+0000","last_undegraded":"2024-05-08T18:07:26.611207+0000","last_fullsized":"2024-05-08T18:07:26.611207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.592567+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:07:26.592567+0000","last_peered":"2024-05-08T18:07:26.592567+0000","last_clean":"2024-05-08T18:07:26.592567+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:07:26.592567+0000","last_undegraded":"2024-05-08T18:07:26.592567+0000","last_fullsized":"2024-05-08T18:07:26.592567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567068+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:07:26.567068+0000","last_peered":"2024-05-08T18:07:26.567068+0000","last_clean":"2024-05-08T18:07:26.567068+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:07:26.567068+0000","last_undegraded":"2024-05-08T18:07:26.567068+0000","last_fullsized":"2024-05-08T18:07:26.567068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609274+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:07:26.609274+0000","last_peered":"2024-05-08T18:07:26.609274+0000","last_clean":"2024-05-08T18:07:26.609274+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:07:26.609274+0000","last_undegraded":"2024-05-08T18:07:26.609274+0000","last_fullsized":"2024-05-08T18:07:26.609274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.569490+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:07:26.569490+0000","last_peered":"2024-05-08T18:07:26.569490+0000","last_clean":"2024-05-08T18:07:26.569490+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:07:26.569490+0000","last_undegraded":"2024-05-08T18:07:26.569490+0000","last_fullsized":"2024-05-08T18:07:26.569490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594353+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:07:26.594353+0000","last_peered":"2024-05-08T18:07:26.594353+0000","last_clean":"2024-05-08T18:07:26.594353+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:07:26.594353+0000","last_undegraded":"2024-05-08T18:07:26.594353+0000","last_fullsized":"2024-05-08T18:07:26.594353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.603466+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:07:26.603466+0000","last_peered":"2024-05-08T18:07:26.603466+0000","last_clean":"2024-05-08T18:07:26.603466+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:07:26.603466+0000","last_undegraded":"2024-05-08T18:07:26.603466+0000","last_fullsized":"2024-05-08T18:07:26.603466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594406+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:07:26.594406+0000","last_peered":"2024-05-08T18:07:26.594406+0000","last_clean":"2024-05-08T18:07:26.594406+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:07:26.594406+0000","last_undegraded":"2024-05-08T18:07:26.594406+0000","last_fullsized":"2024-05-08T18:07:26.594406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.570435+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:07:26.570435+0000","last_peered":"2024-05-08T18:07:26.570435+0000","last_clean":"2024-05-08T18:07:26.570435+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:07:26.570435+0000","last_undegraded":"2024-05-08T18:07:26.570435+0000","last_fullsized":"2024-05-08T18:07:26.570435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599491+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:07:26.599491+0000","last_peered":"2024-05-08T18:07:26.599491+0000","last_clean":"2024-05-08T18:07:26.599491+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:07:26.599491+0000","last_undegraded":"2024-05-08T18:07:26.599491+0000","last_fullsized":"2024-05-08T18:07:26.599491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600323+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:07:26.600323+0000","last_peered":"2024-05-08T18:07:26.600323+0000","last_clean":"2024-05-08T18:07:26.600323+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:07:26.600323+0000","last_undegraded":"2024-05-08T18:07:26.600323+0000","last_fullsized":"2024-05-08T18:07:26.600323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594163+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:07:26.594163+0000","last_peered":"2024-05-08T18:07:26.594163+0000","last_clean":"2024-05-08T18:07:26.594163+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:07:26.594163+0000","last_undegraded":"2024-05-08T18:07:26.594163+0000","last_fullsized":"2024-05-08T18:07:26.594163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609490+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:07:26.609490+0000","last_peered":"2024-05-08T18:07:26.609490+0000","last_clean":"2024-05-08T18:07:26.609490+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:07:26.609490+0000","last_undegraded":"2024-05-08T18:07:26.609490+0000","last_fullsized":"2024-05-08T18:07:26.609490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.574370+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:07:26.574370+0000","last_peered":"2024-05-08T18:07:26.574370+0000","last_clean":"2024-05-08T18:07:26.574370+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:07:26.574370+0000","last_undegraded":"2024-05-08T18:07:26.574370+0000","last_fullsized":"2024-05-08T18:07:26.574370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.575717+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:07:26.575717+0000","last_peered":"2024-05-08T18:07:26.575717+0000","last_clean":"2024-05-08T18:07:26.575717+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:07:26.575717+0000","last_undegraded":"2024-05-08T18:07:26.575717+0000","last_fullsized":"2024-05-08T18:07:26.575717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567861+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:07:26.567861+0000","last_peered":"2024-05-08T18:07:26.567861+0000","last_clean":"2024-05-08T18:07:26.567861+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:07:26.567861+0000","last_undegraded":"2024-05-08T18:07:26.567861+0000","last_fullsized":"2024-05-08T18:07:26.567861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.595218+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:07:26.595218+0000","last_peered":"2024-05-08T18:07:26.595218+0000","last_clean":"2024-05-08T18:07:26.595218+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:07:26.595218+0000","last_undegraded":"2024-05-08T18:07:26.595218+0000","last_fullsized":"2024-05-08T18:07:26.595218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.572020+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:07:26.572020+0000","last_peered":"2024-05-08T18:07:26.572020+0000","last_clean":"2024-05-08T18:07:26.572020+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:07:26.572020+0000","last_undegraded":"2024-05-08T18:07:26.572020+0000","last_fullsized":"2024-05-08T18:07:26.572020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.605397+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:07:26.605397+0000","last_peered":"2024-05-08T18:07:26.605397+0000","last_clean":"2024-05-08T18:07:26.605397+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:07:26.605397+0000","last_undegraded":"2024-05-08T18:07:26.605397+0000","last_fullsized":"2024-05-08T18:07:26.605397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.603311+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:07:26.603311+0000","last_peered":"2024-05-08T18:07:26.603311+0000","last_clean":"2024-05-08T18:07:26.603311+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:07:26.603311+0000","last_undegraded":"2024-05-08T18:07:26.603311+0000","last_fullsized":"2024-05-08T18:07:26.603311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.577492+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:07:26.577492+0000","last_peered":"2024-05-08T18:07:26.577492+0000","last_clean":"2024-05-08T18:07:26.577492+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:07:26.577492+0000","last_undegraded":"2024-05-08T18:07:26.577492+0000","last_fullsized":"2024-05-08T18:07:26.577492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.611151+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:07:26.611151+0000","last_peered":"2024-05-08T18:07:26.611151+0000","last_clean":"2024-05-08T18:07:26.611151+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:07:26.611151+0000","last_undegraded":"2024-05-08T18:07:26.611151+0000","last_fullsized":"2024-05-08T18:07:26.611151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599377+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:07:26.599377+0000","last_peered":"2024-05-08T18:07:26.599377+0000","last_clean":"2024-05-08T18:07:26.599377+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:07:26.599377+0000","last_undegraded":"2024-05-08T18:07:26.599377+0000","last_fullsized":"2024-05-08T18:07:26.599377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.569198+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:07:26.569198+0000","last_peered":"2024-05-08T18:07:26.569198+0000","last_clean":"2024-05-08T18:07:26.569198+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:07:26.569198+0000","last_undegraded":"2024-05-08T18:07:26.569198+0000","last_fullsized":"2024-05-08T18:07:26.569198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.572615+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:07:26.572615+0000","last_peered":"2024-05-08T18:07:26.572615+0000","last_clean":"2024-05-08T18:07:26.572615+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:07:26.572615+0000","last_undegraded":"2024-05-08T18:07:26.572615+0000","last_fullsized":"2024-05-08T18:07:26.572615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571614+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:07:26.571614+0000","last_peered":"2024-05-08T18:07:26.571614+0000","last_clean":"2024-05-08T18:07:26.571614+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:07:26.571614+0000","last_undegraded":"2024-05-08T18:07:26.571614+0000","last_fullsized":"2024-05-08T18:07:26.571614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600086+0000","last_change":"2024-05-08T18:07:15.498938+0000","last_active":"2024-05-08T18:07:26.600086+0000","last_peered":"2024-05-08T18:07:26.600086+0000","last_clean":"2024-05-08T18:07:26.600086+0000","last_became_active":"2024-05-08T18:07:15.498206+0000","last_became_peered":"2024-05-08T18:07:15.498206+0000","last_unstale":"2024-05-08T18:07:26.600086+0000","last_undegraded":"2024-05-08T18:07:26.600086+0000","last_fullsized":"2024-05-08T18:07:26.600086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568806+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:07:26.568806+0000","last_peered":"2024-05-08T18:07:26.568806+0000","last_clean":"2024-05-08T18:07:26.568806+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:07:26.568806+0000","last_undegraded":"2024-05-08T18:07:26.568806+0000","last_fullsized":"2024-05-08T18:07:26.568806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609741+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:07:26.609741+0000","last_peered":"2024-05-08T18:07:26.609741+0000","last_clean":"2024-05-08T18:07:26.609741+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:07:26.609741+0000","last_undegraded":"2024-05-08T18:07:26.609741+0000","last_fullsized":"2024-05-08T18:07:26.609741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589550+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:07:26.589550+0000","last_peered":"2024-05-08T18:07:26.589550+0000","last_clean":"2024-05-08T18:07:26.589550+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:07:26.589550+0000","last_undegraded":"2024-05-08T18:07:26.589550+0000","last_fullsized":"2024-05-08T18:07:26.589550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604541+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:07:26.604541+0000","last_peered":"2024-05-08T18:07:26.604541+0000","last_clean":"2024-05-08T18:07:26.604541+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:07:26.604541+0000","last_undegraded":"2024-05-08T18:07:26.604541+0000","last_fullsized":"2024-05-08T18:07:26.604541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.608683+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:07:26.608683+0000","last_peered":"2024-05-08T18:07:26.608683+0000","last_clean":"2024-05-08T18:07:26.608683+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:07:26.608683+0000","last_undegraded":"2024-05-08T18:07:26.608683+0000","last_fullsized":"2024-05-08T18:07:26.608683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.591240+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:07:26.591240+0000","last_peered":"2024-05-08T18:07:26.591240+0000","last_clean":"2024-05-08T18:07:26.591240+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:07:26.591240+0000","last_undegraded":"2024-05-08T18:07:26.591240+0000","last_fullsized":"2024-05-08T18:07:26.591240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571786+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:07:26.571786+0000","last_peered":"2024-05-08T18:07:26.571786+0000","last_clean":"2024-05-08T18:07:26.571786+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:07:26.571786+0000","last_undegraded":"2024-05-08T18:07:26.571786+0000","last_fullsized":"2024-05-08T18:07:26.571786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573342+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:07:26.573342+0000","last_peered":"2024-05-08T18:07:26.573342+0000","last_clean":"2024-05-08T18:07:26.573342+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:07:26.573342+0000","last_undegraded":"2024-05-08T18:07:26.573342+0000","last_fullsized":"2024-05-08T18:07:26.573342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.588673+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:07:26.588673+0000","last_peered":"2024-05-08T18:07:26.588673+0000","last_clean":"2024-05-08T18:07:26.588673+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:07:26.588673+0000","last_undegraded":"2024-05-08T18:07:26.588673+0000","last_fullsized":"2024-05-08T18:07:26.588673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.601533+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:07:26.601533+0000","last_peered":"2024-05-08T18:07:26.601533+0000","last_clean":"2024-05-08T18:07:26.601533+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:07:26.601533+0000","last_undegraded":"2024-05-08T18:07:26.601533+0000","last_fullsized":"2024-05-08T18:07:26.601533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599138+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:07:26.599138+0000","last_peered":"2024-05-08T18:07:26.599138+0000","last_clean":"2024-05-08T18:07:26.599138+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:07:26.599138+0000","last_undegraded":"2024-05-08T18:07:26.599138+0000","last_fullsized":"2024-05-08T18:07:26.599138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610984+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:07:26.610984+0000","last_peered":"2024-05-08T18:07:26.610984+0000","last_clean":"2024-05-08T18:07:26.610984+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:07:26.610984+0000","last_undegraded":"2024-05-08T18:07:26.610984+0000","last_fullsized":"2024-05-08T18:07:26.610984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593291+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:07:26.593291+0000","last_peered":"2024-05-08T18:07:26.593291+0000","last_clean":"2024-05-08T18:07:26.593291+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:07:26.593291+0000","last_undegraded":"2024-05-08T18:07:26.593291+0000","last_fullsized":"2024-05-08T18:07:26.593291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600121+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:07:26.600121+0000","last_peered":"2024-05-08T18:07:26.600121+0000","last_clean":"2024-05-08T18:07:26.600121+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:07:26.600121+0000","last_undegraded":"2024-05-08T18:07:26.600121+0000","last_fullsized":"2024-05-08T18:07:26.600121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3592,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":65,"num_read_kb":1,"num_write":65,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":7294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":740732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":149928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":150979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":150859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":157872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":149820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":158826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":937984,"data_stored":740578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:07:33.540 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:07:33.884 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:07:33.891 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:07:33.904 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-05-08T18:07:33.665664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":528,"num_write_kb":1668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220404,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754316,"statfs":{"total":773094113280,"available":772868419584,"internally_reserved":0,"allocated":4333568,"data_stored":2453462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.129697"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590934+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:07:26.590934+0000","last_peered":"2024-05-08T18:07:26.590934+0000","last_clean":"2024-05-08T18:07:26.590934+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:07:26.590934+0000","last_undegraded":"2024-05-08T18:07:26.590934+0000","last_fullsized":"2024-05-08T18:07:26.590934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.598333+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:07:26.598333+0000","last_peered":"2024-05-08T18:07:26.598333+0000","last_clean":"2024-05-08T18:07:26.598333+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:07:26.598333+0000","last_undegraded":"2024-05-08T18:07:26.598333+0000","last_fullsized":"2024-05-08T18:07:26.598333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594662+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:07:26.594662+0000","last_peered":"2024-05-08T18:07:26.594662+0000","last_clean":"2024-05-08T18:07:26.594662+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:07:26.594662+0000","last_undegraded":"2024-05-08T18:07:26.594662+0000","last_fullsized":"2024-05-08T18:07:26.594662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589208+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:07:26.589208+0000","last_peered":"2024-05-08T18:07:26.589208+0000","last_clean":"2024-05-08T18:07:26.589208+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:07:26.589208+0000","last_undegraded":"2024-05-08T18:07:26.589208+0000","last_fullsized":"2024-05-08T18:07:26.589208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610165+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:07:26.610165+0000","last_peered":"2024-05-08T18:07:26.610165+0000","last_clean":"2024-05-08T18:07:26.610165+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:07:26.610165+0000","last_undegraded":"2024-05-08T18:07:26.610165+0000","last_fullsized":"2024-05-08T18:07:26.610165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567215+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:07:26.567215+0000","last_peered":"2024-05-08T18:07:26.567215+0000","last_clean":"2024-05-08T18:07:26.567215+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:07:26.567215+0000","last_undegraded":"2024-05-08T18:07:26.567215+0000","last_fullsized":"2024-05-08T18:07:26.567215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.601132+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:07:26.601132+0000","last_peered":"2024-05-08T18:07:26.601132+0000","last_clean":"2024-05-08T18:07:26.601132+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:07:26.601132+0000","last_undegraded":"2024-05-08T18:07:26.601132+0000","last_fullsized":"2024-05-08T18:07:26.601132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609423+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:07:26.609423+0000","last_peered":"2024-05-08T18:07:26.609423+0000","last_clean":"2024-05-08T18:07:26.609423+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:07:26.609423+0000","last_undegraded":"2024-05-08T18:07:26.609423+0000","last_fullsized":"2024-05-08T18:07:26.609423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589901+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:07:26.589901+0000","last_peered":"2024-05-08T18:07:26.589901+0000","last_clean":"2024-05-08T18:07:26.589901+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:07:26.589901+0000","last_undegraded":"2024-05-08T18:07:26.589901+0000","last_fullsized":"2024-05-08T18:07:26.589901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604286+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:07:26.604286+0000","last_peered":"2024-05-08T18:07:26.604286+0000","last_clean":"2024-05-08T18:07:26.604286+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:07:26.604286+0000","last_undegraded":"2024-05-08T18:07:26.604286+0000","last_fullsized":"2024-05-08T18:07:26.604286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.598981+0000","last_change":"2024-05-08T18:07:15.502659+0000","last_active":"2024-05-08T18:07:26.598981+0000","last_peered":"2024-05-08T18:07:26.598981+0000","last_clean":"2024-05-08T18:07:26.598981+0000","last_became_active":"2024-05-08T18:07:15.501947+0000","last_became_peered":"2024-05-08T18:07:15.501947+0000","last_unstale":"2024-05-08T18:07:26.598981+0000","last_undegraded":"2024-05-08T18:07:26.598981+0000","last_fullsized":"2024-05-08T18:07:26.598981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568605+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:07:26.568605+0000","last_peered":"2024-05-08T18:07:26.568605+0000","last_clean":"2024-05-08T18:07:26.568605+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:07:26.568605+0000","last_undegraded":"2024-05-08T18:07:26.568605+0000","last_fullsized":"2024-05-08T18:07:26.568605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589539+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:07:26.589539+0000","last_peered":"2024-05-08T18:07:26.589539+0000","last_clean":"2024-05-08T18:07:26.589539+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:07:26.589539+0000","last_undegraded":"2024-05-08T18:07:26.589539+0000","last_fullsized":"2024-05-08T18:07:26.589539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599871+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:07:26.599871+0000","last_peered":"2024-05-08T18:07:26.599871+0000","last_clean":"2024-05-08T18:07:26.599871+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:07:26.599871+0000","last_undegraded":"2024-05-08T18:07:26.599871+0000","last_fullsized":"2024-05-08T18:07:26.599871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.575539+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:07:26.575539+0000","last_peered":"2024-05-08T18:07:26.575539+0000","last_clean":"2024-05-08T18:07:26.575539+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:07:26.575539+0000","last_undegraded":"2024-05-08T18:07:26.575539+0000","last_fullsized":"2024-05-08T18:07:26.575539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573072+0000","last_change":"2024-05-08T18:07:17.508968+0000","last_active":"2024-05-08T18:07:26.573072+0000","last_peered":"2024-05-08T18:07:26.573072+0000","last_clean":"2024-05-08T18:07:26.573072+0000","last_became_active":"2024-05-08T18:07:17.508588+0000","last_became_peered":"2024-05-08T18:07:17.508588+0000","last_unstale":"2024-05-08T18:07:26.573072+0000","last_undegraded":"2024-05-08T18:07:26.573072+0000","last_fullsized":"2024-05-08T18:07:26.573072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:08.890984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.566810+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:07:26.566810+0000","last_peered":"2024-05-08T18:07:26.566810+0000","last_clean":"2024-05-08T18:07:26.566810+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:07:26.566810+0000","last_undegraded":"2024-05-08T18:07:26.566810+0000","last_fullsized":"2024-05-08T18:07:26.566810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.591007+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:07:26.591007+0000","last_peered":"2024-05-08T18:07:26.591007+0000","last_clean":"2024-05-08T18:07:26.591007+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:07:26.591007+0000","last_undegraded":"2024-05-08T18:07:26.591007+0000","last_fullsized":"2024-05-08T18:07:26.591007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589332+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:07:26.589332+0000","last_peered":"2024-05-08T18:07:26.589332+0000","last_clean":"2024-05-08T18:07:26.589332+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:07:26.589332+0000","last_undegraded":"2024-05-08T18:07:26.589332+0000","last_fullsized":"2024-05-08T18:07:26.589332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.605242+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:07:26.605242+0000","last_peered":"2024-05-08T18:07:26.605242+0000","last_clean":"2024-05-08T18:07:26.605242+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:07:26.605242+0000","last_undegraded":"2024-05-08T18:07:26.605242+0000","last_fullsized":"2024-05-08T18:07:26.605242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599849+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:07:26.599849+0000","last_peered":"2024-05-08T18:07:26.599849+0000","last_clean":"2024-05-08T18:07:26.599849+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:07:26.599849+0000","last_undegraded":"2024-05-08T18:07:26.599849+0000","last_fullsized":"2024-05-08T18:07:26.599849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.605100+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:07:26.605100+0000","last_peered":"2024-05-08T18:07:26.605100+0000","last_clean":"2024-05-08T18:07:26.605100+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:07:26.605100+0000","last_undegraded":"2024-05-08T18:07:26.605100+0000","last_fullsized":"2024-05-08T18:07:26.605100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571248+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:07:26.571248+0000","last_peered":"2024-05-08T18:07:26.571248+0000","last_clean":"2024-05-08T18:07:26.571248+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:07:26.571248+0000","last_undegraded":"2024-05-08T18:07:26.571248+0000","last_fullsized":"2024-05-08T18:07:26.571248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568244+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:07:26.568244+0000","last_peered":"2024-05-08T18:07:26.568244+0000","last_clean":"2024-05-08T18:07:26.568244+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:07:26.568244+0000","last_undegraded":"2024-05-08T18:07:26.568244+0000","last_fullsized":"2024-05-08T18:07:26.568244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573188+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:07:26.573188+0000","last_peered":"2024-05-08T18:07:26.573188+0000","last_clean":"2024-05-08T18:07:26.573188+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:07:26.573188+0000","last_undegraded":"2024-05-08T18:07:26.573188+0000","last_fullsized":"2024-05-08T18:07:26.573188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573854+0000","last_change":"2024-05-08T18:07:15.480500+0000","last_active":"2024-05-08T18:07:26.573854+0000","last_peered":"2024-05-08T18:07:26.573854+0000","last_clean":"2024-05-08T18:07:26.573854+0000","last_became_active":"2024-05-08T18:07:15.480192+0000","last_became_peered":"2024-05-08T18:07:15.480192+0000","last_unstale":"2024-05-08T18:07:26.573854+0000","last_undegraded":"2024-05-08T18:07:26.573854+0000","last_fullsized":"2024-05-08T18:07:26.573854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568732+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:07:26.568732+0000","last_peered":"2024-05-08T18:07:26.568732+0000","last_clean":"2024-05-08T18:07:26.568732+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:07:26.568732+0000","last_undegraded":"2024-05-08T18:07:26.568732+0000","last_fullsized":"2024-05-08T18:07:26.568732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610351+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:07:26.610351+0000","last_peered":"2024-05-08T18:07:26.610351+0000","last_clean":"2024-05-08T18:07:26.610351+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:07:26.610351+0000","last_undegraded":"2024-05-08T18:07:26.610351+0000","last_fullsized":"2024-05-08T18:07:26.610351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.566467+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:07:26.566467+0000","last_peered":"2024-05-08T18:07:26.566467+0000","last_clean":"2024-05-08T18:07:26.566467+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:07:26.566467+0000","last_undegraded":"2024-05-08T18:07:26.566467+0000","last_fullsized":"2024-05-08T18:07:26.566467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.575270+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:07:26.575270+0000","last_peered":"2024-05-08T18:07:26.575270+0000","last_clean":"2024-05-08T18:07:26.575270+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:07:26.575270+0000","last_undegraded":"2024-05-08T18:07:26.575270+0000","last_fullsized":"2024-05-08T18:07:26.575270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590041+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:07:26.590041+0000","last_peered":"2024-05-08T18:07:26.590041+0000","last_clean":"2024-05-08T18:07:26.590041+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:07:26.590041+0000","last_undegraded":"2024-05-08T18:07:26.590041+0000","last_fullsized":"2024-05-08T18:07:26.590041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599490+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:07:26.599490+0000","last_peered":"2024-05-08T18:07:26.599490+0000","last_clean":"2024-05-08T18:07:26.599490+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:07:26.599490+0000","last_undegraded":"2024-05-08T18:07:26.599490+0000","last_fullsized":"2024-05-08T18:07:26.599490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.006372+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:07:27.006372+0000","last_peered":"2024-05-08T18:07:27.006372+0000","last_clean":"2024-05-08T18:07:27.006372+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:07:27.006372+0000","last_undegraded":"2024-05-08T18:07:27.006372+0000","last_fullsized":"2024-05-08T18:07:27.006372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590796+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:07:26.590796+0000","last_peered":"2024-05-08T18:07:26.590796+0000","last_clean":"2024-05-08T18:07:26.590796+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:07:26.590796+0000","last_undegraded":"2024-05-08T18:07:26.590796+0000","last_fullsized":"2024-05-08T18:07:26.590796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.598441+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:07:26.598441+0000","last_peered":"2024-05-08T18:07:26.598441+0000","last_clean":"2024-05-08T18:07:26.598441+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:07:26.598441+0000","last_undegraded":"2024-05-08T18:07:26.598441+0000","last_fullsized":"2024-05-08T18:07:26.598441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600076+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:07:26.600076+0000","last_peered":"2024-05-08T18:07:26.600076+0000","last_clean":"2024-05-08T18:07:26.600076+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:07:26.600076+0000","last_undegraded":"2024-05-08T18:07:26.600076+0000","last_fullsized":"2024-05-08T18:07:26.600076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610592+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:07:26.610592+0000","last_peered":"2024-05-08T18:07:26.610592+0000","last_clean":"2024-05-08T18:07:26.610592+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:07:26.610592+0000","last_undegraded":"2024-05-08T18:07:26.610592+0000","last_fullsized":"2024-05-08T18:07:26.610592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.574692+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:07:26.574692+0000","last_peered":"2024-05-08T18:07:26.574692+0000","last_clean":"2024-05-08T18:07:26.574692+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:07:26.574692+0000","last_undegraded":"2024-05-08T18:07:26.574692+0000","last_fullsized":"2024-05-08T18:07:26.574692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.401795+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:07:27.401795+0000","last_peered":"2024-05-08T18:07:27.401795+0000","last_clean":"2024-05-08T18:07:27.401795+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:07:27.401795+0000","last_undegraded":"2024-05-08T18:07:27.401795+0000","last_fullsized":"2024-05-08T18:07:27.401795+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568758+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:07:26.568758+0000","last_peered":"2024-05-08T18:07:26.568758+0000","last_clean":"2024-05-08T18:07:26.568758+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:07:26.568758+0000","last_undegraded":"2024-05-08T18:07:26.568758+0000","last_fullsized":"2024-05-08T18:07:26.568758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609151+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:07:26.609151+0000","last_peered":"2024-05-08T18:07:26.609151+0000","last_clean":"2024-05-08T18:07:26.609151+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:07:26.609151+0000","last_undegraded":"2024-05-08T18:07:26.609151+0000","last_fullsized":"2024-05-08T18:07:26.609151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.611521+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:07:26.611521+0000","last_peered":"2024-05-08T18:07:26.611521+0000","last_clean":"2024-05-08T18:07:26.611521+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:07:26.611521+0000","last_undegraded":"2024-05-08T18:07:26.611521+0000","last_fullsized":"2024-05-08T18:07:26.611521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589592+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:07:26.589592+0000","last_peered":"2024-05-08T18:07:26.589592+0000","last_clean":"2024-05-08T18:07:26.589592+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:07:26.589592+0000","last_undegraded":"2024-05-08T18:07:26.589592+0000","last_fullsized":"2024-05-08T18:07:26.589592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.578015+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:07:26.578015+0000","last_peered":"2024-05-08T18:07:26.578015+0000","last_clean":"2024-05-08T18:07:26.578015+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:07:26.578015+0000","last_undegraded":"2024-05-08T18:07:26.578015+0000","last_fullsized":"2024-05-08T18:07:26.578015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.457741+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:07:27.457741+0000","last_peered":"2024-05-08T18:07:27.457741+0000","last_clean":"2024-05-08T18:07:27.457741+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:07:27.457741+0000","last_undegraded":"2024-05-08T18:07:27.457741+0000","last_fullsized":"2024-05-08T18:07:27.457741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.703173+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:07:26.703173+0000","last_peered":"2024-05-08T18:07:26.703173+0000","last_clean":"2024-05-08T18:07:26.703173+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:07:26.703173+0000","last_undegraded":"2024-05-08T18:07:26.703173+0000","last_fullsized":"2024-05-08T18:07:26.703173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567420+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:07:26.567420+0000","last_peered":"2024-05-08T18:07:26.567420+0000","last_clean":"2024-05-08T18:07:26.567420+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:07:26.567420+0000","last_undegraded":"2024-05-08T18:07:26.567420+0000","last_fullsized":"2024-05-08T18:07:26.567420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.577222+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:07:26.577222+0000","last_peered":"2024-05-08T18:07:26.577222+0000","last_clean":"2024-05-08T18:07:26.577222+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:07:26.577222+0000","last_undegraded":"2024-05-08T18:07:26.577222+0000","last_fullsized":"2024-05-08T18:07:26.577222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.603616+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:07:26.603616+0000","last_peered":"2024-05-08T18:07:26.603616+0000","last_clean":"2024-05-08T18:07:26.603616+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:07:26.603616+0000","last_undegraded":"2024-05-08T18:07:26.603616+0000","last_fullsized":"2024-05-08T18:07:26.603616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599785+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:07:26.599785+0000","last_peered":"2024-05-08T18:07:26.599785+0000","last_clean":"2024-05-08T18:07:26.599785+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:07:26.599785+0000","last_undegraded":"2024-05-08T18:07:26.599785+0000","last_fullsized":"2024-05-08T18:07:26.599785+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.463906+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:07:27.463906+0000","last_peered":"2024-05-08T18:07:27.463906+0000","last_clean":"2024-05-08T18:07:27.463906+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:07:27.463906+0000","last_undegraded":"2024-05-08T18:07:27.463906+0000","last_fullsized":"2024-05-08T18:07:27.463906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.704041+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:07:26.704041+0000","last_peered":"2024-05-08T18:07:26.704041+0000","last_clean":"2024-05-08T18:07:26.704041+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:07:26.704041+0000","last_undegraded":"2024-05-08T18:07:26.704041+0000","last_fullsized":"2024-05-08T18:07:26.704041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.598816+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:07:26.598816+0000","last_peered":"2024-05-08T18:07:26.598816+0000","last_clean":"2024-05-08T18:07:26.598816+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:07:26.598816+0000","last_undegraded":"2024-05-08T18:07:26.598816+0000","last_fullsized":"2024-05-08T18:07:26.598816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.591197+0000","last_change":"2024-05-08T18:07:15.515622+0000","last_active":"2024-05-08T18:07:26.591197+0000","last_peered":"2024-05-08T18:07:26.591197+0000","last_clean":"2024-05-08T18:07:26.591197+0000","last_became_active":"2024-05-08T18:07:15.515050+0000","last_became_peered":"2024-05-08T18:07:15.515050+0000","last_unstale":"2024-05-08T18:07:26.591197+0000","last_undegraded":"2024-05-08T18:07:26.591197+0000","last_fullsized":"2024-05-08T18:07:26.591197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.588781+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:07:26.588781+0000","last_peered":"2024-05-08T18:07:26.588781+0000","last_clean":"2024-05-08T18:07:26.588781+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:07:26.588781+0000","last_undegraded":"2024-05-08T18:07:26.588781+0000","last_fullsized":"2024-05-08T18:07:26.588781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.561152+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:07:27.561152+0000","last_peered":"2024-05-08T18:07:27.561152+0000","last_clean":"2024-05-08T18:07:27.561152+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:07:27.561152+0000","last_undegraded":"2024-05-08T18:07:27.561152+0000","last_fullsized":"2024-05-08T18:07:27.561152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593647+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:07:26.593647+0000","last_peered":"2024-05-08T18:07:26.593647+0000","last_clean":"2024-05-08T18:07:26.593647+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:07:26.593647+0000","last_undegraded":"2024-05-08T18:07:26.593647+0000","last_fullsized":"2024-05-08T18:07:26.593647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.601037+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:07:26.601037+0000","last_peered":"2024-05-08T18:07:26.601037+0000","last_clean":"2024-05-08T18:07:26.601037+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:07:26.601037+0000","last_undegraded":"2024-05-08T18:07:26.601037+0000","last_fullsized":"2024-05-08T18:07:26.601037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567012+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:07:26.567012+0000","last_peered":"2024-05-08T18:07:26.567012+0000","last_clean":"2024-05-08T18:07:26.567012+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:07:26.567012+0000","last_undegraded":"2024-05-08T18:07:26.567012+0000","last_fullsized":"2024-05-08T18:07:26.567012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.591072+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:07:26.591072+0000","last_peered":"2024-05-08T18:07:26.591072+0000","last_clean":"2024-05-08T18:07:26.591072+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:07:26.591072+0000","last_undegraded":"2024-05-08T18:07:26.591072+0000","last_fullsized":"2024-05-08T18:07:26.591072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.570307+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:07:26.570307+0000","last_peered":"2024-05-08T18:07:26.570307+0000","last_clean":"2024-05-08T18:07:26.570307+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:07:26.570307+0000","last_undegraded":"2024-05-08T18:07:26.570307+0000","last_fullsized":"2024-05-08T18:07:26.570307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.436921+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:07:27.436921+0000","last_peered":"2024-05-08T18:07:27.436921+0000","last_clean":"2024-05-08T18:07:27.436921+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:07:27.436921+0000","last_undegraded":"2024-05-08T18:07:27.436921+0000","last_fullsized":"2024-05-08T18:07:27.436921+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571650+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:07:26.571650+0000","last_peered":"2024-05-08T18:07:26.571650+0000","last_clean":"2024-05-08T18:07:26.571650+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:07:26.571650+0000","last_undegraded":"2024-05-08T18:07:26.571650+0000","last_fullsized":"2024-05-08T18:07:26.571650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604368+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:07:26.604368+0000","last_peered":"2024-05-08T18:07:26.604368+0000","last_clean":"2024-05-08T18:07:26.604368+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:07:26.604368+0000","last_undegraded":"2024-05-08T18:07:26.604368+0000","last_fullsized":"2024-05-08T18:07:26.604368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604481+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:07:26.604481+0000","last_peered":"2024-05-08T18:07:26.604481+0000","last_clean":"2024-05-08T18:07:26.604481+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:07:26.604481+0000","last_undegraded":"2024-05-08T18:07:26.604481+0000","last_fullsized":"2024-05-08T18:07:26.604481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590999+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:07:26.590999+0000","last_peered":"2024-05-08T18:07:26.590999+0000","last_clean":"2024-05-08T18:07:26.590999+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:07:26.590999+0000","last_undegraded":"2024-05-08T18:07:26.590999+0000","last_fullsized":"2024-05-08T18:07:26.590999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571984+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:07:26.571984+0000","last_peered":"2024-05-08T18:07:26.571984+0000","last_clean":"2024-05-08T18:07:26.571984+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:07:26.571984+0000","last_undegraded":"2024-05-08T18:07:26.571984+0000","last_fullsized":"2024-05-08T18:07:26.571984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.349572+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:07:27.349572+0000","last_peered":"2024-05-08T18:07:27.349572+0000","last_clean":"2024-05-08T18:07:27.349572+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:07:27.349572+0000","last_undegraded":"2024-05-08T18:07:27.349572+0000","last_fullsized":"2024-05-08T18:07:27.349572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.710425+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:07:26.710425+0000","last_peered":"2024-05-08T18:07:26.710425+0000","last_clean":"2024-05-08T18:07:26.710425+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:07:26.710425+0000","last_undegraded":"2024-05-08T18:07:26.710425+0000","last_fullsized":"2024-05-08T18:07:26.710425+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610809+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:07:26.610809+0000","last_peered":"2024-05-08T18:07:26.610809+0000","last_clean":"2024-05-08T18:07:26.610809+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:07:26.610809+0000","last_undegraded":"2024-05-08T18:07:26.610809+0000","last_fullsized":"2024-05-08T18:07:26.610809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610465+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:07:26.610465+0000","last_peered":"2024-05-08T18:07:26.610465+0000","last_clean":"2024-05-08T18:07:26.610465+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:07:26.610465+0000","last_undegraded":"2024-05-08T18:07:26.610465+0000","last_fullsized":"2024-05-08T18:07:26.610465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.601413+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:07:26.601413+0000","last_peered":"2024-05-08T18:07:26.601413+0000","last_clean":"2024-05-08T18:07:26.601413+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:07:26.601413+0000","last_undegraded":"2024-05-08T18:07:26.601413+0000","last_fullsized":"2024-05-08T18:07:26.601413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.570889+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:07:26.570889+0000","last_peered":"2024-05-08T18:07:26.570889+0000","last_clean":"2024-05-08T18:07:26.570889+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:07:26.570889+0000","last_undegraded":"2024-05-08T18:07:26.570889+0000","last_fullsized":"2024-05-08T18:07:26.570889+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.965738+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:07:26.965738+0000","last_peered":"2024-05-08T18:07:26.965738+0000","last_clean":"2024-05-08T18:07:26.965738+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:07:26.965738+0000","last_undegraded":"2024-05-08T18:07:26.965738+0000","last_fullsized":"2024-05-08T18:07:26.965738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.570228+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:07:26.570228+0000","last_peered":"2024-05-08T18:07:26.570228+0000","last_clean":"2024-05-08T18:07:26.570228+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:07:26.570228+0000","last_undegraded":"2024-05-08T18:07:26.570228+0000","last_fullsized":"2024-05-08T18:07:26.570228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594310+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:07:26.594310+0000","last_peered":"2024-05-08T18:07:26.594310+0000","last_clean":"2024-05-08T18:07:26.594310+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:07:26.594310+0000","last_undegraded":"2024-05-08T18:07:26.594310+0000","last_fullsized":"2024-05-08T18:07:26.594310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568783+0000","last_change":"2024-05-08T18:07:17.495459+0000","last_active":"2024-05-08T18:07:26.568783+0000","last_peered":"2024-05-08T18:07:26.568783+0000","last_clean":"2024-05-08T18:07:26.568783+0000","last_became_active":"2024-05-08T18:07:17.494659+0000","last_became_peered":"2024-05-08T18:07:17.494659+0000","last_unstale":"2024-05-08T18:07:26.568783+0000","last_undegraded":"2024-05-08T18:07:26.568783+0000","last_fullsized":"2024-05-08T18:07:26.568783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573594+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:07:26.573594+0000","last_peered":"2024-05-08T18:07:26.573594+0000","last_clean":"2024-05-08T18:07:26.573594+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:07:26.573594+0000","last_undegraded":"2024-05-08T18:07:26.573594+0000","last_fullsized":"2024-05-08T18:07:26.573594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571180+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:07:26.571180+0000","last_peered":"2024-05-08T18:07:26.571180+0000","last_clean":"2024-05-08T18:07:26.571180+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:07:26.571180+0000","last_undegraded":"2024-05-08T18:07:26.571180+0000","last_fullsized":"2024-05-08T18:07:26.571180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.499079+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:07:27.499079+0000","last_peered":"2024-05-08T18:07:27.499079+0000","last_clean":"2024-05-08T18:07:27.499079+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:07:27.499079+0000","last_undegraded":"2024-05-08T18:07:27.499079+0000","last_fullsized":"2024-05-08T18:07:27.499079+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610856+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:07:26.610856+0000","last_peered":"2024-05-08T18:07:26.610856+0000","last_clean":"2024-05-08T18:07:26.610856+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:07:26.610856+0000","last_undegraded":"2024-05-08T18:07:26.610856+0000","last_fullsized":"2024-05-08T18:07:26.610856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571482+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:07:26.571482+0000","last_peered":"2024-05-08T18:07:26.571482+0000","last_clean":"2024-05-08T18:07:26.571482+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:07:26.571482+0000","last_undegraded":"2024-05-08T18:07:26.571482+0000","last_fullsized":"2024-05-08T18:07:26.571482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568898+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:07:26.568898+0000","last_peered":"2024-05-08T18:07:26.568898+0000","last_clean":"2024-05-08T18:07:26.568898+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:07:26.568898+0000","last_undegraded":"2024-05-08T18:07:26.568898+0000","last_fullsized":"2024-05-08T18:07:26.568898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604772+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:07:26.604772+0000","last_peered":"2024-05-08T18:07:26.604772+0000","last_clean":"2024-05-08T18:07:26.604772+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:07:26.604772+0000","last_undegraded":"2024-05-08T18:07:26.604772+0000","last_fullsized":"2024-05-08T18:07:26.604772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593386+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:07:26.593386+0000","last_peered":"2024-05-08T18:07:26.593386+0000","last_clean":"2024-05-08T18:07:26.593386+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:07:26.593386+0000","last_undegraded":"2024-05-08T18:07:26.593386+0000","last_fullsized":"2024-05-08T18:07:26.593386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.568716+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:07:27.568716+0000","last_peered":"2024-05-08T18:07:27.568716+0000","last_clean":"2024-05-08T18:07:27.568716+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:07:27.568716+0000","last_undegraded":"2024-05-08T18:07:27.568716+0000","last_fullsized":"2024-05-08T18:07:27.568716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.707146+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:07:26.707146+0000","last_peered":"2024-05-08T18:07:26.707146+0000","last_clean":"2024-05-08T18:07:26.707146+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:07:26.707146+0000","last_undegraded":"2024-05-08T18:07:26.707146+0000","last_fullsized":"2024-05-08T18:07:26.707146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593153+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:07:26.593153+0000","last_peered":"2024-05-08T18:07:26.593153+0000","last_clean":"2024-05-08T18:07:26.593153+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:07:26.593153+0000","last_undegraded":"2024-05-08T18:07:26.593153+0000","last_fullsized":"2024-05-08T18:07:26.593153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.569475+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:07:26.569475+0000","last_peered":"2024-05-08T18:07:26.569475+0000","last_clean":"2024-05-08T18:07:26.569475+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:07:26.569475+0000","last_undegraded":"2024-05-08T18:07:26.569475+0000","last_fullsized":"2024-05-08T18:07:26.569475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567619+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:07:26.567619+0000","last_peered":"2024-05-08T18:07:26.567619+0000","last_clean":"2024-05-08T18:07:26.567619+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:07:26.567619+0000","last_undegraded":"2024-05-08T18:07:26.567619+0000","last_fullsized":"2024-05-08T18:07:26.567619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599176+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:07:26.599176+0000","last_peered":"2024-05-08T18:07:26.599176+0000","last_clean":"2024-05-08T18:07:26.599176+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:07:26.599176+0000","last_undegraded":"2024-05-08T18:07:26.599176+0000","last_fullsized":"2024-05-08T18:07:26.599176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.357601+0000","last_change":"2024-05-08T18:07:21.533056+0000","last_active":"2024-05-08T18:07:27.357601+0000","last_peered":"2024-05-08T18:07:27.357601+0000","last_clean":"2024-05-08T18:07:27.357601+0000","last_became_active":"2024-05-08T18:07:21.532184+0000","last_became_peered":"2024-05-08T18:07:21.532184+0000","last_unstale":"2024-05-08T18:07:27.357601+0000","last_undegraded":"2024-05-08T18:07:27.357601+0000","last_fullsized":"2024-05-08T18:07:27.357601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:50.629014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.702900+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:07:26.702900+0000","last_peered":"2024-05-08T18:07:26.702900+0000","last_clean":"2024-05-08T18:07:26.702900+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:07:26.702900+0000","last_undegraded":"2024-05-08T18:07:26.702900+0000","last_fullsized":"2024-05-08T18:07:26.702900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567441+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:07:26.567441+0000","last_peered":"2024-05-08T18:07:26.567441+0000","last_clean":"2024-05-08T18:07:26.567441+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:07:26.567441+0000","last_undegraded":"2024-05-08T18:07:26.567441+0000","last_fullsized":"2024-05-08T18:07:26.567441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594495+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:07:26.594495+0000","last_peered":"2024-05-08T18:07:26.594495+0000","last_clean":"2024-05-08T18:07:26.594495+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:07:26.594495+0000","last_undegraded":"2024-05-08T18:07:26.594495+0000","last_fullsized":"2024-05-08T18:07:26.594495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.575981+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:07:26.575981+0000","last_peered":"2024-05-08T18:07:26.575981+0000","last_clean":"2024-05-08T18:07:26.575981+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:07:26.575981+0000","last_undegraded":"2024-05-08T18:07:26.575981+0000","last_fullsized":"2024-05-08T18:07:26.575981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.569214+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:07:26.569214+0000","last_peered":"2024-05-08T18:07:26.569214+0000","last_clean":"2024-05-08T18:07:26.569214+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:07:26.569214+0000","last_undegraded":"2024-05-08T18:07:26.569214+0000","last_fullsized":"2024-05-08T18:07:26.569214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.491719+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:07:27.491719+0000","last_peered":"2024-05-08T18:07:27.491719+0000","last_clean":"2024-05-08T18:07:27.491719+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:07:27.491719+0000","last_undegraded":"2024-05-08T18:07:27.491719+0000","last_fullsized":"2024-05-08T18:07:27.491719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604827+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:07:26.604827+0000","last_peered":"2024-05-08T18:07:26.604827+0000","last_clean":"2024-05-08T18:07:26.604827+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:07:26.604827+0000","last_undegraded":"2024-05-08T18:07:26.604827+0000","last_fullsized":"2024-05-08T18:07:26.604827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593259+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:07:26.593259+0000","last_peered":"2024-05-08T18:07:26.593259+0000","last_clean":"2024-05-08T18:07:26.593259+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:07:26.593259+0000","last_undegraded":"2024-05-08T18:07:26.593259+0000","last_fullsized":"2024-05-08T18:07:26.593259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604865+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:07:26.604865+0000","last_peered":"2024-05-08T18:07:26.604865+0000","last_clean":"2024-05-08T18:07:26.604865+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:07:26.604865+0000","last_undegraded":"2024-05-08T18:07:26.604865+0000","last_fullsized":"2024-05-08T18:07:26.604865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589228+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:07:26.589228+0000","last_peered":"2024-05-08T18:07:26.589228+0000","last_clean":"2024-05-08T18:07:26.589228+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:07:26.589228+0000","last_undegraded":"2024-05-08T18:07:26.589228+0000","last_fullsized":"2024-05-08T18:07:26.589228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600608+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:07:26.600608+0000","last_peered":"2024-05-08T18:07:26.600608+0000","last_clean":"2024-05-08T18:07:26.600608+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:07:26.600608+0000","last_undegraded":"2024-05-08T18:07:26.600608+0000","last_fullsized":"2024-05-08T18:07:26.600608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573343+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:07:26.573343+0000","last_peered":"2024-05-08T18:07:26.573343+0000","last_clean":"2024-05-08T18:07:26.573343+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:07:26.573343+0000","last_undegraded":"2024-05-08T18:07:26.573343+0000","last_fullsized":"2024-05-08T18:07:26.573343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589833+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:07:26.589833+0000","last_peered":"2024-05-08T18:07:26.589833+0000","last_clean":"2024-05-08T18:07:26.589833+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:07:26.589833+0000","last_undegraded":"2024-05-08T18:07:26.589833+0000","last_fullsized":"2024-05-08T18:07:26.589833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.288497+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:07:27.288497+0000","last_peered":"2024-05-08T18:07:27.288497+0000","last_clean":"2024-05-08T18:07:27.288497+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:07:27.288497+0000","last_undegraded":"2024-05-08T18:07:27.288497+0000","last_fullsized":"2024-05-08T18:07:27.288497+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610862+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:07:26.610862+0000","last_peered":"2024-05-08T18:07:26.610862+0000","last_clean":"2024-05-08T18:07:26.610862+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:07:26.610862+0000","last_undegraded":"2024-05-08T18:07:26.610862+0000","last_fullsized":"2024-05-08T18:07:26.610862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.603538+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:07:26.603538+0000","last_peered":"2024-05-08T18:07:26.603538+0000","last_clean":"2024-05-08T18:07:26.603538+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:07:26.603538+0000","last_undegraded":"2024-05-08T18:07:26.603538+0000","last_fullsized":"2024-05-08T18:07:26.603538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.611242+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:07:26.611242+0000","last_peered":"2024-05-08T18:07:26.611242+0000","last_clean":"2024-05-08T18:07:26.611242+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:07:26.611242+0000","last_undegraded":"2024-05-08T18:07:26.611242+0000","last_fullsized":"2024-05-08T18:07:26.611242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.588936+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:07:26.588936+0000","last_peered":"2024-05-08T18:07:26.588936+0000","last_clean":"2024-05-08T18:07:26.588936+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:07:26.588936+0000","last_undegraded":"2024-05-08T18:07:26.588936+0000","last_fullsized":"2024-05-08T18:07:26.588936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.608986+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:07:26.608986+0000","last_peered":"2024-05-08T18:07:26.608986+0000","last_clean":"2024-05-08T18:07:26.608986+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:07:26.608986+0000","last_undegraded":"2024-05-08T18:07:26.608986+0000","last_fullsized":"2024-05-08T18:07:26.608986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.601328+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:07:26.601328+0000","last_peered":"2024-05-08T18:07:26.601328+0000","last_clean":"2024-05-08T18:07:26.601328+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:07:26.601328+0000","last_undegraded":"2024-05-08T18:07:26.601328+0000","last_fullsized":"2024-05-08T18:07:26.601328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.481519+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:07:27.481519+0000","last_peered":"2024-05-08T18:07:27.481519+0000","last_clean":"2024-05-08T18:07:27.481519+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:07:27.481519+0000","last_undegraded":"2024-05-08T18:07:27.481519+0000","last_fullsized":"2024-05-08T18:07:27.481519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590296+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:07:26.590296+0000","last_peered":"2024-05-08T18:07:26.590296+0000","last_clean":"2024-05-08T18:07:26.590296+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:07:26.590296+0000","last_undegraded":"2024-05-08T18:07:26.590296+0000","last_fullsized":"2024-05-08T18:07:26.590296+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593460+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:07:26.593460+0000","last_peered":"2024-05-08T18:07:26.593460+0000","last_clean":"2024-05-08T18:07:26.593460+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:07:26.593460+0000","last_undegraded":"2024-05-08T18:07:26.593460+0000","last_fullsized":"2024-05-08T18:07:26.593460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594609+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:07:26.594609+0000","last_peered":"2024-05-08T18:07:26.594609+0000","last_clean":"2024-05-08T18:07:26.594609+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:07:26.594609+0000","last_undegraded":"2024-05-08T18:07:26.594609+0000","last_fullsized":"2024-05-08T18:07:26.594609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.570685+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:07:26.570685+0000","last_peered":"2024-05-08T18:07:26.570685+0000","last_clean":"2024-05-08T18:07:26.570685+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:07:26.570685+0000","last_undegraded":"2024-05-08T18:07:26.570685+0000","last_fullsized":"2024-05-08T18:07:26.570685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.592782+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:07:26.592782+0000","last_peered":"2024-05-08T18:07:26.592782+0000","last_clean":"2024-05-08T18:07:26.592782+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:07:26.592782+0000","last_undegraded":"2024-05-08T18:07:26.592782+0000","last_fullsized":"2024-05-08T18:07:26.592782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.572892+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:07:26.572892+0000","last_peered":"2024-05-08T18:07:26.572892+0000","last_clean":"2024-05-08T18:07:26.572892+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:07:26.572892+0000","last_undegraded":"2024-05-08T18:07:26.572892+0000","last_fullsized":"2024-05-08T18:07:26.572892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.487596+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:07:27.487596+0000","last_peered":"2024-05-08T18:07:27.487596+0000","last_clean":"2024-05-08T18:07:27.487596+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:07:27.487596+0000","last_undegraded":"2024-05-08T18:07:27.487596+0000","last_fullsized":"2024-05-08T18:07:27.487596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609622+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:07:26.609622+0000","last_peered":"2024-05-08T18:07:26.609622+0000","last_clean":"2024-05-08T18:07:26.609622+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:07:26.609622+0000","last_undegraded":"2024-05-08T18:07:26.609622+0000","last_fullsized":"2024-05-08T18:07:26.609622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.574350+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:07:26.574350+0000","last_peered":"2024-05-08T18:07:26.574350+0000","last_clean":"2024-05-08T18:07:26.574350+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:07:26.574350+0000","last_undegraded":"2024-05-08T18:07:26.574350+0000","last_fullsized":"2024-05-08T18:07:26.574350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593866+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:07:26.593866+0000","last_peered":"2024-05-08T18:07:26.593866+0000","last_clean":"2024-05-08T18:07:26.593866+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:07:26.593866+0000","last_undegraded":"2024-05-08T18:07:26.593866+0000","last_fullsized":"2024-05-08T18:07:26.593866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600568+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:07:26.600568+0000","last_peered":"2024-05-08T18:07:26.600568+0000","last_clean":"2024-05-08T18:07:26.600568+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:07:26.600568+0000","last_undegraded":"2024-05-08T18:07:26.600568+0000","last_fullsized":"2024-05-08T18:07:26.600568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568082+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:07:26.568082+0000","last_peered":"2024-05-08T18:07:26.568082+0000","last_clean":"2024-05-08T18:07:26.568082+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:07:26.568082+0000","last_undegraded":"2024-05-08T18:07:26.568082+0000","last_fullsized":"2024-05-08T18:07:26.568082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609855+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:07:26.609855+0000","last_peered":"2024-05-08T18:07:26.609855+0000","last_clean":"2024-05-08T18:07:26.609855+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:07:26.609855+0000","last_undegraded":"2024-05-08T18:07:26.609855+0000","last_fullsized":"2024-05-08T18:07:26.609855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.323471+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:07:27.323471+0000","last_peered":"2024-05-08T18:07:27.323471+0000","last_clean":"2024-05-08T18:07:27.323471+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:07:27.323471+0000","last_undegraded":"2024-05-08T18:07:27.323471+0000","last_fullsized":"2024-05-08T18:07:27.323471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.605264+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:07:26.605264+0000","last_peered":"2024-05-08T18:07:26.605264+0000","last_clean":"2024-05-08T18:07:26.605264+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:07:26.605264+0000","last_undegraded":"2024-05-08T18:07:26.605264+0000","last_fullsized":"2024-05-08T18:07:26.605264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.598201+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:07:26.598201+0000","last_peered":"2024-05-08T18:07:26.598201+0000","last_clean":"2024-05-08T18:07:26.598201+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:07:26.598201+0000","last_undegraded":"2024-05-08T18:07:26.598201+0000","last_fullsized":"2024-05-08T18:07:26.598201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593399+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:07:26.593399+0000","last_peered":"2024-05-08T18:07:26.593399+0000","last_clean":"2024-05-08T18:07:26.593399+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:07:26.593399+0000","last_undegraded":"2024-05-08T18:07:26.593399+0000","last_fullsized":"2024-05-08T18:07:26.593399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600589+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:07:26.600589+0000","last_peered":"2024-05-08T18:07:26.600589+0000","last_clean":"2024-05-08T18:07:26.600589+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:07:26.600589+0000","last_undegraded":"2024-05-08T18:07:26.600589+0000","last_fullsized":"2024-05-08T18:07:26.600589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594321+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:07:26.594321+0000","last_peered":"2024-05-08T18:07:26.594321+0000","last_clean":"2024-05-08T18:07:26.594321+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:07:26.594321+0000","last_undegraded":"2024-05-08T18:07:26.594321+0000","last_fullsized":"2024-05-08T18:07:26.594321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609679+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:07:26.609679+0000","last_peered":"2024-05-08T18:07:26.609679+0000","last_clean":"2024-05-08T18:07:26.609679+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:07:26.609679+0000","last_undegraded":"2024-05-08T18:07:26.609679+0000","last_fullsized":"2024-05-08T18:07:26.609679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.416092+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:07:27.416092+0000","last_peered":"2024-05-08T18:07:27.416092+0000","last_clean":"2024-05-08T18:07:27.416092+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:07:27.416092+0000","last_undegraded":"2024-05-08T18:07:27.416092+0000","last_fullsized":"2024-05-08T18:07:27.416092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.566533+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:07:26.566533+0000","last_peered":"2024-05-08T18:07:26.566533+0000","last_clean":"2024-05-08T18:07:26.566533+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:07:26.566533+0000","last_undegraded":"2024-05-08T18:07:26.566533+0000","last_fullsized":"2024-05-08T18:07:26.566533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610300+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:07:26.610300+0000","last_peered":"2024-05-08T18:07:26.610300+0000","last_clean":"2024-05-08T18:07:26.610300+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:07:26.610300+0000","last_undegraded":"2024-05-08T18:07:26.610300+0000","last_fullsized":"2024-05-08T18:07:26.610300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610476+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:07:26.610476+0000","last_peered":"2024-05-08T18:07:26.610476+0000","last_clean":"2024-05-08T18:07:26.610476+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:07:26.610476+0000","last_undegraded":"2024-05-08T18:07:26.610476+0000","last_fullsized":"2024-05-08T18:07:26.610476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593998+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:07:26.593998+0000","last_peered":"2024-05-08T18:07:26.593998+0000","last_clean":"2024-05-08T18:07:26.593998+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:07:26.593998+0000","last_undegraded":"2024-05-08T18:07:26.593998+0000","last_fullsized":"2024-05-08T18:07:26.593998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.591263+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:07:26.591263+0000","last_peered":"2024-05-08T18:07:26.591263+0000","last_clean":"2024-05-08T18:07:26.591263+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:07:26.591263+0000","last_undegraded":"2024-05-08T18:07:26.591263+0000","last_fullsized":"2024-05-08T18:07:26.591263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604172+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:07:26.604172+0000","last_peered":"2024-05-08T18:07:26.604172+0000","last_clean":"2024-05-08T18:07:26.604172+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:07:26.604172+0000","last_undegraded":"2024-05-08T18:07:26.604172+0000","last_fullsized":"2024-05-08T18:07:26.604172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.514294+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:07:27.514294+0000","last_peered":"2024-05-08T18:07:27.514294+0000","last_clean":"2024-05-08T18:07:27.514294+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:07:27.514294+0000","last_undegraded":"2024-05-08T18:07:27.514294+0000","last_fullsized":"2024-05-08T18:07:27.514294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.706966+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:07:26.706966+0000","last_peered":"2024-05-08T18:07:26.706966+0000","last_clean":"2024-05-08T18:07:26.706966+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:07:26.706966+0000","last_undegraded":"2024-05-08T18:07:26.706966+0000","last_fullsized":"2024-05-08T18:07:26.706966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.577761+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:07:26.577761+0000","last_peered":"2024-05-08T18:07:26.577761+0000","last_clean":"2024-05-08T18:07:26.577761+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:07:26.577761+0000","last_undegraded":"2024-05-08T18:07:26.577761+0000","last_fullsized":"2024-05-08T18:07:26.577761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.574931+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:07:26.574931+0000","last_peered":"2024-05-08T18:07:26.574931+0000","last_clean":"2024-05-08T18:07:26.574931+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:07:26.574931+0000","last_undegraded":"2024-05-08T18:07:26.574931+0000","last_fullsized":"2024-05-08T18:07:26.574931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.576983+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:07:26.576983+0000","last_peered":"2024-05-08T18:07:26.576983+0000","last_clean":"2024-05-08T18:07:26.576983+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:07:26.576983+0000","last_undegraded":"2024-05-08T18:07:26.576983+0000","last_fullsized":"2024-05-08T18:07:26.576983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594715+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:07:26.594715+0000","last_peered":"2024-05-08T18:07:26.594715+0000","last_clean":"2024-05-08T18:07:26.594715+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:07:26.594715+0000","last_undegraded":"2024-05-08T18:07:26.594715+0000","last_fullsized":"2024-05-08T18:07:26.594715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.566681+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:07:26.566681+0000","last_peered":"2024-05-08T18:07:26.566681+0000","last_clean":"2024-05-08T18:07:26.566681+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:07:26.566681+0000","last_undegraded":"2024-05-08T18:07:26.566681+0000","last_fullsized":"2024-05-08T18:07:26.566681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.470977+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:07:27.470977+0000","last_peered":"2024-05-08T18:07:27.470977+0000","last_clean":"2024-05-08T18:07:27.470977+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:07:27.470977+0000","last_undegraded":"2024-05-08T18:07:27.470977+0000","last_fullsized":"2024-05-08T18:07:27.470977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.704019+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:07:26.704019+0000","last_peered":"2024-05-08T18:07:26.704019+0000","last_clean":"2024-05-08T18:07:26.704019+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:07:26.704019+0000","last_undegraded":"2024-05-08T18:07:26.704019+0000","last_fullsized":"2024-05-08T18:07:26.704019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609694+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:07:26.609694+0000","last_peered":"2024-05-08T18:07:26.609694+0000","last_clean":"2024-05-08T18:07:26.609694+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:07:26.609694+0000","last_undegraded":"2024-05-08T18:07:26.609694+0000","last_fullsized":"2024-05-08T18:07:26.609694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567088+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:07:26.567088+0000","last_peered":"2024-05-08T18:07:26.567088+0000","last_clean":"2024-05-08T18:07:26.567088+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:07:26.567088+0000","last_undegraded":"2024-05-08T18:07:26.567088+0000","last_fullsized":"2024-05-08T18:07:26.567088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.611552+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:07:26.611552+0000","last_peered":"2024-05-08T18:07:26.611552+0000","last_clean":"2024-05-08T18:07:26.611552+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:07:26.611552+0000","last_undegraded":"2024-05-08T18:07:26.611552+0000","last_fullsized":"2024-05-08T18:07:26.611552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.605625+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:07:26.605625+0000","last_peered":"2024-05-08T18:07:26.605625+0000","last_clean":"2024-05-08T18:07:26.605625+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:07:26.605625+0000","last_undegraded":"2024-05-08T18:07:26.605625+0000","last_fullsized":"2024-05-08T18:07:26.605625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.572012+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:07:26.572012+0000","last_peered":"2024-05-08T18:07:26.572012+0000","last_clean":"2024-05-08T18:07:26.572012+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:07:26.572012+0000","last_undegraded":"2024-05-08T18:07:26.572012+0000","last_fullsized":"2024-05-08T18:07:26.572012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.449853+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:07:27.449853+0000","last_peered":"2024-05-08T18:07:27.449853+0000","last_clean":"2024-05-08T18:07:27.449853+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:07:27.449853+0000","last_undegraded":"2024-05-08T18:07:27.449853+0000","last_fullsized":"2024-05-08T18:07:27.449853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571901+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:07:26.571901+0000","last_peered":"2024-05-08T18:07:26.571901+0000","last_clean":"2024-05-08T18:07:26.571901+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:07:26.571901+0000","last_undegraded":"2024-05-08T18:07:26.571901+0000","last_fullsized":"2024-05-08T18:07:26.571901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599364+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:07:26.599364+0000","last_peered":"2024-05-08T18:07:26.599364+0000","last_clean":"2024-05-08T18:07:26.599364+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:07:26.599364+0000","last_undegraded":"2024-05-08T18:07:26.599364+0000","last_fullsized":"2024-05-08T18:07:26.599364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.611025+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:07:26.611025+0000","last_peered":"2024-05-08T18:07:26.611025+0000","last_clean":"2024-05-08T18:07:26.611025+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:07:26.611025+0000","last_undegraded":"2024-05-08T18:07:26.611025+0000","last_fullsized":"2024-05-08T18:07:26.611025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567680+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:07:26.567680+0000","last_peered":"2024-05-08T18:07:26.567680+0000","last_clean":"2024-05-08T18:07:26.567680+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:07:26.567680+0000","last_undegraded":"2024-05-08T18:07:26.567680+0000","last_fullsized":"2024-05-08T18:07:26.567680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567367+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:07:26.567367+0000","last_peered":"2024-05-08T18:07:26.567367+0000","last_clean":"2024-05-08T18:07:26.567367+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:07:26.567367+0000","last_undegraded":"2024-05-08T18:07:26.567367+0000","last_fullsized":"2024-05-08T18:07:26.567367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593605+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:07:26.593605+0000","last_peered":"2024-05-08T18:07:26.593605+0000","last_clean":"2024-05-08T18:07:26.593605+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:07:26.593605+0000","last_undegraded":"2024-05-08T18:07:26.593605+0000","last_fullsized":"2024-05-08T18:07:26.593605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.520379+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:07:27.520379+0000","last_peered":"2024-05-08T18:07:27.520379+0000","last_clean":"2024-05-08T18:07:27.520379+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:07:27.520379+0000","last_undegraded":"2024-05-08T18:07:27.520379+0000","last_fullsized":"2024-05-08T18:07:27.520379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571741+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:07:26.571741+0000","last_peered":"2024-05-08T18:07:26.571741+0000","last_clean":"2024-05-08T18:07:26.571741+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:07:26.571741+0000","last_undegraded":"2024-05-08T18:07:26.571741+0000","last_fullsized":"2024-05-08T18:07:26.571741+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573842+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:07:26.573842+0000","last_peered":"2024-05-08T18:07:26.573842+0000","last_clean":"2024-05-08T18:07:26.573842+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:07:26.573842+0000","last_undegraded":"2024-05-08T18:07:26.573842+0000","last_fullsized":"2024-05-08T18:07:26.573842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593135+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:07:26.593135+0000","last_peered":"2024-05-08T18:07:26.593135+0000","last_clean":"2024-05-08T18:07:26.593135+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:07:26.593135+0000","last_undegraded":"2024-05-08T18:07:26.593135+0000","last_fullsized":"2024-05-08T18:07:26.593135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590978+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:07:26.590978+0000","last_peered":"2024-05-08T18:07:26.590978+0000","last_clean":"2024-05-08T18:07:26.590978+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:07:26.590978+0000","last_undegraded":"2024-05-08T18:07:26.590978+0000","last_fullsized":"2024-05-08T18:07:26.590978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573979+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:07:26.573979+0000","last_peered":"2024-05-08T18:07:26.573979+0000","last_clean":"2024-05-08T18:07:26.573979+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:07:26.573979+0000","last_undegraded":"2024-05-08T18:07:26.573979+0000","last_fullsized":"2024-05-08T18:07:26.573979+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.972014+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:07:26.972014+0000","last_peered":"2024-05-08T18:07:26.972014+0000","last_clean":"2024-05-08T18:07:26.972014+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:07:26.972014+0000","last_undegraded":"2024-05-08T18:07:26.972014+0000","last_fullsized":"2024-05-08T18:07:26.972014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589191+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:07:26.589191+0000","last_peered":"2024-05-08T18:07:26.589191+0000","last_clean":"2024-05-08T18:07:26.589191+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:07:26.589191+0000","last_undegraded":"2024-05-08T18:07:26.589191+0000","last_fullsized":"2024-05-08T18:07:26.589191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609671+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:07:26.609671+0000","last_peered":"2024-05-08T18:07:26.609671+0000","last_clean":"2024-05-08T18:07:26.609671+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:07:26.609671+0000","last_undegraded":"2024-05-08T18:07:26.609671+0000","last_fullsized":"2024-05-08T18:07:26.609671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.572384+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:07:26.572384+0000","last_peered":"2024-05-08T18:07:26.572384+0000","last_clean":"2024-05-08T18:07:26.572384+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:07:26.572384+0000","last_undegraded":"2024-05-08T18:07:26.572384+0000","last_fullsized":"2024-05-08T18:07:26.572384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600303+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:07:26.600303+0000","last_peered":"2024-05-08T18:07:26.600303+0000","last_clean":"2024-05-08T18:07:26.600303+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:07:26.600303+0000","last_undegraded":"2024-05-08T18:07:26.600303+0000","last_fullsized":"2024-05-08T18:07:26.600303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.588306+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:07:26.588306+0000","last_peered":"2024-05-08T18:07:26.588306+0000","last_clean":"2024-05-08T18:07:26.588306+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:07:26.588306+0000","last_undegraded":"2024-05-08T18:07:26.588306+0000","last_fullsized":"2024-05-08T18:07:26.588306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.429263+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:07:27.429263+0000","last_peered":"2024-05-08T18:07:27.429263+0000","last_clean":"2024-05-08T18:07:27.429263+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:07:27.429263+0000","last_undegraded":"2024-05-08T18:07:27.429263+0000","last_fullsized":"2024-05-08T18:07:27.429263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604162+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:07:26.604162+0000","last_peered":"2024-05-08T18:07:26.604162+0000","last_clean":"2024-05-08T18:07:26.604162+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:07:26.604162+0000","last_undegraded":"2024-05-08T18:07:26.604162+0000","last_fullsized":"2024-05-08T18:07:26.604162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600705+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:07:26.600705+0000","last_peered":"2024-05-08T18:07:26.600705+0000","last_clean":"2024-05-08T18:07:26.600705+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:07:26.600705+0000","last_undegraded":"2024-05-08T18:07:26.600705+0000","last_fullsized":"2024-05-08T18:07:26.600705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.575310+0000","last_change":"2024-05-08T18:07:17.504030+0000","last_active":"2024-05-08T18:07:26.575310+0000","last_peered":"2024-05-08T18:07:26.575310+0000","last_clean":"2024-05-08T18:07:26.575310+0000","last_became_active":"2024-05-08T18:07:17.497558+0000","last_became_peered":"2024-05-08T18:07:17.497558+0000","last_unstale":"2024-05-08T18:07:26.575310+0000","last_undegraded":"2024-05-08T18:07:26.575310+0000","last_fullsized":"2024-05-08T18:07:26.575310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.611297+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:07:26.611297+0000","last_peered":"2024-05-08T18:07:26.611297+0000","last_clean":"2024-05-08T18:07:26.611297+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:07:26.611297+0000","last_undegraded":"2024-05-08T18:07:26.611297+0000","last_fullsized":"2024-05-08T18:07:26.611297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604116+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:07:26.604116+0000","last_peered":"2024-05-08T18:07:26.604116+0000","last_clean":"2024-05-08T18:07:26.604116+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:07:26.604116+0000","last_undegraded":"2024-05-08T18:07:26.604116+0000","last_fullsized":"2024-05-08T18:07:26.604116+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.207928+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:07:27.207928+0000","last_peered":"2024-05-08T18:07:27.207928+0000","last_clean":"2024-05-08T18:07:27.207928+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:07:27.207928+0000","last_undegraded":"2024-05-08T18:07:27.207928+0000","last_fullsized":"2024-05-08T18:07:27.207928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609101+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:07:26.609101+0000","last_peered":"2024-05-08T18:07:26.609101+0000","last_clean":"2024-05-08T18:07:26.609101+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:07:26.609101+0000","last_undegraded":"2024-05-08T18:07:26.609101+0000","last_fullsized":"2024-05-08T18:07:26.609101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.605402+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:07:26.605402+0000","last_peered":"2024-05-08T18:07:26.605402+0000","last_clean":"2024-05-08T18:07:26.605402+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:07:26.605402+0000","last_undegraded":"2024-05-08T18:07:26.605402+0000","last_fullsized":"2024-05-08T18:07:26.605402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.575769+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:07:26.575769+0000","last_peered":"2024-05-08T18:07:26.575769+0000","last_clean":"2024-05-08T18:07:26.575769+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:07:26.575769+0000","last_undegraded":"2024-05-08T18:07:26.575769+0000","last_fullsized":"2024-05-08T18:07:26.575769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610963+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:07:26.610963+0000","last_peered":"2024-05-08T18:07:26.610963+0000","last_clean":"2024-05-08T18:07:26.610963+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:07:26.610963+0000","last_undegraded":"2024-05-08T18:07:26.610963+0000","last_fullsized":"2024-05-08T18:07:26.610963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.548869+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:07:27.548869+0000","last_peered":"2024-05-08T18:07:27.548869+0000","last_clean":"2024-05-08T18:07:27.548869+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:07:27.548869+0000","last_undegraded":"2024-05-08T18:07:27.548869+0000","last_fullsized":"2024-05-08T18:07:27.548869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600995+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:07:26.600995+0000","last_peered":"2024-05-08T18:07:26.600995+0000","last_clean":"2024-05-08T18:07:26.600995+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:07:26.600995+0000","last_undegraded":"2024-05-08T18:07:26.600995+0000","last_fullsized":"2024-05-08T18:07:26.600995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573570+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:07:26.573570+0000","last_peered":"2024-05-08T18:07:26.573570+0000","last_clean":"2024-05-08T18:07:26.573570+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:07:26.573570+0000","last_undegraded":"2024-05-08T18:07:26.573570+0000","last_fullsized":"2024-05-08T18:07:26.573570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.611177+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:07:26.611177+0000","last_peered":"2024-05-08T18:07:26.611177+0000","last_clean":"2024-05-08T18:07:26.611177+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:07:26.611177+0000","last_undegraded":"2024-05-08T18:07:26.611177+0000","last_fullsized":"2024-05-08T18:07:26.611177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593421+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:07:26.593421+0000","last_peered":"2024-05-08T18:07:26.593421+0000","last_clean":"2024-05-08T18:07:26.593421+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:07:26.593421+0000","last_undegraded":"2024-05-08T18:07:26.593421+0000","last_fullsized":"2024-05-08T18:07:26.593421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.605148+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:07:26.605148+0000","last_peered":"2024-05-08T18:07:26.605148+0000","last_clean":"2024-05-08T18:07:26.605148+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:07:26.605148+0000","last_undegraded":"2024-05-08T18:07:26.605148+0000","last_fullsized":"2024-05-08T18:07:26.605148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.329757+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:07:27.329757+0000","last_peered":"2024-05-08T18:07:27.329757+0000","last_clean":"2024-05-08T18:07:27.329757+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:07:27.329757+0000","last_undegraded":"2024-05-08T18:07:27.329757+0000","last_fullsized":"2024-05-08T18:07:27.329757+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593957+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:07:26.593957+0000","last_peered":"2024-05-08T18:07:26.593957+0000","last_clean":"2024-05-08T18:07:26.593957+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:07:26.593957+0000","last_undegraded":"2024-05-08T18:07:26.593957+0000","last_fullsized":"2024-05-08T18:07:26.593957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604005+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:07:26.604005+0000","last_peered":"2024-05-08T18:07:26.604005+0000","last_clean":"2024-05-08T18:07:26.604005+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:07:26.604005+0000","last_undegraded":"2024-05-08T18:07:26.604005+0000","last_fullsized":"2024-05-08T18:07:26.604005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.574391+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:07:26.574391+0000","last_peered":"2024-05-08T18:07:26.574391+0000","last_clean":"2024-05-08T18:07:26.574391+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:07:26.574391+0000","last_undegraded":"2024-05-08T18:07:26.574391+0000","last_fullsized":"2024-05-08T18:07:26.574391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567887+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:07:26.567887+0000","last_peered":"2024-05-08T18:07:26.567887+0000","last_clean":"2024-05-08T18:07:26.567887+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:07:26.567887+0000","last_undegraded":"2024-05-08T18:07:26.567887+0000","last_fullsized":"2024-05-08T18:07:26.567887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.569250+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:07:26.569250+0000","last_peered":"2024-05-08T18:07:26.569250+0000","last_clean":"2024-05-08T18:07:26.569250+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:07:26.569250+0000","last_undegraded":"2024-05-08T18:07:26.569250+0000","last_fullsized":"2024-05-08T18:07:26.569250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.527679+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:07:27.527679+0000","last_peered":"2024-05-08T18:07:27.527679+0000","last_clean":"2024-05-08T18:07:27.527679+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:07:27.527679+0000","last_undegraded":"2024-05-08T18:07:27.527679+0000","last_fullsized":"2024-05-08T18:07:27.527679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593893+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:07:26.593893+0000","last_peered":"2024-05-08T18:07:26.593893+0000","last_clean":"2024-05-08T18:07:26.593893+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:07:26.593893+0000","last_undegraded":"2024-05-08T18:07:26.593893+0000","last_fullsized":"2024-05-08T18:07:26.593893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.598706+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:07:26.598706+0000","last_peered":"2024-05-08T18:07:26.598706+0000","last_clean":"2024-05-08T18:07:26.598706+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:07:26.598706+0000","last_undegraded":"2024-05-08T18:07:26.598706+0000","last_fullsized":"2024-05-08T18:07:26.598706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573423+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:07:26.573423+0000","last_peered":"2024-05-08T18:07:26.573423+0000","last_clean":"2024-05-08T18:07:26.573423+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:07:26.573423+0000","last_undegraded":"2024-05-08T18:07:26.573423+0000","last_fullsized":"2024-05-08T18:07:26.573423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609242+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:07:26.609242+0000","last_peered":"2024-05-08T18:07:26.609242+0000","last_clean":"2024-05-08T18:07:26.609242+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:07:26.609242+0000","last_undegraded":"2024-05-08T18:07:26.609242+0000","last_fullsized":"2024-05-08T18:07:26.609242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594855+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:07:26.594855+0000","last_peered":"2024-05-08T18:07:26.594855+0000","last_clean":"2024-05-08T18:07:26.594855+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:07:26.594855+0000","last_undegraded":"2024-05-08T18:07:26.594855+0000","last_fullsized":"2024-05-08T18:07:26.594855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.506804+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:07:27.506804+0000","last_peered":"2024-05-08T18:07:27.506804+0000","last_clean":"2024-05-08T18:07:27.506804+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:07:27.506804+0000","last_undegraded":"2024-05-08T18:07:27.506804+0000","last_fullsized":"2024-05-08T18:07:27.506804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.702977+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:07:26.702977+0000","last_peered":"2024-05-08T18:07:26.702977+0000","last_clean":"2024-05-08T18:07:26.702977+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:07:26.702977+0000","last_undegraded":"2024-05-08T18:07:26.702977+0000","last_fullsized":"2024-05-08T18:07:26.702977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.588607+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:07:26.588607+0000","last_peered":"2024-05-08T18:07:26.588607+0000","last_clean":"2024-05-08T18:07:26.588607+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:07:26.588607+0000","last_undegraded":"2024-05-08T18:07:26.588607+0000","last_fullsized":"2024-05-08T18:07:26.588607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567603+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:07:26.567603+0000","last_peered":"2024-05-08T18:07:26.567603+0000","last_clean":"2024-05-08T18:07:26.567603+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:07:26.567603+0000","last_undegraded":"2024-05-08T18:07:26.567603+0000","last_fullsized":"2024-05-08T18:07:26.567603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.601215+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:07:26.601215+0000","last_peered":"2024-05-08T18:07:26.601215+0000","last_clean":"2024-05-08T18:07:26.601215+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:07:26.601215+0000","last_undegraded":"2024-05-08T18:07:26.601215+0000","last_fullsized":"2024-05-08T18:07:26.601215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.588990+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:07:26.588990+0000","last_peered":"2024-05-08T18:07:26.588990+0000","last_clean":"2024-05-08T18:07:26.588990+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:07:26.588990+0000","last_undegraded":"2024-05-08T18:07:26.588990+0000","last_fullsized":"2024-05-08T18:07:26.588990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.540825+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:07:27.540825+0000","last_peered":"2024-05-08T18:07:27.540825+0000","last_clean":"2024-05-08T18:07:27.540825+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:07:27.540825+0000","last_undegraded":"2024-05-08T18:07:27.540825+0000","last_fullsized":"2024-05-08T18:07:27.540825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.608226+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:07:26.608226+0000","last_peered":"2024-05-08T18:07:26.608226+0000","last_clean":"2024-05-08T18:07:26.608226+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:07:26.608226+0000","last_undegraded":"2024-05-08T18:07:26.608226+0000","last_fullsized":"2024-05-08T18:07:26.608226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.591435+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:07:26.591435+0000","last_peered":"2024-05-08T18:07:26.591435+0000","last_clean":"2024-05-08T18:07:26.591435+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:07:26.591435+0000","last_undegraded":"2024-05-08T18:07:26.591435+0000","last_fullsized":"2024-05-08T18:07:26.591435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567585+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:07:26.567585+0000","last_peered":"2024-05-08T18:07:26.567585+0000","last_clean":"2024-05-08T18:07:26.567585+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:07:26.567585+0000","last_undegraded":"2024-05-08T18:07:26.567585+0000","last_fullsized":"2024-05-08T18:07:26.567585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600337+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:07:26.600337+0000","last_peered":"2024-05-08T18:07:26.600337+0000","last_clean":"2024-05-08T18:07:26.600337+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:07:26.600337+0000","last_undegraded":"2024-05-08T18:07:26.600337+0000","last_fullsized":"2024-05-08T18:07:26.600337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599095+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:07:26.599095+0000","last_peered":"2024-05-08T18:07:26.599095+0000","last_clean":"2024-05-08T18:07:26.599095+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:07:26.599095+0000","last_undegraded":"2024-05-08T18:07:26.599095+0000","last_fullsized":"2024-05-08T18:07:26.599095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.920369+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:07:26.920369+0000","last_peered":"2024-05-08T18:07:26.920369+0000","last_clean":"2024-05-08T18:07:26.920369+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:07:26.920369+0000","last_undegraded":"2024-05-08T18:07:26.920369+0000","last_fullsized":"2024-05-08T18:07:26.920369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.603553+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:07:26.603553+0000","last_peered":"2024-05-08T18:07:26.603553+0000","last_clean":"2024-05-08T18:07:26.603553+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:07:26.603553+0000","last_undegraded":"2024-05-08T18:07:26.603553+0000","last_fullsized":"2024-05-08T18:07:26.603553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.576617+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:07:26.576617+0000","last_peered":"2024-05-08T18:07:26.576617+0000","last_clean":"2024-05-08T18:07:26.576617+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:07:26.576617+0000","last_undegraded":"2024-05-08T18:07:26.576617+0000","last_fullsized":"2024-05-08T18:07:26.576617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.572534+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:07:26.572534+0000","last_peered":"2024-05-08T18:07:26.572534+0000","last_clean":"2024-05-08T18:07:26.572534+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:07:26.572534+0000","last_undegraded":"2024-05-08T18:07:26.572534+0000","last_fullsized":"2024-05-08T18:07:26.572534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.576916+0000","last_change":"2024-05-08T18:07:15.488647+0000","last_active":"2024-05-08T18:07:26.576916+0000","last_peered":"2024-05-08T18:07:26.576916+0000","last_clean":"2024-05-08T18:07:26.576916+0000","last_became_active":"2024-05-08T18:07:15.487842+0000","last_became_peered":"2024-05-08T18:07:15.487842+0000","last_unstale":"2024-05-08T18:07:26.576916+0000","last_undegraded":"2024-05-08T18:07:26.576916+0000","last_fullsized":"2024-05-08T18:07:26.576916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.566280+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:07:26.566280+0000","last_peered":"2024-05-08T18:07:26.566280+0000","last_clean":"2024-05-08T18:07:26.566280+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:07:26.566280+0000","last_undegraded":"2024-05-08T18:07:26.566280+0000","last_fullsized":"2024-05-08T18:07:26.566280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.159681+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:07:27.159681+0000","last_peered":"2024-05-08T18:07:27.159681+0000","last_clean":"2024-05-08T18:07:27.159681+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:07:27.159681+0000","last_undegraded":"2024-05-08T18:07:27.159681+0000","last_fullsized":"2024-05-08T18:07:27.159681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.566791+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:07:26.566791+0000","last_peered":"2024-05-08T18:07:26.566791+0000","last_clean":"2024-05-08T18:07:26.566791+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:07:26.566791+0000","last_undegraded":"2024-05-08T18:07:26.566791+0000","last_fullsized":"2024-05-08T18:07:26.566791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.590635+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:07:26.590635+0000","last_peered":"2024-05-08T18:07:26.590635+0000","last_clean":"2024-05-08T18:07:26.590635+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:07:26.590635+0000","last_undegraded":"2024-05-08T18:07:26.590635+0000","last_fullsized":"2024-05-08T18:07:26.590635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.566895+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:07:26.566895+0000","last_peered":"2024-05-08T18:07:26.566895+0000","last_clean":"2024-05-08T18:07:26.566895+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:07:26.566895+0000","last_undegraded":"2024-05-08T18:07:26.566895+0000","last_fullsized":"2024-05-08T18:07:26.566895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.611207+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:07:26.611207+0000","last_peered":"2024-05-08T18:07:26.611207+0000","last_clean":"2024-05-08T18:07:26.611207+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:07:26.611207+0000","last_undegraded":"2024-05-08T18:07:26.611207+0000","last_fullsized":"2024-05-08T18:07:26.611207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.592567+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:07:26.592567+0000","last_peered":"2024-05-08T18:07:26.592567+0000","last_clean":"2024-05-08T18:07:26.592567+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:07:26.592567+0000","last_undegraded":"2024-05-08T18:07:26.592567+0000","last_fullsized":"2024-05-08T18:07:26.592567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:27.228128+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:07:27.228128+0000","last_peered":"2024-05-08T18:07:27.228128+0000","last_clean":"2024-05-08T18:07:27.228128+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:07:27.228128+0000","last_undegraded":"2024-05-08T18:07:27.228128+0000","last_fullsized":"2024-05-08T18:07:27.228128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609274+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:07:26.609274+0000","last_peered":"2024-05-08T18:07:26.609274+0000","last_clean":"2024-05-08T18:07:26.609274+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:07:26.609274+0000","last_undegraded":"2024-05-08T18:07:26.609274+0000","last_fullsized":"2024-05-08T18:07:26.609274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.569490+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:07:26.569490+0000","last_peered":"2024-05-08T18:07:26.569490+0000","last_clean":"2024-05-08T18:07:26.569490+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:07:26.569490+0000","last_undegraded":"2024-05-08T18:07:26.569490+0000","last_fullsized":"2024-05-08T18:07:26.569490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594353+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:07:26.594353+0000","last_peered":"2024-05-08T18:07:26.594353+0000","last_clean":"2024-05-08T18:07:26.594353+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:07:26.594353+0000","last_undegraded":"2024-05-08T18:07:26.594353+0000","last_fullsized":"2024-05-08T18:07:26.594353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.603466+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:07:26.603466+0000","last_peered":"2024-05-08T18:07:26.603466+0000","last_clean":"2024-05-08T18:07:26.603466+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:07:26.603466+0000","last_undegraded":"2024-05-08T18:07:26.603466+0000","last_fullsized":"2024-05-08T18:07:26.603466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594406+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:07:26.594406+0000","last_peered":"2024-05-08T18:07:26.594406+0000","last_clean":"2024-05-08T18:07:26.594406+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:07:26.594406+0000","last_undegraded":"2024-05-08T18:07:26.594406+0000","last_fullsized":"2024-05-08T18:07:26.594406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.570435+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:07:26.570435+0000","last_peered":"2024-05-08T18:07:26.570435+0000","last_clean":"2024-05-08T18:07:26.570435+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:07:26.570435+0000","last_undegraded":"2024-05-08T18:07:26.570435+0000","last_fullsized":"2024-05-08T18:07:26.570435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599491+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:07:26.599491+0000","last_peered":"2024-05-08T18:07:26.599491+0000","last_clean":"2024-05-08T18:07:26.599491+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:07:26.599491+0000","last_undegraded":"2024-05-08T18:07:26.599491+0000","last_fullsized":"2024-05-08T18:07:26.599491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600323+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:07:26.600323+0000","last_peered":"2024-05-08T18:07:26.600323+0000","last_clean":"2024-05-08T18:07:26.600323+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:07:26.600323+0000","last_undegraded":"2024-05-08T18:07:26.600323+0000","last_fullsized":"2024-05-08T18:07:26.600323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.594163+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:07:26.594163+0000","last_peered":"2024-05-08T18:07:26.594163+0000","last_clean":"2024-05-08T18:07:26.594163+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:07:26.594163+0000","last_undegraded":"2024-05-08T18:07:26.594163+0000","last_fullsized":"2024-05-08T18:07:26.594163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609490+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:07:26.609490+0000","last_peered":"2024-05-08T18:07:26.609490+0000","last_clean":"2024-05-08T18:07:26.609490+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:07:26.609490+0000","last_undegraded":"2024-05-08T18:07:26.609490+0000","last_fullsized":"2024-05-08T18:07:26.609490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.574370+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:07:26.574370+0000","last_peered":"2024-05-08T18:07:26.574370+0000","last_clean":"2024-05-08T18:07:26.574370+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:07:26.574370+0000","last_undegraded":"2024-05-08T18:07:26.574370+0000","last_fullsized":"2024-05-08T18:07:26.574370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.575717+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:07:26.575717+0000","last_peered":"2024-05-08T18:07:26.575717+0000","last_clean":"2024-05-08T18:07:26.575717+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:07:26.575717+0000","last_undegraded":"2024-05-08T18:07:26.575717+0000","last_fullsized":"2024-05-08T18:07:26.575717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.567861+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:07:26.567861+0000","last_peered":"2024-05-08T18:07:26.567861+0000","last_clean":"2024-05-08T18:07:26.567861+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:07:26.567861+0000","last_undegraded":"2024-05-08T18:07:26.567861+0000","last_fullsized":"2024-05-08T18:07:26.567861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.595218+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:07:26.595218+0000","last_peered":"2024-05-08T18:07:26.595218+0000","last_clean":"2024-05-08T18:07:26.595218+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:07:26.595218+0000","last_undegraded":"2024-05-08T18:07:26.595218+0000","last_fullsized":"2024-05-08T18:07:26.595218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.572020+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:07:26.572020+0000","last_peered":"2024-05-08T18:07:26.572020+0000","last_clean":"2024-05-08T18:07:26.572020+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:07:26.572020+0000","last_undegraded":"2024-05-08T18:07:26.572020+0000","last_fullsized":"2024-05-08T18:07:26.572020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.605397+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:07:26.605397+0000","last_peered":"2024-05-08T18:07:26.605397+0000","last_clean":"2024-05-08T18:07:26.605397+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:07:26.605397+0000","last_undegraded":"2024-05-08T18:07:26.605397+0000","last_fullsized":"2024-05-08T18:07:26.605397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.603311+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:07:26.603311+0000","last_peered":"2024-05-08T18:07:26.603311+0000","last_clean":"2024-05-08T18:07:26.603311+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:07:26.603311+0000","last_undegraded":"2024-05-08T18:07:26.603311+0000","last_fullsized":"2024-05-08T18:07:26.603311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.577492+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:07:26.577492+0000","last_peered":"2024-05-08T18:07:26.577492+0000","last_clean":"2024-05-08T18:07:26.577492+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:07:26.577492+0000","last_undegraded":"2024-05-08T18:07:26.577492+0000","last_fullsized":"2024-05-08T18:07:26.577492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.611151+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:07:26.611151+0000","last_peered":"2024-05-08T18:07:26.611151+0000","last_clean":"2024-05-08T18:07:26.611151+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:07:26.611151+0000","last_undegraded":"2024-05-08T18:07:26.611151+0000","last_fullsized":"2024-05-08T18:07:26.611151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599377+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:07:26.599377+0000","last_peered":"2024-05-08T18:07:26.599377+0000","last_clean":"2024-05-08T18:07:26.599377+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:07:26.599377+0000","last_undegraded":"2024-05-08T18:07:26.599377+0000","last_fullsized":"2024-05-08T18:07:26.599377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.569198+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:07:26.569198+0000","last_peered":"2024-05-08T18:07:26.569198+0000","last_clean":"2024-05-08T18:07:26.569198+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:07:26.569198+0000","last_undegraded":"2024-05-08T18:07:26.569198+0000","last_fullsized":"2024-05-08T18:07:26.569198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.572615+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:07:26.572615+0000","last_peered":"2024-05-08T18:07:26.572615+0000","last_clean":"2024-05-08T18:07:26.572615+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:07:26.572615+0000","last_undegraded":"2024-05-08T18:07:26.572615+0000","last_fullsized":"2024-05-08T18:07:26.572615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571614+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:07:26.571614+0000","last_peered":"2024-05-08T18:07:26.571614+0000","last_clean":"2024-05-08T18:07:26.571614+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:07:26.571614+0000","last_undegraded":"2024-05-08T18:07:26.571614+0000","last_fullsized":"2024-05-08T18:07:26.571614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600086+0000","last_change":"2024-05-08T18:07:15.498938+0000","last_active":"2024-05-08T18:07:26.600086+0000","last_peered":"2024-05-08T18:07:26.600086+0000","last_clean":"2024-05-08T18:07:26.600086+0000","last_became_active":"2024-05-08T18:07:15.498206+0000","last_became_peered":"2024-05-08T18:07:15.498206+0000","last_unstale":"2024-05-08T18:07:26.600086+0000","last_undegraded":"2024-05-08T18:07:26.600086+0000","last_fullsized":"2024-05-08T18:07:26.600086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.568806+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:07:26.568806+0000","last_peered":"2024-05-08T18:07:26.568806+0000","last_clean":"2024-05-08T18:07:26.568806+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:07:26.568806+0000","last_undegraded":"2024-05-08T18:07:26.568806+0000","last_fullsized":"2024-05-08T18:07:26.568806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.609741+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:07:26.609741+0000","last_peered":"2024-05-08T18:07:26.609741+0000","last_clean":"2024-05-08T18:07:26.609741+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:07:26.609741+0000","last_undegraded":"2024-05-08T18:07:26.609741+0000","last_fullsized":"2024-05-08T18:07:26.609741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.589550+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:07:26.589550+0000","last_peered":"2024-05-08T18:07:26.589550+0000","last_clean":"2024-05-08T18:07:26.589550+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:07:26.589550+0000","last_undegraded":"2024-05-08T18:07:26.589550+0000","last_fullsized":"2024-05-08T18:07:26.589550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.604541+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:07:26.604541+0000","last_peered":"2024-05-08T18:07:26.604541+0000","last_clean":"2024-05-08T18:07:26.604541+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:07:26.604541+0000","last_undegraded":"2024-05-08T18:07:26.604541+0000","last_fullsized":"2024-05-08T18:07:26.604541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.608683+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:07:26.608683+0000","last_peered":"2024-05-08T18:07:26.608683+0000","last_clean":"2024-05-08T18:07:26.608683+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:07:26.608683+0000","last_undegraded":"2024-05-08T18:07:26.608683+0000","last_fullsized":"2024-05-08T18:07:26.608683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.591240+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:07:26.591240+0000","last_peered":"2024-05-08T18:07:26.591240+0000","last_clean":"2024-05-08T18:07:26.591240+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:07:26.591240+0000","last_undegraded":"2024-05-08T18:07:26.591240+0000","last_fullsized":"2024-05-08T18:07:26.591240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.571786+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:07:26.571786+0000","last_peered":"2024-05-08T18:07:26.571786+0000","last_clean":"2024-05-08T18:07:26.571786+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:07:26.571786+0000","last_undegraded":"2024-05-08T18:07:26.571786+0000","last_fullsized":"2024-05-08T18:07:26.571786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.573342+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:07:26.573342+0000","last_peered":"2024-05-08T18:07:26.573342+0000","last_clean":"2024-05-08T18:07:26.573342+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:07:26.573342+0000","last_undegraded":"2024-05-08T18:07:26.573342+0000","last_fullsized":"2024-05-08T18:07:26.573342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.588673+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:07:26.588673+0000","last_peered":"2024-05-08T18:07:26.588673+0000","last_clean":"2024-05-08T18:07:26.588673+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:07:26.588673+0000","last_undegraded":"2024-05-08T18:07:26.588673+0000","last_fullsized":"2024-05-08T18:07:26.588673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.601533+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:07:26.601533+0000","last_peered":"2024-05-08T18:07:26.601533+0000","last_clean":"2024-05-08T18:07:26.601533+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:07:26.601533+0000","last_undegraded":"2024-05-08T18:07:26.601533+0000","last_fullsized":"2024-05-08T18:07:26.601533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.599138+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:07:26.599138+0000","last_peered":"2024-05-08T18:07:26.599138+0000","last_clean":"2024-05-08T18:07:26.599138+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:07:26.599138+0000","last_undegraded":"2024-05-08T18:07:26.599138+0000","last_fullsized":"2024-05-08T18:07:26.599138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.610984+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:07:26.610984+0000","last_peered":"2024-05-08T18:07:26.610984+0000","last_clean":"2024-05-08T18:07:26.610984+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:07:26.610984+0000","last_undegraded":"2024-05-08T18:07:26.610984+0000","last_fullsized":"2024-05-08T18:07:26.610984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.593291+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:07:26.593291+0000","last_peered":"2024-05-08T18:07:26.593291+0000","last_clean":"2024-05-08T18:07:26.593291+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:07:26.593291+0000","last_undegraded":"2024-05-08T18:07:26.593291+0000","last_fullsized":"2024-05-08T18:07:26.593291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:07:26.600121+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:07:26.600121+0000","last_peered":"2024-05-08T18:07:26.600121+0000","last_clean":"2024-05-08T18:07:26.600121+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:07:26.600121+0000","last_undegraded":"2024-05-08T18:07:26.600121+0000","last_fullsized":"2024-05-08T18:07:26.600121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":750040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":158576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":160397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":159067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":158972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":158138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":158826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":749446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:07:33.913 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T18:07:33.914 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-05-08T18:07:34.236 INFO:teuthology.orchestra.run.smithi080.stdout:epoch 32 2024-05-08T18:07:34.236 INFO:teuthology.orchestra.run.smithi080.stdout:fsid 0d8284a2-bb69-4df9-9f45-9ef5b469ca40 2024-05-08T18:07:34.236 INFO:teuthology.orchestra.run.smithi080.stdout:created 2024-05-08T18:06:48.916680+0000 2024-05-08T18:07:34.236 INFO:teuthology.orchestra.run.smithi080.stdout:modified 2024-05-08T18:07:26.553826+0000 2024-05-08T18:07:34.236 INFO:teuthology.orchestra.run.smithi080.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-08T18:07:34.237 INFO:teuthology.orchestra.run.smithi080.stdout:crush_version 4 2024-05-08T18:07:34.237 INFO:teuthology.orchestra.run.smithi080.stdout:full_ratio 0.95 2024-05-08T18:07:34.237 INFO:teuthology.orchestra.run.smithi080.stdout:backfillfull_ratio 0.9 2024-05-08T18:07:34.237 INFO:teuthology.orchestra.run.smithi080.stdout:nearfull_ratio 0.85 2024-05-08T18:07:34.237 INFO:teuthology.orchestra.run.smithi080.stdout:require_min_compat_client luminous 2024-05-08T18:07:34.237 INFO:teuthology.orchestra.run.smithi080.stdout:min_compat_client jewel 2024-05-08T18:07:34.237 INFO:teuthology.orchestra.run.smithi080.stdout:require_osd_release squid 2024-05-08T18:07:34.237 INFO:teuthology.orchestra.run.smithi080.stdout:stretch_mode_enabled false 2024-05-08T18:07:34.237 INFO:teuthology.orchestra.run.smithi080.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-05-08T18:07:34.237 INFO:teuthology.orchestra.run.smithi080.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 application rbd read_balance_score 1.99 2024-05-08T18:07:34.237 INFO:teuthology.orchestra.run.smithi080.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-05-08T18:07:34.237 INFO:teuthology.orchestra.run.smithi080.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 24 flags hashpspool stripe_width 0 application rgw read_balance_score 2.00 2024-05-08T18:07:34.237 INFO:teuthology.orchestra.run.smithi080.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 26 flags hashpspool stripe_width 0 application rgw read_balance_score 1.25 2024-05-08T18:07:34.237 INFO:teuthology.orchestra.run.smithi080.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 28 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-05-08T18:07:34.237 INFO:teuthology.orchestra.run.smithi080.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 30 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-05-08T18:07:34.237 INFO:teuthology.orchestra.run.smithi080.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 32 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-05-08T18:07:34.238 INFO:teuthology.orchestra.run.smithi080.stdout:max_osd 8 2024-05-08T18:07:34.238 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6809/3565382691,v1:172.21.15.80:6812/3565382691] [v2:172.21.15.80:6815/3565382691,v1:172.21.15.80:6817/3565382691] exists,up e14e7bbc-18b8-4961-bcde-109f22cc52e6 2024-05-08T18:07:34.238 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6800/3922502534,v1:172.21.15.80:6801/3922502534] [v2:172.21.15.80:6802/3922502534,v1:172.21.15.80:6803/3922502534] exists,up d4ce30c2-52b8-45a3-8a34-b0addc8311dd 2024-05-08T18:07:34.238 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2 up in weight 1 up_from 13 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6824/3474282780,v1:172.21.15.80:6825/3474282780] [v2:172.21.15.80:6826/3474282780,v1:172.21.15.80:6827/3474282780] exists,up 0049cbe1-578f-4202-a572-2328d79f0496 2024-05-08T18:07:34.238 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6808/3525633066,v1:172.21.15.80:6810/3525633066] [v2:172.21.15.80:6811/3525633066,v1:172.21.15.80:6813/3525633066] exists,up 3ec754a0-b0ca-4d44-bce0-7c380245ec0a 2024-05-08T18:07:34.238 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6816/4103080494,v1:172.21.15.115:6817/4103080494] [v2:172.21.15.115:6819/4103080494,v1:172.21.15.115:6821/4103080494] exists,up 1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d 2024-05-08T18:07:34.238 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6818/87947085,v1:172.21.15.115:6820/87947085] [v2:172.21.15.115:6822/87947085,v1:172.21.15.115:6824/87947085] exists,up 3dc618ad-e40d-418e-844c-57572043f866 2024-05-08T18:07:34.238 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6800/2090404725,v1:172.21.15.115:6801/2090404725] [v2:172.21.15.115:6802/2090404725,v1:172.21.15.115:6803/2090404725] exists,up 1f8172c6-5d27-4542-80a6-1c630dddf752 2024-05-08T18:07:34.238 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6808/133828553,v1:172.21.15.115:6809/133828553] [v2:172.21.15.115:6810/133828553,v1:172.21.15.115:6811/133828553] exists,up e4146a73-11ca-4499-afa7-23e23d70a662 2024-05-08T18:07:34.252 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6809/3565382691,v1:172.21.15.80:6812/3565382691] [v2:172.21.15.80:6815/3565382691,v1:172.21.15.80:6817/3565382691] exists,up e14e7bbc-18b8-4961-bcde-109f22cc52e6', 'osd.1 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6800/3922502534,v1:172.21.15.80:6801/3922502534] [v2:172.21.15.80:6802/3922502534,v1:172.21.15.80:6803/3922502534] exists,up d4ce30c2-52b8-45a3-8a34-b0addc8311dd', 'osd.2 up in weight 1 up_from 13 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6824/3474282780,v1:172.21.15.80:6825/3474282780] [v2:172.21.15.80:6826/3474282780,v1:172.21.15.80:6827/3474282780] exists,up 0049cbe1-578f-4202-a572-2328d79f0496', 'osd.3 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6808/3525633066,v1:172.21.15.80:6810/3525633066] [v2:172.21.15.80:6811/3525633066,v1:172.21.15.80:6813/3525633066] exists,up 3ec754a0-b0ca-4d44-bce0-7c380245ec0a', 'osd.4 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6816/4103080494,v1:172.21.15.115:6817/4103080494] [v2:172.21.15.115:6819/4103080494,v1:172.21.15.115:6821/4103080494] exists,up 1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d', 'osd.5 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6818/87947085,v1:172.21.15.115:6820/87947085] [v2:172.21.15.115:6822/87947085,v1:172.21.15.115:6824/87947085] exists,up 3dc618ad-e40d-418e-844c-57572043f866', 'osd.6 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6800/2090404725,v1:172.21.15.115:6801/2090404725] [v2:172.21.15.115:6802/2090404725,v1:172.21.15.115:6803/2090404725] exists,up 1f8172c6-5d27-4542-80a6-1c630dddf752', 'osd.7 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6808/133828553,v1:172.21.15.115:6809/133828553] [v2:172.21.15.115:6810/133828553,v1:172.21.15.115:6811/133828553] exists,up e4146a73-11ca-4499-afa7-23e23d70a662'] 2024-05-08T18:07:34.253 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-05-08T18:07:34.357 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:34.357 INFO:teuthology.orchestra.run.smithi080.stdout: "name": "mon.a", 2024-05-08T18:07:34.357 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster": "ceph", 2024-05-08T18:07:34.357 INFO:teuthology.orchestra.run.smithi080.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-05-08T18:07:34.357 INFO:teuthology.orchestra.run.smithi080.stdout: "admin_socket_mode": "", 2024-05-08T18:07:34.357 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-05-08T18:07:34.357 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_client_required": "cephx, none", 2024-05-08T18:07:34.358 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_cluster_required": "cephx", 2024-05-08T18:07:34.358 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_debug": "true", 2024-05-08T18:07:34.358 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-05-08T18:07:34.358 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-05-08T18:07:34.358 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_service_required": "cephx", 2024-05-08T18:07:34.358 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_service_ticket_ttl": "240.000000", 2024-05-08T18:07:34.358 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_supported": "cephx", 2024-05-08T18:07:34.358 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_aio": "true", 2024-05-08T18:07:34.358 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_aio_max_queue_depth": "1024", 2024-05-08T18:07:34.358 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_aio_poll_ms": "250", 2024-05-08T18:07:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_aio_reap_max": "16", 2024-05-08T18:07:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_async_discard_threads": "0", 2024-05-08T18:07:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_block_size": "4096", 2024-05-08T18:07:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_debug_aio": "false", 2024-05-08T18:07:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-05-08T18:07:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-05-08T18:07:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_debug_inflight_ios": "false", 2024-05-08T18:07:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_enable_discard": "false", 2024-05-08T18:07:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_flock_retry": "3", 2024-05-08T18:07:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_flock_retry_interval": "0.100000", 2024-05-08T18:07:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_inject_crash": "0", 2024-05-08T18:07:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_inject_crash_flush_delay": "2", 2024-05-08T18:07:34.359 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_ioring": "false", 2024-05-08T18:07:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_ioring_hipri": "false", 2024-05-08T18:07:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_ioring_sqthread_poll": "false", 2024-05-08T18:07:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-05-08T18:07:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_read_buffer_alignment": "4096", 2024-05-08T18:07:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-05-08T18:07:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "bdev_type": "", 2024-05-08T18:07:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_alloc_size": "1048576", 2024-05-08T18:07:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_allocator": "hybrid", 2024-05-08T18:07:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_buffered_io": "true", 2024-05-08T18:07:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_check_for_zeros": "false", 2024-05-08T18:07:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_check_volume_selector_often": "false", 2024-05-08T18:07:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-05-08T18:07:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_compact_log_sync": "false", 2024-05-08T18:07:34.360 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-05-08T18:07:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-05-08T18:07:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_log_compact_min_size": "16777216", 2024-05-08T18:07:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_log_replay_check_allocations": "true", 2024-05-08T18:07:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_max_log_runway": "4194304", 2024-05-08T18:07:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_max_prefetch": "1048576", 2024-05-08T18:07:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_min_flush_size": "524288", 2024-05-08T18:07:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_min_log_runway": "1048576", 2024-05-08T18:07:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_replay_recovery": "false", 2024-05-08T18:07:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-05-08T18:07:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_shared_alloc_size": "65536", 2024-05-08T18:07:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "bluefs_sync_write": "false", 2024-05-08T18:07:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-05-08T18:07:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-05-08T18:07:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-05-08T18:07:34.361 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_allocation_from_file": "true", 2024-05-08T18:07:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_allocator": "hybrid", 2024-05-08T18:07:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-05-08T18:07:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-05-08T18:07:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-05-08T18:07:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-05-08T18:07:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-05-08T18:07:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-05-08T18:07:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_blobid_prealloc": "10240", 2024-05-08T18:07:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_create": "true", 2024-05-08T18:07:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_db_create": "false", 2024-05-08T18:07:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_db_path": "", 2024-05-08T18:07:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_db_size": "0", 2024-05-08T18:07:34.362 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_path": "", 2024-05-08T18:07:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_preallocate_file": "false", 2024-05-08T18:07:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_size": "107374182400", 2024-05-08T18:07:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_wal_create": "false", 2024-05-08T18:07:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_wal_path": "", 2024-05-08T18:07:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_block_wal_size": "100663296", 2024-05-08T18:07:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_bluefs": "true", 2024-05-08T18:07:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-05-08T18:07:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_bluefs_env_mirror": "false", 2024-05-08T18:07:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-05-08T18:07:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-05-08T18:07:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-05-08T18:07:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-05-08T18:07:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-05-08T18:07:34.363 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-05-08T18:07:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_autotune": "true", 2024-05-08T18:07:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-05-08T18:07:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-05-08T18:07:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-05-08T18:07:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-05-08T18:07:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_size": "0", 2024-05-08T18:07:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-05-08T18:07:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-05-08T18:07:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-05-08T18:07:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-05-08T18:07:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cache_type": "2q", 2024-05-08T18:07:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-05-08T18:07:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_clone_cow": "true", 2024-05-08T18:07:34.364 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_algorithm": "snappy", 2024-05-08T18:07:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_max_blob_size": "0", 2024-05-08T18:07:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-05-08T18:07:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-05-08T18:07:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_min_blob_size": "0", 2024-05-08T18:07:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-05-08T18:07:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-05-08T18:07:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_mode": "none", 2024-05-08T18:07:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-05-08T18:07:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_csum_type": "crc32c", 2024-05-08T18:07:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-05-08T18:07:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_enforce_settings": "default", 2024-05-08T18:07:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_freelist": "false", 2024-05-08T18:07:34.365 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_fsck_abort": "false", 2024-05-08T18:07:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-05-08T18:07:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-05-08T18:07:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_inject_read_err": "false", 2024-05-08T18:07:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_legacy_omap": "false", 2024-05-08T18:07:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-05-08T18:07:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-05-08T18:07:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-05-08T18:07:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-05-08T18:07:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_prefill": "0.000000", 2024-05-08T18:07:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-05-08T18:07:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-05-08T18:07:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-05-08T18:07:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_small_allocations": "0", 2024-05-08T18:07:34.366 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-05-08T18:07:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_default_buffered_read": "true", 2024-05-08T18:07:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_default_buffered_write": "false", 2024-05-08T18:07:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_deferred_batch_ops": "0", 2024-05-08T18:07:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-05-08T18:07:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-05-08T18:07:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_elastic_shared_blobs": "true", 2024-05-08T18:07:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-05-08T18:07:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-05-08T18:07:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-05-08T18:07:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-05-08T18:07:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-05-08T18:07:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fail_eio": "false", 2024-05-08T18:07:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-05-08T18:07:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-05-08T18:07:34.367 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-05-08T18:07:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-05-08T18:07:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_on_mkfs": "true", 2024-05-08T18:07:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-05-08T18:07:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_on_mount": "false", 2024-05-08T18:07:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-05-08T18:07:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_on_umount": "false", 2024-05-08T18:07:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-05-08T18:07:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-05-08T18:07:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-05-08T18:07:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-05-08T18:07:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-05-08T18:07:34.368 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_ignore_data_csum": "false", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_kvbackend": "rocksdb", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_log_op_age": "5.000000", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_max_alloc_size": "0", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_max_blob_size": "0", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_max_defer_interval": "3.000000", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_max_deferred_txc": "32", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_min_alloc_size": "0", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-05-08T18:07:34.369 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-05-08T18:07:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_nid_prealloc": "1024", 2024-05-08T18:07:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_prefer_deferred_size": "0", 2024-05-08T18:07:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-05-08T18:07:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-05-08T18:07:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_qfsck_on_mount": "true", 2024-05-08T18:07:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_retry_disk_reads": "3", 2024-05-08T18:07:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_rocksdb_cf": "true", 2024-05-08T18:07:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-05-08T18:07:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-05-08T18:07:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_rocksdb_options_annex": "", 2024-05-08T18:07:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_spdk_coremask": "0x1", 2024-05-08T18:07:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_spdk_io_sleep": "5", 2024-05-08T18:07:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_spdk_max_io_completion": "0", 2024-05-08T18:07:34.370 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_spdk_mem": "512", 2024-05-08T18:07:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_sync_submit_transaction": "false", 2024-05-08T18:07:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_throttle_bytes": "67108864", 2024-05-08T18:07:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_throttle_cost_per_io": "0", 2024-05-08T18:07:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-05-08T18:07:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-05-08T18:07:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-05-08T18:07:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-05-08T18:07:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_tracing": "false", 2024-05-08T18:07:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-05-08T18:07:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-05-08T18:07:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_volume_selection_reserved": "0", 2024-05-08T18:07:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-05-08T18:07:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-05-08T18:07:34.371 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-05-08T18:07:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-05-08T18:07:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-05-08T18:07:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-05-08T18:07:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "bluestore_zero_block_detection": "false", 2024-05-08T18:07:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-05-08T18:07:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_action_update_interval": "2", 2024-05-08T18:07:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-05-08T18:07:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-05-08T18:07:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-05-08T18:07:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-05-08T18:07:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_mount_timeout": "10", 2024-05-08T18:07:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-05-08T18:07:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-05-08T18:07:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-05-08T18:07:34.372 INFO:teuthology.orchestra.run.smithi080.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-05-08T18:07:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-05-08T18:07:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-05-08T18:07:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-05-08T18:07:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cephx_cluster_require_signatures": "false", 2024-05-08T18:07:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cephx_cluster_require_version": "2", 2024-05-08T18:07:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cephx_require_signatures": "false", 2024-05-08T18:07:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cephx_require_version": "2", 2024-05-08T18:07:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cephx_service_require_signatures": "false", 2024-05-08T18:07:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cephx_service_require_version": "2", 2024-05-08T18:07:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "cephx_sign_messages": "true", 2024-05-08T18:07:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "chdir": "", 2024-05-08T18:07:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "client_acl_type": "", 2024-05-08T18:07:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "client_asio_thread_count": "2", 2024-05-08T18:07:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "client_cache_mid": "0.750000", 2024-05-08T18:07:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "client_cache_size": "16384", 2024-05-08T18:07:34.373 INFO:teuthology.orchestra.run.smithi080.stdout: "client_caps_release_delay": "5", 2024-05-08T18:07:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_check_pool_perm": "true", 2024-05-08T18:07:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_collect_and_send_global_metrics": "false", 2024-05-08T18:07:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_debug_force_sync_read": "false", 2024-05-08T18:07:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_debug_getattr_caps": "false", 2024-05-08T18:07:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_debug_inject_tick_delay": "0", 2024-05-08T18:07:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-05-08T18:07:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_die_on_failed_remount": "false", 2024-05-08T18:07:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_dirsize_rbytes": "true", 2024-05-08T18:07:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_force_lazyio": "false", 2024-05-08T18:07:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_fs": "", 2024-05-08T18:07:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_inject_fixed_oldest_tid": "false", 2024-05-08T18:07:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_inject_release_failure": "false", 2024-05-08T18:07:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_max_inline_size": "4096", 2024-05-08T18:07:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_max_retries_on_remount_failure": "5", 2024-05-08T18:07:34.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_mds_namespace": "", 2024-05-08T18:07:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "client_metadata": "", 2024-05-08T18:07:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "client_mount_gid": "-1", 2024-05-08T18:07:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "client_mount_timeout": "300", 2024-05-08T18:07:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "client_mount_uid": "-1", 2024-05-08T18:07:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "client_mountpoint": "/", 2024-05-08T18:07:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "client_notify_timeout": "10", 2024-05-08T18:07:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "client_oc": "true", 2024-05-08T18:07:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "client_oc_max_dirty": "104857600", 2024-05-08T18:07:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "client_oc_max_dirty_age": "5.000000", 2024-05-08T18:07:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "client_oc_max_objects": "1000", 2024-05-08T18:07:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "client_oc_size": "209715200", 2024-05-08T18:07:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "client_oc_target_dirty": "8388608", 2024-05-08T18:07:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "client_permissions": "true", 2024-05-08T18:07:34.375 INFO:teuthology.orchestra.run.smithi080.stdout: "client_quota": "true", 2024-05-08T18:07:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client_quota_df": "true", 2024-05-08T18:07:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client_readahead_max_bytes": "0", 2024-05-08T18:07:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client_readahead_max_periods": "4", 2024-05-08T18:07:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client_readahead_min": "131072", 2024-05-08T18:07:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client_reconnect_stale": "false", 2024-05-08T18:07:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client_shutdown_timeout": "30", 2024-05-08T18:07:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client_snapdir": ".snap", 2024-05-08T18:07:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client_tick_interval": "1", 2024-05-08T18:07:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client_trace": "", 2024-05-08T18:07:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client_try_dentry_invalidate": "false", 2024-05-08T18:07:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client_use_faked_inos": "false", 2024-05-08T18:07:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client_use_random_mds": "false", 2024-05-08T18:07:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "clog_to_graylog": "false", 2024-05-08T18:07:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-05-08T18:07:34.376 INFO:teuthology.orchestra.run.smithi080.stdout: "clog_to_graylog_port": "12201", 2024-05-08T18:07:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "clog_to_monitors": "default=true", 2024-05-08T18:07:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "clog_to_syslog": "false", 2024-05-08T18:07:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-05-08T18:07:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "clog_to_syslog_level": "info", 2024-05-08T18:07:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "-", 2024-05-08T18:07:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_network": "", 2024-05-08T18:07:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_network_interface": "", 2024-05-08T18:07:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "compressor_zlib_isal": "false", 2024-05-08T18:07:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "compressor_zlib_level": "5", 2024-05-08T18:07:34.377 INFO:teuthology.orchestra.run.smithi080.stdout: "compressor_zlib_winsize": "-15", 2024-05-08T18:07:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "compressor_zstd_level": "1", 2024-05-08T18:07:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-05-08T18:07:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-05-08T18:07:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "crimson_alien_op_num_threads": "6", 2024-05-08T18:07:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "crimson_alien_thread_cpu_cores": "", 2024-05-08T18:07:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "crimson_osd_obc_lru_size": "512", 2024-05-08T18:07:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-05-08T18:07:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "crimson_osd_stat_interval": "0", 2024-05-08T18:07:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "crimson_seastar_cpu_cores": "", 2024-05-08T18:07:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_location": "", 2024-05-08T18:07:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_location_hook": "", 2024-05-08T18:07:34.378 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_location_hook_timeout": "10", 2024-05-08T18:07:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "daemonize": "false", 2024-05-08T18:07:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "daos_pool": "tank", 2024-05-08T18:07:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-05-08T18:07:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-05-08T18:07:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "dbstore_db_name_prefix": "dbstore", 2024-05-08T18:07:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_alienstore": "0/5", 2024-05-08T18:07:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_allow_any_pool_priority": "false", 2024-05-08T18:07:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_asok": "1/5", 2024-05-08T18:07:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_asok_assert_abort": "false", 2024-05-08T18:07:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_asserts_on_shutdown": "true", 2024-05-08T18:07:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_auth": "20/20", 2024-05-08T18:07:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_bdev": "1/3", 2024-05-08T18:07:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_bluefs": "1/5", 2024-05-08T18:07:34.379 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_bluestore": "1/5", 2024-05-08T18:07:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_buffer": "0/1", 2024-05-08T18:07:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_ceph_dedup": "0/5", 2024-05-08T18:07:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_ceph_exporter": "1/5", 2024-05-08T18:07:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_cephfs_mirror": "0/5", 2024-05-08T18:07:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_cephsqlite": "0/5", 2024-05-08T18:07:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_client": "0/5", 2024-05-08T18:07:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_compressor": "1/5", 2024-05-08T18:07:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_context": "0/1", 2024-05-08T18:07:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_crimson_interrupt": "0/5", 2024-05-08T18:07:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_crush": "1/1", 2024-05-08T18:07:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_crypto": "1/5", 2024-05-08T18:07:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_cyanstore": "0/5", 2024-05-08T18:07:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_deliberately_leak_memory": "false", 2024-05-08T18:07:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_disable_randomized_ping": "false", 2024-05-08T18:07:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_dpdk": "1/5", 2024-05-08T18:07:34.380 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_eventtrace": "1/5", 2024-05-08T18:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_filer": "0/1", 2024-05-08T18:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_filestore": "1/3", 2024-05-08T18:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_finisher": "1/1", 2024-05-08T18:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_fuse": "1/5", 2024-05-08T18:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_heartbeat_testing_span": "0", 2024-05-08T18:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_heartbeatmap": "1/5", 2024-05-08T18:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_immutable_obj_cache": "0/5", 2024-05-08T18:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_javaclient": "1/5", 2024-05-08T18:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_journal": "1/3", 2024-05-08T18:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_journaler": "0/5", 2024-05-08T18:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_kstore": "1/5", 2024-05-08T18:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_lockdep": "0/1", 2024-05-08T18:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mclock": "1/5", 2024-05-08T18:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mds": "1/5", 2024-05-08T18:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mds_balancer": "1/5", 2024-05-08T18:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mds_locker": "1/5", 2024-05-08T18:07:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mds_log": "1/5", 2024-05-08T18:07:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mds_log_expire": "1/5", 2024-05-08T18:07:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mds_migrator": "1/5", 2024-05-08T18:07:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mds_quiesce": "3/5", 2024-05-08T18:07:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_memstore": "1/5", 2024-05-08T18:07:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mgr": "2/5", 2024-05-08T18:07:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mgrc": "1/5", 2024-05-08T18:07:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_mon": "20/20", 2024-05-08T18:07:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_monc": "0/10", 2024-05-08T18:07:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_ms": "1/1", 2024-05-08T18:07:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_none": "0/5", 2024-05-08T18:07:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_objclass": "0/5", 2024-05-08T18:07:34.382 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_objectcacher": "0/5", 2024-05-08T18:07:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_objecter": "0/1", 2024-05-08T18:07:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_optracker": "0/5", 2024-05-08T18:07:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_osd": "1/5", 2024-05-08T18:07:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_paxos": "20/20", 2024-05-08T18:07:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_perfcounter": "1/5", 2024-05-08T18:07:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_prioritycache": "1/5", 2024-05-08T18:07:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rados": "0/5", 2024-05-08T18:07:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rbd": "0/5", 2024-05-08T18:07:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rbd_mirror": "0/5", 2024-05-08T18:07:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rbd_pwl": "0/5", 2024-05-08T18:07:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rbd_replay": "0/5", 2024-05-08T18:07:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_refs": "0/0", 2024-05-08T18:07:34.383 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_reserver": "1/1", 2024-05-08T18:07:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rgw": "1/5", 2024-05-08T18:07:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rgw_access": "1/5", 2024-05-08T18:07:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rgw_datacache": "1/5", 2024-05-08T18:07:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rgw_dbstore": "1/5", 2024-05-08T18:07:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rgw_flight": "1/5", 2024-05-08T18:07:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rgw_lifecycle": "1/5", 2024-05-08T18:07:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rgw_notification": "1/5", 2024-05-08T18:07:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rgw_sync": "1/5", 2024-05-08T18:07:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_rocksdb": "4/5", 2024-05-08T18:07:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_seastore": "0/5", 2024-05-08T18:07:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_seastore_backref": "0/5", 2024-05-08T18:07:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_seastore_cache": "0/5", 2024-05-08T18:07:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_seastore_cleaner": "0/5", 2024-05-08T18:07:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_seastore_device": "0/5", 2024-05-08T18:07:34.384 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_seastore_epm": "0/5", 2024-05-08T18:07:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-05-08T18:07:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_seastore_journal": "0/5", 2024-05-08T18:07:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_seastore_lba": "0/5", 2024-05-08T18:07:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_seastore_odata": "0/5", 2024-05-08T18:07:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_seastore_omap": "0/5", 2024-05-08T18:07:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_seastore_onode": "0/5", 2024-05-08T18:07:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_seastore_t": "0/5", 2024-05-08T18:07:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_seastore_tm": "0/5", 2024-05-08T18:07:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_striper": "0/1", 2024-05-08T18:07:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_test": "0/5", 2024-05-08T18:07:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_throttle": "1/1", 2024-05-08T18:07:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_timer": "0/1", 2024-05-08T18:07:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_tp": "0/5", 2024-05-08T18:07:34.385 INFO:teuthology.orchestra.run.smithi080.stdout: "debug_trace": "1/5", 2024-05-08T18:07:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-05-08T18:07:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "device_failure_prediction_mode": "none", 2024-05-08T18:07:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-05-08T18:07:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-05-08T18:07:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "err_to_graylog": "false", 2024-05-08T18:07:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "err_to_journald": "false", 2024-05-08T18:07:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "err_to_stderr": "true", 2024-05-08T18:07:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "err_to_syslog": "false", 2024-05-08T18:07:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event_tracing": "false", 2024-05-08T18:07:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "exporter_addr": "0.0.0.0", 2024-05-08T18:07:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "exporter_http_port": "9926", 2024-05-08T18:07:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "exporter_prio_limit": "5", 2024-05-08T18:07:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-05-08T18:07:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "exporter_sort_metrics": "true", 2024-05-08T18:07:34.386 INFO:teuthology.orchestra.run.smithi080.stdout: "exporter_stats_period": "5", 2024-05-08T18:07:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "fake_statfs_for_testing": "0", 2024-05-08T18:07:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "fatal_signal_handlers": "true", 2024-05-08T18:07:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "filer_max_purge_ops": "10", 2024-05-08T18:07:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "filer_max_truncate_ops": "128", 2024-05-08T18:07:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_apply_finisher_threads": "1", 2024-05-08T18:07:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_blackhole": "false", 2024-05-08T18:07:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_btrfs_clone_range": "true", 2024-05-08T18:07:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_btrfs_snap": "true", 2024-05-08T18:07:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_caller_concurrency": "10", 2024-05-08T18:07:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_collect_device_partition_information": "true", 2024-05-08T18:07:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_commit_timeout": "600.000000", 2024-05-08T18:07:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_debug_inject_read_err": "false", 2024-05-08T18:07:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_debug_omap_check": "false", 2024-05-08T18:07:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_debug_verify_split": "false", 2024-05-08T18:07:34.387 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_dump_file": "", 2024-05-08T18:07:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-05-08T18:07:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-05-08T18:07:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_fadvise": "true", 2024-05-08T18:07:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_fail_eio": "true", 2024-05-08T18:07:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_fd_cache_shards": "16", 2024-05-08T18:07:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_fd_cache_size": "128", 2024-05-08T18:07:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_fiemap": "false", 2024-05-08T18:07:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_fiemap_threshold": "4096", 2024-05-08T18:07:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-05-08T18:07:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_index_retry_probability": "0.000000", 2024-05-08T18:07:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_inject_stall": "0", 2024-05-08T18:07:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_journal_parallel": "false", 2024-05-08T18:07:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_journal_trailing": "false", 2024-05-08T18:07:34.388 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_journal_writeahead": "false", 2024-05-08T18:07:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_kill_at": "0", 2024-05-08T18:07:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-05-08T18:07:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_inline_xattr_size": "0", 2024-05-08T18:07:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-05-08T18:07:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-05-08T18:07:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-05-08T18:07:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_inline_xattrs": "0", 2024-05-08T18:07:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-05-08T18:07:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_inline_xattrs_other": "2", 2024-05-08T18:07:34.389 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-05-08T18:07:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_sync_interval": "5.000000", 2024-05-08T18:07:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_xattr_value_size": "0", 2024-05-08T18:07:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-05-08T18:07:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-05-08T18:07:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-05-08T18:07:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_merge_threshold": "-10", 2024-05-08T18:07:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_min_sync_interval": "0.010000", 2024-05-08T18:07:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_odsync_write": "false", 2024-05-08T18:07:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_omap_backend": "rocksdb", 2024-05-08T18:07:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_omap_backend_path": "", 2024-05-08T18:07:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_omap_header_cache_size": "1024", 2024-05-08T18:07:34.390 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_ondisk_finisher_threads": "1", 2024-05-08T18:07:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-05-08T18:07:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_op_thread_timeout": "60", 2024-05-08T18:07:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_op_threads": "2", 2024-05-08T18:07:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_punch_hole": "false", 2024-05-08T18:07:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-05-08T18:07:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-05-08T18:07:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-05-08T18:07:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-05-08T18:07:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-05-08T18:07:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_max_bytes": "104857600", 2024-05-08T18:07:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-05-08T18:07:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-05-08T18:07:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-05-08T18:07:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_queue_max_ops": "50", 2024-05-08T18:07:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-05-08T18:07:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_seek_data_hole": "false", 2024-05-08T18:07:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_sloppy_crc": "false", 2024-05-08T18:07:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-05-08T18:07:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_splice": "false", 2024-05-08T18:07:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_split_multiple": "2", 2024-05-08T18:07:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_split_rand_factor": "20", 2024-05-08T18:07:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_update_to": "1000", 2024-05-08T18:07:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-05-08T18:07:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-05-08T18:07:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-05-08T18:07:34.392 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-05-08T18:07:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-05-08T18:07:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-05-08T18:07:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_enable": "true", 2024-05-08T18:07:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-05-08T18:07:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-05-08T18:07:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-05-08T18:07:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-05-08T18:07:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-05-08T18:07:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-05-08T18:07:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_xfs_extsize": "false", 2024-05-08T18:07:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "filestore_zfs_snap": "false", 2024-05-08T18:07:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "fio_dir": "/tmp/fio", 2024-05-08T18:07:34.393 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "0d8284a2-bb69-4df9-9f45-9ef5b469ca40", 2024-05-08T18:07:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_allow_other": "true", 2024-05-08T18:07:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_atomic_o_trunc": "true", 2024-05-08T18:07:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_big_writes": "true", 2024-05-08T18:07:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_debug": "false", 2024-05-08T18:07:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_default_permissions": "false", 2024-05-08T18:07:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_disable_pagecache": "false", 2024-05-08T18:07:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_max_write": "0", 2024-05-08T18:07:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_multithreaded": "true", 2024-05-08T18:07:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_require_active_mds": "true", 2024-05-08T18:07:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_set_user_groups": "true", 2024-05-08T18:07:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_splice_move": "true", 2024-05-08T18:07:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_splice_read": "true", 2024-05-08T18:07:34.394 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_splice_write": "true", 2024-05-08T18:07:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_syncfs_on_mksnap": "true", 2024-05-08T18:07:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "fuse_use_invalidate_cb": "true", 2024-05-08T18:07:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-05-08T18:07:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "gss_target_name": "ceph", 2024-05-08T18:07:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_file": "", 2024-05-08T18:07:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_inject_failure": "0", 2024-05-08T18:07:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_interval": "5", 2024-05-08T18:07:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "host": "smithi080", 2024-05-08T18:07:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-05-08T18:07:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-05-08T18:07:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_max_size": "1073741824", 2024-05-08T18:07:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-05-08T18:07:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-05-08T18:07:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-05-08T18:07:34.395 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-05-08T18:07:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-05-08T18:07:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-05-08T18:07:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-05-08T18:07:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-05-08T18:07:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-05-08T18:07:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "immutable_object_cache_watermark": "0.900000", 2024-05-08T18:07:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "inject_early_sigterm": "false", 2024-05-08T18:07:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "jaeger_agent_port": "6799", 2024-05-08T18:07:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "jaeger_tracing_enable": "false", 2024-05-08T18:07:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_aio": "true", 2024-05-08T18:07:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_align_min_size": "65536", 2024-05-08T18:07:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_block_align": "true", 2024-05-08T18:07:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_block_size": "4096", 2024-05-08T18:07:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_dio": "true", 2024-05-08T18:07:34.396 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_discard": "false", 2024-05-08T18:07:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_force_aio": "false", 2024-05-08T18:07:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_ignore_corruption": "false", 2024-05-08T18:07:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_max_write_bytes": "10485760", 2024-05-08T18:07:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_max_write_entries": "100", 2024-05-08T18:07:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_replay_from": "0", 2024-05-08T18:07:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_throttle_high_multiple": "0.000000", 2024-05-08T18:07:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-05-08T18:07:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-05-08T18:07:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_throttle_max_multiple": "0.000000", 2024-05-08T18:07:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_write_header_frequency": "0", 2024-05-08T18:07:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "journal_zero_on_create": "false", 2024-05-08T18:07:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "journaler_prefetch_periods": "10", 2024-05-08T18:07:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "journaler_prezero_periods": "5", 2024-05-08T18:07:34.397 INFO:teuthology.orchestra.run.smithi080.stdout: "journaler_write_head_interval": "15", 2024-05-08T18:07:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "", 2024-05-08T18:07:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "keyfile": "", 2024-05-08T18:07:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-05-08T18:07:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_backend": "rocksdb", 2024-05-08T18:07:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_default_stripe_size": "65536", 2024-05-08T18:07:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_fsck_on_mount": "false", 2024-05-08T18:07:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_fsck_on_mount_deep": "true", 2024-05-08T18:07:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_max_bytes": "67108864", 2024-05-08T18:07:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_max_ops": "512", 2024-05-08T18:07:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_nid_prealloc": "1024", 2024-05-08T18:07:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_onode_map_size": "1024", 2024-05-08T18:07:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-05-08T18:07:34.398 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_sync_submit_transaction": "false", 2024-05-08T18:07:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "kstore_sync_transaction": "false", 2024-05-08T18:07:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "librados_thread_count": "2", 2024-05-08T18:07:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "lockdep": "false", 2024-05-08T18:07:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "lockdep_force_backtrace": "false", 2024-05-08T18:07:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "log_coarse_timestamps": "true", 2024-05-08T18:07:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-05-08T18:07:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "log_flush_on_exit": "false", 2024-05-08T18:07:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "log_graylog_host": "127.0.0.1", 2024-05-08T18:07:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "log_graylog_port": "12201", 2024-05-08T18:07:34.399 INFO:teuthology.orchestra.run.smithi080.stdout: "log_max_new": "1000", 2024-05-08T18:07:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "log_max_recent": "10000", 2024-05-08T18:07:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "log_stderr_prefix": "", 2024-05-08T18:07:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "log_stop_at_utilization": "0.970000", 2024-05-08T18:07:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_file": "true", 2024-05-08T18:07:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_graylog": "false", 2024-05-08T18:07:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_journald": "false", 2024-05-08T18:07:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_stderr": "false", 2024-05-08T18:07:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "log_to_syslog": "false", 2024-05-08T18:07:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "max_rotating_auth_attempts": "10", 2024-05-08T18:07:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-05-08T18:07:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_action_on_write_error": "1", 2024-05-08T18:07:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_alternate_name_max": "8192", 2024-05-08T18:07:34.400 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_asio_thread_count": "2", 2024-05-08T18:07:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_export_pin": "true", 2024-05-08T18:07:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_fragment_dirs": "true", 2024-05-08T18:07:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-05-08T18:07:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_fragment_interval": "5", 2024-05-08T18:07:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_fragment_size_max": "100000", 2024-05-08T18:07:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_idle_threshold": "0.000000", 2024-05-08T18:07:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_interval": "10", 2024-05-08T18:07:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_max": "-1", 2024-05-08T18:07:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_max_until": "-1", 2024-05-08T18:07:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_merge_size": "50", 2024-05-08T18:07:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_midchunk": "0.300000", 2024-05-08T18:07:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_min_rebalance": "0.100000", 2024-05-08T18:07:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_min_start": "0.200000", 2024-05-08T18:07:34.401 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_minchunk": "0.001000", 2024-05-08T18:07:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_mode": "0", 2024-05-08T18:07:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_need_max": "1.200000", 2024-05-08T18:07:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_need_min": "0.800000", 2024-05-08T18:07:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_overload_epochs": "2", 2024-05-08T18:07:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-05-08T18:07:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_sample_interval": "3.000000", 2024-05-08T18:07:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_split_bits": "3", 2024-05-08T18:07:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_split_rd": "25000.000000", 2024-05-08T18:07:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_split_size": "10000", 2024-05-08T18:07:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_split_wr": "10000.000000", 2024-05-08T18:07:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_target_decay": "10.000000", 2024-05-08T18:07:34.402 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-05-08T18:07:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_beacon_grace": "15.000000", 2024-05-08T18:07:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_beacon_interval": "4.000000", 2024-05-08T18:07:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_beacon_mon_down_grace": "60", 2024-05-08T18:07:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_memory_limit": "4294967296", 2024-05-08T18:07:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_mid": "0.700000", 2024-05-08T18:07:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-05-08T18:07:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_quiesce_delay": "0", 2024-05-08T18:07:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_quiesce_sleep": "200", 2024-05-08T18:07:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_quiesce_splitauth": "true", 2024-05-08T18:07:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_quiesce_threshold": "524288", 2024-05-08T18:07:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_release_free_interval": "10", 2024-05-08T18:07:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_reservation": "0.050000", 2024-05-08T18:07:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-05-08T18:07:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_trim_interval": "1", 2024-05-08T18:07:34.403 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cache_trim_threshold": "262144", 2024-05-08T18:07:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-05-08T18:07:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-05-08T18:07:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_client_delegate_inos_pct": "50", 2024-05-08T18:07:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_client_prealloc_inos": "1000", 2024-05-08T18:07:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-05-08T18:07:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_connect_bootstrapping": "false", 2024-05-08T18:07:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_damage_table_max_entries": "10000", 2024-05-08T18:07:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-05-08T18:07:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_debug_auth_pins": "false", 2024-05-08T18:07:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_debug_frag": "false", 2024-05-08T18:07:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_debug_scatterstat": "false", 2024-05-08T18:07:34.404 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_debug_subtrees": "false", 2024-05-08T18:07:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_decay_halflife": "5.000000", 2024-05-08T18:07:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_default_dir_hash": "2", 2024-05-08T18:07:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_defer_session_stale": "true", 2024-05-08T18:07:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_deny_all_reconnect": "false", 2024-05-08T18:07:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dir_keys_per_op": "16384", 2024-05-08T18:07:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dir_max_commit_size": "10", 2024-05-08T18:07:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dir_max_entries": "0", 2024-05-08T18:07:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dir_prefetch": "true", 2024-05-08T18:07:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dirstat_min_interval": "1.000000", 2024-05-08T18:07:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dump_cache_after_rejoin": "false", 2024-05-08T18:07:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dump_cache_on_map": "false", 2024-05-08T18:07:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dump_cache_threshold_file": "0", 2024-05-08T18:07:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-05-08T18:07:34.405 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_early_reply": "true", 2024-05-08T18:07:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_enable_op_tracker": "true", 2024-05-08T18:07:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_enforce_unique_name": "true", 2024-05-08T18:07:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_export_ephemeral_distributed": "true", 2024-05-08T18:07:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-05-08T18:07:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_export_ephemeral_random": "true", 2024-05-08T18:07:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-05-08T18:07:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-05-08T18:07:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_forward_all_requests_to_auth": "false", 2024-05-08T18:07:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-05-08T18:07:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-05-08T18:07:34.406 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-05-08T18:07:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-05-08T18:07:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_health_cache_threshold": "1.500000", 2024-05-08T18:07:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_health_summarize_threshold": "10", 2024-05-08T18:07:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_heartbeat_grace": "15.000000", 2024-05-08T18:07:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_heartbeat_reset_grace": "1000", 2024-05-08T18:07:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_inject_health_dummy": "false", 2024-05-08T18:07:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-05-08T18:07:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_inject_migrator_session_race": "false", 2024-05-08T18:07:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-05-08T18:07:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-05-08T18:07:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-05-08T18:07:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_join_fs": "", 2024-05-08T18:07:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_journal_format": "1", 2024-05-08T18:07:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-05-08T18:07:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_create_at": "0", 2024-05-08T18:07:34.407 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_export_at": "0", 2024-05-08T18:07:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_import_at": "0", 2024-05-08T18:07:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_journal_at": "0", 2024-05-08T18:07:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_journal_expire_at": "0", 2024-05-08T18:07:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_journal_replay_at": "0", 2024-05-08T18:07:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_link_at": "0", 2024-05-08T18:07:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_mdstable_at": "0", 2024-05-08T18:07:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_openc_at": "0", 2024-05-08T18:07:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_rename_at": "0", 2024-05-08T18:07:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_kill_shutdown_at": "0", 2024-05-08T18:07:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_event_large_threshold": "524288", 2024-05-08T18:07:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_events_per_segment": "1024", 2024-05-08T18:07:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_major_segment_event_ratio": "12", 2024-05-08T18:07:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_max_events": "-1", 2024-05-08T18:07:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_max_segments": "128", 2024-05-08T18:07:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_pause": "false", 2024-05-08T18:07:34.408 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_segment_size": "0", 2024-05-08T18:07:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_skip_corrupt_events": "false", 2024-05-08T18:07:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_skip_unbounded_events": "false", 2024-05-08T18:07:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-05-08T18:07:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_trim_threshold": "128", 2024-05-08T18:07:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-05-08T18:07:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_log_warn_factor": "2.000000", 2024-05-08T18:07:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_caps_per_client": "1048576", 2024-05-08T18:07:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_completed_flushes": "100000", 2024-05-08T18:07:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_completed_requests": "100000", 2024-05-08T18:07:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_export_size": "20971520", 2024-05-08T18:07:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_file_recover": "32", 2024-05-08T18:07:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_purge_files": "64", 2024-05-08T18:07:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_purge_ops": "8192", 2024-05-08T18:07:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-05-08T18:07:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-05-08T18:07:34.409 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_max_snaps_per_dir": "100", 2024-05-08T18:07:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_metrics_update_interval": "2", 2024-05-08T18:07:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_min_caps_per_client": "100", 2024-05-08T18:07:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_min_caps_working_set": "10000", 2024-05-08T18:07:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-05-08T18:07:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_numa_node": "-1", 2024-05-08T18:07:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-05-08T18:07:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_op_complaint_time": "30.000000", 2024-05-08T18:07:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_op_history_duration": "600", 2024-05-08T18:07:34.410 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_op_history_size": "20", 2024-05-08T18:07:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_op_history_slow_op_size": "20", 2024-05-08T18:07:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_op_history_slow_op_threshold": "10", 2024-05-08T18:07:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_op_log_threshold": "5", 2024-05-08T18:07:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_ping_grace": "15", 2024-05-08T18:07:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_ping_interval": "5", 2024-05-08T18:07:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-05-08T18:07:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-05-08T18:07:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_recall_max_caps": "30000", 2024-05-08T18:07:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-05-08T18:07:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_recall_max_decay_threshold": "131072", 2024-05-08T18:07:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-05-08T18:07:34.411 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_recall_warning_threshold": "262144", 2024-05-08T18:07:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_reconnect_timeout": "45.000000", 2024-05-08T18:07:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_replay_interval": "1.000000", 2024-05-08T18:07:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-05-08T18:07:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-05-08T18:07:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_root_ino_gid": "0", 2024-05-08T18:07:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_root_ino_uid": "0", 2024-05-08T18:07:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-05-08T18:07:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-05-08T18:07:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-05-08T18:07:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_session_blocklist_on_evict": "true", 2024-05-08T18:07:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_session_blocklist_on_timeout": "true", 2024-05-08T18:07:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-05-08T18:07:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-05-08T18:07:34.412 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-05-08T18:07:34.413 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-05-08T18:07:34.413 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-05-08T18:07:34.413 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_session_metadata_threshold": "16777216", 2024-05-08T18:07:34.413 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-05-08T18:07:34.413 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_shutdown_check": "0", 2024-05-08T18:07:34.413 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_skip_ino": "0", 2024-05-08T18:07:34.413 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_sleep_rank_change": "0.000000", 2024-05-08T18:07:34.413 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_snap_max_uid": "4294967294", 2024-05-08T18:07:34.413 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_snap_min_uid": "0", 2024-05-08T18:07:34.413 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_snap_rstat": "false", 2024-05-08T18:07:34.413 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_standby_replay_damaged": "false", 2024-05-08T18:07:34.413 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_symlink_recovery": "true", 2024-05-08T18:07:34.413 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_task_status_update_interval": "2.000000", 2024-05-08T18:07:34.413 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_thrash_exports": "0", 2024-05-08T18:07:34.414 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_thrash_fragments": "0", 2024-05-08T18:07:34.414 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_tick_interval": "5.000000", 2024-05-08T18:07:34.414 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_valgrind_exit": "false", 2024-05-08T18:07:34.414 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_verify_backtrace": "1", 2024-05-08T18:07:34.414 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_verify_scatter": "false", 2024-05-08T18:07:34.414 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_wipe_ino_prealloc": "false", 2024-05-08T18:07:34.414 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_wipe_sessions": "false", 2024-05-08T18:07:34.414 INFO:teuthology.orchestra.run.smithi080.stdout: "mempool_debug": "false", 2024-05-08T18:07:34.414 INFO:teuthology.orchestra.run.smithi080.stdout: "memstore_debug_omit_block_device_write": "false", 2024-05-08T18:07:34.414 INFO:teuthology.orchestra.run.smithi080.stdout: "memstore_device_bytes": "1073741824", 2024-05-08T18:07:34.414 INFO:teuthology.orchestra.run.smithi080.stdout: "memstore_page_set": "false", 2024-05-08T18:07:34.414 INFO:teuthology.orchestra.run.smithi080.stdout: "memstore_page_size": "65536", 2024-05-08T18:07:34.414 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_client_bytes": "134217728", 2024-05-08T18:07:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_client_messages": "512", 2024-05-08T18:07:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-05-08T18:07:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_connect_retry_interval": "1.000000", 2024-05-08T18:07:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-05-08T18:07:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-05-08T18:07:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_disabled_modules": "", 2024-05-08T18:07:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_enable_op_tracker": "true", 2024-05-08T18:07:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-05-08T18:07:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_max_pg_creating": "1024", 2024-05-08T18:07:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_max_pg_num_change": "128", 2024-05-08T18:07:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_mds_bytes": "134217728", 2024-05-08T18:07:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_mds_messages": "128", 2024-05-08T18:07:34.415 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-05-08T18:07:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_mon_bytes": "134217728", 2024-05-08T18:07:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_mon_messages": "128", 2024-05-08T18:07:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_num_op_tracker_shard": "32", 2024-05-08T18:07:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_op_complaint_time": "30.000000", 2024-05-08T18:07:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_op_history_duration": "600", 2024-05-08T18:07:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_op_history_size": "20", 2024-05-08T18:07:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_op_history_slow_op_size": "20", 2024-05-08T18:07:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-05-08T18:07:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_op_log_threshold": "5", 2024-05-08T18:07:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_osd_bytes": "536870912", 2024-05-08T18:07:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_osd_messages": "8192", 2024-05-08T18:07:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_pool": "true", 2024-05-08T18:07:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_service_beacon_grace": "60.000000", 2024-05-08T18:07:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_standby_modules": "true", 2024-05-08T18:07:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_stats_period": "5", 2024-05-08T18:07:34.416 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_stats_threshold": "5", 2024-05-08T18:07:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_tick_period": "2", 2024-05-08T18:07:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-05-08T18:07:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_accept_timeout_factor": "2.000000", 2024-05-08T18:07:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_allow_pool_delete": "true", 2024-05-08T18:07:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_allow_pool_size_one": "true", 2024-05-08T18:07:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_auth_validate_all_caps": "true", 2024-05-08T18:07:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-05-08T18:07:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-05-08T18:07:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_bytes": "104857600", 2024-05-08T18:07:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_directed_command_retry": "2", 2024-05-08T18:07:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_hunt_interval": "3.000000", 2024-05-08T18:07:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-05-08T18:07:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-05-08T18:07:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-05-08T18:07:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_hunt_parallel": "3", 2024-05-08T18:07:34.417 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_log_interval": "1.000000", 2024-05-08T18:07:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-05-08T18:07:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_ping_interval": "10.000000", 2024-05-08T18:07:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_ping_timeout": "30.000000", 2024-05-08T18:07:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_client_target_rank": "-1", 2024-05-08T18:07:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_clock_drift_allowed": "1.000000", 2024-05-08T18:07:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-05-08T18:07:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-05-08T18:07:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_level": "debug", 2024-05-08T18:07:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_to_file": "true", 2024-05-08T18:07:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_to_graylog": "false", 2024-05-08T18:07:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-05-08T18:07:34.418 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-05-08T18:07:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_to_journald": "false", 2024-05-08T18:07:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_to_stderr": "false", 2024-05-08T18:07:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-05-08T18:07:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-05-08T18:07:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_compact_on_bootstrap": "false", 2024-05-08T18:07:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_compact_on_start": "false", 2024-05-08T18:07:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_compact_on_trim": "true", 2024-05-08T18:07:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_con_tracker_persist_interval": "10", 2024-05-08T18:07:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_con_tracker_score_halflife": "43200", 2024-05-08T18:07:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_config_key_max_entry_size": "65536", 2024-05-08T18:07:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_cpu_threads": "4", 2024-05-08T18:07:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_crush_min_required_version": "hammer", 2024-05-08T18:07:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_daemon_bytes": "419430400", 2024-05-08T18:07:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-05-08T18:07:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_data_avail_crit": "5", 2024-05-08T18:07:34.419 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_data_avail_warn": "5", 2024-05-08T18:07:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_data_size_warn": "16106127360", 2024-05-08T18:07:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_block_osdmap_trim": "false", 2024-05-08T18:07:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-05-08T18:07:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_dump_json": "false", 2024-05-08T18:07:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-05-08T18:07:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_dump_transactions": "false", 2024-05-08T18:07:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_extra_checks": "false", 2024-05-08T18:07:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-05-08T18:07:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-05-08T18:07:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_no_require_reef": "false", 2024-05-08T18:07:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_no_require_squid": "false", 2024-05-08T18:07:34.420 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-05-08T18:07:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_delta_reset_interval": "10.000000", 2024-05-08T18:07:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_dns_srv_name": "ceph-mon", 2024-05-08T18:07:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_down_mkfs_grace": "120", 2024-05-08T18:07:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_down_uptime_grace": "60", 2024-05-08T18:07:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_election_default_strategy": "1", 2024-05-08T18:07:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_election_timeout": "5.000000", 2024-05-08T18:07:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-05-08T18:07:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_elector_ping_divisor": "2", 2024-05-08T18:07:34.421 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_elector_ping_timeout": "2.000000", 2024-05-08T18:07:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_enable_op_tracker": "true", 2024-05-08T18:07:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_fake_pool_delete": "false", 2024-05-08T18:07:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_force_quorum_join": "false", 2024-05-08T18:07:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_globalid_prealloc": "10000", 2024-05-08T18:07:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_health_detail_to_clog": "false", 2024-05-08T18:07:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_health_log_update_period": "5", 2024-05-08T18:07:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_health_max_detail": "50", 2024-05-08T18:07:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_health_to_clog": "true", 2024-05-08T18:07:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_health_to_clog_interval": "600", 2024-05-08T18:07:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-05-08T18:07:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_host": "172.21.15.80,[v2:172.21.15.80:3301,v1:172.21.15.80:6790],172.21.15.115", 2024-05-08T18:07:34.422 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_host_override": "", 2024-05-08T18:07:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_initial_members": "", 2024-05-08T18:07:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-05-08T18:07:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-05-08T18:07:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-05-08T18:07:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-05-08T18:07:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_keyvaluedb": "rocksdb", 2024-05-08T18:07:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_lease": "5.000000", 2024-05-08T18:07:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-05-08T18:07:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-05-08T18:07:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_log_full_interval": "50", 2024-05-08T18:07:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_log_max": "10000", 2024-05-08T18:07:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_log_max_summary": "50", 2024-05-08T18:07:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_max_log_entries_per_event": "4096", 2024-05-08T18:07:34.423 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_max_log_epochs": "500", 2024-05-08T18:07:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_max_mdsmap_epochs": "500", 2024-05-08T18:07:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_max_mgrmap_epochs": "500", 2024-05-08T18:07:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_max_osd": "10000", 2024-05-08T18:07:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_max_pg_per_osd": "10000", 2024-05-08T18:07:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_max_pool_pg_num": "65536", 2024-05-08T18:07:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-05-08T18:07:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-05-08T18:07:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mds_force_trim_to": "0", 2024-05-08T18:07:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mds_skip_sanity": "false", 2024-05-08T18:07:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_memory_autotune": "true", 2024-05-08T18:07:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_memory_target": "2147483648", 2024-05-08T18:07:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mgr_beacon_grace": "30", 2024-05-08T18:07:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-05-08T18:07:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mgr_digest_period": "5", 2024-05-08T18:07:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mgr_inactive_grace": "60", 2024-05-08T18:07:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mgr_mkfs_grace": "240", 2024-05-08T18:07:34.425 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-05-08T18:07:34.425 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_min_osdmap_epochs": "500", 2024-05-08T18:07:34.425 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_op_complaint_time": "30", 2024-05-08T18:07:34.425 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_op_history_duration": "600", 2024-05-08T18:07:34.425 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_op_history_size": "20", 2024-05-08T18:07:34.425 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_op_history_slow_op_size": "20", 2024-05-08T18:07:34.425 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_op_history_slow_op_threshold": "10", 2024-05-08T18:07:34.425 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_op_log_threshold": "5", 2024-05-08T18:07:34.425 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-05-08T18:07:34.425 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-05-08T18:07:34.425 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-05-08T18:07:34.425 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_auto_mark_in": "false", 2024-05-08T18:07:34.425 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_auto_mark_new_in": "true", 2024-05-08T18:07:34.425 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-05-08T18:07:34.426 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-05-08T18:07:34.426 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_cache_size": "500", 2024-05-08T18:07:34.426 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_cache_size_min": "134217728", 2024-05-08T18:07:34.426 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_crush_smoke_test": "true", 2024-05-08T18:07:34.426 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_destroyed_out_interval": "600", 2024-05-08T18:07:34.426 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_down_out_interval": "600", 2024-05-08T18:07:34.426 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-05-08T18:07:34.426 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-05-08T18:07:34.426 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_force_trim_to": "0", 2024-05-08T18:07:34.426 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_full_ratio": "0.950000", 2024-05-08T18:07:34.426 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-05-08T18:07:34.426 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_laggy_halflife": "3600", 2024-05-08T18:07:34.426 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_laggy_max_interval": "300", 2024-05-08T18:07:34.426 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_laggy_weight": "0.300000", 2024-05-08T18:07:34.426 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-05-08T18:07:34.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_max_initial_pgs": "1024", 2024-05-08T18:07:34.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_min_down_reporters": "2", 2024-05-08T18:07:34.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-05-08T18:07:34.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-05-08T18:07:34.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-05-08T18:07:34.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_prime_pg_temp": "true", 2024-05-08T18:07:34.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-05-08T18:07:34.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-05-08T18:07:34.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_report_timeout": "900", 2024-05-08T18:07:34.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-05-08T18:07:34.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-05-08T18:07:34.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_warn_num_repaired": "10", 2024-05-08T18:07:34.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osd_warn_op_age": "32.000000", 2024-05-08T18:07:34.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-05-08T18:07:34.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osdmap_full_prune_interval": "10", 2024-05-08T18:07:34.427 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osdmap_full_prune_min": "10000", 2024-05-08T18:07:34.428 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-05-08T18:07:34.428 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-05-08T18:07:34.428 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_pg_stuck_threshold": "60", 2024-05-08T18:07:34.428 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-05-08T18:07:34.428 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_pg_warn_min_objects": "10000", 2024-05-08T18:07:34.428 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_pg_warn_min_per_osd": "0", 2024-05-08T18:07:34.428 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-05-08T18:07:34.428 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_pool_quota_crit_threshold": "0", 2024-05-08T18:07:34.428 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_pool_quota_warn_threshold": "0", 2024-05-08T18:07:34.428 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_probe_timeout": "2.000000", 2024-05-08T18:07:34.428 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_reweight_max_change": "0.050000", 2024-05-08T18:07:34.428 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_reweight_max_osds": "4", 2024-05-08T18:07:34.428 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-05-08T18:07:34.428 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-05-08T18:07:34.429 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-05-08T18:07:34.429 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-05-08T18:07:34.429 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-05-08T18:07:34.429 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_scrub_interval": "86400", 2024-05-08T18:07:34.429 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_scrub_max_keys": "100", 2024-05-08T18:07:34.429 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_scrub_timeout": "300", 2024-05-08T18:07:34.429 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_session_timeout": "300", 2024-05-08T18:07:34.429 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_smart_report_timeout": "5", 2024-05-08T18:07:34.429 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_stat_smooth_intervals": "6", 2024-05-08T18:07:34.429 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-05-08T18:07:34.429 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_stretch_pool_min_size": "2", 2024-05-08T18:07:34.429 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_stretch_pool_size": "4", 2024-05-08T18:07:34.429 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-05-08T18:07:34.430 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_subscribe_interval": "86400.000000", 2024-05-08T18:07:34.430 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_sync_debug": "false", 2024-05-08T18:07:34.430 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_sync_max_payload_keys": "2000", 2024-05-08T18:07:34.430 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_sync_max_payload_size": "1048576", 2024-05-08T18:07:34.430 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_sync_provider_kill_at": "0", 2024-05-08T18:07:34.430 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_sync_requester_kill_at": "0", 2024-05-08T18:07:34.430 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_sync_timeout": "60.000000", 2024-05-08T18:07:34.430 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_target_pg_per_osd": "100", 2024-05-08T18:07:34.430 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_tick_interval": "5", 2024-05-08T18:07:34.430 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_timecheck_interval": "300.000000", 2024-05-08T18:07:34.430 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-05-08T18:07:34.430 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_use_min_delay_socket": "false", 2024-05-08T18:07:34.430 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_older_version_delay": "604800", 2024-05-08T18:07:34.431 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-05-08T18:07:34.431 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-05-08T18:07:34.431 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-05-08T18:07:34.431 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_filestore_osds": "false", 2024-05-08T18:07:34.431 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-05-08T18:07:34.431 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-05-08T18:07:34.431 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-05-08T18:07:34.431 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_misplaced": "false", 2024-05-08T18:07:34.431 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-05-08T18:07:34.431 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_older_version": "true", 2024-05-08T18:07:34.432 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-05-08T18:07:34.432 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_pool_no_app": "true", 2024-05-08T18:07:34.432 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-05-08T18:07:34.432 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-05-08T18:07:34.432 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-05-08T18:07:34.432 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-05-08T18:07:34.432 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_on_too_few_osds": "false", 2024-05-08T18:07:34.432 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-05-08T18:07:34.432 INFO:teuthology.orchestra.run.smithi080.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-05-08T18:07:34.432 INFO:teuthology.orchestra.run.smithi080.stdout: "monmap": "", 2024-05-08T18:07:34.433 INFO:teuthology.orchestra.run.smithi080.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-05-08T18:07:34.433 INFO:teuthology.orchestra.run.smithi080.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-05-08T18:07:34.433 INFO:teuthology.orchestra.run.smithi080.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-05-08T18:07:34.433 INFO:teuthology.orchestra.run.smithi080.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-05-08T18:07:34.433 INFO:teuthology.orchestra.run.smithi080.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-05-08T18:07:34.433 INFO:teuthology.orchestra.run.smithi080.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-05-08T18:07:34.433 INFO:teuthology.orchestra.run.smithi080.stdout: "motr_tracing_enabled": "false", 2024-05-08T18:07:34.433 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_op_threads": "3", 2024-05-08T18:07:34.433 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_buffer_size": "131072", 2024-05-08T18:07:34.433 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_cm": "false", 2024-05-08T18:07:34.433 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_device_name": "", 2024-05-08T18:07:34.434 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_dscp": "96", 2024-05-08T18:07:34.434 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-05-08T18:07:34.434 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_gid_idx": "0", 2024-05-08T18:07:34.434 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_local_gid": "", 2024-05-08T18:07:34.434 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_polling_us": "1000", 2024-05-08T18:07:34.434 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_port_num": "1", 2024-05-08T18:07:34.434 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-05-08T18:07:34.434 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-05-08T18:07:34.434 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_roce_ver": "1", 2024-05-08T18:07:34.434 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_send_buffers": "1024", 2024-05-08T18:07:34.434 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_sl": "3", 2024-05-08T18:07:34.434 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_support_srq": "true", 2024-05-08T18:07:34.434 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_rdma_type": "ib", 2024-05-08T18:07:34.434 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_async_reap_threshold": "5", 2024-05-08T18:07:34.435 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_before_connect": "false", 2024-05-08T18:07:34.435 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_ipv4": "true", 2024-05-08T18:07:34.435 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_ipv6": "false", 2024-05-08T18:07:34.435 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_msgr1": "true", 2024-05-08T18:07:34.435 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_msgr2": "true", 2024-05-08T18:07:34.435 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_port_max": "7568", 2024-05-08T18:07:34.435 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_port_min": "6800", 2024-05-08T18:07:34.435 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_prefer_ipv4": "false", 2024-05-08T18:07:34.435 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_retry_count": "3", 2024-05-08T18:07:34.435 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_bind_retry_delay": "5", 2024-05-08T18:07:34.435 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_blackhole_client": "false", 2024-05-08T18:07:34.435 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_blackhole_mds": "false", 2024-05-08T18:07:34.435 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_blackhole_mgr": "false", 2024-05-08T18:07:34.435 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_blackhole_mon": "false", 2024-05-08T18:07:34.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_blackhole_osd": "false", 2024-05-08T18:07:34.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_client_mode": "crc secure", 2024-05-08T18:07:34.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_cluster_mode": "crc secure", 2024-05-08T18:07:34.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_cluster_type": "", 2024-05-08T18:07:34.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_compress_secure": "false", 2024-05-08T18:07:34.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_connection_idle_timeout": "900", 2024-05-08T18:07:34.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_connection_ready_timeout": "10", 2024-05-08T18:07:34.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_crc_data": "true", 2024-05-08T18:07:34.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_crc_header": "true", 2024-05-08T18:07:34.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_die_on_bad_msg": "false", 2024-05-08T18:07:34.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_die_on_bug": "true", 2024-05-08T18:07:34.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_die_on_old_message": "true", 2024-05-08T18:07:34.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_die_on_skipped_message": "false", 2024-05-08T18:07:34.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_die_on_unhandled_msg": "false", 2024-05-08T18:07:34.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-05-08T18:07:34.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_coremask": "0xF", 2024-05-08T18:07:34.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-05-08T18:07:34.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_devs_allowlist": "", 2024-05-08T18:07:34.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_enable_tso": "true", 2024-05-08T18:07:34.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-05-08T18:07:34.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-05-08T18:07:34.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_hugepages": "", 2024-05-08T18:07:34.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_hw_flow_control": "true", 2024-05-08T18:07:34.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-05-08T18:07:34.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_lro": "true", 2024-05-08T18:07:34.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_memory_channel": "4", 2024-05-08T18:07:34.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-05-08T18:07:34.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_pmd": "", 2024-05-08T18:07:34.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_port_id": "0", 2024-05-08T18:07:34.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-05-08T18:07:34.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dump_corrupt_message_level": "1", 2024-05-08T18:07:34.438 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_dump_on_send": "false", 2024-05-08T18:07:34.438 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_initial_backoff": "0.200000", 2024-05-08T18:07:34.438 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_inject_delay_max": "1.000000", 2024-05-08T18:07:34.438 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_inject_delay_probability": "0.000000", 2024-05-08T18:07:34.438 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_inject_delay_type": "", 2024-05-08T18:07:34.438 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_inject_internal_delays": "0.000000", 2024-05-08T18:07:34.438 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_inject_network_congestion": "0", 2024-05-08T18:07:34.438 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_inject_socket_failures": "0", 2024-05-08T18:07:34.438 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_learn_addr_from_peer": "true", 2024-05-08T18:07:34.438 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_max_accept_failures": "4", 2024-05-08T18:07:34.438 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_max_backoff": "15.000000", 2024-05-08T18:07:34.438 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_mon_client_mode": "secure crc", 2024-05-08T18:07:34.438 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_mon_cluster_mode": "secure crc", 2024-05-08T18:07:34.438 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_mon_service_mode": "secure crc", 2024-05-08T18:07:34.438 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_osd_compress_min_size": "1024", 2024-05-08T18:07:34.439 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_osd_compress_mode": "none", 2024-05-08T18:07:34.439 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_osd_compression_algorithm": "snappy", 2024-05-08T18:07:34.439 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-05-08T18:07:34.439 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_pq_min_cost": "65536", 2024-05-08T18:07:34.439 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_public_type": "", 2024-05-08T18:07:34.439 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_service_mode": "crc secure", 2024-05-08T18:07:34.439 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_tcp_listen_backlog": "512", 2024-05-08T18:07:34.439 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_tcp_nodelay": "true", 2024-05-08T18:07:34.439 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-05-08T18:07:34.439 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_tcp_rcvbuf": "0", 2024-05-08T18:07:34.439 INFO:teuthology.orchestra.run.smithi080.stdout: "ms_type": "async+posix", 2024-05-08T18:07:34.439 INFO:teuthology.orchestra.run.smithi080.stdout: "no_config_file": "false", 2024-05-08T18:07:34.439 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter_completion_locks_per_session": "32", 2024-05-08T18:07:34.439 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter_debug_inject_relock_delay": "false", 2024-05-08T18:07:34.440 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter_inflight_op_bytes": "104857600", 2024-05-08T18:07:34.440 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter_inflight_ops": "1024", 2024-05-08T18:07:34.440 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter_inject_no_watch_ping": "false", 2024-05-08T18:07:34.440 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-05-08T18:07:34.440 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter_tick_interval": "5.000000", 2024-05-08T18:07:34.440 INFO:teuthology.orchestra.run.smithi080.stdout: "objecter_timeout": "10.000000", 2024-05-08T18:07:34.440 INFO:teuthology.orchestra.run.smithi080.stdout: "objectstore_blackhole": "false", 2024-05-08T18:07:34.440 INFO:teuthology.orchestra.run.smithi080.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-05-08T18:07:34.440 INFO:teuthology.orchestra.run.smithi080.stdout: "openssl_engine_opts": "", 2024-05-08T18:07:34.440 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_agent_delay_time": "5.000000", 2024-05-08T18:07:34.440 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_agent_hist_halflife": "1000", 2024-05-08T18:07:34.440 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_agent_max_low_ops": "2", 2024-05-08T18:07:34.441 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_agent_max_ops": "4", 2024-05-08T18:07:34.441 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-05-08T18:07:34.441 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_agent_quantize_effort": "0.100000", 2024-05-08T18:07:34.441 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_agent_slop": "0.020000", 2024-05-08T18:07:34.441 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-05-08T18:07:34.441 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_allow_recovery_below_min_size": "true", 2024-05-08T18:07:34.441 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_asio_thread_count": "2", 2024-05-08T18:07:34.441 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_async_recovery_min_cost": "100", 2024-05-08T18:07:34.441 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_auto_mark_unfound_lost": "false", 2024-05-08T18:07:34.441 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_backfill_retry_interval": "30.000000", 2024-05-08T18:07:34.441 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_backfill_scan_max": "512", 2024-05-08T18:07:34.442 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_backfill_scan_min": "64", 2024-05-08T18:07:34.442 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_backoff_on_degraded": "false", 2024-05-08T18:07:34.442 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_backoff_on_peering": "false", 2024-05-08T18:07:34.442 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_backoff_on_unfound": "true", 2024-05-08T18:07:34.442 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_beacon_report_interval": "300", 2024-05-08T18:07:34.442 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bench_duration": "30", 2024-05-08T18:07:34.442 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-05-08T18:07:34.442 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bench_max_block_size": "67108864", 2024-05-08T18:07:34.442 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_bench_small_size_max_iops": "100", 2024-05-08T18:07:34.442 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_blkin_trace_all": "false", 2024-05-08T18:07:34.442 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_blocked_scrub_grace_period": "120", 2024-05-08T18:07:34.442 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-05-08T18:07:34.443 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-05-08T18:07:34.443 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-05-08T18:07:34.443 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_check_for_log_corruption": "false", 2024-05-08T18:07:34.443 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-05-08T18:07:34.443 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-05-08T18:07:34.443 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-05-08T18:07:34.443 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-05-08T18:07:34.443 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_class_update_on_start": "true", 2024-05-08T18:07:34.443 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_client_message_cap": "256", 2024-05-08T18:07:34.443 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_client_message_size_cap": "524288000", 2024-05-08T18:07:34.443 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_client_op_priority": "63", 2024-05-08T18:07:34.443 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_client_watch_timeout": "30", 2024-05-08T18:07:34.443 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_command_max_records": "256", 2024-05-08T18:07:34.443 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_compact_on_start": "false", 2024-05-08T18:07:34.443 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-05-08T18:07:34.444 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_crush_chooseleaf_type": "0", 2024-05-08T18:07:34.444 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_crush_initial_weight": "-1.000000", 2024-05-08T18:07:34.444 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_crush_update_on_start": "true", 2024-05-08T18:07:34.444 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_crush_update_weight_set": "true", 2024-05-08T18:07:34.444 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-05-08T18:07:34.444 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-05-08T18:07:34.444 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-05-08T18:07:34.444 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_drop_ping_duration": "0", 2024-05-08T18:07:34.444 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-05-08T18:07:34.444 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_feed_pullee": "-1", 2024-05-08T18:07:34.444 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-05-08T18:07:34.444 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-05-08T18:07:34.444 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-05-08T18:07:34.445 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_misdirected_ops": "false", 2024-05-08T18:07:34.445 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_no_acting_change": "false", 2024-05-08T18:07:34.445 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_no_purge_strays": "false", 2024-05-08T18:07:34.445 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_op_order": "false", 2024-05-08T18:07:34.445 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_pg_log_writeout": "false", 2024-05-08T18:07:34.445 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_pretend_recovery_active": "false", 2024-05-08T18:07:34.445 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-05-08T18:07:34.445 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-05-08T18:07:34.445 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_shutdown": "false", 2024-05-08T18:07:34.445 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-05-08T18:07:34.445 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-05-08T18:07:34.445 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_trim_objects": "false", 2024-05-08T18:07:34.445 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_verify_cached_snaps": "false", 2024-05-08T18:07:34.445 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_verify_missing_on_start": "false", 2024-05-08T18:07:34.446 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_verify_snaps": "false", 2024-05-08T18:07:34.446 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-05-08T18:07:34.446 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-05-08T18:07:34.446 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_deep_scrub_keys": "1024", 2024-05-08T18:07:34.446 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-05-08T18:07:34.446 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-05-08T18:07:34.446 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-05-08T18:07:34.447 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_deep_scrub_stride": "524288", 2024-05-08T18:07:34.447 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-05-08T18:07:34.447 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_default_data_pool_replay_window": "5", 2024-05-08T18:07:34.447 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_default_notify_timeout": "30", 2024-05-08T18:07:34.447 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_delete_sleep": "0.000000", 2024-05-08T18:07:34.447 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-05-08T18:07:34.447 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-05-08T18:07:34.447 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-05-08T18:07:34.447 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_discard_disconnected_ops": "true", 2024-05-08T18:07:34.447 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_enable_op_tracker": "true", 2024-05-08T18:07:34.447 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-05-08T18:07:34.447 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_extblkdev_plugins": "vdo", 2024-05-08T18:07:34.447 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-05-08T18:07:34.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-05-08T18:07:34.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_fast_info": "true", 2024-05-08T18:07:34.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_fast_shutdown": "true", 2024-05-08T18:07:34.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-05-08T18:07:34.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_fast_shutdown_timeout": "15", 2024-05-08T18:07:34.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-05-08T18:07:34.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-05-08T18:07:34.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-05-08T18:07:34.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_function_tracing": "false", 2024-05-08T18:07:34.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_heartbeat_grace": "20", 2024-05-08T18:07:34.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_heartbeat_interval": "6", 2024-05-08T18:07:34.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-05-08T18:07:34.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_heartbeat_min_peers": "10", 2024-05-08T18:07:34.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_heartbeat_min_size": "2000", 2024-05-08T18:07:34.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_heartbeat_stale": "600", 2024-05-08T18:07:34.448 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-05-08T18:07:34.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_hit_set_max_size": "100000", 2024-05-08T18:07:34.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_hit_set_min_size": "1000", 2024-05-08T18:07:34.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-05-08T18:07:34.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-05-08T18:07:34.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-05-08T18:07:34.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-05-08T18:07:34.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-05-08T18:07:34.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_journal_flush_on_shutdown": "true", 2024-05-08T18:07:34.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_journal_size": "5120", 2024-05-08T18:07:34.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_kill_backfill_at": "0", 2024-05-08T18:07:34.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_loop_before_reset_tphandle": "64", 2024-05-08T18:07:34.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_map_cache_size": "50", 2024-05-08T18:07:34.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_map_dedup": "true", 2024-05-08T18:07:34.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_map_message_max": "40", 2024-05-08T18:07:34.449 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_map_message_max_bytes": "10485760", 2024-05-08T18:07:34.450 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_map_share_max_epochs": "40", 2024-05-08T18:07:34.450 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_attr_name_len": "100", 2024-05-08T18:07:34.450 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_attr_size": "0", 2024-05-08T18:07:34.450 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_backfills": "1", 2024-05-08T18:07:34.450 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_markdown_count": "5", 2024-05-08T18:07:34.450 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_markdown_period": "600", 2024-05-08T18:07:34.450 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_object_name_len": "2048", 2024-05-08T18:07:34.450 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_object_namespace_len": "256", 2024-05-08T18:07:34.450 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_object_size": "134217728", 2024-05-08T18:07:34.450 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-05-08T18:07:34.450 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_omap_entries_per_request": "1024", 2024-05-08T18:07:34.450 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_pg_blocked_by": "16", 2024-05-08T18:07:34.450 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_pg_log_entries": "10000", 2024-05-08T18:07:34.450 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-05-08T18:07:34.450 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_pgls": "1024", 2024-05-08T18:07:34.451 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_push_cost": "8388608", 2024-05-08T18:07:34.451 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_push_objects": "10", 2024-05-08T18:07:34.451 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_scrubs": "3", 2024-05-08T18:07:34.451 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-05-08T18:07:34.451 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_trimming_pgs": "2", 2024-05-08T18:07:34.451 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_write_op_reply_len": "64", 2024-05-08T18:07:34.451 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_max_write_size": "90", 2024-05-08T18:07:34.451 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-05-08T18:07:34.451 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-05-08T18:07:34.451 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-05-08T18:07:34.451 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-05-08T18:07:34.451 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-05-08T18:07:34.451 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-05-08T18:07:34.451 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-05-08T18:07:34.452 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_override_recovery_settings": "false", 2024-05-08T18:07:34.452 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_profile": "balanced", 2024-05-08T18:07:34.452 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-05-08T18:07:34.452 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-05-08T18:07:34.452 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-05-08T18:07:34.452 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-05-08T18:07:34.452 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-05-08T18:07:34.452 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-05-08T18:07:34.452 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-05-08T18:07:34.452 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-05-08T18:07:34.453 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-05-08T18:07:34.453 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-05-08T18:07:34.453 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mclock_skip_benchmark": "false", 2024-05-08T18:07:34.453 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_memory_base": "805306368", 2024-05-08T18:07:34.453 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_memory_cache_min": "134217728", 2024-05-08T18:07:34.453 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-05-08T18:07:34.453 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-05-08T18:07:34.453 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_memory_target": "4294967296", 2024-05-08T18:07:34.453 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_memory_target_autotune": "false", 2024-05-08T18:07:34.453 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-05-08T18:07:34.453 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_min_pg_log_entries": "250", 2024-05-08T18:07:34.453 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_min_recovery_priority": "0", 2024-05-08T18:07:34.453 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mon_heartbeat_interval": "30", 2024-05-08T18:07:34.453 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-05-08T18:07:34.453 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mon_report_interval": "5", 2024-05-08T18:07:34.454 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mon_report_max_in_flight": "2", 2024-05-08T18:07:34.454 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-05-08T18:07:34.454 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_num_cache_shards": "32", 2024-05-08T18:07:34.454 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_num_op_tracker_shard": "32", 2024-05-08T18:07:34.454 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_numa_auto_affinity": "true", 2024-05-08T18:07:34.454 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_numa_node": "-1", 2024-05-08T18:07:34.454 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_numa_prefer_iface": "true", 2024-05-08T18:07:34.454 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-05-08T18:07:34.454 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_objecter_finishers": "1", 2024-05-08T18:07:34.454 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_objectstore": "bluestore", 2024-05-08T18:07:34.454 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_objectstore_fuse": "false", 2024-05-08T18:07:34.454 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_objectstore_tracing": "false", 2024-05-08T18:07:34.454 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_complaint_time": "30.000000", 2024-05-08T18:07:34.454 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_history_duration": "600", 2024-05-08T18:07:34.455 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_history_size": "20", 2024-05-08T18:07:34.455 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_history_slow_op_size": "20", 2024-05-08T18:07:34.455 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-05-08T18:07:34.455 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_log_threshold": "5", 2024-05-08T18:07:34.455 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_num_shards": "0", 2024-05-08T18:07:34.455 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_num_shards_hdd": "5", 2024-05-08T18:07:34.455 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_num_shards_ssd": "8", 2024-05-08T18:07:34.455 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_num_threads_per_shard": "0", 2024-05-08T18:07:34.455 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-05-08T18:07:34.455 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-05-08T18:07:34.455 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-05-08T18:07:34.455 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_pq_min_cost": "65536", 2024-05-08T18:07:34.455 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_queue": "mclock_scheduler", 2024-05-08T18:07:34.455 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_queue_cut_off": "high", 2024-05-08T18:07:34.455 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_thread_suicide_timeout": "150", 2024-05-08T18:07:34.456 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_op_thread_timeout": "15", 2024-05-08T18:07:34.456 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_open_classes_on_start": "true", 2024-05-08T18:07:34.456 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_os_flags": "0", 2024-05-08T18:07:34.456 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_peering_op_priority": "255", 2024-05-08T18:07:34.456 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_delete_cost": "1048576", 2024-05-08T18:07:34.456 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_delete_priority": "5", 2024-05-08T18:07:34.456 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-05-08T18:07:34.456 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-05-08T18:07:34.456 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_log_dups_tracked": "3000", 2024-05-08T18:07:34.456 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_log_trim_max": "10000", 2024-05-08T18:07:34.456 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_log_trim_min": "100", 2024-05-08T18:07:34.456 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-05-08T18:07:34.456 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_object_context_cache_count": "64", 2024-05-08T18:07:34.457 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-05-08T18:07:34.457 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-05-08T18:07:34.457 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-05-08T18:07:34.457 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-05-08T18:07:34.457 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-05-08T18:07:34.457 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-05-08T18:07:34.457 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-05-08T18:07:34.457 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-05-08T18:07:34.457 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_crimson": "false", 2024-05-08T18:07:34.457 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_crush_rule": "-1", 2024-05-08T18:07:34.457 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_ec_fast_read": "false", 2024-05-08T18:07:34.457 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-05-08T18:07:34.457 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_flag_bulk": "false", 2024-05-08T18:07:34.457 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-05-08T18:07:34.457 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_flag_nodelete": "false", 2024-05-08T18:07:34.458 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-05-08T18:07:34.458 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-05-08T18:07:34.458 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_flags": "0", 2024-05-08T18:07:34.458 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-05-08T18:07:34.458 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_min_size": "0", 2024-05-08T18:07:34.458 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-05-08T18:07:34.458 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_pg_num": "32", 2024-05-08T18:07:34.458 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_pgp_num": "0", 2024-05-08T18:07:34.458 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-05-08T18:07:34.458 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_read_ratio": "70", 2024-05-08T18:07:34.458 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_size": "2", 2024-05-08T18:07:34.458 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_default_type": "replicated", 2024-05-08T18:07:34.458 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-05-08T18:07:34.458 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_pool_use_gmt_hitset": "true", 2024-05-08T18:07:34.459 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_push_per_object_cost": "1000", 2024-05-08T18:07:34.459 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_read_ec_check_for_errors": "false", 2024-05-08T18:07:34.459 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recover_clone_overlap": "true", 2024-05-08T18:07:34.459 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recover_clone_overlap_limit": "10", 2024-05-08T18:07:34.459 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_cost": "20971520", 2024-05-08T18:07:34.459 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_delay_start": "0.000000", 2024-05-08T18:07:34.459 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_max_active": "0", 2024-05-08T18:07:34.459 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_max_active_hdd": "3", 2024-05-08T18:07:34.459 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_max_active_ssd": "10", 2024-05-08T18:07:34.459 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_max_chunk": "8388608", 2024-05-08T18:07:34.459 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-05-08T18:07:34.459 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_max_single_start": "1", 2024-05-08T18:07:34.459 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_op_priority": "3", 2024-05-08T18:07:34.459 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_op_warn_multiple": "16", 2024-05-08T18:07:34.459 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_priority": "5", 2024-05-08T18:07:34.460 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_retry_interval": "30.000000", 2024-05-08T18:07:34.460 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_sleep": "0.000000", 2024-05-08T18:07:34.460 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-05-08T18:07:34.460 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-05-08T18:07:34.460 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-05-08T18:07:34.460 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_repair_during_recovery": "false", 2024-05-08T18:07:34.460 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_requested_scrub_priority": "120", 2024-05-08T18:07:34.460 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-05-08T18:07:34.460 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_rollback_to_cluster_snap": "", 2024-05-08T18:07:34.460 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_auto_repair": "false", 2024-05-08T18:07:34.460 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-05-08T18:07:34.460 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-05-08T18:07:34.460 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_begin_hour": "0", 2024-05-08T18:07:34.460 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_begin_week_day": "0", 2024-05-08T18:07:34.460 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_chunk_max": "25", 2024-05-08T18:07:34.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_chunk_min": "5", 2024-05-08T18:07:34.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_cost": "52428800", 2024-05-08T18:07:34.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-05-08T18:07:34.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_during_recovery": "false", 2024-05-08T18:07:34.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_end_hour": "0", 2024-05-08T18:07:34.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_end_week_day": "0", 2024-05-08T18:07:34.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_event_cost": "4096", 2024-05-08T18:07:34.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-05-08T18:07:34.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-05-08T18:07:34.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_invalid_stats": "true", 2024-05-08T18:07:34.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_load_threshold": "0.500000", 2024-05-08T18:07:34.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_max_interval": "604800.000000", 2024-05-08T18:07:34.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_max_preemptions": "5", 2024-05-08T18:07:34.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_min_interval": "86400.000000", 2024-05-08T18:07:34.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_priority": "5", 2024-05-08T18:07:34.461 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_reservation_timeout": "300000", 2024-05-08T18:07:34.462 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_scrub_sleep": "0.000000", 2024-05-08T18:07:34.462 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-05-08T18:07:34.462 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-05-08T18:07:34.462 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_shutdown_pgref_assert": "false", 2024-05-08T18:07:34.462 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-05-08T18:07:34.462 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_skip_data_digest": "false", 2024-05-08T18:07:34.462 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_smart_report_timeout": "5", 2024-05-08T18:07:34.462 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_snap_trim_cost": "1048576", 2024-05-08T18:07:34.462 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_snap_trim_priority": "5", 2024-05-08T18:07:34.462 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_snap_trim_sleep": "0.000000", 2024-05-08T18:07:34.462 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-05-08T18:07:34.463 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-05-08T18:07:34.463 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-05-08T18:07:34.463 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-05-08T18:07:34.463 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_stats_update_period_scrubbing": "15", 2024-05-08T18:07:34.463 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-05-08T18:07:34.463 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_target_transaction_size": "30", 2024-05-08T18:07:34.463 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-05-08T18:07:34.463 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-05-08T18:07:34.463 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-05-08T18:07:34.463 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-05-08T18:07:34.463 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-05-08T18:07:34.463 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-05-08T18:07:34.463 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-05-08T18:07:34.463 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_default_cache_mode": "writeback", 2024-05-08T18:07:34.463 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-05-08T18:07:34.464 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-05-08T18:07:34.464 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_tracing": "false", 2024-05-08T18:07:34.464 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_use_stale_snap": "false", 2024-05-08T18:07:34.464 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-05-08T18:07:34.464 INFO:teuthology.orchestra.run.smithi080.stdout: "osdc_blkin_trace_all": "false", 2024-05-08T18:07:34.464 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_kill_at": "0", 2024-05-08T18:07:34.464 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_max_join_drift": "10", 2024-05-08T18:07:34.464 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_min": "500", 2024-05-08T18:07:34.464 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_min_wait": "0.050000", 2024-05-08T18:07:34.464 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_propose_interval": "1.000000", 2024-05-08T18:07:34.464 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_service_trim_max": "500", 2024-05-08T18:07:34.464 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_service_trim_max_multiplier": "20", 2024-05-08T18:07:34.465 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_service_trim_min": "250", 2024-05-08T18:07:34.465 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_stash_full_interval": "25", 2024-05-08T18:07:34.465 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_trim_max": "500", 2024-05-08T18:07:34.465 INFO:teuthology.orchestra.run.smithi080.stdout: "paxos_trim_min": "250", 2024-05-08T18:07:34.465 INFO:teuthology.orchestra.run.smithi080.stdout: "perf": "true", 2024-05-08T18:07:34.465 INFO:teuthology.orchestra.run.smithi080.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-05-08T18:07:34.465 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-05-08T18:07:34.465 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin_dir": "/usr/lib/ceph", 2024-05-08T18:07:34.465 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "-", 2024-05-08T18:07:34.465 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrv": "", 2024-05-08T18:07:34.465 INFO:teuthology.orchestra.run.smithi080.stdout: "public_bind_addr": "-", 2024-05-08T18:07:34.465 INFO:teuthology.orchestra.run.smithi080.stdout: "public_network": "", 2024-05-08T18:07:34.465 INFO:teuthology.orchestra.run.smithi080.stdout: "public_network_interface": "", 2024-05-08T18:07:34.465 INFO:teuthology.orchestra.run.smithi080.stdout: "qat_compressor_enabled": "false", 2024-05-08T18:07:34.465 INFO:teuthology.orchestra.run.smithi080.stdout: "qat_compressor_session_max_number": "256", 2024-05-08T18:07:34.465 INFO:teuthology.orchestra.run.smithi080.stdout: "rados_mon_op_timeout": "0", 2024-05-08T18:07:34.466 INFO:teuthology.orchestra.run.smithi080.stdout: "rados_osd_op_timeout": "0", 2024-05-08T18:07:34.466 INFO:teuthology.orchestra.run.smithi080.stdout: "rados_tracing": "false", 2024-05-08T18:07:34.466 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_atime_update_interval": "60", 2024-05-08T18:07:34.466 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-05-08T18:07:34.466 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_balance_parent_reads": "false", 2024-05-08T18:07:34.466 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_balance_snap_reads": "false", 2024-05-08T18:07:34.466 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_blkin_trace_all": "false", 2024-05-08T18:07:34.466 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_blocklist_expire_seconds": "0", 2024-05-08T18:07:34.466 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_blocklist_on_break_lock": "true", 2024-05-08T18:07:34.466 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache": "true", 2024-05-08T18:07:34.466 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache_block_writes_upfront": "false", 2024-05-08T18:07:34.467 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache_max_dirty": "25165824", 2024-05-08T18:07:34.467 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-05-08T18:07:34.467 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache_max_dirty_object": "0", 2024-05-08T18:07:34.467 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache_policy": "writearound", 2024-05-08T18:07:34.467 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache_size": "33554432", 2024-05-08T18:07:34.467 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache_target_dirty": "16777216", 2024-05-08T18:07:34.467 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-05-08T18:07:34.467 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_clone_copy_on_read": "false", 2024-05-08T18:07:34.467 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_compression_hint": "none", 2024-05-08T18:07:34.467 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_concurrent_management_ops": "10", 2024-05-08T18:07:34.467 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-05-08T18:07:34.467 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_clone_format": "auto", 2024-05-08T18:07:34.467 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_data_pool": "", 2024-05-08T18:07:34.467 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_features": "61", 2024-05-08T18:07:34.467 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_format": "2", 2024-05-08T18:07:34.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_map_options": "", 2024-05-08T18:07:34.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_order": "22", 2024-05-08T18:07:34.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_pool": "rbd", 2024-05-08T18:07:34.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-05-08T18:07:34.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_stripe_count": "0", 2024-05-08T18:07:34.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_default_stripe_unit": "0", 2024-05-08T18:07:34.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_disable_zero_copy_writes": "true", 2024-05-08T18:07:34.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_discard_granularity_bytes": "65536", 2024-05-08T18:07:34.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-05-08T18:07:34.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_enable_alloc_hint": "true", 2024-05-08T18:07:34.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-05-08T18:07:34.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_io_scheduler": "simple", 2024-05-08T18:07:34.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-05-08T18:07:34.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_commit_age": "5.000000", 2024-05-08T18:07:34.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-05-08T18:07:34.468 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_object_flush_interval": "0", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_order": "24", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_pool": "", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_journal_splay_width": "4", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_localize_parent_reads": "false", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_localize_snap_reads": "false", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-05-08T18:07:34.469 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_image_policy_type": "simple", 2024-05-08T18:07:34.470 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-05-08T18:07:34.470 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-05-08T18:07:34.470 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-05-08T18:07:34.470 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-05-08T18:07:34.470 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-05-08T18:07:34.470 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-05-08T18:07:34.470 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-05-08T18:07:34.470 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_memory_autotune": "true", 2024-05-08T18:07:34.470 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_memory_base": "805306368", 2024-05-08T18:07:34.470 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-05-08T18:07:34.470 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-05-08T18:07:34.470 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-05-08T18:07:34.470 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-05-08T18:07:34.471 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_memory_target": "4294967296", 2024-05-08T18:07:34.471 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-05-08T18:07:34.471 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-05-08T18:07:34.471 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-05-08T18:07:34.471 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirroring_delete_delay": "0", 2024-05-08T18:07:34.471 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-05-08T18:07:34.471 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirroring_replay_delay": "0", 2024-05-08T18:07:34.471 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-05-08T18:07:34.471 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-05-08T18:07:34.471 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_move_to_trash_on_remove": "false", 2024-05-08T18:07:34.471 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-05-08T18:07:34.471 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_mtime_update_interval": "60", 2024-05-08T18:07:34.471 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_non_blocking_aio": "true", 2024-05-08T18:07:34.471 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_op_thread_timeout": "60", 2024-05-08T18:07:34.472 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_op_threads": "1", 2024-05-08T18:07:34.472 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_parent_cache_enabled": "false", 2024-05-08T18:07:34.472 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_persistent_cache_mode": "disabled", 2024-05-08T18:07:34.472 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_persistent_cache_path": "/tmp", 2024-05-08T18:07:34.472 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_persistent_cache_size": "1073741824", 2024-05-08T18:07:34.472 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_plugins": "", 2024-05-08T18:07:34.472 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_bps_burst": "0", 2024-05-08T18:07:34.472 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-05-08T18:07:34.472 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_bps_limit": "0", 2024-05-08T18:07:34.472 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_exclude_ops": "0", 2024-05-08T18:07:34.472 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_iops_burst": "0", 2024-05-08T18:07:34.472 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-05-08T18:07:34.472 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_iops_limit": "0", 2024-05-08T18:07:34.472 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_read_bps_burst": "0", 2024-05-08T18:07:34.472 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-05-08T18:07:34.473 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_read_bps_limit": "0", 2024-05-08T18:07:34.473 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_read_iops_burst": "0", 2024-05-08T18:07:34.473 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-05-08T18:07:34.473 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_read_iops_limit": "0", 2024-05-08T18:07:34.473 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_schedule_tick_min": "50", 2024-05-08T18:07:34.473 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_write_bps_burst": "0", 2024-05-08T18:07:34.473 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-05-08T18:07:34.473 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_write_bps_limit": "0", 2024-05-08T18:07:34.473 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_write_iops_burst": "0", 2024-05-08T18:07:34.473 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-05-08T18:07:34.473 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_qos_write_iops_limit": "0", 2024-05-08T18:07:34.474 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_quiesce_notification_attempts": "10", 2024-05-08T18:07:34.474 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_read_from_replica_policy": "default", 2024-05-08T18:07:34.474 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-05-08T18:07:34.474 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_readahead_max_bytes": "524288", 2024-05-08T18:07:34.474 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_readahead_trigger_requests": "10", 2024-05-08T18:07:34.474 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_request_timed_out_seconds": "30", 2024-05-08T18:07:34.474 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_skip_partial_discard": "true", 2024-05-08T18:07:34.474 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-05-08T18:07:34.474 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_tracing": "false", 2024-05-08T18:07:34.474 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_validate_names": "true", 2024-05-08T18:07:34.474 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd_validate_pool": "true", 2024-05-08T18:07:34.474 INFO:teuthology.orchestra.run.smithi080.stdout: "restapi_base_url": "", 2024-05-08T18:07:34.474 INFO:teuthology.orchestra.run.smithi080.stdout: "restapi_log_level": "", 2024-05-08T18:07:34.474 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-05-08T18:07:34.475 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_account_default_quota_max_size": "-1", 2024-05-08T18:07:34.475 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_acl_grants_max_num": "100", 2024-05-08T18:07:34.475 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_admin_entry": "admin", 2024-05-08T18:07:34.475 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-05-08T18:07:34.475 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_backend_store": "rados", 2024-05-08T18:07:34.475 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_barbican_url": "", 2024-05-08T18:07:34.475 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_beast_enable_async": "true", 2024-05-08T18:07:34.475 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_bucket_counters_cache": "false", 2024-05-08T18:07:34.475 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-05-08T18:07:34.475 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-05-08T18:07:34.475 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-05-08T18:07:34.475 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_bucket_index_max_aio": "128", 2024-05-08T18:07:34.475 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-05-08T18:07:34.475 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-05-08T18:07:34.475 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_bucket_quota_ttl": "600", 2024-05-08T18:07:34.475 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-05-08T18:07:34.476 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_cache_enabled": "true", 2024-05-08T18:07:34.476 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_cache_expiry_interval": "900", 2024-05-08T18:07:34.476 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_cache_lru_size": "25000", 2024-05-08T18:07:34.476 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_config_store": "rados", 2024-05-08T18:07:34.476 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_content_length_compat": "false", 2024-05-08T18:07:34.476 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_copy_obj_progress": "true", 2024-05-08T18:07:34.476 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-05-08T18:07:34.476 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_cors_rules_max_num": "100", 2024-05-08T18:07:34.476 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_cross_domain_policy": "", 2024-05-08T18:07:34.476 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_default_encryption_key": "", 2024-05-08T18:07:34.476 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_kmip_addr": "", 2024-05-08T18:07:34.476 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_kmip_ca_path": "", 2024-05-08T18:07:34.476 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_kmip_client_cert": "", 2024-05-08T18:07:34.476 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_kmip_client_key": "", 2024-05-08T18:07:34.476 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-05-08T18:07:34.476 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_kmip_password": "", 2024-05-08T18:07:34.477 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-05-08T18:07:34.477 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_kmip_username": "", 2024-05-08T18:07:34.477 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_require_ssl": "true", 2024-05-08T18:07:34.477 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-05-08T18:07:34.477 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-05-08T18:07:34.477 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-05-08T18:07:34.477 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-05-08T18:07:34.477 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-05-08T18:07:34.477 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-05-08T18:07:34.477 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-05-08T18:07:34.477 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-05-08T18:07:34.477 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-05-08T18:07:34.477 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-05-08T18:07:34.478 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-05-08T18:07:34.478 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-05-08T18:07:34.478 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-05-08T18:07:34.478 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-05-08T18:07:34.478 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_suppress_logs": "true", 2024-05-08T18:07:34.478 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_addr": "", 2024-05-08T18:07:34.478 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_auth": "token", 2024-05-08T18:07:34.478 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_namespace": "", 2024-05-08T18:07:34.478 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_prefix": "", 2024-05-08T18:07:34.478 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-05-08T18:07:34.479 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-05-08T18:07:34.479 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-05-08T18:07:34.479 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-05-08T18:07:34.479 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_token_file": "", 2024-05-08T18:07:34.479 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-05-08T18:07:34.479 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_curl_buffersize": "524288", 2024-05-08T18:07:34.479 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_curl_low_speed_limit": "1024", 2024-05-08T18:07:34.479 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_curl_low_speed_time": "300", 2024-05-08T18:07:34.479 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_curl_tcp_keepalive": "0", 2024-05-08T18:07:34.479 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-05-08T18:07:34.479 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-05-08T18:07:34.479 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-05-08T18:07:34.479 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-05-08T18:07:34.479 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-05-08T18:07:34.480 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_d3n_l1_fadvise": "4", 2024-05-08T18:07:34.480 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-05-08T18:07:34.480 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-05-08T18:07:34.480 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-05-08T18:07:34.480 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_d4n_host": "127.0.0.1", 2024-05-08T18:07:34.480 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-05-08T18:07:34.480 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-05-08T18:07:34.480 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-05-08T18:07:34.480 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_d4n_l1_fadvise": "4", 2024-05-08T18:07:34.480 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-05-08T18:07:34.480 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-05-08T18:07:34.480 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_d4n_port": "6379", 2024-05-08T18:07:34.480 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-05-08T18:07:34.480 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_data_log_changes_size": "1000", 2024-05-08T18:07:34.480 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_data_log_num_shards": "128", 2024-05-08T18:07:34.480 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-05-08T18:07:34.481 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_data_log_window": "30", 2024-05-08T18:07:34.481 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_data_notify_interval_msec": "0", 2024-05-08T18:07:34.481 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_data_sync_poll_interval": "20", 2024-05-08T18:07:34.481 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_data_sync_spawn_window": "20", 2024-05-08T18:07:34.481 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-05-08T18:07:34.481 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-05-08T18:07:34.481 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-05-08T18:07:34.481 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_default_data_log_backing": "fifo", 2024-05-08T18:07:34.481 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-05-08T18:07:34.481 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_default_region_info_oid": "default.region", 2024-05-08T18:07:34.481 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-05-08T18:07:34.481 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-05-08T18:07:34.481 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_defer_to_bucket_acls": "", 2024-05-08T18:07:34.481 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-05-08T18:07:34.481 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-05-08T18:07:34.482 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-05-08T18:07:34.482 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-05-08T18:07:34.482 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-05-08T18:07:34.482 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-05-08T18:07:34.482 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-05-08T18:07:34.482 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-05-08T18:07:34.482 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_data_res": "500.000000", 2024-05-08T18:07:34.482 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-05-08T18:07:34.482 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-05-08T18:07:34.483 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-05-08T18:07:34.483 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-05-08T18:07:34.483 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dns_name": "", 2024-05-08T18:07:34.483 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dns_s3website_name": "", 2024-05-08T18:07:34.483 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_dynamic_resharding": "true", 2024-05-08T18:07:34.483 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-05-08T18:07:34.483 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enable_gc_threads": "true", 2024-05-08T18:07:34.484 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enable_lc_threads": "true", 2024-05-08T18:07:34.484 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enable_mdsearch": "true", 2024-05-08T18:07:34.484 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enable_ops_log": "false", 2024-05-08T18:07:34.484 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enable_quota_threads": "true", 2024-05-08T18:07:34.484 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enable_static_website": "false", 2024-05-08T18:07:34.484 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enable_usage_log": "false", 2024-05-08T18:07:34.484 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_enforce_swift_acls": "true", 2024-05-08T18:07:34.484 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_exit_timeout_secs": "120", 2024-05-08T18:07:34.484 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_expose_bucket": "false", 2024-05-08T18:07:34.484 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_extended_http_attrs": "", 2024-05-08T18:07:34.484 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_filter": "none", 2024-05-08T18:07:34.484 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-05-08T18:07:34.485 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_frontends": "beast port=7480", 2024-05-08T18:07:34.485 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_max_concurrent_io": "10", 2024-05-08T18:07:34.485 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_max_deferred": "50", 2024-05-08T18:07:34.485 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-05-08T18:07:34.485 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_max_objs": "32", 2024-05-08T18:07:34.485 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_max_queue_size": "134213632", 2024-05-08T18:07:34.485 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_max_trim_chunk": "16", 2024-05-08T18:07:34.485 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_obj_min_wait": "7200", 2024-05-08T18:07:34.485 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_processor_max_time": "3600", 2024-05-08T18:07:34.485 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_gc_processor_period": "3600", 2024-05-08T18:07:34.485 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-05-08T18:07:34.485 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_get_obj_window_size": "16777216", 2024-05-08T18:07:34.485 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_healthcheck_disabling_path": "", 2024-05-08T18:07:34.485 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ignore_get_invalid_range": "false", 2024-05-08T18:07:34.485 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_init_timeout": "300", 2024-05-08T18:07:34.486 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-05-08T18:07:34.486 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-05-08T18:07:34.486 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_kafka_connection_idle": "300", 2024-05-08T18:07:34.486 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_kafka_message_timeout": "5000", 2024-05-08T18:07:34.486 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_kafka_sleep_timeout": "10", 2024-05-08T18:07:34.486 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-05-08T18:07:34.486 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-05-08T18:07:34.486 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-05-08T18:07:34.486 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_admin_domain": "", 2024-05-08T18:07:34.486 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_admin_password": "", 2024-05-08T18:07:34.486 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_admin_password_path": "", 2024-05-08T18:07:34.486 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_admin_project": "", 2024-05-08T18:07:34.486 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_admin_tenant": "", 2024-05-08T18:07:34.486 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_admin_token": "", 2024-05-08T18:07:34.487 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_admin_token_path": "", 2024-05-08T18:07:34.487 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_admin_user": "", 2024-05-08T18:07:34.487 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_api_version": "2", 2024-05-08T18:07:34.487 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_barbican_domain": "", 2024-05-08T18:07:34.487 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_barbican_password": "", 2024-05-08T18:07:34.487 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_barbican_project": "", 2024-05-08T18:07:34.487 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_barbican_tenant": "", 2024-05-08T18:07:34.487 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_barbican_user": "", 2024-05-08T18:07:34.487 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-05-08T18:07:34.487 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_implicit_tenants": "false", 2024-05-08T18:07:34.487 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-05-08T18:07:34.487 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_service_token_enabled": "false", 2024-05-08T18:07:34.487 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_token_cache_size": "10000", 2024-05-08T18:07:34.487 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_url": "", 2024-05-08T18:07:34.488 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_keystone_verify_ssl": "true", 2024-05-08T18:07:34.488 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lc_debug_interval": "-1", 2024-05-08T18:07:34.488 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lc_lock_max_time": "90", 2024-05-08T18:07:34.488 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lc_max_objs": "32", 2024-05-08T18:07:34.488 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lc_max_rules": "1000", 2024-05-08T18:07:34.488 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lc_max_worker": "3", 2024-05-08T18:07:34.488 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lc_max_wp_worker": "3", 2024-05-08T18:07:34.488 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lc_thread_delay": "0", 2024-05-08T18:07:34.488 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-05-08T18:07:34.488 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ldap_dnattr": "uid", 2024-05-08T18:07:34.488 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-05-08T18:07:34.488 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ldap_searchfilter": "", 2024-05-08T18:07:34.488 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-05-08T18:07:34.489 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ldap_uri": "", 2024-05-08T18:07:34.489 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lfuda_sync_frequency": "60", 2024-05-08T18:07:34.489 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-05-08T18:07:34.489 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-05-08T18:07:34.489 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-05-08T18:07:34.489 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_local_cache_address": "127.0.0.1:6379", 2024-05-08T18:07:34.489 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_log_http_headers": "", 2024-05-08T18:07:34.489 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_log_nonexistent_bucket": "false", 2024-05-08T18:07:34.489 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-05-08T18:07:34.490 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_log_object_name_utc": "false", 2024-05-08T18:07:34.490 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-05-08T18:07:34.490 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-05-08T18:07:34.490 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_attr_name_len": "0", 2024-05-08T18:07:34.490 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_attr_size": "0", 2024-05-08T18:07:34.491 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_attrs_num_in_req": "0", 2024-05-08T18:07:34.491 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_chunk_size": "4194304", 2024-05-08T18:07:34.491 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_concurrent_requests": "1024", 2024-05-08T18:07:34.491 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-05-08T18:07:34.491 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_dynamic_shards": "1999", 2024-05-08T18:07:34.491 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_listing_results": "1000", 2024-05-08T18:07:34.492 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_notify_retries": "10", 2024-05-08T18:07:34.492 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_objs_per_shard": "100000", 2024-05-08T18:07:34.492 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_put_param_size": "1048576", 2024-05-08T18:07:34.492 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_put_size": "5368709120", 2024-05-08T18:07:34.492 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_max_slo_entries": "1000", 2024-05-08T18:07:34.492 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_md_log_max_shards": "64", 2024-05-08T18:07:34.493 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_md_notify_interval_msec": "200", 2024-05-08T18:07:34.493 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_meta_sync_poll_interval": "20", 2024-05-08T18:07:34.493 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_meta_sync_spawn_window": "20", 2024-05-08T18:07:34.493 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-05-08T18:07:34.493 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_mp_lock_max_time": "600", 2024-05-08T18:07:34.493 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-05-08T18:07:34.494 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_multipart_min_part_size": "5242880", 2024-05-08T18:07:34.494 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-05-08T18:07:34.494 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-05-08T18:07:34.494 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_fhcache_size": "2017", 2024-05-08T18:07:34.494 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-05-08T18:07:34.494 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-05-08T18:07:34.494 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_lru_lanes": "5", 2024-05-08T18:07:34.494 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_max_gc": "300", 2024-05-08T18:07:34.494 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-05-08T18:07:34.495 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_run_gc_threads": "false", 2024-05-08T18:07:34.495 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_run_lc_threads": "false", 2024-05-08T18:07:34.495 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_run_quota_threads": "false", 2024-05-08T18:07:34.495 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_run_sync_thread": "false", 2024-05-08T18:07:34.495 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-05-08T18:07:34.495 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-05-08T18:07:34.495 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_num_async_rados_threads": "32", 2024-05-08T18:07:34.495 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_num_control_oids": "8", 2024-05-08T18:07:34.495 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_numa_node": "-1", 2024-05-08T18:07:34.495 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_obj_stripe_size": "4194304", 2024-05-08T18:07:34.495 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-05-08T18:07:34.495 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_objexp_chunk_size": "100", 2024-05-08T18:07:34.495 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_objexp_gc_interval": "600", 2024-05-08T18:07:34.495 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_objexp_hints_num_shards": "127", 2024-05-08T18:07:34.495 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-05-08T18:07:34.496 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-05-08T18:07:34.496 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_op_thread_timeout": "600", 2024-05-08T18:07:34.496 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_op_tracing": "false", 2024-05-08T18:07:34.496 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_opa_token": "", 2024-05-08T18:07:34.496 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_opa_url": "", 2024-05-08T18:07:34.496 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_opa_verify_ssl": "true", 2024-05-08T18:07:34.496 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-05-08T18:07:34.496 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-05-08T18:07:34.496 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ops_log_rados": "false", 2024-05-08T18:07:34.496 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_ops_log_socket_path": "", 2024-05-08T18:07:34.496 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-05-08T18:07:34.496 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-05-08T18:07:34.496 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-05-08T18:07:34.496 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_period_push_interval": "2.000000", 2024-05-08T18:07:34.496 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_period_push_interval_max": "30.000000", 2024-05-08T18:07:34.497 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_period_root_pool": ".rgw.root", 2024-05-08T18:07:34.497 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-05-08T18:07:34.497 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-05-08T18:07:34.497 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_posix_cache_lanes": "3", 2024-05-08T18:07:34.497 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-05-08T18:07:34.497 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_posix_cache_max_buckets": "100", 2024-05-08T18:07:34.497 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_posix_cache_partitions": "3", 2024-05-08T18:07:34.497 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-05-08T18:07:34.497 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_print_continue": "true", 2024-05-08T18:07:34.497 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_print_prohibited_content_length": "false", 2024-05-08T18:07:34.497 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-05-08T18:07:34.497 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-05-08T18:07:34.497 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-05-08T18:07:34.497 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-05-08T18:07:34.497 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_rados_tracing": "false", 2024-05-08T18:07:34.498 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_realm": "", 2024-05-08T18:07:34.498 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_realm_id": "", 2024-05-08T18:07:34.498 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-05-08T18:07:34.498 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_region": "", 2024-05-08T18:07:34.498 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_region_root_pool": ".rgw.root", 2024-05-08T18:07:34.498 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_relaxed_region_enforcement": "false", 2024-05-08T18:07:34.498 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-05-08T18:07:34.498 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-05-08T18:07:34.498 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_request_uri": "", 2024-05-08T18:07:34.498 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_reshard_batch_size": "64", 2024-05-08T18:07:34.498 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-05-08T18:07:34.498 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_reshard_max_aio": "128", 2024-05-08T18:07:34.498 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_reshard_num_logs": "16", 2024-05-08T18:07:34.498 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_reshard_thread_interval": "600", 2024-05-08T18:07:34.499 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_resolve_cname": "false", 2024-05-08T18:07:34.499 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_rest_getusage_op_compat": "false", 2024-05-08T18:07:34.499 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_run_sync_thread": "true", 2024-05-08T18:07:34.499 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-05-08T18:07:34.499 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-05-08T18:07:34.499 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_s3_auth_use_keystone": "false", 2024-05-08T18:07:34.499 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_s3_auth_use_ldap": "false", 2024-05-08T18:07:34.499 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_s3_auth_use_rados": "true", 2024-05-08T18:07:34.499 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_s3_auth_use_sts": "false", 2024-05-08T18:07:34.499 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-05-08T18:07:34.499 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_s3_success_create_obj_status": "0", 2024-05-08T18:07:34.499 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-05-08T18:07:34.499 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_scheduler_type": "throttler", 2024-05-08T18:07:34.499 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_script_uri": "", 2024-05-08T18:07:34.499 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_service_provider_name": "", 2024-05-08T18:07:34.499 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-05-08T18:07:34.500 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sts_client_id": "", 2024-05-08T18:07:34.500 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sts_client_secret": "", 2024-05-08T18:07:34.500 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sts_entry": "sts", 2024-05-08T18:07:34.500 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sts_key": "sts", 2024-05-08T18:07:34.500 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sts_max_session_duration": "43200", 2024-05-08T18:07:34.500 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sts_min_session_duration": "900", 2024-05-08T18:07:34.500 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sts_token_introspection_url": "", 2024-05-08T18:07:34.500 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_account_in_url": "false", 2024-05-08T18:07:34.500 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_auth_entry": "auth", 2024-05-08T18:07:34.500 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_auth_url": "", 2024-05-08T18:07:34.500 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_custom_header": "", 2024-05-08T18:07:34.500 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_enforce_content_length": "false", 2024-05-08T18:07:34.500 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_need_stats": "true", 2024-05-08T18:07:34.500 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_tenant_name": "", 2024-05-08T18:07:34.500 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_token_expiration": "86400", 2024-05-08T18:07:34.501 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_url": "", 2024-05-08T18:07:34.501 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_url_prefix": "swift", 2024-05-08T18:07:34.501 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_swift_versioning_enabled": "false", 2024-05-08T18:07:34.501 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-05-08T18:07:34.501 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-05-08T18:07:34.501 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_lease_period": "120", 2024-05-08T18:07:34.501 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-05-08T18:07:34.501 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_log_trim_interval": "1200", 2024-05-08T18:07:34.501 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-05-08T18:07:34.501 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-05-08T18:07:34.501 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-05-08T18:07:34.501 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_obj_etag_verify": "false", 2024-05-08T18:07:34.501 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_trace_history_size": "4096", 2024-05-08T18:07:34.501 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-05-08T18:07:34.501 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-05-08T18:07:34.501 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_thread_pool_size": "512", 2024-05-08T18:07:34.502 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_topic_persistency_max_retries": "0", 2024-05-08T18:07:34.502 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-05-08T18:07:34.502 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-05-08T18:07:34.502 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_topic_require_publish_policy": "false", 2024-05-08T18:07:34.502 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_torrent_comment": "", 2024-05-08T18:07:34.502 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_torrent_createby": "", 2024-05-08T18:07:34.502 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_torrent_encoding": "", 2024-05-08T18:07:34.502 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_torrent_flag": "false", 2024-05-08T18:07:34.502 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_torrent_max_size": "5368709120", 2024-05-08T18:07:34.502 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_torrent_origin": "", 2024-05-08T18:07:34.502 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_torrent_sha_unit": "524288", 2024-05-08T18:07:34.502 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_torrent_tracker": "", 2024-05-08T18:07:34.502 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_trust_forwarded_https": "false", 2024-05-08T18:07:34.502 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-05-08T18:07:34.502 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_usage_log_tick_interval": "30", 2024-05-08T18:07:34.502 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_usage_max_shards": "32", 2024-05-08T18:07:34.503 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_usage_max_user_shards": "1", 2024-05-08T18:07:34.503 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_use_opa_authz": "false", 2024-05-08T18:07:34.503 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_counters_cache": "false", 2024-05-08T18:07:34.503 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_counters_cache_size": "10000", 2024-05-08T18:07:34.503 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-05-08T18:07:34.503 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_default_quota_max_size": "-1", 2024-05-08T18:07:34.503 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_max_buckets": "1000", 2024-05-08T18:07:34.503 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_policies_max_num": "100", 2024-05-08T18:07:34.503 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-05-08T18:07:34.503 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-05-08T18:07:34.503 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_quota_sync_interval": "86400", 2024-05-08T18:07:34.503 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-05-08T18:07:34.503 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_user_unique_email": "true", 2024-05-08T18:07:34.504 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_verify_ssl": "true", 2024-05-08T18:07:34.504 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_website_routing_rules_max_num": "50", 2024-05-08T18:07:34.504 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_zone": "", 2024-05-08T18:07:34.504 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_zone_id": "", 2024-05-08T18:07:34.504 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-05-08T18:07:34.504 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_zonegroup": "", 2024-05-08T18:07:34.504 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_zonegroup_id": "", 2024-05-08T18:07:34.504 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-05-08T18:07:34.504 INFO:teuthology.orchestra.run.smithi080.stdout: "rgwlc_auto_session_clear": "true", 2024-05-08T18:07:34.504 INFO:teuthology.orchestra.run.smithi080.stdout: "rgwlc_skip_bucket_step": "false", 2024-05-08T18:07:34.504 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_block_size": "4096", 2024-05-08T18:07:34.504 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-05-08T18:07:34.504 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-05-08T18:07:34.504 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-05-08T18:07:34.504 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-05-08T18:07:34.505 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cache_shard_bits": "4", 2024-05-08T18:07:34.505 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cache_size": "536870912", 2024-05-08T18:07:34.505 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cache_type": "binned_lru", 2024-05-08T18:07:34.505 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-05-08T18:07:34.505 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-05-08T18:07:34.505 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-05-08T18:07:34.505 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_collect_compaction_stats": "false", 2024-05-08T18:07:34.505 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_collect_extended_stats": "false", 2024-05-08T18:07:34.505 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_collect_memory_stats": "false", 2024-05-08T18:07:34.505 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-05-08T18:07:34.505 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_index_type": "binary_search", 2024-05-08T18:07:34.505 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_log_to_ceph_log": "true", 2024-05-08T18:07:34.505 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_metadata_block_size": "4096", 2024-05-08T18:07:34.505 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_partition_filters": "false", 2024-05-08T18:07:34.506 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_perf": "false", 2024-05-08T18:07:34.506 INFO:teuthology.orchestra.run.smithi080.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-05-08T18:07:34.506 INFO:teuthology.orchestra.run.smithi080.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-05-08T18:07:34.506 INFO:teuthology.orchestra.run.smithi080.stdout: "rotating_keys_renewal_timeout": "10", 2024-05-08T18:07:34.506 INFO:teuthology.orchestra.run.smithi080.stdout: "run_dir": "/var/run/ceph", 2024-05-08T18:07:34.506 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_block_create": "true", 2024-05-08T18:07:34.506 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_cache_lru_size": "67108864", 2024-05-08T18:07:34.506 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_cbjournal_size": "5368709120", 2024-05-08T18:07:34.506 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_data_delta_based_overwrite": "0", 2024-05-08T18:07:34.506 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_default_max_object_size": "16777216", 2024-05-08T18:07:34.506 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-05-08T18:07:34.506 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_device_size": "53687091200", 2024-05-08T18:07:34.506 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_full_integrity_check": "false", 2024-05-08T18:07:34.507 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_journal_batch_capacity": "16", 2024-05-08T18:07:34.507 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-05-08T18:07:34.507 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-05-08T18:07:34.507 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_journal_iodepth_limit": "5", 2024-05-08T18:07:34.507 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_main_device_type": "SSD", 2024-05-08T18:07:34.507 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_max_concurrent_transactions": "8", 2024-05-08T18:07:34.507 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_max_data_allocation_size": "32768", 2024-05-08T18:07:34.507 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-05-08T18:07:34.507 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-05-08T18:07:34.507 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-05-08T18:07:34.507 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-05-08T18:07:34.507 INFO:teuthology.orchestra.run.smithi080.stdout: "seastore_segment_size": "67108864", 2024-05-08T18:07:34.507 INFO:teuthology.orchestra.run.smithi080.stdout: "set_keepcaps": "false", 2024-05-08T18:07:34.507 INFO:teuthology.orchestra.run.smithi080.stdout: "setgroup": "", 2024-05-08T18:07:34.507 INFO:teuthology.orchestra.run.smithi080.stdout: "setuser": "", 2024-05-08T18:07:34.507 INFO:teuthology.orchestra.run.smithi080.stdout: "setuser_match_path": "", 2024-05-08T18:07:34.508 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_misplaced_ratio": "0.050000", 2024-05-08T18:07:34.508 INFO:teuthology.orchestra.run.smithi080.stdout: "thp": "false", 2024-05-08T18:07:34.508 INFO:teuthology.orchestra.run.smithi080.stdout: "threadpool_default_timeout": "60", 2024-05-08T18:07:34.508 INFO:teuthology.orchestra.run.smithi080.stdout: "threadpool_empty_queue_max_wait": "2", 2024-05-08T18:07:34.508 INFO:teuthology.orchestra.run.smithi080.stdout: "throttler_perf_counter": "true" 2024-05-08T18:07:34.508 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:34.510 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-05-08T18:07:34.647 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a: {} 2024-05-08T18:07:34.647 INFO:teuthology.orchestra.run.smithi080.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-08T18:07:34.660 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b: {} 2024-05-08T18:07:34.660 INFO:teuthology.orchestra.run.smithi080.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-08T18:07:34.669 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c: {} 2024-05-08T18:07:34.669 INFO:teuthology.orchestra.run.smithi080.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-08T18:07:34.684 DEBUG:teuthology.orchestra.run.smithi080:> type ceph-objectstore-tool 2024-05-08T18:07:34.688 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-05-08T18:07:34.689 DEBUG:teuthology.orchestra.run.smithi115:> type ceph-objectstore-tool 2024-05-08T18:07:34.695 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-05-08T18:07:34.695 INFO:teuthology.run_tasks:Running task workunit... 2024-05-08T18:07:34.707 INFO:tasks.workunit:Pulling workunits from ref 27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:07:34.707 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-08T18:07:34.708 DEBUG:teuthology.orchestra.run.smithi080:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-08T18:07:34.708 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-05-08T18:07:34.708 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-08T18:07:34.708 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-08T18:07:34.708 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-05-08T18:07:34.709 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-05-08T18:07:34.709 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:07:34.709 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-05-08T18:07:34.709 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:07:34.710 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-05-08T18:07:34.710 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:07:34.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:07:34.736 INFO:teuthology.orchestra.run.smithi080.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-05-08T18:07:34.736 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-05-08T18:07:34.739 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:34.740+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:34.783 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-05-08T18:07:34.784 DEBUG:teuthology.orchestra.run.smithi080:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-05-08T18:07:34.810 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:34.812+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:34.835 INFO:tasks.workunit:timeout=3h 2024-05-08T18:07:34.835 INFO:tasks.workunit:cleanup=True 2024-05-08T18:07:34.836 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:07:34.851 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:34.851 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:34.851 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:34.851 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:34.855 INFO:tasks.workunit.client.0.smithi080.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-08T18:07:34.868 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:07:34.869 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:07:34.870 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:07:34.900 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:07:34.900 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:07:34.910 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:34.909+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:34.917 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:07:34.917 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:07:34.934 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:07:34.934 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:07:34.954 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:07:34.955 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:07:34.982 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:34.982 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:34.988 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:07:34.988 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:07:34.996 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:07:35.011 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:07:35.011 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:07:35.011 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:35.012+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:35.032 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:07:35.032 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:07:35.112 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:35.113+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:35.131 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:35.131 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:35.143 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:07:35.157 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-05-08T18:07:35.157 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.0 to 1 (10000) 2024-05-08T18:07:35.184 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-08T18:07:35.214 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:35.212+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:35.281 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:35.281 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:35.296 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:07:35.343 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:35.345+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:35.413 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:35.413 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:35.416 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:35.417+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:35.426 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:07:35.516 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:35.517+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:35.582 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:35.582 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:35.595 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:07:35.617 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:35.616+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:35.718 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:35.716+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:35.753 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:35.753 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:35.767 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:07:35.819 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:35.820+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:35.886 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:35.886 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:35.900 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:07:35.920 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:07:35.920+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:07:36.021 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:36.021+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:36.022 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:36.022 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:36.036 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:07:36.123 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:36.125+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:36.165 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.1 to 1 (10000) 2024-05-08T18:07:36.187 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-08T18:07:36.208 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:36.208 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:36.223 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:07:36.224 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:36.224+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:36.324 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:36.324+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:36.420 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:36.420 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:36.425 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:36.424+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:36.434 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:07:36.526 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:36.525+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:36.552 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:36.552 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:36.565 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:07:36.626 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:07:36.624+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:07:36.699 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:36.699 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:36.713 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:07:36.755 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:36.756+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:36.828 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:36.833+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:36.875 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:36.875 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:36.890 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:07:36.929 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:36.929+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:37.008 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:37.008 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:37.023 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:07:37.056 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:07:37.067 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:37.068+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:37.131 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:37.133+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:37.147 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:37.147 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:37.161 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:07:37.185 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:07:37.186 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.2 to 1 (10000) 2024-05-08T18:07:37.207 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-08T18:07:37.213 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:07:37.214 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:07:37.230 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:07:37.230 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:07:37.246 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:07:37.246 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:07:37.247 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:37.248+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:37.262 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:07:37.262 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:07:37.281 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:07:37.281 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:07:37.300 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:07:37.300 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:07:37.321 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:07:37.322 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:07:37.325 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:07:37.325 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:07:37.326 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:07:37.326 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:07:37.326 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:07:37.333 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:37.333+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:37.340 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:07:37.349 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:07:37.349 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:07:37.435 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:37.432+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:37.504 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:07:37.504 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:07:37.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:07:37.504 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:07:37.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.504 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:3 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:07:37.504 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:07:37.504 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 17.968386166999998, 2024-05-08T18:07:37.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046964590000000001, 2024-05-08T18:07:37.505 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.505 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.505 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:07:37.505 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:37.505 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:07:37.505 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:07:37.505 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 3 2024-05-08T18:07:37.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.505 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:07:37.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:07:37.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534906+0000", 2024-05-08T18:07:37.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1030000000000002e-06 2024-05-08T18:07:37.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534918+0000", 2024-05-08T18:07:37.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1732999999999999e-05 2024-05-08T18:07:37.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534950+0000", 2024-05-08T18:07:37.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1420000000000001e-05 2024-05-08T18:07:37.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534974+0000", 2024-05-08T18:07:37.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4473000000000001e-05 2024-05-08T18:07:37.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.539338+0000", 2024-05-08T18:07:37.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043636719999999999 2024-05-08T18:07:37.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.539600+0000", 2024-05-08T18:07:37.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026205800000000002 2024-05-08T18:07:37.508 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.508 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.508 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.508 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:37.508 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:07:37.508 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.935312503, 2024-05-08T18:07:37.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054299370000000001, 2024-05-08T18:07:37.508 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.508 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.508 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.508 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:37.508 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:37.509 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:37.509 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 48 2024-05-08T18:07:37.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.509 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:07:37.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:07:37.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567980+0000", 2024-05-08T18:07:37.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.554e-06 2024-05-08T18:07:37.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567990+0000", 2024-05-08T18:07:37.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0961999999999999e-05 2024-05-08T18:07:37.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568023+0000", 2024-05-08T18:07:37.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441999999999999e-05 2024-05-08T18:07:37.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568042+0000", 2024-05-08T18:07:37.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8760999999999999e-05 2024-05-08T18:07:37.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568165+0000", 2024-05-08T18:07:37.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012333400000000001 2024-05-08T18:07:37.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568426+0000", 2024-05-08T18:07:37.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026132999999999999 2024-05-08T18:07:37.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:07:37.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568666+0000", 2024-05-08T18:07:37.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024009500000000001 2024-05-08T18:07:37.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:37.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.569886+0000", 2024-05-08T18:07:37.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012194790000000001 2024-05-08T18:07:37.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:37.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573254+0000", 2024-05-08T18:07:37.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033677109999999998 2024-05-08T18:07:37.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573339+0000", 2024-05-08T18:07:37.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5666000000000003e-05 2024-05-08T18:07:37.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573407+0000", 2024-05-08T18:07:37.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7602999999999996e-05 2024-05-08T18:07:37.513 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.513 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.513 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.514 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94206896343168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:37.514 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:07:37.514 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.929632341, 2024-05-08T18:07:37.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054113640000000001, 2024-05-08T18:07:37.514 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.514 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.514 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.514 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:37.514 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:37.514 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:37.514 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 49 2024-05-08T18:07:37.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.515 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:07:37.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:07:37.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573659+0000", 2024-05-08T18:07:37.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.762e-06 2024-05-08T18:07:37.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573667+0000", 2024-05-08T18:07:37.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8120000000000008e-06 2024-05-08T18:07:37.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573693+0000", 2024-05-08T18:07:37.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6057000000000001e-05 2024-05-08T18:07:37.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573710+0000", 2024-05-08T18:07:37.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7555999999999999e-05 2024-05-08T18:07:37.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573851+0000", 2024-05-08T18:07:37.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014109800000000001 2024-05-08T18:07:37.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.574072+0000", 2024-05-08T18:07:37.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022062899999999999 2024-05-08T18:07:37.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:07:37.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.574500+0000", 2024-05-08T18:07:37.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042798100000000002 2024-05-08T18:07:37.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:37.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.575719+0000", 2024-05-08T18:07:37.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001218717 2024-05-08T18:07:37.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:37.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578840+0000", 2024-05-08T18:07:37.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031215380000000001 2024-05-08T18:07:37.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578925+0000", 2024-05-08T18:07:37.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5191999999999993e-05 2024-05-08T18:07:37.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579069+0000", 2024-05-08T18:07:37.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143022 2024-05-08T18:07:37.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.519 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.519 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:07:37.519 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:07:37.519 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.926844362000001, 2024-05-08T18:07:37.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034814389999999998, 2024-05-08T18:07:37.520 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.520 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.520 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.520 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:37.520 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:37.520 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:37.520 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 205 2024-05-08T18:07:37.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.520 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:07:37.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:07:37.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576448+0000", 2024-05-08T18:07:37.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7839999999999999e-06 2024-05-08T18:07:37.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576462+0000", 2024-05-08T18:07:37.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4348999999999999e-05 2024-05-08T18:07:37.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576500+0000", 2024-05-08T18:07:37.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7252999999999997e-05 2024-05-08T18:07:37.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576528+0000", 2024-05-08T18:07:37.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8691e-05 2024-05-08T18:07:37.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576686+0000", 2024-05-08T18:07:37.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015810999999999999 2024-05-08T18:07:37.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576927+0000", 2024-05-08T18:07:37.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000240337 2024-05-08T18:07:37.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:07:37.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.577354+0000", 2024-05-08T18:07:37.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042767499999999997 2024-05-08T18:07:37.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:37.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.578866+0000", 2024-05-08T18:07:37.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001511271 2024-05-08T18:07:37.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:37.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579762+0000", 2024-05-08T18:07:37.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089618599999999999 2024-05-08T18:07:37.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579858+0000", 2024-05-08T18:07:37.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6686000000000002e-05 2024-05-08T18:07:37.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579927+0000", 2024-05-08T18:07:37.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8096999999999995e-05 2024-05-08T18:07:37.525 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.525 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.525 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.525 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:37.525 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:07:37.525 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.858848522000001, 2024-05-08T18:07:37.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035139590000000001, 2024-05-08T18:07:37.525 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.525 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.525 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.526 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:37.526 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:37.526 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:37.526 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 220 2024-05-08T18:07:37.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.526 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:07:37.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:07:37.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644444+0000", 2024-05-08T18:07:37.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6759999999999999e-06 2024-05-08T18:07:37.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644455+0000", 2024-05-08T18:07:37.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:07:37.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644487+0000", 2024-05-08T18:07:37.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2199999999999997e-05 2024-05-08T18:07:37.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644503+0000", 2024-05-08T18:07:37.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5452e-05 2024-05-08T18:07:37.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644689+0000", 2024-05-08T18:07:37.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000186541 2024-05-08T18:07:37.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644902+0000", 2024-05-08T18:07:37.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021321299999999999 2024-05-08T18:07:37.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.645299+0000", 2024-05-08T18:07:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039702699999999999 2024-05-08T18:07:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647459+0000", 2024-05-08T18:07:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021598279999999999 2024-05-08T18:07:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647803+0000", 2024-05-08T18:07:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034338199999999999 2024-05-08T18:07:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647888+0000", 2024-05-08T18:07:37.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5125999999999998e-05 2024-05-08T18:07:37.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647955+0000", 2024-05-08T18:07:37.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7280999999999995e-05 2024-05-08T18:07:37.530 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.530 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.530 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.530 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:37.531 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:07:37.531 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.838984003, 2024-05-08T18:07:37.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003220367, 2024-05-08T18:07:37.531 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.531 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.531 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.531 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:37.531 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:37.531 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:37.531 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 225 2024-05-08T18:07:37.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.531 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:07:37.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:07:37.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664308+0000", 2024-05-08T18:07:37.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:07:37.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664333+0000", 2024-05-08T18:07:37.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5361e-05 2024-05-08T18:07:37.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664362+0000", 2024-05-08T18:07:37.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8671999999999999e-05 2024-05-08T18:07:37.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664376+0000", 2024-05-08T18:07:37.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4741e-05 2024-05-08T18:07:37.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664541+0000", 2024-05-08T18:07:37.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016484400000000001 2024-05-08T18:07:37.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664767+0000", 2024-05-08T18:07:37.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000226061 2024-05-08T18:07:37.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:37.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.665199+0000", 2024-05-08T18:07:37.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000431674 2024-05-08T18:07:37.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:37.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.666428+0000", 2024-05-08T18:07:37.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001228605 2024-05-08T18:07:37.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:37.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667367+0000", 2024-05-08T18:07:37.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093924199999999996 2024-05-08T18:07:37.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667461+0000", 2024-05-08T18:07:37.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3762000000000001e-05 2024-05-08T18:07:37.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667526+0000", 2024-05-08T18:07:37.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5254999999999998e-05 2024-05-08T18:07:37.536 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.536 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.536 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.536 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:37.536 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:07:37.536 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.806756504999999, 2024-05-08T18:07:37.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037451559999999999, 2024-05-08T18:07:37.536 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.536 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.536 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.536 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:37.536 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:37.537 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:37.537 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 234 2024-05-08T18:07:37.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.537 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:07:37.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:07:37.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696535+0000", 2024-05-08T18:07:37.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0760000000000001e-06 2024-05-08T18:07:37.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696546+0000", 2024-05-08T18:07:37.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0556e-05 2024-05-08T18:07:37.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696577+0000", 2024-05-08T18:07:37.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0904000000000001e-05 2024-05-08T18:07:37.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696592+0000", 2024-05-08T18:07:37.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5316e-05 2024-05-08T18:07:37.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696731+0000", 2024-05-08T18:07:37.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138818 2024-05-08T18:07:37.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.697085+0000", 2024-05-08T18:07:37.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00035397800000000002 2024-05-08T18:07:37.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:37.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.697838+0000", 2024-05-08T18:07:37.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00075314800000000003 2024-05-08T18:07:37.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:37.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.699440+0000", 2024-05-08T18:07:37.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016023470000000001 2024-05-08T18:07:37.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:37.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700067+0000", 2024-05-08T18:07:37.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062698400000000003 2024-05-08T18:07:37.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700161+0000", 2024-05-08T18:07:37.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3762000000000001e-05 2024-05-08T18:07:37.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700278+0000", 2024-05-08T18:07:37.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117267 2024-05-08T18:07:37.541 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.541 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.542 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.542 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:431 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:37.542 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:07:37.542 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.741264492999999, 2024-05-08T18:07:37.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040957049999999998, 2024-05-08T18:07:37.542 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.542 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.542 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.542 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:37.542 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:37.542 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:37.542 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 431 2024-05-08T18:07:37.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.543 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:07:37.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:07:37.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762027+0000", 2024-05-08T18:07:37.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7889999999999999e-06 2024-05-08T18:07:37.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762036+0000", 2024-05-08T18:07:37.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6029999999999994e-06 2024-05-08T18:07:37.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762061+0000", 2024-05-08T18:07:37.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4831e-05 2024-05-08T18:07:37.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762076+0000", 2024-05-08T18:07:37.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4996e-05 2024-05-08T18:07:37.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.763559+0000", 2024-05-08T18:07:37.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001482501 2024-05-08T18:07:37.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.763747+0000", 2024-05-08T18:07:37.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018864399999999999 2024-05-08T18:07:37.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:37.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.764172+0000", 2024-05-08T18:07:37.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042445900000000002 2024-05-08T18:07:37.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:37.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.765292+0000", 2024-05-08T18:07:37.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001120196 2024-05-08T18:07:37.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:37.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.765812+0000", 2024-05-08T18:07:37.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052044000000000005 2024-05-08T18:07:37.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.766007+0000", 2024-05-08T18:07:37.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019423500000000001 2024-05-08T18:07:37.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.766121+0000", 2024-05-08T18:07:37.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114011 2024-05-08T18:07:37.547 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.547 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.547 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.547 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:37.547 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:07:37.547 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.734607022, 2024-05-08T18:07:37.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031982880000000001, 2024-05-08T18:07:37.547 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.548 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.548 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.548 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:37.548 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:37.548 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:37.548 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 438 2024-05-08T18:07:37.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.548 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:07:37.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:07:37.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768684+0000", 2024-05-08T18:07:37.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0049999999999999e-06 2024-05-08T18:07:37.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768697+0000", 2024-05-08T18:07:37.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2211e-05 2024-05-08T18:07:37.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768726+0000", 2024-05-08T18:07:37.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8949e-05 2024-05-08T18:07:37.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768743+0000", 2024-05-08T18:07:37.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7478000000000001e-05 2024-05-08T18:07:37.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768852+0000", 2024-05-08T18:07:37.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010889499999999999 2024-05-08T18:07:37.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.769168+0000", 2024-05-08T18:07:37.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031610900000000002 2024-05-08T18:07:37.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:37.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.769542+0000", 2024-05-08T18:07:37.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037368299999999998 2024-05-08T18:07:37.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:37.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.770721+0000", 2024-05-08T18:07:37.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001179591 2024-05-08T18:07:37.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:37.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771722+0000", 2024-05-08T18:07:37.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001000463 2024-05-08T18:07:37.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771819+0000", 2024-05-08T18:07:37.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6909000000000003e-05 2024-05-08T18:07:37.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771881+0000", 2024-05-08T18:07:37.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1995000000000005e-05 2024-05-08T18:07:37.552 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.552 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.552 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.552 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:477 6.4 e32/26 6:24c8e1ae:gc::gc.19:head v 32'12, mlcod=32'10)", 2024-05-08T18:07:37.552 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:07:37.553 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.712511994, 2024-05-08T18:07:37.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038511489999999999, 2024-05-08T18:07:37.553 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.553 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.553 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.553 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:07:37.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:07:37.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790779+0000", 2024-05-08T18:07:37.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4559999999999999e-06 2024-05-08T18:07:37.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790791+0000", 2024-05-08T18:07:37.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1780000000000001e-05 2024-05-08T18:07:37.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790817+0000", 2024-05-08T18:07:37.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5874999999999999e-05 2024-05-08T18:07:37.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790832+0000", 2024-05-08T18:07:37.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4909000000000001e-05 2024-05-08T18:07:37.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790959+0000", 2024-05-08T18:07:37.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012728199999999999 2024-05-08T18:07:37.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791007+0000", 2024-05-08T18:07:37.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7766000000000003e-05 2024-05-08T18:07:37.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794549+0000", 2024-05-08T18:07:37.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035422959999999999 2024-05-08T18:07:37.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794629+0000", 2024-05-08T18:07:37.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9784999999999996e-05 2024-05-08T18:07:37.556 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.556 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.556 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.557 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:487 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:37.557 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:07:37.557 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.707174746, 2024-05-08T18:07:37.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046865559999999997, 2024-05-08T18:07:37.557 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.557 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.557 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.557 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:37.557 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:37.557 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:37.557 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 487 2024-05-08T18:07:37.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.557 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:07:37.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:07:37.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796116+0000", 2024-05-08T18:07:37.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5650000000000001e-06 2024-05-08T18:07:37.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796124+0000", 2024-05-08T18:07:37.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6909999999999997e-06 2024-05-08T18:07:37.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796143+0000", 2024-05-08T18:07:37.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9483999999999998e-05 2024-05-08T18:07:37.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796154+0000", 2024-05-08T18:07:37.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0416e-05 2024-05-08T18:07:37.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796266+0000", 2024-05-08T18:07:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112011 2024-05-08T18:07:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796432+0000", 2024-05-08T18:07:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016641799999999999 2024-05-08T18:07:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:07:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796718+0000", 2024-05-08T18:07:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028548000000000001 2024-05-08T18:07:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798117+0000", 2024-05-08T18:07:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001399151 2024-05-08T18:07:37.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:37.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800656+0000", 2024-05-08T18:07:37.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025392689999999998 2024-05-08T18:07:37.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800733+0000", 2024-05-08T18:07:37.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6508000000000007e-05 2024-05-08T18:07:37.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800801+0000", 2024-05-08T18:07:37.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8563000000000001e-05 2024-05-08T18:07:37.561 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.562 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.562 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.562 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:489 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:37.562 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:07:37.562 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.705228247999999, 2024-05-08T18:07:37.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058220679999999997, 2024-05-08T18:07:37.562 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.562 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.562 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.562 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:37.562 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:37.562 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:37.562 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 489 2024-05-08T18:07:37.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.563 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:07:37.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:07:37.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798064+0000", 2024-05-08T18:07:37.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:07:37.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798074+0000", 2024-05-08T18:07:37.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0438999999999999e-05 2024-05-08T18:07:37.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798097+0000", 2024-05-08T18:07:37.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3019000000000001e-05 2024-05-08T18:07:37.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798115+0000", 2024-05-08T18:07:37.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7638e-05 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798230+0000", 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115375 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798395+0000", 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016542099999999999 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798633+0000", 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000237977 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:37.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.799628+0000", 2024-05-08T18:07:37.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00099459099999999996 2024-05-08T18:07:37.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:37.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803706+0000", 2024-05-08T18:07:37.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040776199999999997 2024-05-08T18:07:37.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803796+0000", 2024-05-08T18:07:37.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0704000000000004e-05 2024-05-08T18:07:37.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803883+0000", 2024-05-08T18:07:37.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6923999999999996e-05 2024-05-08T18:07:37.567 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.567 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.567 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.567 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:491 6.10 e32/26 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 32'1, mlcod=0'0)", 2024-05-08T18:07:37.567 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:07:37.567 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.702004789, 2024-05-08T18:07:37.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052480360000000002, 2024-05-08T18:07:37.567 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.567 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.567 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.567 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:07:37.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:07:37.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801286+0000", 2024-05-08T18:07:37.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.085e-06 2024-05-08T18:07:37.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801293+0000", 2024-05-08T18:07:37.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.627e-06 2024-05-08T18:07:37.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801311+0000", 2024-05-08T18:07:37.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-05-08T18:07:37.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801320+0000", 2024-05-08T18:07:37.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5710000000000004e-06 2024-05-08T18:07:37.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801401+0000", 2024-05-08T18:07:37.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0798999999999997e-05 2024-05-08T18:07:37.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801439+0000", 2024-05-08T18:07:37.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7994000000000002e-05 2024-05-08T18:07:37.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806447+0000", 2024-05-08T18:07:37.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050077339999999998 2024-05-08T18:07:37.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806533+0000", 2024-05-08T18:07:37.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.577e-05 2024-05-08T18:07:37.571 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.571 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.571 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.571 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:495 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'2, mlcod=0'0)", 2024-05-08T18:07:37.572 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:07:37.572 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.698467898000001, 2024-05-08T18:07:37.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045481219999999999, 2024-05-08T18:07:37.572 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.572 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.572 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.572 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:07:37.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:07:37.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804823+0000", 2024-05-08T18:07:37.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.42e-06 2024-05-08T18:07:37.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804834+0000", 2024-05-08T18:07:37.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0584999999999999e-05 2024-05-08T18:07:37.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804848+0000", 2024-05-08T18:07:37.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:07:37.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804857+0000", 2024-05-08T18:07:37.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.302e-06 2024-05-08T18:07:37.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804967+0000", 2024-05-08T18:07:37.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109543 2024-05-08T18:07:37.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805018+0000", 2024-05-08T18:07:37.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0924000000000002e-05 2024-05-08T18:07:37.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809281+0000", 2024-05-08T18:07:37.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042631479999999996 2024-05-08T18:07:37.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809370+0000", 2024-05-08T18:07:37.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8787000000000002e-05 2024-05-08T18:07:37.576 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.576 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.576 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.576 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:500 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:37.576 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:07:37.576 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.696909484000001, 2024-05-08T18:07:37.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061595829999999997, 2024-05-08T18:07:37.576 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.576 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.576 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.576 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 500 2024-05-08T18:07:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:07:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:07:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806382+0000", 2024-05-08T18:07:37.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2709999999999999e-06 2024-05-08T18:07:37.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806395+0000", 2024-05-08T18:07:37.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2782000000000001e-05 2024-05-08T18:07:37.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806419+0000", 2024-05-08T18:07:37.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3841000000000001e-05 2024-05-08T18:07:37.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806437+0000", 2024-05-08T18:07:37.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8318999999999999e-05 2024-05-08T18:07:37.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806554+0000", 2024-05-08T18:07:37.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116507 2024-05-08T18:07:37.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806732+0000", 2024-05-08T18:07:37.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017828200000000001 2024-05-08T18:07:37.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806986+0000", 2024-05-08T18:07:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431100000000001 2024-05-08T18:07:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.808032+0000", 2024-05-08T18:07:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010455530000000001 2024-05-08T18:07:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812373+0000", 2024-05-08T18:07:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043410139999999998 2024-05-08T18:07:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812485+0000", 2024-05-08T18:07:37.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011234999999999999 2024-05-08T18:07:37.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812540+0000", 2024-05-08T18:07:37.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4353e-05 2024-05-08T18:07:37.581 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.581 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.581 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.581 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:502 6.10 e32/26 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 32'2, mlcod=0'0)", 2024-05-08T18:07:37.581 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:07:37.581 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.695735880999999, 2024-05-08T18:07:37.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049263659999999997, 2024-05-08T18:07:37.582 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.582 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.582 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.582 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:07:37.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:07:37.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807555+0000", 2024-05-08T18:07:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2079999999999999e-06 2024-05-08T18:07:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807563+0000", 2024-05-08T18:07:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3280000000000006e-06 2024-05-08T18:07:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807585+0000", 2024-05-08T18:07:37.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2361000000000002e-05 2024-05-08T18:07:37.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807596+0000", 2024-05-08T18:07:37.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0968000000000001e-05 2024-05-08T18:07:37.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807700+0000", 2024-05-08T18:07:37.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103232 2024-05-08T18:07:37.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807732+0000", 2024-05-08T18:07:37.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2373999999999999e-05 2024-05-08T18:07:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812391+0000", 2024-05-08T18:07:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046590140000000004 2024-05-08T18:07:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812480+0000", 2024-05-08T18:07:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8881000000000005e-05 2024-05-08T18:07:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.585 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:504 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'3, mlcod=32'1)", 2024-05-08T18:07:37.586 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:07:37.586 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.692063076, 2024-05-08T18:07:37.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389472, 2024-05-08T18:07:37.586 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.586 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.586 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.586 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:07:37.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:07:37.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811228+0000", 2024-05-08T18:07:37.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8819999999999999e-06 2024-05-08T18:07:37.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811240+0000", 2024-05-08T18:07:37.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1276e-05 2024-05-08T18:07:37.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811266+0000", 2024-05-08T18:07:37.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.601e-05 2024-05-08T18:07:37.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811283+0000", 2024-05-08T18:07:37.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7473e-05 2024-05-08T18:07:37.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811444+0000", 2024-05-08T18:07:37.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000161249 2024-05-08T18:07:37.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811501+0000", 2024-05-08T18:07:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6394999999999998e-05 2024-05-08T18:07:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815025+0000", 2024-05-08T18:07:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003524335 2024-05-08T18:07:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815121+0000", 2024-05-08T18:07:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6100000000000005e-05 2024-05-08T18:07:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.589 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.590 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.590 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:505 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:37.590 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:07:37.590 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.690433780999999, 2024-05-08T18:07:37.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007675075, 2024-05-08T18:07:37.590 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.590 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.590 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.590 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:37.590 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:37.590 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:37.591 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 505 2024-05-08T18:07:37.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.591 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:07:37.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:07:37.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812857+0000", 2024-05-08T18:07:37.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.621e-06 2024-05-08T18:07:37.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812865+0000", 2024-05-08T18:07:37.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0600000000000008e-06 2024-05-08T18:07:37.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812889+0000", 2024-05-08T18:07:37.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3569000000000001e-05 2024-05-08T18:07:37.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812901+0000", 2024-05-08T18:07:37.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1610000000000001e-05 2024-05-08T18:07:37.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813025+0000", 2024-05-08T18:07:37.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012430399999999999 2024-05-08T18:07:37.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813168+0000", 2024-05-08T18:07:37.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014329699999999999 2024-05-08T18:07:37.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:37.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813419+0000", 2024-05-08T18:07:37.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000250788 2024-05-08T18:07:37.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:37.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815462+0000", 2024-05-08T18:07:37.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002042865 2024-05-08T18:07:37.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:37.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820385+0000", 2024-05-08T18:07:37.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049229529999999999 2024-05-08T18:07:37.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820462+0000", 2024-05-08T18:07:37.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7101000000000006e-05 2024-05-08T18:07:37.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820531+0000", 2024-05-08T18:07:37.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8906999999999996e-05 2024-05-08T18:07:37.595 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.595 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.595 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.595 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:506 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'4, mlcod=32'2)", 2024-05-08T18:07:37.595 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:07:37.595 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.689210938, 2024-05-08T18:07:37.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006383143, 2024-05-08T18:07:37.596 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.596 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.596 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.596 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:07:37.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:07:37.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814081+0000", 2024-05-08T18:07:37.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0080000000000001e-06 2024-05-08T18:07:37.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814094+0000", 2024-05-08T18:07:37.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3407999999999999e-05 2024-05-08T18:07:37.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814125+0000", 2024-05-08T18:07:37.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0688999999999997e-05 2024-05-08T18:07:37.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814142+0000", 2024-05-08T18:07:37.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7192000000000001e-05 2024-05-08T18:07:37.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814245+0000", 2024-05-08T18:07:37.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103164 2024-05-08T18:07:37.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814302+0000", 2024-05-08T18:07:37.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6613999999999997e-05 2024-05-08T18:07:37.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820398+0000", 2024-05-08T18:07:37.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060967620000000004 2024-05-08T18:07:37.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820462+0000", 2024-05-08T18:07:37.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3305999999999993e-05 2024-05-08T18:07:37.599 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.599 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.599 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.600 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:750 6.19 6:9fecf831:::obj_delete_at_hint.0000000057:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:37.600 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:07:37.600 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.413972567, 2024-05-08T18:07:37.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035713440000000002, 2024-05-08T18:07:37.600 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:37.600 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:37.600 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:37.600 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:37.600 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:37.600 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:37.600 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 750 2024-05-08T18:07:37.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.600 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:37.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:37.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:07:37.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:37.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:07:37.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:37.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:37.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089318+0000", 2024-05-08T18:07:37.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.446e-06 2024-05-08T18:07:37.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:37.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089325+0000", 2024-05-08T18:07:37.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8560000000000001e-06 2024-05-08T18:07:37.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:37.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089345+0000", 2024-05-08T18:07:37.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9641999999999999e-05 2024-05-08T18:07:37.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:37.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089355+0000", 2024-05-08T18:07:37.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0586e-05 2024-05-08T18:07:37.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:37.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089469+0000", 2024-05-08T18:07:37.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113324 2024-05-08T18:07:37.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:37.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089692+0000", 2024-05-08T18:07:37.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022334500000000001 2024-05-08T18:07:37.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:07:37.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.090160+0000", 2024-05-08T18:07:37.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00046827799999999998 2024-05-08T18:07:37.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:37.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.091322+0000", 2024-05-08T18:07:37.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001161282 2024-05-08T18:07:37.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:37.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092750+0000", 2024-05-08T18:07:37.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014281299999999999 2024-05-08T18:07:37.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:37.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092829+0000", 2024-05-08T18:07:37.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9376999999999996e-05 2024-05-08T18:07:37.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:37.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:37.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:37.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092888+0000", 2024-05-08T18:07:37.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9077999999999999e-05 2024-05-08T18:07:37.604 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.604 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.605 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.605 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:37.605 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:37.605 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:07:37.606 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:07:37.606 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:37.604+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:37.707 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:37.708+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:37.773 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:07:37.773 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:07:37.773 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:07:37.773 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:07:37.787 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:07:37.808 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:37.809+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:37.909 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:07:37.908+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:07:37.956 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:07:37.956 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:07:37.956 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:07:37.956 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:07:37.956 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:07:37.970 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:07:38.011 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:07:38.012+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:07:38.111 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:38.112+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:38.139 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:07:38.139 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:07:38.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:07:38.139 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:07:38.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.139 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:38.139 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:07:38.139 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.603303936, 2024-05-08T18:07:38.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.032012946, 2024-05-08T18:07:38.140 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.140 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.140 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.140 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.140 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:38.140 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:38.140 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:07:38.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.140 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:07:38.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:07:38.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535484+0000", 2024-05-08T18:07:38.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7929999999999999e-06 2024-05-08T18:07:38.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535500+0000", 2024-05-08T18:07:38.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5226e-05 2024-05-08T18:07:38.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535535+0000", 2024-05-08T18:07:38.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5213000000000003e-05 2024-05-08T18:07:38.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535564+0000", 2024-05-08T18:07:38.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9360999999999999e-05 2024-05-08T18:07:38.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535757+0000", 2024-05-08T18:07:38.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000193229 2024-05-08T18:07:38.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:07:38.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535775+0000", 2024-05-08T18:07:38.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7098000000000001e-05 2024-05-08T18:07:38.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556004+0000", 2024-05-08T18:07:38.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020229068999999999 2024-05-08T18:07:38.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:07:38.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556036+0000", 2024-05-08T18:07:38.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1943000000000002e-05 2024-05-08T18:07:38.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.564721+0000", 2024-05-08T18:07:38.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086853320000000005 2024-05-08T18:07:38.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565032+0000", 2024-05-08T18:07:38.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031121799999999999 2024-05-08T18:07:38.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565365+0000", 2024-05-08T18:07:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000332744 2024-05-08T18:07:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567305+0000", 2024-05-08T18:07:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00194016 2024-05-08T18:07:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567368+0000", 2024-05-08T18:07:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3342000000000004e-05 2024-05-08T18:07:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567433+0000", 2024-05-08T18:07:38.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4726000000000003e-05 2024-05-08T18:07:38.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567494+0000", 2024-05-08T18:07:38.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0492000000000003e-05 2024-05-08T18:07:38.146 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.146 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.146 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.146 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206896342016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:38.146 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:07:38.147 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.570886844, 2024-05-08T18:07:38.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026490820000000001, 2024-05-08T18:07:38.147 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.147 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.147 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.147 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.147 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:38.147 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:38.147 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 47 2024-05-08T18:07:38.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.147 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:07:38.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:07:38.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567900+0000", 2024-05-08T18:07:38.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.03e-06 2024-05-08T18:07:38.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567909+0000", 2024-05-08T18:07:38.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0389999999999993e-06 2024-05-08T18:07:38.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567947+0000", 2024-05-08T18:07:38.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8013999999999999e-05 2024-05-08T18:07:38.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567961+0000", 2024-05-08T18:07:38.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3777999999999999e-05 2024-05-08T18:07:38.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568066+0000", 2024-05-08T18:07:38.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105208 2024-05-08T18:07:38.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568176+0000", 2024-05-08T18:07:38.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011041599999999999 2024-05-08T18:07:38.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:38.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568443+0000", 2024-05-08T18:07:38.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000266846 2024-05-08T18:07:38.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.569612+0000", 2024-05-08T18:07:38.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001169156 2024-05-08T18:07:38.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570378+0000", 2024-05-08T18:07:38.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00076617799999999995 2024-05-08T18:07:38.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570457+0000", 2024-05-08T18:07:38.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8750000000000003e-05 2024-05-08T18:07:38.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570547+0000", 2024-05-08T18:07:38.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9666999999999994e-05 2024-05-08T18:07:38.151 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.151 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.151 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.152 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:38.152 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:07:38.152 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.559839572, 2024-05-08T18:07:38.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051182119999999996, 2024-05-08T18:07:38.152 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.152 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.152 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.152 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.152 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:38.152 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:38.152 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 54 2024-05-08T18:07:38.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.152 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:07:38.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:07:38.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578947+0000", 2024-05-08T18:07:38.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:07:38.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578957+0000", 2024-05-08T18:07:38.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6020000000000006e-06 2024-05-08T18:07:38.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578997+0000", 2024-05-08T18:07:38.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0663e-05 2024-05-08T18:07:38.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579016+0000", 2024-05-08T18:07:38.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8185e-05 2024-05-08T18:07:38.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579117+0000", 2024-05-08T18:07:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010117599999999999 2024-05-08T18:07:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579252+0000", 2024-05-08T18:07:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013552 2024-05-08T18:07:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:07:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579393+0000", 2024-05-08T18:07:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140605 2024-05-08T18:07:38.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.580414+0000", 2024-05-08T18:07:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010214219999999999 2024-05-08T18:07:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.583866+0000", 2024-05-08T18:07:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034512840000000002 2024-05-08T18:07:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.583946+0000", 2024-05-08T18:07:38.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0406000000000002e-05 2024-05-08T18:07:38.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584063+0000", 2024-05-08T18:07:38.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117199 2024-05-08T18:07:38.157 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.157 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.157 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.157 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206896337408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:38.157 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:07:38.157 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.554552845, 2024-05-08T18:07:38.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027716910000000002, 2024-05-08T18:07:38.157 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.157 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.158 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.158 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.158 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:38.158 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:38.158 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 55 2024-05-08T18:07:38.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.158 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:07:38.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:07:38.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584234+0000", 2024-05-08T18:07:38.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9259999999999999e-06 2024-05-08T18:07:38.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584244+0000", 2024-05-08T18:07:38.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0369e-05 2024-05-08T18:07:38.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584270+0000", 2024-05-08T18:07:38.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5554999999999998e-05 2024-05-08T18:07:38.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584283+0000", 2024-05-08T18:07:38.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3039e-05 2024-05-08T18:07:38.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584384+0000", 2024-05-08T18:07:38.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000100881 2024-05-08T18:07:38.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584510+0000", 2024-05-08T18:07:38.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012627100000000001 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584741+0000", 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023162899999999999 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.585714+0000", 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00097270500000000003 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.586818+0000", 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00110403 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.586908+0000", 2024-05-08T18:07:38.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9641000000000005e-05 2024-05-08T18:07:38.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.587003+0000", 2024-05-08T18:07:38.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5644999999999997e-05 2024-05-08T18:07:38.162 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.162 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.162 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.162 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:191 6.5 e29/26 6:a2ace8b3:::data_log.0:head v 29'1, mlcod=0'0)", 2024-05-08T18:07:38.162 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:07:38.163 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.454725276, 2024-05-08T18:07:38.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001855095, 2024-05-08T18:07:38.163 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.163 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.163 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.163 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:07:38.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:07:38.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684061+0000", 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684074+0000", 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2479e-05 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684104+0000", 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0689999999999999e-05 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684120+0000", 2024-05-08T18:07:38.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5996000000000001e-05 2024-05-08T18:07:38.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684221+0000", 2024-05-08T18:07:38.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000100647 2024-05-08T18:07:38.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684273+0000", 2024-05-08T18:07:38.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2074999999999999e-05 2024-05-08T18:07:38.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.685828+0000", 2024-05-08T18:07:38.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015553030000000001 2024-05-08T18:07:38.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.685914+0000", 2024-05-08T18:07:38.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5927999999999995e-05 2024-05-08T18:07:38.166 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.166 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.166 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.166 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-05-08T18:07:38.166 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:07:38.166 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.539687013, 2024-05-08T18:07:38.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003347367, 2024-05-08T18:07:38.167 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.167 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.167 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.167 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:07:38.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:07:38.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5300000000000003e-07 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599110+0000", 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1826e-05 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599159+0000", 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8322000000000003e-05 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599180+0000", 2024-05-08T18:07:38.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1682e-05 2024-05-08T18:07:38.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599427+0000", 2024-05-08T18:07:38.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024721299999999998 2024-05-08T18:07:38.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599475+0000", 2024-05-08T18:07:38.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7299000000000002e-05 2024-05-08T18:07:38.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.602326+0000", 2024-05-08T18:07:38.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028516409999999998 2024-05-08T18:07:38.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.602445+0000", 2024-05-08T18:07:38.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011853099999999999 2024-05-08T18:07:38.170 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.170 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.170 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.170 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:231 6.1f e32/26 6:fde4dd55:gc::gc.26:head v 32'1, mlcod=0'0)", 2024-05-08T18:07:38.170 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:07:38.170 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.452033914999999, 2024-05-08T18:07:38.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017909390000000001, 2024-05-08T18:07:38.170 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.171 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.171 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.171 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:07:38.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:07:38.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:07:38.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5000000000000002e-07 2024-05-08T18:07:38.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686785+0000", 2024-05-08T18:07:38.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3438000000000001e-05 2024-05-08T18:07:38.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686810+0000", 2024-05-08T18:07:38.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4858000000000002e-05 2024-05-08T18:07:38.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686823+0000", 2024-05-08T18:07:38.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3417999999999999e-05 2024-05-08T18:07:38.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686989+0000", 2024-05-08T18:07:38.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016624700000000001 2024-05-08T18:07:38.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.687023+0000", 2024-05-08T18:07:38.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3396999999999999e-05 2024-05-08T18:07:38.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.688453+0000", 2024-05-08T18:07:38.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001430675 2024-05-08T18:07:38.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.688542+0000", 2024-05-08T18:07:38.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8256000000000003e-05 2024-05-08T18:07:38.174 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.174 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.174 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.174 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:292 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'4, mlcod=32'2)", 2024-05-08T18:07:38.174 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:07:38.174 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.418647196, 2024-05-08T18:07:38.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020064839999999998, 2024-05-08T18:07:38.174 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.175 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.175 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.175 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:07:38.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:07:38.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720170+0000", 2024-05-08T18:07:38.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3090999999999999e-05 2024-05-08T18:07:38.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720189+0000", 2024-05-08T18:07:38.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8077999999999999e-05 2024-05-08T18:07:38.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720222+0000", 2024-05-08T18:07:38.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3111000000000002e-05 2024-05-08T18:07:38.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720241+0000", 2024-05-08T18:07:38.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9528e-05 2024-05-08T18:07:38.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720452+0000", 2024-05-08T18:07:38.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021077300000000001 2024-05-08T18:07:38.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720505+0000", 2024-05-08T18:07:38.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2605000000000002e-05 2024-05-08T18:07:38.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.722038+0000", 2024-05-08T18:07:38.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015334630000000001 2024-05-08T18:07:38.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.722144+0000", 2024-05-08T18:07:38.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010583500000000001 2024-05-08T18:07:38.178 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.178 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.178 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.178 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:328 6.1 e32/26 6:856b9b26:reshard::reshard.0000000002:head v 32'1, mlcod=0'0)", 2024-05-08T18:07:38.178 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:07:38.179 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.413218905000001, 2024-05-08T18:07:38.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0018910070000000001, 2024-05-08T18:07:38.179 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.179 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.179 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.179 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:07:38.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:07:38.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:07:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3e-07 2024-05-08T18:07:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725576+0000", 2024-05-08T18:07:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5759999999999995e-06 2024-05-08T18:07:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725622+0000", 2024-05-08T18:07:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6196000000000003e-05 2024-05-08T18:07:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725642+0000", 2024-05-08T18:07:38.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9947999999999999e-05 2024-05-08T18:07:38.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.726011+0000", 2024-05-08T18:07:38.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036876699999999999 2024-05-08T18:07:38.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.726062+0000", 2024-05-08T18:07:38.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1062e-05 2024-05-08T18:07:38.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.727367+0000", 2024-05-08T18:07:38.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001304869 2024-05-08T18:07:38.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.727457+0000", 2024-05-08T18:07:38.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9858999999999995e-05 2024-05-08T18:07:38.182 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.182 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.182 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.182 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:382 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'6, mlcod=32'4)", 2024-05-08T18:07:38.182 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:07:38.182 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.400254301, 2024-05-08T18:07:38.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023570779999999999, 2024-05-08T18:07:38.183 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.183 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.183 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.183 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:07:38.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:07:38.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738532+0000", 2024-05-08T18:07:38.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.95e-06 2024-05-08T18:07:38.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738548+0000", 2024-05-08T18:07:38.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5911000000000001e-05 2024-05-08T18:07:38.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738583+0000", 2024-05-08T18:07:38.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4830999999999999e-05 2024-05-08T18:07:38.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738605+0000", 2024-05-08T18:07:38.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2005e-05 2024-05-08T18:07:38.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738747+0000", 2024-05-08T18:07:38.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014162800000000001 2024-05-08T18:07:38.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738800+0000", 2024-05-08T18:07:38.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2918999999999999e-05 2024-05-08T18:07:38.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.740802+0000", 2024-05-08T18:07:38.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020026150000000001 2024-05-08T18:07:38.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.740887+0000", 2024-05-08T18:07:38.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5218999999999998e-05 2024-05-08T18:07:38.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.186 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.186 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:394 6.c e32/26 6:3677c228:::obj_delete_at_hint.0000000006:head v 32'1, mlcod=0'0)", 2024-05-08T18:07:38.186 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:07:38.186 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.39558909, 2024-05-08T18:07:38.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026335320000000001, 2024-05-08T18:07:38.187 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.187 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.187 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.187 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:07:38.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:07:38.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743197+0000", 2024-05-08T18:07:38.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.81e-06 2024-05-08T18:07:38.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743210+0000", 2024-05-08T18:07:38.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2354999999999999e-05 2024-05-08T18:07:38.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743237+0000", 2024-05-08T18:07:38.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7328e-05 2024-05-08T18:07:38.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743256+0000", 2024-05-08T18:07:38.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8712e-05 2024-05-08T18:07:38.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743394+0000", 2024-05-08T18:07:38.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138009 2024-05-08T18:07:38.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743449+0000", 2024-05-08T18:07:38.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5371000000000002e-05 2024-05-08T18:07:38.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745754+0000", 2024-05-08T18:07:38.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002304567 2024-05-08T18:07:38.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745829+0000", 2024-05-08T18:07:38.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.538e-05 2024-05-08T18:07:38.190 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.190 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.190 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.190 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:392 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'7, mlcod=32'5)", 2024-05-08T18:07:38.190 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:07:38.191 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.395136571, 2024-05-08T18:07:38.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022345389999999998, 2024-05-08T18:07:38.191 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.191 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.191 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.191 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:07:38.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:07:38.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743650+0000", 2024-05-08T18:07:38.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1260000000000001e-06 2024-05-08T18:07:38.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743666+0000", 2024-05-08T18:07:38.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5696e-05 2024-05-08T18:07:38.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743696+0000", 2024-05-08T18:07:38.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0037999999999999e-05 2024-05-08T18:07:38.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743716+0000", 2024-05-08T18:07:38.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0251e-05 2024-05-08T18:07:38.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743838+0000", 2024-05-08T18:07:38.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012187 2024-05-08T18:07:38.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743886+0000", 2024-05-08T18:07:38.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8053000000000002e-05 2024-05-08T18:07:38.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745805+0000", 2024-05-08T18:07:38.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019189509999999999 2024-05-08T18:07:38.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745883+0000", 2024-05-08T18:07:38.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7553999999999996e-05 2024-05-08T18:07:38.194 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.194 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.194 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.195 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:453 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'4, mlcod=32'2)", 2024-05-08T18:07:38.195 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:07:38.195 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.360971391, 2024-05-08T18:07:38.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017625729999999999, 2024-05-08T18:07:38.195 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.195 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.195 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.195 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:07:38.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:07:38.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777815+0000", 2024-05-08T18:07:38.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6130000000000001e-06 2024-05-08T18:07:38.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777826+0000", 2024-05-08T18:07:38.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:07:38.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777852+0000", 2024-05-08T18:07:38.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6787999999999998e-05 2024-05-08T18:07:38.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777865+0000", 2024-05-08T18:07:38.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2882e-05 2024-05-08T18:07:38.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777961+0000", 2024-05-08T18:07:38.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5280999999999998e-05 2024-05-08T18:07:38.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777993+0000", 2024-05-08T18:07:38.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1931999999999999e-05 2024-05-08T18:07:38.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779496+0000", 2024-05-08T18:07:38.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001503307 2024-05-08T18:07:38.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779576+0000", 2024-05-08T18:07:38.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9887000000000003e-05 2024-05-08T18:07:38.198 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.199 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.199 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.199 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:460 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'3, mlcod=32'1)", 2024-05-08T18:07:38.199 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:07:38.199 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.359636021, 2024-05-08T18:07:38.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032252579999999999, 2024-05-08T18:07:38.199 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.199 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.199 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.199 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:07:38.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:07:38.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779150+0000", 2024-05-08T18:07:38.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:07:38.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779161+0000", 2024-05-08T18:07:38.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0906e-05 2024-05-08T18:07:38.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779186+0000", 2024-05-08T18:07:38.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4861000000000001e-05 2024-05-08T18:07:38.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779198+0000", 2024-05-08T18:07:38.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1969e-05 2024-05-08T18:07:38.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779334+0000", 2024-05-08T18:07:38.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000135513 2024-05-08T18:07:38.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779396+0000", 2024-05-08T18:07:38.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2815000000000001e-05 2024-05-08T18:07:38.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.782247+0000", 2024-05-08T18:07:38.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028502200000000001 2024-05-08T18:07:38.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.782374+0000", 2024-05-08T18:07:38.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012726400000000001 2024-05-08T18:07:38.203 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.203 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.203 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.203 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:463 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-05-08T18:07:38.203 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:07:38.203 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.357289915999999, 2024-05-08T18:07:38.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0036423610000000002, 2024-05-08T18:07:38.203 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.203 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.203 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.203 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:07:38.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:07:38.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781497+0000", 2024-05-08T18:07:38.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.917e-06 2024-05-08T18:07:38.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781509+0000", 2024-05-08T18:07:38.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2227e-05 2024-05-08T18:07:38.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781539+0000", 2024-05-08T18:07:38.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0218000000000001e-05 2024-05-08T18:07:38.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781558+0000", 2024-05-08T18:07:38.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8918000000000001e-05 2024-05-08T18:07:38.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781660+0000", 2024-05-08T18:07:38.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101584 2024-05-08T18:07:38.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781697+0000", 2024-05-08T18:07:38.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7360000000000001e-05 2024-05-08T18:07:38.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785059+0000", 2024-05-08T18:07:38.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033618810000000002 2024-05-08T18:07:38.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785137+0000", 2024-05-08T18:07:38.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8256000000000004e-05 2024-05-08T18:07:38.207 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.207 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.207 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.207 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:466 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'4, mlcod=32'2)", 2024-05-08T18:07:38.207 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:07:38.207 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.355169664, 2024-05-08T18:07:38.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002137496, 2024-05-08T18:07:38.207 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.207 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.207 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.208 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:07:38.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:07:38.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783617+0000", 2024-05-08T18:07:38.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8330000000000001e-06 2024-05-08T18:07:38.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:07:38.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5872e-05 2024-05-08T18:07:38.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783668+0000", 2024-05-08T18:07:38.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5880999999999997e-05 2024-05-08T18:07:38.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783688+0000", 2024-05-08T18:07:38.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9485000000000001e-05 2024-05-08T18:07:38.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783819+0000", 2024-05-08T18:07:38.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013098600000000001 2024-05-08T18:07:38.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783865+0000", 2024-05-08T18:07:38.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5711000000000003e-05 2024-05-08T18:07:38.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785680+0000", 2024-05-08T18:07:38.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001815374 2024-05-08T18:07:38.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785752+0000", 2024-05-08T18:07:38.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2354000000000006e-05 2024-05-08T18:07:38.211 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.211 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.211 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.211 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:469 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'10, mlcod=32'8)", 2024-05-08T18:07:38.211 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:07:38.211 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.351878675, 2024-05-08T18:07:38.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002120242, 2024-05-08T18:07:38.211 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.211 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.212 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.212 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:07:38.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:07:38.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786907+0000", 2024-05-08T18:07:38.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.412e-06 2024-05-08T18:07:38.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786917+0000", 2024-05-08T18:07:38.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3489999999999998e-06 2024-05-08T18:07:38.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786940+0000", 2024-05-08T18:07:38.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3019000000000001e-05 2024-05-08T18:07:38.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786951+0000", 2024-05-08T18:07:38.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0956e-05 2024-05-08T18:07:38.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.787229+0000", 2024-05-08T18:07:38.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027875000000000003 2024-05-08T18:07:38.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.787263+0000", 2024-05-08T18:07:38.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3563999999999999e-05 2024-05-08T18:07:38.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.788886+0000", 2024-05-08T18:07:38.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016228320000000001 2024-05-08T18:07:38.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.789026+0000", 2024-05-08T18:07:38.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014035999999999999 2024-05-08T18:07:38.215 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.215 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.215 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.215 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:478 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'11, mlcod=32'9)", 2024-05-08T18:07:38.215 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:07:38.215 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.347767062000001, 2024-05-08T18:07:38.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037403340000000001, 2024-05-08T18:07:38.215 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.215 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.216 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.216 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:07:38.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:07:38.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791019+0000", 2024-05-08T18:07:38.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5999999999999999e-06 2024-05-08T18:07:38.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791032+0000", 2024-05-08T18:07:38.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3021e-05 2024-05-08T18:07:38.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791057+0000", 2024-05-08T18:07:38.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4600000000000002e-05 2024-05-08T18:07:38.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791071+0000", 2024-05-08T18:07:38.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4756000000000001e-05 2024-05-08T18:07:38.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791185+0000", 2024-05-08T18:07:38.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011333200000000001 2024-05-08T18:07:38.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791234+0000", 2024-05-08T18:07:38.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8695e-05 2024-05-08T18:07:38.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794662+0000", 2024-05-08T18:07:38.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034282520000000001 2024-05-08T18:07:38.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794758+0000", 2024-05-08T18:07:38.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6077999999999997e-05 2024-05-08T18:07:38.219 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.219 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.219 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.219 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:829 6.5 e32/26 6:a77c5545:::obj_delete_at_hint.0000000084:head v 32'12, mlcod=32'10)", 2024-05-08T18:07:38.219 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:07:38.219 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.866598048, 2024-05-08T18:07:38.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017254, 2024-05-08T18:07:38.219 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.220 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.220 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.220 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:07:38.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:07:38.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272188+0000", 2024-05-08T18:07:38.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7269999999999999e-06 2024-05-08T18:07:38.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272229+0000", 2024-05-08T18:07:38.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0256999999999998e-05 2024-05-08T18:07:38.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272261+0000", 2024-05-08T18:07:38.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2017000000000002e-05 2024-05-08T18:07:38.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272275+0000", 2024-05-08T18:07:38.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4532000000000001e-05 2024-05-08T18:07:38.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272437+0000", 2024-05-08T18:07:38.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016199699999999999 2024-05-08T18:07:38.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272501+0000", 2024-05-08T18:07:38.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3805000000000003e-05 2024-05-08T18:07:38.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.273824+0000", 2024-05-08T18:07:38.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001323039 2024-05-08T18:07:38.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.273912+0000", 2024-05-08T18:07:38.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8026000000000001e-05 2024-05-08T18:07:38.223 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.223 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.223 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.223 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:937 6.1f e32/26 6:fd6b5df8:::obj_delete_at_hint.0000000120:head v 32'10, mlcod=32'8)", 2024-05-08T18:07:38.223 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:07:38.223 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.615361932999999, 2024-05-08T18:07:38.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019919009999999999, 2024-05-08T18:07:38.224 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.224 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.224 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.224 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:07:38.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:07:38.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523425+0000", 2024-05-08T18:07:38.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8560000000000001e-06 2024-05-08T18:07:38.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523437+0000", 2024-05-08T18:07:38.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2833000000000001e-05 2024-05-08T18:07:38.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523464+0000", 2024-05-08T18:07:38.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6621000000000001e-05 2024-05-08T18:07:38.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523477+0000", 2024-05-08T18:07:38.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2758999999999999e-05 2024-05-08T18:07:38.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523612+0000", 2024-05-08T18:07:38.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013525899999999999 2024-05-08T18:07:38.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523679+0000", 2024-05-08T18:07:38.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6964000000000005e-05 2024-05-08T18:07:38.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.525312+0000", 2024-05-08T18:07:38.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016331 2024-05-08T18:07:38.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.525415+0000", 2024-05-08T18:07:38.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000102509 2024-05-08T18:07:38.227 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.227 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.227 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.227 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.227 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.227 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:07:38.228 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-05-08T18:07:38.230 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:07:38.230 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:38.228+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:38.230 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.3 to 1 (10000) 2024-05-08T18:07:38.230 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-08T18:07:38.330 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:07:38.328+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:07:38.398 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:07:38.398 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:07:38.398 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:07:38.399 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:07:38.413 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:07:38.430 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:38.429+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:38.531 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:38.533+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:38.583 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:07:38.583 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:07:38.583 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:07:38.584 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:07:38.584 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:07:38.601 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:07:38.647 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:38.647+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:38.721 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:07:38.721 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:07:38.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:07:38.721 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:07:38.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.721 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.721 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:07:38.722 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.905320519, 2024-05-08T18:07:38.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.16213206199999999, 2024-05-08T18:07:38.722 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.722 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.722 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.722 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.722 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.722 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.722 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1 2024-05-08T18:07:38.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.722 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:07:38.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:07:38.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814494+0000", 2024-05-08T18:07:38.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:07:38.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814520+0000", 2024-05-08T18:07:38.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-05 2024-05-08T18:07:38.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814543+0000", 2024-05-08T18:07:38.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2353000000000001e-05 2024-05-08T18:07:38.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814563+0000", 2024-05-08T18:07:38.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.048e-05 2024-05-08T18:07:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814677+0000", 2024-05-08T18:07:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113632 2024-05-08T18:07:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:07:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814705+0000", 2024-05-08T18:07:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8626999999999999e-05 2024-05-08T18:07:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971115+0000", 2024-05-08T18:07:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.156409825 2024-05-08T18:07:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971438+0000", 2024-05-08T18:07:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00032289200000000002 2024-05-08T18:07:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971849+0000", 2024-05-08T18:07:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041139300000000002 2024-05-08T18:07:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.975364+0000", 2024-05-08T18:07:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035148390000000001 2024-05-08T18:07:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976474+0000", 2024-05-08T18:07:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001110099 2024-05-08T18:07:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976564+0000", 2024-05-08T18:07:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9522000000000001e-05 2024-05-08T18:07:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976624+0000", 2024-05-08T18:07:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9616e-05 2024-05-08T18:07:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:07:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.707371072999997, 2024-05-08T18:07:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010762776999999999, 2024-05-08T18:07:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 24 2024-05-08T18:07:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:07:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:07:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012442+0000", 2024-05-08T18:07:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.4300000000000002e-07 2024-05-08T18:07:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012573+0000", 2024-05-08T18:07:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013108299999999999 2024-05-08T18:07:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012592+0000", 2024-05-08T18:07:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9009e-05 2024-05-08T18:07:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012610+0000", 2024-05-08T18:07:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.789e-05 2024-05-08T18:07:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019108+0000", 2024-05-08T18:07:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064981470000000001 2024-05-08T18:07:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019348+0000", 2024-05-08T18:07:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024006099999999999 2024-05-08T18:07:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019751+0000", 2024-05-08T18:07:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040324099999999998 2024-05-08T18:07:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.022727+0000", 2024-05-08T18:07:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002976107 2024-05-08T18:07:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.022826+0000", 2024-05-08T18:07:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8626000000000001e-05 2024-05-08T18:07:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023036+0000", 2024-05-08T18:07:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000209578 2024-05-08T18:07:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023204+0000", 2024-05-08T18:07:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016819200000000001 2024-05-08T18:07:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:07:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.707183978000003, 2024-05-08T18:07:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011074977999999999, 2024-05-08T18:07:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 25 2024-05-08T18:07:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:07:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:07:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012629+0000", 2024-05-08T18:07:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7700000000000004e-07 2024-05-08T18:07:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012636+0000", 2024-05-08T18:07:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-05-08T18:07:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012646+0000", 2024-05-08T18:07:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0147e-05 2024-05-08T18:07:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012657+0000", 2024-05-08T18:07:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0473e-05 2024-05-08T18:07:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021198+0000", 2024-05-08T18:07:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0085417510000000002 2024-05-08T18:07:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021445+0000", 2024-05-08T18:07:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024665100000000002 2024-05-08T18:07:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021820+0000", 2024-05-08T18:07:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037519400000000003 2024-05-08T18:07:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023231+0000", 2024-05-08T18:07:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001410412 2024-05-08T18:07:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023550+0000", 2024-05-08T18:07:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000319368 2024-05-08T18:07:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023632+0000", 2024-05-08T18:07:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2366000000000004e-05 2024-05-08T18:07:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023703+0000", 2024-05-08T18:07:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0568999999999995e-05 2024-05-08T18:07:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:07:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.610838190999999, 2024-05-08T18:07:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011460965, 2024-05-08T18:07:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 45 2024-05-08T18:07:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:07:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:07:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108975+0000", 2024-05-08T18:07:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:07:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108983+0000", 2024-05-08T18:07:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6669999999999996e-06 2024-05-08T18:07:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109005+0000", 2024-05-08T18:07:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2787000000000001e-05 2024-05-08T18:07:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109020+0000", 2024-05-08T18:07:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4192999999999999e-05 2024-05-08T18:07:38.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116378+0000", 2024-05-08T18:07:38.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073585600000000001 2024-05-08T18:07:38.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116516+0000", 2024-05-08T18:07:38.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000137739 2024-05-08T18:07:38.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116747+0000", 2024-05-08T18:07:38.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023132799999999999 2024-05-08T18:07:38.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120140+0000", 2024-05-08T18:07:38.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033931439999999998 2024-05-08T18:07:38.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120290+0000", 2024-05-08T18:07:38.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149765 2024-05-08T18:07:38.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120369+0000", 2024-05-08T18:07:38.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.907e-05 2024-05-08T18:07:38.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120435+0000", 2024-05-08T18:07:38.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5642999999999995e-05 2024-05-08T18:07:38.745 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.745 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.745 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.745 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.745 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:07:38.746 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.610774098, 2024-05-08T18:07:38.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013705973999999999, 2024-05-08T18:07:38.746 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.746 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.746 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.746 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.746 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.746 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.746 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:07:38.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.746 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:07:38.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:07:38.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109039+0000", 2024-05-08T18:07:38.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:07:38.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109044+0000", 2024-05-08T18:07:38.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6699999999999999e-06 2024-05-08T18:07:38.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109054+0000", 2024-05-08T18:07:38.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7100000000000002e-06 2024-05-08T18:07:38.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109064+0000", 2024-05-08T18:07:38.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5740000000000002e-06 2024-05-08T18:07:38.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.117676+0000", 2024-05-08T18:07:38.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086126060000000001 2024-05-08T18:07:38.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.117828+0000", 2024-05-08T18:07:38.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151552 2024-05-08T18:07:38.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118041+0000", 2024-05-08T18:07:38.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000212692 2024-05-08T18:07:38.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120269+0000", 2024-05-08T18:07:38.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022281860000000001 2024-05-08T18:07:38.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122593+0000", 2024-05-08T18:07:38.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023239419999999998 2024-05-08T18:07:38.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122672+0000", 2024-05-08T18:07:38.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9579999999999994e-05 2024-05-08T18:07:38.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122744+0000", 2024-05-08T18:07:38.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1695999999999999e-05 2024-05-08T18:07:38.751 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.751 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.751 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.751 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.751 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:07:38.751 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.610730255, 2024-05-08T18:07:38.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016228664, 2024-05-08T18:07:38.751 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.751 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.751 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.751 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.751 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.752 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.752 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 47 2024-05-08T18:07:38.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.752 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:07:38.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:07:38.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109083+0000", 2024-05-08T18:07:38.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4600000000000004e-07 2024-05-08T18:07:38.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109232+0000", 2024-05-08T18:07:38.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149782 2024-05-08T18:07:38.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109257+0000", 2024-05-08T18:07:38.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4856999999999999e-05 2024-05-08T18:07:38.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109272+0000", 2024-05-08T18:07:38.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.503e-05 2024-05-08T18:07:38.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118799+0000", 2024-05-08T18:07:38.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0095264400000000006 2024-05-08T18:07:38.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118947+0000", 2024-05-08T18:07:38.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014848199999999999 2024-05-08T18:07:38.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.119151+0000", 2024-05-08T18:07:38.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020350500000000001 2024-05-08T18:07:38.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121458+0000", 2024-05-08T18:07:38.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002307749 2024-05-08T18:07:38.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125170+0000", 2024-05-08T18:07:38.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037113409999999999 2024-05-08T18:07:38.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125246+0000", 2024-05-08T18:07:38.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6029e-05 2024-05-08T18:07:38.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125310+0000", 2024-05-08T18:07:38.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4702999999999994e-05 2024-05-08T18:07:38.756 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.756 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.757 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.757 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.757 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:07:38.757 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.610510736999998, 2024-05-08T18:07:38.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016305097000000001, 2024-05-08T18:07:38.757 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.757 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.757 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.757 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.757 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.757 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.757 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 48 2024-05-08T18:07:38.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.758 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:07:38.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:07:38.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109303+0000", 2024-05-08T18:07:38.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:07:38.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109332+0000", 2024-05-08T18:07:38.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9220000000000001e-05 2024-05-08T18:07:38.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109375+0000", 2024-05-08T18:07:38.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2765999999999997e-05 2024-05-08T18:07:38.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109394+0000", 2024-05-08T18:07:38.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8603000000000001e-05 2024-05-08T18:07:38.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120508+0000", 2024-05-08T18:07:38.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011114811 2024-05-08T18:07:38.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120663+0000", 2024-05-08T18:07:38.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000154332 2024-05-08T18:07:38.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120863+0000", 2024-05-08T18:07:38.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019995599999999999 2024-05-08T18:07:38.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125326+0000", 2024-05-08T18:07:38.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044631180000000003 2024-05-08T18:07:38.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125431+0000", 2024-05-08T18:07:38.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010522900000000001 2024-05-08T18:07:38.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125541+0000", 2024-05-08T18:07:38.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109802 2024-05-08T18:07:38.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125606+0000", 2024-05-08T18:07:38.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5549999999999994e-05 2024-05-08T18:07:38.762 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.762 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.762 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.763 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.763 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:07:38.763 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.610390418000001, 2024-05-08T18:07:38.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016563135, 2024-05-08T18:07:38.763 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.763 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.763 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.763 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.763 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.763 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.763 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 49 2024-05-08T18:07:38.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.763 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:07:38.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:07:38.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109423+0000", 2024-05-08T18:07:38.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5969999999999999e-06 2024-05-08T18:07:38.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109434+0000", 2024-05-08T18:07:38.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.113e-05 2024-05-08T18:07:38.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109455+0000", 2024-05-08T18:07:38.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0873000000000002e-05 2024-05-08T18:07:38.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109469+0000", 2024-05-08T18:07:38.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4039999999999999e-05 2024-05-08T18:07:38.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121566+0000", 2024-05-08T18:07:38.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012096325999999999 2024-05-08T18:07:38.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121725+0000", 2024-05-08T18:07:38.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015932899999999999 2024-05-08T18:07:38.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121981+0000", 2024-05-08T18:07:38.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025583799999999999 2024-05-08T18:07:38.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125680+0000", 2024-05-08T18:07:38.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0036995579999999999 2024-05-08T18:07:38.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125838+0000", 2024-05-08T18:07:38.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015731499999999999 2024-05-08T18:07:38.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125914+0000", 2024-05-08T18:07:38.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6686000000000004e-05 2024-05-08T18:07:38.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125985+0000", 2024-05-08T18:07:38.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0443000000000003e-05 2024-05-08T18:07:38.768 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.768 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.768 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.768 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.768 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:07:38.769 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.610318038999999, 2024-05-08T18:07:38.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016620291999999998, 2024-05-08T18:07:38.769 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.769 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.769 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.769 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.769 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.769 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.769 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 50 2024-05-08T18:07:38.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.769 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:07:38.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:07:38.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109495+0000", 2024-05-08T18:07:38.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.477e-06 2024-05-08T18:07:38.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109692+0000", 2024-05-08T18:07:38.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019638199999999999 2024-05-08T18:07:38.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109733+0000", 2024-05-08T18:07:38.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1093000000000001e-05 2024-05-08T18:07:38.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109745+0000", 2024-05-08T18:07:38.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1715999999999999e-05 2024-05-08T18:07:38.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122839+0000", 2024-05-08T18:07:38.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013094809000000001 2024-05-08T18:07:38.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122980+0000", 2024-05-08T18:07:38.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140829 2024-05-08T18:07:38.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.123239+0000", 2024-05-08T18:07:38.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025834799999999999 2024-05-08T18:07:38.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125810+0000", 2024-05-08T18:07:38.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025717729999999999 2024-05-08T18:07:38.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126001+0000", 2024-05-08T18:07:38.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019013600000000001 2024-05-08T18:07:38.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126064+0000", 2024-05-08T18:07:38.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3301999999999998e-05 2024-05-08T18:07:38.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126114+0000", 2024-05-08T18:07:38.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0426999999999997e-05 2024-05-08T18:07:38.774 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.774 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.774 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.774 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.774 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:07:38.774 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.610038891000002, 2024-05-08T18:07:38.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018305669, 2024-05-08T18:07:38.774 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.774 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.774 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.775 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.775 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.775 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.775 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 51 2024-05-08T18:07:38.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.775 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:07:38.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:07:38.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109775+0000", 2024-05-08T18:07:38.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5269999999999999e-06 2024-05-08T18:07:38.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109786+0000", 2024-05-08T18:07:38.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1296e-05 2024-05-08T18:07:38.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109806+0000", 2024-05-08T18:07:38.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0114000000000001e-05 2024-05-08T18:07:38.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109823+0000", 2024-05-08T18:07:38.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6665999999999999e-05 2024-05-08T18:07:38.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124193+0000", 2024-05-08T18:07:38.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014369916 2024-05-08T18:07:38.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124354+0000", 2024-05-08T18:07:38.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016167899999999999 2024-05-08T18:07:38.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124571+0000", 2024-05-08T18:07:38.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021652800000000001 2024-05-08T18:07:38.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126978+0000", 2024-05-08T18:07:38.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024071679999999999 2024-05-08T18:07:38.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127921+0000", 2024-05-08T18:07:38.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00094277599999999999 2024-05-08T18:07:38.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.128012+0000", 2024-05-08T18:07:38.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0818999999999999e-05 2024-05-08T18:07:38.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.128079+0000", 2024-05-08T18:07:38.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7180000000000004e-05 2024-05-08T18:07:38.779 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.779 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.779 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.779 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.779 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:07:38.780 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.609963784999998, 2024-05-08T18:07:38.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021440811000000001, 2024-05-08T18:07:38.780 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.780 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.780 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.780 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.780 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.780 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.780 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 52 2024-05-08T18:07:38.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.780 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:07:38.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:07:38.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109849+0000", 2024-05-08T18:07:38.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1370000000000001e-06 2024-05-08T18:07:38.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109861+0000", 2024-05-08T18:07:38.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1559999999999999e-05 2024-05-08T18:07:38.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109878+0000", 2024-05-08T18:07:38.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7105999999999999e-05 2024-05-08T18:07:38.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109892+0000", 2024-05-08T18:07:38.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3577000000000001e-05 2024-05-08T18:07:38.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126161+0000", 2024-05-08T18:07:38.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016269458000000001 2024-05-08T18:07:38.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126299+0000", 2024-05-08T18:07:38.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138405 2024-05-08T18:07:38.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126534+0000", 2024-05-08T18:07:38.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000234875 2024-05-08T18:07:38.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127543+0000", 2024-05-08T18:07:38.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001008852 2024-05-08T18:07:38.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131128+0000", 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035844359999999999 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131222+0000", 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3905000000000003e-05 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131289+0000", 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7500000000000001e-05 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.785 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.785 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:07:38.785 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.369678086, 2024-05-08T18:07:38.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010652125, 2024-05-08T18:07:38.785 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.785 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.785 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.785 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.785 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.785 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.785 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 67 2024-05-08T18:07:38.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.785 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:07:38.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:07:38.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350135+0000", 2024-05-08T18:07:38.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.083e-06 2024-05-08T18:07:38.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350141+0000", 2024-05-08T18:07:38.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.178e-06 2024-05-08T18:07:38.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350152+0000", 2024-05-08T18:07:38.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0706999999999999e-05 2024-05-08T18:07:38.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350159+0000", 2024-05-08T18:07:38.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3640000000000001e-06 2024-05-08T18:07:38.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352606+0000", 2024-05-08T18:07:38.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024470379999999999 2024-05-08T18:07:38.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352718+0000", 2024-05-08T18:07:38.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000111366 2024-05-08T18:07:38.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352887+0000", 2024-05-08T18:07:38.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016887900000000001 2024-05-08T18:07:38.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358041+0000", 2024-05-08T18:07:38.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051542940000000002 2024-05-08T18:07:38.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360681+0000", 2024-05-08T18:07:38.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026404639999999999 2024-05-08T18:07:38.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360726+0000", 2024-05-08T18:07:38.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4666999999999998e-05 2024-05-08T18:07:38.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360786+0000", 2024-05-08T18:07:38.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0084999999999998e-05 2024-05-08T18:07:38.790 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.790 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.790 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.790 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.790 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:07:38.790 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.369422698000001, 2024-05-08T18:07:38.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010500438000000001, 2024-05-08T18:07:38.790 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.790 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.790 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.791 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.791 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.791 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.791 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 68 2024-05-08T18:07:38.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.791 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:07:38.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:07:38.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350391+0000", 2024-05-08T18:07:38.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:07:38.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350398+0000", 2024-05-08T18:07:38.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6599999999999995e-06 2024-05-08T18:07:38.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350414+0000", 2024-05-08T18:07:38.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6101000000000001e-05 2024-05-08T18:07:38.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350425+0000", 2024-05-08T18:07:38.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.099e-05 2024-05-08T18:07:38.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353737+0000", 2024-05-08T18:07:38.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033112739999999999 2024-05-08T18:07:38.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353810+0000", 2024-05-08T18:07:38.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3337999999999995e-05 2024-05-08T18:07:38.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353922+0000", 2024-05-08T18:07:38.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112409 2024-05-08T18:07:38.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358114+0000", 2024-05-08T18:07:38.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041912909999999998 2024-05-08T18:07:38.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360798+0000", 2024-05-08T18:07:38.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026845850000000002 2024-05-08T18:07:38.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360838+0000", 2024-05-08T18:07:38.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9619999999999997e-05 2024-05-08T18:07:38.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360890+0000", 2024-05-08T18:07:38.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.185e-05 2024-05-08T18:07:38.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.795 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.796 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.796 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:07:38.796 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.369046478000001, 2024-05-08T18:07:38.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010508969999999999, 2024-05-08T18:07:38.796 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.796 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.796 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.796 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.796 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.796 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.796 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 71 2024-05-08T18:07:38.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.796 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:07:38.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:07:38.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:07:38.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.61e-07 2024-05-08T18:07:38.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350771+0000", 2024-05-08T18:07:38.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6720000000000003e-06 2024-05-08T18:07:38.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350781+0000", 2024-05-08T18:07:38.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9450000000000005e-06 2024-05-08T18:07:38.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350786+0000", 2024-05-08T18:07:38.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2530000000000004e-06 2024-05-08T18:07:38.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356065+0000", 2024-05-08T18:07:38.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052789239999999999 2024-05-08T18:07:38.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356174+0000", 2024-05-08T18:07:38.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108564 2024-05-08T18:07:38.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356336+0000", 2024-05-08T18:07:38.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162566 2024-05-08T18:07:38.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358285+0000", 2024-05-08T18:07:38.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001948443 2024-05-08T18:07:38.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361124+0000", 2024-05-08T18:07:38.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028390120000000001 2024-05-08T18:07:38.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361217+0000", 2024-05-08T18:07:38.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3899000000000003e-05 2024-05-08T18:07:38.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361275+0000", 2024-05-08T18:07:38.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7031000000000003e-05 2024-05-08T18:07:38.801 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.801 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.801 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.802 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.802 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:07:38.802 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.368969006, 2024-05-08T18:07:38.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010535020000000001, 2024-05-08T18:07:38.802 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.802 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.802 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.802 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.802 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.802 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.802 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 72 2024-05-08T18:07:38.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.803 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:07:38.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:07:38.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350844+0000", 2024-05-08T18:07:38.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:07:38.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350957+0000", 2024-05-08T18:07:38.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112958 2024-05-08T18:07:38.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350966+0000", 2024-05-08T18:07:38.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3440000000000007e-06 2024-05-08T18:07:38.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350972+0000", 2024-05-08T18:07:38.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.37e-06 2024-05-08T18:07:38.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356777+0000", 2024-05-08T18:07:38.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058049199999999999 2024-05-08T18:07:38.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356852+0000", 2024-05-08T18:07:38.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5109000000000002e-05 2024-05-08T18:07:38.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356961+0000", 2024-05-08T18:07:38.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108818 2024-05-08T18:07:38.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359695+0000", 2024-05-08T18:07:38.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002733685 2024-05-08T18:07:38.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361284+0000", 2024-05-08T18:07:38.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015888740000000001 2024-05-08T18:07:38.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361323+0000", 2024-05-08T18:07:38.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9824999999999999e-05 2024-05-08T18:07:38.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361378+0000", 2024-05-08T18:07:38.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4593999999999999e-05 2024-05-08T18:07:38.807 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.807 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.807 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.807 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.807 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:07:38.808 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.368829204000001, 2024-05-08T18:07:38.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01225805, 2024-05-08T18:07:38.808 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.808 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.808 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.808 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.808 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.808 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.808 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 73 2024-05-08T18:07:38.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.808 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:07:38.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:07:38.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:07:38.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0999999999999999e-07 2024-05-08T18:07:38.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350987+0000", 2024-05-08T18:07:38.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3529999999999999e-06 2024-05-08T18:07:38.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350994+0000", 2024-05-08T18:07:38.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0840000000000003e-06 2024-05-08T18:07:38.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350998+0000", 2024-05-08T18:07:38.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.194e-06 2024-05-08T18:07:38.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358336+0000", 2024-05-08T18:07:38.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073376070000000003 2024-05-08T18:07:38.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358456+0000", 2024-05-08T18:07:38.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012042199999999999 2024-05-08T18:07:38.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358615+0000", 2024-05-08T18:07:38.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015928399999999999 2024-05-08T18:07:38.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.362117+0000", 2024-05-08T18:07:38.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035021039999999998 2024-05-08T18:07:38.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363139+0000", 2024-05-08T18:07:38.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010220349999999999 2024-05-08T18:07:38.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363181+0000", 2024-05-08T18:07:38.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1465999999999999e-05 2024-05-08T18:07:38.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363241+0000", 2024-05-08T18:07:38.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9991000000000002e-05 2024-05-08T18:07:38.813 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.813 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.813 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.813 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.813 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:07:38.813 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.368804386999997, 2024-05-08T18:07:38.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012698229, 2024-05-08T18:07:38.813 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.813 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.813 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.813 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.814 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.814 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.814 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 74 2024-05-08T18:07:38.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.814 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:07:38.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:07:38.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:07:38.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4000000000000002e-07 2024-05-08T18:07:38.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351013+0000", 2024-05-08T18:07:38.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8239999999999999e-06 2024-05-08T18:07:38.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351020+0000", 2024-05-08T18:07:38.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.52e-06 2024-05-08T18:07:38.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351025+0000", 2024-05-08T18:07:38.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3499999999999999e-06 2024-05-08T18:07:38.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359063+0000", 2024-05-08T18:07:38.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0080381800000000007 2024-05-08T18:07:38.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359140+0000", 2024-05-08T18:07:38.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7225999999999995e-05 2024-05-08T18:07:38.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359256+0000", 2024-05-08T18:07:38.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011537899999999999 2024-05-08T18:07:38.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363249+0000", 2024-05-08T18:07:38.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039937089999999998 2024-05-08T18:07:38.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363584+0000", 2024-05-08T18:07:38.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033516500000000001 2024-05-08T18:07:38.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363654+0000", 2024-05-08T18:07:38.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9093999999999999e-05 2024-05-08T18:07:38.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363706+0000", 2024-05-08T18:07:38.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2342000000000001e-05 2024-05-08T18:07:38.818 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.818 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.818 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.819 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.819 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:07:38.819 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.368766127000001, 2024-05-08T18:07:38.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015677229000000001, 2024-05-08T18:07:38.819 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.819 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.819 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.819 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.819 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.819 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.819 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 75 2024-05-08T18:07:38.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.819 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:07:38.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:07:38.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:07:38.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1699999999999999e-07 2024-05-08T18:07:38.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351141+0000", 2024-05-08T18:07:38.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4661999999999996e-05 2024-05-08T18:07:38.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351151+0000", 2024-05-08T18:07:38.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0084e-05 2024-05-08T18:07:38.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351160+0000", 2024-05-08T18:07:38.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2490000000000007e-06 2024-05-08T18:07:38.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359748+0000", 2024-05-08T18:07:38.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0085879849999999994 2024-05-08T18:07:38.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359820+0000", 2024-05-08T18:07:38.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2081000000000003e-05 2024-05-08T18:07:38.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359928+0000", 2024-05-08T18:07:38.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107157 2024-05-08T18:07:38.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363254+0000", 2024-05-08T18:07:38.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033268579999999998 2024-05-08T18:07:38.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366611+0000", 2024-05-08T18:07:38.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033564179999999999 2024-05-08T18:07:38.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366672+0000", 2024-05-08T18:07:38.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0714999999999997e-05 2024-05-08T18:07:38.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366723+0000", 2024-05-08T18:07:38.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1603e-05 2024-05-08T18:07:38.824 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.824 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.824 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.824 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.824 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:07:38.824 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.368641627000002, 2024-05-08T18:07:38.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015696418, 2024-05-08T18:07:38.824 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.824 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.824 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.824 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.825 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.825 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.825 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 76 2024-05-08T18:07:38.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.825 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:07:38.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:07:38.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351171+0000", 2024-05-08T18:07:38.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4600000000000004e-07 2024-05-08T18:07:38.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351174+0000", 2024-05-08T18:07:38.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2030000000000001e-06 2024-05-08T18:07:38.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351179+0000", 2024-05-08T18:07:38.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2079999999999999e-06 2024-05-08T18:07:38.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351184+0000", 2024-05-08T18:07:38.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3120000000000004e-06 2024-05-08T18:07:38.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361430+0000", 2024-05-08T18:07:38.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010246175 2024-05-08T18:07:38.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361545+0000", 2024-05-08T18:07:38.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115139 2024-05-08T18:07:38.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361712+0000", 2024-05-08T18:07:38.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000166491 2024-05-08T18:07:38.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363473+0000", 2024-05-08T18:07:38.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017610799999999999 2024-05-08T18:07:38.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366769+0000", 2024-05-08T18:07:38.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032964880000000002 2024-05-08T18:07:38.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366811+0000", 2024-05-08T18:07:38.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2296000000000003e-05 2024-05-08T18:07:38.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366867+0000", 2024-05-08T18:07:38.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5380000000000002e-05 2024-05-08T18:07:38.829 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.829 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.829 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.829 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:38.830 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:07:38.830 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.017713657999998, 2024-05-08T18:07:38.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010497067000000001, 2024-05-08T18:07:38.830 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:38.830 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:38.830 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:38.830 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:38.830 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:38.830 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:38.830 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 94 2024-05-08T18:07:38.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.830 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:38.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:38.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:07:38.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:38.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:07:38.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:38.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:38.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702099+0000", 2024-05-08T18:07:38.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4099999999999999e-07 2024-05-08T18:07:38.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:38.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702102+0000", 2024-05-08T18:07:38.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6650000000000001e-06 2024-05-08T18:07:38.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:38.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702108+0000", 2024-05-08T18:07:38.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.711e-06 2024-05-08T18:07:38.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:38.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702114+0000", 2024-05-08T18:07:38.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.241e-06 2024-05-08T18:07:38.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:38.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.708666+0000", 2024-05-08T18:07:38.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065511459999999999 2024-05-08T18:07:38.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:38.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.708833+0000", 2024-05-08T18:07:38.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000166966 2024-05-08T18:07:38.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:38.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.709171+0000", 2024-05-08T18:07:38.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033834000000000002 2024-05-08T18:07:38.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:38.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.710246+0000", 2024-05-08T18:07:38.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001074642 2024-05-08T18:07:38.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:38.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712422+0000", 2024-05-08T18:07:38.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021762370000000001 2024-05-08T18:07:38.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:38.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712521+0000", 2024-05-08T18:07:38.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9432999999999995e-05 2024-05-08T18:07:38.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:38.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:38.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:38.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712595+0000", 2024-05-08T18:07:38.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4245000000000005e-05 2024-05-08T18:07:38.835 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.835 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.835 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.835 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:38.835 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:38.835 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:07:38.836 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:38.835+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:38.837 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:07:38.937 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:38.937+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:38.960 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:38.960 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:38.960 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:38.960 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:38.973 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:07:39.063 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:39.065+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:39.138 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:07:39.138 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:07:39.138 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:39.139 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:39.137+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:39.152 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:07:39.195 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.4 to 1 (10000) 2024-05-08T18:07:39.217 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-08T18:07:39.240 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:39.239+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:39.320 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:07:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:07:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:07:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:52 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'31)", 2024-05-08T18:07:39.320 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:07:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.194032264000001, 2024-05-08T18:07:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00409947, 2024-05-08T18:07:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:07:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:07:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127167+0000", 2024-05-08T18:07:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7800000000000001e-07 2024-05-08T18:07:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127172+0000", 2024-05-08T18:07:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1120000000000004e-06 2024-05-08T18:07:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127183+0000", 2024-05-08T18:07:39.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1107000000000001e-05 2024-05-08T18:07:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127189+0000", 2024-05-08T18:07:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0310000000000004e-06 2024-05-08T18:07:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127237+0000", 2024-05-08T18:07:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7907000000000001e-05 2024-05-08T18:07:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127252+0000", 2024-05-08T18:07:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5373e-05 2024-05-08T18:07:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131206+0000", 2024-05-08T18:07:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039540199999999999 2024-05-08T18:07:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131265+0000", 2024-05-08T18:07:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9141999999999997e-05 2024-05-08T18:07:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.324 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-05-08T18:07:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:07:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.185273860000002, 2024-05-08T18:07:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049265589999999996, 2024-05-08T18:07:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:07:39.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:07:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135925+0000", 2024-05-08T18:07:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8100000000000002e-07 2024-05-08T18:07:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136007+0000", 2024-05-08T18:07:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1864000000000001e-05 2024-05-08T18:07:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136019+0000", 2024-05-08T18:07:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2438e-05 2024-05-08T18:07:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136026+0000", 2024-05-08T18:07:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0809999999999996e-06 2024-05-08T18:07:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136093+0000", 2024-05-08T18:07:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6769999999999999e-05 2024-05-08T18:07:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136108+0000", 2024-05-08T18:07:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.465e-05 2024-05-08T18:07:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140800+0000", 2024-05-08T18:07:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046919450000000003 2024-05-08T18:07:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140851+0000", 2024-05-08T18:07:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.113e-05 2024-05-08T18:07:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-05-08T18:07:39.329 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:07:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.96878865, 2024-05-08T18:07:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042257299999999996, 2024-05-08T18:07:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:07:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:07:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352410+0000", 2024-05-08T18:07:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7599999999999997e-07 2024-05-08T18:07:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352489+0000", 2024-05-08T18:07:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8564000000000002e-05 2024-05-08T18:07:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.331 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352500+0000", 2024-05-08T18:07:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1411e-05 2024-05-08T18:07:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352506+0000", 2024-05-08T18:07:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7309999999999998e-06 2024-05-08T18:07:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352569+0000", 2024-05-08T18:07:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3173e-05 2024-05-08T18:07:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352598+0000", 2024-05-08T18:07:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8855000000000001e-05 2024-05-08T18:07:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356592+0000", 2024-05-08T18:07:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039941539999999998 2024-05-08T18:07:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356635+0000", 2024-05-08T18:07:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3166e-05 2024-05-08T18:07:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:75 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'53, mlcod=15'43)", 2024-05-08T18:07:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.960617233000001, 2024-05-08T18:07:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063708030000000004, 2024-05-08T18:07:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.335 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:39.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:07:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360641+0000", 2024-05-08T18:07:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9273e-05 2024-05-08T18:07:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360651+0000", 2024-05-08T18:07:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0353000000000001e-05 2024-05-08T18:07:39.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360659+0000", 2024-05-08T18:07:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4789999999999999e-06 2024-05-08T18:07:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360720+0000", 2024-05-08T18:07:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699000000000007e-05 2024-05-08T18:07:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360739+0000", 2024-05-08T18:07:39.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8913999999999999e-05 2024-05-08T18:07:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366883+0000", 2024-05-08T18:07:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061438229999999996 2024-05-08T18:07:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366952+0000", 2024-05-08T18:07:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8677000000000007e-05 2024-05-08T18:07:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.339 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:76 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'54, mlcod=15'49)", 2024-05-08T18:07:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:07:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.958880727999997, 2024-05-08T18:07:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046550610000000003, 2024-05-08T18:07:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:07:39.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:07:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362318+0000", 2024-05-08T18:07:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.99e-07 2024-05-08T18:07:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362323+0000", 2024-05-08T18:07:39.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.566e-06 2024-05-08T18:07:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362334+0000", 2024-05-08T18:07:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1403000000000001e-05 2024-05-08T18:07:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362342+0000", 2024-05-08T18:07:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3420000000000008e-06 2024-05-08T18:07:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362396+0000", 2024-05-08T18:07:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3476000000000001e-05 2024-05-08T18:07:39.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362415+0000", 2024-05-08T18:07:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8787000000000002e-05 2024-05-08T18:07:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366954+0000", 2024-05-08T18:07:39.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045388609999999999 2024-05-08T18:07:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366972+0000", 2024-05-08T18:07:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8927e-05 2024-05-08T18:07:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:79 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'57, mlcod=15'53)", 2024-05-08T18:07:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:07:39.344 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.951484800000003, 2024-05-08T18:07:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045322499999999998, 2024-05-08T18:07:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.345 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:07:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:07:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369714+0000", 2024-05-08T18:07:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:07:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369787+0000", 2024-05-08T18:07:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3317000000000003e-05 2024-05-08T18:07:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369797+0000", 2024-05-08T18:07:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9510000000000001e-06 2024-05-08T18:07:39.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369802+0000", 2024-05-08T18:07:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8210000000000001e-06 2024-05-08T18:07:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369854+0000", 2024-05-08T18:07:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1751e-05 2024-05-08T18:07:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369880+0000", 2024-05-08T18:07:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6577999999999999e-05 2024-05-08T18:07:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374202+0000", 2024-05-08T18:07:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217029999999997 2024-05-08T18:07:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374246+0000", 2024-05-08T18:07:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3544000000000002e-05 2024-05-08T18:07:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.349 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:89 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'63, mlcod=15'60)", 2024-05-08T18:07:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.617942634999999, 2024-05-08T18:07:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057729900000000004, 2024-05-08T18:07:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:07:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703261+0000", 2024-05-08T18:07:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2569999999999998e-06 2024-05-08T18:07:39.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703272+0000", 2024-05-08T18:07:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0739e-05 2024-05-08T18:07:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703282+0000", 2024-05-08T18:07:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6250000000000002e-06 2024-05-08T18:07:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703333+0000", 2024-05-08T18:07:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1588000000000001e-05 2024-05-08T18:07:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703358+0000", 2024-05-08T18:07:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4913999999999999e-05 2024-05-08T18:07:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708907+0000", 2024-05-08T18:07:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055484829999999999 2024-05-08T18:07:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.709028+0000", 2024-05-08T18:07:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121667 2024-05-08T18:07:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.353 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-05-08T18:07:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:07:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.616877117999998, 2024-05-08T18:07:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0074185579999999996, 2024-05-08T18:07:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:07:39.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:07:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704322+0000", 2024-05-08T18:07:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8299999999999997e-07 2024-05-08T18:07:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704410+0000", 2024-05-08T18:07:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8552000000000002e-05 2024-05-08T18:07:39.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704421+0000", 2024-05-08T18:07:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0794e-05 2024-05-08T18:07:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704427+0000", 2024-05-08T18:07:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8699999999999997e-06 2024-05-08T18:07:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704481+0000", 2024-05-08T18:07:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4410999999999998e-05 2024-05-08T18:07:39.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704511+0000", 2024-05-08T18:07:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9906000000000001e-05 2024-05-08T18:07:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711682+0000", 2024-05-08T18:07:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071710209999999996 2024-05-08T18:07:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711740+0000", 2024-05-08T18:07:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7521e-05 2024-05-08T18:07:39.357 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:91 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'65, mlcod=15'60)", 2024-05-08T18:07:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:07:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.615332924999997, 2024-05-08T18:07:39.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059345600000000002, 2024-05-08T18:07:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:07:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:07:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705866+0000", 2024-05-08T18:07:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0900000000000001e-07 2024-05-08T18:07:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705872+0000", 2024-05-08T18:07:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0580000000000003e-06 2024-05-08T18:07:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705883+0000", 2024-05-08T18:07:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0986e-05 2024-05-08T18:07:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705889+0000", 2024-05-08T18:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6400000000000002e-06 2024-05-08T18:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705942+0000", 2024-05-08T18:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3726e-05 2024-05-08T18:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705963+0000", 2024-05-08T18:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0713e-05 2024-05-08T18:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711744+0000", 2024-05-08T18:07:39.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057812669999999997 2024-05-08T18:07:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711800+0000", 2024-05-08T18:07:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5461000000000003e-05 2024-05-08T18:07:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:92 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'66, mlcod=15'61)", 2024-05-08T18:07:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:07:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.614008577, 2024-05-08T18:07:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046553640000000004, 2024-05-08T18:07:39.362 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:07:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:07:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707191+0000", 2024-05-08T18:07:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9300000000000006e-07 2024-05-08T18:07:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707198+0000", 2024-05-08T18:07:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4669999999999998e-06 2024-05-08T18:07:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707214+0000", 2024-05-08T18:07:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5911000000000001e-05 2024-05-08T18:07:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707221+0000", 2024-05-08T18:07:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.43e-06 2024-05-08T18:07:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707283+0000", 2024-05-08T18:07:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1974e-05 2024-05-08T18:07:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707308+0000", 2024-05-08T18:07:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4589000000000001e-05 2024-05-08T18:07:39.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711802+0000", 2024-05-08T18:07:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044944939999999999 2024-05-08T18:07:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711845+0000", 2024-05-08T18:07:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2506000000000003e-05 2024-05-08T18:07:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:93 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'67, mlcod=15'61)", 2024-05-08T18:07:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:07:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.613178320000003, 2024-05-08T18:07:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217760000000003, 2024-05-08T18:07:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:07:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:07:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708021+0000", 2024-05-08T18:07:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.92e-07 2024-05-08T18:07:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708106+0000", 2024-05-08T18:07:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5400000000000002e-05 2024-05-08T18:07:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708116+0000", 2024-05-08T18:07:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0482000000000001e-05 2024-05-08T18:07:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708124+0000", 2024-05-08T18:07:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5349999999999999e-06 2024-05-08T18:07:39.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708182+0000", 2024-05-08T18:07:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8130000000000001e-05 2024-05-08T18:07:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708203+0000", 2024-05-08T18:07:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1118e-05 2024-05-08T18:07:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712298+0000", 2024-05-08T18:07:39.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004094688 2024-05-08T18:07:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712342+0000", 2024-05-08T18:07:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3730999999999999e-05 2024-05-08T18:07:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:07:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.716752253999999, 2024-05-08T18:07:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087837890000000002, 2024-05-08T18:07:39.371 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.372 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.372 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.372 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:39.372 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:39.372 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:39.372 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210 2024-05-08T18:07:39.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.372 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:07:39.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:07:39.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604448+0000", 2024-05-08T18:07:39.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4229999999999999e-06 2024-05-08T18:07:39.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604460+0000", 2024-05-08T18:07:39.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:07:39.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604491+0000", 2024-05-08T18:07:39.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1004000000000003e-05 2024-05-08T18:07:39.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604513+0000", 2024-05-08T18:07:39.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1886e-05 2024-05-08T18:07:39.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604670+0000", 2024-05-08T18:07:39.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000156735 2024-05-08T18:07:39.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:07:39.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604680+0000", 2024-05-08T18:07:39.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0113e-05 2024-05-08T18:07:39.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609236+0000", 2024-05-08T18:07:39.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045557269999999999 2024-05-08T18:07:39.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609544+0000", 2024-05-08T18:07:39.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030863800000000002 2024-05-08T18:07:39.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:39.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.610952+0000", 2024-05-08T18:07:39.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014077269999999999 2024-05-08T18:07:39.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:39.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.612639+0000", 2024-05-08T18:07:39.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001686398 2024-05-08T18:07:39.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:39.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613101+0000", 2024-05-08T18:07:39.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00046249600000000001 2024-05-08T18:07:39.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613176+0000", 2024-05-08T18:07:39.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5032999999999998e-05 2024-05-08T18:07:39.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613230+0000", 2024-05-08T18:07:39.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3638999999999999e-05 2024-05-08T18:07:39.377 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.377 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.377 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.378 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:39.378 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:07:39.378 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.668164043999999, 2024-05-08T18:07:39.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046602199999999996, 2024-05-08T18:07:39.378 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.378 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.378 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.378 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:39.378 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:39.378 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:39.378 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 222 2024-05-08T18:07:39.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.378 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:07:39.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:07:39.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653037+0000", 2024-05-08T18:07:39.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:07:39.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653048+0000", 2024-05-08T18:07:39.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:07:39.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653077+0000", 2024-05-08T18:07:39.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9326e-05 2024-05-08T18:07:39.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653098+0000", 2024-05-08T18:07:39.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1327000000000001e-05 2024-05-08T18:07:39.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653230+0000", 2024-05-08T18:07:39.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013206599999999999 2024-05-08T18:07:39.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653444+0000", 2024-05-08T18:07:39.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000213401 2024-05-08T18:07:39.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:39.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653852+0000", 2024-05-08T18:07:39.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040808700000000001 2024-05-08T18:07:39.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:39.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.656108+0000", 2024-05-08T18:07:39.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022565739999999999 2024-05-08T18:07:39.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:39.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657533+0000", 2024-05-08T18:07:39.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014241799999999999 2024-05-08T18:07:39.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657629+0000", 2024-05-08T18:07:39.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6435999999999996e-05 2024-05-08T18:07:39.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657694+0000", 2024-05-08T18:07:39.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5349000000000001e-05 2024-05-08T18:07:39.383 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.383 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.384 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.384 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:461 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:39.384 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:07:39.384 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.541542238, 2024-05-08T18:07:39.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040933549999999999, 2024-05-08T18:07:39.384 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.384 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.384 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.384 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:39.384 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:39.384 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:39.384 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 461 2024-05-08T18:07:39.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.385 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:07:39.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:07:39.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779657+0000", 2024-05-08T18:07:39.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.252e-06 2024-05-08T18:07:39.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779663+0000", 2024-05-08T18:07:39.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0170000000000002e-06 2024-05-08T18:07:39.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779676+0000", 2024-05-08T18:07:39.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.296e-05 2024-05-08T18:07:39.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779684+0000", 2024-05-08T18:07:39.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4209999999999998e-06 2024-05-08T18:07:39.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779736+0000", 2024-05-08T18:07:39.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2296999999999998e-05 2024-05-08T18:07:39.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779787+0000", 2024-05-08T18:07:39.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0954e-05 2024-05-08T18:07:39.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:39.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779897+0000", 2024-05-08T18:07:39.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011001999999999999 2024-05-08T18:07:39.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:39.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780506+0000", 2024-05-08T18:07:39.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060872599999999997 2024-05-08T18:07:39.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:39.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783690+0000", 2024-05-08T18:07:39.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031847210000000002 2024-05-08T18:07:39.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783722+0000", 2024-05-08T18:07:39.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1608e-05 2024-05-08T18:07:39.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783749+0000", 2024-05-08T18:07:39.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7379e-05 2024-05-08T18:07:39.389 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.389 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.389 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.389 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:491 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:39.389 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:07:39.390 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.519278630000001, 2024-05-08T18:07:39.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059507570000000001, 2024-05-08T18:07:39.390 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.390 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.390 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.390 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:39.390 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:39.390 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:39.390 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 491 2024-05-08T18:07:39.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.390 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:07:39.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:07:39.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801921+0000", 2024-05-08T18:07:39.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6959999999999999e-06 2024-05-08T18:07:39.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801928+0000", 2024-05-08T18:07:39.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0299999999999996e-06 2024-05-08T18:07:39.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801944+0000", 2024-05-08T18:07:39.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285e-05 2024-05-08T18:07:39.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801953+0000", 2024-05-08T18:07:39.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1849999999999993e-06 2024-05-08T18:07:39.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802008+0000", 2024-05-08T18:07:39.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5379e-05 2024-05-08T18:07:39.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802093+0000", 2024-05-08T18:07:39.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4907000000000005e-05 2024-05-08T18:07:39.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:39.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802217+0000", 2024-05-08T18:07:39.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000124253 2024-05-08T18:07:39.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:39.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802725+0000", 2024-05-08T18:07:39.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050758699999999999 2024-05-08T18:07:39.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:39.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807807+0000", 2024-05-08T18:07:39.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005082133 2024-05-08T18:07:39.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807840+0000", 2024-05-08T18:07:39.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3399000000000003e-05 2024-05-08T18:07:39.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807870+0000", 2024-05-08T18:07:39.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9903000000000002e-05 2024-05-08T18:07:39.395 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.395 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.395 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.395 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:39.395 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:07:39.395 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.512936426, 2024-05-08T18:07:39.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056057140000000004, 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 502 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:07:39.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808263+0000", 2024-05-08T18:07:39.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.054e-06 2024-05-08T18:07:39.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808268+0000", 2024-05-08T18:07:39.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4829999999999999e-06 2024-05-08T18:07:39.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808279+0000", 2024-05-08T18:07:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0710000000000001e-05 2024-05-08T18:07:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808285+0000", 2024-05-08T18:07:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0610000000000001e-06 2024-05-08T18:07:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808331+0000", 2024-05-08T18:07:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5939000000000002e-05 2024-05-08T18:07:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808380+0000", 2024-05-08T18:07:39.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9382999999999998e-05 2024-05-08T18:07:39.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:39.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808484+0000", 2024-05-08T18:07:39.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010410499999999999 2024-05-08T18:07:39.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:39.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.809035+0000", 2024-05-08T18:07:39.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000550969 2024-05-08T18:07:39.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:39.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813811+0000", 2024-05-08T18:07:39.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047759830000000001 2024-05-08T18:07:39.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813842+0000", 2024-05-08T18:07:39.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0778000000000002e-05 2024-05-08T18:07:39.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813867+0000", 2024-05-08T18:07:39.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5249000000000002e-05 2024-05-08T18:07:39.401 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.401 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.401 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.401 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:39.401 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:07:39.401 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.48640614, 2024-05-08T18:07:39.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041392019999999998, 2024-05-08T18:07:39.401 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.401 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.401 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.401 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:39.402 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:39.402 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:39.402 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 527 2024-05-08T18:07:39.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.402 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:07:39.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:07:39.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834793+0000", 2024-05-08T18:07:39.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.212e-06 2024-05-08T18:07:39.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834799+0000", 2024-05-08T18:07:39.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.468e-06 2024-05-08T18:07:39.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834811+0000", 2024-05-08T18:07:39.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2602000000000001e-05 2024-05-08T18:07:39.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834819+0000", 2024-05-08T18:07:39.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6660000000000008e-06 2024-05-08T18:07:39.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834871+0000", 2024-05-08T18:07:39.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2450000000000001e-05 2024-05-08T18:07:39.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834973+0000", 2024-05-08T18:07:39.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101778 2024-05-08T18:07:39.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:39.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835114+0000", 2024-05-08T18:07:39.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014053399999999999 2024-05-08T18:07:39.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:39.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835758+0000", 2024-05-08T18:07:39.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064386100000000002 2024-05-08T18:07:39.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:39.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838876+0000", 2024-05-08T18:07:39.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031188890000000001 2024-05-08T18:07:39.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838907+0000", 2024-05-08T18:07:39.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-08T18:07:39.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838931+0000", 2024-05-08T18:07:39.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3822999999999999e-05 2024-05-08T18:07:39.406 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.406 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.407 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.407 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:39.407 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:07:39.407 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.48190116, 2024-05-08T18:07:39.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048358089999999999, 2024-05-08T18:07:39.407 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.407 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.407 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.407 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:39.407 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:39.407 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:39.407 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 534 2024-05-08T18:07:39.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.408 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:07:39.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:07:39.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839298+0000", 2024-05-08T18:07:39.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1429999999999999e-06 2024-05-08T18:07:39.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839304+0000", 2024-05-08T18:07:39.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4380000000000003e-06 2024-05-08T18:07:39.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839313+0000", 2024-05-08T18:07:39.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5210000000000008e-06 2024-05-08T18:07:39.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839318+0000", 2024-05-08T18:07:39.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0540000000000002e-06 2024-05-08T18:07:39.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839355+0000", 2024-05-08T18:07:39.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6541999999999997e-05 2024-05-08T18:07:39.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839400+0000", 2024-05-08T18:07:39.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4861999999999998e-05 2024-05-08T18:07:39.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:39.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839504+0000", 2024-05-08T18:07:39.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104169 2024-05-08T18:07:39.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:39.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.840046+0000", 2024-05-08T18:07:39.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054245400000000005 2024-05-08T18:07:39.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:39.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844075+0000", 2024-05-08T18:07:39.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040287559999999997 2024-05-08T18:07:39.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844108+0000", 2024-05-08T18:07:39.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2872e-05 2024-05-08T18:07:39.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844133+0000", 2024-05-08T18:07:39.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4998e-05 2024-05-08T18:07:39.412 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.412 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.412 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.412 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:544 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:39.412 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:07:39.413 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.468758149999999, 2024-05-08T18:07:39.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052743060000000003, 2024-05-08T18:07:39.413 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.413 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.413 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.413 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:39.413 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:39.413 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:39.413 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 544 2024-05-08T18:07:39.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.413 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:07:39.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:07:39.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852442+0000", 2024-05-08T18:07:39.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.88e-06 2024-05-08T18:07:39.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852450+0000", 2024-05-08T18:07:39.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1999999999999994e-06 2024-05-08T18:07:39.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852472+0000", 2024-05-08T18:07:39.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2160000000000001e-05 2024-05-08T18:07:39.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852487+0000", 2024-05-08T18:07:39.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5044e-05 2024-05-08T18:07:39.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852550+0000", 2024-05-08T18:07:39.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3152999999999997e-05 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852608+0000", 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8026000000000003e-05 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852727+0000", 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118919 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.853180+0000", 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045216599999999999 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:39.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857638+0000", 2024-05-08T18:07:39.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044584510000000004 2024-05-08T18:07:39.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857672+0000", 2024-05-08T18:07:39.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3571000000000001e-05 2024-05-08T18:07:39.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857714+0000", 2024-05-08T18:07:39.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2735999999999999e-05 2024-05-08T18:07:39.418 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.418 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.418 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.418 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:39.418 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:07:39.418 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.140929371, 2024-05-08T18:07:39.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004733213, 2024-05-08T18:07:39.418 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:39.418 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:39.418 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:39.418 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:39.418 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:39.419 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:39.419 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 789 2024-05-08T18:07:39.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.419 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:39.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:39.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:07:39.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:39.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:07:39.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:39.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:39.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180271+0000", 2024-05-08T18:07:39.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8700000000000001e-06 2024-05-08T18:07:39.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:39.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180281+0000", 2024-05-08T18:07:39.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0067e-05 2024-05-08T18:07:39.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:39.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180311+0000", 2024-05-08T18:07:39.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0783e-05 2024-05-08T18:07:39.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:39.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180333+0000", 2024-05-08T18:07:39.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1509999999999999e-05 2024-05-08T18:07:39.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:39.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180450+0000", 2024-05-08T18:07:39.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116686 2024-05-08T18:07:39.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:39.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180581+0000", 2024-05-08T18:07:39.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013103499999999999 2024-05-08T18:07:39.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:39.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180848+0000", 2024-05-08T18:07:39.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026750199999999997 2024-05-08T18:07:39.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:39.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184268+0000", 2024-05-08T18:07:39.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034198319999999998 2024-05-08T18:07:39.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:39.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184844+0000", 2024-05-08T18:07:39.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057643899999999999 2024-05-08T18:07:39.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:39.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184933+0000", 2024-05-08T18:07:39.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8692999999999999e-05 2024-05-08T18:07:39.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:39.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:39.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:39.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.185002+0000", 2024-05-08T18:07:39.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8795999999999997e-05 2024-05-08T18:07:39.423 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.424 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.424 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.424 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:39.424 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:39.424 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:39.424 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:07:39.426 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:07:39.426 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:39.425+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:39.526 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:39.523+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:39.594 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:39.594 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:39.594 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:39.594 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:39.612 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:07:39.619 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:07:39.619 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:07:39.626 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:39.625+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:39.636 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:07:39.636 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:07:39.652 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:07:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:07:39.669 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:07:39.669 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:07:39.689 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:07:39.689 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:07:39.710 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:07:39.710 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:07:39.720 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:39.720 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:39.727 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:39.729+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:39.730 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:07:39.731 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:07:39.732 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:07:39.751 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:07:39.751 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:07:39.829 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:39.831+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:39.873 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:39.873 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:39.886 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:07:39.931 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:39.933+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:40.007 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:40.007 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:40.021 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:07:40.031 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:40.031+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:40.132 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:40.131+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:40.178 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:40.178 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:40.192 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:07:40.203 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.5 to 1 (10000) 2024-05-08T18:07:40.223 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-08T18:07:40.232 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:07:40.271 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:40.273+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:40.314 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:40.314 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:40.328 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:07:40.371 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:40.373+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:40.434 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:07:40.431+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:07:40.491 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:40.491 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:40.504 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:07:40.535 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:40.535+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:40.621 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:40.621 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:40.635 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:07:40.636 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:40.637+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:40.738 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:40.735+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:40.755 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:40.756 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:40.769 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:07:40.838 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:40.841+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:40.900 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:40.900 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:40.914 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:07:40.939 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:40.941+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:41.031 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:41.032 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:41.040 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:41.039+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:41.045 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:07:41.141 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:41.141+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:41.209 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.6 to 1 (10000) 2024-05-08T18:07:41.214 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:41.214 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:41.222 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-05-08T18:07:41.230 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:07:41.239 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-08T18:07:41.275 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:07:41.275+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:07:41.342 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:41.341+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:41.348 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:41.348 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:41.362 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:07:41.443 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:41.445+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:41.525 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:41.525 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:41.539 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:07:41.587 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:41.587+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:41.645 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:41.643+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:41.661 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:41.662 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:41.675 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:07:41.745 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:41.745+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:41.768 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:07:41.844 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:41.844 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:41.845 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:41.843+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:41.863 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:07:41.923 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:07:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:07:41.939 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:07:41.939 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:07:41.951 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:41.951+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:41.955 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:07:41.956 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:07:41.972 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:07:41.973 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:07:41.992 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:07:41.992 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:07:42.012 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:07:42.012 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:07:42.033 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:07:42.033 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:07:42.033 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:07:42.033 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:07:42.034 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:07:42.034 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:07:42.034 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:07:42.048 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:07:42.048 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:42.047+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:42.054 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:07:42.054 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:07:42.149 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:42.149+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:42.216 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:07:42.216 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:07:42.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:07:42.217 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:07:42.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.217 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:42.217 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:07:42.217 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.680747200999999, 2024-05-08T18:07:42.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.032012946, 2024-05-08T18:07:42.217 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.217 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.217 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.217 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.217 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:42.217 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:42.217 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:07:42.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.218 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:07:42.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:07:42.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535484+0000", 2024-05-08T18:07:42.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7929999999999999e-06 2024-05-08T18:07:42.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535500+0000", 2024-05-08T18:07:42.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5226e-05 2024-05-08T18:07:42.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535535+0000", 2024-05-08T18:07:42.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5213000000000003e-05 2024-05-08T18:07:42.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535564+0000", 2024-05-08T18:07:42.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9360999999999999e-05 2024-05-08T18:07:42.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535757+0000", 2024-05-08T18:07:42.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000193229 2024-05-08T18:07:42.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:07:42.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535775+0000", 2024-05-08T18:07:42.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7098000000000001e-05 2024-05-08T18:07:42.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556004+0000", 2024-05-08T18:07:42.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020229068999999999 2024-05-08T18:07:42.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:07:42.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556036+0000", 2024-05-08T18:07:42.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1943000000000002e-05 2024-05-08T18:07:42.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.564721+0000", 2024-05-08T18:07:42.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086853320000000005 2024-05-08T18:07:42.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565032+0000", 2024-05-08T18:07:42.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031121799999999999 2024-05-08T18:07:42.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:42.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565365+0000", 2024-05-08T18:07:42.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000332744 2024-05-08T18:07:42.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567305+0000", 2024-05-08T18:07:42.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00194016 2024-05-08T18:07:42.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567368+0000", 2024-05-08T18:07:42.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3342000000000004e-05 2024-05-08T18:07:42.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567433+0000", 2024-05-08T18:07:42.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4726000000000003e-05 2024-05-08T18:07:42.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567494+0000", 2024-05-08T18:07:42.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0492000000000003e-05 2024-05-08T18:07:42.224 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.224 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.224 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.225 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206896342016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:42.225 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:07:42.225 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.648330109, 2024-05-08T18:07:42.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026490820000000001, 2024-05-08T18:07:42.225 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.225 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.225 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.225 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.225 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:42.225 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:42.225 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 47 2024-05-08T18:07:42.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.225 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:07:42.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:07:42.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567900+0000", 2024-05-08T18:07:42.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.03e-06 2024-05-08T18:07:42.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567909+0000", 2024-05-08T18:07:42.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0389999999999993e-06 2024-05-08T18:07:42.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567947+0000", 2024-05-08T18:07:42.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8013999999999999e-05 2024-05-08T18:07:42.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567961+0000", 2024-05-08T18:07:42.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3777999999999999e-05 2024-05-08T18:07:42.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568066+0000", 2024-05-08T18:07:42.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105208 2024-05-08T18:07:42.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568176+0000", 2024-05-08T18:07:42.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011041599999999999 2024-05-08T18:07:42.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:42.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568443+0000", 2024-05-08T18:07:42.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000266846 2024-05-08T18:07:42.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.569612+0000", 2024-05-08T18:07:42.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001169156 2024-05-08T18:07:42.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570378+0000", 2024-05-08T18:07:42.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00076617799999999995 2024-05-08T18:07:42.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570457+0000", 2024-05-08T18:07:42.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8750000000000003e-05 2024-05-08T18:07:42.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570547+0000", 2024-05-08T18:07:42.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9666999999999994e-05 2024-05-08T18:07:42.230 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.230 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.230 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.230 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:42.230 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:07:42.231 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.637282837000001, 2024-05-08T18:07:42.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051182119999999996, 2024-05-08T18:07:42.231 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.231 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.231 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.231 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.231 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:42.231 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:42.231 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 54 2024-05-08T18:07:42.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.231 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:07:42.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:07:42.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578947+0000", 2024-05-08T18:07:42.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:07:42.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578957+0000", 2024-05-08T18:07:42.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6020000000000006e-06 2024-05-08T18:07:42.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578997+0000", 2024-05-08T18:07:42.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0663e-05 2024-05-08T18:07:42.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579016+0000", 2024-05-08T18:07:42.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8185e-05 2024-05-08T18:07:42.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579117+0000", 2024-05-08T18:07:42.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010117599999999999 2024-05-08T18:07:42.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579252+0000", 2024-05-08T18:07:42.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013552 2024-05-08T18:07:42.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:07:42.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579393+0000", 2024-05-08T18:07:42.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140605 2024-05-08T18:07:42.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.580414+0000", 2024-05-08T18:07:42.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010214219999999999 2024-05-08T18:07:42.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.583866+0000", 2024-05-08T18:07:42.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034512840000000002 2024-05-08T18:07:42.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.583946+0000", 2024-05-08T18:07:42.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0406000000000002e-05 2024-05-08T18:07:42.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584063+0000", 2024-05-08T18:07:42.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117199 2024-05-08T18:07:42.236 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.236 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.236 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.236 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206896337408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:42.236 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:07:42.236 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.631996109999999, 2024-05-08T18:07:42.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027716910000000002, 2024-05-08T18:07:42.237 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.237 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.237 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.237 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.237 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:07:42.237 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:42.237 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 55 2024-05-08T18:07:42.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.237 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:07:42.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:07:42.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584234+0000", 2024-05-08T18:07:42.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9259999999999999e-06 2024-05-08T18:07:42.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584244+0000", 2024-05-08T18:07:42.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0369e-05 2024-05-08T18:07:42.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584270+0000", 2024-05-08T18:07:42.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5554999999999998e-05 2024-05-08T18:07:42.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584283+0000", 2024-05-08T18:07:42.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3039e-05 2024-05-08T18:07:42.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584384+0000", 2024-05-08T18:07:42.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000100881 2024-05-08T18:07:42.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584510+0000", 2024-05-08T18:07:42.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012627100000000001 2024-05-08T18:07:42.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:07:42.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584741+0000", 2024-05-08T18:07:42.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023162899999999999 2024-05-08T18:07:42.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.585714+0000", 2024-05-08T18:07:42.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00097270500000000003 2024-05-08T18:07:42.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.586818+0000", 2024-05-08T18:07:42.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00110403 2024-05-08T18:07:42.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.586908+0000", 2024-05-08T18:07:42.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9641000000000005e-05 2024-05-08T18:07:42.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.587003+0000", 2024-05-08T18:07:42.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5644999999999997e-05 2024-05-08T18:07:42.242 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.242 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.242 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.242 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:191 6.5 e29/26 6:a2ace8b3:::data_log.0:head v 29'1, mlcod=0'0)", 2024-05-08T18:07:42.243 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:07:42.243 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.532168541000001, 2024-05-08T18:07:42.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001855095, 2024-05-08T18:07:42.243 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.243 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.243 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.243 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:07:42.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:07:42.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684061+0000", 2024-05-08T18:07:42.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:07:42.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684074+0000", 2024-05-08T18:07:42.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2479e-05 2024-05-08T18:07:42.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684104+0000", 2024-05-08T18:07:42.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0689999999999999e-05 2024-05-08T18:07:42.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684120+0000", 2024-05-08T18:07:42.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5996000000000001e-05 2024-05-08T18:07:42.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684221+0000", 2024-05-08T18:07:42.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000100647 2024-05-08T18:07:42.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684273+0000", 2024-05-08T18:07:42.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2074999999999999e-05 2024-05-08T18:07:42.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.685828+0000", 2024-05-08T18:07:42.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015553030000000001 2024-05-08T18:07:42.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.685914+0000", 2024-05-08T18:07:42.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5927999999999995e-05 2024-05-08T18:07:42.248 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.248 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.248 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.248 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-05-08T18:07:42.248 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:07:42.248 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.617130277999999, 2024-05-08T18:07:42.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003347367, 2024-05-08T18:07:42.248 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.248 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.248 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.248 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:07:42.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:07:42.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:07:42.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5300000000000003e-07 2024-05-08T18:07:42.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599110+0000", 2024-05-08T18:07:42.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1826e-05 2024-05-08T18:07:42.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599159+0000", 2024-05-08T18:07:42.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8322000000000003e-05 2024-05-08T18:07:42.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599180+0000", 2024-05-08T18:07:42.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1682e-05 2024-05-08T18:07:42.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599427+0000", 2024-05-08T18:07:42.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024721299999999998 2024-05-08T18:07:42.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599475+0000", 2024-05-08T18:07:42.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7299000000000002e-05 2024-05-08T18:07:42.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.602326+0000", 2024-05-08T18:07:42.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028516409999999998 2024-05-08T18:07:42.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.602445+0000", 2024-05-08T18:07:42.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011853099999999999 2024-05-08T18:07:42.252 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.252 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.252 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.252 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:231 6.1f e32/26 6:fde4dd55:gc::gc.26:head v 32'1, mlcod=0'0)", 2024-05-08T18:07:42.252 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:07:42.253 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.529477180000001, 2024-05-08T18:07:42.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017909390000000001, 2024-05-08T18:07:42.253 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.253 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.253 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.253 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:07:42.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:07:42.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:07:42.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5000000000000002e-07 2024-05-08T18:07:42.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686785+0000", 2024-05-08T18:07:42.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3438000000000001e-05 2024-05-08T18:07:42.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686810+0000", 2024-05-08T18:07:42.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4858000000000002e-05 2024-05-08T18:07:42.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686823+0000", 2024-05-08T18:07:42.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3417999999999999e-05 2024-05-08T18:07:42.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686989+0000", 2024-05-08T18:07:42.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016624700000000001 2024-05-08T18:07:42.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.687023+0000", 2024-05-08T18:07:42.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3396999999999999e-05 2024-05-08T18:07:42.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.688453+0000", 2024-05-08T18:07:42.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001430675 2024-05-08T18:07:42.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.688542+0000", 2024-05-08T18:07:42.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8256000000000003e-05 2024-05-08T18:07:42.257 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.257 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.257 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.258 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:292 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'4, mlcod=32'2)", 2024-05-08T18:07:42.258 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:07:42.258 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.496090461, 2024-05-08T18:07:42.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020064839999999998, 2024-05-08T18:07:42.258 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.258 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.258 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.258 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:07:42.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:07:42.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720170+0000", 2024-05-08T18:07:42.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3090999999999999e-05 2024-05-08T18:07:42.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720189+0000", 2024-05-08T18:07:42.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8077999999999999e-05 2024-05-08T18:07:42.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720222+0000", 2024-05-08T18:07:42.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3111000000000002e-05 2024-05-08T18:07:42.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720241+0000", 2024-05-08T18:07:42.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9528e-05 2024-05-08T18:07:42.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720452+0000", 2024-05-08T18:07:42.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021077300000000001 2024-05-08T18:07:42.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720505+0000", 2024-05-08T18:07:42.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2605000000000002e-05 2024-05-08T18:07:42.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.722038+0000", 2024-05-08T18:07:42.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015334630000000001 2024-05-08T18:07:42.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.722144+0000", 2024-05-08T18:07:42.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010583500000000001 2024-05-08T18:07:42.262 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.262 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.262 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.262 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:328 6.1 e32/26 6:856b9b26:reshard::reshard.0000000002:head v 32'1, mlcod=0'0)", 2024-05-08T18:07:42.262 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:07:42.262 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.49066217, 2024-05-08T18:07:42.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0018910070000000001, 2024-05-08T18:07:42.262 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.262 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.262 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.262 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:07:42.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:07:42.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:07:42.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3e-07 2024-05-08T18:07:42.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725576+0000", 2024-05-08T18:07:42.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5759999999999995e-06 2024-05-08T18:07:42.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725622+0000", 2024-05-08T18:07:42.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6196000000000003e-05 2024-05-08T18:07:42.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725642+0000", 2024-05-08T18:07:42.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9947999999999999e-05 2024-05-08T18:07:42.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.726011+0000", 2024-05-08T18:07:42.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036876699999999999 2024-05-08T18:07:42.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.726062+0000", 2024-05-08T18:07:42.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1062e-05 2024-05-08T18:07:42.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.727367+0000", 2024-05-08T18:07:42.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001304869 2024-05-08T18:07:42.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.727457+0000", 2024-05-08T18:07:42.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9858999999999995e-05 2024-05-08T18:07:42.266 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.266 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.266 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.266 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:382 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'6, mlcod=32'4)", 2024-05-08T18:07:42.266 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:07:42.266 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.477697566, 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023570779999999999, 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738532+0000", 2024-05-08T18:07:42.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.95e-06 2024-05-08T18:07:42.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738548+0000", 2024-05-08T18:07:42.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5911000000000001e-05 2024-05-08T18:07:42.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738583+0000", 2024-05-08T18:07:42.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4830999999999999e-05 2024-05-08T18:07:42.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738605+0000", 2024-05-08T18:07:42.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2005e-05 2024-05-08T18:07:42.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738747+0000", 2024-05-08T18:07:42.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014162800000000001 2024-05-08T18:07:42.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738800+0000", 2024-05-08T18:07:42.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2918999999999999e-05 2024-05-08T18:07:42.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.740802+0000", 2024-05-08T18:07:42.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020026150000000001 2024-05-08T18:07:42.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.740887+0000", 2024-05-08T18:07:42.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5218999999999998e-05 2024-05-08T18:07:42.270 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.270 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.270 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.271 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:394 6.c e32/26 6:3677c228:::obj_delete_at_hint.0000000006:head v 32'1, mlcod=0'0)", 2024-05-08T18:07:42.271 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:07:42.271 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.473032355000001, 2024-05-08T18:07:42.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026335320000000001, 2024-05-08T18:07:42.271 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.271 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.272 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.272 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:07:42.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:07:42.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743197+0000", 2024-05-08T18:07:42.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.81e-06 2024-05-08T18:07:42.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743210+0000", 2024-05-08T18:07:42.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2354999999999999e-05 2024-05-08T18:07:42.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743237+0000", 2024-05-08T18:07:42.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7328e-05 2024-05-08T18:07:42.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743256+0000", 2024-05-08T18:07:42.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8712e-05 2024-05-08T18:07:42.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743394+0000", 2024-05-08T18:07:42.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138009 2024-05-08T18:07:42.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743449+0000", 2024-05-08T18:07:42.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5371000000000002e-05 2024-05-08T18:07:42.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745754+0000", 2024-05-08T18:07:42.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002304567 2024-05-08T18:07:42.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745829+0000", 2024-05-08T18:07:42.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.538e-05 2024-05-08T18:07:42.275 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.275 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.275 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.275 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:392 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'7, mlcod=32'5)", 2024-05-08T18:07:42.276 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:07:42.276 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.472579836, 2024-05-08T18:07:42.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022345389999999998, 2024-05-08T18:07:42.276 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.276 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.276 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.276 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:07:42.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:07:42.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743650+0000", 2024-05-08T18:07:42.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1260000000000001e-06 2024-05-08T18:07:42.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743666+0000", 2024-05-08T18:07:42.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5696e-05 2024-05-08T18:07:42.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743696+0000", 2024-05-08T18:07:42.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0037999999999999e-05 2024-05-08T18:07:42.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743716+0000", 2024-05-08T18:07:42.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0251e-05 2024-05-08T18:07:42.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743838+0000", 2024-05-08T18:07:42.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012187 2024-05-08T18:07:42.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743886+0000", 2024-05-08T18:07:42.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8053000000000002e-05 2024-05-08T18:07:42.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745805+0000", 2024-05-08T18:07:42.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019189509999999999 2024-05-08T18:07:42.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745883+0000", 2024-05-08T18:07:42.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7553999999999996e-05 2024-05-08T18:07:42.279 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.280 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.280 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.280 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:453 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'4, mlcod=32'2)", 2024-05-08T18:07:42.280 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:07:42.280 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.438414656000001, 2024-05-08T18:07:42.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017625729999999999, 2024-05-08T18:07:42.280 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.280 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.280 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.280 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:07:42.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:07:42.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777815+0000", 2024-05-08T18:07:42.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6130000000000001e-06 2024-05-08T18:07:42.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777826+0000", 2024-05-08T18:07:42.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:07:42.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777852+0000", 2024-05-08T18:07:42.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6787999999999998e-05 2024-05-08T18:07:42.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777865+0000", 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2882e-05 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777961+0000", 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5280999999999998e-05 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777993+0000", 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1931999999999999e-05 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779496+0000", 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001503307 2024-05-08T18:07:42.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779576+0000", 2024-05-08T18:07:42.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9887000000000003e-05 2024-05-08T18:07:42.284 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.284 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.284 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.284 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:460 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'3, mlcod=32'1)", 2024-05-08T18:07:42.284 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:07:42.284 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.437079285999999, 2024-05-08T18:07:42.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032252579999999999, 2024-05-08T18:07:42.284 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.285 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.285 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.285 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:07:42.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:07:42.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779150+0000", 2024-05-08T18:07:42.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:07:42.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779161+0000", 2024-05-08T18:07:42.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0906e-05 2024-05-08T18:07:42.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779186+0000", 2024-05-08T18:07:42.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4861000000000001e-05 2024-05-08T18:07:42.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779198+0000", 2024-05-08T18:07:42.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1969e-05 2024-05-08T18:07:42.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779334+0000", 2024-05-08T18:07:42.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000135513 2024-05-08T18:07:42.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779396+0000", 2024-05-08T18:07:42.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2815000000000001e-05 2024-05-08T18:07:42.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.782247+0000", 2024-05-08T18:07:42.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028502200000000001 2024-05-08T18:07:42.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.782374+0000", 2024-05-08T18:07:42.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012726400000000001 2024-05-08T18:07:42.288 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.288 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.288 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.288 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:463 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-05-08T18:07:42.288 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:07:42.289 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.434733181, 2024-05-08T18:07:42.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0036423610000000002, 2024-05-08T18:07:42.289 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.289 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.289 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.289 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:07:42.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:07:42.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781497+0000", 2024-05-08T18:07:42.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.917e-06 2024-05-08T18:07:42.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781509+0000", 2024-05-08T18:07:42.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2227e-05 2024-05-08T18:07:42.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781539+0000", 2024-05-08T18:07:42.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0218000000000001e-05 2024-05-08T18:07:42.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781558+0000", 2024-05-08T18:07:42.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8918000000000001e-05 2024-05-08T18:07:42.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781660+0000", 2024-05-08T18:07:42.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101584 2024-05-08T18:07:42.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781697+0000", 2024-05-08T18:07:42.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7360000000000001e-05 2024-05-08T18:07:42.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785059+0000", 2024-05-08T18:07:42.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033618810000000002 2024-05-08T18:07:42.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785137+0000", 2024-05-08T18:07:42.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8256000000000004e-05 2024-05-08T18:07:42.293 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.293 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.293 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.293 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:466 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'4, mlcod=32'2)", 2024-05-08T18:07:42.293 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:07:42.293 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.432612928999999, 2024-05-08T18:07:42.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002137496, 2024-05-08T18:07:42.293 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.293 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.294 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.294 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:07:42.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:07:42.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783617+0000", 2024-05-08T18:07:42.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8330000000000001e-06 2024-05-08T18:07:42.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:07:42.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5872e-05 2024-05-08T18:07:42.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783668+0000", 2024-05-08T18:07:42.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5880999999999997e-05 2024-05-08T18:07:42.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783688+0000", 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9485000000000001e-05 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783819+0000", 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013098600000000001 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783865+0000", 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5711000000000003e-05 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785680+0000", 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001815374 2024-05-08T18:07:42.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785752+0000", 2024-05-08T18:07:42.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2354000000000006e-05 2024-05-08T18:07:42.297 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.297 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.297 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.297 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:469 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'10, mlcod=32'8)", 2024-05-08T18:07:42.297 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:07:42.297 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.429321939999999, 2024-05-08T18:07:42.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002120242, 2024-05-08T18:07:42.297 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.297 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.298 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.298 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:07:42.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:07:42.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786907+0000", 2024-05-08T18:07:42.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.412e-06 2024-05-08T18:07:42.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786917+0000", 2024-05-08T18:07:42.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3489999999999998e-06 2024-05-08T18:07:42.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786940+0000", 2024-05-08T18:07:42.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3019000000000001e-05 2024-05-08T18:07:42.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786951+0000", 2024-05-08T18:07:42.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0956e-05 2024-05-08T18:07:42.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.787229+0000", 2024-05-08T18:07:42.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027875000000000003 2024-05-08T18:07:42.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.787263+0000", 2024-05-08T18:07:42.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3563999999999999e-05 2024-05-08T18:07:42.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.788886+0000", 2024-05-08T18:07:42.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016228320000000001 2024-05-08T18:07:42.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.789026+0000", 2024-05-08T18:07:42.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014035999999999999 2024-05-08T18:07:42.301 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.302 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.302 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.302 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:478 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'11, mlcod=32'9)", 2024-05-08T18:07:42.302 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:07:42.302 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.425210327, 2024-05-08T18:07:42.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037403340000000001, 2024-05-08T18:07:42.302 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.302 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.302 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.303 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:07:42.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:07:42.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791019+0000", 2024-05-08T18:07:42.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5999999999999999e-06 2024-05-08T18:07:42.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791032+0000", 2024-05-08T18:07:42.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3021e-05 2024-05-08T18:07:42.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791057+0000", 2024-05-08T18:07:42.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4600000000000002e-05 2024-05-08T18:07:42.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791071+0000", 2024-05-08T18:07:42.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4756000000000001e-05 2024-05-08T18:07:42.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791185+0000", 2024-05-08T18:07:42.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011333200000000001 2024-05-08T18:07:42.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791234+0000", 2024-05-08T18:07:42.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8695e-05 2024-05-08T18:07:42.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794662+0000", 2024-05-08T18:07:42.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034282520000000001 2024-05-08T18:07:42.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794758+0000", 2024-05-08T18:07:42.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6077999999999997e-05 2024-05-08T18:07:42.307 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.307 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.307 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.307 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:829 6.5 e32/26 6:a77c5545:::obj_delete_at_hint.0000000084:head v 32'12, mlcod=32'10)", 2024-05-08T18:07:42.307 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:07:42.307 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.944041313, 2024-05-08T18:07:42.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017254, 2024-05-08T18:07:42.307 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.307 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.308 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.308 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:07:42.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:07:42.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272188+0000", 2024-05-08T18:07:42.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7269999999999999e-06 2024-05-08T18:07:42.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272229+0000", 2024-05-08T18:07:42.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0256999999999998e-05 2024-05-08T18:07:42.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272261+0000", 2024-05-08T18:07:42.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2017000000000002e-05 2024-05-08T18:07:42.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272275+0000", 2024-05-08T18:07:42.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4532000000000001e-05 2024-05-08T18:07:42.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272437+0000", 2024-05-08T18:07:42.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016199699999999999 2024-05-08T18:07:42.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272501+0000", 2024-05-08T18:07:42.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3805000000000003e-05 2024-05-08T18:07:42.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.273824+0000", 2024-05-08T18:07:42.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001323039 2024-05-08T18:07:42.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.273912+0000", 2024-05-08T18:07:42.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8026000000000001e-05 2024-05-08T18:07:42.311 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.311 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.311 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.312 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:937 6.1f e32/26 6:fd6b5df8:::obj_delete_at_hint.0000000120:head v 32'10, mlcod=32'8)", 2024-05-08T18:07:42.312 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:07:42.312 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.692805198, 2024-05-08T18:07:42.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019919009999999999, 2024-05-08T18:07:42.312 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.312 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.312 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.312 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:07:42.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:07:42.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523425+0000", 2024-05-08T18:07:42.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8560000000000001e-06 2024-05-08T18:07:42.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523437+0000", 2024-05-08T18:07:42.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2833000000000001e-05 2024-05-08T18:07:42.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523464+0000", 2024-05-08T18:07:42.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6621000000000001e-05 2024-05-08T18:07:42.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523477+0000", 2024-05-08T18:07:42.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2758999999999999e-05 2024-05-08T18:07:42.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523612+0000", 2024-05-08T18:07:42.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013525899999999999 2024-05-08T18:07:42.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523679+0000", 2024-05-08T18:07:42.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6964000000000005e-05 2024-05-08T18:07:42.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.525312+0000", 2024-05-08T18:07:42.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016331 2024-05-08T18:07:42.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.525415+0000", 2024-05-08T18:07:42.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000102509 2024-05-08T18:07:42.315 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.316 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.316 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.316 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.316 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.316 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:07:42.317 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.7 to 1 (10000) 2024-05-08T18:07:42.318 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:07:42.318 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-08T18:07:42.318 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:07:42.319 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:42.317+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:42.418 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:42.415+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:42.445 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:07:42.445 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:07:42.445 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:07:42.445 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:07:42.459 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:07:42.519 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:42.521+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:42.620 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:42.621+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:42.632 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:07:42.632 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:07:42.632 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:07:42.632 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:07:42.632 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:07:42.645 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:07:42.680 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:07:42.686 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:07:42.696 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-05-08T18:07:42.235430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":528,"num_write_kb":1668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221016,"kb_used_data":4832,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753704,"statfs":{"total":773094113280,"available":772867792896,"internally_reserved":0,"allocated":4947968,"data_stored":2835562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.044089"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241745+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:07:40.241745+0000","last_peered":"2024-05-08T18:07:40.241745+0000","last_clean":"2024-05-08T18:07:40.241745+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:07:40.241745+0000","last_undegraded":"2024-05-08T18:07:40.241745+0000","last_fullsized":"2024-05-08T18:07:40.241745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235146+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:07:40.235146+0000","last_peered":"2024-05-08T18:07:40.235146+0000","last_clean":"2024-05-08T18:07:40.235146+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:07:40.235146+0000","last_undegraded":"2024-05-08T18:07:40.235146+0000","last_fullsized":"2024-05-08T18:07:40.235146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224125+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:07:41.224125+0000","last_peered":"2024-05-08T18:07:41.224125+0000","last_clean":"2024-05-08T18:07:41.224125+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:07:41.224125+0000","last_undegraded":"2024-05-08T18:07:41.224125+0000","last_fullsized":"2024-05-08T18:07:41.224125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238246+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:07:40.238246+0000","last_peered":"2024-05-08T18:07:40.238246+0000","last_clean":"2024-05-08T18:07:40.238246+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:07:40.238246+0000","last_undegraded":"2024-05-08T18:07:40.238246+0000","last_fullsized":"2024-05-08T18:07:40.238246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236150+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:07:40.236150+0000","last_peered":"2024-05-08T18:07:40.236150+0000","last_clean":"2024-05-08T18:07:40.236150+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:07:40.236150+0000","last_undegraded":"2024-05-08T18:07:40.236150+0000","last_fullsized":"2024-05-08T18:07:40.236150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219670+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:07:41.219670+0000","last_peered":"2024-05-08T18:07:41.219670+0000","last_clean":"2024-05-08T18:07:41.219670+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:07:41.219670+0000","last_undegraded":"2024-05-08T18:07:41.219670+0000","last_fullsized":"2024-05-08T18:07:41.219670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236858+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:07:40.236858+0000","last_peered":"2024-05-08T18:07:40.236858+0000","last_clean":"2024-05-08T18:07:40.236858+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:07:40.236858+0000","last_undegraded":"2024-05-08T18:07:40.236858+0000","last_fullsized":"2024-05-08T18:07:40.236858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235497+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:07:40.235497+0000","last_peered":"2024-05-08T18:07:40.235497+0000","last_clean":"2024-05-08T18:07:40.235497+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:07:40.235497+0000","last_undegraded":"2024-05-08T18:07:40.235497+0000","last_fullsized":"2024-05-08T18:07:40.235497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238484+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:07:40.238484+0000","last_peered":"2024-05-08T18:07:40.238484+0000","last_clean":"2024-05-08T18:07:40.238484+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:07:40.238484+0000","last_undegraded":"2024-05-08T18:07:40.238484+0000","last_fullsized":"2024-05-08T18:07:40.238484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201643+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:07:40.201643+0000","last_peered":"2024-05-08T18:07:40.201643+0000","last_clean":"2024-05-08T18:07:40.201643+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:07:40.201643+0000","last_undegraded":"2024-05-08T18:07:40.201643+0000","last_fullsized":"2024-05-08T18:07:40.201643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238380+0000","last_change":"2024-05-08T18:07:15.502659+0000","last_active":"2024-05-08T18:07:40.238380+0000","last_peered":"2024-05-08T18:07:40.238380+0000","last_clean":"2024-05-08T18:07:40.238380+0000","last_became_active":"2024-05-08T18:07:15.501947+0000","last_became_peered":"2024-05-08T18:07:15.501947+0000","last_unstale":"2024-05-08T18:07:40.238380+0000","last_undegraded":"2024-05-08T18:07:40.238380+0000","last_fullsized":"2024-05-08T18:07:40.238380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221139+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:07:41.221139+0000","last_peered":"2024-05-08T18:07:41.221139+0000","last_clean":"2024-05-08T18:07:41.221139+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:07:41.221139+0000","last_undegraded":"2024-05-08T18:07:41.221139+0000","last_fullsized":"2024-05-08T18:07:41.221139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238846+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:07:40.238846+0000","last_peered":"2024-05-08T18:07:40.238846+0000","last_clean":"2024-05-08T18:07:40.238846+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:07:40.238846+0000","last_undegraded":"2024-05-08T18:07:40.238846+0000","last_fullsized":"2024-05-08T18:07:40.238846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241317+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:07:40.241317+0000","last_peered":"2024-05-08T18:07:40.241317+0000","last_clean":"2024-05-08T18:07:40.241317+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:07:40.241317+0000","last_undegraded":"2024-05-08T18:07:40.241317+0000","last_fullsized":"2024-05-08T18:07:40.241317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223365+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:07:41.223365+0000","last_peered":"2024-05-08T18:07:41.223365+0000","last_clean":"2024-05-08T18:07:41.223365+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:07:41.223365+0000","last_undegraded":"2024-05-08T18:07:41.223365+0000","last_fullsized":"2024-05-08T18:07:41.223365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.205153+0000","last_change":"2024-05-08T18:07:17.508968+0000","last_active":"2024-05-08T18:07:40.205153+0000","last_peered":"2024-05-08T18:07:40.205153+0000","last_clean":"2024-05-08T18:07:40.205153+0000","last_became_active":"2024-05-08T18:07:17.508588+0000","last_became_peered":"2024-05-08T18:07:17.508588+0000","last_unstale":"2024-05-08T18:07:40.205153+0000","last_undegraded":"2024-05-08T18:07:40.205153+0000","last_fullsized":"2024-05-08T18:07:40.205153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:08.890984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218904+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:07:41.218904+0000","last_peered":"2024-05-08T18:07:41.218904+0000","last_clean":"2024-05-08T18:07:41.218904+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:07:41.218904+0000","last_undegraded":"2024-05-08T18:07:41.218904+0000","last_fullsized":"2024-05-08T18:07:41.218904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241957+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:07:40.241957+0000","last_peered":"2024-05-08T18:07:40.241957+0000","last_clean":"2024-05-08T18:07:40.241957+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:07:40.241957+0000","last_undegraded":"2024-05-08T18:07:40.241957+0000","last_fullsized":"2024-05-08T18:07:40.241957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238489+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:07:40.238489+0000","last_peered":"2024-05-08T18:07:40.238489+0000","last_clean":"2024-05-08T18:07:40.238489+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:07:40.238489+0000","last_undegraded":"2024-05-08T18:07:40.238489+0000","last_fullsized":"2024-05-08T18:07:40.238489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201894+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:07:40.201894+0000","last_peered":"2024-05-08T18:07:40.201894+0000","last_clean":"2024-05-08T18:07:40.201894+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:07:40.201894+0000","last_undegraded":"2024-05-08T18:07:40.201894+0000","last_fullsized":"2024-05-08T18:07:40.201894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238769+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:07:40.238769+0000","last_peered":"2024-05-08T18:07:40.238769+0000","last_clean":"2024-05-08T18:07:40.238769+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:07:40.238769+0000","last_undegraded":"2024-05-08T18:07:40.238769+0000","last_fullsized":"2024-05-08T18:07:40.238769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202086+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:07:40.202086+0000","last_peered":"2024-05-08T18:07:40.202086+0000","last_clean":"2024-05-08T18:07:40.202086+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:07:40.202086+0000","last_undegraded":"2024-05-08T18:07:40.202086+0000","last_fullsized":"2024-05-08T18:07:40.202086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204767+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:07:40.204767+0000","last_peered":"2024-05-08T18:07:40.204767+0000","last_clean":"2024-05-08T18:07:40.204767+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:07:40.204767+0000","last_undegraded":"2024-05-08T18:07:40.204767+0000","last_fullsized":"2024-05-08T18:07:40.204767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219930+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:07:41.219930+0000","last_peered":"2024-05-08T18:07:41.219930+0000","last_clean":"2024-05-08T18:07:41.219930+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:07:41.219930+0000","last_undegraded":"2024-05-08T18:07:41.219930+0000","last_fullsized":"2024-05-08T18:07:41.219930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206077+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:07:40.206077+0000","last_peered":"2024-05-08T18:07:40.206077+0000","last_clean":"2024-05-08T18:07:40.206077+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:07:40.206077+0000","last_undegraded":"2024-05-08T18:07:40.206077+0000","last_fullsized":"2024-05-08T18:07:40.206077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223830+0000","last_change":"2024-05-08T18:07:15.480500+0000","last_active":"2024-05-08T18:07:41.223830+0000","last_peered":"2024-05-08T18:07:41.223830+0000","last_clean":"2024-05-08T18:07:41.223830+0000","last_became_active":"2024-05-08T18:07:15.480192+0000","last_became_peered":"2024-05-08T18:07:15.480192+0000","last_unstale":"2024-05-08T18:07:41.223830+0000","last_undegraded":"2024-05-08T18:07:41.223830+0000","last_fullsized":"2024-05-08T18:07:41.223830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221336+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:07:41.221336+0000","last_peered":"2024-05-08T18:07:41.221336+0000","last_clean":"2024-05-08T18:07:41.221336+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:07:41.221336+0000","last_undegraded":"2024-05-08T18:07:41.221336+0000","last_fullsized":"2024-05-08T18:07:41.221336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236024+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:07:40.236024+0000","last_peered":"2024-05-08T18:07:40.236024+0000","last_clean":"2024-05-08T18:07:40.236024+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:07:40.236024+0000","last_undegraded":"2024-05-08T18:07:40.236024+0000","last_fullsized":"2024-05-08T18:07:40.236024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218463+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:07:41.218463+0000","last_peered":"2024-05-08T18:07:41.218463+0000","last_clean":"2024-05-08T18:07:41.218463+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:07:41.218463+0000","last_undegraded":"2024-05-08T18:07:41.218463+0000","last_fullsized":"2024-05-08T18:07:41.218463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.228275+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:07:41.228275+0000","last_peered":"2024-05-08T18:07:41.228275+0000","last_clean":"2024-05-08T18:07:41.228275+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:07:41.228275+0000","last_undegraded":"2024-05-08T18:07:41.228275+0000","last_fullsized":"2024-05-08T18:07:41.228275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238633+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:07:40.238633+0000","last_peered":"2024-05-08T18:07:40.238633+0000","last_clean":"2024-05-08T18:07:40.238633+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:07:40.238633+0000","last_undegraded":"2024-05-08T18:07:40.238633+0000","last_fullsized":"2024-05-08T18:07:40.238633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239977+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:07:40.239977+0000","last_peered":"2024-05-08T18:07:40.239977+0000","last_clean":"2024-05-08T18:07:40.239977+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:07:40.239977+0000","last_undegraded":"2024-05-08T18:07:40.239977+0000","last_fullsized":"2024-05-08T18:07:40.239977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236168+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:07:40.236168+0000","last_peered":"2024-05-08T18:07:40.236168+0000","last_clean":"2024-05-08T18:07:40.236168+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:07:40.236168+0000","last_undegraded":"2024-05-08T18:07:40.236168+0000","last_fullsized":"2024-05-08T18:07:40.236168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241238+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:07:40.241238+0000","last_peered":"2024-05-08T18:07:40.241238+0000","last_clean":"2024-05-08T18:07:40.241238+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:07:40.241238+0000","last_undegraded":"2024-05-08T18:07:40.241238+0000","last_fullsized":"2024-05-08T18:07:40.241238+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238562+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:07:40.238562+0000","last_peered":"2024-05-08T18:07:40.238562+0000","last_clean":"2024-05-08T18:07:40.238562+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:07:40.238562+0000","last_undegraded":"2024-05-08T18:07:40.238562+0000","last_fullsized":"2024-05-08T18:07:40.238562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240560+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:07:40.240560+0000","last_peered":"2024-05-08T18:07:40.240560+0000","last_clean":"2024-05-08T18:07:40.240560+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:07:40.240560+0000","last_undegraded":"2024-05-08T18:07:40.240560+0000","last_fullsized":"2024-05-08T18:07:40.240560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236106+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:07:40.236106+0000","last_peered":"2024-05-08T18:07:40.236106+0000","last_clean":"2024-05-08T18:07:40.236106+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:07:40.236106+0000","last_undegraded":"2024-05-08T18:07:40.236106+0000","last_fullsized":"2024-05-08T18:07:40.236106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.227952+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:07:41.227952+0000","last_peered":"2024-05-08T18:07:41.227952+0000","last_clean":"2024-05-08T18:07:41.227952+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:07:41.227952+0000","last_undegraded":"2024-05-08T18:07:41.227952+0000","last_fullsized":"2024-05-08T18:07:41.227952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221217+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:07:41.221217+0000","last_peered":"2024-05-08T18:07:41.221217+0000","last_clean":"2024-05-08T18:07:41.221217+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:07:41.221217+0000","last_undegraded":"2024-05-08T18:07:41.221217+0000","last_fullsized":"2024-05-08T18:07:41.221217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221065+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:07:41.221065+0000","last_peered":"2024-05-08T18:07:41.221065+0000","last_clean":"2024-05-08T18:07:41.221065+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:07:41.221065+0000","last_undegraded":"2024-05-08T18:07:41.221065+0000","last_fullsized":"2024-05-08T18:07:41.221065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235765+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:07:40.235765+0000","last_peered":"2024-05-08T18:07:40.235765+0000","last_clean":"2024-05-08T18:07:40.235765+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:07:40.235765+0000","last_undegraded":"2024-05-08T18:07:40.235765+0000","last_fullsized":"2024-05-08T18:07:40.235765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236901+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:07:40.236901+0000","last_peered":"2024-05-08T18:07:40.236901+0000","last_clean":"2024-05-08T18:07:40.236901+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:07:40.236901+0000","last_undegraded":"2024-05-08T18:07:40.236901+0000","last_fullsized":"2024-05-08T18:07:40.236901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239199+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:07:40.239199+0000","last_peered":"2024-05-08T18:07:40.239199+0000","last_clean":"2024-05-08T18:07:40.239199+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:07:40.239199+0000","last_undegraded":"2024-05-08T18:07:40.239199+0000","last_fullsized":"2024-05-08T18:07:40.239199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225439+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:07:41.225439+0000","last_peered":"2024-05-08T18:07:41.225439+0000","last_clean":"2024-05-08T18:07:41.225439+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:07:41.225439+0000","last_undegraded":"2024-05-08T18:07:41.225439+0000","last_fullsized":"2024-05-08T18:07:41.225439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.205615+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:07:40.205615+0000","last_peered":"2024-05-08T18:07:40.205615+0000","last_clean":"2024-05-08T18:07:40.205615+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:07:40.205615+0000","last_undegraded":"2024-05-08T18:07:40.205615+0000","last_fullsized":"2024-05-08T18:07:40.205615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239291+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:07:40.239291+0000","last_peered":"2024-05-08T18:07:40.239291+0000","last_clean":"2024-05-08T18:07:40.239291+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:07:40.239291+0000","last_undegraded":"2024-05-08T18:07:40.239291+0000","last_fullsized":"2024-05-08T18:07:40.239291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218981+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:07:41.218981+0000","last_peered":"2024-05-08T18:07:41.218981+0000","last_clean":"2024-05-08T18:07:41.218981+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:07:41.218981+0000","last_undegraded":"2024-05-08T18:07:41.218981+0000","last_fullsized":"2024-05-08T18:07:41.218981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224996+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:07:41.224996+0000","last_peered":"2024-05-08T18:07:41.224996+0000","last_clean":"2024-05-08T18:07:41.224996+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:07:41.224996+0000","last_undegraded":"2024-05-08T18:07:41.224996+0000","last_fullsized":"2024-05-08T18:07:41.224996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.200795+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:07:40.200795+0000","last_peered":"2024-05-08T18:07:40.200795+0000","last_clean":"2024-05-08T18:07:40.200795+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:07:40.200795+0000","last_undegraded":"2024-05-08T18:07:40.200795+0000","last_fullsized":"2024-05-08T18:07:40.200795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241308+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:07:40.241308+0000","last_peered":"2024-05-08T18:07:40.241308+0000","last_clean":"2024-05-08T18:07:40.241308+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:07:40.241308+0000","last_undegraded":"2024-05-08T18:07:40.241308+0000","last_fullsized":"2024-05-08T18:07:40.241308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240181+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:07:40.240181+0000","last_peered":"2024-05-08T18:07:40.240181+0000","last_clean":"2024-05-08T18:07:40.240181+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:07:40.240181+0000","last_undegraded":"2024-05-08T18:07:40.240181+0000","last_fullsized":"2024-05-08T18:07:40.240181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223675+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:07:41.223675+0000","last_peered":"2024-05-08T18:07:41.223675+0000","last_clean":"2024-05-08T18:07:41.223675+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:07:41.223675+0000","last_undegraded":"2024-05-08T18:07:41.223675+0000","last_fullsized":"2024-05-08T18:07:41.223675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235814+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:07:40.235814+0000","last_peered":"2024-05-08T18:07:40.235814+0000","last_clean":"2024-05-08T18:07:40.235814+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:07:40.235814+0000","last_undegraded":"2024-05-08T18:07:40.235814+0000","last_fullsized":"2024-05-08T18:07:40.235814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.242078+0000","last_change":"2024-05-08T18:07:15.515622+0000","last_active":"2024-05-08T18:07:40.242078+0000","last_peered":"2024-05-08T18:07:40.242078+0000","last_clean":"2024-05-08T18:07:40.242078+0000","last_became_active":"2024-05-08T18:07:15.515050+0000","last_became_peered":"2024-05-08T18:07:15.515050+0000","last_unstale":"2024-05-08T18:07:40.242078+0000","last_undegraded":"2024-05-08T18:07:40.242078+0000","last_fullsized":"2024-05-08T18:07:40.242078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237648+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:07:40.237648+0000","last_peered":"2024-05-08T18:07:40.237648+0000","last_clean":"2024-05-08T18:07:40.237648+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:07:40.237648+0000","last_undegraded":"2024-05-08T18:07:40.237648+0000","last_fullsized":"2024-05-08T18:07:40.237648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":63,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235270+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:07:40.235270+0000","last_peered":"2024-05-08T18:07:40.235270+0000","last_clean":"2024-05-08T18:07:40.235270+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:07:40.235270+0000","last_undegraded":"2024-05-08T18:07:40.235270+0000","last_fullsized":"2024-05-08T18:07:40.235270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224035+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:07:41.224035+0000","last_peered":"2024-05-08T18:07:41.224035+0000","last_clean":"2024-05-08T18:07:41.224035+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:07:41.224035+0000","last_undegraded":"2024-05-08T18:07:41.224035+0000","last_fullsized":"2024-05-08T18:07:41.224035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236214+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:07:40.236214+0000","last_peered":"2024-05-08T18:07:40.236214+0000","last_clean":"2024-05-08T18:07:40.236214+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:07:40.236214+0000","last_undegraded":"2024-05-08T18:07:40.236214+0000","last_fullsized":"2024-05-08T18:07:40.236214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218965+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:07:41.218965+0000","last_peered":"2024-05-08T18:07:41.218965+0000","last_clean":"2024-05-08T18:07:41.218965+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:07:41.218965+0000","last_undegraded":"2024-05-08T18:07:41.218965+0000","last_fullsized":"2024-05-08T18:07:41.218965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241551+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:07:40.241551+0000","last_peered":"2024-05-08T18:07:40.241551+0000","last_clean":"2024-05-08T18:07:40.241551+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:07:40.241551+0000","last_undegraded":"2024-05-08T18:07:40.241551+0000","last_fullsized":"2024-05-08T18:07:40.241551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204671+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:07:40.204671+0000","last_peered":"2024-05-08T18:07:40.204671+0000","last_clean":"2024-05-08T18:07:40.204671+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:07:40.204671+0000","last_undegraded":"2024-05-08T18:07:40.204671+0000","last_fullsized":"2024-05-08T18:07:40.204671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224224+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:07:41.224224+0000","last_peered":"2024-05-08T18:07:41.224224+0000","last_clean":"2024-05-08T18:07:41.224224+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:07:41.224224+0000","last_undegraded":"2024-05-08T18:07:41.224224+0000","last_fullsized":"2024-05-08T18:07:41.224224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222963+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:07:41.222963+0000","last_peered":"2024-05-08T18:07:41.222963+0000","last_clean":"2024-05-08T18:07:41.222963+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:07:41.222963+0000","last_undegraded":"2024-05-08T18:07:41.222963+0000","last_fullsized":"2024-05-08T18:07:41.222963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201029+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:07:40.201029+0000","last_peered":"2024-05-08T18:07:40.201029+0000","last_clean":"2024-05-08T18:07:40.201029+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:07:40.201029+0000","last_undegraded":"2024-05-08T18:07:40.201029+0000","last_fullsized":"2024-05-08T18:07:40.201029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201874+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:07:40.201874+0000","last_peered":"2024-05-08T18:07:40.201874+0000","last_clean":"2024-05-08T18:07:40.201874+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:07:40.201874+0000","last_undegraded":"2024-05-08T18:07:40.201874+0000","last_fullsized":"2024-05-08T18:07:40.201874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240446+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:07:40.240446+0000","last_peered":"2024-05-08T18:07:40.240446+0000","last_clean":"2024-05-08T18:07:40.240446+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:07:40.240446+0000","last_undegraded":"2024-05-08T18:07:40.240446+0000","last_fullsized":"2024-05-08T18:07:40.240446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204923+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:07:40.204923+0000","last_peered":"2024-05-08T18:07:40.204923+0000","last_clean":"2024-05-08T18:07:40.204923+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:07:40.204923+0000","last_undegraded":"2024-05-08T18:07:40.204923+0000","last_fullsized":"2024-05-08T18:07:40.204923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236245+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:07:40.236245+0000","last_peered":"2024-05-08T18:07:40.236245+0000","last_clean":"2024-05-08T18:07:40.236245+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:07:40.236245+0000","last_undegraded":"2024-05-08T18:07:40.236245+0000","last_fullsized":"2024-05-08T18:07:40.236245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235169+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:07:40.235169+0000","last_peered":"2024-05-08T18:07:40.235169+0000","last_clean":"2024-05-08T18:07:40.235169+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:07:40.235169+0000","last_undegraded":"2024-05-08T18:07:40.235169+0000","last_fullsized":"2024-05-08T18:07:40.235169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236219+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:07:40.236219+0000","last_peered":"2024-05-08T18:07:40.236219+0000","last_clean":"2024-05-08T18:07:40.236219+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:07:40.236219+0000","last_undegraded":"2024-05-08T18:07:40.236219+0000","last_fullsized":"2024-05-08T18:07:40.236219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235885+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:07:40.235885+0000","last_peered":"2024-05-08T18:07:40.235885+0000","last_clean":"2024-05-08T18:07:40.235885+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:07:40.235885+0000","last_undegraded":"2024-05-08T18:07:40.235885+0000","last_fullsized":"2024-05-08T18:07:40.235885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237462+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:07:40.237462+0000","last_peered":"2024-05-08T18:07:40.237462+0000","last_clean":"2024-05-08T18:07:40.237462+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:07:40.237462+0000","last_undegraded":"2024-05-08T18:07:40.237462+0000","last_fullsized":"2024-05-08T18:07:40.237462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204614+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:07:40.204614+0000","last_peered":"2024-05-08T18:07:40.204614+0000","last_clean":"2024-05-08T18:07:40.204614+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:07:40.204614+0000","last_undegraded":"2024-05-08T18:07:40.204614+0000","last_fullsized":"2024-05-08T18:07:40.204614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235490+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:07:40.235490+0000","last_peered":"2024-05-08T18:07:40.235490+0000","last_clean":"2024-05-08T18:07:40.235490+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:07:40.235490+0000","last_undegraded":"2024-05-08T18:07:40.235490+0000","last_fullsized":"2024-05-08T18:07:40.235490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204419+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:07:40.204419+0000","last_peered":"2024-05-08T18:07:40.204419+0000","last_clean":"2024-05-08T18:07:40.204419+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:07:40.204419+0000","last_undegraded":"2024-05-08T18:07:40.204419+0000","last_fullsized":"2024-05-08T18:07:40.204419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224407+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:07:41.224407+0000","last_peered":"2024-05-08T18:07:41.224407+0000","last_clean":"2024-05-08T18:07:41.224407+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:07:41.224407+0000","last_undegraded":"2024-05-08T18:07:41.224407+0000","last_fullsized":"2024-05-08T18:07:41.224407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220409+0000","last_change":"2024-05-08T18:07:17.495459+0000","last_active":"2024-05-08T18:07:41.220409+0000","last_peered":"2024-05-08T18:07:41.220409+0000","last_clean":"2024-05-08T18:07:41.220409+0000","last_became_active":"2024-05-08T18:07:17.494659+0000","last_became_peered":"2024-05-08T18:07:17.494659+0000","last_unstale":"2024-05-08T18:07:41.220409+0000","last_undegraded":"2024-05-08T18:07:41.220409+0000","last_fullsized":"2024-05-08T18:07:41.220409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223329+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:07:41.223329+0000","last_peered":"2024-05-08T18:07:41.223329+0000","last_clean":"2024-05-08T18:07:41.223329+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:07:41.223329+0000","last_undegraded":"2024-05-08T18:07:41.223329+0000","last_fullsized":"2024-05-08T18:07:41.223329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206221+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:07:40.206221+0000","last_peered":"2024-05-08T18:07:40.206221+0000","last_clean":"2024-05-08T18:07:40.206221+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:07:40.206221+0000","last_undegraded":"2024-05-08T18:07:40.206221+0000","last_fullsized":"2024-05-08T18:07:40.206221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221218+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:07:41.221218+0000","last_peered":"2024-05-08T18:07:41.221218+0000","last_clean":"2024-05-08T18:07:41.221218+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:07:41.221218+0000","last_undegraded":"2024-05-08T18:07:41.221218+0000","last_fullsized":"2024-05-08T18:07:41.221218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236262+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:07:40.236262+0000","last_peered":"2024-05-08T18:07:40.236262+0000","last_clean":"2024-05-08T18:07:40.236262+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:07:40.236262+0000","last_undegraded":"2024-05-08T18:07:40.236262+0000","last_fullsized":"2024-05-08T18:07:40.236262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222041+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:07:41.222041+0000","last_peered":"2024-05-08T18:07:41.222041+0000","last_clean":"2024-05-08T18:07:41.222041+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:07:41.222041+0000","last_undegraded":"2024-05-08T18:07:41.222041+0000","last_fullsized":"2024-05-08T18:07:41.222041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221320+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:07:41.221320+0000","last_peered":"2024-05-08T18:07:41.221320+0000","last_clean":"2024-05-08T18:07:41.221320+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:07:41.221320+0000","last_undegraded":"2024-05-08T18:07:41.221320+0000","last_fullsized":"2024-05-08T18:07:41.221320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202382+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:07:40.202382+0000","last_peered":"2024-05-08T18:07:40.202382+0000","last_clean":"2024-05-08T18:07:40.202382+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:07:40.202382+0000","last_undegraded":"2024-05-08T18:07:40.202382+0000","last_fullsized":"2024-05-08T18:07:40.202382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224189+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:07:41.224189+0000","last_peered":"2024-05-08T18:07:41.224189+0000","last_clean":"2024-05-08T18:07:41.224189+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:07:41.224189+0000","last_undegraded":"2024-05-08T18:07:41.224189+0000","last_fullsized":"2024-05-08T18:07:41.224189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.205114+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:07:40.205114+0000","last_peered":"2024-05-08T18:07:40.205114+0000","last_clean":"2024-05-08T18:07:40.205114+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:07:40.205114+0000","last_undegraded":"2024-05-08T18:07:40.205114+0000","last_fullsized":"2024-05-08T18:07:40.205114+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206369+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:07:40.206369+0000","last_peered":"2024-05-08T18:07:40.206369+0000","last_clean":"2024-05-08T18:07:40.206369+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:07:40.206369+0000","last_undegraded":"2024-05-08T18:07:40.206369+0000","last_fullsized":"2024-05-08T18:07:40.206369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222447+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:07:41.222447+0000","last_peered":"2024-05-08T18:07:41.222447+0000","last_clean":"2024-05-08T18:07:41.222447+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:07:41.222447+0000","last_undegraded":"2024-05-08T18:07:41.222447+0000","last_fullsized":"2024-05-08T18:07:41.222447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221664+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:07:41.221664+0000","last_peered":"2024-05-08T18:07:41.221664+0000","last_clean":"2024-05-08T18:07:41.221664+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:07:41.221664+0000","last_undegraded":"2024-05-08T18:07:41.221664+0000","last_fullsized":"2024-05-08T18:07:41.221664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219629+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:07:41.219629+0000","last_peered":"2024-05-08T18:07:41.219629+0000","last_clean":"2024-05-08T18:07:41.219629+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:07:41.219629+0000","last_undegraded":"2024-05-08T18:07:41.219629+0000","last_fullsized":"2024-05-08T18:07:41.219629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240482+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:07:40.240482+0000","last_peered":"2024-05-08T18:07:40.240482+0000","last_clean":"2024-05-08T18:07:40.240482+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:07:40.240482+0000","last_undegraded":"2024-05-08T18:07:40.240482+0000","last_fullsized":"2024-05-08T18:07:40.240482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223976+0000","last_change":"2024-05-08T18:07:21.533056+0000","last_active":"2024-05-08T18:07:41.223976+0000","last_peered":"2024-05-08T18:07:41.223976+0000","last_clean":"2024-05-08T18:07:41.223976+0000","last_became_active":"2024-05-08T18:07:21.532184+0000","last_became_peered":"2024-05-08T18:07:21.532184+0000","last_unstale":"2024-05-08T18:07:41.223976+0000","last_undegraded":"2024-05-08T18:07:41.223976+0000","last_fullsized":"2024-05-08T18:07:41.223976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:50.629014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201470+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:07:40.201470+0000","last_peered":"2024-05-08T18:07:40.201470+0000","last_clean":"2024-05-08T18:07:40.201470+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:07:40.201470+0000","last_undegraded":"2024-05-08T18:07:40.201470+0000","last_fullsized":"2024-05-08T18:07:40.201470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219407+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:07:41.219407+0000","last_peered":"2024-05-08T18:07:41.219407+0000","last_clean":"2024-05-08T18:07:41.219407+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:07:41.219407+0000","last_undegraded":"2024-05-08T18:07:41.219407+0000","last_fullsized":"2024-05-08T18:07:41.219407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225198+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:07:41.225198+0000","last_peered":"2024-05-08T18:07:41.225198+0000","last_clean":"2024-05-08T18:07:41.225198+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:07:41.225198+0000","last_undegraded":"2024-05-08T18:07:41.225198+0000","last_fullsized":"2024-05-08T18:07:41.225198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223858+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:07:41.223858+0000","last_peered":"2024-05-08T18:07:41.223858+0000","last_clean":"2024-05-08T18:07:41.223858+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:07:41.223858+0000","last_undegraded":"2024-05-08T18:07:41.223858+0000","last_fullsized":"2024-05-08T18:07:41.223858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221524+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:07:41.221524+0000","last_peered":"2024-05-08T18:07:41.221524+0000","last_clean":"2024-05-08T18:07:41.221524+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:07:41.221524+0000","last_undegraded":"2024-05-08T18:07:41.221524+0000","last_fullsized":"2024-05-08T18:07:41.221524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236236+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:07:40.236236+0000","last_peered":"2024-05-08T18:07:40.236236+0000","last_clean":"2024-05-08T18:07:40.236236+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:07:40.236236+0000","last_undegraded":"2024-05-08T18:07:40.236236+0000","last_fullsized":"2024-05-08T18:07:40.236236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201182+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:07:40.201182+0000","last_peered":"2024-05-08T18:07:40.201182+0000","last_clean":"2024-05-08T18:07:40.201182+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:07:40.201182+0000","last_undegraded":"2024-05-08T18:07:40.201182+0000","last_fullsized":"2024-05-08T18:07:40.201182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223902+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:07:41.223902+0000","last_peered":"2024-05-08T18:07:41.223902+0000","last_clean":"2024-05-08T18:07:41.223902+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:07:41.223902+0000","last_undegraded":"2024-05-08T18:07:41.223902+0000","last_fullsized":"2024-05-08T18:07:41.223902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201817+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:07:40.201817+0000","last_peered":"2024-05-08T18:07:40.201817+0000","last_clean":"2024-05-08T18:07:40.201817+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:07:40.201817+0000","last_undegraded":"2024-05-08T18:07:40.201817+0000","last_fullsized":"2024-05-08T18:07:40.201817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":146,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236507+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:07:40.236507+0000","last_peered":"2024-05-08T18:07:40.236507+0000","last_clean":"2024-05-08T18:07:40.236507+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:07:40.236507+0000","last_undegraded":"2024-05-08T18:07:40.236507+0000","last_fullsized":"2024-05-08T18:07:40.236507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237052+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:07:40.237052+0000","last_peered":"2024-05-08T18:07:40.237052+0000","last_clean":"2024-05-08T18:07:40.237052+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:07:40.237052+0000","last_undegraded":"2024-05-08T18:07:40.237052+0000","last_fullsized":"2024-05-08T18:07:40.237052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223191+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:07:41.223191+0000","last_peered":"2024-05-08T18:07:41.223191+0000","last_clean":"2024-05-08T18:07:41.223191+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:07:41.223191+0000","last_undegraded":"2024-05-08T18:07:41.223191+0000","last_fullsized":"2024-05-08T18:07:41.223191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239412+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:07:40.239412+0000","last_peered":"2024-05-08T18:07:40.239412+0000","last_clean":"2024-05-08T18:07:40.239412+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:07:40.239412+0000","last_undegraded":"2024-05-08T18:07:40.239412+0000","last_fullsized":"2024-05-08T18:07:40.239412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":59,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240778+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:07:40.240778+0000","last_peered":"2024-05-08T18:07:40.240778+0000","last_clean":"2024-05-08T18:07:40.240778+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:07:40.240778+0000","last_undegraded":"2024-05-08T18:07:40.240778+0000","last_fullsized":"2024-05-08T18:07:40.240778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236351+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:07:40.236351+0000","last_peered":"2024-05-08T18:07:40.236351+0000","last_clean":"2024-05-08T18:07:40.236351+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:07:40.236351+0000","last_undegraded":"2024-05-08T18:07:40.236351+0000","last_fullsized":"2024-05-08T18:07:40.236351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.200434+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:07:40.200434+0000","last_peered":"2024-05-08T18:07:40.200434+0000","last_clean":"2024-05-08T18:07:40.200434+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:07:40.200434+0000","last_undegraded":"2024-05-08T18:07:40.200434+0000","last_fullsized":"2024-05-08T18:07:40.200434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236745+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:07:40.236745+0000","last_peered":"2024-05-08T18:07:40.236745+0000","last_clean":"2024-05-08T18:07:40.236745+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:07:40.236745+0000","last_undegraded":"2024-05-08T18:07:40.236745+0000","last_fullsized":"2024-05-08T18:07:40.236745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236011+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:07:40.236011+0000","last_peered":"2024-05-08T18:07:40.236011+0000","last_clean":"2024-05-08T18:07:40.236011+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:07:40.236011+0000","last_undegraded":"2024-05-08T18:07:40.236011+0000","last_fullsized":"2024-05-08T18:07:40.236011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235618+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:07:40.235618+0000","last_peered":"2024-05-08T18:07:40.235618+0000","last_clean":"2024-05-08T18:07:40.235618+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:07:40.235618+0000","last_undegraded":"2024-05-08T18:07:40.235618+0000","last_fullsized":"2024-05-08T18:07:40.235618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241306+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:07:40.241306+0000","last_peered":"2024-05-08T18:07:40.241306+0000","last_clean":"2024-05-08T18:07:40.241306+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:07:40.241306+0000","last_undegraded":"2024-05-08T18:07:40.241306+0000","last_fullsized":"2024-05-08T18:07:40.241306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224002+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:07:41.224002+0000","last_peered":"2024-05-08T18:07:41.224002+0000","last_clean":"2024-05-08T18:07:41.224002+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:07:41.224002+0000","last_undegraded":"2024-05-08T18:07:41.224002+0000","last_fullsized":"2024-05-08T18:07:41.224002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239274+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:07:40.239274+0000","last_peered":"2024-05-08T18:07:40.239274+0000","last_clean":"2024-05-08T18:07:40.239274+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:07:40.239274+0000","last_undegraded":"2024-05-08T18:07:40.239274+0000","last_fullsized":"2024-05-08T18:07:40.239274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222008+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:07:41.222008+0000","last_peered":"2024-05-08T18:07:41.222008+0000","last_clean":"2024-05-08T18:07:41.222008+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:07:41.222008+0000","last_undegraded":"2024-05-08T18:07:41.222008+0000","last_fullsized":"2024-05-08T18:07:41.222008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225435+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:07:41.225435+0000","last_peered":"2024-05-08T18:07:41.225435+0000","last_clean":"2024-05-08T18:07:41.225435+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:07:41.225435+0000","last_undegraded":"2024-05-08T18:07:41.225435+0000","last_fullsized":"2024-05-08T18:07:41.225435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.205230+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:07:40.205230+0000","last_peered":"2024-05-08T18:07:40.205230+0000","last_clean":"2024-05-08T18:07:40.205230+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:07:40.205230+0000","last_undegraded":"2024-05-08T18:07:40.205230+0000","last_fullsized":"2024-05-08T18:07:40.205230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221775+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:07:41.221775+0000","last_peered":"2024-05-08T18:07:41.221775+0000","last_clean":"2024-05-08T18:07:41.221775+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:07:41.221775+0000","last_undegraded":"2024-05-08T18:07:41.221775+0000","last_fullsized":"2024-05-08T18:07:41.221775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206526+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:07:40.206526+0000","last_peered":"2024-05-08T18:07:40.206526+0000","last_clean":"2024-05-08T18:07:40.206526+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:07:40.206526+0000","last_undegraded":"2024-05-08T18:07:40.206526+0000","last_fullsized":"2024-05-08T18:07:40.206526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239831+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:07:40.239831+0000","last_peered":"2024-05-08T18:07:40.239831+0000","last_clean":"2024-05-08T18:07:40.239831+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:07:40.239831+0000","last_undegraded":"2024-05-08T18:07:40.239831+0000","last_fullsized":"2024-05-08T18:07:40.239831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235840+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:07:40.235840+0000","last_peered":"2024-05-08T18:07:40.235840+0000","last_clean":"2024-05-08T18:07:40.235840+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:07:40.235840+0000","last_undegraded":"2024-05-08T18:07:40.235840+0000","last_fullsized":"2024-05-08T18:07:40.235840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224009+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:07:41.224009+0000","last_peered":"2024-05-08T18:07:41.224009+0000","last_clean":"2024-05-08T18:07:41.224009+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:07:41.224009+0000","last_undegraded":"2024-05-08T18:07:41.224009+0000","last_fullsized":"2024-05-08T18:07:41.224009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224553+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:07:41.224553+0000","last_peered":"2024-05-08T18:07:41.224553+0000","last_clean":"2024-05-08T18:07:41.224553+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:07:41.224553+0000","last_undegraded":"2024-05-08T18:07:41.224553+0000","last_fullsized":"2024-05-08T18:07:41.224553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239448+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:07:40.239448+0000","last_peered":"2024-05-08T18:07:40.239448+0000","last_clean":"2024-05-08T18:07:40.239448+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:07:40.239448+0000","last_undegraded":"2024-05-08T18:07:40.239448+0000","last_fullsized":"2024-05-08T18:07:40.239448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219896+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:07:41.219896+0000","last_peered":"2024-05-08T18:07:41.219896+0000","last_clean":"2024-05-08T18:07:41.219896+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:07:41.219896+0000","last_undegraded":"2024-05-08T18:07:41.219896+0000","last_fullsized":"2024-05-08T18:07:41.219896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235651+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:07:40.235651+0000","last_peered":"2024-05-08T18:07:40.235651+0000","last_clean":"2024-05-08T18:07:40.235651+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:07:40.235651+0000","last_undegraded":"2024-05-08T18:07:40.235651+0000","last_fullsized":"2024-05-08T18:07:40.235651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223707+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:07:41.223707+0000","last_peered":"2024-05-08T18:07:41.223707+0000","last_clean":"2024-05-08T18:07:41.223707+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:07:41.223707+0000","last_undegraded":"2024-05-08T18:07:41.223707+0000","last_fullsized":"2024-05-08T18:07:41.223707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201807+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:07:40.201807+0000","last_peered":"2024-05-08T18:07:40.201807+0000","last_clean":"2024-05-08T18:07:40.201807+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:07:40.201807+0000","last_undegraded":"2024-05-08T18:07:40.201807+0000","last_fullsized":"2024-05-08T18:07:40.201807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.234834+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:07:40.234834+0000","last_peered":"2024-05-08T18:07:40.234834+0000","last_clean":"2024-05-08T18:07:40.234834+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:07:40.234834+0000","last_undegraded":"2024-05-08T18:07:40.234834+0000","last_fullsized":"2024-05-08T18:07:40.234834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222477+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:07:41.222477+0000","last_peered":"2024-05-08T18:07:41.222477+0000","last_clean":"2024-05-08T18:07:41.222477+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:07:41.222477+0000","last_undegraded":"2024-05-08T18:07:41.222477+0000","last_fullsized":"2024-05-08T18:07:41.222477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241024+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:07:40.241024+0000","last_peered":"2024-05-08T18:07:40.241024+0000","last_clean":"2024-05-08T18:07:40.241024+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:07:40.241024+0000","last_undegraded":"2024-05-08T18:07:40.241024+0000","last_fullsized":"2024-05-08T18:07:40.241024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225142+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:07:41.225142+0000","last_peered":"2024-05-08T18:07:41.225142+0000","last_clean":"2024-05-08T18:07:41.225142+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:07:41.225142+0000","last_undegraded":"2024-05-08T18:07:41.225142+0000","last_fullsized":"2024-05-08T18:07:41.225142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235567+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:07:40.235567+0000","last_peered":"2024-05-08T18:07:40.235567+0000","last_clean":"2024-05-08T18:07:40.235567+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:07:40.235567+0000","last_undegraded":"2024-05-08T18:07:40.235567+0000","last_fullsized":"2024-05-08T18:07:40.235567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":64,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.234863+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:07:40.234863+0000","last_peered":"2024-05-08T18:07:40.234863+0000","last_clean":"2024-05-08T18:07:40.234863+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:07:40.234863+0000","last_undegraded":"2024-05-08T18:07:40.234863+0000","last_fullsized":"2024-05-08T18:07:40.234863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218652+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:07:41.218652+0000","last_peered":"2024-05-08T18:07:41.218652+0000","last_clean":"2024-05-08T18:07:41.218652+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:07:41.218652+0000","last_undegraded":"2024-05-08T18:07:41.218652+0000","last_fullsized":"2024-05-08T18:07:41.218652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235095+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:07:40.235095+0000","last_peered":"2024-05-08T18:07:40.235095+0000","last_clean":"2024-05-08T18:07:40.235095+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:07:40.235095+0000","last_undegraded":"2024-05-08T18:07:40.235095+0000","last_fullsized":"2024-05-08T18:07:40.235095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235820+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:07:40.235820+0000","last_peered":"2024-05-08T18:07:40.235820+0000","last_clean":"2024-05-08T18:07:40.235820+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:07:40.235820+0000","last_undegraded":"2024-05-08T18:07:40.235820+0000","last_fullsized":"2024-05-08T18:07:40.235820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224781+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:07:41.224781+0000","last_peered":"2024-05-08T18:07:41.224781+0000","last_clean":"2024-05-08T18:07:41.224781+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:07:41.224781+0000","last_undegraded":"2024-05-08T18:07:41.224781+0000","last_fullsized":"2024-05-08T18:07:41.224781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240728+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:07:40.240728+0000","last_peered":"2024-05-08T18:07:40.240728+0000","last_clean":"2024-05-08T18:07:40.240728+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:07:40.240728+0000","last_undegraded":"2024-05-08T18:07:40.240728+0000","last_fullsized":"2024-05-08T18:07:40.240728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201271+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:07:40.201271+0000","last_peered":"2024-05-08T18:07:40.201271+0000","last_clean":"2024-05-08T18:07:40.201271+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:07:40.201271+0000","last_undegraded":"2024-05-08T18:07:40.201271+0000","last_fullsized":"2024-05-08T18:07:40.201271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221595+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:07:41.221595+0000","last_peered":"2024-05-08T18:07:41.221595+0000","last_clean":"2024-05-08T18:07:41.221595+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:07:41.221595+0000","last_undegraded":"2024-05-08T18:07:41.221595+0000","last_fullsized":"2024-05-08T18:07:41.221595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235412+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:07:40.235412+0000","last_peered":"2024-05-08T18:07:40.235412+0000","last_clean":"2024-05-08T18:07:40.235412+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:07:40.235412+0000","last_undegraded":"2024-05-08T18:07:40.235412+0000","last_fullsized":"2024-05-08T18:07:40.235412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225215+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:07:41.225215+0000","last_peered":"2024-05-08T18:07:41.225215+0000","last_clean":"2024-05-08T18:07:41.225215+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:07:41.225215+0000","last_undegraded":"2024-05-08T18:07:41.225215+0000","last_fullsized":"2024-05-08T18:07:41.225215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222725+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:07:41.222725+0000","last_peered":"2024-05-08T18:07:41.222725+0000","last_clean":"2024-05-08T18:07:41.222725+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:07:41.222725+0000","last_undegraded":"2024-05-08T18:07:41.222725+0000","last_fullsized":"2024-05-08T18:07:41.222725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224757+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:07:41.224757+0000","last_peered":"2024-05-08T18:07:41.224757+0000","last_clean":"2024-05-08T18:07:41.224757+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:07:41.224757+0000","last_undegraded":"2024-05-08T18:07:41.224757+0000","last_fullsized":"2024-05-08T18:07:41.224757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224259+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:07:41.224259+0000","last_peered":"2024-05-08T18:07:41.224259+0000","last_clean":"2024-05-08T18:07:41.224259+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:07:41.224259+0000","last_undegraded":"2024-05-08T18:07:41.224259+0000","last_fullsized":"2024-05-08T18:07:41.224259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218898+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:07:41.218898+0000","last_peered":"2024-05-08T18:07:41.218898+0000","last_clean":"2024-05-08T18:07:41.218898+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:07:41.218898+0000","last_undegraded":"2024-05-08T18:07:41.218898+0000","last_fullsized":"2024-05-08T18:07:41.218898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219913+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:07:41.219913+0000","last_peered":"2024-05-08T18:07:41.219913+0000","last_clean":"2024-05-08T18:07:41.219913+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:07:41.219913+0000","last_undegraded":"2024-05-08T18:07:41.219913+0000","last_fullsized":"2024-05-08T18:07:41.219913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.228624+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:07:41.228624+0000","last_peered":"2024-05-08T18:07:41.228624+0000","last_clean":"2024-05-08T18:07:41.228624+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:07:41.228624+0000","last_undegraded":"2024-05-08T18:07:41.228624+0000","last_fullsized":"2024-05-08T18:07:41.228624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235991+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:07:40.235991+0000","last_peered":"2024-05-08T18:07:40.235991+0000","last_clean":"2024-05-08T18:07:40.235991+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:07:40.235991+0000","last_undegraded":"2024-05-08T18:07:40.235991+0000","last_fullsized":"2024-05-08T18:07:40.235991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219127+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:07:41.219127+0000","last_peered":"2024-05-08T18:07:41.219127+0000","last_clean":"2024-05-08T18:07:41.219127+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:07:41.219127+0000","last_undegraded":"2024-05-08T18:07:41.219127+0000","last_fullsized":"2024-05-08T18:07:41.219127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236997+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:07:40.236997+0000","last_peered":"2024-05-08T18:07:40.236997+0000","last_clean":"2024-05-08T18:07:40.236997+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:07:40.236997+0000","last_undegraded":"2024-05-08T18:07:40.236997+0000","last_fullsized":"2024-05-08T18:07:40.236997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202498+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:07:40.202498+0000","last_peered":"2024-05-08T18:07:40.202498+0000","last_clean":"2024-05-08T18:07:40.202498+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:07:40.202498+0000","last_undegraded":"2024-05-08T18:07:40.202498+0000","last_fullsized":"2024-05-08T18:07:40.202498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222322+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:07:41.222322+0000","last_peered":"2024-05-08T18:07:41.222322+0000","last_clean":"2024-05-08T18:07:41.222322+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:07:41.222322+0000","last_undegraded":"2024-05-08T18:07:41.222322+0000","last_fullsized":"2024-05-08T18:07:41.222322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":68,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237627+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:07:40.237627+0000","last_peered":"2024-05-08T18:07:40.237627+0000","last_clean":"2024-05-08T18:07:40.237627+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:07:40.237627+0000","last_undegraded":"2024-05-08T18:07:40.237627+0000","last_fullsized":"2024-05-08T18:07:40.237627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222959+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:07:41.222959+0000","last_peered":"2024-05-08T18:07:41.222959+0000","last_clean":"2024-05-08T18:07:41.222959+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:07:41.222959+0000","last_undegraded":"2024-05-08T18:07:41.222959+0000","last_fullsized":"2024-05-08T18:07:41.222959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235949+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:07:40.235949+0000","last_peered":"2024-05-08T18:07:40.235949+0000","last_clean":"2024-05-08T18:07:40.235949+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:07:40.235949+0000","last_undegraded":"2024-05-08T18:07:40.235949+0000","last_fullsized":"2024-05-08T18:07:40.235949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236152+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:07:40.236152+0000","last_peered":"2024-05-08T18:07:40.236152+0000","last_clean":"2024-05-08T18:07:40.236152+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:07:40.236152+0000","last_undegraded":"2024-05-08T18:07:40.236152+0000","last_fullsized":"2024-05-08T18:07:40.236152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219514+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:07:41.219514+0000","last_peered":"2024-05-08T18:07:41.219514+0000","last_clean":"2024-05-08T18:07:41.219514+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:07:41.219514+0000","last_undegraded":"2024-05-08T18:07:41.219514+0000","last_fullsized":"2024-05-08T18:07:41.219514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219801+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:07:41.219801+0000","last_peered":"2024-05-08T18:07:41.219801+0000","last_clean":"2024-05-08T18:07:41.219801+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:07:41.219801+0000","last_undegraded":"2024-05-08T18:07:41.219801+0000","last_fullsized":"2024-05-08T18:07:41.219801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222599+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:07:41.222599+0000","last_peered":"2024-05-08T18:07:41.222599+0000","last_clean":"2024-05-08T18:07:41.222599+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:07:41.222599+0000","last_undegraded":"2024-05-08T18:07:41.222599+0000","last_fullsized":"2024-05-08T18:07:41.222599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222254+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:07:41.222254+0000","last_peered":"2024-05-08T18:07:41.222254+0000","last_clean":"2024-05-08T18:07:41.222254+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:07:41.222254+0000","last_undegraded":"2024-05-08T18:07:41.222254+0000","last_fullsized":"2024-05-08T18:07:41.222254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222137+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:07:41.222137+0000","last_peered":"2024-05-08T18:07:41.222137+0000","last_clean":"2024-05-08T18:07:41.222137+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:07:41.222137+0000","last_undegraded":"2024-05-08T18:07:41.222137+0000","last_fullsized":"2024-05-08T18:07:41.222137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223441+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:07:41.223441+0000","last_peered":"2024-05-08T18:07:41.223441+0000","last_clean":"2024-05-08T18:07:41.223441+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:07:41.223441+0000","last_undegraded":"2024-05-08T18:07:41.223441+0000","last_fullsized":"2024-05-08T18:07:41.223441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222358+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:07:41.222358+0000","last_peered":"2024-05-08T18:07:41.222358+0000","last_clean":"2024-05-08T18:07:41.222358+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:07:41.222358+0000","last_undegraded":"2024-05-08T18:07:41.222358+0000","last_fullsized":"2024-05-08T18:07:41.222358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240367+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:07:40.240367+0000","last_peered":"2024-05-08T18:07:40.240367+0000","last_clean":"2024-05-08T18:07:40.240367+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:07:40.240367+0000","last_undegraded":"2024-05-08T18:07:40.240367+0000","last_fullsized":"2024-05-08T18:07:40.240367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223930+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:07:41.223930+0000","last_peered":"2024-05-08T18:07:41.223930+0000","last_clean":"2024-05-08T18:07:41.223930+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:07:41.223930+0000","last_undegraded":"2024-05-08T18:07:41.223930+0000","last_fullsized":"2024-05-08T18:07:41.223930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'4","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235006+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:07:40.235006+0000","last_peered":"2024-05-08T18:07:40.235006+0000","last_clean":"2024-05-08T18:07:40.235006+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:07:40.235006+0000","last_undegraded":"2024-05-08T18:07:40.235006+0000","last_fullsized":"2024-05-08T18:07:40.235006+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238013+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:07:40.238013+0000","last_peered":"2024-05-08T18:07:40.238013+0000","last_clean":"2024-05-08T18:07:40.238013+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:07:40.238013+0000","last_undegraded":"2024-05-08T18:07:40.238013+0000","last_fullsized":"2024-05-08T18:07:40.238013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235561+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:07:40.235561+0000","last_peered":"2024-05-08T18:07:40.235561+0000","last_clean":"2024-05-08T18:07:40.235561+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:07:40.235561+0000","last_undegraded":"2024-05-08T18:07:40.235561+0000","last_fullsized":"2024-05-08T18:07:40.235561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222630+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:07:41.222630+0000","last_peered":"2024-05-08T18:07:41.222630+0000","last_clean":"2024-05-08T18:07:41.222630+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:07:41.222630+0000","last_undegraded":"2024-05-08T18:07:41.222630+0000","last_fullsized":"2024-05-08T18:07:41.222630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241836+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:07:40.241836+0000","last_peered":"2024-05-08T18:07:40.241836+0000","last_clean":"2024-05-08T18:07:40.241836+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:07:40.241836+0000","last_undegraded":"2024-05-08T18:07:40.241836+0000","last_fullsized":"2024-05-08T18:07:40.241836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235170+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:07:40.235170+0000","last_peered":"2024-05-08T18:07:40.235170+0000","last_clean":"2024-05-08T18:07:40.235170+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:07:40.235170+0000","last_undegraded":"2024-05-08T18:07:40.235170+0000","last_fullsized":"2024-05-08T18:07:40.235170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223540+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:07:41.223540+0000","last_peered":"2024-05-08T18:07:41.223540+0000","last_clean":"2024-05-08T18:07:41.223540+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:07:41.223540+0000","last_undegraded":"2024-05-08T18:07:41.223540+0000","last_fullsized":"2024-05-08T18:07:41.223540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201000+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:07:40.201000+0000","last_peered":"2024-05-08T18:07:40.201000+0000","last_clean":"2024-05-08T18:07:40.201000+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:07:40.201000+0000","last_undegraded":"2024-05-08T18:07:40.201000+0000","last_fullsized":"2024-05-08T18:07:40.201000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235943+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:07:40.235943+0000","last_peered":"2024-05-08T18:07:40.235943+0000","last_clean":"2024-05-08T18:07:40.235943+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:07:40.235943+0000","last_undegraded":"2024-05-08T18:07:40.235943+0000","last_fullsized":"2024-05-08T18:07:40.235943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223121+0000","last_change":"2024-05-08T18:07:17.504030+0000","last_active":"2024-05-08T18:07:41.223121+0000","last_peered":"2024-05-08T18:07:41.223121+0000","last_clean":"2024-05-08T18:07:41.223121+0000","last_became_active":"2024-05-08T18:07:17.497558+0000","last_became_peered":"2024-05-08T18:07:17.497558+0000","last_unstale":"2024-05-08T18:07:41.223121+0000","last_undegraded":"2024-05-08T18:07:41.223121+0000","last_fullsized":"2024-05-08T18:07:41.223121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236621+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:07:40.236621+0000","last_peered":"2024-05-08T18:07:40.236621+0000","last_clean":"2024-05-08T18:07:40.236621+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:07:40.236621+0000","last_undegraded":"2024-05-08T18:07:40.236621+0000","last_fullsized":"2024-05-08T18:07:40.236621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201274+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:07:40.201274+0000","last_peered":"2024-05-08T18:07:40.201274+0000","last_clean":"2024-05-08T18:07:40.201274+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:07:40.201274+0000","last_undegraded":"2024-05-08T18:07:40.201274+0000","last_fullsized":"2024-05-08T18:07:40.201274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237710+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:07:40.237710+0000","last_peered":"2024-05-08T18:07:40.237710+0000","last_clean":"2024-05-08T18:07:40.237710+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:07:40.237710+0000","last_undegraded":"2024-05-08T18:07:40.237710+0000","last_fullsized":"2024-05-08T18:07:40.237710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235449+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:07:40.235449+0000","last_peered":"2024-05-08T18:07:40.235449+0000","last_clean":"2024-05-08T18:07:40.235449+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:07:40.235449+0000","last_undegraded":"2024-05-08T18:07:40.235449+0000","last_fullsized":"2024-05-08T18:07:40.235449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202312+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:07:40.202312+0000","last_peered":"2024-05-08T18:07:40.202312+0000","last_clean":"2024-05-08T18:07:40.202312+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:07:40.202312+0000","last_undegraded":"2024-05-08T18:07:40.202312+0000","last_fullsized":"2024-05-08T18:07:40.202312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223595+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:07:41.223595+0000","last_peered":"2024-05-08T18:07:41.223595+0000","last_clean":"2024-05-08T18:07:41.223595+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:07:41.223595+0000","last_undegraded":"2024-05-08T18:07:41.223595+0000","last_fullsized":"2024-05-08T18:07:41.223595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236456+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:07:40.236456+0000","last_peered":"2024-05-08T18:07:40.236456+0000","last_clean":"2024-05-08T18:07:40.236456+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:07:40.236456+0000","last_undegraded":"2024-05-08T18:07:40.236456+0000","last_fullsized":"2024-05-08T18:07:40.236456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.226166+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:07:41.226166+0000","last_peered":"2024-05-08T18:07:41.226166+0000","last_clean":"2024-05-08T18:07:41.226166+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:07:41.226166+0000","last_undegraded":"2024-05-08T18:07:41.226166+0000","last_fullsized":"2024-05-08T18:07:41.226166+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236468+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:07:40.236468+0000","last_peered":"2024-05-08T18:07:40.236468+0000","last_clean":"2024-05-08T18:07:40.236468+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:07:40.236468+0000","last_undegraded":"2024-05-08T18:07:40.236468+0000","last_fullsized":"2024-05-08T18:07:40.236468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223129+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:07:41.223129+0000","last_peered":"2024-05-08T18:07:41.223129+0000","last_clean":"2024-05-08T18:07:41.223129+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:07:41.223129+0000","last_undegraded":"2024-05-08T18:07:41.223129+0000","last_fullsized":"2024-05-08T18:07:41.223129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236644+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:07:40.236644+0000","last_peered":"2024-05-08T18:07:40.236644+0000","last_clean":"2024-05-08T18:07:40.236644+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:07:40.236644+0000","last_undegraded":"2024-05-08T18:07:40.236644+0000","last_fullsized":"2024-05-08T18:07:40.236644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223253+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:07:41.223253+0000","last_peered":"2024-05-08T18:07:41.223253+0000","last_clean":"2024-05-08T18:07:41.223253+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:07:41.223253+0000","last_undegraded":"2024-05-08T18:07:41.223253+0000","last_fullsized":"2024-05-08T18:07:41.223253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202040+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:07:40.202040+0000","last_peered":"2024-05-08T18:07:40.202040+0000","last_clean":"2024-05-08T18:07:40.202040+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:07:40.202040+0000","last_undegraded":"2024-05-08T18:07:40.202040+0000","last_fullsized":"2024-05-08T18:07:40.202040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238953+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:07:40.238953+0000","last_peered":"2024-05-08T18:07:40.238953+0000","last_clean":"2024-05-08T18:07:40.238953+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:07:40.238953+0000","last_undegraded":"2024-05-08T18:07:40.238953+0000","last_fullsized":"2024-05-08T18:07:40.238953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.226386+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:07:41.226386+0000","last_peered":"2024-05-08T18:07:41.226386+0000","last_clean":"2024-05-08T18:07:41.226386+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:07:41.226386+0000","last_undegraded":"2024-05-08T18:07:41.226386+0000","last_fullsized":"2024-05-08T18:07:41.226386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201042+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:07:40.201042+0000","last_peered":"2024-05-08T18:07:40.201042+0000","last_clean":"2024-05-08T18:07:40.201042+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:07:40.201042+0000","last_undegraded":"2024-05-08T18:07:40.201042+0000","last_fullsized":"2024-05-08T18:07:40.201042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223272+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:07:41.223272+0000","last_peered":"2024-05-08T18:07:41.223272+0000","last_clean":"2024-05-08T18:07:41.223272+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:07:41.223272+0000","last_undegraded":"2024-05-08T18:07:41.223272+0000","last_fullsized":"2024-05-08T18:07:41.223272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220367+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:07:41.220367+0000","last_peered":"2024-05-08T18:07:41.220367+0000","last_clean":"2024-05-08T18:07:41.220367+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:07:41.220367+0000","last_undegraded":"2024-05-08T18:07:41.220367+0000","last_fullsized":"2024-05-08T18:07:41.220367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220899+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:07:41.220899+0000","last_peered":"2024-05-08T18:07:41.220899+0000","last_clean":"2024-05-08T18:07:41.220899+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:07:41.220899+0000","last_undegraded":"2024-05-08T18:07:41.220899+0000","last_fullsized":"2024-05-08T18:07:41.220899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225406+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:07:41.225406+0000","last_peered":"2024-05-08T18:07:41.225406+0000","last_clean":"2024-05-08T18:07:41.225406+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:07:41.225406+0000","last_undegraded":"2024-05-08T18:07:41.225406+0000","last_fullsized":"2024-05-08T18:07:41.225406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223610+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:07:41.223610+0000","last_peered":"2024-05-08T18:07:41.223610+0000","last_clean":"2024-05-08T18:07:41.223610+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:07:41.223610+0000","last_undegraded":"2024-05-08T18:07:41.223610+0000","last_fullsized":"2024-05-08T18:07:41.223610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235324+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:07:40.235324+0000","last_peered":"2024-05-08T18:07:40.235324+0000","last_clean":"2024-05-08T18:07:40.235324+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:07:40.235324+0000","last_undegraded":"2024-05-08T18:07:40.235324+0000","last_fullsized":"2024-05-08T18:07:40.235324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206221+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:07:40.206221+0000","last_peered":"2024-05-08T18:07:40.206221+0000","last_clean":"2024-05-08T18:07:40.206221+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:07:40.206221+0000","last_undegraded":"2024-05-08T18:07:40.206221+0000","last_fullsized":"2024-05-08T18:07:40.206221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235478+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:07:40.235478+0000","last_peered":"2024-05-08T18:07:40.235478+0000","last_clean":"2024-05-08T18:07:40.235478+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:07:40.235478+0000","last_undegraded":"2024-05-08T18:07:40.235478+0000","last_fullsized":"2024-05-08T18:07:40.235478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.227027+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:07:41.227027+0000","last_peered":"2024-05-08T18:07:41.227027+0000","last_clean":"2024-05-08T18:07:41.227027+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:07:41.227027+0000","last_undegraded":"2024-05-08T18:07:41.227027+0000","last_fullsized":"2024-05-08T18:07:41.227027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221399+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:07:41.221399+0000","last_peered":"2024-05-08T18:07:41.221399+0000","last_clean":"2024-05-08T18:07:41.221399+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:07:41.221399+0000","last_undegraded":"2024-05-08T18:07:41.221399+0000","last_fullsized":"2024-05-08T18:07:41.221399+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201452+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:07:40.201452+0000","last_peered":"2024-05-08T18:07:40.201452+0000","last_clean":"2024-05-08T18:07:40.201452+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:07:40.201452+0000","last_undegraded":"2024-05-08T18:07:40.201452+0000","last_fullsized":"2024-05-08T18:07:40.201452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.234920+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:07:40.234920+0000","last_peered":"2024-05-08T18:07:40.234920+0000","last_clean":"2024-05-08T18:07:40.234920+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:07:40.234920+0000","last_undegraded":"2024-05-08T18:07:40.234920+0000","last_fullsized":"2024-05-08T18:07:40.234920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219173+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:07:41.219173+0000","last_peered":"2024-05-08T18:07:41.219173+0000","last_clean":"2024-05-08T18:07:41.219173+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:07:41.219173+0000","last_undegraded":"2024-05-08T18:07:41.219173+0000","last_fullsized":"2024-05-08T18:07:41.219173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237087+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:07:40.237087+0000","last_peered":"2024-05-08T18:07:40.237087+0000","last_clean":"2024-05-08T18:07:40.237087+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:07:40.237087+0000","last_undegraded":"2024-05-08T18:07:40.237087+0000","last_fullsized":"2024-05-08T18:07:40.237087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237842+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:07:40.237842+0000","last_peered":"2024-05-08T18:07:40.237842+0000","last_clean":"2024-05-08T18:07:40.237842+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:07:40.237842+0000","last_undegraded":"2024-05-08T18:07:40.237842+0000","last_fullsized":"2024-05-08T18:07:40.237842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235756+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:07:40.235756+0000","last_peered":"2024-05-08T18:07:40.235756+0000","last_clean":"2024-05-08T18:07:40.235756+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:07:40.235756+0000","last_undegraded":"2024-05-08T18:07:40.235756+0000","last_fullsized":"2024-05-08T18:07:40.235756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.234582+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:07:40.234582+0000","last_peered":"2024-05-08T18:07:40.234582+0000","last_clean":"2024-05-08T18:07:40.234582+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:07:40.234582+0000","last_undegraded":"2024-05-08T18:07:40.234582+0000","last_fullsized":"2024-05-08T18:07:40.234582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.242193+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:07:40.242193+0000","last_peered":"2024-05-08T18:07:40.242193+0000","last_clean":"2024-05-08T18:07:40.242193+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:07:40.242193+0000","last_undegraded":"2024-05-08T18:07:40.242193+0000","last_fullsized":"2024-05-08T18:07:40.242193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220050+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:07:41.220050+0000","last_peered":"2024-05-08T18:07:41.220050+0000","last_clean":"2024-05-08T18:07:41.220050+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:07:41.220050+0000","last_undegraded":"2024-05-08T18:07:41.220050+0000","last_fullsized":"2024-05-08T18:07:41.220050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240790+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:07:40.240790+0000","last_peered":"2024-05-08T18:07:40.240790+0000","last_clean":"2024-05-08T18:07:40.240790+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:07:40.240790+0000","last_undegraded":"2024-05-08T18:07:40.240790+0000","last_fullsized":"2024-05-08T18:07:40.240790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236677+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:07:40.236677+0000","last_peered":"2024-05-08T18:07:40.236677+0000","last_clean":"2024-05-08T18:07:40.236677+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:07:40.236677+0000","last_undegraded":"2024-05-08T18:07:40.236677+0000","last_fullsized":"2024-05-08T18:07:40.236677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.234682+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:07:40.234682+0000","last_peered":"2024-05-08T18:07:40.234682+0000","last_clean":"2024-05-08T18:07:40.234682+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:07:40.234682+0000","last_undegraded":"2024-05-08T18:07:40.234682+0000","last_fullsized":"2024-05-08T18:07:40.234682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.200754+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:07:40.200754+0000","last_peered":"2024-05-08T18:07:40.200754+0000","last_clean":"2024-05-08T18:07:40.200754+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:07:40.200754+0000","last_undegraded":"2024-05-08T18:07:40.200754+0000","last_fullsized":"2024-05-08T18:07:40.200754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223544+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:07:41.223544+0000","last_peered":"2024-05-08T18:07:41.223544+0000","last_clean":"2024-05-08T18:07:41.223544+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:07:41.223544+0000","last_undegraded":"2024-05-08T18:07:41.223544+0000","last_fullsized":"2024-05-08T18:07:41.223544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222762+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:07:41.222762+0000","last_peered":"2024-05-08T18:07:41.222762+0000","last_clean":"2024-05-08T18:07:41.222762+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:07:41.222762+0000","last_undegraded":"2024-05-08T18:07:41.222762+0000","last_fullsized":"2024-05-08T18:07:41.222762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224730+0000","last_change":"2024-05-08T18:07:15.488647+0000","last_active":"2024-05-08T18:07:41.224730+0000","last_peered":"2024-05-08T18:07:41.224730+0000","last_clean":"2024-05-08T18:07:41.224730+0000","last_became_active":"2024-05-08T18:07:15.487842+0000","last_became_peered":"2024-05-08T18:07:15.487842+0000","last_unstale":"2024-05-08T18:07:41.224730+0000","last_undegraded":"2024-05-08T18:07:41.224730+0000","last_fullsized":"2024-05-08T18:07:41.224730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218499+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:07:41.218499+0000","last_peered":"2024-05-08T18:07:41.218499+0000","last_clean":"2024-05-08T18:07:41.218499+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:07:41.218499+0000","last_undegraded":"2024-05-08T18:07:41.218499+0000","last_fullsized":"2024-05-08T18:07:41.218499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.228517+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:07:41.228517+0000","last_peered":"2024-05-08T18:07:41.228517+0000","last_clean":"2024-05-08T18:07:41.228517+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:07:41.228517+0000","last_undegraded":"2024-05-08T18:07:41.228517+0000","last_fullsized":"2024-05-08T18:07:41.228517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218845+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:07:41.218845+0000","last_peered":"2024-05-08T18:07:41.218845+0000","last_clean":"2024-05-08T18:07:41.218845+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:07:41.218845+0000","last_undegraded":"2024-05-08T18:07:41.218845+0000","last_fullsized":"2024-05-08T18:07:41.218845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239582+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:07:40.239582+0000","last_peered":"2024-05-08T18:07:40.239582+0000","last_clean":"2024-05-08T18:07:40.239582+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:07:40.239582+0000","last_undegraded":"2024-05-08T18:07:40.239582+0000","last_fullsized":"2024-05-08T18:07:40.239582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219133+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:07:41.219133+0000","last_peered":"2024-05-08T18:07:41.219133+0000","last_clean":"2024-05-08T18:07:41.219133+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:07:41.219133+0000","last_undegraded":"2024-05-08T18:07:41.219133+0000","last_fullsized":"2024-05-08T18:07:41.219133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236610+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:07:40.236610+0000","last_peered":"2024-05-08T18:07:40.236610+0000","last_clean":"2024-05-08T18:07:40.236610+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:07:40.236610+0000","last_undegraded":"2024-05-08T18:07:40.236610+0000","last_fullsized":"2024-05-08T18:07:40.236610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221884+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:07:41.221884+0000","last_peered":"2024-05-08T18:07:41.221884+0000","last_clean":"2024-05-08T18:07:41.221884+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:07:41.221884+0000","last_undegraded":"2024-05-08T18:07:41.221884+0000","last_fullsized":"2024-05-08T18:07:41.221884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219172+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:07:41.219172+0000","last_peered":"2024-05-08T18:07:41.219172+0000","last_clean":"2024-05-08T18:07:41.219172+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:07:41.219172+0000","last_undegraded":"2024-05-08T18:07:41.219172+0000","last_fullsized":"2024-05-08T18:07:41.219172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235398+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:07:40.235398+0000","last_peered":"2024-05-08T18:07:40.235398+0000","last_clean":"2024-05-08T18:07:40.235398+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:07:40.235398+0000","last_undegraded":"2024-05-08T18:07:40.235398+0000","last_fullsized":"2024-05-08T18:07:40.235398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220885+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:07:41.220885+0000","last_peered":"2024-05-08T18:07:41.220885+0000","last_clean":"2024-05-08T18:07:41.220885+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:07:41.220885+0000","last_undegraded":"2024-05-08T18:07:41.220885+0000","last_fullsized":"2024-05-08T18:07:41.220885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224955+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:07:41.224955+0000","last_peered":"2024-05-08T18:07:41.224955+0000","last_clean":"2024-05-08T18:07:41.224955+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:07:41.224955+0000","last_undegraded":"2024-05-08T18:07:41.224955+0000","last_fullsized":"2024-05-08T18:07:41.224955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.200603+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:07:40.200603+0000","last_peered":"2024-05-08T18:07:40.200603+0000","last_clean":"2024-05-08T18:07:40.200603+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:07:40.200603+0000","last_undegraded":"2024-05-08T18:07:40.200603+0000","last_fullsized":"2024-05-08T18:07:40.200603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223948+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:07:41.223948+0000","last_peered":"2024-05-08T18:07:41.223948+0000","last_clean":"2024-05-08T18:07:41.223948+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:07:41.223948+0000","last_undegraded":"2024-05-08T18:07:41.223948+0000","last_fullsized":"2024-05-08T18:07:41.223948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204848+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:07:40.204848+0000","last_peered":"2024-05-08T18:07:40.204848+0000","last_clean":"2024-05-08T18:07:40.204848+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:07:40.204848+0000","last_undegraded":"2024-05-08T18:07:40.204848+0000","last_fullsized":"2024-05-08T18:07:40.204848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240028+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:07:40.240028+0000","last_peered":"2024-05-08T18:07:40.240028+0000","last_clean":"2024-05-08T18:07:40.240028+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:07:40.240028+0000","last_undegraded":"2024-05-08T18:07:40.240028+0000","last_fullsized":"2024-05-08T18:07:40.240028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239223+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:07:40.239223+0000","last_peered":"2024-05-08T18:07:40.239223+0000","last_clean":"2024-05-08T18:07:40.239223+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:07:40.239223+0000","last_undegraded":"2024-05-08T18:07:40.239223+0000","last_fullsized":"2024-05-08T18:07:40.239223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224999+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:07:41.224999+0000","last_peered":"2024-05-08T18:07:41.224999+0000","last_clean":"2024-05-08T18:07:41.224999+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:07:41.224999+0000","last_undegraded":"2024-05-08T18:07:41.224999+0000","last_fullsized":"2024-05-08T18:07:41.224999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235568+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:07:40.235568+0000","last_peered":"2024-05-08T18:07:40.235568+0000","last_clean":"2024-05-08T18:07:40.235568+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:07:40.235568+0000","last_undegraded":"2024-05-08T18:07:40.235568+0000","last_fullsized":"2024-05-08T18:07:40.235568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224141+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:07:41.224141+0000","last_peered":"2024-05-08T18:07:41.224141+0000","last_clean":"2024-05-08T18:07:41.224141+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:07:41.224141+0000","last_undegraded":"2024-05-08T18:07:41.224141+0000","last_fullsized":"2024-05-08T18:07:41.224141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.228484+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:07:41.228484+0000","last_peered":"2024-05-08T18:07:41.228484+0000","last_clean":"2024-05-08T18:07:41.228484+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:07:41.228484+0000","last_undegraded":"2024-05-08T18:07:41.228484+0000","last_fullsized":"2024-05-08T18:07:41.228484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220252+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:07:41.220252+0000","last_peered":"2024-05-08T18:07:41.220252+0000","last_clean":"2024-05-08T18:07:41.220252+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:07:41.220252+0000","last_undegraded":"2024-05-08T18:07:41.220252+0000","last_fullsized":"2024-05-08T18:07:41.220252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.227570+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:07:41.227570+0000","last_peered":"2024-05-08T18:07:41.227570+0000","last_clean":"2024-05-08T18:07:41.227570+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:07:41.227570+0000","last_undegraded":"2024-05-08T18:07:41.227570+0000","last_fullsized":"2024-05-08T18:07:41.227570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222548+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:07:41.222548+0000","last_peered":"2024-05-08T18:07:41.222548+0000","last_clean":"2024-05-08T18:07:41.222548+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:07:41.222548+0000","last_undegraded":"2024-05-08T18:07:41.222548+0000","last_fullsized":"2024-05-08T18:07:41.222548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202179+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:07:40.202179+0000","last_peered":"2024-05-08T18:07:40.202179+0000","last_clean":"2024-05-08T18:07:40.202179+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:07:40.202179+0000","last_undegraded":"2024-05-08T18:07:40.202179+0000","last_fullsized":"2024-05-08T18:07:40.202179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.200461+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:07:40.200461+0000","last_peered":"2024-05-08T18:07:40.200461+0000","last_clean":"2024-05-08T18:07:40.200461+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:07:40.200461+0000","last_undegraded":"2024-05-08T18:07:40.200461+0000","last_fullsized":"2024-05-08T18:07:40.200461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225155+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:07:41.225155+0000","last_peered":"2024-05-08T18:07:41.225155+0000","last_clean":"2024-05-08T18:07:41.225155+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:07:41.225155+0000","last_undegraded":"2024-05-08T18:07:41.225155+0000","last_fullsized":"2024-05-08T18:07:41.225155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236511+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:07:40.236511+0000","last_peered":"2024-05-08T18:07:40.236511+0000","last_clean":"2024-05-08T18:07:40.236511+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:07:40.236511+0000","last_undegraded":"2024-05-08T18:07:40.236511+0000","last_fullsized":"2024-05-08T18:07:40.236511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236279+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:07:40.236279+0000","last_peered":"2024-05-08T18:07:40.236279+0000","last_clean":"2024-05-08T18:07:40.236279+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:07:40.236279+0000","last_undegraded":"2024-05-08T18:07:40.236279+0000","last_fullsized":"2024-05-08T18:07:40.236279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221672+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:07:41.221672+0000","last_peered":"2024-05-08T18:07:41.221672+0000","last_clean":"2024-05-08T18:07:41.221672+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:07:41.221672+0000","last_undegraded":"2024-05-08T18:07:41.221672+0000","last_fullsized":"2024-05-08T18:07:41.221672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222845+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:07:41.222845+0000","last_peered":"2024-05-08T18:07:41.222845+0000","last_clean":"2024-05-08T18:07:41.222845+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:07:41.222845+0000","last_undegraded":"2024-05-08T18:07:41.222845+0000","last_fullsized":"2024-05-08T18:07:41.222845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206392+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:07:40.206392+0000","last_peered":"2024-05-08T18:07:40.206392+0000","last_clean":"2024-05-08T18:07:40.206392+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:07:40.206392+0000","last_undegraded":"2024-05-08T18:07:40.206392+0000","last_fullsized":"2024-05-08T18:07:40.206392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238993+0000","last_change":"2024-05-08T18:07:15.498938+0000","last_active":"2024-05-08T18:07:40.238993+0000","last_peered":"2024-05-08T18:07:40.238993+0000","last_clean":"2024-05-08T18:07:40.238993+0000","last_became_active":"2024-05-08T18:07:15.498206+0000","last_became_peered":"2024-05-08T18:07:15.498206+0000","last_unstale":"2024-05-08T18:07:40.238993+0000","last_undegraded":"2024-05-08T18:07:40.238993+0000","last_fullsized":"2024-05-08T18:07:40.238993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220710+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:07:41.220710+0000","last_peered":"2024-05-08T18:07:41.220710+0000","last_clean":"2024-05-08T18:07:41.220710+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:07:41.220710+0000","last_undegraded":"2024-05-08T18:07:41.220710+0000","last_fullsized":"2024-05-08T18:07:41.220710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235651+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:07:40.235651+0000","last_peered":"2024-05-08T18:07:40.235651+0000","last_clean":"2024-05-08T18:07:40.235651+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:07:40.235651+0000","last_undegraded":"2024-05-08T18:07:40.235651+0000","last_fullsized":"2024-05-08T18:07:40.235651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238151+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:07:40.238151+0000","last_peered":"2024-05-08T18:07:40.238151+0000","last_clean":"2024-05-08T18:07:40.238151+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:07:40.238151+0000","last_undegraded":"2024-05-08T18:07:40.238151+0000","last_fullsized":"2024-05-08T18:07:40.238151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202051+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:07:40.202051+0000","last_peered":"2024-05-08T18:07:40.202051+0000","last_clean":"2024-05-08T18:07:40.202051+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:07:40.202051+0000","last_undegraded":"2024-05-08T18:07:40.202051+0000","last_fullsized":"2024-05-08T18:07:40.202051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235682+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:07:40.235682+0000","last_peered":"2024-05-08T18:07:40.235682+0000","last_clean":"2024-05-08T18:07:40.235682+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:07:40.235682+0000","last_undegraded":"2024-05-08T18:07:40.235682+0000","last_fullsized":"2024-05-08T18:07:40.235682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240677+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:07:40.240677+0000","last_peered":"2024-05-08T18:07:40.240677+0000","last_clean":"2024-05-08T18:07:40.240677+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:07:40.240677+0000","last_undegraded":"2024-05-08T18:07:40.240677+0000","last_fullsized":"2024-05-08T18:07:40.240677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222455+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:07:41.222455+0000","last_peered":"2024-05-08T18:07:41.222455+0000","last_clean":"2024-05-08T18:07:41.222455+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:07:41.222455+0000","last_undegraded":"2024-05-08T18:07:41.222455+0000","last_fullsized":"2024-05-08T18:07:41.222455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206655+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:07:40.206655+0000","last_peered":"2024-05-08T18:07:40.206655+0000","last_clean":"2024-05-08T18:07:40.206655+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:07:40.206655+0000","last_undegraded":"2024-05-08T18:07:40.206655+0000","last_fullsized":"2024-05-08T18:07:40.206655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235657+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:07:40.235657+0000","last_peered":"2024-05-08T18:07:40.235657+0000","last_clean":"2024-05-08T18:07:40.235657+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:07:40.235657+0000","last_undegraded":"2024-05-08T18:07:40.235657+0000","last_fullsized":"2024-05-08T18:07:40.235657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241657+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:07:40.241657+0000","last_peered":"2024-05-08T18:07:40.241657+0000","last_clean":"2024-05-08T18:07:40.241657+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:07:40.241657+0000","last_undegraded":"2024-05-08T18:07:40.241657+0000","last_fullsized":"2024-05-08T18:07:40.241657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236041+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:07:40.236041+0000","last_peered":"2024-05-08T18:07:40.236041+0000","last_clean":"2024-05-08T18:07:40.236041+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:07:40.236041+0000","last_undegraded":"2024-05-08T18:07:40.236041+0000","last_fullsized":"2024-05-08T18:07:40.236041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236510+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:07:40.236510+0000","last_peered":"2024-05-08T18:07:40.236510+0000","last_clean":"2024-05-08T18:07:40.236510+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:07:40.236510+0000","last_undegraded":"2024-05-08T18:07:40.236510+0000","last_fullsized":"2024-05-08T18:07:40.236510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222946+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:07:41.222946+0000","last_peered":"2024-05-08T18:07:41.222946+0000","last_clean":"2024-05-08T18:07:41.222946+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:07:41.222946+0000","last_undegraded":"2024-05-08T18:07:41.222946+0000","last_fullsized":"2024-05-08T18:07:41.222946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241747+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:07:40.241747+0000","last_peered":"2024-05-08T18:07:40.241747+0000","last_clean":"2024-05-08T18:07:40.241747+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:07:40.241747+0000","last_undegraded":"2024-05-08T18:07:40.241747+0000","last_fullsized":"2024-05-08T18:07:40.241747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1077248,"data_stored":795892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":204428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":503808,"data_stored":206249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":204919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":212466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":203990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":212320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1056768,"data_stored":795298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:07:42.708 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:07:42.739 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:42.741+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:42.766 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:07:42.767 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:07:42.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:07:42.767 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:07:42.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.767 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.767 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:07:42.767 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.951018036000001, 2024-05-08T18:07:42.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.16213206199999999, 2024-05-08T18:07:42.767 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.767 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.767 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.767 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.767 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.768 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.768 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1 2024-05-08T18:07:42.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.768 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:07:42.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:07:42.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814494+0000", 2024-05-08T18:07:42.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:07:42.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814520+0000", 2024-05-08T18:07:42.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-05 2024-05-08T18:07:42.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814543+0000", 2024-05-08T18:07:42.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2353000000000001e-05 2024-05-08T18:07:42.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814563+0000", 2024-05-08T18:07:42.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.048e-05 2024-05-08T18:07:42.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814677+0000", 2024-05-08T18:07:42.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113632 2024-05-08T18:07:42.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:07:42.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814705+0000", 2024-05-08T18:07:42.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8626999999999999e-05 2024-05-08T18:07:42.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971115+0000", 2024-05-08T18:07:42.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.156409825 2024-05-08T18:07:42.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971438+0000", 2024-05-08T18:07:42.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00032289200000000002 2024-05-08T18:07:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971849+0000", 2024-05-08T18:07:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041139300000000002 2024-05-08T18:07:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.975364+0000", 2024-05-08T18:07:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035148390000000001 2024-05-08T18:07:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976474+0000", 2024-05-08T18:07:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001110099 2024-05-08T18:07:42.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976564+0000", 2024-05-08T18:07:42.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9522000000000001e-05 2024-05-08T18:07:42.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976624+0000", 2024-05-08T18:07:42.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9616e-05 2024-05-08T18:07:42.773 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.773 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.773 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.773 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.774 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:07:42.774 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.753068589999998, 2024-05-08T18:07:42.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010762776999999999, 2024-05-08T18:07:42.774 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.774 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.774 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.774 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.774 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.774 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.774 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 24 2024-05-08T18:07:42.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.775 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:07:42.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:07:42.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012442+0000", 2024-05-08T18:07:42.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.4300000000000002e-07 2024-05-08T18:07:42.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012573+0000", 2024-05-08T18:07:42.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013108299999999999 2024-05-08T18:07:42.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012592+0000", 2024-05-08T18:07:42.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9009e-05 2024-05-08T18:07:42.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012610+0000", 2024-05-08T18:07:42.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.789e-05 2024-05-08T18:07:42.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019108+0000", 2024-05-08T18:07:42.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064981470000000001 2024-05-08T18:07:42.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019348+0000", 2024-05-08T18:07:42.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024006099999999999 2024-05-08T18:07:42.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019751+0000", 2024-05-08T18:07:42.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040324099999999998 2024-05-08T18:07:42.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.022727+0000", 2024-05-08T18:07:42.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002976107 2024-05-08T18:07:42.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.022826+0000", 2024-05-08T18:07:42.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8626000000000001e-05 2024-05-08T18:07:42.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023036+0000", 2024-05-08T18:07:42.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000209578 2024-05-08T18:07:42.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023204+0000", 2024-05-08T18:07:42.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016819200000000001 2024-05-08T18:07:42.779 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.779 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.779 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.779 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.779 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:07:42.779 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.752881494999997, 2024-05-08T18:07:42.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011074977999999999, 2024-05-08T18:07:42.779 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.779 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.779 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 25 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012629+0000", 2024-05-08T18:07:42.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7700000000000004e-07 2024-05-08T18:07:42.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012636+0000", 2024-05-08T18:07:42.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-05-08T18:07:42.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012646+0000", 2024-05-08T18:07:42.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0147e-05 2024-05-08T18:07:42.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012657+0000", 2024-05-08T18:07:42.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0473e-05 2024-05-08T18:07:42.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021198+0000", 2024-05-08T18:07:42.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0085417510000000002 2024-05-08T18:07:42.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021445+0000", 2024-05-08T18:07:42.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024665100000000002 2024-05-08T18:07:42.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021820+0000", 2024-05-08T18:07:42.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037519400000000003 2024-05-08T18:07:42.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023231+0000", 2024-05-08T18:07:42.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001410412 2024-05-08T18:07:42.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023550+0000", 2024-05-08T18:07:42.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000319368 2024-05-08T18:07:42.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023632+0000", 2024-05-08T18:07:42.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2366000000000004e-05 2024-05-08T18:07:42.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023703+0000", 2024-05-08T18:07:42.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0568999999999995e-05 2024-05-08T18:07:42.784 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.784 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.784 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.784 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.784 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:07:42.784 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.656535708, 2024-05-08T18:07:42.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011460965, 2024-05-08T18:07:42.785 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.785 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.785 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.785 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.785 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.785 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.785 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 45 2024-05-08T18:07:42.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.785 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:07:42.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:07:42.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108975+0000", 2024-05-08T18:07:42.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:07:42.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108983+0000", 2024-05-08T18:07:42.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6669999999999996e-06 2024-05-08T18:07:42.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109005+0000", 2024-05-08T18:07:42.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2787000000000001e-05 2024-05-08T18:07:42.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109020+0000", 2024-05-08T18:07:42.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4192999999999999e-05 2024-05-08T18:07:42.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116378+0000", 2024-05-08T18:07:42.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073585600000000001 2024-05-08T18:07:42.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116516+0000", 2024-05-08T18:07:42.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000137739 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116747+0000", 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023132799999999999 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120140+0000", 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033931439999999998 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120290+0000", 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149765 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120369+0000", 2024-05-08T18:07:42.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.907e-05 2024-05-08T18:07:42.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120435+0000", 2024-05-08T18:07:42.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5642999999999995e-05 2024-05-08T18:07:42.789 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.789 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.789 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.789 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.789 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:07:42.790 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.656471615000001, 2024-05-08T18:07:42.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013705973999999999, 2024-05-08T18:07:42.790 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.790 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.790 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.790 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.790 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.790 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.790 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:07:42.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.790 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:07:42.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:07:42.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109039+0000", 2024-05-08T18:07:42.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:07:42.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109044+0000", 2024-05-08T18:07:42.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6699999999999999e-06 2024-05-08T18:07:42.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109054+0000", 2024-05-08T18:07:42.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7100000000000002e-06 2024-05-08T18:07:42.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109064+0000", 2024-05-08T18:07:42.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5740000000000002e-06 2024-05-08T18:07:42.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.117676+0000", 2024-05-08T18:07:42.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086126060000000001 2024-05-08T18:07:42.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.117828+0000", 2024-05-08T18:07:42.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151552 2024-05-08T18:07:42.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118041+0000", 2024-05-08T18:07:42.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000212692 2024-05-08T18:07:42.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120269+0000", 2024-05-08T18:07:42.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022281860000000001 2024-05-08T18:07:42.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122593+0000", 2024-05-08T18:07:42.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023239419999999998 2024-05-08T18:07:42.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122672+0000", 2024-05-08T18:07:42.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9579999999999994e-05 2024-05-08T18:07:42.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122744+0000", 2024-05-08T18:07:42.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1695999999999999e-05 2024-05-08T18:07:42.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.795 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.795 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.795 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:07:42.795 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.656427772000001, 2024-05-08T18:07:42.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016228664, 2024-05-08T18:07:42.795 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.796 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.796 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.796 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.796 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.796 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.796 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 47 2024-05-08T18:07:42.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.796 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:07:42.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:07:42.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109083+0000", 2024-05-08T18:07:42.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4600000000000004e-07 2024-05-08T18:07:42.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109232+0000", 2024-05-08T18:07:42.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149782 2024-05-08T18:07:42.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109257+0000", 2024-05-08T18:07:42.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4856999999999999e-05 2024-05-08T18:07:42.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109272+0000", 2024-05-08T18:07:42.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.503e-05 2024-05-08T18:07:42.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118799+0000", 2024-05-08T18:07:42.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0095264400000000006 2024-05-08T18:07:42.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118947+0000", 2024-05-08T18:07:42.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014848199999999999 2024-05-08T18:07:42.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.119151+0000", 2024-05-08T18:07:42.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020350500000000001 2024-05-08T18:07:42.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121458+0000", 2024-05-08T18:07:42.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002307749 2024-05-08T18:07:42.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125170+0000", 2024-05-08T18:07:42.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037113409999999999 2024-05-08T18:07:42.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125246+0000", 2024-05-08T18:07:42.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6029e-05 2024-05-08T18:07:42.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125310+0000", 2024-05-08T18:07:42.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4702999999999994e-05 2024-05-08T18:07:42.801 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.802 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.802 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.802 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.802 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:07:42.802 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.656208253999999, 2024-05-08T18:07:42.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016305097000000001, 2024-05-08T18:07:42.802 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.802 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.802 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.802 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.802 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.802 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.803 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 48 2024-05-08T18:07:42.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.803 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:07:42.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:07:42.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109303+0000", 2024-05-08T18:07:42.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:07:42.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109332+0000", 2024-05-08T18:07:42.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9220000000000001e-05 2024-05-08T18:07:42.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109375+0000", 2024-05-08T18:07:42.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2765999999999997e-05 2024-05-08T18:07:42.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109394+0000", 2024-05-08T18:07:42.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8603000000000001e-05 2024-05-08T18:07:42.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120508+0000", 2024-05-08T18:07:42.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011114811 2024-05-08T18:07:42.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120663+0000", 2024-05-08T18:07:42.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000154332 2024-05-08T18:07:42.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120863+0000", 2024-05-08T18:07:42.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019995599999999999 2024-05-08T18:07:42.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125326+0000", 2024-05-08T18:07:42.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044631180000000003 2024-05-08T18:07:42.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125431+0000", 2024-05-08T18:07:42.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010522900000000001 2024-05-08T18:07:42.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125541+0000", 2024-05-08T18:07:42.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109802 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125606+0000", 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5549999999999994e-05 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.656087935000002, 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016563135, 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.807 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.808 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.808 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.808 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.808 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 49 2024-05-08T18:07:42.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.808 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:07:42.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:07:42.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109423+0000", 2024-05-08T18:07:42.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5969999999999999e-06 2024-05-08T18:07:42.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109434+0000", 2024-05-08T18:07:42.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.113e-05 2024-05-08T18:07:42.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109455+0000", 2024-05-08T18:07:42.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0873000000000002e-05 2024-05-08T18:07:42.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109469+0000", 2024-05-08T18:07:42.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4039999999999999e-05 2024-05-08T18:07:42.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121566+0000", 2024-05-08T18:07:42.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012096325999999999 2024-05-08T18:07:42.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121725+0000", 2024-05-08T18:07:42.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015932899999999999 2024-05-08T18:07:42.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121981+0000", 2024-05-08T18:07:42.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025583799999999999 2024-05-08T18:07:42.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125680+0000", 2024-05-08T18:07:42.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0036995579999999999 2024-05-08T18:07:42.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125838+0000", 2024-05-08T18:07:42.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015731499999999999 2024-05-08T18:07:42.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125914+0000", 2024-05-08T18:07:42.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6686000000000004e-05 2024-05-08T18:07:42.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125985+0000", 2024-05-08T18:07:42.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0443000000000003e-05 2024-05-08T18:07:42.812 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.812 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.812 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.813 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.813 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:07:42.813 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.656015556, 2024-05-08T18:07:42.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016620291999999998, 2024-05-08T18:07:42.813 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.813 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.813 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.813 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.813 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.813 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.813 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 50 2024-05-08T18:07:42.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.813 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:07:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:07:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109495+0000", 2024-05-08T18:07:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.477e-06 2024-05-08T18:07:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109692+0000", 2024-05-08T18:07:42.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019638199999999999 2024-05-08T18:07:42.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109733+0000", 2024-05-08T18:07:42.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1093000000000001e-05 2024-05-08T18:07:42.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109745+0000", 2024-05-08T18:07:42.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1715999999999999e-05 2024-05-08T18:07:42.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122839+0000", 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013094809000000001 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122980+0000", 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140829 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.123239+0000", 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025834799999999999 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125810+0000", 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025717729999999999 2024-05-08T18:07:42.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126001+0000", 2024-05-08T18:07:42.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019013600000000001 2024-05-08T18:07:42.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126064+0000", 2024-05-08T18:07:42.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3301999999999998e-05 2024-05-08T18:07:42.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126114+0000", 2024-05-08T18:07:42.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0426999999999997e-05 2024-05-08T18:07:42.817 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.817 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.818 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.818 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.818 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:07:42.818 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.655736408000003, 2024-05-08T18:07:42.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018305669, 2024-05-08T18:07:42.818 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.818 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.818 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.818 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.818 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.818 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.818 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 51 2024-05-08T18:07:42.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.819 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:07:42.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:07:42.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109775+0000", 2024-05-08T18:07:42.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5269999999999999e-06 2024-05-08T18:07:42.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109786+0000", 2024-05-08T18:07:42.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1296e-05 2024-05-08T18:07:42.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109806+0000", 2024-05-08T18:07:42.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0114000000000001e-05 2024-05-08T18:07:42.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109823+0000", 2024-05-08T18:07:42.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6665999999999999e-05 2024-05-08T18:07:42.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124193+0000", 2024-05-08T18:07:42.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014369916 2024-05-08T18:07:42.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124354+0000", 2024-05-08T18:07:42.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016167899999999999 2024-05-08T18:07:42.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124571+0000", 2024-05-08T18:07:42.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021652800000000001 2024-05-08T18:07:42.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126978+0000", 2024-05-08T18:07:42.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024071679999999999 2024-05-08T18:07:42.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127921+0000", 2024-05-08T18:07:42.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00094277599999999999 2024-05-08T18:07:42.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.128012+0000", 2024-05-08T18:07:42.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0818999999999999e-05 2024-05-08T18:07:42.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.128079+0000", 2024-05-08T18:07:42.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7180000000000004e-05 2024-05-08T18:07:42.823 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.823 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.823 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.823 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.823 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:07:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.655661301999999, 2024-05-08T18:07:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021440811000000001, 2024-05-08T18:07:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 52 2024-05-08T18:07:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:07:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:07:42.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109849+0000", 2024-05-08T18:07:42.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1370000000000001e-06 2024-05-08T18:07:42.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109861+0000", 2024-05-08T18:07:42.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1559999999999999e-05 2024-05-08T18:07:42.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109878+0000", 2024-05-08T18:07:42.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7105999999999999e-05 2024-05-08T18:07:42.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109892+0000", 2024-05-08T18:07:42.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3577000000000001e-05 2024-05-08T18:07:42.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126161+0000", 2024-05-08T18:07:42.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016269458000000001 2024-05-08T18:07:42.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126299+0000", 2024-05-08T18:07:42.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138405 2024-05-08T18:07:42.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126534+0000", 2024-05-08T18:07:42.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000234875 2024-05-08T18:07:42.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127543+0000", 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001008852 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131128+0000", 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035844359999999999 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131222+0000", 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3905000000000003e-05 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131289+0000", 2024-05-08T18:07:42.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7500000000000001e-05 2024-05-08T18:07:42.829 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.829 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.829 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.829 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.829 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:07:42.829 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.415375603000001, 2024-05-08T18:07:42.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010652125, 2024-05-08T18:07:42.829 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.829 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.829 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.829 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.829 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.829 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.830 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 67 2024-05-08T18:07:42.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.830 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:07:42.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:07:42.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350135+0000", 2024-05-08T18:07:42.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.083e-06 2024-05-08T18:07:42.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350141+0000", 2024-05-08T18:07:42.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.178e-06 2024-05-08T18:07:42.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350152+0000", 2024-05-08T18:07:42.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0706999999999999e-05 2024-05-08T18:07:42.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350159+0000", 2024-05-08T18:07:42.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3640000000000001e-06 2024-05-08T18:07:42.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352606+0000", 2024-05-08T18:07:42.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024470379999999999 2024-05-08T18:07:42.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352718+0000", 2024-05-08T18:07:42.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000111366 2024-05-08T18:07:42.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352887+0000", 2024-05-08T18:07:42.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016887900000000001 2024-05-08T18:07:42.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358041+0000", 2024-05-08T18:07:42.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051542940000000002 2024-05-08T18:07:42.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360681+0000", 2024-05-08T18:07:42.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026404639999999999 2024-05-08T18:07:42.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360726+0000", 2024-05-08T18:07:42.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4666999999999998e-05 2024-05-08T18:07:42.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360786+0000", 2024-05-08T18:07:42.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0084999999999998e-05 2024-05-08T18:07:42.834 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.834 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.834 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.834 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.834 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:07:42.835 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.415120215000002, 2024-05-08T18:07:42.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010500438000000001, 2024-05-08T18:07:42.835 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.835 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.835 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.835 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.835 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.835 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.835 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 68 2024-05-08T18:07:42.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.835 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:07:42.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:07:42.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350391+0000", 2024-05-08T18:07:42.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:07:42.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350398+0000", 2024-05-08T18:07:42.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6599999999999995e-06 2024-05-08T18:07:42.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350414+0000", 2024-05-08T18:07:42.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6101000000000001e-05 2024-05-08T18:07:42.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350425+0000", 2024-05-08T18:07:42.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.099e-05 2024-05-08T18:07:42.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353737+0000", 2024-05-08T18:07:42.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033112739999999999 2024-05-08T18:07:42.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353810+0000", 2024-05-08T18:07:42.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3337999999999995e-05 2024-05-08T18:07:42.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353922+0000", 2024-05-08T18:07:42.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112409 2024-05-08T18:07:42.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358114+0000", 2024-05-08T18:07:42.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041912909999999998 2024-05-08T18:07:42.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360798+0000", 2024-05-08T18:07:42.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026845850000000002 2024-05-08T18:07:42.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360838+0000", 2024-05-08T18:07:42.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9619999999999997e-05 2024-05-08T18:07:42.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360890+0000", 2024-05-08T18:07:42.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.185e-05 2024-05-08T18:07:42.840 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.840 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.840 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.840 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.840 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:07:42.840 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.414743995000002, 2024-05-08T18:07:42.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010508969999999999, 2024-05-08T18:07:42.840 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.840 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.840 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.840 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.840 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.841 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.841 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 71 2024-05-08T18:07:42.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.841 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:07:42.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:07:42.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:07:42.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.61e-07 2024-05-08T18:07:42.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350771+0000", 2024-05-08T18:07:42.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6720000000000003e-06 2024-05-08T18:07:42.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350781+0000", 2024-05-08T18:07:42.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9450000000000005e-06 2024-05-08T18:07:42.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350786+0000", 2024-05-08T18:07:42.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2530000000000004e-06 2024-05-08T18:07:42.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356065+0000", 2024-05-08T18:07:42.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052789239999999999 2024-05-08T18:07:42.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356174+0000", 2024-05-08T18:07:42.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108564 2024-05-08T18:07:42.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356336+0000", 2024-05-08T18:07:42.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162566 2024-05-08T18:07:42.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358285+0000", 2024-05-08T18:07:42.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001948443 2024-05-08T18:07:42.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361124+0000", 2024-05-08T18:07:42.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028390120000000001 2024-05-08T18:07:42.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361217+0000", 2024-05-08T18:07:42.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3899000000000003e-05 2024-05-08T18:07:42.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361275+0000", 2024-05-08T18:07:42.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7031000000000003e-05 2024-05-08T18:07:42.845 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.845 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.845 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.845 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.845 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:07:42.845 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.414666523000001, 2024-05-08T18:07:42.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010535020000000001, 2024-05-08T18:07:42.846 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.846 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.846 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.846 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.846 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.846 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.846 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 72 2024-05-08T18:07:42.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.846 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:07:42.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:07:42.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350844+0000", 2024-05-08T18:07:42.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:07:42.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350957+0000", 2024-05-08T18:07:42.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112958 2024-05-08T18:07:42.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350966+0000", 2024-05-08T18:07:42.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3440000000000007e-06 2024-05-08T18:07:42.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350972+0000", 2024-05-08T18:07:42.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.37e-06 2024-05-08T18:07:42.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356777+0000", 2024-05-08T18:07:42.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058049199999999999 2024-05-08T18:07:42.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356852+0000", 2024-05-08T18:07:42.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5109000000000002e-05 2024-05-08T18:07:42.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356961+0000", 2024-05-08T18:07:42.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108818 2024-05-08T18:07:42.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359695+0000", 2024-05-08T18:07:42.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002733685 2024-05-08T18:07:42.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361284+0000", 2024-05-08T18:07:42.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015888740000000001 2024-05-08T18:07:42.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361323+0000", 2024-05-08T18:07:42.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9824999999999999e-05 2024-05-08T18:07:42.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361378+0000", 2024-05-08T18:07:42.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4593999999999999e-05 2024-05-08T18:07:42.851 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.851 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.851 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.851 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.851 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:07:42.851 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.414526721000001, 2024-05-08T18:07:42.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01225805, 2024-05-08T18:07:42.851 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.851 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.851 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.851 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.851 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.851 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.852 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 73 2024-05-08T18:07:42.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.852 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:07:42.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:07:42.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:07:42.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0999999999999999e-07 2024-05-08T18:07:42.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350987+0000", 2024-05-08T18:07:42.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3529999999999999e-06 2024-05-08T18:07:42.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350994+0000", 2024-05-08T18:07:42.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0840000000000003e-06 2024-05-08T18:07:42.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350998+0000", 2024-05-08T18:07:42.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.194e-06 2024-05-08T18:07:42.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358336+0000", 2024-05-08T18:07:42.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073376070000000003 2024-05-08T18:07:42.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358456+0000", 2024-05-08T18:07:42.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012042199999999999 2024-05-08T18:07:42.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358615+0000", 2024-05-08T18:07:42.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015928399999999999 2024-05-08T18:07:42.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.362117+0000", 2024-05-08T18:07:42.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035021039999999998 2024-05-08T18:07:42.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363139+0000", 2024-05-08T18:07:42.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010220349999999999 2024-05-08T18:07:42.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363181+0000", 2024-05-08T18:07:42.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1465999999999999e-05 2024-05-08T18:07:42.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363241+0000", 2024-05-08T18:07:42.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9991000000000002e-05 2024-05-08T18:07:42.856 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.856 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.856 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.856 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.856 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:07:42.856 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.414501903999998, 2024-05-08T18:07:42.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012698229, 2024-05-08T18:07:42.856 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.857 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.857 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.857 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.857 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.857 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.857 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 74 2024-05-08T18:07:42.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.857 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:07:42.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:07:42.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:07:42.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4000000000000002e-07 2024-05-08T18:07:42.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351013+0000", 2024-05-08T18:07:42.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8239999999999999e-06 2024-05-08T18:07:42.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351020+0000", 2024-05-08T18:07:42.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.52e-06 2024-05-08T18:07:42.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351025+0000", 2024-05-08T18:07:42.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3499999999999999e-06 2024-05-08T18:07:42.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359063+0000", 2024-05-08T18:07:42.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0080381800000000007 2024-05-08T18:07:42.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359140+0000", 2024-05-08T18:07:42.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7225999999999995e-05 2024-05-08T18:07:42.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359256+0000", 2024-05-08T18:07:42.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011537899999999999 2024-05-08T18:07:42.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363249+0000", 2024-05-08T18:07:42.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039937089999999998 2024-05-08T18:07:42.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363584+0000", 2024-05-08T18:07:42.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033516500000000001 2024-05-08T18:07:42.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363654+0000", 2024-05-08T18:07:42.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9093999999999999e-05 2024-05-08T18:07:42.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363706+0000", 2024-05-08T18:07:42.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2342000000000001e-05 2024-05-08T18:07:42.862 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.862 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.862 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.862 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.862 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:07:42.862 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.414463644000001, 2024-05-08T18:07:42.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015677229000000001, 2024-05-08T18:07:42.862 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.863 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.863 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.863 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.863 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.863 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.863 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 75 2024-05-08T18:07:42.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.863 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:07:42.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:07:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:07:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1699999999999999e-07 2024-05-08T18:07:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351141+0000", 2024-05-08T18:07:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4661999999999996e-05 2024-05-08T18:07:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351151+0000", 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0084e-05 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351160+0000", 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2490000000000007e-06 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359748+0000", 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0085879849999999994 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359820+0000", 2024-05-08T18:07:42.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2081000000000003e-05 2024-05-08T18:07:42.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359928+0000", 2024-05-08T18:07:42.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107157 2024-05-08T18:07:42.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363254+0000", 2024-05-08T18:07:42.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033268579999999998 2024-05-08T18:07:42.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366611+0000", 2024-05-08T18:07:42.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033564179999999999 2024-05-08T18:07:42.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366672+0000", 2024-05-08T18:07:42.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0714999999999997e-05 2024-05-08T18:07:42.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366723+0000", 2024-05-08T18:07:42.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1603e-05 2024-05-08T18:07:42.867 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.867 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.867 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.868 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.868 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:07:42.868 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.414339144000003, 2024-05-08T18:07:42.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015696418, 2024-05-08T18:07:42.868 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.868 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.868 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.868 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.868 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.868 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.868 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 76 2024-05-08T18:07:42.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.868 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351171+0000", 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4600000000000004e-07 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351174+0000", 2024-05-08T18:07:42.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2030000000000001e-06 2024-05-08T18:07:42.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351179+0000", 2024-05-08T18:07:42.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2079999999999999e-06 2024-05-08T18:07:42.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351184+0000", 2024-05-08T18:07:42.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3120000000000004e-06 2024-05-08T18:07:42.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361430+0000", 2024-05-08T18:07:42.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010246175 2024-05-08T18:07:42.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361545+0000", 2024-05-08T18:07:42.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115139 2024-05-08T18:07:42.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361712+0000", 2024-05-08T18:07:42.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000166491 2024-05-08T18:07:42.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363473+0000", 2024-05-08T18:07:42.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017610799999999999 2024-05-08T18:07:42.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366769+0000", 2024-05-08T18:07:42.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032964880000000002 2024-05-08T18:07:42.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366811+0000", 2024-05-08T18:07:42.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2296000000000003e-05 2024-05-08T18:07:42.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366867+0000", 2024-05-08T18:07:42.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5380000000000002e-05 2024-05-08T18:07:42.873 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.873 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.873 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.873 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:42.873 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:07:42.873 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.063411174999999, 2024-05-08T18:07:42.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010497067000000001, 2024-05-08T18:07:42.873 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:42.874 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:42.874 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:42.874 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:42.874 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:42.874 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:42.874 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 94 2024-05-08T18:07:42.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.874 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:42.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:42.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:07:42.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:42.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:07:42.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:42.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:42.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702099+0000", 2024-05-08T18:07:42.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4099999999999999e-07 2024-05-08T18:07:42.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:42.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702102+0000", 2024-05-08T18:07:42.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6650000000000001e-06 2024-05-08T18:07:42.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:42.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702108+0000", 2024-05-08T18:07:42.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.711e-06 2024-05-08T18:07:42.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:42.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702114+0000", 2024-05-08T18:07:42.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.241e-06 2024-05-08T18:07:42.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:42.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.708666+0000", 2024-05-08T18:07:42.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065511459999999999 2024-05-08T18:07:42.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.708833+0000", 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000166966 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.709171+0000", 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033834000000000002 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.710246+0000", 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001074642 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:42.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712422+0000", 2024-05-08T18:07:42.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021762370000000001 2024-05-08T18:07:42.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:42.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712521+0000", 2024-05-08T18:07:42.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9432999999999995e-05 2024-05-08T18:07:42.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:42.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:42.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:42.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712595+0000", 2024-05-08T18:07:42.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4245000000000005e-05 2024-05-08T18:07:42.878 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.878 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.878 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.878 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:42.879 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:42.879 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:07:42.880 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:07:42.880 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:42.881+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:42.980 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:42.981+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:42.995 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:42.996 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:42.996 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:42.996 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:43.009 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:07:43.059 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:07:43.066 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:07:43.080 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-05-08T18:07:42.235430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":528,"num_write_kb":1668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221016,"kb_used_data":4832,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753704,"statfs":{"total":773094113280,"available":772867792896,"internally_reserved":0,"allocated":4947968,"data_stored":2835562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.044089"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241745+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:07:40.241745+0000","last_peered":"2024-05-08T18:07:40.241745+0000","last_clean":"2024-05-08T18:07:40.241745+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:07:40.241745+0000","last_undegraded":"2024-05-08T18:07:40.241745+0000","last_fullsized":"2024-05-08T18:07:40.241745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235146+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:07:40.235146+0000","last_peered":"2024-05-08T18:07:40.235146+0000","last_clean":"2024-05-08T18:07:40.235146+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:07:40.235146+0000","last_undegraded":"2024-05-08T18:07:40.235146+0000","last_fullsized":"2024-05-08T18:07:40.235146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224125+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:07:41.224125+0000","last_peered":"2024-05-08T18:07:41.224125+0000","last_clean":"2024-05-08T18:07:41.224125+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:07:41.224125+0000","last_undegraded":"2024-05-08T18:07:41.224125+0000","last_fullsized":"2024-05-08T18:07:41.224125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238246+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:07:40.238246+0000","last_peered":"2024-05-08T18:07:40.238246+0000","last_clean":"2024-05-08T18:07:40.238246+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:07:40.238246+0000","last_undegraded":"2024-05-08T18:07:40.238246+0000","last_fullsized":"2024-05-08T18:07:40.238246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236150+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:07:40.236150+0000","last_peered":"2024-05-08T18:07:40.236150+0000","last_clean":"2024-05-08T18:07:40.236150+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:07:40.236150+0000","last_undegraded":"2024-05-08T18:07:40.236150+0000","last_fullsized":"2024-05-08T18:07:40.236150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219670+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:07:41.219670+0000","last_peered":"2024-05-08T18:07:41.219670+0000","last_clean":"2024-05-08T18:07:41.219670+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:07:41.219670+0000","last_undegraded":"2024-05-08T18:07:41.219670+0000","last_fullsized":"2024-05-08T18:07:41.219670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236858+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:07:40.236858+0000","last_peered":"2024-05-08T18:07:40.236858+0000","last_clean":"2024-05-08T18:07:40.236858+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:07:40.236858+0000","last_undegraded":"2024-05-08T18:07:40.236858+0000","last_fullsized":"2024-05-08T18:07:40.236858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235497+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:07:40.235497+0000","last_peered":"2024-05-08T18:07:40.235497+0000","last_clean":"2024-05-08T18:07:40.235497+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:07:40.235497+0000","last_undegraded":"2024-05-08T18:07:40.235497+0000","last_fullsized":"2024-05-08T18:07:40.235497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238484+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:07:40.238484+0000","last_peered":"2024-05-08T18:07:40.238484+0000","last_clean":"2024-05-08T18:07:40.238484+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:07:40.238484+0000","last_undegraded":"2024-05-08T18:07:40.238484+0000","last_fullsized":"2024-05-08T18:07:40.238484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201643+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:07:40.201643+0000","last_peered":"2024-05-08T18:07:40.201643+0000","last_clean":"2024-05-08T18:07:40.201643+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:07:40.201643+0000","last_undegraded":"2024-05-08T18:07:40.201643+0000","last_fullsized":"2024-05-08T18:07:40.201643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238380+0000","last_change":"2024-05-08T18:07:15.502659+0000","last_active":"2024-05-08T18:07:40.238380+0000","last_peered":"2024-05-08T18:07:40.238380+0000","last_clean":"2024-05-08T18:07:40.238380+0000","last_became_active":"2024-05-08T18:07:15.501947+0000","last_became_peered":"2024-05-08T18:07:15.501947+0000","last_unstale":"2024-05-08T18:07:40.238380+0000","last_undegraded":"2024-05-08T18:07:40.238380+0000","last_fullsized":"2024-05-08T18:07:40.238380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221139+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:07:41.221139+0000","last_peered":"2024-05-08T18:07:41.221139+0000","last_clean":"2024-05-08T18:07:41.221139+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:07:41.221139+0000","last_undegraded":"2024-05-08T18:07:41.221139+0000","last_fullsized":"2024-05-08T18:07:41.221139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238846+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:07:40.238846+0000","last_peered":"2024-05-08T18:07:40.238846+0000","last_clean":"2024-05-08T18:07:40.238846+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:07:40.238846+0000","last_undegraded":"2024-05-08T18:07:40.238846+0000","last_fullsized":"2024-05-08T18:07:40.238846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241317+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:07:40.241317+0000","last_peered":"2024-05-08T18:07:40.241317+0000","last_clean":"2024-05-08T18:07:40.241317+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:07:40.241317+0000","last_undegraded":"2024-05-08T18:07:40.241317+0000","last_fullsized":"2024-05-08T18:07:40.241317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223365+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:07:41.223365+0000","last_peered":"2024-05-08T18:07:41.223365+0000","last_clean":"2024-05-08T18:07:41.223365+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:07:41.223365+0000","last_undegraded":"2024-05-08T18:07:41.223365+0000","last_fullsized":"2024-05-08T18:07:41.223365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.205153+0000","last_change":"2024-05-08T18:07:17.508968+0000","last_active":"2024-05-08T18:07:40.205153+0000","last_peered":"2024-05-08T18:07:40.205153+0000","last_clean":"2024-05-08T18:07:40.205153+0000","last_became_active":"2024-05-08T18:07:17.508588+0000","last_became_peered":"2024-05-08T18:07:17.508588+0000","last_unstale":"2024-05-08T18:07:40.205153+0000","last_undegraded":"2024-05-08T18:07:40.205153+0000","last_fullsized":"2024-05-08T18:07:40.205153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:08.890984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218904+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:07:41.218904+0000","last_peered":"2024-05-08T18:07:41.218904+0000","last_clean":"2024-05-08T18:07:41.218904+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:07:41.218904+0000","last_undegraded":"2024-05-08T18:07:41.218904+0000","last_fullsized":"2024-05-08T18:07:41.218904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241957+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:07:40.241957+0000","last_peered":"2024-05-08T18:07:40.241957+0000","last_clean":"2024-05-08T18:07:40.241957+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:07:40.241957+0000","last_undegraded":"2024-05-08T18:07:40.241957+0000","last_fullsized":"2024-05-08T18:07:40.241957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238489+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:07:40.238489+0000","last_peered":"2024-05-08T18:07:40.238489+0000","last_clean":"2024-05-08T18:07:40.238489+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:07:40.238489+0000","last_undegraded":"2024-05-08T18:07:40.238489+0000","last_fullsized":"2024-05-08T18:07:40.238489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201894+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:07:40.201894+0000","last_peered":"2024-05-08T18:07:40.201894+0000","last_clean":"2024-05-08T18:07:40.201894+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:07:40.201894+0000","last_undegraded":"2024-05-08T18:07:40.201894+0000","last_fullsized":"2024-05-08T18:07:40.201894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238769+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:07:40.238769+0000","last_peered":"2024-05-08T18:07:40.238769+0000","last_clean":"2024-05-08T18:07:40.238769+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:07:40.238769+0000","last_undegraded":"2024-05-08T18:07:40.238769+0000","last_fullsized":"2024-05-08T18:07:40.238769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202086+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:07:40.202086+0000","last_peered":"2024-05-08T18:07:40.202086+0000","last_clean":"2024-05-08T18:07:40.202086+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:07:40.202086+0000","last_undegraded":"2024-05-08T18:07:40.202086+0000","last_fullsized":"2024-05-08T18:07:40.202086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204767+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:07:40.204767+0000","last_peered":"2024-05-08T18:07:40.204767+0000","last_clean":"2024-05-08T18:07:40.204767+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:07:40.204767+0000","last_undegraded":"2024-05-08T18:07:40.204767+0000","last_fullsized":"2024-05-08T18:07:40.204767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219930+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:07:41.219930+0000","last_peered":"2024-05-08T18:07:41.219930+0000","last_clean":"2024-05-08T18:07:41.219930+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:07:41.219930+0000","last_undegraded":"2024-05-08T18:07:41.219930+0000","last_fullsized":"2024-05-08T18:07:41.219930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206077+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:07:40.206077+0000","last_peered":"2024-05-08T18:07:40.206077+0000","last_clean":"2024-05-08T18:07:40.206077+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:07:40.206077+0000","last_undegraded":"2024-05-08T18:07:40.206077+0000","last_fullsized":"2024-05-08T18:07:40.206077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223830+0000","last_change":"2024-05-08T18:07:15.480500+0000","last_active":"2024-05-08T18:07:41.223830+0000","last_peered":"2024-05-08T18:07:41.223830+0000","last_clean":"2024-05-08T18:07:41.223830+0000","last_became_active":"2024-05-08T18:07:15.480192+0000","last_became_peered":"2024-05-08T18:07:15.480192+0000","last_unstale":"2024-05-08T18:07:41.223830+0000","last_undegraded":"2024-05-08T18:07:41.223830+0000","last_fullsized":"2024-05-08T18:07:41.223830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221336+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:07:41.221336+0000","last_peered":"2024-05-08T18:07:41.221336+0000","last_clean":"2024-05-08T18:07:41.221336+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:07:41.221336+0000","last_undegraded":"2024-05-08T18:07:41.221336+0000","last_fullsized":"2024-05-08T18:07:41.221336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236024+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:07:40.236024+0000","last_peered":"2024-05-08T18:07:40.236024+0000","last_clean":"2024-05-08T18:07:40.236024+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:07:40.236024+0000","last_undegraded":"2024-05-08T18:07:40.236024+0000","last_fullsized":"2024-05-08T18:07:40.236024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218463+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:07:41.218463+0000","last_peered":"2024-05-08T18:07:41.218463+0000","last_clean":"2024-05-08T18:07:41.218463+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:07:41.218463+0000","last_undegraded":"2024-05-08T18:07:41.218463+0000","last_fullsized":"2024-05-08T18:07:41.218463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.228275+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:07:41.228275+0000","last_peered":"2024-05-08T18:07:41.228275+0000","last_clean":"2024-05-08T18:07:41.228275+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:07:41.228275+0000","last_undegraded":"2024-05-08T18:07:41.228275+0000","last_fullsized":"2024-05-08T18:07:41.228275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238633+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:07:40.238633+0000","last_peered":"2024-05-08T18:07:40.238633+0000","last_clean":"2024-05-08T18:07:40.238633+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:07:40.238633+0000","last_undegraded":"2024-05-08T18:07:40.238633+0000","last_fullsized":"2024-05-08T18:07:40.238633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239977+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:07:40.239977+0000","last_peered":"2024-05-08T18:07:40.239977+0000","last_clean":"2024-05-08T18:07:40.239977+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:07:40.239977+0000","last_undegraded":"2024-05-08T18:07:40.239977+0000","last_fullsized":"2024-05-08T18:07:40.239977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236168+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:07:40.236168+0000","last_peered":"2024-05-08T18:07:40.236168+0000","last_clean":"2024-05-08T18:07:40.236168+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:07:40.236168+0000","last_undegraded":"2024-05-08T18:07:40.236168+0000","last_fullsized":"2024-05-08T18:07:40.236168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241238+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:07:40.241238+0000","last_peered":"2024-05-08T18:07:40.241238+0000","last_clean":"2024-05-08T18:07:40.241238+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:07:40.241238+0000","last_undegraded":"2024-05-08T18:07:40.241238+0000","last_fullsized":"2024-05-08T18:07:40.241238+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238562+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:07:40.238562+0000","last_peered":"2024-05-08T18:07:40.238562+0000","last_clean":"2024-05-08T18:07:40.238562+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:07:40.238562+0000","last_undegraded":"2024-05-08T18:07:40.238562+0000","last_fullsized":"2024-05-08T18:07:40.238562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240560+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:07:40.240560+0000","last_peered":"2024-05-08T18:07:40.240560+0000","last_clean":"2024-05-08T18:07:40.240560+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:07:40.240560+0000","last_undegraded":"2024-05-08T18:07:40.240560+0000","last_fullsized":"2024-05-08T18:07:40.240560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236106+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:07:40.236106+0000","last_peered":"2024-05-08T18:07:40.236106+0000","last_clean":"2024-05-08T18:07:40.236106+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:07:40.236106+0000","last_undegraded":"2024-05-08T18:07:40.236106+0000","last_fullsized":"2024-05-08T18:07:40.236106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.227952+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:07:41.227952+0000","last_peered":"2024-05-08T18:07:41.227952+0000","last_clean":"2024-05-08T18:07:41.227952+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:07:41.227952+0000","last_undegraded":"2024-05-08T18:07:41.227952+0000","last_fullsized":"2024-05-08T18:07:41.227952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221217+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:07:41.221217+0000","last_peered":"2024-05-08T18:07:41.221217+0000","last_clean":"2024-05-08T18:07:41.221217+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:07:41.221217+0000","last_undegraded":"2024-05-08T18:07:41.221217+0000","last_fullsized":"2024-05-08T18:07:41.221217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221065+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:07:41.221065+0000","last_peered":"2024-05-08T18:07:41.221065+0000","last_clean":"2024-05-08T18:07:41.221065+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:07:41.221065+0000","last_undegraded":"2024-05-08T18:07:41.221065+0000","last_fullsized":"2024-05-08T18:07:41.221065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235765+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:07:40.235765+0000","last_peered":"2024-05-08T18:07:40.235765+0000","last_clean":"2024-05-08T18:07:40.235765+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:07:40.235765+0000","last_undegraded":"2024-05-08T18:07:40.235765+0000","last_fullsized":"2024-05-08T18:07:40.235765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236901+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:07:40.236901+0000","last_peered":"2024-05-08T18:07:40.236901+0000","last_clean":"2024-05-08T18:07:40.236901+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:07:40.236901+0000","last_undegraded":"2024-05-08T18:07:40.236901+0000","last_fullsized":"2024-05-08T18:07:40.236901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239199+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:07:40.239199+0000","last_peered":"2024-05-08T18:07:40.239199+0000","last_clean":"2024-05-08T18:07:40.239199+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:07:40.239199+0000","last_undegraded":"2024-05-08T18:07:40.239199+0000","last_fullsized":"2024-05-08T18:07:40.239199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225439+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:07:41.225439+0000","last_peered":"2024-05-08T18:07:41.225439+0000","last_clean":"2024-05-08T18:07:41.225439+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:07:41.225439+0000","last_undegraded":"2024-05-08T18:07:41.225439+0000","last_fullsized":"2024-05-08T18:07:41.225439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.205615+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:07:40.205615+0000","last_peered":"2024-05-08T18:07:40.205615+0000","last_clean":"2024-05-08T18:07:40.205615+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:07:40.205615+0000","last_undegraded":"2024-05-08T18:07:40.205615+0000","last_fullsized":"2024-05-08T18:07:40.205615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239291+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:07:40.239291+0000","last_peered":"2024-05-08T18:07:40.239291+0000","last_clean":"2024-05-08T18:07:40.239291+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:07:40.239291+0000","last_undegraded":"2024-05-08T18:07:40.239291+0000","last_fullsized":"2024-05-08T18:07:40.239291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218981+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:07:41.218981+0000","last_peered":"2024-05-08T18:07:41.218981+0000","last_clean":"2024-05-08T18:07:41.218981+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:07:41.218981+0000","last_undegraded":"2024-05-08T18:07:41.218981+0000","last_fullsized":"2024-05-08T18:07:41.218981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224996+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:07:41.224996+0000","last_peered":"2024-05-08T18:07:41.224996+0000","last_clean":"2024-05-08T18:07:41.224996+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:07:41.224996+0000","last_undegraded":"2024-05-08T18:07:41.224996+0000","last_fullsized":"2024-05-08T18:07:41.224996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.200795+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:07:40.200795+0000","last_peered":"2024-05-08T18:07:40.200795+0000","last_clean":"2024-05-08T18:07:40.200795+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:07:40.200795+0000","last_undegraded":"2024-05-08T18:07:40.200795+0000","last_fullsized":"2024-05-08T18:07:40.200795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241308+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:07:40.241308+0000","last_peered":"2024-05-08T18:07:40.241308+0000","last_clean":"2024-05-08T18:07:40.241308+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:07:40.241308+0000","last_undegraded":"2024-05-08T18:07:40.241308+0000","last_fullsized":"2024-05-08T18:07:40.241308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240181+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:07:40.240181+0000","last_peered":"2024-05-08T18:07:40.240181+0000","last_clean":"2024-05-08T18:07:40.240181+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:07:40.240181+0000","last_undegraded":"2024-05-08T18:07:40.240181+0000","last_fullsized":"2024-05-08T18:07:40.240181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223675+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:07:41.223675+0000","last_peered":"2024-05-08T18:07:41.223675+0000","last_clean":"2024-05-08T18:07:41.223675+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:07:41.223675+0000","last_undegraded":"2024-05-08T18:07:41.223675+0000","last_fullsized":"2024-05-08T18:07:41.223675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235814+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:07:40.235814+0000","last_peered":"2024-05-08T18:07:40.235814+0000","last_clean":"2024-05-08T18:07:40.235814+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:07:40.235814+0000","last_undegraded":"2024-05-08T18:07:40.235814+0000","last_fullsized":"2024-05-08T18:07:40.235814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.242078+0000","last_change":"2024-05-08T18:07:15.515622+0000","last_active":"2024-05-08T18:07:40.242078+0000","last_peered":"2024-05-08T18:07:40.242078+0000","last_clean":"2024-05-08T18:07:40.242078+0000","last_became_active":"2024-05-08T18:07:15.515050+0000","last_became_peered":"2024-05-08T18:07:15.515050+0000","last_unstale":"2024-05-08T18:07:40.242078+0000","last_undegraded":"2024-05-08T18:07:40.242078+0000","last_fullsized":"2024-05-08T18:07:40.242078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237648+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:07:40.237648+0000","last_peered":"2024-05-08T18:07:40.237648+0000","last_clean":"2024-05-08T18:07:40.237648+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:07:40.237648+0000","last_undegraded":"2024-05-08T18:07:40.237648+0000","last_fullsized":"2024-05-08T18:07:40.237648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":63,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235270+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:07:40.235270+0000","last_peered":"2024-05-08T18:07:40.235270+0000","last_clean":"2024-05-08T18:07:40.235270+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:07:40.235270+0000","last_undegraded":"2024-05-08T18:07:40.235270+0000","last_fullsized":"2024-05-08T18:07:40.235270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224035+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:07:41.224035+0000","last_peered":"2024-05-08T18:07:41.224035+0000","last_clean":"2024-05-08T18:07:41.224035+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:07:41.224035+0000","last_undegraded":"2024-05-08T18:07:41.224035+0000","last_fullsized":"2024-05-08T18:07:41.224035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236214+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:07:40.236214+0000","last_peered":"2024-05-08T18:07:40.236214+0000","last_clean":"2024-05-08T18:07:40.236214+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:07:40.236214+0000","last_undegraded":"2024-05-08T18:07:40.236214+0000","last_fullsized":"2024-05-08T18:07:40.236214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218965+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:07:41.218965+0000","last_peered":"2024-05-08T18:07:41.218965+0000","last_clean":"2024-05-08T18:07:41.218965+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:07:41.218965+0000","last_undegraded":"2024-05-08T18:07:41.218965+0000","last_fullsized":"2024-05-08T18:07:41.218965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241551+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:07:40.241551+0000","last_peered":"2024-05-08T18:07:40.241551+0000","last_clean":"2024-05-08T18:07:40.241551+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:07:40.241551+0000","last_undegraded":"2024-05-08T18:07:40.241551+0000","last_fullsized":"2024-05-08T18:07:40.241551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204671+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:07:40.204671+0000","last_peered":"2024-05-08T18:07:40.204671+0000","last_clean":"2024-05-08T18:07:40.204671+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:07:40.204671+0000","last_undegraded":"2024-05-08T18:07:40.204671+0000","last_fullsized":"2024-05-08T18:07:40.204671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224224+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:07:41.224224+0000","last_peered":"2024-05-08T18:07:41.224224+0000","last_clean":"2024-05-08T18:07:41.224224+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:07:41.224224+0000","last_undegraded":"2024-05-08T18:07:41.224224+0000","last_fullsized":"2024-05-08T18:07:41.224224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222963+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:07:41.222963+0000","last_peered":"2024-05-08T18:07:41.222963+0000","last_clean":"2024-05-08T18:07:41.222963+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:07:41.222963+0000","last_undegraded":"2024-05-08T18:07:41.222963+0000","last_fullsized":"2024-05-08T18:07:41.222963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201029+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:07:40.201029+0000","last_peered":"2024-05-08T18:07:40.201029+0000","last_clean":"2024-05-08T18:07:40.201029+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:07:40.201029+0000","last_undegraded":"2024-05-08T18:07:40.201029+0000","last_fullsized":"2024-05-08T18:07:40.201029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201874+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:07:40.201874+0000","last_peered":"2024-05-08T18:07:40.201874+0000","last_clean":"2024-05-08T18:07:40.201874+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:07:40.201874+0000","last_undegraded":"2024-05-08T18:07:40.201874+0000","last_fullsized":"2024-05-08T18:07:40.201874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240446+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:07:40.240446+0000","last_peered":"2024-05-08T18:07:40.240446+0000","last_clean":"2024-05-08T18:07:40.240446+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:07:40.240446+0000","last_undegraded":"2024-05-08T18:07:40.240446+0000","last_fullsized":"2024-05-08T18:07:40.240446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204923+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:07:40.204923+0000","last_peered":"2024-05-08T18:07:40.204923+0000","last_clean":"2024-05-08T18:07:40.204923+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:07:40.204923+0000","last_undegraded":"2024-05-08T18:07:40.204923+0000","last_fullsized":"2024-05-08T18:07:40.204923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236245+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:07:40.236245+0000","last_peered":"2024-05-08T18:07:40.236245+0000","last_clean":"2024-05-08T18:07:40.236245+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:07:40.236245+0000","last_undegraded":"2024-05-08T18:07:40.236245+0000","last_fullsized":"2024-05-08T18:07:40.236245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235169+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:07:40.235169+0000","last_peered":"2024-05-08T18:07:40.235169+0000","last_clean":"2024-05-08T18:07:40.235169+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:07:40.235169+0000","last_undegraded":"2024-05-08T18:07:40.235169+0000","last_fullsized":"2024-05-08T18:07:40.235169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236219+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:07:40.236219+0000","last_peered":"2024-05-08T18:07:40.236219+0000","last_clean":"2024-05-08T18:07:40.236219+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:07:40.236219+0000","last_undegraded":"2024-05-08T18:07:40.236219+0000","last_fullsized":"2024-05-08T18:07:40.236219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235885+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:07:40.235885+0000","last_peered":"2024-05-08T18:07:40.235885+0000","last_clean":"2024-05-08T18:07:40.235885+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:07:40.235885+0000","last_undegraded":"2024-05-08T18:07:40.235885+0000","last_fullsized":"2024-05-08T18:07:40.235885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237462+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:07:40.237462+0000","last_peered":"2024-05-08T18:07:40.237462+0000","last_clean":"2024-05-08T18:07:40.237462+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:07:40.237462+0000","last_undegraded":"2024-05-08T18:07:40.237462+0000","last_fullsized":"2024-05-08T18:07:40.237462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204614+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:07:40.204614+0000","last_peered":"2024-05-08T18:07:40.204614+0000","last_clean":"2024-05-08T18:07:40.204614+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:07:40.204614+0000","last_undegraded":"2024-05-08T18:07:40.204614+0000","last_fullsized":"2024-05-08T18:07:40.204614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235490+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:07:40.235490+0000","last_peered":"2024-05-08T18:07:40.235490+0000","last_clean":"2024-05-08T18:07:40.235490+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:07:40.235490+0000","last_undegraded":"2024-05-08T18:07:40.235490+0000","last_fullsized":"2024-05-08T18:07:40.235490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204419+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:07:40.204419+0000","last_peered":"2024-05-08T18:07:40.204419+0000","last_clean":"2024-05-08T18:07:40.204419+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:07:40.204419+0000","last_undegraded":"2024-05-08T18:07:40.204419+0000","last_fullsized":"2024-05-08T18:07:40.204419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224407+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:07:41.224407+0000","last_peered":"2024-05-08T18:07:41.224407+0000","last_clean":"2024-05-08T18:07:41.224407+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:07:41.224407+0000","last_undegraded":"2024-05-08T18:07:41.224407+0000","last_fullsized":"2024-05-08T18:07:41.224407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220409+0000","last_change":"2024-05-08T18:07:17.495459+0000","last_active":"2024-05-08T18:07:41.220409+0000","last_peered":"2024-05-08T18:07:41.220409+0000","last_clean":"2024-05-08T18:07:41.220409+0000","last_became_active":"2024-05-08T18:07:17.494659+0000","last_became_peered":"2024-05-08T18:07:17.494659+0000","last_unstale":"2024-05-08T18:07:41.220409+0000","last_undegraded":"2024-05-08T18:07:41.220409+0000","last_fullsized":"2024-05-08T18:07:41.220409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223329+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:07:41.223329+0000","last_peered":"2024-05-08T18:07:41.223329+0000","last_clean":"2024-05-08T18:07:41.223329+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:07:41.223329+0000","last_undegraded":"2024-05-08T18:07:41.223329+0000","last_fullsized":"2024-05-08T18:07:41.223329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206221+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:07:40.206221+0000","last_peered":"2024-05-08T18:07:40.206221+0000","last_clean":"2024-05-08T18:07:40.206221+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:07:40.206221+0000","last_undegraded":"2024-05-08T18:07:40.206221+0000","last_fullsized":"2024-05-08T18:07:40.206221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221218+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:07:41.221218+0000","last_peered":"2024-05-08T18:07:41.221218+0000","last_clean":"2024-05-08T18:07:41.221218+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:07:41.221218+0000","last_undegraded":"2024-05-08T18:07:41.221218+0000","last_fullsized":"2024-05-08T18:07:41.221218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236262+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:07:40.236262+0000","last_peered":"2024-05-08T18:07:40.236262+0000","last_clean":"2024-05-08T18:07:40.236262+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:07:40.236262+0000","last_undegraded":"2024-05-08T18:07:40.236262+0000","last_fullsized":"2024-05-08T18:07:40.236262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222041+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:07:41.222041+0000","last_peered":"2024-05-08T18:07:41.222041+0000","last_clean":"2024-05-08T18:07:41.222041+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:07:41.222041+0000","last_undegraded":"2024-05-08T18:07:41.222041+0000","last_fullsized":"2024-05-08T18:07:41.222041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221320+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:07:41.221320+0000","last_peered":"2024-05-08T18:07:41.221320+0000","last_clean":"2024-05-08T18:07:41.221320+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:07:41.221320+0000","last_undegraded":"2024-05-08T18:07:41.221320+0000","last_fullsized":"2024-05-08T18:07:41.221320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202382+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:07:40.202382+0000","last_peered":"2024-05-08T18:07:40.202382+0000","last_clean":"2024-05-08T18:07:40.202382+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:07:40.202382+0000","last_undegraded":"2024-05-08T18:07:40.202382+0000","last_fullsized":"2024-05-08T18:07:40.202382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224189+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:07:41.224189+0000","last_peered":"2024-05-08T18:07:41.224189+0000","last_clean":"2024-05-08T18:07:41.224189+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:07:41.224189+0000","last_undegraded":"2024-05-08T18:07:41.224189+0000","last_fullsized":"2024-05-08T18:07:41.224189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.205114+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:07:40.205114+0000","last_peered":"2024-05-08T18:07:40.205114+0000","last_clean":"2024-05-08T18:07:40.205114+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:07:40.205114+0000","last_undegraded":"2024-05-08T18:07:40.205114+0000","last_fullsized":"2024-05-08T18:07:40.205114+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206369+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:07:40.206369+0000","last_peered":"2024-05-08T18:07:40.206369+0000","last_clean":"2024-05-08T18:07:40.206369+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:07:40.206369+0000","last_undegraded":"2024-05-08T18:07:40.206369+0000","last_fullsized":"2024-05-08T18:07:40.206369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222447+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:07:41.222447+0000","last_peered":"2024-05-08T18:07:41.222447+0000","last_clean":"2024-05-08T18:07:41.222447+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:07:41.222447+0000","last_undegraded":"2024-05-08T18:07:41.222447+0000","last_fullsized":"2024-05-08T18:07:41.222447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221664+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:07:41.221664+0000","last_peered":"2024-05-08T18:07:41.221664+0000","last_clean":"2024-05-08T18:07:41.221664+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:07:41.221664+0000","last_undegraded":"2024-05-08T18:07:41.221664+0000","last_fullsized":"2024-05-08T18:07:41.221664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219629+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:07:41.219629+0000","last_peered":"2024-05-08T18:07:41.219629+0000","last_clean":"2024-05-08T18:07:41.219629+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:07:41.219629+0000","last_undegraded":"2024-05-08T18:07:41.219629+0000","last_fullsized":"2024-05-08T18:07:41.219629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240482+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:07:40.240482+0000","last_peered":"2024-05-08T18:07:40.240482+0000","last_clean":"2024-05-08T18:07:40.240482+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:07:40.240482+0000","last_undegraded":"2024-05-08T18:07:40.240482+0000","last_fullsized":"2024-05-08T18:07:40.240482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223976+0000","last_change":"2024-05-08T18:07:21.533056+0000","last_active":"2024-05-08T18:07:41.223976+0000","last_peered":"2024-05-08T18:07:41.223976+0000","last_clean":"2024-05-08T18:07:41.223976+0000","last_became_active":"2024-05-08T18:07:21.532184+0000","last_became_peered":"2024-05-08T18:07:21.532184+0000","last_unstale":"2024-05-08T18:07:41.223976+0000","last_undegraded":"2024-05-08T18:07:41.223976+0000","last_fullsized":"2024-05-08T18:07:41.223976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:50.629014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201470+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:07:40.201470+0000","last_peered":"2024-05-08T18:07:40.201470+0000","last_clean":"2024-05-08T18:07:40.201470+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:07:40.201470+0000","last_undegraded":"2024-05-08T18:07:40.201470+0000","last_fullsized":"2024-05-08T18:07:40.201470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219407+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:07:41.219407+0000","last_peered":"2024-05-08T18:07:41.219407+0000","last_clean":"2024-05-08T18:07:41.219407+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:07:41.219407+0000","last_undegraded":"2024-05-08T18:07:41.219407+0000","last_fullsized":"2024-05-08T18:07:41.219407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225198+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:07:41.225198+0000","last_peered":"2024-05-08T18:07:41.225198+0000","last_clean":"2024-05-08T18:07:41.225198+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:07:41.225198+0000","last_undegraded":"2024-05-08T18:07:41.225198+0000","last_fullsized":"2024-05-08T18:07:41.225198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223858+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:07:41.223858+0000","last_peered":"2024-05-08T18:07:41.223858+0000","last_clean":"2024-05-08T18:07:41.223858+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:07:41.223858+0000","last_undegraded":"2024-05-08T18:07:41.223858+0000","last_fullsized":"2024-05-08T18:07:41.223858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221524+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:07:41.221524+0000","last_peered":"2024-05-08T18:07:41.221524+0000","last_clean":"2024-05-08T18:07:41.221524+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:07:41.221524+0000","last_undegraded":"2024-05-08T18:07:41.221524+0000","last_fullsized":"2024-05-08T18:07:41.221524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236236+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:07:40.236236+0000","last_peered":"2024-05-08T18:07:40.236236+0000","last_clean":"2024-05-08T18:07:40.236236+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:07:40.236236+0000","last_undegraded":"2024-05-08T18:07:40.236236+0000","last_fullsized":"2024-05-08T18:07:40.236236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201182+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:07:40.201182+0000","last_peered":"2024-05-08T18:07:40.201182+0000","last_clean":"2024-05-08T18:07:40.201182+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:07:40.201182+0000","last_undegraded":"2024-05-08T18:07:40.201182+0000","last_fullsized":"2024-05-08T18:07:40.201182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223902+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:07:41.223902+0000","last_peered":"2024-05-08T18:07:41.223902+0000","last_clean":"2024-05-08T18:07:41.223902+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:07:41.223902+0000","last_undegraded":"2024-05-08T18:07:41.223902+0000","last_fullsized":"2024-05-08T18:07:41.223902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201817+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:07:40.201817+0000","last_peered":"2024-05-08T18:07:40.201817+0000","last_clean":"2024-05-08T18:07:40.201817+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:07:40.201817+0000","last_undegraded":"2024-05-08T18:07:40.201817+0000","last_fullsized":"2024-05-08T18:07:40.201817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":146,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236507+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:07:40.236507+0000","last_peered":"2024-05-08T18:07:40.236507+0000","last_clean":"2024-05-08T18:07:40.236507+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:07:40.236507+0000","last_undegraded":"2024-05-08T18:07:40.236507+0000","last_fullsized":"2024-05-08T18:07:40.236507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237052+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:07:40.237052+0000","last_peered":"2024-05-08T18:07:40.237052+0000","last_clean":"2024-05-08T18:07:40.237052+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:07:40.237052+0000","last_undegraded":"2024-05-08T18:07:40.237052+0000","last_fullsized":"2024-05-08T18:07:40.237052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223191+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:07:41.223191+0000","last_peered":"2024-05-08T18:07:41.223191+0000","last_clean":"2024-05-08T18:07:41.223191+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:07:41.223191+0000","last_undegraded":"2024-05-08T18:07:41.223191+0000","last_fullsized":"2024-05-08T18:07:41.223191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239412+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:07:40.239412+0000","last_peered":"2024-05-08T18:07:40.239412+0000","last_clean":"2024-05-08T18:07:40.239412+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:07:40.239412+0000","last_undegraded":"2024-05-08T18:07:40.239412+0000","last_fullsized":"2024-05-08T18:07:40.239412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":59,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240778+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:07:40.240778+0000","last_peered":"2024-05-08T18:07:40.240778+0000","last_clean":"2024-05-08T18:07:40.240778+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:07:40.240778+0000","last_undegraded":"2024-05-08T18:07:40.240778+0000","last_fullsized":"2024-05-08T18:07:40.240778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236351+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:07:40.236351+0000","last_peered":"2024-05-08T18:07:40.236351+0000","last_clean":"2024-05-08T18:07:40.236351+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:07:40.236351+0000","last_undegraded":"2024-05-08T18:07:40.236351+0000","last_fullsized":"2024-05-08T18:07:40.236351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.200434+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:07:40.200434+0000","last_peered":"2024-05-08T18:07:40.200434+0000","last_clean":"2024-05-08T18:07:40.200434+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:07:40.200434+0000","last_undegraded":"2024-05-08T18:07:40.200434+0000","last_fullsized":"2024-05-08T18:07:40.200434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236745+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:07:40.236745+0000","last_peered":"2024-05-08T18:07:40.236745+0000","last_clean":"2024-05-08T18:07:40.236745+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:07:40.236745+0000","last_undegraded":"2024-05-08T18:07:40.236745+0000","last_fullsized":"2024-05-08T18:07:40.236745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236011+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:07:40.236011+0000","last_peered":"2024-05-08T18:07:40.236011+0000","last_clean":"2024-05-08T18:07:40.236011+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:07:40.236011+0000","last_undegraded":"2024-05-08T18:07:40.236011+0000","last_fullsized":"2024-05-08T18:07:40.236011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235618+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:07:40.235618+0000","last_peered":"2024-05-08T18:07:40.235618+0000","last_clean":"2024-05-08T18:07:40.235618+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:07:40.235618+0000","last_undegraded":"2024-05-08T18:07:40.235618+0000","last_fullsized":"2024-05-08T18:07:40.235618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241306+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:07:40.241306+0000","last_peered":"2024-05-08T18:07:40.241306+0000","last_clean":"2024-05-08T18:07:40.241306+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:07:40.241306+0000","last_undegraded":"2024-05-08T18:07:40.241306+0000","last_fullsized":"2024-05-08T18:07:40.241306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224002+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:07:41.224002+0000","last_peered":"2024-05-08T18:07:41.224002+0000","last_clean":"2024-05-08T18:07:41.224002+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:07:41.224002+0000","last_undegraded":"2024-05-08T18:07:41.224002+0000","last_fullsized":"2024-05-08T18:07:41.224002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239274+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:07:40.239274+0000","last_peered":"2024-05-08T18:07:40.239274+0000","last_clean":"2024-05-08T18:07:40.239274+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:07:40.239274+0000","last_undegraded":"2024-05-08T18:07:40.239274+0000","last_fullsized":"2024-05-08T18:07:40.239274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222008+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:07:41.222008+0000","last_peered":"2024-05-08T18:07:41.222008+0000","last_clean":"2024-05-08T18:07:41.222008+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:07:41.222008+0000","last_undegraded":"2024-05-08T18:07:41.222008+0000","last_fullsized":"2024-05-08T18:07:41.222008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225435+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:07:41.225435+0000","last_peered":"2024-05-08T18:07:41.225435+0000","last_clean":"2024-05-08T18:07:41.225435+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:07:41.225435+0000","last_undegraded":"2024-05-08T18:07:41.225435+0000","last_fullsized":"2024-05-08T18:07:41.225435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.205230+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:07:40.205230+0000","last_peered":"2024-05-08T18:07:40.205230+0000","last_clean":"2024-05-08T18:07:40.205230+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:07:40.205230+0000","last_undegraded":"2024-05-08T18:07:40.205230+0000","last_fullsized":"2024-05-08T18:07:40.205230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221775+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:07:41.221775+0000","last_peered":"2024-05-08T18:07:41.221775+0000","last_clean":"2024-05-08T18:07:41.221775+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:07:41.221775+0000","last_undegraded":"2024-05-08T18:07:41.221775+0000","last_fullsized":"2024-05-08T18:07:41.221775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206526+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:07:40.206526+0000","last_peered":"2024-05-08T18:07:40.206526+0000","last_clean":"2024-05-08T18:07:40.206526+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:07:40.206526+0000","last_undegraded":"2024-05-08T18:07:40.206526+0000","last_fullsized":"2024-05-08T18:07:40.206526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239831+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:07:40.239831+0000","last_peered":"2024-05-08T18:07:40.239831+0000","last_clean":"2024-05-08T18:07:40.239831+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:07:40.239831+0000","last_undegraded":"2024-05-08T18:07:40.239831+0000","last_fullsized":"2024-05-08T18:07:40.239831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235840+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:07:40.235840+0000","last_peered":"2024-05-08T18:07:40.235840+0000","last_clean":"2024-05-08T18:07:40.235840+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:07:40.235840+0000","last_undegraded":"2024-05-08T18:07:40.235840+0000","last_fullsized":"2024-05-08T18:07:40.235840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224009+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:07:41.224009+0000","last_peered":"2024-05-08T18:07:41.224009+0000","last_clean":"2024-05-08T18:07:41.224009+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:07:41.224009+0000","last_undegraded":"2024-05-08T18:07:41.224009+0000","last_fullsized":"2024-05-08T18:07:41.224009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224553+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:07:41.224553+0000","last_peered":"2024-05-08T18:07:41.224553+0000","last_clean":"2024-05-08T18:07:41.224553+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:07:41.224553+0000","last_undegraded":"2024-05-08T18:07:41.224553+0000","last_fullsized":"2024-05-08T18:07:41.224553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239448+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:07:40.239448+0000","last_peered":"2024-05-08T18:07:40.239448+0000","last_clean":"2024-05-08T18:07:40.239448+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:07:40.239448+0000","last_undegraded":"2024-05-08T18:07:40.239448+0000","last_fullsized":"2024-05-08T18:07:40.239448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219896+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:07:41.219896+0000","last_peered":"2024-05-08T18:07:41.219896+0000","last_clean":"2024-05-08T18:07:41.219896+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:07:41.219896+0000","last_undegraded":"2024-05-08T18:07:41.219896+0000","last_fullsized":"2024-05-08T18:07:41.219896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235651+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:07:40.235651+0000","last_peered":"2024-05-08T18:07:40.235651+0000","last_clean":"2024-05-08T18:07:40.235651+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:07:40.235651+0000","last_undegraded":"2024-05-08T18:07:40.235651+0000","last_fullsized":"2024-05-08T18:07:40.235651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223707+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:07:41.223707+0000","last_peered":"2024-05-08T18:07:41.223707+0000","last_clean":"2024-05-08T18:07:41.223707+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:07:41.223707+0000","last_undegraded":"2024-05-08T18:07:41.223707+0000","last_fullsized":"2024-05-08T18:07:41.223707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201807+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:07:40.201807+0000","last_peered":"2024-05-08T18:07:40.201807+0000","last_clean":"2024-05-08T18:07:40.201807+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:07:40.201807+0000","last_undegraded":"2024-05-08T18:07:40.201807+0000","last_fullsized":"2024-05-08T18:07:40.201807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.234834+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:07:40.234834+0000","last_peered":"2024-05-08T18:07:40.234834+0000","last_clean":"2024-05-08T18:07:40.234834+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:07:40.234834+0000","last_undegraded":"2024-05-08T18:07:40.234834+0000","last_fullsized":"2024-05-08T18:07:40.234834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222477+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:07:41.222477+0000","last_peered":"2024-05-08T18:07:41.222477+0000","last_clean":"2024-05-08T18:07:41.222477+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:07:41.222477+0000","last_undegraded":"2024-05-08T18:07:41.222477+0000","last_fullsized":"2024-05-08T18:07:41.222477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241024+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:07:40.241024+0000","last_peered":"2024-05-08T18:07:40.241024+0000","last_clean":"2024-05-08T18:07:40.241024+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:07:40.241024+0000","last_undegraded":"2024-05-08T18:07:40.241024+0000","last_fullsized":"2024-05-08T18:07:40.241024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225142+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:07:41.225142+0000","last_peered":"2024-05-08T18:07:41.225142+0000","last_clean":"2024-05-08T18:07:41.225142+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:07:41.225142+0000","last_undegraded":"2024-05-08T18:07:41.225142+0000","last_fullsized":"2024-05-08T18:07:41.225142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235567+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:07:40.235567+0000","last_peered":"2024-05-08T18:07:40.235567+0000","last_clean":"2024-05-08T18:07:40.235567+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:07:40.235567+0000","last_undegraded":"2024-05-08T18:07:40.235567+0000","last_fullsized":"2024-05-08T18:07:40.235567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":64,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.234863+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:07:40.234863+0000","last_peered":"2024-05-08T18:07:40.234863+0000","last_clean":"2024-05-08T18:07:40.234863+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:07:40.234863+0000","last_undegraded":"2024-05-08T18:07:40.234863+0000","last_fullsized":"2024-05-08T18:07:40.234863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218652+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:07:41.218652+0000","last_peered":"2024-05-08T18:07:41.218652+0000","last_clean":"2024-05-08T18:07:41.218652+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:07:41.218652+0000","last_undegraded":"2024-05-08T18:07:41.218652+0000","last_fullsized":"2024-05-08T18:07:41.218652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235095+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:07:40.235095+0000","last_peered":"2024-05-08T18:07:40.235095+0000","last_clean":"2024-05-08T18:07:40.235095+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:07:40.235095+0000","last_undegraded":"2024-05-08T18:07:40.235095+0000","last_fullsized":"2024-05-08T18:07:40.235095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235820+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:07:40.235820+0000","last_peered":"2024-05-08T18:07:40.235820+0000","last_clean":"2024-05-08T18:07:40.235820+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:07:40.235820+0000","last_undegraded":"2024-05-08T18:07:40.235820+0000","last_fullsized":"2024-05-08T18:07:40.235820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224781+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:07:41.224781+0000","last_peered":"2024-05-08T18:07:41.224781+0000","last_clean":"2024-05-08T18:07:41.224781+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:07:41.224781+0000","last_undegraded":"2024-05-08T18:07:41.224781+0000","last_fullsized":"2024-05-08T18:07:41.224781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240728+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:07:40.240728+0000","last_peered":"2024-05-08T18:07:40.240728+0000","last_clean":"2024-05-08T18:07:40.240728+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:07:40.240728+0000","last_undegraded":"2024-05-08T18:07:40.240728+0000","last_fullsized":"2024-05-08T18:07:40.240728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201271+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:07:40.201271+0000","last_peered":"2024-05-08T18:07:40.201271+0000","last_clean":"2024-05-08T18:07:40.201271+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:07:40.201271+0000","last_undegraded":"2024-05-08T18:07:40.201271+0000","last_fullsized":"2024-05-08T18:07:40.201271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221595+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:07:41.221595+0000","last_peered":"2024-05-08T18:07:41.221595+0000","last_clean":"2024-05-08T18:07:41.221595+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:07:41.221595+0000","last_undegraded":"2024-05-08T18:07:41.221595+0000","last_fullsized":"2024-05-08T18:07:41.221595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235412+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:07:40.235412+0000","last_peered":"2024-05-08T18:07:40.235412+0000","last_clean":"2024-05-08T18:07:40.235412+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:07:40.235412+0000","last_undegraded":"2024-05-08T18:07:40.235412+0000","last_fullsized":"2024-05-08T18:07:40.235412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225215+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:07:41.225215+0000","last_peered":"2024-05-08T18:07:41.225215+0000","last_clean":"2024-05-08T18:07:41.225215+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:07:41.225215+0000","last_undegraded":"2024-05-08T18:07:41.225215+0000","last_fullsized":"2024-05-08T18:07:41.225215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222725+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:07:41.222725+0000","last_peered":"2024-05-08T18:07:41.222725+0000","last_clean":"2024-05-08T18:07:41.222725+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:07:41.222725+0000","last_undegraded":"2024-05-08T18:07:41.222725+0000","last_fullsized":"2024-05-08T18:07:41.222725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224757+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:07:41.224757+0000","last_peered":"2024-05-08T18:07:41.224757+0000","last_clean":"2024-05-08T18:07:41.224757+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:07:41.224757+0000","last_undegraded":"2024-05-08T18:07:41.224757+0000","last_fullsized":"2024-05-08T18:07:41.224757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224259+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:07:41.224259+0000","last_peered":"2024-05-08T18:07:41.224259+0000","last_clean":"2024-05-08T18:07:41.224259+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:07:41.224259+0000","last_undegraded":"2024-05-08T18:07:41.224259+0000","last_fullsized":"2024-05-08T18:07:41.224259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218898+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:07:41.218898+0000","last_peered":"2024-05-08T18:07:41.218898+0000","last_clean":"2024-05-08T18:07:41.218898+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:07:41.218898+0000","last_undegraded":"2024-05-08T18:07:41.218898+0000","last_fullsized":"2024-05-08T18:07:41.218898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219913+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:07:41.219913+0000","last_peered":"2024-05-08T18:07:41.219913+0000","last_clean":"2024-05-08T18:07:41.219913+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:07:41.219913+0000","last_undegraded":"2024-05-08T18:07:41.219913+0000","last_fullsized":"2024-05-08T18:07:41.219913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.228624+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:07:41.228624+0000","last_peered":"2024-05-08T18:07:41.228624+0000","last_clean":"2024-05-08T18:07:41.228624+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:07:41.228624+0000","last_undegraded":"2024-05-08T18:07:41.228624+0000","last_fullsized":"2024-05-08T18:07:41.228624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235991+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:07:40.235991+0000","last_peered":"2024-05-08T18:07:40.235991+0000","last_clean":"2024-05-08T18:07:40.235991+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:07:40.235991+0000","last_undegraded":"2024-05-08T18:07:40.235991+0000","last_fullsized":"2024-05-08T18:07:40.235991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219127+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:07:41.219127+0000","last_peered":"2024-05-08T18:07:41.219127+0000","last_clean":"2024-05-08T18:07:41.219127+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:07:41.219127+0000","last_undegraded":"2024-05-08T18:07:41.219127+0000","last_fullsized":"2024-05-08T18:07:41.219127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236997+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:07:40.236997+0000","last_peered":"2024-05-08T18:07:40.236997+0000","last_clean":"2024-05-08T18:07:40.236997+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:07:40.236997+0000","last_undegraded":"2024-05-08T18:07:40.236997+0000","last_fullsized":"2024-05-08T18:07:40.236997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202498+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:07:40.202498+0000","last_peered":"2024-05-08T18:07:40.202498+0000","last_clean":"2024-05-08T18:07:40.202498+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:07:40.202498+0000","last_undegraded":"2024-05-08T18:07:40.202498+0000","last_fullsized":"2024-05-08T18:07:40.202498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222322+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:07:41.222322+0000","last_peered":"2024-05-08T18:07:41.222322+0000","last_clean":"2024-05-08T18:07:41.222322+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:07:41.222322+0000","last_undegraded":"2024-05-08T18:07:41.222322+0000","last_fullsized":"2024-05-08T18:07:41.222322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":68,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237627+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:07:40.237627+0000","last_peered":"2024-05-08T18:07:40.237627+0000","last_clean":"2024-05-08T18:07:40.237627+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:07:40.237627+0000","last_undegraded":"2024-05-08T18:07:40.237627+0000","last_fullsized":"2024-05-08T18:07:40.237627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222959+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:07:41.222959+0000","last_peered":"2024-05-08T18:07:41.222959+0000","last_clean":"2024-05-08T18:07:41.222959+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:07:41.222959+0000","last_undegraded":"2024-05-08T18:07:41.222959+0000","last_fullsized":"2024-05-08T18:07:41.222959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235949+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:07:40.235949+0000","last_peered":"2024-05-08T18:07:40.235949+0000","last_clean":"2024-05-08T18:07:40.235949+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:07:40.235949+0000","last_undegraded":"2024-05-08T18:07:40.235949+0000","last_fullsized":"2024-05-08T18:07:40.235949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236152+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:07:40.236152+0000","last_peered":"2024-05-08T18:07:40.236152+0000","last_clean":"2024-05-08T18:07:40.236152+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:07:40.236152+0000","last_undegraded":"2024-05-08T18:07:40.236152+0000","last_fullsized":"2024-05-08T18:07:40.236152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219514+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:07:41.219514+0000","last_peered":"2024-05-08T18:07:41.219514+0000","last_clean":"2024-05-08T18:07:41.219514+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:07:41.219514+0000","last_undegraded":"2024-05-08T18:07:41.219514+0000","last_fullsized":"2024-05-08T18:07:41.219514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219801+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:07:41.219801+0000","last_peered":"2024-05-08T18:07:41.219801+0000","last_clean":"2024-05-08T18:07:41.219801+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:07:41.219801+0000","last_undegraded":"2024-05-08T18:07:41.219801+0000","last_fullsized":"2024-05-08T18:07:41.219801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222599+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:07:41.222599+0000","last_peered":"2024-05-08T18:07:41.222599+0000","last_clean":"2024-05-08T18:07:41.222599+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:07:41.222599+0000","last_undegraded":"2024-05-08T18:07:41.222599+0000","last_fullsized":"2024-05-08T18:07:41.222599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222254+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:07:41.222254+0000","last_peered":"2024-05-08T18:07:41.222254+0000","last_clean":"2024-05-08T18:07:41.222254+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:07:41.222254+0000","last_undegraded":"2024-05-08T18:07:41.222254+0000","last_fullsized":"2024-05-08T18:07:41.222254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222137+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:07:41.222137+0000","last_peered":"2024-05-08T18:07:41.222137+0000","last_clean":"2024-05-08T18:07:41.222137+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:07:41.222137+0000","last_undegraded":"2024-05-08T18:07:41.222137+0000","last_fullsized":"2024-05-08T18:07:41.222137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223441+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:07:41.223441+0000","last_peered":"2024-05-08T18:07:41.223441+0000","last_clean":"2024-05-08T18:07:41.223441+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:07:41.223441+0000","last_undegraded":"2024-05-08T18:07:41.223441+0000","last_fullsized":"2024-05-08T18:07:41.223441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222358+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:07:41.222358+0000","last_peered":"2024-05-08T18:07:41.222358+0000","last_clean":"2024-05-08T18:07:41.222358+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:07:41.222358+0000","last_undegraded":"2024-05-08T18:07:41.222358+0000","last_fullsized":"2024-05-08T18:07:41.222358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240367+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:07:40.240367+0000","last_peered":"2024-05-08T18:07:40.240367+0000","last_clean":"2024-05-08T18:07:40.240367+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:07:40.240367+0000","last_undegraded":"2024-05-08T18:07:40.240367+0000","last_fullsized":"2024-05-08T18:07:40.240367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223930+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:07:41.223930+0000","last_peered":"2024-05-08T18:07:41.223930+0000","last_clean":"2024-05-08T18:07:41.223930+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:07:41.223930+0000","last_undegraded":"2024-05-08T18:07:41.223930+0000","last_fullsized":"2024-05-08T18:07:41.223930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'4","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235006+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:07:40.235006+0000","last_peered":"2024-05-08T18:07:40.235006+0000","last_clean":"2024-05-08T18:07:40.235006+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:07:40.235006+0000","last_undegraded":"2024-05-08T18:07:40.235006+0000","last_fullsized":"2024-05-08T18:07:40.235006+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238013+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:07:40.238013+0000","last_peered":"2024-05-08T18:07:40.238013+0000","last_clean":"2024-05-08T18:07:40.238013+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:07:40.238013+0000","last_undegraded":"2024-05-08T18:07:40.238013+0000","last_fullsized":"2024-05-08T18:07:40.238013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235561+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:07:40.235561+0000","last_peered":"2024-05-08T18:07:40.235561+0000","last_clean":"2024-05-08T18:07:40.235561+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:07:40.235561+0000","last_undegraded":"2024-05-08T18:07:40.235561+0000","last_fullsized":"2024-05-08T18:07:40.235561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222630+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:07:41.222630+0000","last_peered":"2024-05-08T18:07:41.222630+0000","last_clean":"2024-05-08T18:07:41.222630+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:07:41.222630+0000","last_undegraded":"2024-05-08T18:07:41.222630+0000","last_fullsized":"2024-05-08T18:07:41.222630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241836+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:07:40.241836+0000","last_peered":"2024-05-08T18:07:40.241836+0000","last_clean":"2024-05-08T18:07:40.241836+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:07:40.241836+0000","last_undegraded":"2024-05-08T18:07:40.241836+0000","last_fullsized":"2024-05-08T18:07:40.241836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235170+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:07:40.235170+0000","last_peered":"2024-05-08T18:07:40.235170+0000","last_clean":"2024-05-08T18:07:40.235170+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:07:40.235170+0000","last_undegraded":"2024-05-08T18:07:40.235170+0000","last_fullsized":"2024-05-08T18:07:40.235170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223540+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:07:41.223540+0000","last_peered":"2024-05-08T18:07:41.223540+0000","last_clean":"2024-05-08T18:07:41.223540+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:07:41.223540+0000","last_undegraded":"2024-05-08T18:07:41.223540+0000","last_fullsized":"2024-05-08T18:07:41.223540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201000+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:07:40.201000+0000","last_peered":"2024-05-08T18:07:40.201000+0000","last_clean":"2024-05-08T18:07:40.201000+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:07:40.201000+0000","last_undegraded":"2024-05-08T18:07:40.201000+0000","last_fullsized":"2024-05-08T18:07:40.201000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235943+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:07:40.235943+0000","last_peered":"2024-05-08T18:07:40.235943+0000","last_clean":"2024-05-08T18:07:40.235943+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:07:40.235943+0000","last_undegraded":"2024-05-08T18:07:40.235943+0000","last_fullsized":"2024-05-08T18:07:40.235943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223121+0000","last_change":"2024-05-08T18:07:17.504030+0000","last_active":"2024-05-08T18:07:41.223121+0000","last_peered":"2024-05-08T18:07:41.223121+0000","last_clean":"2024-05-08T18:07:41.223121+0000","last_became_active":"2024-05-08T18:07:17.497558+0000","last_became_peered":"2024-05-08T18:07:17.497558+0000","last_unstale":"2024-05-08T18:07:41.223121+0000","last_undegraded":"2024-05-08T18:07:41.223121+0000","last_fullsized":"2024-05-08T18:07:41.223121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236621+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:07:40.236621+0000","last_peered":"2024-05-08T18:07:40.236621+0000","last_clean":"2024-05-08T18:07:40.236621+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:07:40.236621+0000","last_undegraded":"2024-05-08T18:07:40.236621+0000","last_fullsized":"2024-05-08T18:07:40.236621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201274+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:07:40.201274+0000","last_peered":"2024-05-08T18:07:40.201274+0000","last_clean":"2024-05-08T18:07:40.201274+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:07:40.201274+0000","last_undegraded":"2024-05-08T18:07:40.201274+0000","last_fullsized":"2024-05-08T18:07:40.201274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237710+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:07:40.237710+0000","last_peered":"2024-05-08T18:07:40.237710+0000","last_clean":"2024-05-08T18:07:40.237710+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:07:40.237710+0000","last_undegraded":"2024-05-08T18:07:40.237710+0000","last_fullsized":"2024-05-08T18:07:40.237710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235449+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:07:40.235449+0000","last_peered":"2024-05-08T18:07:40.235449+0000","last_clean":"2024-05-08T18:07:40.235449+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:07:40.235449+0000","last_undegraded":"2024-05-08T18:07:40.235449+0000","last_fullsized":"2024-05-08T18:07:40.235449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202312+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:07:40.202312+0000","last_peered":"2024-05-08T18:07:40.202312+0000","last_clean":"2024-05-08T18:07:40.202312+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:07:40.202312+0000","last_undegraded":"2024-05-08T18:07:40.202312+0000","last_fullsized":"2024-05-08T18:07:40.202312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223595+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:07:41.223595+0000","last_peered":"2024-05-08T18:07:41.223595+0000","last_clean":"2024-05-08T18:07:41.223595+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:07:41.223595+0000","last_undegraded":"2024-05-08T18:07:41.223595+0000","last_fullsized":"2024-05-08T18:07:41.223595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236456+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:07:40.236456+0000","last_peered":"2024-05-08T18:07:40.236456+0000","last_clean":"2024-05-08T18:07:40.236456+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:07:40.236456+0000","last_undegraded":"2024-05-08T18:07:40.236456+0000","last_fullsized":"2024-05-08T18:07:40.236456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.226166+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:07:41.226166+0000","last_peered":"2024-05-08T18:07:41.226166+0000","last_clean":"2024-05-08T18:07:41.226166+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:07:41.226166+0000","last_undegraded":"2024-05-08T18:07:41.226166+0000","last_fullsized":"2024-05-08T18:07:41.226166+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236468+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:07:40.236468+0000","last_peered":"2024-05-08T18:07:40.236468+0000","last_clean":"2024-05-08T18:07:40.236468+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:07:40.236468+0000","last_undegraded":"2024-05-08T18:07:40.236468+0000","last_fullsized":"2024-05-08T18:07:40.236468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223129+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:07:41.223129+0000","last_peered":"2024-05-08T18:07:41.223129+0000","last_clean":"2024-05-08T18:07:41.223129+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:07:41.223129+0000","last_undegraded":"2024-05-08T18:07:41.223129+0000","last_fullsized":"2024-05-08T18:07:41.223129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236644+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:07:40.236644+0000","last_peered":"2024-05-08T18:07:40.236644+0000","last_clean":"2024-05-08T18:07:40.236644+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:07:40.236644+0000","last_undegraded":"2024-05-08T18:07:40.236644+0000","last_fullsized":"2024-05-08T18:07:40.236644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223253+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:07:41.223253+0000","last_peered":"2024-05-08T18:07:41.223253+0000","last_clean":"2024-05-08T18:07:41.223253+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:07:41.223253+0000","last_undegraded":"2024-05-08T18:07:41.223253+0000","last_fullsized":"2024-05-08T18:07:41.223253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202040+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:07:40.202040+0000","last_peered":"2024-05-08T18:07:40.202040+0000","last_clean":"2024-05-08T18:07:40.202040+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:07:40.202040+0000","last_undegraded":"2024-05-08T18:07:40.202040+0000","last_fullsized":"2024-05-08T18:07:40.202040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238953+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:07:40.238953+0000","last_peered":"2024-05-08T18:07:40.238953+0000","last_clean":"2024-05-08T18:07:40.238953+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:07:40.238953+0000","last_undegraded":"2024-05-08T18:07:40.238953+0000","last_fullsized":"2024-05-08T18:07:40.238953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.226386+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:07:41.226386+0000","last_peered":"2024-05-08T18:07:41.226386+0000","last_clean":"2024-05-08T18:07:41.226386+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:07:41.226386+0000","last_undegraded":"2024-05-08T18:07:41.226386+0000","last_fullsized":"2024-05-08T18:07:41.226386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201042+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:07:40.201042+0000","last_peered":"2024-05-08T18:07:40.201042+0000","last_clean":"2024-05-08T18:07:40.201042+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:07:40.201042+0000","last_undegraded":"2024-05-08T18:07:40.201042+0000","last_fullsized":"2024-05-08T18:07:40.201042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223272+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:07:41.223272+0000","last_peered":"2024-05-08T18:07:41.223272+0000","last_clean":"2024-05-08T18:07:41.223272+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:07:41.223272+0000","last_undegraded":"2024-05-08T18:07:41.223272+0000","last_fullsized":"2024-05-08T18:07:41.223272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220367+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:07:41.220367+0000","last_peered":"2024-05-08T18:07:41.220367+0000","last_clean":"2024-05-08T18:07:41.220367+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:07:41.220367+0000","last_undegraded":"2024-05-08T18:07:41.220367+0000","last_fullsized":"2024-05-08T18:07:41.220367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220899+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:07:41.220899+0000","last_peered":"2024-05-08T18:07:41.220899+0000","last_clean":"2024-05-08T18:07:41.220899+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:07:41.220899+0000","last_undegraded":"2024-05-08T18:07:41.220899+0000","last_fullsized":"2024-05-08T18:07:41.220899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225406+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:07:41.225406+0000","last_peered":"2024-05-08T18:07:41.225406+0000","last_clean":"2024-05-08T18:07:41.225406+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:07:41.225406+0000","last_undegraded":"2024-05-08T18:07:41.225406+0000","last_fullsized":"2024-05-08T18:07:41.225406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223610+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:07:41.223610+0000","last_peered":"2024-05-08T18:07:41.223610+0000","last_clean":"2024-05-08T18:07:41.223610+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:07:41.223610+0000","last_undegraded":"2024-05-08T18:07:41.223610+0000","last_fullsized":"2024-05-08T18:07:41.223610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235324+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:07:40.235324+0000","last_peered":"2024-05-08T18:07:40.235324+0000","last_clean":"2024-05-08T18:07:40.235324+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:07:40.235324+0000","last_undegraded":"2024-05-08T18:07:40.235324+0000","last_fullsized":"2024-05-08T18:07:40.235324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206221+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:07:40.206221+0000","last_peered":"2024-05-08T18:07:40.206221+0000","last_clean":"2024-05-08T18:07:40.206221+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:07:40.206221+0000","last_undegraded":"2024-05-08T18:07:40.206221+0000","last_fullsized":"2024-05-08T18:07:40.206221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235478+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:07:40.235478+0000","last_peered":"2024-05-08T18:07:40.235478+0000","last_clean":"2024-05-08T18:07:40.235478+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:07:40.235478+0000","last_undegraded":"2024-05-08T18:07:40.235478+0000","last_fullsized":"2024-05-08T18:07:40.235478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.227027+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:07:41.227027+0000","last_peered":"2024-05-08T18:07:41.227027+0000","last_clean":"2024-05-08T18:07:41.227027+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:07:41.227027+0000","last_undegraded":"2024-05-08T18:07:41.227027+0000","last_fullsized":"2024-05-08T18:07:41.227027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221399+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:07:41.221399+0000","last_peered":"2024-05-08T18:07:41.221399+0000","last_clean":"2024-05-08T18:07:41.221399+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:07:41.221399+0000","last_undegraded":"2024-05-08T18:07:41.221399+0000","last_fullsized":"2024-05-08T18:07:41.221399+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201452+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:07:40.201452+0000","last_peered":"2024-05-08T18:07:40.201452+0000","last_clean":"2024-05-08T18:07:40.201452+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:07:40.201452+0000","last_undegraded":"2024-05-08T18:07:40.201452+0000","last_fullsized":"2024-05-08T18:07:40.201452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.234920+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:07:40.234920+0000","last_peered":"2024-05-08T18:07:40.234920+0000","last_clean":"2024-05-08T18:07:40.234920+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:07:40.234920+0000","last_undegraded":"2024-05-08T18:07:40.234920+0000","last_fullsized":"2024-05-08T18:07:40.234920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219173+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:07:41.219173+0000","last_peered":"2024-05-08T18:07:41.219173+0000","last_clean":"2024-05-08T18:07:41.219173+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:07:41.219173+0000","last_undegraded":"2024-05-08T18:07:41.219173+0000","last_fullsized":"2024-05-08T18:07:41.219173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237087+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:07:40.237087+0000","last_peered":"2024-05-08T18:07:40.237087+0000","last_clean":"2024-05-08T18:07:40.237087+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:07:40.237087+0000","last_undegraded":"2024-05-08T18:07:40.237087+0000","last_fullsized":"2024-05-08T18:07:40.237087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237842+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:07:40.237842+0000","last_peered":"2024-05-08T18:07:40.237842+0000","last_clean":"2024-05-08T18:07:40.237842+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:07:40.237842+0000","last_undegraded":"2024-05-08T18:07:40.237842+0000","last_fullsized":"2024-05-08T18:07:40.237842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235756+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:07:40.235756+0000","last_peered":"2024-05-08T18:07:40.235756+0000","last_clean":"2024-05-08T18:07:40.235756+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:07:40.235756+0000","last_undegraded":"2024-05-08T18:07:40.235756+0000","last_fullsized":"2024-05-08T18:07:40.235756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.234582+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:07:40.234582+0000","last_peered":"2024-05-08T18:07:40.234582+0000","last_clean":"2024-05-08T18:07:40.234582+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:07:40.234582+0000","last_undegraded":"2024-05-08T18:07:40.234582+0000","last_fullsized":"2024-05-08T18:07:40.234582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.242193+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:07:40.242193+0000","last_peered":"2024-05-08T18:07:40.242193+0000","last_clean":"2024-05-08T18:07:40.242193+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:07:40.242193+0000","last_undegraded":"2024-05-08T18:07:40.242193+0000","last_fullsized":"2024-05-08T18:07:40.242193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220050+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:07:41.220050+0000","last_peered":"2024-05-08T18:07:41.220050+0000","last_clean":"2024-05-08T18:07:41.220050+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:07:41.220050+0000","last_undegraded":"2024-05-08T18:07:41.220050+0000","last_fullsized":"2024-05-08T18:07:41.220050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240790+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:07:40.240790+0000","last_peered":"2024-05-08T18:07:40.240790+0000","last_clean":"2024-05-08T18:07:40.240790+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:07:40.240790+0000","last_undegraded":"2024-05-08T18:07:40.240790+0000","last_fullsized":"2024-05-08T18:07:40.240790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236677+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:07:40.236677+0000","last_peered":"2024-05-08T18:07:40.236677+0000","last_clean":"2024-05-08T18:07:40.236677+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:07:40.236677+0000","last_undegraded":"2024-05-08T18:07:40.236677+0000","last_fullsized":"2024-05-08T18:07:40.236677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.234682+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:07:40.234682+0000","last_peered":"2024-05-08T18:07:40.234682+0000","last_clean":"2024-05-08T18:07:40.234682+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:07:40.234682+0000","last_undegraded":"2024-05-08T18:07:40.234682+0000","last_fullsized":"2024-05-08T18:07:40.234682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.200754+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:07:40.200754+0000","last_peered":"2024-05-08T18:07:40.200754+0000","last_clean":"2024-05-08T18:07:40.200754+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:07:40.200754+0000","last_undegraded":"2024-05-08T18:07:40.200754+0000","last_fullsized":"2024-05-08T18:07:40.200754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223544+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:07:41.223544+0000","last_peered":"2024-05-08T18:07:41.223544+0000","last_clean":"2024-05-08T18:07:41.223544+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:07:41.223544+0000","last_undegraded":"2024-05-08T18:07:41.223544+0000","last_fullsized":"2024-05-08T18:07:41.223544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222762+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:07:41.222762+0000","last_peered":"2024-05-08T18:07:41.222762+0000","last_clean":"2024-05-08T18:07:41.222762+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:07:41.222762+0000","last_undegraded":"2024-05-08T18:07:41.222762+0000","last_fullsized":"2024-05-08T18:07:41.222762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224730+0000","last_change":"2024-05-08T18:07:15.488647+0000","last_active":"2024-05-08T18:07:41.224730+0000","last_peered":"2024-05-08T18:07:41.224730+0000","last_clean":"2024-05-08T18:07:41.224730+0000","last_became_active":"2024-05-08T18:07:15.487842+0000","last_became_peered":"2024-05-08T18:07:15.487842+0000","last_unstale":"2024-05-08T18:07:41.224730+0000","last_undegraded":"2024-05-08T18:07:41.224730+0000","last_fullsized":"2024-05-08T18:07:41.224730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218499+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:07:41.218499+0000","last_peered":"2024-05-08T18:07:41.218499+0000","last_clean":"2024-05-08T18:07:41.218499+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:07:41.218499+0000","last_undegraded":"2024-05-08T18:07:41.218499+0000","last_fullsized":"2024-05-08T18:07:41.218499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.228517+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:07:41.228517+0000","last_peered":"2024-05-08T18:07:41.228517+0000","last_clean":"2024-05-08T18:07:41.228517+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:07:41.228517+0000","last_undegraded":"2024-05-08T18:07:41.228517+0000","last_fullsized":"2024-05-08T18:07:41.228517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218845+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:07:41.218845+0000","last_peered":"2024-05-08T18:07:41.218845+0000","last_clean":"2024-05-08T18:07:41.218845+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:07:41.218845+0000","last_undegraded":"2024-05-08T18:07:41.218845+0000","last_fullsized":"2024-05-08T18:07:41.218845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239582+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:07:40.239582+0000","last_peered":"2024-05-08T18:07:40.239582+0000","last_clean":"2024-05-08T18:07:40.239582+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:07:40.239582+0000","last_undegraded":"2024-05-08T18:07:40.239582+0000","last_fullsized":"2024-05-08T18:07:40.239582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219133+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:07:41.219133+0000","last_peered":"2024-05-08T18:07:41.219133+0000","last_clean":"2024-05-08T18:07:41.219133+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:07:41.219133+0000","last_undegraded":"2024-05-08T18:07:41.219133+0000","last_fullsized":"2024-05-08T18:07:41.219133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236610+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:07:40.236610+0000","last_peered":"2024-05-08T18:07:40.236610+0000","last_clean":"2024-05-08T18:07:40.236610+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:07:40.236610+0000","last_undegraded":"2024-05-08T18:07:40.236610+0000","last_fullsized":"2024-05-08T18:07:40.236610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221884+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:07:41.221884+0000","last_peered":"2024-05-08T18:07:41.221884+0000","last_clean":"2024-05-08T18:07:41.221884+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:07:41.221884+0000","last_undegraded":"2024-05-08T18:07:41.221884+0000","last_fullsized":"2024-05-08T18:07:41.221884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219172+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:07:41.219172+0000","last_peered":"2024-05-08T18:07:41.219172+0000","last_clean":"2024-05-08T18:07:41.219172+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:07:41.219172+0000","last_undegraded":"2024-05-08T18:07:41.219172+0000","last_fullsized":"2024-05-08T18:07:41.219172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235398+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:07:40.235398+0000","last_peered":"2024-05-08T18:07:40.235398+0000","last_clean":"2024-05-08T18:07:40.235398+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:07:40.235398+0000","last_undegraded":"2024-05-08T18:07:40.235398+0000","last_fullsized":"2024-05-08T18:07:40.235398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220885+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:07:41.220885+0000","last_peered":"2024-05-08T18:07:41.220885+0000","last_clean":"2024-05-08T18:07:41.220885+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:07:41.220885+0000","last_undegraded":"2024-05-08T18:07:41.220885+0000","last_fullsized":"2024-05-08T18:07:41.220885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224955+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:07:41.224955+0000","last_peered":"2024-05-08T18:07:41.224955+0000","last_clean":"2024-05-08T18:07:41.224955+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:07:41.224955+0000","last_undegraded":"2024-05-08T18:07:41.224955+0000","last_fullsized":"2024-05-08T18:07:41.224955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.200603+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:07:40.200603+0000","last_peered":"2024-05-08T18:07:40.200603+0000","last_clean":"2024-05-08T18:07:40.200603+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:07:40.200603+0000","last_undegraded":"2024-05-08T18:07:40.200603+0000","last_fullsized":"2024-05-08T18:07:40.200603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223948+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:07:41.223948+0000","last_peered":"2024-05-08T18:07:41.223948+0000","last_clean":"2024-05-08T18:07:41.223948+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:07:41.223948+0000","last_undegraded":"2024-05-08T18:07:41.223948+0000","last_fullsized":"2024-05-08T18:07:41.223948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204848+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:07:40.204848+0000","last_peered":"2024-05-08T18:07:40.204848+0000","last_clean":"2024-05-08T18:07:40.204848+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:07:40.204848+0000","last_undegraded":"2024-05-08T18:07:40.204848+0000","last_fullsized":"2024-05-08T18:07:40.204848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240028+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:07:40.240028+0000","last_peered":"2024-05-08T18:07:40.240028+0000","last_clean":"2024-05-08T18:07:40.240028+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:07:40.240028+0000","last_undegraded":"2024-05-08T18:07:40.240028+0000","last_fullsized":"2024-05-08T18:07:40.240028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239223+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:07:40.239223+0000","last_peered":"2024-05-08T18:07:40.239223+0000","last_clean":"2024-05-08T18:07:40.239223+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:07:40.239223+0000","last_undegraded":"2024-05-08T18:07:40.239223+0000","last_fullsized":"2024-05-08T18:07:40.239223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224999+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:07:41.224999+0000","last_peered":"2024-05-08T18:07:41.224999+0000","last_clean":"2024-05-08T18:07:41.224999+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:07:41.224999+0000","last_undegraded":"2024-05-08T18:07:41.224999+0000","last_fullsized":"2024-05-08T18:07:41.224999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235568+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:07:40.235568+0000","last_peered":"2024-05-08T18:07:40.235568+0000","last_clean":"2024-05-08T18:07:40.235568+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:07:40.235568+0000","last_undegraded":"2024-05-08T18:07:40.235568+0000","last_fullsized":"2024-05-08T18:07:40.235568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224141+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:07:41.224141+0000","last_peered":"2024-05-08T18:07:41.224141+0000","last_clean":"2024-05-08T18:07:41.224141+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:07:41.224141+0000","last_undegraded":"2024-05-08T18:07:41.224141+0000","last_fullsized":"2024-05-08T18:07:41.224141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.228484+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:07:41.228484+0000","last_peered":"2024-05-08T18:07:41.228484+0000","last_clean":"2024-05-08T18:07:41.228484+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:07:41.228484+0000","last_undegraded":"2024-05-08T18:07:41.228484+0000","last_fullsized":"2024-05-08T18:07:41.228484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220252+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:07:41.220252+0000","last_peered":"2024-05-08T18:07:41.220252+0000","last_clean":"2024-05-08T18:07:41.220252+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:07:41.220252+0000","last_undegraded":"2024-05-08T18:07:41.220252+0000","last_fullsized":"2024-05-08T18:07:41.220252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.227570+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:07:41.227570+0000","last_peered":"2024-05-08T18:07:41.227570+0000","last_clean":"2024-05-08T18:07:41.227570+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:07:41.227570+0000","last_undegraded":"2024-05-08T18:07:41.227570+0000","last_fullsized":"2024-05-08T18:07:41.227570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222548+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:07:41.222548+0000","last_peered":"2024-05-08T18:07:41.222548+0000","last_clean":"2024-05-08T18:07:41.222548+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:07:41.222548+0000","last_undegraded":"2024-05-08T18:07:41.222548+0000","last_fullsized":"2024-05-08T18:07:41.222548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202179+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:07:40.202179+0000","last_peered":"2024-05-08T18:07:40.202179+0000","last_clean":"2024-05-08T18:07:40.202179+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:07:40.202179+0000","last_undegraded":"2024-05-08T18:07:40.202179+0000","last_fullsized":"2024-05-08T18:07:40.202179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.200461+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:07:40.200461+0000","last_peered":"2024-05-08T18:07:40.200461+0000","last_clean":"2024-05-08T18:07:40.200461+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:07:40.200461+0000","last_undegraded":"2024-05-08T18:07:40.200461+0000","last_fullsized":"2024-05-08T18:07:40.200461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225155+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:07:41.225155+0000","last_peered":"2024-05-08T18:07:41.225155+0000","last_clean":"2024-05-08T18:07:41.225155+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:07:41.225155+0000","last_undegraded":"2024-05-08T18:07:41.225155+0000","last_fullsized":"2024-05-08T18:07:41.225155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236511+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:07:40.236511+0000","last_peered":"2024-05-08T18:07:40.236511+0000","last_clean":"2024-05-08T18:07:40.236511+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:07:40.236511+0000","last_undegraded":"2024-05-08T18:07:40.236511+0000","last_fullsized":"2024-05-08T18:07:40.236511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236279+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:07:40.236279+0000","last_peered":"2024-05-08T18:07:40.236279+0000","last_clean":"2024-05-08T18:07:40.236279+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:07:40.236279+0000","last_undegraded":"2024-05-08T18:07:40.236279+0000","last_fullsized":"2024-05-08T18:07:40.236279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221672+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:07:41.221672+0000","last_peered":"2024-05-08T18:07:41.221672+0000","last_clean":"2024-05-08T18:07:41.221672+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:07:41.221672+0000","last_undegraded":"2024-05-08T18:07:41.221672+0000","last_fullsized":"2024-05-08T18:07:41.221672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222845+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:07:41.222845+0000","last_peered":"2024-05-08T18:07:41.222845+0000","last_clean":"2024-05-08T18:07:41.222845+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:07:41.222845+0000","last_undegraded":"2024-05-08T18:07:41.222845+0000","last_fullsized":"2024-05-08T18:07:41.222845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206392+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:07:40.206392+0000","last_peered":"2024-05-08T18:07:40.206392+0000","last_clean":"2024-05-08T18:07:40.206392+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:07:40.206392+0000","last_undegraded":"2024-05-08T18:07:40.206392+0000","last_fullsized":"2024-05-08T18:07:40.206392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238993+0000","last_change":"2024-05-08T18:07:15.498938+0000","last_active":"2024-05-08T18:07:40.238993+0000","last_peered":"2024-05-08T18:07:40.238993+0000","last_clean":"2024-05-08T18:07:40.238993+0000","last_became_active":"2024-05-08T18:07:15.498206+0000","last_became_peered":"2024-05-08T18:07:15.498206+0000","last_unstale":"2024-05-08T18:07:40.238993+0000","last_undegraded":"2024-05-08T18:07:40.238993+0000","last_fullsized":"2024-05-08T18:07:40.238993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220710+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:07:41.220710+0000","last_peered":"2024-05-08T18:07:41.220710+0000","last_clean":"2024-05-08T18:07:41.220710+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:07:41.220710+0000","last_undegraded":"2024-05-08T18:07:41.220710+0000","last_fullsized":"2024-05-08T18:07:41.220710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235651+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:07:40.235651+0000","last_peered":"2024-05-08T18:07:40.235651+0000","last_clean":"2024-05-08T18:07:40.235651+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:07:40.235651+0000","last_undegraded":"2024-05-08T18:07:40.235651+0000","last_fullsized":"2024-05-08T18:07:40.235651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238151+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:07:40.238151+0000","last_peered":"2024-05-08T18:07:40.238151+0000","last_clean":"2024-05-08T18:07:40.238151+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:07:40.238151+0000","last_undegraded":"2024-05-08T18:07:40.238151+0000","last_fullsized":"2024-05-08T18:07:40.238151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202051+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:07:40.202051+0000","last_peered":"2024-05-08T18:07:40.202051+0000","last_clean":"2024-05-08T18:07:40.202051+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:07:40.202051+0000","last_undegraded":"2024-05-08T18:07:40.202051+0000","last_fullsized":"2024-05-08T18:07:40.202051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235682+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:07:40.235682+0000","last_peered":"2024-05-08T18:07:40.235682+0000","last_clean":"2024-05-08T18:07:40.235682+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:07:40.235682+0000","last_undegraded":"2024-05-08T18:07:40.235682+0000","last_fullsized":"2024-05-08T18:07:40.235682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240677+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:07:40.240677+0000","last_peered":"2024-05-08T18:07:40.240677+0000","last_clean":"2024-05-08T18:07:40.240677+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:07:40.240677+0000","last_undegraded":"2024-05-08T18:07:40.240677+0000","last_fullsized":"2024-05-08T18:07:40.240677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222455+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:07:41.222455+0000","last_peered":"2024-05-08T18:07:41.222455+0000","last_clean":"2024-05-08T18:07:41.222455+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:07:41.222455+0000","last_undegraded":"2024-05-08T18:07:41.222455+0000","last_fullsized":"2024-05-08T18:07:41.222455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206655+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:07:40.206655+0000","last_peered":"2024-05-08T18:07:40.206655+0000","last_clean":"2024-05-08T18:07:40.206655+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:07:40.206655+0000","last_undegraded":"2024-05-08T18:07:40.206655+0000","last_fullsized":"2024-05-08T18:07:40.206655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235657+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:07:40.235657+0000","last_peered":"2024-05-08T18:07:40.235657+0000","last_clean":"2024-05-08T18:07:40.235657+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:07:40.235657+0000","last_undegraded":"2024-05-08T18:07:40.235657+0000","last_fullsized":"2024-05-08T18:07:40.235657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241657+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:07:40.241657+0000","last_peered":"2024-05-08T18:07:40.241657+0000","last_clean":"2024-05-08T18:07:40.241657+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:07:40.241657+0000","last_undegraded":"2024-05-08T18:07:40.241657+0000","last_fullsized":"2024-05-08T18:07:40.241657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236041+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:07:40.236041+0000","last_peered":"2024-05-08T18:07:40.236041+0000","last_clean":"2024-05-08T18:07:40.236041+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:07:40.236041+0000","last_undegraded":"2024-05-08T18:07:40.236041+0000","last_fullsized":"2024-05-08T18:07:40.236041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236510+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:07:40.236510+0000","last_peered":"2024-05-08T18:07:40.236510+0000","last_clean":"2024-05-08T18:07:40.236510+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:07:40.236510+0000","last_undegraded":"2024-05-08T18:07:40.236510+0000","last_fullsized":"2024-05-08T18:07:40.236510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222946+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:07:41.222946+0000","last_peered":"2024-05-08T18:07:41.222946+0000","last_clean":"2024-05-08T18:07:41.222946+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:07:41.222946+0000","last_undegraded":"2024-05-08T18:07:41.222946+0000","last_fullsized":"2024-05-08T18:07:41.222946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241747+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:07:40.241747+0000","last_peered":"2024-05-08T18:07:40.241747+0000","last_clean":"2024-05-08T18:07:40.241747+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:07:40.241747+0000","last_undegraded":"2024-05-08T18:07:40.241747+0000","last_fullsized":"2024-05-08T18:07:40.241747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1077248,"data_stored":795892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":204428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":503808,"data_stored":206249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":204919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":212466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":203990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":212320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1056768,"data_stored":795298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:07:43.090 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-08T18:07:43.090 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-08T18:07:43.090 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-05-08T18:07:43.090 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-05-08T18:07:43.092 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:43.091+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:43.176 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:43.176 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:43.176 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:07:43.176 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:07:43.176 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:43.190 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:07:43.192 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:43.193+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:43.248 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:07:43.299 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:43.301+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:43.306 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:43.307 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:07:43.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:07:43.307 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:07:43.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.307 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:52 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'31)", 2024-05-08T18:07:43.307 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:07:43.307 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 40.181906576000003, 2024-05-08T18:07:43.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00409947, 2024-05-08T18:07:43.307 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.307 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.307 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.307 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:07:43.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.308 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:07:43.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.308 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127167+0000", 2024-05-08T18:07:43.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7800000000000001e-07 2024-05-08T18:07:43.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.308 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127172+0000", 2024-05-08T18:07:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1120000000000004e-06 2024-05-08T18:07:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127183+0000", 2024-05-08T18:07:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1107000000000001e-05 2024-05-08T18:07:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127189+0000", 2024-05-08T18:07:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0310000000000004e-06 2024-05-08T18:07:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.309 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127237+0000", 2024-05-08T18:07:43.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7907000000000001e-05 2024-05-08T18:07:43.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.310 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.310 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127252+0000", 2024-05-08T18:07:43.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5373e-05 2024-05-08T18:07:43.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.310 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.310 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131206+0000", 2024-05-08T18:07:43.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039540199999999999 2024-05-08T18:07:43.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.310 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.311 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131265+0000", 2024-05-08T18:07:43.311 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9141999999999997e-05 2024-05-08T18:07:43.311 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.311 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.311 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.311 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-05-08T18:07:43.311 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:07:43.311 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 40.173148171999998, 2024-05-08T18:07:43.311 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049265589999999996, 2024-05-08T18:07:43.311 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.311 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.311 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.311 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:07:43.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:07:43.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135925+0000", 2024-05-08T18:07:43.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8100000000000002e-07 2024-05-08T18:07:43.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136007+0000", 2024-05-08T18:07:43.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1864000000000001e-05 2024-05-08T18:07:43.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136019+0000", 2024-05-08T18:07:43.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2438e-05 2024-05-08T18:07:43.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136026+0000", 2024-05-08T18:07:43.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0809999999999996e-06 2024-05-08T18:07:43.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.314 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.314 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136093+0000", 2024-05-08T18:07:43.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6769999999999999e-05 2024-05-08T18:07:43.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.314 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.314 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136108+0000", 2024-05-08T18:07:43.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.465e-05 2024-05-08T18:07:43.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.315 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.315 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140800+0000", 2024-05-08T18:07:43.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046919450000000003 2024-05-08T18:07:43.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.315 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.316 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140851+0000", 2024-05-08T18:07:43.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.113e-05 2024-05-08T18:07:43.316 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.316 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.316 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.316 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-05-08T18:07:43.316 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:07:43.316 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.956662962000003, 2024-05-08T18:07:43.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042257299999999996, 2024-05-08T18:07:43.316 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.316 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.317 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.317 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:07:43.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:07:43.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352410+0000", 2024-05-08T18:07:43.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7599999999999997e-07 2024-05-08T18:07:43.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352489+0000", 2024-05-08T18:07:43.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8564000000000002e-05 2024-05-08T18:07:43.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352500+0000", 2024-05-08T18:07:43.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1411e-05 2024-05-08T18:07:43.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352506+0000", 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7309999999999998e-06 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352569+0000", 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3173e-05 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352598+0000", 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8855000000000001e-05 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356592+0000", 2024-05-08T18:07:43.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039941539999999998 2024-05-08T18:07:43.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.320 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.320 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356635+0000", 2024-05-08T18:07:43.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3166e-05 2024-05-08T18:07:43.320 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.320 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.320 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.320 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:75 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'53, mlcod=15'43)", 2024-05-08T18:07:43.320 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:43.320 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.948491545000003, 2024-05-08T18:07:43.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063708030000000004, 2024-05-08T18:07:43.321 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.321 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.321 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.321 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:43.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:43.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:43.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:07:43.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360641+0000", 2024-05-08T18:07:43.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9273e-05 2024-05-08T18:07:43.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360651+0000", 2024-05-08T18:07:43.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0353000000000001e-05 2024-05-08T18:07:43.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360659+0000", 2024-05-08T18:07:43.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4789999999999999e-06 2024-05-08T18:07:43.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360720+0000", 2024-05-08T18:07:43.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699000000000007e-05 2024-05-08T18:07:43.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360739+0000", 2024-05-08T18:07:43.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8913999999999999e-05 2024-05-08T18:07:43.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366883+0000", 2024-05-08T18:07:43.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061438229999999996 2024-05-08T18:07:43.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366952+0000", 2024-05-08T18:07:43.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8677000000000007e-05 2024-05-08T18:07:43.324 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.324 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.324 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.324 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:76 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'54, mlcod=15'49)", 2024-05-08T18:07:43.324 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:07:43.325 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.946755039999999, 2024-05-08T18:07:43.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046550610000000003, 2024-05-08T18:07:43.325 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.325 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.325 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.325 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:07:43.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:07:43.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362318+0000", 2024-05-08T18:07:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.99e-07 2024-05-08T18:07:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362323+0000", 2024-05-08T18:07:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.566e-06 2024-05-08T18:07:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362334+0000", 2024-05-08T18:07:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1403000000000001e-05 2024-05-08T18:07:43.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362342+0000", 2024-05-08T18:07:43.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3420000000000008e-06 2024-05-08T18:07:43.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362396+0000", 2024-05-08T18:07:43.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3476000000000001e-05 2024-05-08T18:07:43.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362415+0000", 2024-05-08T18:07:43.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8787000000000002e-05 2024-05-08T18:07:43.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366954+0000", 2024-05-08T18:07:43.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045388609999999999 2024-05-08T18:07:43.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366972+0000", 2024-05-08T18:07:43.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8927e-05 2024-05-08T18:07:43.328 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.328 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.328 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.329 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:79 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'57, mlcod=15'53)", 2024-05-08T18:07:43.329 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:07:43.329 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.939359111999998, 2024-05-08T18:07:43.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045322499999999998, 2024-05-08T18:07:43.329 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.329 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.329 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.329 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.329 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:07:43.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:07:43.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369714+0000", 2024-05-08T18:07:43.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:07:43.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369787+0000", 2024-05-08T18:07:43.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3317000000000003e-05 2024-05-08T18:07:43.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.331 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.331 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369797+0000", 2024-05-08T18:07:43.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9510000000000001e-06 2024-05-08T18:07:43.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.331 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.331 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369802+0000", 2024-05-08T18:07:43.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8210000000000001e-06 2024-05-08T18:07:43.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.331 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.331 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369854+0000", 2024-05-08T18:07:43.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1751e-05 2024-05-08T18:07:43.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.331 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369880+0000", 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6577999999999999e-05 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374202+0000", 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217029999999997 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374246+0000", 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3544000000000002e-05 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:89 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'63, mlcod=15'60)", 2024-05-08T18:07:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.605816947000001, 2024-05-08T18:07:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057729900000000004, 2024-05-08T18:07:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:07:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703261+0000", 2024-05-08T18:07:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2569999999999998e-06 2024-05-08T18:07:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.334 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703272+0000", 2024-05-08T18:07:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0739e-05 2024-05-08T18:07:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703282+0000", 2024-05-08T18:07:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6250000000000002e-06 2024-05-08T18:07:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703333+0000", 2024-05-08T18:07:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1588000000000001e-05 2024-05-08T18:07:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703358+0000", 2024-05-08T18:07:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4913999999999999e-05 2024-05-08T18:07:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708907+0000", 2024-05-08T18:07:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055484829999999999 2024-05-08T18:07:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.709028+0000", 2024-05-08T18:07:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121667 2024-05-08T18:07:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.336 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-05-08T18:07:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:07:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.60475143, 2024-05-08T18:07:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0074185579999999996, 2024-05-08T18:07:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.337 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:07:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:07:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704322+0000", 2024-05-08T18:07:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8299999999999997e-07 2024-05-08T18:07:43.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704410+0000", 2024-05-08T18:07:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8552000000000002e-05 2024-05-08T18:07:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704421+0000", 2024-05-08T18:07:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0794e-05 2024-05-08T18:07:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704427+0000", 2024-05-08T18:07:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8699999999999997e-06 2024-05-08T18:07:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704481+0000", 2024-05-08T18:07:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4410999999999998e-05 2024-05-08T18:07:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704511+0000", 2024-05-08T18:07:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9906000000000001e-05 2024-05-08T18:07:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711682+0000", 2024-05-08T18:07:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071710209999999996 2024-05-08T18:07:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711740+0000", 2024-05-08T18:07:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7521e-05 2024-05-08T18:07:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:91 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'65, mlcod=15'60)", 2024-05-08T18:07:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:07:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.603207236999999, 2024-05-08T18:07:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059345600000000002, 2024-05-08T18:07:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:07:43.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:07:43.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705866+0000", 2024-05-08T18:07:43.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0900000000000001e-07 2024-05-08T18:07:43.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705872+0000", 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0580000000000003e-06 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705883+0000", 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0986e-05 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705889+0000", 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6400000000000002e-06 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705942+0000", 2024-05-08T18:07:43.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3726e-05 2024-05-08T18:07:43.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705963+0000", 2024-05-08T18:07:43.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0713e-05 2024-05-08T18:07:43.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711744+0000", 2024-05-08T18:07:43.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057812669999999997 2024-05-08T18:07:43.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711800+0000", 2024-05-08T18:07:43.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5461000000000003e-05 2024-05-08T18:07:43.344 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:92 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'66, mlcod=15'61)", 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.601882889000002, 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046553640000000004, 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:07:43.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707191+0000", 2024-05-08T18:07:43.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9300000000000006e-07 2024-05-08T18:07:43.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707198+0000", 2024-05-08T18:07:43.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4669999999999998e-06 2024-05-08T18:07:43.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.347 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.347 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707214+0000", 2024-05-08T18:07:43.347 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5911000000000001e-05 2024-05-08T18:07:43.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.347 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.347 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707221+0000", 2024-05-08T18:07:43.347 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.43e-06 2024-05-08T18:07:43.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.347 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.347 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707283+0000", 2024-05-08T18:07:43.347 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1974e-05 2024-05-08T18:07:43.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707308+0000", 2024-05-08T18:07:43.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4589000000000001e-05 2024-05-08T18:07:43.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711802+0000", 2024-05-08T18:07:43.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044944939999999999 2024-05-08T18:07:43.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711845+0000", 2024-05-08T18:07:43.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2506000000000003e-05 2024-05-08T18:07:43.348 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.349 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.349 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.349 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:93 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'67, mlcod=15'61)", 2024-05-08T18:07:43.349 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:07:43.349 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.601052631999998, 2024-05-08T18:07:43.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217760000000003, 2024-05-08T18:07:43.349 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.349 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.349 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.349 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:07:43.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.350 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:07:43.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.350 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708021+0000", 2024-05-08T18:07:43.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.92e-07 2024-05-08T18:07:43.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.350 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708106+0000", 2024-05-08T18:07:43.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5400000000000002e-05 2024-05-08T18:07:43.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708116+0000", 2024-05-08T18:07:43.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0482000000000001e-05 2024-05-08T18:07:43.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708124+0000", 2024-05-08T18:07:43.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5349999999999999e-06 2024-05-08T18:07:43.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708182+0000", 2024-05-08T18:07:43.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8130000000000001e-05 2024-05-08T18:07:43.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.352 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.352 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708203+0000", 2024-05-08T18:07:43.352 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1118e-05 2024-05-08T18:07:43.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.352 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.352 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712298+0000", 2024-05-08T18:07:43.352 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004094688 2024-05-08T18:07:43.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.352 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.352 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712342+0000", 2024-05-08T18:07:43.352 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3730999999999999e-05 2024-05-08T18:07:43.352 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.352 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.353 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.353 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.353 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:07:43.353 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.704626566000002, 2024-05-08T18:07:43.353 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087837890000000002, 2024-05-08T18:07:43.353 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.353 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.353 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.353 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.353 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.353 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.353 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210 2024-05-08T18:07:43.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.353 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:07:43.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:07:43.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604448+0000", 2024-05-08T18:07:43.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4229999999999999e-06 2024-05-08T18:07:43.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604460+0000", 2024-05-08T18:07:43.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:07:43.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604491+0000", 2024-05-08T18:07:43.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1004000000000003e-05 2024-05-08T18:07:43.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604513+0000", 2024-05-08T18:07:43.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1886e-05 2024-05-08T18:07:43.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.356 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604670+0000", 2024-05-08T18:07:43.356 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000156735 2024-05-08T18:07:43.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:07:43.356 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604680+0000", 2024-05-08T18:07:43.356 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0113e-05 2024-05-08T18:07:43.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.356 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609236+0000", 2024-05-08T18:07:43.356 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045557269999999999 2024-05-08T18:07:43.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609544+0000", 2024-05-08T18:07:43.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030863800000000002 2024-05-08T18:07:43.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:43.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.610952+0000", 2024-05-08T18:07:43.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014077269999999999 2024-05-08T18:07:43.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.612639+0000", 2024-05-08T18:07:43.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001686398 2024-05-08T18:07:43.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.358 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.358 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613101+0000", 2024-05-08T18:07:43.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00046249600000000001 2024-05-08T18:07:43.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.358 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.358 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613176+0000", 2024-05-08T18:07:43.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5032999999999998e-05 2024-05-08T18:07:43.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.358 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.358 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613230+0000", 2024-05-08T18:07:43.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3638999999999999e-05 2024-05-08T18:07:43.359 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.359 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.359 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.359 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.359 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:07:43.359 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.656038356, 2024-05-08T18:07:43.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046602199999999996, 2024-05-08T18:07:43.359 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.359 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.359 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.359 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.359 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.360 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.360 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 222 2024-05-08T18:07:43.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.360 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:07:43.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:07:43.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.361 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.361 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653037+0000", 2024-05-08T18:07:43.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:07:43.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.361 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.361 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653048+0000", 2024-05-08T18:07:43.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:07:43.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.361 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.361 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653077+0000", 2024-05-08T18:07:43.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9326e-05 2024-05-08T18:07:43.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.362 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.362 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653098+0000", 2024-05-08T18:07:43.362 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1327000000000001e-05 2024-05-08T18:07:43.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.362 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.362 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653230+0000", 2024-05-08T18:07:43.362 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013206599999999999 2024-05-08T18:07:43.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.362 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.362 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653444+0000", 2024-05-08T18:07:43.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000213401 2024-05-08T18:07:43.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:43.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653852+0000", 2024-05-08T18:07:43.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040808700000000001 2024-05-08T18:07:43.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.656108+0000", 2024-05-08T18:07:43.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022565739999999999 2024-05-08T18:07:43.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657533+0000", 2024-05-08T18:07:43.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014241799999999999 2024-05-08T18:07:43.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657629+0000", 2024-05-08T18:07:43.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6435999999999996e-05 2024-05-08T18:07:43.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657694+0000", 2024-05-08T18:07:43.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5349000000000001e-05 2024-05-08T18:07:43.364 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.364 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.364 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.365 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:461 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.365 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:07:43.365 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.529416550000001, 2024-05-08T18:07:43.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040933549999999999, 2024-05-08T18:07:43.365 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.365 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.365 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.365 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.365 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.365 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.365 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 461 2024-05-08T18:07:43.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.365 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:07:43.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:07:43.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779657+0000", 2024-05-08T18:07:43.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.252e-06 2024-05-08T18:07:43.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779663+0000", 2024-05-08T18:07:43.367 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0170000000000002e-06 2024-05-08T18:07:43.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.367 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.367 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779676+0000", 2024-05-08T18:07:43.367 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.296e-05 2024-05-08T18:07:43.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.367 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.367 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779684+0000", 2024-05-08T18:07:43.367 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4209999999999998e-06 2024-05-08T18:07:43.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.367 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.367 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779736+0000", 2024-05-08T18:07:43.367 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2296999999999998e-05 2024-05-08T18:07:43.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779787+0000", 2024-05-08T18:07:43.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0954e-05 2024-05-08T18:07:43.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:43.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779897+0000", 2024-05-08T18:07:43.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011001999999999999 2024-05-08T18:07:43.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780506+0000", 2024-05-08T18:07:43.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060872599999999997 2024-05-08T18:07:43.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783690+0000", 2024-05-08T18:07:43.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031847210000000002 2024-05-08T18:07:43.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783722+0000", 2024-05-08T18:07:43.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1608e-05 2024-05-08T18:07:43.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783749+0000", 2024-05-08T18:07:43.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7379e-05 2024-05-08T18:07:43.370 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.370 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.370 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.370 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:491 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.371 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:07:43.371 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.507152942000001, 2024-05-08T18:07:43.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059507570000000001, 2024-05-08T18:07:43.371 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.371 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.371 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.371 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.371 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.371 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.371 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 491 2024-05-08T18:07:43.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.371 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:07:43.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:07:43.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801921+0000", 2024-05-08T18:07:43.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6959999999999999e-06 2024-05-08T18:07:43.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801928+0000", 2024-05-08T18:07:43.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0299999999999996e-06 2024-05-08T18:07:43.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801944+0000", 2024-05-08T18:07:43.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285e-05 2024-05-08T18:07:43.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801953+0000", 2024-05-08T18:07:43.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1849999999999993e-06 2024-05-08T18:07:43.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802008+0000", 2024-05-08T18:07:43.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5379e-05 2024-05-08T18:07:43.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802093+0000", 2024-05-08T18:07:43.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4907000000000005e-05 2024-05-08T18:07:43.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:43.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802217+0000", 2024-05-08T18:07:43.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000124253 2024-05-08T18:07:43.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802725+0000", 2024-05-08T18:07:43.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050758699999999999 2024-05-08T18:07:43.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807807+0000", 2024-05-08T18:07:43.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005082133 2024-05-08T18:07:43.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807840+0000", 2024-05-08T18:07:43.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3399000000000003e-05 2024-05-08T18:07:43.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807870+0000", 2024-05-08T18:07:43.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9903000000000002e-05 2024-05-08T18:07:43.376 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.376 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.376 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.376 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.376 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:07:43.376 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.500810737999998, 2024-05-08T18:07:43.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056057140000000004, 2024-05-08T18:07:43.376 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.376 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.376 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.377 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.377 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 502 2024-05-08T18:07:43.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.377 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:07:43.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:07:43.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808263+0000", 2024-05-08T18:07:43.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.054e-06 2024-05-08T18:07:43.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808268+0000", 2024-05-08T18:07:43.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4829999999999999e-06 2024-05-08T18:07:43.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808279+0000", 2024-05-08T18:07:43.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0710000000000001e-05 2024-05-08T18:07:43.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808285+0000", 2024-05-08T18:07:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0610000000000001e-06 2024-05-08T18:07:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808331+0000", 2024-05-08T18:07:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5939000000000002e-05 2024-05-08T18:07:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808380+0000", 2024-05-08T18:07:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9382999999999998e-05 2024-05-08T18:07:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808484+0000", 2024-05-08T18:07:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010410499999999999 2024-05-08T18:07:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.809035+0000", 2024-05-08T18:07:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000550969 2024-05-08T18:07:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813811+0000", 2024-05-08T18:07:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047759830000000001 2024-05-08T18:07:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813842+0000", 2024-05-08T18:07:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0778000000000002e-05 2024-05-08T18:07:43.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813867+0000", 2024-05-08T18:07:43.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5249000000000002e-05 2024-05-08T18:07:43.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.381 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.381 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.381 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:07:43.381 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.474280451999999, 2024-05-08T18:07:43.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041392019999999998, 2024-05-08T18:07:43.382 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.382 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.382 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.382 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.382 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.382 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.383 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 527 2024-05-08T18:07:43.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.383 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:07:43.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:07:43.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834793+0000", 2024-05-08T18:07:43.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.212e-06 2024-05-08T18:07:43.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834799+0000", 2024-05-08T18:07:43.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.468e-06 2024-05-08T18:07:43.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834811+0000", 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2602000000000001e-05 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834819+0000", 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6660000000000008e-06 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834871+0000", 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2450000000000001e-05 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834973+0000", 2024-05-08T18:07:43.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101778 2024-05-08T18:07:43.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:43.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835114+0000", 2024-05-08T18:07:43.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014053399999999999 2024-05-08T18:07:43.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835758+0000", 2024-05-08T18:07:43.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064386100000000002 2024-05-08T18:07:43.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838876+0000", 2024-05-08T18:07:43.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031188890000000001 2024-05-08T18:07:43.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838907+0000", 2024-05-08T18:07:43.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-08T18:07:43.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838931+0000", 2024-05-08T18:07:43.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3822999999999999e-05 2024-05-08T18:07:43.387 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.387 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.387 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.388 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.388 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:07:43.388 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.469775471999998, 2024-05-08T18:07:43.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048358089999999999, 2024-05-08T18:07:43.388 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.388 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.388 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.388 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.388 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.388 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.388 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 534 2024-05-08T18:07:43.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.388 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:07:43.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:07:43.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839298+0000", 2024-05-08T18:07:43.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1429999999999999e-06 2024-05-08T18:07:43.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839304+0000", 2024-05-08T18:07:43.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4380000000000003e-06 2024-05-08T18:07:43.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839313+0000", 2024-05-08T18:07:43.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5210000000000008e-06 2024-05-08T18:07:43.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839318+0000", 2024-05-08T18:07:43.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0540000000000002e-06 2024-05-08T18:07:43.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839355+0000", 2024-05-08T18:07:43.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6541999999999997e-05 2024-05-08T18:07:43.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839400+0000", 2024-05-08T18:07:43.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4861999999999998e-05 2024-05-08T18:07:43.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:43.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839504+0000", 2024-05-08T18:07:43.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104169 2024-05-08T18:07:43.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.840046+0000", 2024-05-08T18:07:43.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054245400000000005 2024-05-08T18:07:43.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844075+0000", 2024-05-08T18:07:43.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040287559999999997 2024-05-08T18:07:43.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844108+0000", 2024-05-08T18:07:43.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2872e-05 2024-05-08T18:07:43.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844133+0000", 2024-05-08T18:07:43.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4998e-05 2024-05-08T18:07:43.393 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.393 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.393 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.393 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:544 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.393 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:07:43.393 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.456632462000002, 2024-05-08T18:07:43.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052743060000000003, 2024-05-08T18:07:43.393 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.393 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.393 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.393 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.393 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.393 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.394 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 544 2024-05-08T18:07:43.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.394 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:07:43.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:07:43.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852442+0000", 2024-05-08T18:07:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.88e-06 2024-05-08T18:07:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852450+0000", 2024-05-08T18:07:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1999999999999994e-06 2024-05-08T18:07:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852472+0000", 2024-05-08T18:07:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2160000000000001e-05 2024-05-08T18:07:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852487+0000", 2024-05-08T18:07:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5044e-05 2024-05-08T18:07:43.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852550+0000", 2024-05-08T18:07:43.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3152999999999997e-05 2024-05-08T18:07:43.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852608+0000", 2024-05-08T18:07:43.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8026000000000003e-05 2024-05-08T18:07:43.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:43.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852727+0000", 2024-05-08T18:07:43.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118919 2024-05-08T18:07:43.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.853180+0000", 2024-05-08T18:07:43.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045216599999999999 2024-05-08T18:07:43.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857638+0000", 2024-05-08T18:07:43.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044584510000000004 2024-05-08T18:07:43.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857672+0000", 2024-05-08T18:07:43.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3571000000000001e-05 2024-05-08T18:07:43.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857714+0000", 2024-05-08T18:07:43.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2735999999999999e-05 2024-05-08T18:07:43.398 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.398 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.398 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.398 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.398 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:07:43.398 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.128803683000001, 2024-05-08T18:07:43.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004733213, 2024-05-08T18:07:43.398 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.398 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.399 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.399 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.399 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.399 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.399 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 789 2024-05-08T18:07:43.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.399 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:07:43.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:07:43.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180271+0000", 2024-05-08T18:07:43.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8700000000000001e-06 2024-05-08T18:07:43.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180281+0000", 2024-05-08T18:07:43.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0067e-05 2024-05-08T18:07:43.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180311+0000", 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0783e-05 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180333+0000", 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1509999999999999e-05 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180450+0000", 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116686 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180581+0000", 2024-05-08T18:07:43.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013103499999999999 2024-05-08T18:07:43.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:43.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180848+0000", 2024-05-08T18:07:43.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026750199999999997 2024-05-08T18:07:43.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184268+0000", 2024-05-08T18:07:43.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034198319999999998 2024-05-08T18:07:43.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184844+0000", 2024-05-08T18:07:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057643899999999999 2024-05-08T18:07:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184933+0000", 2024-05-08T18:07:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8692999999999999e-05 2024-05-08T18:07:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.185002+0000", 2024-05-08T18:07:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8795999999999997e-05 2024-05-08T18:07:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.403 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.404 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.404 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.404 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.404 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:43.405 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:07:43.406 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:43.405+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:43.415 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:07:43.415 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:43.415 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 40, 2024-05-08T18:07:43.415 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "0d8284a2-bb69-4df9-9f45-9ef5b469ca40", 2024-05-08T18:07:43.415 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2024-05-08T18:06:48.916680+0000", 2024-05-08T18:07:43.415 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2024-05-08T18:07:42.230157+0000", 2024-05-08T18:07:43.415 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2024-05-08T18:07:00.796481+0000", 2024-05-08T18:07:43.416 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2024-05-08T18:06:51.530709+0000", 2024-05-08T18:07:43.416 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-05-08T18:07:43.416 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5804032, 2024-05-08T18:07:43.416 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2024-05-08T18:07:43.416 INFO:teuthology.orchestra.run.smithi080.stdout: "nodeep-scrub", 2024-05-08T18:07:43.416 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2024-05-08T18:07:43.416 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2024-05-08T18:07:43.416 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2024-05-08T18:07:43.416 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2024-05-08T18:07:43.416 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-05-08T18:07:43.416 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 4, 2024-05-08T18:07:43.417 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2024-05-08T18:07:43.417 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-05-08T18:07:43.417 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2024-05-08T18:07:43.417 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2024-05-08T18:07:43.417 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 8, 2024-05-08T18:07:43.417 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2024-05-08T18:07:43.417 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "luminous", 2024-05-08T18:07:43.417 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "jewel", 2024-05-08T18:07:43.417 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "squid", 2024-05-08T18:07:43.417 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_crimson": false, 2024-05-08T18:07:43.417 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2024-05-08T18:07:43.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.418 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2024-05-08T18:07:43.418 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": ".mgr", 2024-05-08T18:07:43.418 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:01.699859+0000", 2024-05-08T18:07:43.418 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:07:43.418 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:07:43.418 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:07:43.418 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:07:43.418 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:07:43.418 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:07:43.418 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:07:43.418 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:07:43.418 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:07:43.418 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:07:43.419 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:07:43.419 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:07:43.419 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 1, 2024-05-08T18:07:43.419 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 1, 2024-05-08T18:07:43.419 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 1, 2024-05-08T18:07:43.419 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 1, 2024-05-08T18:07:43.419 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 1, 2024-05-08T18:07:43.419 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:07:43.419 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:07:43.419 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:07:43.419 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:07:43.419 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:07:43.419 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:07:43.419 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:07:43.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.420 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "16", 2024-05-08T18:07:43.420 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:07:43.420 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:07:43.420 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:07:43.420 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:07:43.420 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:07:43.420 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:07:43.420 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:07:43.420 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:07:43.420 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:07:43.420 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:07:43.420 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:07:43.420 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:07:43.420 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:07:43.420 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:07:43.421 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:07:43.421 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:07:43.421 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:07:43.421 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:07:43.421 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:07:43.421 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:07:43.421 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:07:43.421 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:07:43.421 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:07:43.421 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:07:43.421 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:07:43.421 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:07:43.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.421 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:07:43.421 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:07:43.421 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:07:43.422 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:07:43.422 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:07:43.422 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:07:43.422 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:07:43.422 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:07:43.422 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:07:43.422 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:07:43.422 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:07:43.422 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-05-08T18:07:43.422 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_max": 32, 2024-05-08T18:07:43.422 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 1 2024-05-08T18:07:43.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.422 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:07:43.422 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": {} 2024-05-08T18:07:43.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.423 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:07:43.423 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:07:43.423 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 8, 2024-05-08T18:07:43.423 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 8, 2024-05-08T18:07:43.423 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 0.25, 2024-05-08T18:07:43.423 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 2, 2024-05-08T18:07:43.423 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 2, 2024-05-08T18:07:43.423 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:07:43.423 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:07:43.423 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:07:43.423 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.423 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 2, 2024-05-08T18:07:43.424 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2024-05-08T18:07:43.424 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:07.479756+0000", 2024-05-08T18:07:43.424 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:07:43.424 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:07:43.424 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:07:43.424 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:07:43.424 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:07:43.424 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:07:43.424 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:07:43.425 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:07:43.425 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:07:43.425 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:07:43.425 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:07:43.425 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:07:43.425 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2024-05-08T18:07:43.425 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2024-05-08T18:07:43.425 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2024-05-08T18:07:43.425 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2024-05-08T18:07:43.425 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2024-05-08T18:07:43.425 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:07:43.425 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:07:43.425 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:07:43.425 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:07:43.426 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:07:43.426 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:07:43.426 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:07:43.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.426 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "19", 2024-05-08T18:07:43.426 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:07:43.426 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:07:43.427 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:07:43.427 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:07:43.427 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:07:43.427 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:07:43.427 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:07:43.427 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:07:43.427 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:07:43.427 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:07:43.427 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:07:43.427 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:07:43.427 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:07:43.427 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:07:43.427 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:07:43.428 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:07:43.428 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:07:43.428 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:07:43.428 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:07:43.428 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:07:43.428 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:07:43.428 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:07:43.428 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:07:43.428 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:07:43.428 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:07:43.428 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:07:43.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.428 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:07:43.428 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:07:43.428 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:07:43.429 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:07:43.429 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:07:43.429 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:07:43.429 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:07:43.429 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:07:43.429 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:07:43.429 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:07:43.429 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:07:43.429 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:07:43.429 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:07:43.429 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2024-05-08T18:07:43.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.429 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:07:43.429 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:07:43.429 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.9900000095367432, 2024-05-08T18:07:43.430 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.9900000095367432, 2024-05-08T18:07:43.430 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 0.87999999523162842, 2024-05-08T18:07:43.430 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.75, 2024-05-08T18:07:43.430 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.75, 2024-05-08T18:07:43.430 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:07:43.430 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:07:43.430 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:07:43.430 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.430 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 3, 2024-05-08T18:07:43.430 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.buckets.data", 2024-05-08T18:07:43.430 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:14.110093+0000", 2024-05-08T18:07:43.430 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:07:43.430 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:07:43.431 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:07:43.431 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:07:43.431 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:07:43.431 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:07:43.431 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:07:43.431 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:07:43.431 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:07:43.431 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:07:43.431 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:07:43.431 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:07:43.431 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 64, 2024-05-08T18:07:43.431 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 64, 2024-05-08T18:07:43.431 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 64, 2024-05-08T18:07:43.431 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 64, 2024-05-08T18:07:43.431 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 64, 2024-05-08T18:07:43.431 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:07:43.432 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:07:43.432 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:07:43.432 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:07:43.432 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:07:43.432 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:07:43.432 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:07:43.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.432 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "22", 2024-05-08T18:07:43.432 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:07:43.432 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:07:43.432 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:07:43.432 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:07:43.432 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:07:43.432 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:07:43.432 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:07:43.433 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:07:43.433 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:07:43.433 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:07:43.433 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:07:43.433 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:07:43.433 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:07:43.433 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:07:43.433 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:07:43.433 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:07:43.433 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:07:43.433 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:07:43.433 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:07:43.433 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:07:43.433 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:07:43.433 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:07:43.433 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:07:43.434 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:07:43.434 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:07:43.434 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:07:43.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.434 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:07:43.434 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:07:43.434 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:07:43.434 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:07:43.434 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:07:43.434 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:07:43.434 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:07:43.434 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:07:43.434 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:07:43.434 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:07:43.434 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:07:43.435 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:07:43.435 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:07:43.435 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:07:43.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.435 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:07:43.435 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:07:43.435 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.5, 2024-05-08T18:07:43.435 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.5, 2024-05-08T18:07:43.435 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:07:43.435 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.5, 2024-05-08T18:07:43.435 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.5, 2024-05-08T18:07:43.435 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:07:43.435 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:07:43.435 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:07:43.435 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.436 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 4, 2024-05-08T18:07:43.436 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.buckets.index", 2024-05-08T18:07:43.436 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:15.798248+0000", 2024-05-08T18:07:43.436 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:07:43.436 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:07:43.436 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:07:43.436 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:07:43.436 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:07:43.436 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:07:43.436 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:07:43.436 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:07:43.436 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:07:43.437 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:07:43.437 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:07:43.437 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:07:43.437 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 64, 2024-05-08T18:07:43.437 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 64, 2024-05-08T18:07:43.437 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 64, 2024-05-08T18:07:43.437 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 64, 2024-05-08T18:07:43.437 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 64, 2024-05-08T18:07:43.437 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:07:43.437 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:07:43.437 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:07:43.437 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:07:43.437 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:07:43.437 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:07:43.437 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:07:43.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.438 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "24", 2024-05-08T18:07:43.438 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:07:43.438 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:07:43.438 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:07:43.438 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:07:43.438 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:07:43.438 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:07:43.438 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:07:43.438 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:07:43.438 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:07:43.439 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:07:43.439 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:07:43.439 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:07:43.439 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:07:43.439 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:07:43.439 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:07:43.439 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:07:43.439 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:07:43.439 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:07:43.439 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:07:43.439 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:07:43.439 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:07:43.439 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:07:43.439 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:07:43.440 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:07:43.440 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:07:43.440 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:07:43.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.440 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:07:43.440 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:07:43.440 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:07:43.440 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:07:43.440 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:07:43.440 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:07:43.440 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:07:43.440 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:07:43.440 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:07:43.440 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:07:43.440 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:07:43.440 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:07:43.441 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:07:43.441 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:07:43.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.441 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:07:43.441 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:07:43.441 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 2, 2024-05-08T18:07:43.441 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 2, 2024-05-08T18:07:43.441 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:07:43.441 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 2, 2024-05-08T18:07:43.441 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 2, 2024-05-08T18:07:43.441 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:07:43.441 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:07:43.441 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:07:43.441 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.442 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 5, 2024-05-08T18:07:43.442 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": ".rgw.root", 2024-05-08T18:07:43.442 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:17.763573+0000", 2024-05-08T18:07:43.442 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:07:43.442 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:07:43.442 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:07:43.442 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:07:43.442 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:07:43.442 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:07:43.442 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:07:43.442 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:07:43.442 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:07:43.442 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:07:43.442 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:07:43.442 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:07:43.443 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-05-08T18:07:43.443 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-05-08T18:07:43.443 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-05-08T18:07:43.443 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-05-08T18:07:43.443 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-05-08T18:07:43.443 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:07:43.443 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:07:43.443 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:07:43.443 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:07:43.443 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:07:43.443 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:07:43.443 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:07:43.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.443 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "26", 2024-05-08T18:07:43.443 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:07:43.444 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:07:43.444 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:07:43.444 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:07:43.444 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:07:43.444 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:07:43.444 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:07:43.444 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:07:43.444 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:07:43.444 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:07:43.444 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:07:43.444 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:07:43.444 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:07:43.444 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:07:43.444 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:07:43.444 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:07:43.444 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:07:43.445 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:07:43.445 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:07:43.445 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:07:43.445 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:07:43.445 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:07:43.445 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:07:43.445 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:07:43.445 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:07:43.445 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:07:43.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.445 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:07:43.445 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:07:43.445 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:07:43.445 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:07:43.445 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:07:43.445 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:07:43.446 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:07:43.446 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:07:43.446 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:07:43.446 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:07:43.446 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:07:43.446 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:07:43.446 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:07:43.446 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:07:43.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.446 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:07:43.446 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:07:43.446 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.25, 2024-05-08T18:07:43.446 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.25, 2024-05-08T18:07:43.446 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:07:43.446 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.25, 2024-05-08T18:07:43.447 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.25, 2024-05-08T18:07:43.447 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:07:43.447 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:07:43.447 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:07:43.447 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.447 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 6, 2024-05-08T18:07:43.447 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.log", 2024-05-08T18:07:43.447 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:19.656809+0000", 2024-05-08T18:07:43.447 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:07:43.447 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:07:43.447 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:07:43.447 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:07:43.447 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:07:43.447 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:07:43.448 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:07:43.448 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:07:43.448 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:07:43.448 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:07:43.448 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:07:43.448 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:07:43.448 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-05-08T18:07:43.448 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-05-08T18:07:43.448 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-05-08T18:07:43.448 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-05-08T18:07:43.448 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-05-08T18:07:43.448 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:07:43.448 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:07:43.448 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:07:43.448 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:07:43.448 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:07:43.449 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:07:43.449 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:07:43.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.449 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "28", 2024-05-08T18:07:43.449 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:07:43.449 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:07:43.449 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:07:43.449 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:07:43.449 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:07:43.449 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:07:43.449 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:07:43.449 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:07:43.449 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:07:43.449 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:07:43.449 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:07:43.449 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:07:43.450 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:07:43.450 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:07:43.450 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:07:43.450 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:07:43.450 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:07:43.450 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:07:43.450 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:07:43.450 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:07:43.450 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:07:43.450 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:07:43.450 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:07:43.450 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:07:43.450 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:07:43.450 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:07:43.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.451 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:07:43.451 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:07:43.451 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:07:43.451 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:07:43.451 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:07:43.451 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:07:43.451 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:07:43.451 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:07:43.451 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:07:43.451 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:07:43.451 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:07:43.451 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:07:43.451 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:07:43.451 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:07:43.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.452 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:07:43.452 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:07:43.452 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.75, 2024-05-08T18:07:43.452 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.75, 2024-05-08T18:07:43.452 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:07:43.452 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.75, 2024-05-08T18:07:43.452 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.75, 2024-05-08T18:07:43.452 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:07:43.452 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:07:43.452 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:07:43.452 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.452 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 7, 2024-05-08T18:07:43.453 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.control", 2024-05-08T18:07:43.453 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:21.569514+0000", 2024-05-08T18:07:43.453 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:07:43.453 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:07:43.453 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:07:43.453 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:07:43.453 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:07:43.453 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:07:43.453 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:07:43.453 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:07:43.453 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:07:43.453 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:07:43.453 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:07:43.453 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:07:43.453 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-05-08T18:07:43.454 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-05-08T18:07:43.454 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-05-08T18:07:43.454 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-05-08T18:07:43.454 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-05-08T18:07:43.454 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:07:43.454 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:07:43.454 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:07:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:07:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:07:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:07:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:07:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "30", 2024-05-08T18:07:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:07:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:07:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:07:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:07:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:07:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:07:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:07:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:07:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:07:43.456 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:07:43.456 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:07:43.456 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:07:43.456 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:07:43.456 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:07:43.456 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:07:43.456 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:07:43.456 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:07:43.456 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:07:43.456 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:07:43.456 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:07:43.456 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:07:43.456 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:07:43.456 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:07:43.456 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:07:43.457 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:07:43.457 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:07:43.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.457 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:07:43.457 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:07:43.457 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:07:43.457 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:07:43.457 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:07:43.457 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:07:43.457 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:07:43.457 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:07:43.457 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:07:43.457 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:07:43.457 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:07:43.457 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:07:43.458 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:07:43.458 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:07:43.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.458 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:07:43.458 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:07:43.458 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.75, 2024-05-08T18:07:43.458 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.75, 2024-05-08T18:07:43.458 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:07:43.458 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.75, 2024-05-08T18:07:43.458 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.75, 2024-05-08T18:07:43.458 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:07:43.458 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:07:43.458 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:07:43.458 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.459 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 8, 2024-05-08T18:07:43.459 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.meta", 2024-05-08T18:07:43.459 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:23.704646+0000", 2024-05-08T18:07:43.459 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:07:43.459 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:07:43.459 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:07:43.459 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:07:43.459 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:07:43.459 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:07:43.459 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:07:43.459 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:07:43.459 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:07:43.459 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:07:43.459 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:07:43.459 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:07:43.459 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-05-08T18:07:43.460 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-05-08T18:07:43.460 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-05-08T18:07:43.460 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-05-08T18:07:43.460 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-05-08T18:07:43.460 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:07:43.460 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:07:43.460 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:07:43.460 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:07:43.460 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:07:43.460 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:07:43.460 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:07:43.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.460 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "32", 2024-05-08T18:07:43.460 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:07:43.460 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:07:43.460 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:07:43.461 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:07:43.461 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:07:43.461 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:07:43.461 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:07:43.461 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:07:43.461 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:07:43.461 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:07:43.461 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:07:43.461 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:07:43.461 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:07:43.461 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:07:43.461 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:07:43.461 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:07:43.462 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:07:43.462 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:07:43.462 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:07:43.462 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:07:43.462 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:07:43.462 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:07:43.462 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:07:43.462 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:07:43.462 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:07:43.462 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:07:43.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.463 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:07:43.463 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:07:43.463 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:07:43.463 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:07:43.463 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:07:43.463 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:07:43.463 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:07:43.463 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:07:43.463 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:07:43.463 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:07:43.463 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:07:43.463 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-05-08T18:07:43.463 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4 2024-05-08T18:07:43.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.463 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:07:43.464 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:07:43.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.464 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:07:43.464 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:07:43.464 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.5, 2024-05-08T18:07:43.464 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.5, 2024-05-08T18:07:43.464 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:07:43.464 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.5, 2024-05-08T18:07:43.464 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.5, 2024-05-08T18:07:43.464 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:07:43.464 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:07:43.464 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:07:43.464 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.464 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.464 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-05-08T18:07:43.464 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-05-08T18:07:43.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.465 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-05-08T18:07:43.465 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "e14e7bbc-18b8-4961-bcde-109f22cc52e6", 2024-05-08T18:07:43.465 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:07:43.465 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:07:43.465 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:07:43.465 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:07:43.465 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:07:43.465 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:07:43.465 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:07:43.465 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 30, 2024-05-08T18:07:43.465 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:07:43.465 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:07:43.465 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:07:43.465 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.466 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.466 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2024-05-08T18:07:43.466 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:07:43.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.466 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.466 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2024-05-08T18:07:43.466 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:07:43.466 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.466 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.466 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:07:43.466 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.466 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.466 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2024-05-08T18:07:43.467 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:07:43.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.467 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.467 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2024-05-08T18:07:43.467 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:07:43.467 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.467 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.467 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:07:43.467 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.467 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.467 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2024-05-08T18:07:43.467 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:07:43.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.468 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.468 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2024-05-08T18:07:43.468 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:07:43.468 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.468 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.468 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:07:43.468 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.468 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.468 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2024-05-08T18:07:43.468 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:07:43.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.469 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.469 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2024-05-08T18:07:43.469 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:07:43.469 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.469 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.469 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6812/3565382691", 2024-05-08T18:07:43.469 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6817/3565382691", 2024-05-08T18:07:43.469 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/3565382691", 2024-05-08T18:07:43.469 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/3565382691", 2024-05-08T18:07:43.469 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:07:43.469 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:07:43.469 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:07:43.469 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.470 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-05-08T18:07:43.470 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "d4ce30c2-52b8-45a3-8a34-b0addc8311dd", 2024-05-08T18:07:43.470 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:07:43.470 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:07:43.470 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:07:43.470 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:07:43.470 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:07:43.470 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:07:43.470 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:07:43.470 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 30, 2024-05-08T18:07:43.470 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:07:43.470 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:07:43.471 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:07:43.471 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.471 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.471 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2024-05-08T18:07:43.471 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:07:43.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.471 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.471 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2024-05-08T18:07:43.471 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:07:43.471 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.471 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.471 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:07:43.471 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.472 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.472 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2024-05-08T18:07:43.472 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:07:43.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.472 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.472 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2024-05-08T18:07:43.472 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:07:43.472 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.472 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.472 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:07:43.473 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.473 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.473 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2024-05-08T18:07:43.473 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:07:43.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.473 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.473 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2024-05-08T18:07:43.473 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:07:43.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.473 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.473 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:07:43.473 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.474 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.474 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2024-05-08T18:07:43.474 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:07:43.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.474 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.474 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2024-05-08T18:07:43.474 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:07:43.474 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.474 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.474 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/3922502534", 2024-05-08T18:07:43.474 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/3922502534", 2024-05-08T18:07:43.474 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/3922502534", 2024-05-08T18:07:43.475 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/3922502534", 2024-05-08T18:07:43.475 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:07:43.475 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:07:43.475 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:07:43.475 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.475 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-05-08T18:07:43.475 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "0049cbe1-578f-4202-a572-2328d79f0496", 2024-05-08T18:07:43.475 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:07:43.475 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:07:43.475 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:07:43.475 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:07:43.475 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:07:43.475 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:07:43.475 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:07:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 28, 2024-05-08T18:07:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:07:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:07:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:07:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2024-05-08T18:07:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:07:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2024-05-08T18:07:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:07:43.476 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.477 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.477 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:07:43.477 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.477 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.477 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2024-05-08T18:07:43.477 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:07:43.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.477 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.477 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2024-05-08T18:07:43.477 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:07:43.477 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.478 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.478 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:07:43.478 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.478 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.478 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2024-05-08T18:07:43.478 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:07:43.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.478 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.478 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2024-05-08T18:07:43.478 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:07:43.478 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.478 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.479 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:07:43.479 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.479 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.479 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2024-05-08T18:07:43.479 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:07:43.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.479 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.479 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2024-05-08T18:07:43.479 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:07:43.479 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.479 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.479 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/3474282780", 2024-05-08T18:07:43.480 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/3474282780", 2024-05-08T18:07:43.480 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/3474282780", 2024-05-08T18:07:43.480 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/3474282780", 2024-05-08T18:07:43.480 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:07:43.480 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:07:43.480 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:07:43.480 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.480 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-05-08T18:07:43.480 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3ec754a0-b0ca-4d44-bce0-7c380245ec0a", 2024-05-08T18:07:43.480 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:07:43.480 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:07:43.480 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:07:43.480 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:07:43.481 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:07:43.481 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:07:43.481 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:07:43.481 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 30, 2024-05-08T18:07:43.481 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:07:43.481 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:07:43.481 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:07:43.481 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.481 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.481 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2024-05-08T18:07:43.481 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:07:43.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.481 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.482 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2024-05-08T18:07:43.482 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:07:43.482 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.482 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.482 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:07:43.482 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.482 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.482 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2024-05-08T18:07:43.482 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:07:43.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.482 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.483 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2024-05-08T18:07:43.483 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:07:43.483 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.483 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.483 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:07:43.483 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.483 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.483 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2024-05-08T18:07:43.483 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:07:43.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.483 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.483 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2024-05-08T18:07:43.483 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:07:43.484 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.484 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.484 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:07:43.484 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.484 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.484 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2024-05-08T18:07:43.484 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:07:43.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.484 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.484 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2024-05-08T18:07:43.484 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:07:43.484 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.484 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.485 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6810/3525633066", 2024-05-08T18:07:43.485 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6813/3525633066", 2024-05-08T18:07:43.485 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6820/3525633066", 2024-05-08T18:07:43.485 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6816/3525633066", 2024-05-08T18:07:43.485 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:07:43.485 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:07:43.485 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:07:43.485 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.485 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-05-08T18:07:43.485 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d", 2024-05-08T18:07:43.485 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:07:43.485 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:07:43.485 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:07:43.486 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:07:43.486 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:07:43.486 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:07:43.486 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:07:43.486 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 30, 2024-05-08T18:07:43.486 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:07:43.486 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:07:43.486 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:07:43.486 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.486 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.486 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6816", 2024-05-08T18:07:43.486 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:07:43.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.487 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.487 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6817", 2024-05-08T18:07:43.487 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:07:43.487 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.487 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.487 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:07:43.487 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.487 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.487 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6819", 2024-05-08T18:07:43.487 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:07:43.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.487 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.488 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6821", 2024-05-08T18:07:43.488 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:07:43.488 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.488 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.488 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:07:43.488 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.488 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.488 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6827", 2024-05-08T18:07:43.488 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:07:43.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.488 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.488 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6829", 2024-05-08T18:07:43.488 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6823", 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6825", 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.490 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.115:6817/4103080494", 2024-05-08T18:07:43.490 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.115:6821/4103080494", 2024-05-08T18:07:43.490 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.115:6829/4103080494", 2024-05-08T18:07:43.490 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.115:6825/4103080494", 2024-05-08T18:07:43.490 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:07:43.490 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:07:43.490 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:07:43.490 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.490 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-05-08T18:07:43.490 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3dc618ad-e40d-418e-844c-57572043f866", 2024-05-08T18:07:43.490 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:07:43.490 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:07:43.490 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:07:43.490 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:07:43.491 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:07:43.491 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:07:43.491 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:07:43.491 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 30, 2024-05-08T18:07:43.491 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:07:43.491 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:07:43.491 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:07:43.491 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.491 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.491 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6818", 2024-05-08T18:07:43.491 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:07:43.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.491 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.492 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6820", 2024-05-08T18:07:43.492 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:07:43.492 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.492 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.492 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:07:43.492 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.492 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.492 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6822", 2024-05-08T18:07:43.492 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:07:43.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.492 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.492 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6824", 2024-05-08T18:07:43.492 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:07:43.493 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.493 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.493 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:07:43.493 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.493 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.493 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6830", 2024-05-08T18:07:43.493 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:07:43.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.493 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.493 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6831", 2024-05-08T18:07:43.494 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:07:43.494 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.494 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.494 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:07:43.494 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.494 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.494 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6826", 2024-05-08T18:07:43.494 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:07:43.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.494 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.494 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6828", 2024-05-08T18:07:43.494 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:07:43.495 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.495 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.495 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.115:6820/87947085", 2024-05-08T18:07:43.495 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.115:6824/87947085", 2024-05-08T18:07:43.495 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.115:6831/87947085", 2024-05-08T18:07:43.495 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.115:6828/87947085", 2024-05-08T18:07:43.495 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:07:43.495 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:07:43.495 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:07:43.495 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.495 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-05-08T18:07:43.495 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "1f8172c6-5d27-4542-80a6-1c630dddf752", 2024-05-08T18:07:43.496 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:07:43.496 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:07:43.496 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:07:43.496 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:07:43.496 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:07:43.496 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:07:43.496 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:07:43.496 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 30, 2024-05-08T18:07:43.496 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:07:43.496 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:07:43.496 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:07:43.496 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.496 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.496 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6800", 2024-05-08T18:07:43.496 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6801", 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6802", 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.497 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.498 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6803", 2024-05-08T18:07:43.498 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:07:43.498 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.498 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.498 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:07:43.498 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.498 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.498 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6806", 2024-05-08T18:07:43.498 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:07:43.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.498 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.498 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6807", 2024-05-08T18:07:43.499 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:07:43.499 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.499 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.499 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:07:43.499 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.499 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.499 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6804", 2024-05-08T18:07:43.499 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:07:43.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.499 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.499 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6805", 2024-05-08T18:07:43.499 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:07:43.499 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.500 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.500 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.115:6801/2090404725", 2024-05-08T18:07:43.500 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.115:6803/2090404725", 2024-05-08T18:07:43.500 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.115:6807/2090404725", 2024-05-08T18:07:43.500 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.115:6805/2090404725", 2024-05-08T18:07:43.500 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:07:43.500 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:07:43.500 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:07:43.500 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.500 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-05-08T18:07:43.500 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "e4146a73-11ca-4499-afa7-23e23d70a662", 2024-05-08T18:07:43.501 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:07:43.501 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:07:43.501 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:07:43.501 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:07:43.501 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:07:43.501 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:07:43.501 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:07:43.501 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 30, 2024-05-08T18:07:43.501 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:07:43.501 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:07:43.501 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:07:43.501 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.501 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.501 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6808", 2024-05-08T18:07:43.501 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:07:43.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.502 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.502 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6809", 2024-05-08T18:07:43.502 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:07:43.502 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.502 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.502 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:07:43.502 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.502 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.502 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6810", 2024-05-08T18:07:43.502 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:07:43.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.503 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.503 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6811", 2024-05-08T18:07:43.503 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:07:43.503 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.503 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.503 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:07:43.503 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.503 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.503 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6814", 2024-05-08T18:07:43.503 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:07:43.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.504 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.504 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6815", 2024-05-08T18:07:43.504 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:07:43.504 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.504 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.504 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:07:43.504 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:07:43.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.504 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:07:43.504 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6812", 2024-05-08T18:07:43.504 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:07:43.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.505 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:07:43.505 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6813", 2024-05-08T18:07:43.505 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:07:43.505 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.505 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.505 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.115:6809/133828553", 2024-05-08T18:07:43.505 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.115:6811/133828553", 2024-05-08T18:07:43.505 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.115:6815/133828553", 2024-05-08T18:07:43.505 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.115:6813/133828553", 2024-05-08T18:07:43.505 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:07:43.505 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:07:43.505 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:07:43.505 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.506 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.506 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-05-08T18:07:43.506 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2024-05-08T18:07:43.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.506 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-05-08T18:07:43.506 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:07:43.506 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:07:43.506 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:07:43.506 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:07:43.506 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:07:43.506 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:56.936317+0000", 2024-05-08T18:07:43.506 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:07:43.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.506 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-05-08T18:07:43.507 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:07:43.507 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:07:43.507 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:07:43.507 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:07:43.507 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:07:43.507 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:56.814583+0000", 2024-05-08T18:07:43.507 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:07:43.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.507 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-05-08T18:07:43.507 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:07:43.507 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:07:43.507 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:07:43.507 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:07:43.507 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:07:43.507 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:57.168294+0000", 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:56.751445+0000", 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:07:43.508 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:07:43.509 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:07:43.509 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:07:43.509 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:57.091268+0000", 2024-05-08T18:07:43.509 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:07:43.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.509 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-05-08T18:07:43.509 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:07:43.509 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:07:43.509 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:07:43.509 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:07:43.509 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:07:43.509 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:57.113133+0000", 2024-05-08T18:07:43.509 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:07:43.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.510 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-05-08T18:07:43.510 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:07:43.510 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:07:43.510 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:07:43.510 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:07:43.510 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:07:43.510 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:57.054822+0000", 2024-05-08T18:07:43.510 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:07:43.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.510 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-05-08T18:07:43.510 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:07:43.510 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:07:43.510 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:07:43.511 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:07:43.511 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:07:43.511 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:57.057214+0000", 2024-05-08T18:07:43.511 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:07:43.511 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.511 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-05-08T18:07:43.511 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [], 2024-05-08T18:07:43.511 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [], 2024-05-08T18:07:43.511 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_primaries": [], 2024-05-08T18:07:43.511 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2024-05-08T18:07:43.511 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2024-05-08T18:07:43.511 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklist": {}, 2024-05-08T18:07:43.511 INFO:teuthology.orchestra.run.smithi080.stdout: "range_blocklist": {}, 2024-05-08T18:07:43.511 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2024-05-08T18:07:43.511 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2024-05-08T18:07:43.512 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2024-05-08T18:07:43.512 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2024-05-08T18:07:43.512 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2024-05-08T18:07:43.512 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2024-05-08T18:07:43.512 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2024-05-08T18:07:43.512 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.512 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2024-05-08T18:07:43.512 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2024-05-08T18:07:43.512 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2024-05-08T18:07:43.512 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2024-05-08T18:07:43.512 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {}, 2024-05-08T18:07:43.512 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode": { 2024-05-08T18:07:43.512 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_enabled": false, 2024-05-08T18:07:43.512 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_bucket_count": 0, 2024-05-08T18:07:43.513 INFO:teuthology.orchestra.run.smithi080.stdout: "degraded_stretch_mode": 0, 2024-05-08T18:07:43.513 INFO:teuthology.orchestra.run.smithi080.stdout: "recovering_stretch_mode": 0, 2024-05-08T18:07:43.513 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_bucket": 0 2024-05-08T18:07:43.513 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.513 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:43.515 INFO:tasks.thrashosds.thrasher:j is {'epoch': 40, 'fsid': '0d8284a2-bb69-4df9-9f45-9ef5b469ca40', 'created': '2024-05-08T18:06:48.916680+0000', 'modified': '2024-05-08T18:07:42.230157+0000', 'last_up_change': '2024-05-08T18:07:00.796481+0000', 'last_in_change': '2024-05-08T18:06:51.530709+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T18:07:01.699859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-08T18:07:07.479756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2024-05-08T18:07:14.110093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2024-05-08T18:07:15.798248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': '.rgw.root', 'create_time': '2024-05-08T18:07:17.763573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'default.rgw.log', 'create_time': '2024-05-08T18:07:19.656809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'default.rgw.control', 'create_time': '2024-05-08T18:07:21.569514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2024-05-08T18:07:23.704646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'e14e7bbc-18b8-4961-bcde-109f22cc52e6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6809', 'nonce': 3565382691}, {'type': 'v1', 'addr': '172.21.15.80:6812', 'nonce': 3565382691}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6815', 'nonce': 3565382691}, {'type': 'v1', 'addr': '172.21.15.80:6817', 'nonce': 3565382691}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6822', 'nonce': 3565382691}, {'type': 'v1', 'addr': '172.21.15.80:6823', 'nonce': 3565382691}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6819', 'nonce': 3565382691}, {'type': 'v1', 'addr': '172.21.15.80:6821', 'nonce': 3565382691}]}, 'public_addr': '172.21.15.80:6812/3565382691', 'cluster_addr': '172.21.15.80:6817/3565382691', 'heartbeat_back_addr': '172.21.15.80:6823/3565382691', 'heartbeat_front_addr': '172.21.15.80:6821/3565382691', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'd4ce30c2-52b8-45a3-8a34-b0addc8311dd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6800', 'nonce': 3922502534}, {'type': 'v1', 'addr': '172.21.15.80:6801', 'nonce': 3922502534}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6802', 'nonce': 3922502534}, {'type': 'v1', 'addr': '172.21.15.80:6803', 'nonce': 3922502534}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6806', 'nonce': 3922502534}, {'type': 'v1', 'addr': '172.21.15.80:6807', 'nonce': 3922502534}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6804', 'nonce': 3922502534}, {'type': 'v1', 'addr': '172.21.15.80:6805', 'nonce': 3922502534}]}, 'public_addr': '172.21.15.80:6801/3922502534', 'cluster_addr': '172.21.15.80:6803/3922502534', 'heartbeat_back_addr': '172.21.15.80:6807/3922502534', 'heartbeat_front_addr': '172.21.15.80:6805/3922502534', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0049cbe1-578f-4202-a572-2328d79f0496', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 28, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6824', 'nonce': 3474282780}, {'type': 'v1', 'addr': '172.21.15.80:6825', 'nonce': 3474282780}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6826', 'nonce': 3474282780}, {'type': 'v1', 'addr': '172.21.15.80:6827', 'nonce': 3474282780}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6830', 'nonce': 3474282780}, {'type': 'v1', 'addr': '172.21.15.80:6831', 'nonce': 3474282780}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6828', 'nonce': 3474282780}, {'type': 'v1', 'addr': '172.21.15.80:6829', 'nonce': 3474282780}]}, 'public_addr': '172.21.15.80:6825/3474282780', 'cluster_addr': '172.21.15.80:6827/3474282780', 'heartbeat_back_addr': '172.21.15.80:6831/3474282780', 'heartbeat_front_addr': '172.21.15.80:6829/3474282780', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '3ec754a0-b0ca-4d44-bce0-7c380245ec0a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6808', 'nonce': 3525633066}, {'type': 'v1', 'addr': '172.21.15.80:6810', 'nonce': 3525633066}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6811', 'nonce': 3525633066}, {'type': 'v1', 'addr': '172.21.15.80:6813', 'nonce': 3525633066}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6818', 'nonce': 3525633066}, {'type': 'v1', 'addr': '172.21.15.80:6820', 'nonce': 3525633066}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6814', 'nonce': 3525633066}, {'type': 'v1', 'addr': '172.21.15.80:6816', 'nonce': 3525633066}]}, 'public_addr': '172.21.15.80:6810/3525633066', 'cluster_addr': '172.21.15.80:6813/3525633066', 'heartbeat_back_addr': '172.21.15.80:6820/3525633066', 'heartbeat_front_addr': '172.21.15.80:6816/3525633066', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6816', 'nonce': 4103080494}, {'type': 'v1', 'addr': '172.21.15.115:6817', 'nonce': 4103080494}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6819', 'nonce': 4103080494}, {'type': 'v1', 'addr': '172.21.15.115:6821', 'nonce': 4103080494}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6827', 'nonce': 4103080494}, {'type': 'v1', 'addr': '172.21.15.115:6829', 'nonce': 4103080494}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6823', 'nonce': 4103080494}, {'type': 'v1', 'addr': '172.21.15.115:6825', 'nonce': 4103080494}]}, 'public_addr': '172.21.15.115:6817/4103080494', 'cluster_addr': '172.21.15.115:6821/4103080494', 'heartbeat_back_addr': '172.21.15.115:6829/4103080494', 'heartbeat_front_addr': '172.21.15.115:6825/4103080494', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '3dc618ad-e40d-418e-844c-57572043f866', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6818', 'nonce': 87947085}, {'type': 'v1', 'addr': '172.21.15.115:6820', 'nonce': 87947085}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6822', 'nonce': 87947085}, {'type': 'v1', 'addr': '172.21.15.115:6824', 'nonce': 87947085}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6830', 'nonce': 87947085}, {'type': 'v1', 'addr': '172.21.15.115:6831', 'nonce': 87947085}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6826', 'nonce': 87947085}, {'type': 'v1', 'addr': '172.21.15.115:6828', 'nonce': 87947085}]}, 'public_addr': '172.21.15.115:6820/87947085', 'cluster_addr': '172.21.15.115:6824/87947085', 'heartbeat_back_addr': '172.21.15.115:6831/87947085', 'heartbeat_front_addr': '172.21.15.115:6828/87947085', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '1f8172c6-5d27-4542-80a6-1c630dddf752', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6800', 'nonce': 2090404725}, {'type': 'v1', 'addr': '172.21.15.115:6801', 'nonce': 2090404725}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6802', 'nonce': 2090404725}, {'type': 'v1', 'addr': '172.21.15.115:6803', 'nonce': 2090404725}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6806', 'nonce': 2090404725}, {'type': 'v1', 'addr': '172.21.15.115:6807', 'nonce': 2090404725}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6804', 'nonce': 2090404725}, {'type': 'v1', 'addr': '172.21.15.115:6805', 'nonce': 2090404725}]}, 'public_addr': '172.21.15.115:6801/2090404725', 'cluster_addr': '172.21.15.115:6803/2090404725', 'heartbeat_back_addr': '172.21.15.115:6807/2090404725', 'heartbeat_front_addr': '172.21.15.115:6805/2090404725', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e4146a73-11ca-4499-afa7-23e23d70a662', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6808', 'nonce': 133828553}, {'type': 'v1', 'addr': '172.21.15.115:6809', 'nonce': 133828553}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6810', 'nonce': 133828553}, {'type': 'v1', 'addr': '172.21.15.115:6811', 'nonce': 133828553}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6814', 'nonce': 133828553}, {'type': 'v1', 'addr': '172.21.15.115:6815', 'nonce': 133828553}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6812', 'nonce': 133828553}, {'type': 'v1', 'addr': '172.21.15.115:6813', 'nonce': 133828553}]}, 'public_addr': '172.21.15.115:6809/133828553', 'cluster_addr': '172.21.15.115:6811/133828553', 'heartbeat_back_addr': '172.21.15.115:6815/133828553', 'heartbeat_front_addr': '172.21.15.115:6813/133828553', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:56.936317+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:56.814583+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:57.168294+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:56.751445+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:57.091268+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:57.113133+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:57.054822+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:57.057214+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-05-08T18:07:43.515 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:07:43.516 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:43.515+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:43.616 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:43.615+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:43.635 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:43.635 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:43.635 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:43.635 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:43.648 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:07:43.716 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:43.715+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:43.763 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:43.763 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:43.764 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:07:43.764 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:07:43.764 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:43.777 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:07:43.823 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:43.825+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:43.857 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:07:43.863 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:07:43.872 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-05-08T18:07:43.669180+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":528,"num_write_kb":1668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221016,"kb_used_data":4832,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753704,"statfs":{"total":773094113280,"available":772867792896,"internally_reserved":0,"allocated":4947968,"data_stored":2835562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.471094"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241745+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:07:40.241745+0000","last_peered":"2024-05-08T18:07:40.241745+0000","last_clean":"2024-05-08T18:07:40.241745+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:07:40.241745+0000","last_undegraded":"2024-05-08T18:07:40.241745+0000","last_fullsized":"2024-05-08T18:07:40.241745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235146+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:07:40.235146+0000","last_peered":"2024-05-08T18:07:40.235146+0000","last_clean":"2024-05-08T18:07:40.235146+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:07:40.235146+0000","last_undegraded":"2024-05-08T18:07:40.235146+0000","last_fullsized":"2024-05-08T18:07:40.235146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224125+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:07:41.224125+0000","last_peered":"2024-05-08T18:07:41.224125+0000","last_clean":"2024-05-08T18:07:41.224125+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:07:41.224125+0000","last_undegraded":"2024-05-08T18:07:41.224125+0000","last_fullsized":"2024-05-08T18:07:41.224125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238246+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:07:40.238246+0000","last_peered":"2024-05-08T18:07:40.238246+0000","last_clean":"2024-05-08T18:07:40.238246+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:07:40.238246+0000","last_undegraded":"2024-05-08T18:07:40.238246+0000","last_fullsized":"2024-05-08T18:07:40.238246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236150+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:07:40.236150+0000","last_peered":"2024-05-08T18:07:40.236150+0000","last_clean":"2024-05-08T18:07:40.236150+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:07:40.236150+0000","last_undegraded":"2024-05-08T18:07:40.236150+0000","last_fullsized":"2024-05-08T18:07:40.236150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219670+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:07:41.219670+0000","last_peered":"2024-05-08T18:07:41.219670+0000","last_clean":"2024-05-08T18:07:41.219670+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:07:41.219670+0000","last_undegraded":"2024-05-08T18:07:41.219670+0000","last_fullsized":"2024-05-08T18:07:41.219670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236858+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:07:40.236858+0000","last_peered":"2024-05-08T18:07:40.236858+0000","last_clean":"2024-05-08T18:07:40.236858+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:07:40.236858+0000","last_undegraded":"2024-05-08T18:07:40.236858+0000","last_fullsized":"2024-05-08T18:07:40.236858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235497+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:07:40.235497+0000","last_peered":"2024-05-08T18:07:40.235497+0000","last_clean":"2024-05-08T18:07:40.235497+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:07:40.235497+0000","last_undegraded":"2024-05-08T18:07:40.235497+0000","last_fullsized":"2024-05-08T18:07:40.235497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238484+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:07:40.238484+0000","last_peered":"2024-05-08T18:07:40.238484+0000","last_clean":"2024-05-08T18:07:40.238484+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:07:40.238484+0000","last_undegraded":"2024-05-08T18:07:40.238484+0000","last_fullsized":"2024-05-08T18:07:40.238484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201643+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:07:40.201643+0000","last_peered":"2024-05-08T18:07:40.201643+0000","last_clean":"2024-05-08T18:07:40.201643+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:07:40.201643+0000","last_undegraded":"2024-05-08T18:07:40.201643+0000","last_fullsized":"2024-05-08T18:07:40.201643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238380+0000","last_change":"2024-05-08T18:07:15.502659+0000","last_active":"2024-05-08T18:07:40.238380+0000","last_peered":"2024-05-08T18:07:40.238380+0000","last_clean":"2024-05-08T18:07:40.238380+0000","last_became_active":"2024-05-08T18:07:15.501947+0000","last_became_peered":"2024-05-08T18:07:15.501947+0000","last_unstale":"2024-05-08T18:07:40.238380+0000","last_undegraded":"2024-05-08T18:07:40.238380+0000","last_fullsized":"2024-05-08T18:07:40.238380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221139+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:07:41.221139+0000","last_peered":"2024-05-08T18:07:41.221139+0000","last_clean":"2024-05-08T18:07:41.221139+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:07:41.221139+0000","last_undegraded":"2024-05-08T18:07:41.221139+0000","last_fullsized":"2024-05-08T18:07:41.221139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238846+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:07:40.238846+0000","last_peered":"2024-05-08T18:07:40.238846+0000","last_clean":"2024-05-08T18:07:40.238846+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:07:40.238846+0000","last_undegraded":"2024-05-08T18:07:40.238846+0000","last_fullsized":"2024-05-08T18:07:40.238846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241317+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:07:40.241317+0000","last_peered":"2024-05-08T18:07:40.241317+0000","last_clean":"2024-05-08T18:07:40.241317+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:07:40.241317+0000","last_undegraded":"2024-05-08T18:07:40.241317+0000","last_fullsized":"2024-05-08T18:07:40.241317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223365+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:07:41.223365+0000","last_peered":"2024-05-08T18:07:41.223365+0000","last_clean":"2024-05-08T18:07:41.223365+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:07:41.223365+0000","last_undegraded":"2024-05-08T18:07:41.223365+0000","last_fullsized":"2024-05-08T18:07:41.223365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.205153+0000","last_change":"2024-05-08T18:07:17.508968+0000","last_active":"2024-05-08T18:07:40.205153+0000","last_peered":"2024-05-08T18:07:40.205153+0000","last_clean":"2024-05-08T18:07:40.205153+0000","last_became_active":"2024-05-08T18:07:17.508588+0000","last_became_peered":"2024-05-08T18:07:17.508588+0000","last_unstale":"2024-05-08T18:07:40.205153+0000","last_undegraded":"2024-05-08T18:07:40.205153+0000","last_fullsized":"2024-05-08T18:07:40.205153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:08.890984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218904+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:07:41.218904+0000","last_peered":"2024-05-08T18:07:41.218904+0000","last_clean":"2024-05-08T18:07:41.218904+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:07:41.218904+0000","last_undegraded":"2024-05-08T18:07:41.218904+0000","last_fullsized":"2024-05-08T18:07:41.218904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241957+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:07:40.241957+0000","last_peered":"2024-05-08T18:07:40.241957+0000","last_clean":"2024-05-08T18:07:40.241957+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:07:40.241957+0000","last_undegraded":"2024-05-08T18:07:40.241957+0000","last_fullsized":"2024-05-08T18:07:40.241957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238489+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:07:40.238489+0000","last_peered":"2024-05-08T18:07:40.238489+0000","last_clean":"2024-05-08T18:07:40.238489+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:07:40.238489+0000","last_undegraded":"2024-05-08T18:07:40.238489+0000","last_fullsized":"2024-05-08T18:07:40.238489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201894+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:07:40.201894+0000","last_peered":"2024-05-08T18:07:40.201894+0000","last_clean":"2024-05-08T18:07:40.201894+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:07:40.201894+0000","last_undegraded":"2024-05-08T18:07:40.201894+0000","last_fullsized":"2024-05-08T18:07:40.201894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238769+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:07:40.238769+0000","last_peered":"2024-05-08T18:07:40.238769+0000","last_clean":"2024-05-08T18:07:40.238769+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:07:40.238769+0000","last_undegraded":"2024-05-08T18:07:40.238769+0000","last_fullsized":"2024-05-08T18:07:40.238769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202086+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:07:40.202086+0000","last_peered":"2024-05-08T18:07:40.202086+0000","last_clean":"2024-05-08T18:07:40.202086+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:07:40.202086+0000","last_undegraded":"2024-05-08T18:07:40.202086+0000","last_fullsized":"2024-05-08T18:07:40.202086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204767+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:07:40.204767+0000","last_peered":"2024-05-08T18:07:40.204767+0000","last_clean":"2024-05-08T18:07:40.204767+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:07:40.204767+0000","last_undegraded":"2024-05-08T18:07:40.204767+0000","last_fullsized":"2024-05-08T18:07:40.204767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219930+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:07:41.219930+0000","last_peered":"2024-05-08T18:07:41.219930+0000","last_clean":"2024-05-08T18:07:41.219930+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:07:41.219930+0000","last_undegraded":"2024-05-08T18:07:41.219930+0000","last_fullsized":"2024-05-08T18:07:41.219930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206077+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:07:40.206077+0000","last_peered":"2024-05-08T18:07:40.206077+0000","last_clean":"2024-05-08T18:07:40.206077+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:07:40.206077+0000","last_undegraded":"2024-05-08T18:07:40.206077+0000","last_fullsized":"2024-05-08T18:07:40.206077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223830+0000","last_change":"2024-05-08T18:07:15.480500+0000","last_active":"2024-05-08T18:07:41.223830+0000","last_peered":"2024-05-08T18:07:41.223830+0000","last_clean":"2024-05-08T18:07:41.223830+0000","last_became_active":"2024-05-08T18:07:15.480192+0000","last_became_peered":"2024-05-08T18:07:15.480192+0000","last_unstale":"2024-05-08T18:07:41.223830+0000","last_undegraded":"2024-05-08T18:07:41.223830+0000","last_fullsized":"2024-05-08T18:07:41.223830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221336+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:07:41.221336+0000","last_peered":"2024-05-08T18:07:41.221336+0000","last_clean":"2024-05-08T18:07:41.221336+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:07:41.221336+0000","last_undegraded":"2024-05-08T18:07:41.221336+0000","last_fullsized":"2024-05-08T18:07:41.221336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236024+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:07:40.236024+0000","last_peered":"2024-05-08T18:07:40.236024+0000","last_clean":"2024-05-08T18:07:40.236024+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:07:40.236024+0000","last_undegraded":"2024-05-08T18:07:40.236024+0000","last_fullsized":"2024-05-08T18:07:40.236024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218463+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:07:41.218463+0000","last_peered":"2024-05-08T18:07:41.218463+0000","last_clean":"2024-05-08T18:07:41.218463+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:07:41.218463+0000","last_undegraded":"2024-05-08T18:07:41.218463+0000","last_fullsized":"2024-05-08T18:07:41.218463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.228275+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:07:41.228275+0000","last_peered":"2024-05-08T18:07:41.228275+0000","last_clean":"2024-05-08T18:07:41.228275+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:07:41.228275+0000","last_undegraded":"2024-05-08T18:07:41.228275+0000","last_fullsized":"2024-05-08T18:07:41.228275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238633+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:07:40.238633+0000","last_peered":"2024-05-08T18:07:40.238633+0000","last_clean":"2024-05-08T18:07:40.238633+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:07:40.238633+0000","last_undegraded":"2024-05-08T18:07:40.238633+0000","last_fullsized":"2024-05-08T18:07:40.238633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239977+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:07:40.239977+0000","last_peered":"2024-05-08T18:07:40.239977+0000","last_clean":"2024-05-08T18:07:40.239977+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:07:40.239977+0000","last_undegraded":"2024-05-08T18:07:40.239977+0000","last_fullsized":"2024-05-08T18:07:40.239977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236168+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:07:40.236168+0000","last_peered":"2024-05-08T18:07:40.236168+0000","last_clean":"2024-05-08T18:07:40.236168+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:07:40.236168+0000","last_undegraded":"2024-05-08T18:07:40.236168+0000","last_fullsized":"2024-05-08T18:07:40.236168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241238+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:07:40.241238+0000","last_peered":"2024-05-08T18:07:40.241238+0000","last_clean":"2024-05-08T18:07:40.241238+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:07:40.241238+0000","last_undegraded":"2024-05-08T18:07:40.241238+0000","last_fullsized":"2024-05-08T18:07:40.241238+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238562+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:07:40.238562+0000","last_peered":"2024-05-08T18:07:40.238562+0000","last_clean":"2024-05-08T18:07:40.238562+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:07:40.238562+0000","last_undegraded":"2024-05-08T18:07:40.238562+0000","last_fullsized":"2024-05-08T18:07:40.238562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240560+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:07:40.240560+0000","last_peered":"2024-05-08T18:07:40.240560+0000","last_clean":"2024-05-08T18:07:40.240560+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:07:40.240560+0000","last_undegraded":"2024-05-08T18:07:40.240560+0000","last_fullsized":"2024-05-08T18:07:40.240560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236106+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:07:40.236106+0000","last_peered":"2024-05-08T18:07:40.236106+0000","last_clean":"2024-05-08T18:07:40.236106+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:07:40.236106+0000","last_undegraded":"2024-05-08T18:07:40.236106+0000","last_fullsized":"2024-05-08T18:07:40.236106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.227952+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:07:41.227952+0000","last_peered":"2024-05-08T18:07:41.227952+0000","last_clean":"2024-05-08T18:07:41.227952+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:07:41.227952+0000","last_undegraded":"2024-05-08T18:07:41.227952+0000","last_fullsized":"2024-05-08T18:07:41.227952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221217+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:07:41.221217+0000","last_peered":"2024-05-08T18:07:41.221217+0000","last_clean":"2024-05-08T18:07:41.221217+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:07:41.221217+0000","last_undegraded":"2024-05-08T18:07:41.221217+0000","last_fullsized":"2024-05-08T18:07:41.221217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221065+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:07:41.221065+0000","last_peered":"2024-05-08T18:07:41.221065+0000","last_clean":"2024-05-08T18:07:41.221065+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:07:41.221065+0000","last_undegraded":"2024-05-08T18:07:41.221065+0000","last_fullsized":"2024-05-08T18:07:41.221065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235765+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:07:40.235765+0000","last_peered":"2024-05-08T18:07:40.235765+0000","last_clean":"2024-05-08T18:07:40.235765+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:07:40.235765+0000","last_undegraded":"2024-05-08T18:07:40.235765+0000","last_fullsized":"2024-05-08T18:07:40.235765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236901+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:07:40.236901+0000","last_peered":"2024-05-08T18:07:40.236901+0000","last_clean":"2024-05-08T18:07:40.236901+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:07:40.236901+0000","last_undegraded":"2024-05-08T18:07:40.236901+0000","last_fullsized":"2024-05-08T18:07:40.236901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239199+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:07:40.239199+0000","last_peered":"2024-05-08T18:07:40.239199+0000","last_clean":"2024-05-08T18:07:40.239199+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:07:40.239199+0000","last_undegraded":"2024-05-08T18:07:40.239199+0000","last_fullsized":"2024-05-08T18:07:40.239199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225439+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:07:41.225439+0000","last_peered":"2024-05-08T18:07:41.225439+0000","last_clean":"2024-05-08T18:07:41.225439+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:07:41.225439+0000","last_undegraded":"2024-05-08T18:07:41.225439+0000","last_fullsized":"2024-05-08T18:07:41.225439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.205615+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:07:40.205615+0000","last_peered":"2024-05-08T18:07:40.205615+0000","last_clean":"2024-05-08T18:07:40.205615+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:07:40.205615+0000","last_undegraded":"2024-05-08T18:07:40.205615+0000","last_fullsized":"2024-05-08T18:07:40.205615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239291+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:07:40.239291+0000","last_peered":"2024-05-08T18:07:40.239291+0000","last_clean":"2024-05-08T18:07:40.239291+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:07:40.239291+0000","last_undegraded":"2024-05-08T18:07:40.239291+0000","last_fullsized":"2024-05-08T18:07:40.239291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218981+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:07:41.218981+0000","last_peered":"2024-05-08T18:07:41.218981+0000","last_clean":"2024-05-08T18:07:41.218981+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:07:41.218981+0000","last_undegraded":"2024-05-08T18:07:41.218981+0000","last_fullsized":"2024-05-08T18:07:41.218981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224996+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:07:41.224996+0000","last_peered":"2024-05-08T18:07:41.224996+0000","last_clean":"2024-05-08T18:07:41.224996+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:07:41.224996+0000","last_undegraded":"2024-05-08T18:07:41.224996+0000","last_fullsized":"2024-05-08T18:07:41.224996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.200795+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:07:40.200795+0000","last_peered":"2024-05-08T18:07:40.200795+0000","last_clean":"2024-05-08T18:07:40.200795+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:07:40.200795+0000","last_undegraded":"2024-05-08T18:07:40.200795+0000","last_fullsized":"2024-05-08T18:07:40.200795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241308+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:07:40.241308+0000","last_peered":"2024-05-08T18:07:40.241308+0000","last_clean":"2024-05-08T18:07:40.241308+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:07:40.241308+0000","last_undegraded":"2024-05-08T18:07:40.241308+0000","last_fullsized":"2024-05-08T18:07:40.241308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240181+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:07:40.240181+0000","last_peered":"2024-05-08T18:07:40.240181+0000","last_clean":"2024-05-08T18:07:40.240181+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:07:40.240181+0000","last_undegraded":"2024-05-08T18:07:40.240181+0000","last_fullsized":"2024-05-08T18:07:40.240181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223675+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:07:41.223675+0000","last_peered":"2024-05-08T18:07:41.223675+0000","last_clean":"2024-05-08T18:07:41.223675+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:07:41.223675+0000","last_undegraded":"2024-05-08T18:07:41.223675+0000","last_fullsized":"2024-05-08T18:07:41.223675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235814+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:07:40.235814+0000","last_peered":"2024-05-08T18:07:40.235814+0000","last_clean":"2024-05-08T18:07:40.235814+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:07:40.235814+0000","last_undegraded":"2024-05-08T18:07:40.235814+0000","last_fullsized":"2024-05-08T18:07:40.235814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.242078+0000","last_change":"2024-05-08T18:07:15.515622+0000","last_active":"2024-05-08T18:07:40.242078+0000","last_peered":"2024-05-08T18:07:40.242078+0000","last_clean":"2024-05-08T18:07:40.242078+0000","last_became_active":"2024-05-08T18:07:15.515050+0000","last_became_peered":"2024-05-08T18:07:15.515050+0000","last_unstale":"2024-05-08T18:07:40.242078+0000","last_undegraded":"2024-05-08T18:07:40.242078+0000","last_fullsized":"2024-05-08T18:07:40.242078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237648+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:07:40.237648+0000","last_peered":"2024-05-08T18:07:40.237648+0000","last_clean":"2024-05-08T18:07:40.237648+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:07:40.237648+0000","last_undegraded":"2024-05-08T18:07:40.237648+0000","last_fullsized":"2024-05-08T18:07:40.237648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":63,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235270+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:07:40.235270+0000","last_peered":"2024-05-08T18:07:40.235270+0000","last_clean":"2024-05-08T18:07:40.235270+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:07:40.235270+0000","last_undegraded":"2024-05-08T18:07:40.235270+0000","last_fullsized":"2024-05-08T18:07:40.235270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224035+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:07:41.224035+0000","last_peered":"2024-05-08T18:07:41.224035+0000","last_clean":"2024-05-08T18:07:41.224035+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:07:41.224035+0000","last_undegraded":"2024-05-08T18:07:41.224035+0000","last_fullsized":"2024-05-08T18:07:41.224035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236214+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:07:40.236214+0000","last_peered":"2024-05-08T18:07:40.236214+0000","last_clean":"2024-05-08T18:07:40.236214+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:07:40.236214+0000","last_undegraded":"2024-05-08T18:07:40.236214+0000","last_fullsized":"2024-05-08T18:07:40.236214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218965+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:07:41.218965+0000","last_peered":"2024-05-08T18:07:41.218965+0000","last_clean":"2024-05-08T18:07:41.218965+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:07:41.218965+0000","last_undegraded":"2024-05-08T18:07:41.218965+0000","last_fullsized":"2024-05-08T18:07:41.218965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241551+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:07:40.241551+0000","last_peered":"2024-05-08T18:07:40.241551+0000","last_clean":"2024-05-08T18:07:40.241551+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:07:40.241551+0000","last_undegraded":"2024-05-08T18:07:40.241551+0000","last_fullsized":"2024-05-08T18:07:40.241551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204671+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:07:40.204671+0000","last_peered":"2024-05-08T18:07:40.204671+0000","last_clean":"2024-05-08T18:07:40.204671+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:07:40.204671+0000","last_undegraded":"2024-05-08T18:07:40.204671+0000","last_fullsized":"2024-05-08T18:07:40.204671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224224+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:07:41.224224+0000","last_peered":"2024-05-08T18:07:41.224224+0000","last_clean":"2024-05-08T18:07:41.224224+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:07:41.224224+0000","last_undegraded":"2024-05-08T18:07:41.224224+0000","last_fullsized":"2024-05-08T18:07:41.224224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222963+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:07:41.222963+0000","last_peered":"2024-05-08T18:07:41.222963+0000","last_clean":"2024-05-08T18:07:41.222963+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:07:41.222963+0000","last_undegraded":"2024-05-08T18:07:41.222963+0000","last_fullsized":"2024-05-08T18:07:41.222963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201029+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:07:40.201029+0000","last_peered":"2024-05-08T18:07:40.201029+0000","last_clean":"2024-05-08T18:07:40.201029+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:07:40.201029+0000","last_undegraded":"2024-05-08T18:07:40.201029+0000","last_fullsized":"2024-05-08T18:07:40.201029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201874+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:07:40.201874+0000","last_peered":"2024-05-08T18:07:40.201874+0000","last_clean":"2024-05-08T18:07:40.201874+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:07:40.201874+0000","last_undegraded":"2024-05-08T18:07:40.201874+0000","last_fullsized":"2024-05-08T18:07:40.201874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240446+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:07:40.240446+0000","last_peered":"2024-05-08T18:07:40.240446+0000","last_clean":"2024-05-08T18:07:40.240446+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:07:40.240446+0000","last_undegraded":"2024-05-08T18:07:40.240446+0000","last_fullsized":"2024-05-08T18:07:40.240446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204923+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:07:40.204923+0000","last_peered":"2024-05-08T18:07:40.204923+0000","last_clean":"2024-05-08T18:07:40.204923+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:07:40.204923+0000","last_undegraded":"2024-05-08T18:07:40.204923+0000","last_fullsized":"2024-05-08T18:07:40.204923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236245+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:07:40.236245+0000","last_peered":"2024-05-08T18:07:40.236245+0000","last_clean":"2024-05-08T18:07:40.236245+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:07:40.236245+0000","last_undegraded":"2024-05-08T18:07:40.236245+0000","last_fullsized":"2024-05-08T18:07:40.236245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235169+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:07:40.235169+0000","last_peered":"2024-05-08T18:07:40.235169+0000","last_clean":"2024-05-08T18:07:40.235169+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:07:40.235169+0000","last_undegraded":"2024-05-08T18:07:40.235169+0000","last_fullsized":"2024-05-08T18:07:40.235169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236219+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:07:40.236219+0000","last_peered":"2024-05-08T18:07:40.236219+0000","last_clean":"2024-05-08T18:07:40.236219+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:07:40.236219+0000","last_undegraded":"2024-05-08T18:07:40.236219+0000","last_fullsized":"2024-05-08T18:07:40.236219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235885+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:07:40.235885+0000","last_peered":"2024-05-08T18:07:40.235885+0000","last_clean":"2024-05-08T18:07:40.235885+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:07:40.235885+0000","last_undegraded":"2024-05-08T18:07:40.235885+0000","last_fullsized":"2024-05-08T18:07:40.235885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237462+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:07:40.237462+0000","last_peered":"2024-05-08T18:07:40.237462+0000","last_clean":"2024-05-08T18:07:40.237462+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:07:40.237462+0000","last_undegraded":"2024-05-08T18:07:40.237462+0000","last_fullsized":"2024-05-08T18:07:40.237462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204614+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:07:40.204614+0000","last_peered":"2024-05-08T18:07:40.204614+0000","last_clean":"2024-05-08T18:07:40.204614+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:07:40.204614+0000","last_undegraded":"2024-05-08T18:07:40.204614+0000","last_fullsized":"2024-05-08T18:07:40.204614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235490+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:07:40.235490+0000","last_peered":"2024-05-08T18:07:40.235490+0000","last_clean":"2024-05-08T18:07:40.235490+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:07:40.235490+0000","last_undegraded":"2024-05-08T18:07:40.235490+0000","last_fullsized":"2024-05-08T18:07:40.235490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204419+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:07:40.204419+0000","last_peered":"2024-05-08T18:07:40.204419+0000","last_clean":"2024-05-08T18:07:40.204419+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:07:40.204419+0000","last_undegraded":"2024-05-08T18:07:40.204419+0000","last_fullsized":"2024-05-08T18:07:40.204419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224407+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:07:41.224407+0000","last_peered":"2024-05-08T18:07:41.224407+0000","last_clean":"2024-05-08T18:07:41.224407+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:07:41.224407+0000","last_undegraded":"2024-05-08T18:07:41.224407+0000","last_fullsized":"2024-05-08T18:07:41.224407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220409+0000","last_change":"2024-05-08T18:07:17.495459+0000","last_active":"2024-05-08T18:07:41.220409+0000","last_peered":"2024-05-08T18:07:41.220409+0000","last_clean":"2024-05-08T18:07:41.220409+0000","last_became_active":"2024-05-08T18:07:17.494659+0000","last_became_peered":"2024-05-08T18:07:17.494659+0000","last_unstale":"2024-05-08T18:07:41.220409+0000","last_undegraded":"2024-05-08T18:07:41.220409+0000","last_fullsized":"2024-05-08T18:07:41.220409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223329+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:07:41.223329+0000","last_peered":"2024-05-08T18:07:41.223329+0000","last_clean":"2024-05-08T18:07:41.223329+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:07:41.223329+0000","last_undegraded":"2024-05-08T18:07:41.223329+0000","last_fullsized":"2024-05-08T18:07:41.223329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206221+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:07:40.206221+0000","last_peered":"2024-05-08T18:07:40.206221+0000","last_clean":"2024-05-08T18:07:40.206221+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:07:40.206221+0000","last_undegraded":"2024-05-08T18:07:40.206221+0000","last_fullsized":"2024-05-08T18:07:40.206221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221218+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:07:41.221218+0000","last_peered":"2024-05-08T18:07:41.221218+0000","last_clean":"2024-05-08T18:07:41.221218+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:07:41.221218+0000","last_undegraded":"2024-05-08T18:07:41.221218+0000","last_fullsized":"2024-05-08T18:07:41.221218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236262+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:07:40.236262+0000","last_peered":"2024-05-08T18:07:40.236262+0000","last_clean":"2024-05-08T18:07:40.236262+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:07:40.236262+0000","last_undegraded":"2024-05-08T18:07:40.236262+0000","last_fullsized":"2024-05-08T18:07:40.236262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222041+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:07:41.222041+0000","last_peered":"2024-05-08T18:07:41.222041+0000","last_clean":"2024-05-08T18:07:41.222041+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:07:41.222041+0000","last_undegraded":"2024-05-08T18:07:41.222041+0000","last_fullsized":"2024-05-08T18:07:41.222041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221320+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:07:41.221320+0000","last_peered":"2024-05-08T18:07:41.221320+0000","last_clean":"2024-05-08T18:07:41.221320+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:07:41.221320+0000","last_undegraded":"2024-05-08T18:07:41.221320+0000","last_fullsized":"2024-05-08T18:07:41.221320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202382+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:07:40.202382+0000","last_peered":"2024-05-08T18:07:40.202382+0000","last_clean":"2024-05-08T18:07:40.202382+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:07:40.202382+0000","last_undegraded":"2024-05-08T18:07:40.202382+0000","last_fullsized":"2024-05-08T18:07:40.202382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224189+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:07:41.224189+0000","last_peered":"2024-05-08T18:07:41.224189+0000","last_clean":"2024-05-08T18:07:41.224189+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:07:41.224189+0000","last_undegraded":"2024-05-08T18:07:41.224189+0000","last_fullsized":"2024-05-08T18:07:41.224189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.205114+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:07:40.205114+0000","last_peered":"2024-05-08T18:07:40.205114+0000","last_clean":"2024-05-08T18:07:40.205114+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:07:40.205114+0000","last_undegraded":"2024-05-08T18:07:40.205114+0000","last_fullsized":"2024-05-08T18:07:40.205114+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206369+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:07:40.206369+0000","last_peered":"2024-05-08T18:07:40.206369+0000","last_clean":"2024-05-08T18:07:40.206369+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:07:40.206369+0000","last_undegraded":"2024-05-08T18:07:40.206369+0000","last_fullsized":"2024-05-08T18:07:40.206369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222447+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:07:41.222447+0000","last_peered":"2024-05-08T18:07:41.222447+0000","last_clean":"2024-05-08T18:07:41.222447+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:07:41.222447+0000","last_undegraded":"2024-05-08T18:07:41.222447+0000","last_fullsized":"2024-05-08T18:07:41.222447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221664+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:07:41.221664+0000","last_peered":"2024-05-08T18:07:41.221664+0000","last_clean":"2024-05-08T18:07:41.221664+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:07:41.221664+0000","last_undegraded":"2024-05-08T18:07:41.221664+0000","last_fullsized":"2024-05-08T18:07:41.221664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219629+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:07:41.219629+0000","last_peered":"2024-05-08T18:07:41.219629+0000","last_clean":"2024-05-08T18:07:41.219629+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:07:41.219629+0000","last_undegraded":"2024-05-08T18:07:41.219629+0000","last_fullsized":"2024-05-08T18:07:41.219629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240482+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:07:40.240482+0000","last_peered":"2024-05-08T18:07:40.240482+0000","last_clean":"2024-05-08T18:07:40.240482+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:07:40.240482+0000","last_undegraded":"2024-05-08T18:07:40.240482+0000","last_fullsized":"2024-05-08T18:07:40.240482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223976+0000","last_change":"2024-05-08T18:07:21.533056+0000","last_active":"2024-05-08T18:07:41.223976+0000","last_peered":"2024-05-08T18:07:41.223976+0000","last_clean":"2024-05-08T18:07:41.223976+0000","last_became_active":"2024-05-08T18:07:21.532184+0000","last_became_peered":"2024-05-08T18:07:21.532184+0000","last_unstale":"2024-05-08T18:07:41.223976+0000","last_undegraded":"2024-05-08T18:07:41.223976+0000","last_fullsized":"2024-05-08T18:07:41.223976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:50.629014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201470+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:07:40.201470+0000","last_peered":"2024-05-08T18:07:40.201470+0000","last_clean":"2024-05-08T18:07:40.201470+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:07:40.201470+0000","last_undegraded":"2024-05-08T18:07:40.201470+0000","last_fullsized":"2024-05-08T18:07:40.201470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219407+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:07:41.219407+0000","last_peered":"2024-05-08T18:07:41.219407+0000","last_clean":"2024-05-08T18:07:41.219407+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:07:41.219407+0000","last_undegraded":"2024-05-08T18:07:41.219407+0000","last_fullsized":"2024-05-08T18:07:41.219407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225198+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:07:41.225198+0000","last_peered":"2024-05-08T18:07:41.225198+0000","last_clean":"2024-05-08T18:07:41.225198+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:07:41.225198+0000","last_undegraded":"2024-05-08T18:07:41.225198+0000","last_fullsized":"2024-05-08T18:07:41.225198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223858+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:07:41.223858+0000","last_peered":"2024-05-08T18:07:41.223858+0000","last_clean":"2024-05-08T18:07:41.223858+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:07:41.223858+0000","last_undegraded":"2024-05-08T18:07:41.223858+0000","last_fullsized":"2024-05-08T18:07:41.223858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221524+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:07:41.221524+0000","last_peered":"2024-05-08T18:07:41.221524+0000","last_clean":"2024-05-08T18:07:41.221524+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:07:41.221524+0000","last_undegraded":"2024-05-08T18:07:41.221524+0000","last_fullsized":"2024-05-08T18:07:41.221524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236236+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:07:40.236236+0000","last_peered":"2024-05-08T18:07:40.236236+0000","last_clean":"2024-05-08T18:07:40.236236+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:07:40.236236+0000","last_undegraded":"2024-05-08T18:07:40.236236+0000","last_fullsized":"2024-05-08T18:07:40.236236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201182+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:07:40.201182+0000","last_peered":"2024-05-08T18:07:40.201182+0000","last_clean":"2024-05-08T18:07:40.201182+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:07:40.201182+0000","last_undegraded":"2024-05-08T18:07:40.201182+0000","last_fullsized":"2024-05-08T18:07:40.201182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223902+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:07:41.223902+0000","last_peered":"2024-05-08T18:07:41.223902+0000","last_clean":"2024-05-08T18:07:41.223902+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:07:41.223902+0000","last_undegraded":"2024-05-08T18:07:41.223902+0000","last_fullsized":"2024-05-08T18:07:41.223902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201817+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:07:40.201817+0000","last_peered":"2024-05-08T18:07:40.201817+0000","last_clean":"2024-05-08T18:07:40.201817+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:07:40.201817+0000","last_undegraded":"2024-05-08T18:07:40.201817+0000","last_fullsized":"2024-05-08T18:07:40.201817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":146,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236507+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:07:40.236507+0000","last_peered":"2024-05-08T18:07:40.236507+0000","last_clean":"2024-05-08T18:07:40.236507+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:07:40.236507+0000","last_undegraded":"2024-05-08T18:07:40.236507+0000","last_fullsized":"2024-05-08T18:07:40.236507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237052+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:07:40.237052+0000","last_peered":"2024-05-08T18:07:40.237052+0000","last_clean":"2024-05-08T18:07:40.237052+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:07:40.237052+0000","last_undegraded":"2024-05-08T18:07:40.237052+0000","last_fullsized":"2024-05-08T18:07:40.237052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223191+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:07:41.223191+0000","last_peered":"2024-05-08T18:07:41.223191+0000","last_clean":"2024-05-08T18:07:41.223191+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:07:41.223191+0000","last_undegraded":"2024-05-08T18:07:41.223191+0000","last_fullsized":"2024-05-08T18:07:41.223191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239412+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:07:40.239412+0000","last_peered":"2024-05-08T18:07:40.239412+0000","last_clean":"2024-05-08T18:07:40.239412+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:07:40.239412+0000","last_undegraded":"2024-05-08T18:07:40.239412+0000","last_fullsized":"2024-05-08T18:07:40.239412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":59,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240778+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:07:40.240778+0000","last_peered":"2024-05-08T18:07:40.240778+0000","last_clean":"2024-05-08T18:07:40.240778+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:07:40.240778+0000","last_undegraded":"2024-05-08T18:07:40.240778+0000","last_fullsized":"2024-05-08T18:07:40.240778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236351+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:07:40.236351+0000","last_peered":"2024-05-08T18:07:40.236351+0000","last_clean":"2024-05-08T18:07:40.236351+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:07:40.236351+0000","last_undegraded":"2024-05-08T18:07:40.236351+0000","last_fullsized":"2024-05-08T18:07:40.236351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.200434+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:07:40.200434+0000","last_peered":"2024-05-08T18:07:40.200434+0000","last_clean":"2024-05-08T18:07:40.200434+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:07:40.200434+0000","last_undegraded":"2024-05-08T18:07:40.200434+0000","last_fullsized":"2024-05-08T18:07:40.200434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236745+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:07:40.236745+0000","last_peered":"2024-05-08T18:07:40.236745+0000","last_clean":"2024-05-08T18:07:40.236745+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:07:40.236745+0000","last_undegraded":"2024-05-08T18:07:40.236745+0000","last_fullsized":"2024-05-08T18:07:40.236745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236011+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:07:40.236011+0000","last_peered":"2024-05-08T18:07:40.236011+0000","last_clean":"2024-05-08T18:07:40.236011+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:07:40.236011+0000","last_undegraded":"2024-05-08T18:07:40.236011+0000","last_fullsized":"2024-05-08T18:07:40.236011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235618+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:07:40.235618+0000","last_peered":"2024-05-08T18:07:40.235618+0000","last_clean":"2024-05-08T18:07:40.235618+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:07:40.235618+0000","last_undegraded":"2024-05-08T18:07:40.235618+0000","last_fullsized":"2024-05-08T18:07:40.235618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241306+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:07:40.241306+0000","last_peered":"2024-05-08T18:07:40.241306+0000","last_clean":"2024-05-08T18:07:40.241306+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:07:40.241306+0000","last_undegraded":"2024-05-08T18:07:40.241306+0000","last_fullsized":"2024-05-08T18:07:40.241306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":79,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224002+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:07:41.224002+0000","last_peered":"2024-05-08T18:07:41.224002+0000","last_clean":"2024-05-08T18:07:41.224002+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:07:41.224002+0000","last_undegraded":"2024-05-08T18:07:41.224002+0000","last_fullsized":"2024-05-08T18:07:41.224002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239274+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:07:40.239274+0000","last_peered":"2024-05-08T18:07:40.239274+0000","last_clean":"2024-05-08T18:07:40.239274+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:07:40.239274+0000","last_undegraded":"2024-05-08T18:07:40.239274+0000","last_fullsized":"2024-05-08T18:07:40.239274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222008+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:07:41.222008+0000","last_peered":"2024-05-08T18:07:41.222008+0000","last_clean":"2024-05-08T18:07:41.222008+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:07:41.222008+0000","last_undegraded":"2024-05-08T18:07:41.222008+0000","last_fullsized":"2024-05-08T18:07:41.222008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225435+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:07:41.225435+0000","last_peered":"2024-05-08T18:07:41.225435+0000","last_clean":"2024-05-08T18:07:41.225435+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:07:41.225435+0000","last_undegraded":"2024-05-08T18:07:41.225435+0000","last_fullsized":"2024-05-08T18:07:41.225435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.205230+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:07:40.205230+0000","last_peered":"2024-05-08T18:07:40.205230+0000","last_clean":"2024-05-08T18:07:40.205230+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:07:40.205230+0000","last_undegraded":"2024-05-08T18:07:40.205230+0000","last_fullsized":"2024-05-08T18:07:40.205230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221775+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:07:41.221775+0000","last_peered":"2024-05-08T18:07:41.221775+0000","last_clean":"2024-05-08T18:07:41.221775+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:07:41.221775+0000","last_undegraded":"2024-05-08T18:07:41.221775+0000","last_fullsized":"2024-05-08T18:07:41.221775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206526+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:07:40.206526+0000","last_peered":"2024-05-08T18:07:40.206526+0000","last_clean":"2024-05-08T18:07:40.206526+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:07:40.206526+0000","last_undegraded":"2024-05-08T18:07:40.206526+0000","last_fullsized":"2024-05-08T18:07:40.206526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239831+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:07:40.239831+0000","last_peered":"2024-05-08T18:07:40.239831+0000","last_clean":"2024-05-08T18:07:40.239831+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:07:40.239831+0000","last_undegraded":"2024-05-08T18:07:40.239831+0000","last_fullsized":"2024-05-08T18:07:40.239831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235840+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:07:40.235840+0000","last_peered":"2024-05-08T18:07:40.235840+0000","last_clean":"2024-05-08T18:07:40.235840+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:07:40.235840+0000","last_undegraded":"2024-05-08T18:07:40.235840+0000","last_fullsized":"2024-05-08T18:07:40.235840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224009+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:07:41.224009+0000","last_peered":"2024-05-08T18:07:41.224009+0000","last_clean":"2024-05-08T18:07:41.224009+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:07:41.224009+0000","last_undegraded":"2024-05-08T18:07:41.224009+0000","last_fullsized":"2024-05-08T18:07:41.224009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224553+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:07:41.224553+0000","last_peered":"2024-05-08T18:07:41.224553+0000","last_clean":"2024-05-08T18:07:41.224553+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:07:41.224553+0000","last_undegraded":"2024-05-08T18:07:41.224553+0000","last_fullsized":"2024-05-08T18:07:41.224553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239448+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:07:40.239448+0000","last_peered":"2024-05-08T18:07:40.239448+0000","last_clean":"2024-05-08T18:07:40.239448+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:07:40.239448+0000","last_undegraded":"2024-05-08T18:07:40.239448+0000","last_fullsized":"2024-05-08T18:07:40.239448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219896+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:07:41.219896+0000","last_peered":"2024-05-08T18:07:41.219896+0000","last_clean":"2024-05-08T18:07:41.219896+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:07:41.219896+0000","last_undegraded":"2024-05-08T18:07:41.219896+0000","last_fullsized":"2024-05-08T18:07:41.219896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235651+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:07:40.235651+0000","last_peered":"2024-05-08T18:07:40.235651+0000","last_clean":"2024-05-08T18:07:40.235651+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:07:40.235651+0000","last_undegraded":"2024-05-08T18:07:40.235651+0000","last_fullsized":"2024-05-08T18:07:40.235651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223707+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:07:41.223707+0000","last_peered":"2024-05-08T18:07:41.223707+0000","last_clean":"2024-05-08T18:07:41.223707+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:07:41.223707+0000","last_undegraded":"2024-05-08T18:07:41.223707+0000","last_fullsized":"2024-05-08T18:07:41.223707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201807+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:07:40.201807+0000","last_peered":"2024-05-08T18:07:40.201807+0000","last_clean":"2024-05-08T18:07:40.201807+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:07:40.201807+0000","last_undegraded":"2024-05-08T18:07:40.201807+0000","last_fullsized":"2024-05-08T18:07:40.201807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.234834+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:07:40.234834+0000","last_peered":"2024-05-08T18:07:40.234834+0000","last_clean":"2024-05-08T18:07:40.234834+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:07:40.234834+0000","last_undegraded":"2024-05-08T18:07:40.234834+0000","last_fullsized":"2024-05-08T18:07:40.234834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222477+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:07:41.222477+0000","last_peered":"2024-05-08T18:07:41.222477+0000","last_clean":"2024-05-08T18:07:41.222477+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:07:41.222477+0000","last_undegraded":"2024-05-08T18:07:41.222477+0000","last_fullsized":"2024-05-08T18:07:41.222477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241024+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:07:40.241024+0000","last_peered":"2024-05-08T18:07:40.241024+0000","last_clean":"2024-05-08T18:07:40.241024+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:07:40.241024+0000","last_undegraded":"2024-05-08T18:07:40.241024+0000","last_fullsized":"2024-05-08T18:07:40.241024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225142+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:07:41.225142+0000","last_peered":"2024-05-08T18:07:41.225142+0000","last_clean":"2024-05-08T18:07:41.225142+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:07:41.225142+0000","last_undegraded":"2024-05-08T18:07:41.225142+0000","last_fullsized":"2024-05-08T18:07:41.225142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235567+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:07:40.235567+0000","last_peered":"2024-05-08T18:07:40.235567+0000","last_clean":"2024-05-08T18:07:40.235567+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:07:40.235567+0000","last_undegraded":"2024-05-08T18:07:40.235567+0000","last_fullsized":"2024-05-08T18:07:40.235567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":64,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.234863+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:07:40.234863+0000","last_peered":"2024-05-08T18:07:40.234863+0000","last_clean":"2024-05-08T18:07:40.234863+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:07:40.234863+0000","last_undegraded":"2024-05-08T18:07:40.234863+0000","last_fullsized":"2024-05-08T18:07:40.234863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218652+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:07:41.218652+0000","last_peered":"2024-05-08T18:07:41.218652+0000","last_clean":"2024-05-08T18:07:41.218652+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:07:41.218652+0000","last_undegraded":"2024-05-08T18:07:41.218652+0000","last_fullsized":"2024-05-08T18:07:41.218652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235095+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:07:40.235095+0000","last_peered":"2024-05-08T18:07:40.235095+0000","last_clean":"2024-05-08T18:07:40.235095+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:07:40.235095+0000","last_undegraded":"2024-05-08T18:07:40.235095+0000","last_fullsized":"2024-05-08T18:07:40.235095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235820+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:07:40.235820+0000","last_peered":"2024-05-08T18:07:40.235820+0000","last_clean":"2024-05-08T18:07:40.235820+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:07:40.235820+0000","last_undegraded":"2024-05-08T18:07:40.235820+0000","last_fullsized":"2024-05-08T18:07:40.235820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224781+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:07:41.224781+0000","last_peered":"2024-05-08T18:07:41.224781+0000","last_clean":"2024-05-08T18:07:41.224781+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:07:41.224781+0000","last_undegraded":"2024-05-08T18:07:41.224781+0000","last_fullsized":"2024-05-08T18:07:41.224781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240728+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:07:40.240728+0000","last_peered":"2024-05-08T18:07:40.240728+0000","last_clean":"2024-05-08T18:07:40.240728+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:07:40.240728+0000","last_undegraded":"2024-05-08T18:07:40.240728+0000","last_fullsized":"2024-05-08T18:07:40.240728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201271+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:07:40.201271+0000","last_peered":"2024-05-08T18:07:40.201271+0000","last_clean":"2024-05-08T18:07:40.201271+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:07:40.201271+0000","last_undegraded":"2024-05-08T18:07:40.201271+0000","last_fullsized":"2024-05-08T18:07:40.201271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221595+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:07:41.221595+0000","last_peered":"2024-05-08T18:07:41.221595+0000","last_clean":"2024-05-08T18:07:41.221595+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:07:41.221595+0000","last_undegraded":"2024-05-08T18:07:41.221595+0000","last_fullsized":"2024-05-08T18:07:41.221595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235412+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:07:40.235412+0000","last_peered":"2024-05-08T18:07:40.235412+0000","last_clean":"2024-05-08T18:07:40.235412+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:07:40.235412+0000","last_undegraded":"2024-05-08T18:07:40.235412+0000","last_fullsized":"2024-05-08T18:07:40.235412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225215+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:07:41.225215+0000","last_peered":"2024-05-08T18:07:41.225215+0000","last_clean":"2024-05-08T18:07:41.225215+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:07:41.225215+0000","last_undegraded":"2024-05-08T18:07:41.225215+0000","last_fullsized":"2024-05-08T18:07:41.225215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222725+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:07:41.222725+0000","last_peered":"2024-05-08T18:07:41.222725+0000","last_clean":"2024-05-08T18:07:41.222725+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:07:41.222725+0000","last_undegraded":"2024-05-08T18:07:41.222725+0000","last_fullsized":"2024-05-08T18:07:41.222725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224757+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:07:41.224757+0000","last_peered":"2024-05-08T18:07:41.224757+0000","last_clean":"2024-05-08T18:07:41.224757+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:07:41.224757+0000","last_undegraded":"2024-05-08T18:07:41.224757+0000","last_fullsized":"2024-05-08T18:07:41.224757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224259+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:07:41.224259+0000","last_peered":"2024-05-08T18:07:41.224259+0000","last_clean":"2024-05-08T18:07:41.224259+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:07:41.224259+0000","last_undegraded":"2024-05-08T18:07:41.224259+0000","last_fullsized":"2024-05-08T18:07:41.224259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218898+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:07:41.218898+0000","last_peered":"2024-05-08T18:07:41.218898+0000","last_clean":"2024-05-08T18:07:41.218898+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:07:41.218898+0000","last_undegraded":"2024-05-08T18:07:41.218898+0000","last_fullsized":"2024-05-08T18:07:41.218898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219913+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:07:41.219913+0000","last_peered":"2024-05-08T18:07:41.219913+0000","last_clean":"2024-05-08T18:07:41.219913+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:07:41.219913+0000","last_undegraded":"2024-05-08T18:07:41.219913+0000","last_fullsized":"2024-05-08T18:07:41.219913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.228624+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:07:41.228624+0000","last_peered":"2024-05-08T18:07:41.228624+0000","last_clean":"2024-05-08T18:07:41.228624+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:07:41.228624+0000","last_undegraded":"2024-05-08T18:07:41.228624+0000","last_fullsized":"2024-05-08T18:07:41.228624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235991+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:07:40.235991+0000","last_peered":"2024-05-08T18:07:40.235991+0000","last_clean":"2024-05-08T18:07:40.235991+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:07:40.235991+0000","last_undegraded":"2024-05-08T18:07:40.235991+0000","last_fullsized":"2024-05-08T18:07:40.235991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219127+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:07:41.219127+0000","last_peered":"2024-05-08T18:07:41.219127+0000","last_clean":"2024-05-08T18:07:41.219127+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:07:41.219127+0000","last_undegraded":"2024-05-08T18:07:41.219127+0000","last_fullsized":"2024-05-08T18:07:41.219127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236997+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:07:40.236997+0000","last_peered":"2024-05-08T18:07:40.236997+0000","last_clean":"2024-05-08T18:07:40.236997+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:07:40.236997+0000","last_undegraded":"2024-05-08T18:07:40.236997+0000","last_fullsized":"2024-05-08T18:07:40.236997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202498+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:07:40.202498+0000","last_peered":"2024-05-08T18:07:40.202498+0000","last_clean":"2024-05-08T18:07:40.202498+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:07:40.202498+0000","last_undegraded":"2024-05-08T18:07:40.202498+0000","last_fullsized":"2024-05-08T18:07:40.202498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222322+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:07:41.222322+0000","last_peered":"2024-05-08T18:07:41.222322+0000","last_clean":"2024-05-08T18:07:41.222322+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:07:41.222322+0000","last_undegraded":"2024-05-08T18:07:41.222322+0000","last_fullsized":"2024-05-08T18:07:41.222322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":68,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237627+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:07:40.237627+0000","last_peered":"2024-05-08T18:07:40.237627+0000","last_clean":"2024-05-08T18:07:40.237627+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:07:40.237627+0000","last_undegraded":"2024-05-08T18:07:40.237627+0000","last_fullsized":"2024-05-08T18:07:40.237627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222959+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:07:41.222959+0000","last_peered":"2024-05-08T18:07:41.222959+0000","last_clean":"2024-05-08T18:07:41.222959+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:07:41.222959+0000","last_undegraded":"2024-05-08T18:07:41.222959+0000","last_fullsized":"2024-05-08T18:07:41.222959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235949+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:07:40.235949+0000","last_peered":"2024-05-08T18:07:40.235949+0000","last_clean":"2024-05-08T18:07:40.235949+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:07:40.235949+0000","last_undegraded":"2024-05-08T18:07:40.235949+0000","last_fullsized":"2024-05-08T18:07:40.235949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236152+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:07:40.236152+0000","last_peered":"2024-05-08T18:07:40.236152+0000","last_clean":"2024-05-08T18:07:40.236152+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:07:40.236152+0000","last_undegraded":"2024-05-08T18:07:40.236152+0000","last_fullsized":"2024-05-08T18:07:40.236152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219514+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:07:41.219514+0000","last_peered":"2024-05-08T18:07:41.219514+0000","last_clean":"2024-05-08T18:07:41.219514+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:07:41.219514+0000","last_undegraded":"2024-05-08T18:07:41.219514+0000","last_fullsized":"2024-05-08T18:07:41.219514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219801+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:07:41.219801+0000","last_peered":"2024-05-08T18:07:41.219801+0000","last_clean":"2024-05-08T18:07:41.219801+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:07:41.219801+0000","last_undegraded":"2024-05-08T18:07:41.219801+0000","last_fullsized":"2024-05-08T18:07:41.219801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222599+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:07:41.222599+0000","last_peered":"2024-05-08T18:07:41.222599+0000","last_clean":"2024-05-08T18:07:41.222599+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:07:41.222599+0000","last_undegraded":"2024-05-08T18:07:41.222599+0000","last_fullsized":"2024-05-08T18:07:41.222599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222254+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:07:41.222254+0000","last_peered":"2024-05-08T18:07:41.222254+0000","last_clean":"2024-05-08T18:07:41.222254+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:07:41.222254+0000","last_undegraded":"2024-05-08T18:07:41.222254+0000","last_fullsized":"2024-05-08T18:07:41.222254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222137+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:07:41.222137+0000","last_peered":"2024-05-08T18:07:41.222137+0000","last_clean":"2024-05-08T18:07:41.222137+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:07:41.222137+0000","last_undegraded":"2024-05-08T18:07:41.222137+0000","last_fullsized":"2024-05-08T18:07:41.222137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223441+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:07:41.223441+0000","last_peered":"2024-05-08T18:07:41.223441+0000","last_clean":"2024-05-08T18:07:41.223441+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:07:41.223441+0000","last_undegraded":"2024-05-08T18:07:41.223441+0000","last_fullsized":"2024-05-08T18:07:41.223441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222358+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:07:41.222358+0000","last_peered":"2024-05-08T18:07:41.222358+0000","last_clean":"2024-05-08T18:07:41.222358+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:07:41.222358+0000","last_undegraded":"2024-05-08T18:07:41.222358+0000","last_fullsized":"2024-05-08T18:07:41.222358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240367+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:07:40.240367+0000","last_peered":"2024-05-08T18:07:40.240367+0000","last_clean":"2024-05-08T18:07:40.240367+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:07:40.240367+0000","last_undegraded":"2024-05-08T18:07:40.240367+0000","last_fullsized":"2024-05-08T18:07:40.240367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223930+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:07:41.223930+0000","last_peered":"2024-05-08T18:07:41.223930+0000","last_clean":"2024-05-08T18:07:41.223930+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:07:41.223930+0000","last_undegraded":"2024-05-08T18:07:41.223930+0000","last_fullsized":"2024-05-08T18:07:41.223930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'4","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235006+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:07:40.235006+0000","last_peered":"2024-05-08T18:07:40.235006+0000","last_clean":"2024-05-08T18:07:40.235006+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:07:40.235006+0000","last_undegraded":"2024-05-08T18:07:40.235006+0000","last_fullsized":"2024-05-08T18:07:40.235006+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238013+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:07:40.238013+0000","last_peered":"2024-05-08T18:07:40.238013+0000","last_clean":"2024-05-08T18:07:40.238013+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:07:40.238013+0000","last_undegraded":"2024-05-08T18:07:40.238013+0000","last_fullsized":"2024-05-08T18:07:40.238013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235561+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:07:40.235561+0000","last_peered":"2024-05-08T18:07:40.235561+0000","last_clean":"2024-05-08T18:07:40.235561+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:07:40.235561+0000","last_undegraded":"2024-05-08T18:07:40.235561+0000","last_fullsized":"2024-05-08T18:07:40.235561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222630+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:07:41.222630+0000","last_peered":"2024-05-08T18:07:41.222630+0000","last_clean":"2024-05-08T18:07:41.222630+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:07:41.222630+0000","last_undegraded":"2024-05-08T18:07:41.222630+0000","last_fullsized":"2024-05-08T18:07:41.222630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241836+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:07:40.241836+0000","last_peered":"2024-05-08T18:07:40.241836+0000","last_clean":"2024-05-08T18:07:40.241836+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:07:40.241836+0000","last_undegraded":"2024-05-08T18:07:40.241836+0000","last_fullsized":"2024-05-08T18:07:40.241836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235170+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:07:40.235170+0000","last_peered":"2024-05-08T18:07:40.235170+0000","last_clean":"2024-05-08T18:07:40.235170+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:07:40.235170+0000","last_undegraded":"2024-05-08T18:07:40.235170+0000","last_fullsized":"2024-05-08T18:07:40.235170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223540+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:07:41.223540+0000","last_peered":"2024-05-08T18:07:41.223540+0000","last_clean":"2024-05-08T18:07:41.223540+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:07:41.223540+0000","last_undegraded":"2024-05-08T18:07:41.223540+0000","last_fullsized":"2024-05-08T18:07:41.223540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201000+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:07:40.201000+0000","last_peered":"2024-05-08T18:07:40.201000+0000","last_clean":"2024-05-08T18:07:40.201000+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:07:40.201000+0000","last_undegraded":"2024-05-08T18:07:40.201000+0000","last_fullsized":"2024-05-08T18:07:40.201000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235943+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:07:40.235943+0000","last_peered":"2024-05-08T18:07:40.235943+0000","last_clean":"2024-05-08T18:07:40.235943+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:07:40.235943+0000","last_undegraded":"2024-05-08T18:07:40.235943+0000","last_fullsized":"2024-05-08T18:07:40.235943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223121+0000","last_change":"2024-05-08T18:07:17.504030+0000","last_active":"2024-05-08T18:07:41.223121+0000","last_peered":"2024-05-08T18:07:41.223121+0000","last_clean":"2024-05-08T18:07:41.223121+0000","last_became_active":"2024-05-08T18:07:17.497558+0000","last_became_peered":"2024-05-08T18:07:17.497558+0000","last_unstale":"2024-05-08T18:07:41.223121+0000","last_undegraded":"2024-05-08T18:07:41.223121+0000","last_fullsized":"2024-05-08T18:07:41.223121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236621+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:07:40.236621+0000","last_peered":"2024-05-08T18:07:40.236621+0000","last_clean":"2024-05-08T18:07:40.236621+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:07:40.236621+0000","last_undegraded":"2024-05-08T18:07:40.236621+0000","last_fullsized":"2024-05-08T18:07:40.236621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201274+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:07:40.201274+0000","last_peered":"2024-05-08T18:07:40.201274+0000","last_clean":"2024-05-08T18:07:40.201274+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:07:40.201274+0000","last_undegraded":"2024-05-08T18:07:40.201274+0000","last_fullsized":"2024-05-08T18:07:40.201274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237710+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:07:40.237710+0000","last_peered":"2024-05-08T18:07:40.237710+0000","last_clean":"2024-05-08T18:07:40.237710+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:07:40.237710+0000","last_undegraded":"2024-05-08T18:07:40.237710+0000","last_fullsized":"2024-05-08T18:07:40.237710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235449+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:07:40.235449+0000","last_peered":"2024-05-08T18:07:40.235449+0000","last_clean":"2024-05-08T18:07:40.235449+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:07:40.235449+0000","last_undegraded":"2024-05-08T18:07:40.235449+0000","last_fullsized":"2024-05-08T18:07:40.235449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202312+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:07:40.202312+0000","last_peered":"2024-05-08T18:07:40.202312+0000","last_clean":"2024-05-08T18:07:40.202312+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:07:40.202312+0000","last_undegraded":"2024-05-08T18:07:40.202312+0000","last_fullsized":"2024-05-08T18:07:40.202312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223595+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:07:41.223595+0000","last_peered":"2024-05-08T18:07:41.223595+0000","last_clean":"2024-05-08T18:07:41.223595+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:07:41.223595+0000","last_undegraded":"2024-05-08T18:07:41.223595+0000","last_fullsized":"2024-05-08T18:07:41.223595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236456+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:07:40.236456+0000","last_peered":"2024-05-08T18:07:40.236456+0000","last_clean":"2024-05-08T18:07:40.236456+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:07:40.236456+0000","last_undegraded":"2024-05-08T18:07:40.236456+0000","last_fullsized":"2024-05-08T18:07:40.236456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.226166+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:07:41.226166+0000","last_peered":"2024-05-08T18:07:41.226166+0000","last_clean":"2024-05-08T18:07:41.226166+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:07:41.226166+0000","last_undegraded":"2024-05-08T18:07:41.226166+0000","last_fullsized":"2024-05-08T18:07:41.226166+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236468+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:07:40.236468+0000","last_peered":"2024-05-08T18:07:40.236468+0000","last_clean":"2024-05-08T18:07:40.236468+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:07:40.236468+0000","last_undegraded":"2024-05-08T18:07:40.236468+0000","last_fullsized":"2024-05-08T18:07:40.236468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223129+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:07:41.223129+0000","last_peered":"2024-05-08T18:07:41.223129+0000","last_clean":"2024-05-08T18:07:41.223129+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:07:41.223129+0000","last_undegraded":"2024-05-08T18:07:41.223129+0000","last_fullsized":"2024-05-08T18:07:41.223129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236644+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:07:40.236644+0000","last_peered":"2024-05-08T18:07:40.236644+0000","last_clean":"2024-05-08T18:07:40.236644+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:07:40.236644+0000","last_undegraded":"2024-05-08T18:07:40.236644+0000","last_fullsized":"2024-05-08T18:07:40.236644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223253+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:07:41.223253+0000","last_peered":"2024-05-08T18:07:41.223253+0000","last_clean":"2024-05-08T18:07:41.223253+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:07:41.223253+0000","last_undegraded":"2024-05-08T18:07:41.223253+0000","last_fullsized":"2024-05-08T18:07:41.223253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202040+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:07:40.202040+0000","last_peered":"2024-05-08T18:07:40.202040+0000","last_clean":"2024-05-08T18:07:40.202040+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:07:40.202040+0000","last_undegraded":"2024-05-08T18:07:40.202040+0000","last_fullsized":"2024-05-08T18:07:40.202040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238953+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:07:40.238953+0000","last_peered":"2024-05-08T18:07:40.238953+0000","last_clean":"2024-05-08T18:07:40.238953+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:07:40.238953+0000","last_undegraded":"2024-05-08T18:07:40.238953+0000","last_fullsized":"2024-05-08T18:07:40.238953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.226386+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:07:41.226386+0000","last_peered":"2024-05-08T18:07:41.226386+0000","last_clean":"2024-05-08T18:07:41.226386+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:07:41.226386+0000","last_undegraded":"2024-05-08T18:07:41.226386+0000","last_fullsized":"2024-05-08T18:07:41.226386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201042+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:07:40.201042+0000","last_peered":"2024-05-08T18:07:40.201042+0000","last_clean":"2024-05-08T18:07:40.201042+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:07:40.201042+0000","last_undegraded":"2024-05-08T18:07:40.201042+0000","last_fullsized":"2024-05-08T18:07:40.201042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223272+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:07:41.223272+0000","last_peered":"2024-05-08T18:07:41.223272+0000","last_clean":"2024-05-08T18:07:41.223272+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:07:41.223272+0000","last_undegraded":"2024-05-08T18:07:41.223272+0000","last_fullsized":"2024-05-08T18:07:41.223272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220367+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:07:41.220367+0000","last_peered":"2024-05-08T18:07:41.220367+0000","last_clean":"2024-05-08T18:07:41.220367+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:07:41.220367+0000","last_undegraded":"2024-05-08T18:07:41.220367+0000","last_fullsized":"2024-05-08T18:07:41.220367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220899+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:07:41.220899+0000","last_peered":"2024-05-08T18:07:41.220899+0000","last_clean":"2024-05-08T18:07:41.220899+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:07:41.220899+0000","last_undegraded":"2024-05-08T18:07:41.220899+0000","last_fullsized":"2024-05-08T18:07:41.220899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225406+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:07:41.225406+0000","last_peered":"2024-05-08T18:07:41.225406+0000","last_clean":"2024-05-08T18:07:41.225406+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:07:41.225406+0000","last_undegraded":"2024-05-08T18:07:41.225406+0000","last_fullsized":"2024-05-08T18:07:41.225406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223610+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:07:41.223610+0000","last_peered":"2024-05-08T18:07:41.223610+0000","last_clean":"2024-05-08T18:07:41.223610+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:07:41.223610+0000","last_undegraded":"2024-05-08T18:07:41.223610+0000","last_fullsized":"2024-05-08T18:07:41.223610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235324+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:07:40.235324+0000","last_peered":"2024-05-08T18:07:40.235324+0000","last_clean":"2024-05-08T18:07:40.235324+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:07:40.235324+0000","last_undegraded":"2024-05-08T18:07:40.235324+0000","last_fullsized":"2024-05-08T18:07:40.235324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206221+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:07:40.206221+0000","last_peered":"2024-05-08T18:07:40.206221+0000","last_clean":"2024-05-08T18:07:40.206221+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:07:40.206221+0000","last_undegraded":"2024-05-08T18:07:40.206221+0000","last_fullsized":"2024-05-08T18:07:40.206221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235478+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:07:40.235478+0000","last_peered":"2024-05-08T18:07:40.235478+0000","last_clean":"2024-05-08T18:07:40.235478+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:07:40.235478+0000","last_undegraded":"2024-05-08T18:07:40.235478+0000","last_fullsized":"2024-05-08T18:07:40.235478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.227027+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:07:41.227027+0000","last_peered":"2024-05-08T18:07:41.227027+0000","last_clean":"2024-05-08T18:07:41.227027+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:07:41.227027+0000","last_undegraded":"2024-05-08T18:07:41.227027+0000","last_fullsized":"2024-05-08T18:07:41.227027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221399+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:07:41.221399+0000","last_peered":"2024-05-08T18:07:41.221399+0000","last_clean":"2024-05-08T18:07:41.221399+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:07:41.221399+0000","last_undegraded":"2024-05-08T18:07:41.221399+0000","last_fullsized":"2024-05-08T18:07:41.221399+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.201452+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:07:40.201452+0000","last_peered":"2024-05-08T18:07:40.201452+0000","last_clean":"2024-05-08T18:07:40.201452+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:07:40.201452+0000","last_undegraded":"2024-05-08T18:07:40.201452+0000","last_fullsized":"2024-05-08T18:07:40.201452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.234920+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:07:40.234920+0000","last_peered":"2024-05-08T18:07:40.234920+0000","last_clean":"2024-05-08T18:07:40.234920+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:07:40.234920+0000","last_undegraded":"2024-05-08T18:07:40.234920+0000","last_fullsized":"2024-05-08T18:07:40.234920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219173+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:07:41.219173+0000","last_peered":"2024-05-08T18:07:41.219173+0000","last_clean":"2024-05-08T18:07:41.219173+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:07:41.219173+0000","last_undegraded":"2024-05-08T18:07:41.219173+0000","last_fullsized":"2024-05-08T18:07:41.219173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237087+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:07:40.237087+0000","last_peered":"2024-05-08T18:07:40.237087+0000","last_clean":"2024-05-08T18:07:40.237087+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:07:40.237087+0000","last_undegraded":"2024-05-08T18:07:40.237087+0000","last_fullsized":"2024-05-08T18:07:40.237087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.237842+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:07:40.237842+0000","last_peered":"2024-05-08T18:07:40.237842+0000","last_clean":"2024-05-08T18:07:40.237842+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:07:40.237842+0000","last_undegraded":"2024-05-08T18:07:40.237842+0000","last_fullsized":"2024-05-08T18:07:40.237842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235756+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:07:40.235756+0000","last_peered":"2024-05-08T18:07:40.235756+0000","last_clean":"2024-05-08T18:07:40.235756+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:07:40.235756+0000","last_undegraded":"2024-05-08T18:07:40.235756+0000","last_fullsized":"2024-05-08T18:07:40.235756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.234582+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:07:40.234582+0000","last_peered":"2024-05-08T18:07:40.234582+0000","last_clean":"2024-05-08T18:07:40.234582+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:07:40.234582+0000","last_undegraded":"2024-05-08T18:07:40.234582+0000","last_fullsized":"2024-05-08T18:07:40.234582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.242193+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:07:40.242193+0000","last_peered":"2024-05-08T18:07:40.242193+0000","last_clean":"2024-05-08T18:07:40.242193+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:07:40.242193+0000","last_undegraded":"2024-05-08T18:07:40.242193+0000","last_fullsized":"2024-05-08T18:07:40.242193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220050+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:07:41.220050+0000","last_peered":"2024-05-08T18:07:41.220050+0000","last_clean":"2024-05-08T18:07:41.220050+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:07:41.220050+0000","last_undegraded":"2024-05-08T18:07:41.220050+0000","last_fullsized":"2024-05-08T18:07:41.220050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240790+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:07:40.240790+0000","last_peered":"2024-05-08T18:07:40.240790+0000","last_clean":"2024-05-08T18:07:40.240790+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:07:40.240790+0000","last_undegraded":"2024-05-08T18:07:40.240790+0000","last_fullsized":"2024-05-08T18:07:40.240790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236677+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:07:40.236677+0000","last_peered":"2024-05-08T18:07:40.236677+0000","last_clean":"2024-05-08T18:07:40.236677+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:07:40.236677+0000","last_undegraded":"2024-05-08T18:07:40.236677+0000","last_fullsized":"2024-05-08T18:07:40.236677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.234682+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:07:40.234682+0000","last_peered":"2024-05-08T18:07:40.234682+0000","last_clean":"2024-05-08T18:07:40.234682+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:07:40.234682+0000","last_undegraded":"2024-05-08T18:07:40.234682+0000","last_fullsized":"2024-05-08T18:07:40.234682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.200754+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:07:40.200754+0000","last_peered":"2024-05-08T18:07:40.200754+0000","last_clean":"2024-05-08T18:07:40.200754+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:07:40.200754+0000","last_undegraded":"2024-05-08T18:07:40.200754+0000","last_fullsized":"2024-05-08T18:07:40.200754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223544+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:07:41.223544+0000","last_peered":"2024-05-08T18:07:41.223544+0000","last_clean":"2024-05-08T18:07:41.223544+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:07:41.223544+0000","last_undegraded":"2024-05-08T18:07:41.223544+0000","last_fullsized":"2024-05-08T18:07:41.223544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222762+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:07:41.222762+0000","last_peered":"2024-05-08T18:07:41.222762+0000","last_clean":"2024-05-08T18:07:41.222762+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:07:41.222762+0000","last_undegraded":"2024-05-08T18:07:41.222762+0000","last_fullsized":"2024-05-08T18:07:41.222762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224730+0000","last_change":"2024-05-08T18:07:15.488647+0000","last_active":"2024-05-08T18:07:41.224730+0000","last_peered":"2024-05-08T18:07:41.224730+0000","last_clean":"2024-05-08T18:07:41.224730+0000","last_became_active":"2024-05-08T18:07:15.487842+0000","last_became_peered":"2024-05-08T18:07:15.487842+0000","last_unstale":"2024-05-08T18:07:41.224730+0000","last_undegraded":"2024-05-08T18:07:41.224730+0000","last_fullsized":"2024-05-08T18:07:41.224730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218499+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:07:41.218499+0000","last_peered":"2024-05-08T18:07:41.218499+0000","last_clean":"2024-05-08T18:07:41.218499+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:07:41.218499+0000","last_undegraded":"2024-05-08T18:07:41.218499+0000","last_fullsized":"2024-05-08T18:07:41.218499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.228517+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:07:41.228517+0000","last_peered":"2024-05-08T18:07:41.228517+0000","last_clean":"2024-05-08T18:07:41.228517+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:07:41.228517+0000","last_undegraded":"2024-05-08T18:07:41.228517+0000","last_fullsized":"2024-05-08T18:07:41.228517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.218845+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:07:41.218845+0000","last_peered":"2024-05-08T18:07:41.218845+0000","last_clean":"2024-05-08T18:07:41.218845+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:07:41.218845+0000","last_undegraded":"2024-05-08T18:07:41.218845+0000","last_fullsized":"2024-05-08T18:07:41.218845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239582+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:07:40.239582+0000","last_peered":"2024-05-08T18:07:40.239582+0000","last_clean":"2024-05-08T18:07:40.239582+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:07:40.239582+0000","last_undegraded":"2024-05-08T18:07:40.239582+0000","last_fullsized":"2024-05-08T18:07:40.239582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219133+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:07:41.219133+0000","last_peered":"2024-05-08T18:07:41.219133+0000","last_clean":"2024-05-08T18:07:41.219133+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:07:41.219133+0000","last_undegraded":"2024-05-08T18:07:41.219133+0000","last_fullsized":"2024-05-08T18:07:41.219133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236610+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:07:40.236610+0000","last_peered":"2024-05-08T18:07:40.236610+0000","last_clean":"2024-05-08T18:07:40.236610+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:07:40.236610+0000","last_undegraded":"2024-05-08T18:07:40.236610+0000","last_fullsized":"2024-05-08T18:07:40.236610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221884+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:07:41.221884+0000","last_peered":"2024-05-08T18:07:41.221884+0000","last_clean":"2024-05-08T18:07:41.221884+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:07:41.221884+0000","last_undegraded":"2024-05-08T18:07:41.221884+0000","last_fullsized":"2024-05-08T18:07:41.221884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.219172+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:07:41.219172+0000","last_peered":"2024-05-08T18:07:41.219172+0000","last_clean":"2024-05-08T18:07:41.219172+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:07:41.219172+0000","last_undegraded":"2024-05-08T18:07:41.219172+0000","last_fullsized":"2024-05-08T18:07:41.219172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235398+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:07:40.235398+0000","last_peered":"2024-05-08T18:07:40.235398+0000","last_clean":"2024-05-08T18:07:40.235398+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:07:40.235398+0000","last_undegraded":"2024-05-08T18:07:40.235398+0000","last_fullsized":"2024-05-08T18:07:40.235398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220885+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:07:41.220885+0000","last_peered":"2024-05-08T18:07:41.220885+0000","last_clean":"2024-05-08T18:07:41.220885+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:07:41.220885+0000","last_undegraded":"2024-05-08T18:07:41.220885+0000","last_fullsized":"2024-05-08T18:07:41.220885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224955+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:07:41.224955+0000","last_peered":"2024-05-08T18:07:41.224955+0000","last_clean":"2024-05-08T18:07:41.224955+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:07:41.224955+0000","last_undegraded":"2024-05-08T18:07:41.224955+0000","last_fullsized":"2024-05-08T18:07:41.224955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.200603+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:07:40.200603+0000","last_peered":"2024-05-08T18:07:40.200603+0000","last_clean":"2024-05-08T18:07:40.200603+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:07:40.200603+0000","last_undegraded":"2024-05-08T18:07:40.200603+0000","last_fullsized":"2024-05-08T18:07:40.200603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.223948+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:07:41.223948+0000","last_peered":"2024-05-08T18:07:41.223948+0000","last_clean":"2024-05-08T18:07:41.223948+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:07:41.223948+0000","last_undegraded":"2024-05-08T18:07:41.223948+0000","last_fullsized":"2024-05-08T18:07:41.223948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.204848+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:07:40.204848+0000","last_peered":"2024-05-08T18:07:40.204848+0000","last_clean":"2024-05-08T18:07:40.204848+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:07:40.204848+0000","last_undegraded":"2024-05-08T18:07:40.204848+0000","last_fullsized":"2024-05-08T18:07:40.204848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240028+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:07:40.240028+0000","last_peered":"2024-05-08T18:07:40.240028+0000","last_clean":"2024-05-08T18:07:40.240028+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:07:40.240028+0000","last_undegraded":"2024-05-08T18:07:40.240028+0000","last_fullsized":"2024-05-08T18:07:40.240028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.239223+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:07:40.239223+0000","last_peered":"2024-05-08T18:07:40.239223+0000","last_clean":"2024-05-08T18:07:40.239223+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:07:40.239223+0000","last_undegraded":"2024-05-08T18:07:40.239223+0000","last_fullsized":"2024-05-08T18:07:40.239223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224999+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:07:41.224999+0000","last_peered":"2024-05-08T18:07:41.224999+0000","last_clean":"2024-05-08T18:07:41.224999+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:07:41.224999+0000","last_undegraded":"2024-05-08T18:07:41.224999+0000","last_fullsized":"2024-05-08T18:07:41.224999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235568+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:07:40.235568+0000","last_peered":"2024-05-08T18:07:40.235568+0000","last_clean":"2024-05-08T18:07:40.235568+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:07:40.235568+0000","last_undegraded":"2024-05-08T18:07:40.235568+0000","last_fullsized":"2024-05-08T18:07:40.235568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.224141+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:07:41.224141+0000","last_peered":"2024-05-08T18:07:41.224141+0000","last_clean":"2024-05-08T18:07:41.224141+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:07:41.224141+0000","last_undegraded":"2024-05-08T18:07:41.224141+0000","last_fullsized":"2024-05-08T18:07:41.224141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.228484+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:07:41.228484+0000","last_peered":"2024-05-08T18:07:41.228484+0000","last_clean":"2024-05-08T18:07:41.228484+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:07:41.228484+0000","last_undegraded":"2024-05-08T18:07:41.228484+0000","last_fullsized":"2024-05-08T18:07:41.228484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220252+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:07:41.220252+0000","last_peered":"2024-05-08T18:07:41.220252+0000","last_clean":"2024-05-08T18:07:41.220252+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:07:41.220252+0000","last_undegraded":"2024-05-08T18:07:41.220252+0000","last_fullsized":"2024-05-08T18:07:41.220252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.227570+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:07:41.227570+0000","last_peered":"2024-05-08T18:07:41.227570+0000","last_clean":"2024-05-08T18:07:41.227570+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:07:41.227570+0000","last_undegraded":"2024-05-08T18:07:41.227570+0000","last_fullsized":"2024-05-08T18:07:41.227570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222548+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:07:41.222548+0000","last_peered":"2024-05-08T18:07:41.222548+0000","last_clean":"2024-05-08T18:07:41.222548+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:07:41.222548+0000","last_undegraded":"2024-05-08T18:07:41.222548+0000","last_fullsized":"2024-05-08T18:07:41.222548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202179+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:07:40.202179+0000","last_peered":"2024-05-08T18:07:40.202179+0000","last_clean":"2024-05-08T18:07:40.202179+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:07:40.202179+0000","last_undegraded":"2024-05-08T18:07:40.202179+0000","last_fullsized":"2024-05-08T18:07:40.202179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.200461+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:07:40.200461+0000","last_peered":"2024-05-08T18:07:40.200461+0000","last_clean":"2024-05-08T18:07:40.200461+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:07:40.200461+0000","last_undegraded":"2024-05-08T18:07:40.200461+0000","last_fullsized":"2024-05-08T18:07:40.200461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.225155+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:07:41.225155+0000","last_peered":"2024-05-08T18:07:41.225155+0000","last_clean":"2024-05-08T18:07:41.225155+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:07:41.225155+0000","last_undegraded":"2024-05-08T18:07:41.225155+0000","last_fullsized":"2024-05-08T18:07:41.225155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236511+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:07:40.236511+0000","last_peered":"2024-05-08T18:07:40.236511+0000","last_clean":"2024-05-08T18:07:40.236511+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:07:40.236511+0000","last_undegraded":"2024-05-08T18:07:40.236511+0000","last_fullsized":"2024-05-08T18:07:40.236511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236279+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:07:40.236279+0000","last_peered":"2024-05-08T18:07:40.236279+0000","last_clean":"2024-05-08T18:07:40.236279+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:07:40.236279+0000","last_undegraded":"2024-05-08T18:07:40.236279+0000","last_fullsized":"2024-05-08T18:07:40.236279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.221672+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:07:41.221672+0000","last_peered":"2024-05-08T18:07:41.221672+0000","last_clean":"2024-05-08T18:07:41.221672+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:07:41.221672+0000","last_undegraded":"2024-05-08T18:07:41.221672+0000","last_fullsized":"2024-05-08T18:07:41.221672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222845+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:07:41.222845+0000","last_peered":"2024-05-08T18:07:41.222845+0000","last_clean":"2024-05-08T18:07:41.222845+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:07:41.222845+0000","last_undegraded":"2024-05-08T18:07:41.222845+0000","last_fullsized":"2024-05-08T18:07:41.222845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206392+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:07:40.206392+0000","last_peered":"2024-05-08T18:07:40.206392+0000","last_clean":"2024-05-08T18:07:40.206392+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:07:40.206392+0000","last_undegraded":"2024-05-08T18:07:40.206392+0000","last_fullsized":"2024-05-08T18:07:40.206392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238993+0000","last_change":"2024-05-08T18:07:15.498938+0000","last_active":"2024-05-08T18:07:40.238993+0000","last_peered":"2024-05-08T18:07:40.238993+0000","last_clean":"2024-05-08T18:07:40.238993+0000","last_became_active":"2024-05-08T18:07:15.498206+0000","last_became_peered":"2024-05-08T18:07:15.498206+0000","last_unstale":"2024-05-08T18:07:40.238993+0000","last_undegraded":"2024-05-08T18:07:40.238993+0000","last_fullsized":"2024-05-08T18:07:40.238993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.220710+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:07:41.220710+0000","last_peered":"2024-05-08T18:07:41.220710+0000","last_clean":"2024-05-08T18:07:41.220710+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:07:41.220710+0000","last_undegraded":"2024-05-08T18:07:41.220710+0000","last_fullsized":"2024-05-08T18:07:41.220710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235651+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:07:40.235651+0000","last_peered":"2024-05-08T18:07:40.235651+0000","last_clean":"2024-05-08T18:07:40.235651+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:07:40.235651+0000","last_undegraded":"2024-05-08T18:07:40.235651+0000","last_fullsized":"2024-05-08T18:07:40.235651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.238151+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:07:40.238151+0000","last_peered":"2024-05-08T18:07:40.238151+0000","last_clean":"2024-05-08T18:07:40.238151+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:07:40.238151+0000","last_undegraded":"2024-05-08T18:07:40.238151+0000","last_fullsized":"2024-05-08T18:07:40.238151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.202051+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:07:40.202051+0000","last_peered":"2024-05-08T18:07:40.202051+0000","last_clean":"2024-05-08T18:07:40.202051+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:07:40.202051+0000","last_undegraded":"2024-05-08T18:07:40.202051+0000","last_fullsized":"2024-05-08T18:07:40.202051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235682+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:07:40.235682+0000","last_peered":"2024-05-08T18:07:40.235682+0000","last_clean":"2024-05-08T18:07:40.235682+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:07:40.235682+0000","last_undegraded":"2024-05-08T18:07:40.235682+0000","last_fullsized":"2024-05-08T18:07:40.235682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.240677+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:07:40.240677+0000","last_peered":"2024-05-08T18:07:40.240677+0000","last_clean":"2024-05-08T18:07:40.240677+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:07:40.240677+0000","last_undegraded":"2024-05-08T18:07:40.240677+0000","last_fullsized":"2024-05-08T18:07:40.240677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222455+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:07:41.222455+0000","last_peered":"2024-05-08T18:07:41.222455+0000","last_clean":"2024-05-08T18:07:41.222455+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:07:41.222455+0000","last_undegraded":"2024-05-08T18:07:41.222455+0000","last_fullsized":"2024-05-08T18:07:41.222455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.206655+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:07:40.206655+0000","last_peered":"2024-05-08T18:07:40.206655+0000","last_clean":"2024-05-08T18:07:40.206655+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:07:40.206655+0000","last_undegraded":"2024-05-08T18:07:40.206655+0000","last_fullsized":"2024-05-08T18:07:40.206655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.235657+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:07:40.235657+0000","last_peered":"2024-05-08T18:07:40.235657+0000","last_clean":"2024-05-08T18:07:40.235657+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:07:40.235657+0000","last_undegraded":"2024-05-08T18:07:40.235657+0000","last_fullsized":"2024-05-08T18:07:40.235657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241657+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:07:40.241657+0000","last_peered":"2024-05-08T18:07:40.241657+0000","last_clean":"2024-05-08T18:07:40.241657+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:07:40.241657+0000","last_undegraded":"2024-05-08T18:07:40.241657+0000","last_fullsized":"2024-05-08T18:07:40.241657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236041+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:07:40.236041+0000","last_peered":"2024-05-08T18:07:40.236041+0000","last_clean":"2024-05-08T18:07:40.236041+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:07:40.236041+0000","last_undegraded":"2024-05-08T18:07:40.236041+0000","last_fullsized":"2024-05-08T18:07:40.236041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.236510+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:07:40.236510+0000","last_peered":"2024-05-08T18:07:40.236510+0000","last_clean":"2024-05-08T18:07:40.236510+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:07:40.236510+0000","last_undegraded":"2024-05-08T18:07:40.236510+0000","last_fullsized":"2024-05-08T18:07:40.236510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:07:41.222946+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:07:41.222946+0000","last_peered":"2024-05-08T18:07:41.222946+0000","last_clean":"2024-05-08T18:07:41.222946+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:07:41.222946+0000","last_undegraded":"2024-05-08T18:07:41.222946+0000","last_fullsized":"2024-05-08T18:07:41.222946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:07:40.241747+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:07:40.241747+0000","last_peered":"2024-05-08T18:07:40.241747+0000","last_clean":"2024-05-08T18:07:40.241747+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:07:40.241747+0000","last_undegraded":"2024-05-08T18:07:40.241747+0000","last_fullsized":"2024-05-08T18:07:40.241747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1077248,"data_stored":795892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":204428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":503808,"data_stored":206249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":204919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":212466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":203990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":212320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1056768,"data_stored":795298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:07:43.882 INFO:tasks.thrashosds.thrasher:Setting 4.3f to [3, 7] 2024-05-08T18:07:43.882 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.3f', '3', '7'] 2024-05-08T18:07:43.882 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.3f 3 7 2024-05-08T18:07:43.891 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:43.891 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:07:43.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:07:43.891 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:07:43.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.891 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-05-08T18:07:43.891 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:07:43.892 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.323990862999999, 2024-05-08T18:07:43.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035750999999999999, 2024-05-08T18:07:43.892 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.892 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.892 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.892 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:07:43.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:07:43.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570203+0000", 2024-05-08T18:07:43.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6749999999999996e-06 2024-05-08T18:07:43.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570213+0000", 2024-05-08T18:07:43.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0139999999999999e-05 2024-05-08T18:07:43.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570231+0000", 2024-05-08T18:07:43.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8402000000000001e-05 2024-05-08T18:07:43.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570245+0000", 2024-05-08T18:07:43.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3135e-05 2024-05-08T18:07:43.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570338+0000", 2024-05-08T18:07:43.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3498000000000005e-05 2024-05-08T18:07:43.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570373+0000", 2024-05-08T18:07:43.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5179999999999999e-05 2024-05-08T18:07:43.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573694+0000", 2024-05-08T18:07:43.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003320524 2024-05-08T18:07:43.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573771+0000", 2024-05-08T18:07:43.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7546000000000006e-05 2024-05-08T18:07:43.896 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.896 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.896 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.896 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-05-08T18:07:43.896 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:07:43.896 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.318677901000001, 2024-05-08T18:07:43.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038280229999999998, 2024-05-08T18:07:43.896 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.896 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.896 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.896 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:07:43.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:07:43.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575510+0000", 2024-05-08T18:07:43.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0979999999999999e-06 2024-05-08T18:07:43.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575527+0000", 2024-05-08T18:07:43.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6393999999999999e-05 2024-05-08T18:07:43.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575549+0000", 2024-05-08T18:07:43.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1843000000000001e-05 2024-05-08T18:07:43.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575560+0000", 2024-05-08T18:07:43.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.186e-05 2024-05-08T18:07:43.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575651+0000", 2024-05-08T18:07:43.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1068000000000003e-05 2024-05-08T18:07:43.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575685+0000", 2024-05-08T18:07:43.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3614e-05 2024-05-08T18:07:43.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579231+0000", 2024-05-08T18:07:43.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003546249 2024-05-08T18:07:43.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579337+0000", 2024-05-08T18:07:43.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010589700000000001 2024-05-08T18:07:43.900 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.900 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.900 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.900 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-05-08T18:07:43.900 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:07:43.900 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.31664061, 2024-05-08T18:07:43.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004223157, 2024-05-08T18:07:43.900 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.900 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.900 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.900 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:07:43.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:07:43.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577548+0000", 2024-05-08T18:07:43.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.66e-06 2024-05-08T18:07:43.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577561+0000", 2024-05-08T18:07:43.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2533e-05 2024-05-08T18:07:43.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577585+0000", 2024-05-08T18:07:43.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3873e-05 2024-05-08T18:07:43.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577605+0000", 2024-05-08T18:07:43.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0477000000000001e-05 2024-05-08T18:07:43.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577717+0000", 2024-05-08T18:07:43.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011229499999999999 2024-05-08T18:07:43.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577777+0000", 2024-05-08T18:07:43.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.944e-05 2024-05-08T18:07:43.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581704+0000", 2024-05-08T18:07:43.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039267800000000004 2024-05-08T18:07:43.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581770+0000", 2024-05-08T18:07:43.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6099000000000005e-05 2024-05-08T18:07:43.904 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.904 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.904 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.904 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:54 7.d e29/28 7:b4812045:::notify.4:head v 29'1, mlcod=0'0)", 2024-05-08T18:07:43.904 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:07:43.905 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.313827885999999, 2024-05-08T18:07:43.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003988503, 2024-05-08T18:07:43.905 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.905 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.905 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.905 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:07:43.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:07:43.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580368+0000", 2024-05-08T18:07:43.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3089999999999996e-06 2024-05-08T18:07:43.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580400+0000", 2024-05-08T18:07:43.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2580000000000003e-05 2024-05-08T18:07:43.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580427+0000", 2024-05-08T18:07:43.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6976999999999999e-05 2024-05-08T18:07:43.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580443+0000", 2024-05-08T18:07:43.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5585000000000001e-05 2024-05-08T18:07:43.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580555+0000", 2024-05-08T18:07:43.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112639 2024-05-08T18:07:43.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580601+0000", 2024-05-08T18:07:43.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6e-05 2024-05-08T18:07:43.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584229+0000", 2024-05-08T18:07:43.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036273659999999999 2024-05-08T18:07:43.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584348+0000", 2024-05-08T18:07:43.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119047 2024-05-08T18:07:43.908 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.908 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.908 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.909 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:43.909 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:07:43.909 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.204414616000001, 2024-05-08T18:07:43.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032136159999999999, 2024-05-08T18:07:43.909 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.909 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.909 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.909 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.909 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.909 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.909 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 193 2024-05-08T18:07:43.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.909 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:07:43.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:07:43.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689775+0000", 2024-05-08T18:07:43.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.357e-06 2024-05-08T18:07:43.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689788+0000", 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3029e-05 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689819+0000", 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.065e-05 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689833+0000", 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4790000000000001e-05 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689948+0000", 2024-05-08T18:07:43.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115089 2024-05-08T18:07:43.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690155+0000", 2024-05-08T18:07:43.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206932 2024-05-08T18:07:43.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:43.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690420+0000", 2024-05-08T18:07:43.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026450200000000001 2024-05-08T18:07:43.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692229+0000", 2024-05-08T18:07:43.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001808823 2024-05-08T18:07:43.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692816+0000", 2024-05-08T18:07:43.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058773199999999999 2024-05-08T18:07:43.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692915+0000", 2024-05-08T18:07:43.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8646000000000004e-05 2024-05-08T18:07:43.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692986+0000", 2024-05-08T18:07:43.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1066e-05 2024-05-08T18:07:43.913 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.914 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.914 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.914 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.914 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:07:43.914 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.305448396999999, 2024-05-08T18:07:43.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089431319999999995, 2024-05-08T18:07:43.914 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.914 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.914 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.914 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.914 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.914 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.915 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 208 2024-05-08T18:07:43.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.915 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:07:43.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:07:43.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588741+0000", 2024-05-08T18:07:43.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:07:43.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588752+0000", 2024-05-08T18:07:43.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0813e-05 2024-05-08T18:07:43.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588782+0000", 2024-05-08T18:07:43.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0020000000000001e-05 2024-05-08T18:07:43.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588803+0000", 2024-05-08T18:07:43.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1115999999999999e-05 2024-05-08T18:07:43.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588943+0000", 2024-05-08T18:07:43.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013971599999999999 2024-05-08T18:07:43.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:07:43.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588954+0000", 2024-05-08T18:07:43.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1365999999999999e-05 2024-05-08T18:07:43.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594340+0000", 2024-05-08T18:07:43.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053854910000000001 2024-05-08T18:07:43.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594670+0000", 2024-05-08T18:07:43.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000330055 2024-05-08T18:07:43.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:43.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.595179+0000", 2024-05-08T18:07:43.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050879199999999999 2024-05-08T18:07:43.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.596408+0000", 2024-05-08T18:07:43.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012295209999999999 2024-05-08T18:07:43.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597532+0000", 2024-05-08T18:07:43.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011233860000000001 2024-05-08T18:07:43.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597619+0000", 2024-05-08T18:07:43.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7775999999999994e-05 2024-05-08T18:07:43.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597682+0000", 2024-05-08T18:07:43.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2522999999999998e-05 2024-05-08T18:07:43.920 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.920 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.920 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.920 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.920 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:07:43.920 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.276819417999999, 2024-05-08T18:07:43.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031262669999999998, 2024-05-08T18:07:43.920 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.920 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.920 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.921 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.921 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.921 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.921 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 212 2024-05-08T18:07:43.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.921 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:07:43.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:07:43.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617370+0000", 2024-05-08T18:07:43.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:07:43.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617379+0000", 2024-05-08T18:07:43.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2359999999999993e-06 2024-05-08T18:07:43.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617405+0000", 2024-05-08T18:07:43.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5639999999999998e-05 2024-05-08T18:07:43.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617425+0000", 2024-05-08T18:07:43.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0457000000000001e-05 2024-05-08T18:07:43.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617573+0000", 2024-05-08T18:07:43.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014776200000000001 2024-05-08T18:07:43.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617786+0000", 2024-05-08T18:07:43.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212418 2024-05-08T18:07:43.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:43.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.618177+0000", 2024-05-08T18:07:43.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039161699999999997 2024-05-08T18:07:43.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.619563+0000", 2024-05-08T18:07:43.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013852999999999999 2024-05-08T18:07:43.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620334+0000", 2024-05-08T18:07:43.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00077182200000000002 2024-05-08T18:07:43.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620426+0000", 2024-05-08T18:07:43.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1526000000000004e-05 2024-05-08T18:07:43.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620494+0000", 2024-05-08T18:07:43.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8078999999999997e-05 2024-05-08T18:07:43.925 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.926 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.926 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.926 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.926 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:07:43.926 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.252500865000002, 2024-05-08T18:07:43.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035230880000000002, 2024-05-08T18:07:43.926 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.926 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.926 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.926 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.926 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.926 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.927 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 219 2024-05-08T18:07:43.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.927 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:07:43.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:07:43.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641689+0000", 2024-05-08T18:07:43.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:07:43.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641700+0000", 2024-05-08T18:07:43.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1507e-05 2024-05-08T18:07:43.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641732+0000", 2024-05-08T18:07:43.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1585999999999999e-05 2024-05-08T18:07:43.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641754+0000", 2024-05-08T18:07:43.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1480000000000001e-05 2024-05-08T18:07:43.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641942+0000", 2024-05-08T18:07:43.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018826300000000001 2024-05-08T18:07:43.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642165+0000", 2024-05-08T18:07:43.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022301100000000001 2024-05-08T18:07:43.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:43.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642587+0000", 2024-05-08T18:07:43.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042182400000000001 2024-05-08T18:07:43.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.643767+0000", 2024-05-08T18:07:43.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001180675 2024-05-08T18:07:43.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645010+0000", 2024-05-08T18:07:43.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012427110000000001 2024-05-08T18:07:43.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645101+0000", 2024-05-08T18:07:43.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0871999999999993e-05 2024-05-08T18:07:43.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645209+0000", 2024-05-08T18:07:43.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108496 2024-05-08T18:07:43.931 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.931 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.932 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.932 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.932 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:07:43.932 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.232703877999999, 2024-05-08T18:07:43.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035793639999999998, 2024-05-08T18:07:43.932 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.932 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.932 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.932 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.932 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.932 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.932 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 224 2024-05-08T18:07:43.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.933 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:07:43.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:07:43.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661485+0000", 2024-05-08T18:07:43.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9759999999999998e-06 2024-05-08T18:07:43.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661494+0000", 2024-05-08T18:07:43.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3469999999999999e-06 2024-05-08T18:07:43.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661517+0000", 2024-05-08T18:07:43.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.389e-05 2024-05-08T18:07:43.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661537+0000", 2024-05-08T18:07:43.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9803e-05 2024-05-08T18:07:43.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661696+0000", 2024-05-08T18:07:43.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015865899999999999 2024-05-08T18:07:43.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661910+0000", 2024-05-08T18:07:43.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021434199999999999 2024-05-08T18:07:43.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:43.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.662336+0000", 2024-05-08T18:07:43.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042575300000000001 2024-05-08T18:07:43.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.663720+0000", 2024-05-08T18:07:43.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013843799999999999 2024-05-08T18:07:43.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.664909+0000", 2024-05-08T18:07:43.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011889019999999999 2024-05-08T18:07:43.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665001+0000", 2024-05-08T18:07:43.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1649000000000003e-05 2024-05-08T18:07:43.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665063+0000", 2024-05-08T18:07:43.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1662999999999996e-05 2024-05-08T18:07:43.937 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.937 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.937 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.937 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.937 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:07:43.937 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.200110603999999, 2024-05-08T18:07:43.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031551930000000001, 2024-05-08T18:07:43.937 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.938 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.938 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.938 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.938 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.938 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.938 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 233 2024-05-08T18:07:43.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.938 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:07:43.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:07:43.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694079+0000", 2024-05-08T18:07:43.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:07:43.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694090+0000", 2024-05-08T18:07:43.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1182999999999999e-05 2024-05-08T18:07:43.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694119+0000", 2024-05-08T18:07:43.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9076000000000001e-05 2024-05-08T18:07:43.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694143+0000", 2024-05-08T18:07:43.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4363e-05 2024-05-08T18:07:43.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694291+0000", 2024-05-08T18:07:43.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147849 2024-05-08T18:07:43.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694534+0000", 2024-05-08T18:07:43.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000242382 2024-05-08T18:07:43.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:43.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694957+0000", 2024-05-08T18:07:43.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042316700000000001 2024-05-08T18:07:43.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.696306+0000", 2024-05-08T18:07:43.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013489940000000001 2024-05-08T18:07:43.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697071+0000", 2024-05-08T18:07:43.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076482999999999998 2024-05-08T18:07:43.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697167+0000", 2024-05-08T18:07:43.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6773000000000003e-05 2024-05-08T18:07:43.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697232+0000", 2024-05-08T18:07:43.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4386000000000003e-05 2024-05-08T18:07:43.943 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.943 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.943 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.943 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:328 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.943 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:07:43.943 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.168392016999999, 2024-05-08T18:07:43.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029659439999999999, 2024-05-08T18:07:43.943 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.943 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.943 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.943 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.944 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.944 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.944 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 328 2024-05-08T18:07:43.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.944 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:07:43.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:07:43.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725796+0000", 2024-05-08T18:07:43.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-06 2024-05-08T18:07:43.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725802+0000", 2024-05-08T18:07:43.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7219999999999996e-06 2024-05-08T18:07:43.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725816+0000", 2024-05-08T18:07:43.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3886999999999999e-05 2024-05-08T18:07:43.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725824+0000", 2024-05-08T18:07:43.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5920000000000003e-06 2024-05-08T18:07:43.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725885+0000", 2024-05-08T18:07:43.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1526999999999996e-05 2024-05-08T18:07:43.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725972+0000", 2024-05-08T18:07:43.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7099000000000001e-05 2024-05-08T18:07:43.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:43.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726093+0000", 2024-05-08T18:07:43.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120383 2024-05-08T18:07:43.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726717+0000", 2024-05-08T18:07:43.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062435099999999999 2024-05-08T18:07:43.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728693+0000", 2024-05-08T18:07:43.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019758309999999999 2024-05-08T18:07:43.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728731+0000", 2024-05-08T18:07:43.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8591999999999999e-05 2024-05-08T18:07:43.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728761+0000", 2024-05-08T18:07:43.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9770000000000001e-05 2024-05-08T18:07:43.948 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.948 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.948 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.948 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:460 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.948 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:07:43.948 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.114574792999999, 2024-05-08T18:07:43.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040209540000000002, 2024-05-08T18:07:43.949 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.949 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.949 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.949 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.949 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.949 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.949 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 460 2024-05-08T18:07:43.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.949 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:07:43.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:07:43.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779613+0000", 2024-05-08T18:07:43.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:07:43.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779619+0000", 2024-05-08T18:07:43.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3630000000000002e-06 2024-05-08T18:07:43.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779631+0000", 2024-05-08T18:07:43.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2211e-05 2024-05-08T18:07:43.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779637+0000", 2024-05-08T18:07:43.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0430000000000004e-06 2024-05-08T18:07:43.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779702+0000", 2024-05-08T18:07:43.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4481999999999997e-05 2024-05-08T18:07:43.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779848+0000", 2024-05-08T18:07:43.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014608500000000001 2024-05-08T18:07:43.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:43.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780056+0000", 2024-05-08T18:07:43.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020889699999999999 2024-05-08T18:07:43.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780700+0000", 2024-05-08T18:07:43.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064379300000000003 2024-05-08T18:07:43.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783576+0000", 2024-05-08T18:07:43.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028754919999999999 2024-05-08T18:07:43.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783608+0000", 2024-05-08T18:07:43.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2223e-05 2024-05-08T18:07:43.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:07:43.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5296e-05 2024-05-08T18:07:43.953 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.953 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.953 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.954 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:466 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.954 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:07:43.954 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.110036555000001, 2024-05-08T18:07:43.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028979520000000001, 2024-05-08T18:07:43.954 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.954 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.954 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.954 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.954 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.954 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.954 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 466 2024-05-08T18:07:43.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.954 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:07:43.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:07:43.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:07:43.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.61e-07 2024-05-08T18:07:43.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784155+0000", 2024-05-08T18:07:43.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9299999999999996e-06 2024-05-08T18:07:43.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784165+0000", 2024-05-08T18:07:43.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5680000000000005e-06 2024-05-08T18:07:43.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784170+0000", 2024-05-08T18:07:43.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1379999999999998e-06 2024-05-08T18:07:43.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784219+0000", 2024-05-08T18:07:43.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9231999999999999e-05 2024-05-08T18:07:43.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784310+0000", 2024-05-08T18:07:43.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0797000000000005e-05 2024-05-08T18:07:43.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:43.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784490+0000", 2024-05-08T18:07:43.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179705 2024-05-08T18:07:43.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.785090+0000", 2024-05-08T18:07:43.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060073899999999998 2024-05-08T18:07:43.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.786973+0000", 2024-05-08T18:07:43.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018824460000000001 2024-05-08T18:07:43.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787007+0000", 2024-05-08T18:07:43.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3779999999999998e-05 2024-05-08T18:07:43.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787049+0000", 2024-05-08T18:07:43.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1856e-05 2024-05-08T18:07:43.959 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.959 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.959 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.959 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:477 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.959 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:07:43.959 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.102894560999999, 2024-05-08T18:07:43.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046076989999999998, 2024-05-08T18:07:43.960 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.960 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.960 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.960 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.960 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.960 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.960 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 477 2024-05-08T18:07:43.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.960 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:07:43.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:07:43.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791294+0000", 2024-05-08T18:07:43.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-06 2024-05-08T18:07:43.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791300+0000", 2024-05-08T18:07:43.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5320000000000003e-06 2024-05-08T18:07:43.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791313+0000", 2024-05-08T18:07:43.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2576e-05 2024-05-08T18:07:43.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791319+0000", 2024-05-08T18:07:43.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1720000000000004e-06 2024-05-08T18:07:43.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791379+0000", 2024-05-08T18:07:43.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0343000000000001e-05 2024-05-08T18:07:43.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791477+0000", 2024-05-08T18:07:43.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7662000000000001e-05 2024-05-08T18:07:43.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:43.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791678+0000", 2024-05-08T18:07:43.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000200788 2024-05-08T18:07:43.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.792263+0000", 2024-05-08T18:07:43.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058525700000000005 2024-05-08T18:07:43.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795842+0000", 2024-05-08T18:07:43.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035787079999999999 2024-05-08T18:07:43.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795874+0000", 2024-05-08T18:07:43.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2205000000000001e-05 2024-05-08T18:07:43.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795900+0000", 2024-05-08T18:07:43.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6222000000000001e-05 2024-05-08T18:07:43.965 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.965 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.965 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.965 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:642 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.965 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:07:43.965 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.964134858000001, 2024-05-08T18:07:43.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030444059999999999, 2024-05-08T18:07:43.965 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.965 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.965 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.965 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.966 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.966 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.966 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 642 2024-05-08T18:07:43.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.966 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:07:43.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:07:43.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930055+0000", 2024-05-08T18:07:43.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7999999999999999e-06 2024-05-08T18:07:43.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930065+0000", 2024-05-08T18:07:43.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0176999999999999e-05 2024-05-08T18:07:43.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930092+0000", 2024-05-08T18:07:43.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6460000000000001e-05 2024-05-08T18:07:43.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930112+0000", 2024-05-08T18:07:43.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0043000000000001e-05 2024-05-08T18:07:43.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930219+0000", 2024-05-08T18:07:43.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010698500000000001 2024-05-08T18:07:43.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930345+0000", 2024-05-08T18:07:43.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012620400000000001 2024-05-08T18:07:43.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:43.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930579+0000", 2024-05-08T18:07:43.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234145 2024-05-08T18:07:43.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.931471+0000", 2024-05-08T18:07:43.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00089161500000000001 2024-05-08T18:07:43.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.932978+0000", 2024-05-08T18:07:43.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001507296 2024-05-08T18:07:43.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933044+0000", 2024-05-08T18:07:43.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6402000000000006e-05 2024-05-08T18:07:43.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933097+0000", 2024-05-08T18:07:43.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2278999999999999e-05 2024-05-08T18:07:43.970 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.970 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.970 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.971 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:681 6.e e32/26 6:748722ff:gc::gc.6:head v 32'7, mlcod=32'5)", 2024-05-08T18:07:43.971 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:07:43.971 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.933339280999999, 2024-05-08T18:07:43.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003318185, 2024-05-08T18:07:43.971 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.971 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.971 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.971 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:07:43.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:07:43.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960849+0000", 2024-05-08T18:07:43.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.423e-06 2024-05-08T18:07:43.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960859+0000", 2024-05-08T18:07:43.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3170000000000008e-06 2024-05-08T18:07:43.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960874+0000", 2024-05-08T18:07:43.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5125e-05 2024-05-08T18:07:43.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960884+0000", 2024-05-08T18:07:43.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8120000000000002e-06 2024-05-08T18:07:43.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960972+0000", 2024-05-08T18:07:43.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8540000000000003e-05 2024-05-08T18:07:43.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960996+0000", 2024-05-08T18:07:43.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3479999999999999e-05 2024-05-08T18:07:43.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964110+0000", 2024-05-08T18:07:43.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031142729999999999 2024-05-08T18:07:43.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964166+0000", 2024-05-08T18:07:43.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6215000000000003e-05 2024-05-08T18:07:43.975 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.975 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.975 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.975 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.975 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:07:43.975 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.842303185999999, 2024-05-08T18:07:43.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030648379999999999, 2024-05-08T18:07:43.975 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.975 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.975 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.975 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.975 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.976 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.976 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 733 2024-05-08T18:07:43.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.976 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:07:43.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:07:43.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051887+0000", 2024-05-08T18:07:43.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.74e-06 2024-05-08T18:07:43.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051900+0000", 2024-05-08T18:07:43.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3113e-05 2024-05-08T18:07:43.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051931+0000", 2024-05-08T18:07:43.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1665999999999998e-05 2024-05-08T18:07:43.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051946+0000", 2024-05-08T18:07:43.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4780000000000001e-05 2024-05-08T18:07:43.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052078+0000", 2024-05-08T18:07:43.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013133200000000001 2024-05-08T18:07:43.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052338+0000", 2024-05-08T18:07:43.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026056899999999999 2024-05-08T18:07:43.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:43.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052652+0000", 2024-05-08T18:07:43.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031396700000000001 2024-05-08T18:07:43.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.053668+0000", 2024-05-08T18:07:43.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00101574 2024-05-08T18:07:43.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054800+0000", 2024-05-08T18:07:43.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011319819999999999 2024-05-08T18:07:43.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054884+0000", 2024-05-08T18:07:43.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4005999999999995e-05 2024-05-08T18:07:43.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054949+0000", 2024-05-08T18:07:43.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4943000000000005e-05 2024-05-08T18:07:43.980 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.980 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.980 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.981 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.981 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:07:43.981 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.838448550999999, 2024-05-08T18:07:43.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029745919999999999, 2024-05-08T18:07:43.981 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.981 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.981 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.981 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.981 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.981 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.981 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 735 2024-05-08T18:07:43.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.981 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:07:43.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:07:43.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055741+0000", 2024-05-08T18:07:43.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.984e-06 2024-05-08T18:07:43.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055766+0000", 2024-05-08T18:07:43.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5253e-05 2024-05-08T18:07:43.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055785+0000", 2024-05-08T18:07:43.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9559999999999999e-05 2024-05-08T18:07:43.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055798+0000", 2024-05-08T18:07:43.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-05 2024-05-08T18:07:43.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055932+0000", 2024-05-08T18:07:43.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134609 2024-05-08T18:07:43.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056184+0000", 2024-05-08T18:07:43.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025167800000000003 2024-05-08T18:07:43.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:43.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056680+0000", 2024-05-08T18:07:43.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049576299999999998 2024-05-08T18:07:43.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058060+0000", 2024-05-08T18:07:43.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013801 2024-05-08T18:07:43.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058447+0000", 2024-05-08T18:07:43.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038695299999999999 2024-05-08T18:07:43.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058601+0000", 2024-05-08T18:07:43.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015396299999999999 2024-05-08T18:07:43.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058713+0000", 2024-05-08T18:07:43.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112389 2024-05-08T18:07:43.986 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.986 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.986 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.986 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.986 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:07:43.986 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.731433201000002, 2024-05-08T18:07:43.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029913650000000002, 2024-05-08T18:07:43.986 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.986 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.986 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.987 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.987 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.987 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.987 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 781 2024-05-08T18:07:43.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.987 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:07:43.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:07:43.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162757+0000", 2024-05-08T18:07:43.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:07:43.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162770+0000", 2024-05-08T18:07:43.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3406e-05 2024-05-08T18:07:43.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162799+0000", 2024-05-08T18:07:43.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-05 2024-05-08T18:07:43.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162813+0000", 2024-05-08T18:07:43.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:07:43.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162942+0000", 2024-05-08T18:07:43.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012902200000000001 2024-05-08T18:07:43.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163159+0000", 2024-05-08T18:07:43.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021738500000000001 2024-05-08T18:07:43.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163476+0000", 2024-05-08T18:07:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031666499999999999 2024-05-08T18:07:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.164533+0000", 2024-05-08T18:07:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010574219999999999 2024-05-08T18:07:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165587+0000", 2024-05-08T18:07:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001053476 2024-05-08T18:07:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165674+0000", 2024-05-08T18:07:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6725999999999996e-05 2024-05-08T18:07:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165745+0000", 2024-05-08T18:07:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1779000000000005e-05 2024-05-08T18:07:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:43.991 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:07:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.348843352999999, 2024-05-08T18:07:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029834750000000002, 2024-05-08T18:07:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 946 2024-05-08T18:07:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:07:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:07:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545346+0000", 2024-05-08T18:07:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6570000000000001e-06 2024-05-08T18:07:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545357+0000", 2024-05-08T18:07:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0740000000000001e-05 2024-05-08T18:07:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:43.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545384+0000", 2024-05-08T18:07:43.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6780000000000001e-05 2024-05-08T18:07:43.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:43.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545398+0000", 2024-05-08T18:07:43.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3936e-05 2024-05-08T18:07:43.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:43.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545515+0000", 2024-05-08T18:07:43.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117413 2024-05-08T18:07:43.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:43.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545751+0000", 2024-05-08T18:07:43.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023559500000000001 2024-05-08T18:07:43.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:43.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.546075+0000", 2024-05-08T18:07:43.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000324357 2024-05-08T18:07:43.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:43.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.547104+0000", 2024-05-08T18:07:43.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010285959999999999 2024-05-08T18:07:43.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:43.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548141+0000", 2024-05-08T18:07:43.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001036922 2024-05-08T18:07:43.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:43.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548223+0000", 2024-05-08T18:07:43.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2260000000000002e-05 2024-05-08T18:07:43.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:43.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:43.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:43.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548327+0000", 2024-05-08T18:07:43.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104219 2024-05-08T18:07:43.997 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.997 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.997 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.997 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:43.997 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:43.997 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:43.998 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:07:43.999 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:07:43.995+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:07:44.072 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:07:44.131 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:44.133+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:44.161 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:44.161 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:44.161 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:44.174 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:07:44.219 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:44.221+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:44.227 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:07:44.227 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:07:44.259 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:07:44.259 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:07:44.268 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-05-08T18:07:44.291 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:07:44.291 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:07:44.300 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:44.301+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:44.312 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:07:44.313 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:07:44.344 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:07:44.344 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:07:44.354 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:44.354 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:44.371 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:07:44.377 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:07:44.377 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:07:44.398 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:07:44.398 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:07:44.401 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:44.401+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:44.418 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:07:44.419 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:07:44.487 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:44.487 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:44.500 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:07:44.502 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:44.503+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:44.603 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:44.605+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:44.606 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:44.607 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:44.619 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:07:44.707 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:44.709+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:44.778 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:44.778 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:44.791 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:07:44.835 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:44.837+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:44.906 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:44.905+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:44.952 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:44.952 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:44.965 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:07:45.011 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:45.011+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:45.097 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:45.097 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:45.107 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:45.107+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:45.112 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:07:45.208 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:45.213+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:45.269 INFO:teuthology.orchestra.run.smithi080.stderr:set 4.3f pg_upmap mapping to [3,7] 2024-05-08T18:07:45.280 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:45.280 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:45.295 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:07:45.339 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:45.341+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:45.410 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:45.409+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:45.412 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:45.412 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:45.428 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:07:45.511 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:45.507+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:45.551 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:45.551 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:45.565 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:07:45.651 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:45.651+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:45.713 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:45.713+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:45.746 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:07:45.814 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:45.817+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:45.912 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:45.913 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:45.915 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:45.917+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:45.926 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:07:46.016 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:46.021+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:46.051 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:46.052 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:46.065 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:07:46.118 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:46.117+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:46.187 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:46.187 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:46.202 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:07:46.218 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:46.217+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:46.286 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:07:46.319 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:46.315+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:46.320 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:46.320 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:46.334 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:07:46.420 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:46.421+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:46.435 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:07:46.499 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:46.499 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:46.513 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:07:46.563 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:46.563+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:46.571 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:07:46.571 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:07:46.588 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:07:46.588 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:07:46.604 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:07:46.604 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:07:46.620 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:07:46.620 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:07:46.621 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:46.619+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:46.636 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:46.636 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:46.641 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:07:46.641 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:07:46.651 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:07:46.659 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:07:46.659 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:07:46.678 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:07:46.678 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:07:46.696 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:07:46.696 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:07:46.722 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:46.725+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:46.822 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:07:46.822 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:07:46.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:07:46.823 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:07:46.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.823 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.823 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:07:46.823 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.006797012, 2024-05-08T18:07:46.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.16213206199999999, 2024-05-08T18:07:46.823 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.823 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.823 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.823 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.823 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.823 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.824 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1 2024-05-08T18:07:46.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.824 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:07:46.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:07:46.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814494+0000", 2024-05-08T18:07:46.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:07:46.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814520+0000", 2024-05-08T18:07:46.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-05 2024-05-08T18:07:46.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814543+0000", 2024-05-08T18:07:46.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2353000000000001e-05 2024-05-08T18:07:46.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814563+0000", 2024-05-08T18:07:46.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.048e-05 2024-05-08T18:07:46.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814677+0000", 2024-05-08T18:07:46.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113632 2024-05-08T18:07:46.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:07:46.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814705+0000", 2024-05-08T18:07:46.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8626999999999999e-05 2024-05-08T18:07:46.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971115+0000", 2024-05-08T18:07:46.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.156409825 2024-05-08T18:07:46.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971438+0000", 2024-05-08T18:07:46.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00032289200000000002 2024-05-08T18:07:46.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971849+0000", 2024-05-08T18:07:46.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041139300000000002 2024-05-08T18:07:46.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.975364+0000", 2024-05-08T18:07:46.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035148390000000001 2024-05-08T18:07:46.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976474+0000", 2024-05-08T18:07:46.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001110099 2024-05-08T18:07:46.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976564+0000", 2024-05-08T18:07:46.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9522000000000001e-05 2024-05-08T18:07:46.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976624+0000", 2024-05-08T18:07:46.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9616e-05 2024-05-08T18:07:46.829 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.829 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.829 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.829 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.829 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:07:46.829 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.808847565999997, 2024-05-08T18:07:46.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010762776999999999, 2024-05-08T18:07:46.830 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.830 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.830 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.830 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.830 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.830 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.830 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 24 2024-05-08T18:07:46.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.830 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:07:46.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:07:46.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012442+0000", 2024-05-08T18:07:46.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.4300000000000002e-07 2024-05-08T18:07:46.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012573+0000", 2024-05-08T18:07:46.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013108299999999999 2024-05-08T18:07:46.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012592+0000", 2024-05-08T18:07:46.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9009e-05 2024-05-08T18:07:46.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012610+0000", 2024-05-08T18:07:46.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.789e-05 2024-05-08T18:07:46.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019108+0000", 2024-05-08T18:07:46.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064981470000000001 2024-05-08T18:07:46.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019348+0000", 2024-05-08T18:07:46.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024006099999999999 2024-05-08T18:07:46.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019751+0000", 2024-05-08T18:07:46.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040324099999999998 2024-05-08T18:07:46.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.022727+0000", 2024-05-08T18:07:46.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002976107 2024-05-08T18:07:46.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.022826+0000", 2024-05-08T18:07:46.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8626000000000001e-05 2024-05-08T18:07:46.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023036+0000", 2024-05-08T18:07:46.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000209578 2024-05-08T18:07:46.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023204+0000", 2024-05-08T18:07:46.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016819200000000001 2024-05-08T18:07:46.835 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.835 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.835 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.835 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.835 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:07:46.835 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.808660471000003, 2024-05-08T18:07:46.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011074977999999999, 2024-05-08T18:07:46.835 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.835 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.835 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.835 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.835 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.836 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.836 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 25 2024-05-08T18:07:46.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.836 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:07:46.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:07:46.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012629+0000", 2024-05-08T18:07:46.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7700000000000004e-07 2024-05-08T18:07:46.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012636+0000", 2024-05-08T18:07:46.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-05-08T18:07:46.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012646+0000", 2024-05-08T18:07:46.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0147e-05 2024-05-08T18:07:46.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012657+0000", 2024-05-08T18:07:46.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0473e-05 2024-05-08T18:07:46.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021198+0000", 2024-05-08T18:07:46.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0085417510000000002 2024-05-08T18:07:46.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021445+0000", 2024-05-08T18:07:46.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024665100000000002 2024-05-08T18:07:46.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021820+0000", 2024-05-08T18:07:46.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037519400000000003 2024-05-08T18:07:46.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023231+0000", 2024-05-08T18:07:46.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001410412 2024-05-08T18:07:46.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023550+0000", 2024-05-08T18:07:46.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000319368 2024-05-08T18:07:46.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023632+0000", 2024-05-08T18:07:46.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2366000000000004e-05 2024-05-08T18:07:46.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023703+0000", 2024-05-08T18:07:46.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0568999999999995e-05 2024-05-08T18:07:46.840 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.840 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.840 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.841 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.841 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:07:46.841 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.712314683999999, 2024-05-08T18:07:46.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011460965, 2024-05-08T18:07:46.841 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.841 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.841 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.841 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.841 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.841 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.841 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 45 2024-05-08T18:07:46.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.842 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:07:46.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:07:46.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108975+0000", 2024-05-08T18:07:46.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:07:46.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108983+0000", 2024-05-08T18:07:46.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6669999999999996e-06 2024-05-08T18:07:46.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109005+0000", 2024-05-08T18:07:46.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2787000000000001e-05 2024-05-08T18:07:46.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109020+0000", 2024-05-08T18:07:46.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4192999999999999e-05 2024-05-08T18:07:46.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116378+0000", 2024-05-08T18:07:46.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073585600000000001 2024-05-08T18:07:46.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116516+0000", 2024-05-08T18:07:46.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000137739 2024-05-08T18:07:46.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116747+0000", 2024-05-08T18:07:46.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023132799999999999 2024-05-08T18:07:46.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120140+0000", 2024-05-08T18:07:46.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033931439999999998 2024-05-08T18:07:46.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120290+0000", 2024-05-08T18:07:46.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149765 2024-05-08T18:07:46.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120369+0000", 2024-05-08T18:07:46.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.907e-05 2024-05-08T18:07:46.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120435+0000", 2024-05-08T18:07:46.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5642999999999995e-05 2024-05-08T18:07:46.846 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.846 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.846 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.847 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.847 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:07:46.847 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.712250591, 2024-05-08T18:07:46.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013705973999999999, 2024-05-08T18:07:46.847 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.847 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.847 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.847 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.847 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.847 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.847 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:07:46.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.847 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:07:46.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:07:46.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109039+0000", 2024-05-08T18:07:46.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:07:46.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109044+0000", 2024-05-08T18:07:46.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6699999999999999e-06 2024-05-08T18:07:46.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109054+0000", 2024-05-08T18:07:46.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7100000000000002e-06 2024-05-08T18:07:46.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109064+0000", 2024-05-08T18:07:46.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5740000000000002e-06 2024-05-08T18:07:46.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.117676+0000", 2024-05-08T18:07:46.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086126060000000001 2024-05-08T18:07:46.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.117828+0000", 2024-05-08T18:07:46.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151552 2024-05-08T18:07:46.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118041+0000", 2024-05-08T18:07:46.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000212692 2024-05-08T18:07:46.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120269+0000", 2024-05-08T18:07:46.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022281860000000001 2024-05-08T18:07:46.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122593+0000", 2024-05-08T18:07:46.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023239419999999998 2024-05-08T18:07:46.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122672+0000", 2024-05-08T18:07:46.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9579999999999994e-05 2024-05-08T18:07:46.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122744+0000", 2024-05-08T18:07:46.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1695999999999999e-05 2024-05-08T18:07:46.852 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.852 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.852 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.852 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.852 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:07:46.852 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.712206748, 2024-05-08T18:07:46.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016228664, 2024-05-08T18:07:46.852 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.852 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.852 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.853 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.853 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.853 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.853 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 47 2024-05-08T18:07:46.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.853 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:07:46.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:07:46.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109083+0000", 2024-05-08T18:07:46.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4600000000000004e-07 2024-05-08T18:07:46.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109232+0000", 2024-05-08T18:07:46.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149782 2024-05-08T18:07:46.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109257+0000", 2024-05-08T18:07:46.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4856999999999999e-05 2024-05-08T18:07:46.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109272+0000", 2024-05-08T18:07:46.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.503e-05 2024-05-08T18:07:46.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118799+0000", 2024-05-08T18:07:46.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0095264400000000006 2024-05-08T18:07:46.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118947+0000", 2024-05-08T18:07:46.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014848199999999999 2024-05-08T18:07:46.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.119151+0000", 2024-05-08T18:07:46.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020350500000000001 2024-05-08T18:07:46.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121458+0000", 2024-05-08T18:07:46.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002307749 2024-05-08T18:07:46.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125170+0000", 2024-05-08T18:07:46.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037113409999999999 2024-05-08T18:07:46.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125246+0000", 2024-05-08T18:07:46.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6029e-05 2024-05-08T18:07:46.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125310+0000", 2024-05-08T18:07:46.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4702999999999994e-05 2024-05-08T18:07:46.857 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.857 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.858 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.858 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.858 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:07:46.858 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.711987229999998, 2024-05-08T18:07:46.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016305097000000001, 2024-05-08T18:07:46.858 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.858 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.858 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.858 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.858 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.858 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.858 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 48 2024-05-08T18:07:46.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.859 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:07:46.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:07:46.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109303+0000", 2024-05-08T18:07:46.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:07:46.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109332+0000", 2024-05-08T18:07:46.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9220000000000001e-05 2024-05-08T18:07:46.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109375+0000", 2024-05-08T18:07:46.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2765999999999997e-05 2024-05-08T18:07:46.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109394+0000", 2024-05-08T18:07:46.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8603000000000001e-05 2024-05-08T18:07:46.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120508+0000", 2024-05-08T18:07:46.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011114811 2024-05-08T18:07:46.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120663+0000", 2024-05-08T18:07:46.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000154332 2024-05-08T18:07:46.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120863+0000", 2024-05-08T18:07:46.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019995599999999999 2024-05-08T18:07:46.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125326+0000", 2024-05-08T18:07:46.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044631180000000003 2024-05-08T18:07:46.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125431+0000", 2024-05-08T18:07:46.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010522900000000001 2024-05-08T18:07:46.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125541+0000", 2024-05-08T18:07:46.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109802 2024-05-08T18:07:46.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125606+0000", 2024-05-08T18:07:46.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5549999999999994e-05 2024-05-08T18:07:46.863 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.863 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.863 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.863 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.863 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:07:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.711866911000001, 2024-05-08T18:07:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016563135, 2024-05-08T18:07:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 49 2024-05-08T18:07:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:07:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:07:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109423+0000", 2024-05-08T18:07:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5969999999999999e-06 2024-05-08T18:07:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109434+0000", 2024-05-08T18:07:46.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.113e-05 2024-05-08T18:07:46.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109455+0000", 2024-05-08T18:07:46.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0873000000000002e-05 2024-05-08T18:07:46.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109469+0000", 2024-05-08T18:07:46.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4039999999999999e-05 2024-05-08T18:07:46.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121566+0000", 2024-05-08T18:07:46.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012096325999999999 2024-05-08T18:07:46.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121725+0000", 2024-05-08T18:07:46.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015932899999999999 2024-05-08T18:07:46.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121981+0000", 2024-05-08T18:07:46.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025583799999999999 2024-05-08T18:07:46.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125680+0000", 2024-05-08T18:07:46.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0036995579999999999 2024-05-08T18:07:46.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125838+0000", 2024-05-08T18:07:46.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015731499999999999 2024-05-08T18:07:46.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125914+0000", 2024-05-08T18:07:46.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6686000000000004e-05 2024-05-08T18:07:46.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125985+0000", 2024-05-08T18:07:46.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0443000000000003e-05 2024-05-08T18:07:46.869 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.869 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.869 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.869 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.869 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:07:46.869 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.711794531999999, 2024-05-08T18:07:46.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016620291999999998, 2024-05-08T18:07:46.869 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.869 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.869 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.869 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.870 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.870 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.870 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 50 2024-05-08T18:07:46.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.870 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:07:46.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:07:46.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109495+0000", 2024-05-08T18:07:46.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.477e-06 2024-05-08T18:07:46.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109692+0000", 2024-05-08T18:07:46.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019638199999999999 2024-05-08T18:07:46.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109733+0000", 2024-05-08T18:07:46.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1093000000000001e-05 2024-05-08T18:07:46.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109745+0000", 2024-05-08T18:07:46.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1715999999999999e-05 2024-05-08T18:07:46.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122839+0000", 2024-05-08T18:07:46.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013094809000000001 2024-05-08T18:07:46.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122980+0000", 2024-05-08T18:07:46.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140829 2024-05-08T18:07:46.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.123239+0000", 2024-05-08T18:07:46.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025834799999999999 2024-05-08T18:07:46.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125810+0000", 2024-05-08T18:07:46.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025717729999999999 2024-05-08T18:07:46.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126001+0000", 2024-05-08T18:07:46.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019013600000000001 2024-05-08T18:07:46.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126064+0000", 2024-05-08T18:07:46.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3301999999999998e-05 2024-05-08T18:07:46.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126114+0000", 2024-05-08T18:07:46.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0426999999999997e-05 2024-05-08T18:07:46.874 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.874 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.874 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.875 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.875 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:07:46.875 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.711515384000002, 2024-05-08T18:07:46.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018305669, 2024-05-08T18:07:46.875 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.875 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.875 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.875 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.875 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.875 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.875 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 51 2024-05-08T18:07:46.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.875 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:07:46.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:07:46.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109775+0000", 2024-05-08T18:07:46.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5269999999999999e-06 2024-05-08T18:07:46.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109786+0000", 2024-05-08T18:07:46.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1296e-05 2024-05-08T18:07:46.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109806+0000", 2024-05-08T18:07:46.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0114000000000001e-05 2024-05-08T18:07:46.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109823+0000", 2024-05-08T18:07:46.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6665999999999999e-05 2024-05-08T18:07:46.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124193+0000", 2024-05-08T18:07:46.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014369916 2024-05-08T18:07:46.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124354+0000", 2024-05-08T18:07:46.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016167899999999999 2024-05-08T18:07:46.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124571+0000", 2024-05-08T18:07:46.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021652800000000001 2024-05-08T18:07:46.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126978+0000", 2024-05-08T18:07:46.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024071679999999999 2024-05-08T18:07:46.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127921+0000", 2024-05-08T18:07:46.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00094277599999999999 2024-05-08T18:07:46.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.128012+0000", 2024-05-08T18:07:46.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0818999999999999e-05 2024-05-08T18:07:46.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.128079+0000", 2024-05-08T18:07:46.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7180000000000004e-05 2024-05-08T18:07:46.879 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.879 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.880 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.880 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.880 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:07:46.880 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.711440277999998, 2024-05-08T18:07:46.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021440811000000001, 2024-05-08T18:07:46.880 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.880 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.880 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.880 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.880 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.880 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.880 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 52 2024-05-08T18:07:46.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.880 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:07:46.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:07:46.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109849+0000", 2024-05-08T18:07:46.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1370000000000001e-06 2024-05-08T18:07:46.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109861+0000", 2024-05-08T18:07:46.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1559999999999999e-05 2024-05-08T18:07:46.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109878+0000", 2024-05-08T18:07:46.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7105999999999999e-05 2024-05-08T18:07:46.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109892+0000", 2024-05-08T18:07:46.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3577000000000001e-05 2024-05-08T18:07:46.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126161+0000", 2024-05-08T18:07:46.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016269458000000001 2024-05-08T18:07:46.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126299+0000", 2024-05-08T18:07:46.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138405 2024-05-08T18:07:46.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126534+0000", 2024-05-08T18:07:46.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000234875 2024-05-08T18:07:46.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127543+0000", 2024-05-08T18:07:46.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001008852 2024-05-08T18:07:46.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131128+0000", 2024-05-08T18:07:46.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035844359999999999 2024-05-08T18:07:46.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131222+0000", 2024-05-08T18:07:46.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3905000000000003e-05 2024-05-08T18:07:46.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131289+0000", 2024-05-08T18:07:46.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7500000000000001e-05 2024-05-08T18:07:46.885 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.885 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.885 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.885 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.885 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:07:46.885 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.471154579, 2024-05-08T18:07:46.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010652125, 2024-05-08T18:07:46.885 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.885 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.885 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.885 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.885 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.885 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.886 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 67 2024-05-08T18:07:46.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.886 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:07:46.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:07:46.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350135+0000", 2024-05-08T18:07:46.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.083e-06 2024-05-08T18:07:46.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350141+0000", 2024-05-08T18:07:46.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.178e-06 2024-05-08T18:07:46.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350152+0000", 2024-05-08T18:07:46.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0706999999999999e-05 2024-05-08T18:07:46.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350159+0000", 2024-05-08T18:07:46.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3640000000000001e-06 2024-05-08T18:07:46.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352606+0000", 2024-05-08T18:07:46.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024470379999999999 2024-05-08T18:07:46.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352718+0000", 2024-05-08T18:07:46.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000111366 2024-05-08T18:07:46.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352887+0000", 2024-05-08T18:07:46.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016887900000000001 2024-05-08T18:07:46.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358041+0000", 2024-05-08T18:07:46.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051542940000000002 2024-05-08T18:07:46.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360681+0000", 2024-05-08T18:07:46.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026404639999999999 2024-05-08T18:07:46.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360726+0000", 2024-05-08T18:07:46.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4666999999999998e-05 2024-05-08T18:07:46.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360786+0000", 2024-05-08T18:07:46.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0084999999999998e-05 2024-05-08T18:07:46.890 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.890 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.890 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.890 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.890 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:07:46.890 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.470899191000001, 2024-05-08T18:07:46.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010500438000000001, 2024-05-08T18:07:46.891 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.891 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.891 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.891 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.891 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.891 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.891 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 68 2024-05-08T18:07:46.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.891 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:07:46.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:07:46.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350391+0000", 2024-05-08T18:07:46.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:07:46.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350398+0000", 2024-05-08T18:07:46.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6599999999999995e-06 2024-05-08T18:07:46.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350414+0000", 2024-05-08T18:07:46.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6101000000000001e-05 2024-05-08T18:07:46.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350425+0000", 2024-05-08T18:07:46.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.099e-05 2024-05-08T18:07:46.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353737+0000", 2024-05-08T18:07:46.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033112739999999999 2024-05-08T18:07:46.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353810+0000", 2024-05-08T18:07:46.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3337999999999995e-05 2024-05-08T18:07:46.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353922+0000", 2024-05-08T18:07:46.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112409 2024-05-08T18:07:46.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358114+0000", 2024-05-08T18:07:46.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041912909999999998 2024-05-08T18:07:46.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360798+0000", 2024-05-08T18:07:46.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026845850000000002 2024-05-08T18:07:46.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360838+0000", 2024-05-08T18:07:46.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9619999999999997e-05 2024-05-08T18:07:46.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360890+0000", 2024-05-08T18:07:46.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.185e-05 2024-05-08T18:07:46.895 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.896 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.896 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.896 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.896 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:07:46.896 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.470522971000001, 2024-05-08T18:07:46.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010508969999999999, 2024-05-08T18:07:46.896 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.896 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.896 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.896 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.896 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.896 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.896 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 71 2024-05-08T18:07:46.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.61e-07 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350771+0000", 2024-05-08T18:07:46.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6720000000000003e-06 2024-05-08T18:07:46.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350781+0000", 2024-05-08T18:07:46.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9450000000000005e-06 2024-05-08T18:07:46.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350786+0000", 2024-05-08T18:07:46.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2530000000000004e-06 2024-05-08T18:07:46.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356065+0000", 2024-05-08T18:07:46.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052789239999999999 2024-05-08T18:07:46.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356174+0000", 2024-05-08T18:07:46.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108564 2024-05-08T18:07:46.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356336+0000", 2024-05-08T18:07:46.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162566 2024-05-08T18:07:46.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358285+0000", 2024-05-08T18:07:46.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001948443 2024-05-08T18:07:46.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361124+0000", 2024-05-08T18:07:46.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028390120000000001 2024-05-08T18:07:46.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361217+0000", 2024-05-08T18:07:46.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3899000000000003e-05 2024-05-08T18:07:46.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361275+0000", 2024-05-08T18:07:46.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7031000000000003e-05 2024-05-08T18:07:46.901 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.901 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.901 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.901 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.901 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:07:46.901 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.470445499, 2024-05-08T18:07:46.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010535020000000001, 2024-05-08T18:07:46.901 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.901 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.901 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.901 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.901 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.902 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.902 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 72 2024-05-08T18:07:46.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.902 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:07:46.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:07:46.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350844+0000", 2024-05-08T18:07:46.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:07:46.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350957+0000", 2024-05-08T18:07:46.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112958 2024-05-08T18:07:46.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350966+0000", 2024-05-08T18:07:46.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3440000000000007e-06 2024-05-08T18:07:46.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350972+0000", 2024-05-08T18:07:46.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.37e-06 2024-05-08T18:07:46.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356777+0000", 2024-05-08T18:07:46.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058049199999999999 2024-05-08T18:07:46.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356852+0000", 2024-05-08T18:07:46.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5109000000000002e-05 2024-05-08T18:07:46.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356961+0000", 2024-05-08T18:07:46.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108818 2024-05-08T18:07:46.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359695+0000", 2024-05-08T18:07:46.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002733685 2024-05-08T18:07:46.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361284+0000", 2024-05-08T18:07:46.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015888740000000001 2024-05-08T18:07:46.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361323+0000", 2024-05-08T18:07:46.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9824999999999999e-05 2024-05-08T18:07:46.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361378+0000", 2024-05-08T18:07:46.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4593999999999999e-05 2024-05-08T18:07:46.906 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.906 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.906 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.906 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.907 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:07:46.907 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.470305697000001, 2024-05-08T18:07:46.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01225805, 2024-05-08T18:07:46.907 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.907 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.907 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.907 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.907 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.907 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.907 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 73 2024-05-08T18:07:46.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.907 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:07:46.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0999999999999999e-07 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350987+0000", 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3529999999999999e-06 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350994+0000", 2024-05-08T18:07:46.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0840000000000003e-06 2024-05-08T18:07:46.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350998+0000", 2024-05-08T18:07:46.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.194e-06 2024-05-08T18:07:46.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358336+0000", 2024-05-08T18:07:46.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073376070000000003 2024-05-08T18:07:46.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358456+0000", 2024-05-08T18:07:46.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012042199999999999 2024-05-08T18:07:46.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358615+0000", 2024-05-08T18:07:46.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015928399999999999 2024-05-08T18:07:46.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.362117+0000", 2024-05-08T18:07:46.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035021039999999998 2024-05-08T18:07:46.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363139+0000", 2024-05-08T18:07:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010220349999999999 2024-05-08T18:07:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363181+0000", 2024-05-08T18:07:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1465999999999999e-05 2024-05-08T18:07:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363241+0000", 2024-05-08T18:07:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9991000000000002e-05 2024-05-08T18:07:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.912 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.912 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:07:46.912 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.470280879999997, 2024-05-08T18:07:46.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012698229, 2024-05-08T18:07:46.912 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.912 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.912 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.912 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.912 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.912 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.912 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 74 2024-05-08T18:07:46.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.912 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:07:46.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:07:46.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:07:46.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4000000000000002e-07 2024-05-08T18:07:46.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351013+0000", 2024-05-08T18:07:46.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8239999999999999e-06 2024-05-08T18:07:46.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351020+0000", 2024-05-08T18:07:46.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.52e-06 2024-05-08T18:07:46.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351025+0000", 2024-05-08T18:07:46.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3499999999999999e-06 2024-05-08T18:07:46.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359063+0000", 2024-05-08T18:07:46.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0080381800000000007 2024-05-08T18:07:46.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359140+0000", 2024-05-08T18:07:46.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7225999999999995e-05 2024-05-08T18:07:46.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359256+0000", 2024-05-08T18:07:46.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011537899999999999 2024-05-08T18:07:46.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363249+0000", 2024-05-08T18:07:46.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039937089999999998 2024-05-08T18:07:46.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363584+0000", 2024-05-08T18:07:46.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033516500000000001 2024-05-08T18:07:46.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363654+0000", 2024-05-08T18:07:46.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9093999999999999e-05 2024-05-08T18:07:46.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363706+0000", 2024-05-08T18:07:46.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2342000000000001e-05 2024-05-08T18:07:46.917 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.917 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.917 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.917 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.917 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:07:46.917 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.47024262, 2024-05-08T18:07:46.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015677229000000001, 2024-05-08T18:07:46.917 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.918 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.918 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.918 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.918 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.918 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.918 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 75 2024-05-08T18:07:46.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.918 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:07:46.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:07:46.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:07:46.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1699999999999999e-07 2024-05-08T18:07:46.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351141+0000", 2024-05-08T18:07:46.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4661999999999996e-05 2024-05-08T18:07:46.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351151+0000", 2024-05-08T18:07:46.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0084e-05 2024-05-08T18:07:46.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351160+0000", 2024-05-08T18:07:46.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2490000000000007e-06 2024-05-08T18:07:46.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359748+0000", 2024-05-08T18:07:46.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0085879849999999994 2024-05-08T18:07:46.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359820+0000", 2024-05-08T18:07:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2081000000000003e-05 2024-05-08T18:07:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359928+0000", 2024-05-08T18:07:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107157 2024-05-08T18:07:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363254+0000", 2024-05-08T18:07:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033268579999999998 2024-05-08T18:07:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366611+0000", 2024-05-08T18:07:46.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033564179999999999 2024-05-08T18:07:46.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366672+0000", 2024-05-08T18:07:46.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0714999999999997e-05 2024-05-08T18:07:46.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366723+0000", 2024-05-08T18:07:46.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1603e-05 2024-05-08T18:07:46.922 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.922 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.922 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.923 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.923 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:07:46.923 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.470118120000002, 2024-05-08T18:07:46.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015696418, 2024-05-08T18:07:46.923 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.923 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.923 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.923 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.923 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.923 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.923 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 76 2024-05-08T18:07:46.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.923 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:07:46.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:07:46.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351171+0000", 2024-05-08T18:07:46.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4600000000000004e-07 2024-05-08T18:07:46.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351174+0000", 2024-05-08T18:07:46.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2030000000000001e-06 2024-05-08T18:07:46.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351179+0000", 2024-05-08T18:07:46.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2079999999999999e-06 2024-05-08T18:07:46.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351184+0000", 2024-05-08T18:07:46.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3120000000000004e-06 2024-05-08T18:07:46.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361430+0000", 2024-05-08T18:07:46.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010246175 2024-05-08T18:07:46.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361545+0000", 2024-05-08T18:07:46.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115139 2024-05-08T18:07:46.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361712+0000", 2024-05-08T18:07:46.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000166491 2024-05-08T18:07:46.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363473+0000", 2024-05-08T18:07:46.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017610799999999999 2024-05-08T18:07:46.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366769+0000", 2024-05-08T18:07:46.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032964880000000002 2024-05-08T18:07:46.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366811+0000", 2024-05-08T18:07:46.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2296000000000003e-05 2024-05-08T18:07:46.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366867+0000", 2024-05-08T18:07:46.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5380000000000002e-05 2024-05-08T18:07:46.928 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.928 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.928 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.928 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:07:46.928 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:07:46.928 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.119190150999998, 2024-05-08T18:07:46.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010497067000000001, 2024-05-08T18:07:46.928 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:07:46.928 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:07:46.928 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:46.928 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:07:46.928 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:07:46.929 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:07:46.929 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 94 2024-05-08T18:07:46.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.929 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:07:46.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:07:46.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:07:46.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:07:46.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:07:46.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:07:46.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:07:46.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702099+0000", 2024-05-08T18:07:46.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4099999999999999e-07 2024-05-08T18:07:46.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:07:46.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702102+0000", 2024-05-08T18:07:46.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6650000000000001e-06 2024-05-08T18:07:46.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:07:46.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702108+0000", 2024-05-08T18:07:46.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.711e-06 2024-05-08T18:07:46.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:07:46.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702114+0000", 2024-05-08T18:07:46.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.241e-06 2024-05-08T18:07:46.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:07:46.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.708666+0000", 2024-05-08T18:07:46.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065511459999999999 2024-05-08T18:07:46.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:07:46.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.708833+0000", 2024-05-08T18:07:46.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000166966 2024-05-08T18:07:46.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:46.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.709171+0000", 2024-05-08T18:07:46.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033834000000000002 2024-05-08T18:07:46.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:07:46.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.710246+0000", 2024-05-08T18:07:46.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001074642 2024-05-08T18:07:46.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:46.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712422+0000", 2024-05-08T18:07:46.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021762370000000001 2024-05-08T18:07:46.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:07:46.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712521+0000", 2024-05-08T18:07:46.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9432999999999995e-05 2024-05-08T18:07:46.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:07:46.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:07:46.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:07:46.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712595+0000", 2024-05-08T18:07:46.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4245000000000005e-05 2024-05-08T18:07:46.933 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.933 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.933 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.933 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:07:46.933 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:07:46.933 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:07:46.935 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:07:46.935 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:46.933+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:47.035 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:47.037+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:47.068 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:47.068 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:47.068 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:47.068 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:47.082 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:07:47.167 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:47.169+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:47.238 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:47.237+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:47.246 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:47.247 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:47.247 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:07:47.247 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:07:47.247 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:47.261 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:07:47.287 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-05-08T18:07:47.359 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:47.361+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:47.413 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:07:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:07:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:07:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:52 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'31)", 2024-05-08T18:07:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:07:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 44.287625251999998, 2024-05-08T18:07:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00409947, 2024-05-08T18:07:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:07:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:07:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127167+0000", 2024-05-08T18:07:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7800000000000001e-07 2024-05-08T18:07:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127172+0000", 2024-05-08T18:07:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1120000000000004e-06 2024-05-08T18:07:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127183+0000", 2024-05-08T18:07:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1107000000000001e-05 2024-05-08T18:07:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127189+0000", 2024-05-08T18:07:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0310000000000004e-06 2024-05-08T18:07:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127237+0000", 2024-05-08T18:07:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7907000000000001e-05 2024-05-08T18:07:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127252+0000", 2024-05-08T18:07:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5373e-05 2024-05-08T18:07:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131206+0000", 2024-05-08T18:07:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039540199999999999 2024-05-08T18:07:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131265+0000", 2024-05-08T18:07:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9141999999999997e-05 2024-05-08T18:07:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-05-08T18:07:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:07:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 44.278866848, 2024-05-08T18:07:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049265589999999996, 2024-05-08T18:07:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:07:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:07:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135925+0000", 2024-05-08T18:07:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8100000000000002e-07 2024-05-08T18:07:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136007+0000", 2024-05-08T18:07:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1864000000000001e-05 2024-05-08T18:07:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136019+0000", 2024-05-08T18:07:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2438e-05 2024-05-08T18:07:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136026+0000", 2024-05-08T18:07:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0809999999999996e-06 2024-05-08T18:07:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136093+0000", 2024-05-08T18:07:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6769999999999999e-05 2024-05-08T18:07:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136108+0000", 2024-05-08T18:07:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.465e-05 2024-05-08T18:07:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140800+0000", 2024-05-08T18:07:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046919450000000003 2024-05-08T18:07:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140851+0000", 2024-05-08T18:07:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.113e-05 2024-05-08T18:07:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-05-08T18:07:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:07:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 44.062381637999998, 2024-05-08T18:07:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042257299999999996, 2024-05-08T18:07:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:07:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:07:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352410+0000", 2024-05-08T18:07:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7599999999999997e-07 2024-05-08T18:07:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352489+0000", 2024-05-08T18:07:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8564000000000002e-05 2024-05-08T18:07:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352500+0000", 2024-05-08T18:07:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1411e-05 2024-05-08T18:07:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352506+0000", 2024-05-08T18:07:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7309999999999998e-06 2024-05-08T18:07:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352569+0000", 2024-05-08T18:07:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3173e-05 2024-05-08T18:07:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352598+0000", 2024-05-08T18:07:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8855000000000001e-05 2024-05-08T18:07:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356592+0000", 2024-05-08T18:07:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039941539999999998 2024-05-08T18:07:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356635+0000", 2024-05-08T18:07:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3166e-05 2024-05-08T18:07:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:75 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'53, mlcod=15'43)", 2024-05-08T18:07:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 44.054210220999998, 2024-05-08T18:07:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063708030000000004, 2024-05-08T18:07:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:07:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360641+0000", 2024-05-08T18:07:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9273e-05 2024-05-08T18:07:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360651+0000", 2024-05-08T18:07:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0353000000000001e-05 2024-05-08T18:07:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360659+0000", 2024-05-08T18:07:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4789999999999999e-06 2024-05-08T18:07:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360720+0000", 2024-05-08T18:07:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699000000000007e-05 2024-05-08T18:07:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360739+0000", 2024-05-08T18:07:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8913999999999999e-05 2024-05-08T18:07:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366883+0000", 2024-05-08T18:07:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061438229999999996 2024-05-08T18:07:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366952+0000", 2024-05-08T18:07:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8677000000000007e-05 2024-05-08T18:07:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:76 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'54, mlcod=15'49)", 2024-05-08T18:07:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:07:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 44.052473716000002, 2024-05-08T18:07:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046550610000000003, 2024-05-08T18:07:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:07:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:07:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362318+0000", 2024-05-08T18:07:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.99e-07 2024-05-08T18:07:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362323+0000", 2024-05-08T18:07:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.566e-06 2024-05-08T18:07:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362334+0000", 2024-05-08T18:07:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1403000000000001e-05 2024-05-08T18:07:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362342+0000", 2024-05-08T18:07:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3420000000000008e-06 2024-05-08T18:07:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362396+0000", 2024-05-08T18:07:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3476000000000001e-05 2024-05-08T18:07:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362415+0000", 2024-05-08T18:07:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8787000000000002e-05 2024-05-08T18:07:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366954+0000", 2024-05-08T18:07:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045388609999999999 2024-05-08T18:07:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366972+0000", 2024-05-08T18:07:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8927e-05 2024-05-08T18:07:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:79 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'57, mlcod=15'53)", 2024-05-08T18:07:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:07:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 44.045077788, 2024-05-08T18:07:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045322499999999998, 2024-05-08T18:07:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:07:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:07:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369714+0000", 2024-05-08T18:07:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:07:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369787+0000", 2024-05-08T18:07:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3317000000000003e-05 2024-05-08T18:07:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369797+0000", 2024-05-08T18:07:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9510000000000001e-06 2024-05-08T18:07:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369802+0000", 2024-05-08T18:07:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8210000000000001e-06 2024-05-08T18:07:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369854+0000", 2024-05-08T18:07:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1751e-05 2024-05-08T18:07:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369880+0000", 2024-05-08T18:07:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6577999999999999e-05 2024-05-08T18:07:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374202+0000", 2024-05-08T18:07:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217029999999997 2024-05-08T18:07:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374246+0000", 2024-05-08T18:07:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3544000000000002e-05 2024-05-08T18:07:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:89 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'63, mlcod=15'60)", 2024-05-08T18:07:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.711535623000003, 2024-05-08T18:07:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057729900000000004, 2024-05-08T18:07:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:07:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703261+0000", 2024-05-08T18:07:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2569999999999998e-06 2024-05-08T18:07:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703272+0000", 2024-05-08T18:07:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0739e-05 2024-05-08T18:07:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703282+0000", 2024-05-08T18:07:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6250000000000002e-06 2024-05-08T18:07:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703333+0000", 2024-05-08T18:07:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1588000000000001e-05 2024-05-08T18:07:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703358+0000", 2024-05-08T18:07:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4913999999999999e-05 2024-05-08T18:07:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708907+0000", 2024-05-08T18:07:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055484829999999999 2024-05-08T18:07:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.709028+0000", 2024-05-08T18:07:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121667 2024-05-08T18:07:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-05-08T18:07:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:07:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.710470106000002, 2024-05-08T18:07:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0074185579999999996, 2024-05-08T18:07:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:07:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:07:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704322+0000", 2024-05-08T18:07:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8299999999999997e-07 2024-05-08T18:07:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704410+0000", 2024-05-08T18:07:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8552000000000002e-05 2024-05-08T18:07:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704421+0000", 2024-05-08T18:07:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0794e-05 2024-05-08T18:07:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704427+0000", 2024-05-08T18:07:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8699999999999997e-06 2024-05-08T18:07:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704481+0000", 2024-05-08T18:07:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4410999999999998e-05 2024-05-08T18:07:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704511+0000", 2024-05-08T18:07:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9906000000000001e-05 2024-05-08T18:07:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711682+0000", 2024-05-08T18:07:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071710209999999996 2024-05-08T18:07:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711740+0000", 2024-05-08T18:07:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7521e-05 2024-05-08T18:07:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:91 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'65, mlcod=15'60)", 2024-05-08T18:07:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:07:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.708925913000002, 2024-05-08T18:07:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059345600000000002, 2024-05-08T18:07:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.451 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:07:47.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:07:47.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705866+0000", 2024-05-08T18:07:47.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0900000000000001e-07 2024-05-08T18:07:47.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705872+0000", 2024-05-08T18:07:47.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0580000000000003e-06 2024-05-08T18:07:47.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705883+0000", 2024-05-08T18:07:47.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0986e-05 2024-05-08T18:07:47.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705889+0000", 2024-05-08T18:07:47.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6400000000000002e-06 2024-05-08T18:07:47.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705942+0000", 2024-05-08T18:07:47.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3726e-05 2024-05-08T18:07:47.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705963+0000", 2024-05-08T18:07:47.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0713e-05 2024-05-08T18:07:47.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711744+0000", 2024-05-08T18:07:47.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057812669999999997 2024-05-08T18:07:47.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711800+0000", 2024-05-08T18:07:47.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5461000000000003e-05 2024-05-08T18:07:47.454 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.454 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.454 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.454 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:92 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'66, mlcod=15'61)", 2024-05-08T18:07:47.454 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:07:47.454 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.707601564999997, 2024-05-08T18:07:47.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046553640000000004, 2024-05-08T18:07:47.455 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.455 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.455 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.455 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:07:47.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:07:47.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707191+0000", 2024-05-08T18:07:47.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9300000000000006e-07 2024-05-08T18:07:47.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707198+0000", 2024-05-08T18:07:47.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4669999999999998e-06 2024-05-08T18:07:47.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707214+0000", 2024-05-08T18:07:47.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5911000000000001e-05 2024-05-08T18:07:47.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707221+0000", 2024-05-08T18:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.43e-06 2024-05-08T18:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707283+0000", 2024-05-08T18:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1974e-05 2024-05-08T18:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707308+0000", 2024-05-08T18:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4589000000000001e-05 2024-05-08T18:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711802+0000", 2024-05-08T18:07:47.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044944939999999999 2024-05-08T18:07:47.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711845+0000", 2024-05-08T18:07:47.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2506000000000003e-05 2024-05-08T18:07:47.458 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.458 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.458 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.458 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:93 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'67, mlcod=15'61)", 2024-05-08T18:07:47.458 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:07:47.459 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.706771308, 2024-05-08T18:07:47.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217760000000003, 2024-05-08T18:07:47.461 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.462 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.462 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.462 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:07:47.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:07:47.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708021+0000", 2024-05-08T18:07:47.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.92e-07 2024-05-08T18:07:47.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708106+0000", 2024-05-08T18:07:47.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5400000000000002e-05 2024-05-08T18:07:47.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708116+0000", 2024-05-08T18:07:47.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0482000000000001e-05 2024-05-08T18:07:47.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708124+0000", 2024-05-08T18:07:47.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5349999999999999e-06 2024-05-08T18:07:47.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708182+0000", 2024-05-08T18:07:47.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8130000000000001e-05 2024-05-08T18:07:47.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708203+0000", 2024-05-08T18:07:47.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1118e-05 2024-05-08T18:07:47.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712298+0000", 2024-05-08T18:07:47.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004094688 2024-05-08T18:07:47.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712342+0000", 2024-05-08T18:07:47.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3730999999999999e-05 2024-05-08T18:07:47.466 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.466 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.466 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.466 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:47.466 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:07:47.466 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.810345242, 2024-05-08T18:07:47.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087837890000000002, 2024-05-08T18:07:47.467 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.467 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.467 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.467 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:47.467 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:47.467 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:47.467 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210 2024-05-08T18:07:47.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.467 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:07:47.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:07:47.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604448+0000", 2024-05-08T18:07:47.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4229999999999999e-06 2024-05-08T18:07:47.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604460+0000", 2024-05-08T18:07:47.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:07:47.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604491+0000", 2024-05-08T18:07:47.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1004000000000003e-05 2024-05-08T18:07:47.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604513+0000", 2024-05-08T18:07:47.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1886e-05 2024-05-08T18:07:47.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604670+0000", 2024-05-08T18:07:47.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000156735 2024-05-08T18:07:47.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:07:47.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604680+0000", 2024-05-08T18:07:47.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0113e-05 2024-05-08T18:07:47.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609236+0000", 2024-05-08T18:07:47.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045557269999999999 2024-05-08T18:07:47.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609544+0000", 2024-05-08T18:07:47.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030863800000000002 2024-05-08T18:07:47.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:47.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.610952+0000", 2024-05-08T18:07:47.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014077269999999999 2024-05-08T18:07:47.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:47.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.612639+0000", 2024-05-08T18:07:47.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001686398 2024-05-08T18:07:47.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:47.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613101+0000", 2024-05-08T18:07:47.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00046249600000000001 2024-05-08T18:07:47.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613176+0000", 2024-05-08T18:07:47.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5032999999999998e-05 2024-05-08T18:07:47.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613230+0000", 2024-05-08T18:07:47.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3638999999999999e-05 2024-05-08T18:07:47.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.473 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.473 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:47.473 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:07:47.473 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.761757031999998, 2024-05-08T18:07:47.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046602199999999996, 2024-05-08T18:07:47.473 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.473 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.473 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.474 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:47.474 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:47.474 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:47.474 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 222 2024-05-08T18:07:47.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.474 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:07:47.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:07:47.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653037+0000", 2024-05-08T18:07:47.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:07:47.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653048+0000", 2024-05-08T18:07:47.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:07:47.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653077+0000", 2024-05-08T18:07:47.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9326e-05 2024-05-08T18:07:47.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653098+0000", 2024-05-08T18:07:47.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1327000000000001e-05 2024-05-08T18:07:47.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653230+0000", 2024-05-08T18:07:47.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013206599999999999 2024-05-08T18:07:47.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653444+0000", 2024-05-08T18:07:47.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000213401 2024-05-08T18:07:47.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:47.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653852+0000", 2024-05-08T18:07:47.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040808700000000001 2024-05-08T18:07:47.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:47.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.656108+0000", 2024-05-08T18:07:47.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022565739999999999 2024-05-08T18:07:47.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:47.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657533+0000", 2024-05-08T18:07:47.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014241799999999999 2024-05-08T18:07:47.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657629+0000", 2024-05-08T18:07:47.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6435999999999996e-05 2024-05-08T18:07:47.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657694+0000", 2024-05-08T18:07:47.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5349000000000001e-05 2024-05-08T18:07:47.480 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.480 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.480 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.481 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:461 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:47.481 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:07:47.481 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.635135225999999, 2024-05-08T18:07:47.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040933549999999999, 2024-05-08T18:07:47.481 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.481 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.482 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.482 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:47.482 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:47.482 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:47.482 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 461 2024-05-08T18:07:47.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.483 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:07:47.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:07:47.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779657+0000", 2024-05-08T18:07:47.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.252e-06 2024-05-08T18:07:47.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779663+0000", 2024-05-08T18:07:47.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0170000000000002e-06 2024-05-08T18:07:47.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779676+0000", 2024-05-08T18:07:47.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.296e-05 2024-05-08T18:07:47.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779684+0000", 2024-05-08T18:07:47.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4209999999999998e-06 2024-05-08T18:07:47.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779736+0000", 2024-05-08T18:07:47.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2296999999999998e-05 2024-05-08T18:07:47.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779787+0000", 2024-05-08T18:07:47.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0954e-05 2024-05-08T18:07:47.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:47.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779897+0000", 2024-05-08T18:07:47.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011001999999999999 2024-05-08T18:07:47.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:47.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780506+0000", 2024-05-08T18:07:47.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060872599999999997 2024-05-08T18:07:47.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:47.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783690+0000", 2024-05-08T18:07:47.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031847210000000002 2024-05-08T18:07:47.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783722+0000", 2024-05-08T18:07:47.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1608e-05 2024-05-08T18:07:47.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783749+0000", 2024-05-08T18:07:47.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7379e-05 2024-05-08T18:07:47.487 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.487 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.487 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.487 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:491 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:47.487 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:07:47.487 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.612871618, 2024-05-08T18:07:47.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059507570000000001, 2024-05-08T18:07:47.487 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.488 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.488 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.488 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:47.488 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:47.488 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:47.488 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 491 2024-05-08T18:07:47.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.488 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:07:47.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:07:47.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801921+0000", 2024-05-08T18:07:47.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6959999999999999e-06 2024-05-08T18:07:47.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801928+0000", 2024-05-08T18:07:47.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0299999999999996e-06 2024-05-08T18:07:47.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801944+0000", 2024-05-08T18:07:47.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285e-05 2024-05-08T18:07:47.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801953+0000", 2024-05-08T18:07:47.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1849999999999993e-06 2024-05-08T18:07:47.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802008+0000", 2024-05-08T18:07:47.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5379e-05 2024-05-08T18:07:47.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802093+0000", 2024-05-08T18:07:47.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4907000000000005e-05 2024-05-08T18:07:47.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:47.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802217+0000", 2024-05-08T18:07:47.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000124253 2024-05-08T18:07:47.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:47.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802725+0000", 2024-05-08T18:07:47.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050758699999999999 2024-05-08T18:07:47.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:47.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807807+0000", 2024-05-08T18:07:47.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005082133 2024-05-08T18:07:47.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807840+0000", 2024-05-08T18:07:47.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3399000000000003e-05 2024-05-08T18:07:47.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807870+0000", 2024-05-08T18:07:47.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9903000000000002e-05 2024-05-08T18:07:47.492 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.492 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.492 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.493 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:47.493 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:07:47.493 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.606529414000001, 2024-05-08T18:07:47.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056057140000000004, 2024-05-08T18:07:47.493 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.493 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.493 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.493 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:47.493 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:47.493 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:47.493 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 502 2024-05-08T18:07:47.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.493 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:07:47.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:07:47.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808263+0000", 2024-05-08T18:07:47.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.054e-06 2024-05-08T18:07:47.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808268+0000", 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4829999999999999e-06 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808279+0000", 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0710000000000001e-05 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808285+0000", 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0610000000000001e-06 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808331+0000", 2024-05-08T18:07:47.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5939000000000002e-05 2024-05-08T18:07:47.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808380+0000", 2024-05-08T18:07:47.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9382999999999998e-05 2024-05-08T18:07:47.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:47.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808484+0000", 2024-05-08T18:07:47.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010410499999999999 2024-05-08T18:07:47.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:47.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.809035+0000", 2024-05-08T18:07:47.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000550969 2024-05-08T18:07:47.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:47.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813811+0000", 2024-05-08T18:07:47.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047759830000000001 2024-05-08T18:07:47.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813842+0000", 2024-05-08T18:07:47.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0778000000000002e-05 2024-05-08T18:07:47.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813867+0000", 2024-05-08T18:07:47.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5249000000000002e-05 2024-05-08T18:07:47.498 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.498 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.498 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.498 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:47.498 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:07:47.499 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.579999128000001, 2024-05-08T18:07:47.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041392019999999998, 2024-05-08T18:07:47.499 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.499 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.499 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.499 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:47.499 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:47.499 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:47.499 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 527 2024-05-08T18:07:47.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.500 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:07:47.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:07:47.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834793+0000", 2024-05-08T18:07:47.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.212e-06 2024-05-08T18:07:47.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834799+0000", 2024-05-08T18:07:47.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.468e-06 2024-05-08T18:07:47.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834811+0000", 2024-05-08T18:07:47.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2602000000000001e-05 2024-05-08T18:07:47.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834819+0000", 2024-05-08T18:07:47.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6660000000000008e-06 2024-05-08T18:07:47.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834871+0000", 2024-05-08T18:07:47.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2450000000000001e-05 2024-05-08T18:07:47.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834973+0000", 2024-05-08T18:07:47.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101778 2024-05-08T18:07:47.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:47.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835114+0000", 2024-05-08T18:07:47.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014053399999999999 2024-05-08T18:07:47.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:47.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835758+0000", 2024-05-08T18:07:47.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064386100000000002 2024-05-08T18:07:47.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:47.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838876+0000", 2024-05-08T18:07:47.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031188890000000001 2024-05-08T18:07:47.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838907+0000", 2024-05-08T18:07:47.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-08T18:07:47.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838931+0000", 2024-05-08T18:07:47.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3822999999999999e-05 2024-05-08T18:07:47.505 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.505 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.505 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.505 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:47.505 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:07:47.505 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.575494148000001, 2024-05-08T18:07:47.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048358089999999999, 2024-05-08T18:07:47.505 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.505 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.505 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.505 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:47.506 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:47.506 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:47.506 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 534 2024-05-08T18:07:47.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.506 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:07:47.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:07:47.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839298+0000", 2024-05-08T18:07:47.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1429999999999999e-06 2024-05-08T18:07:47.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839304+0000", 2024-05-08T18:07:47.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4380000000000003e-06 2024-05-08T18:07:47.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839313+0000", 2024-05-08T18:07:47.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5210000000000008e-06 2024-05-08T18:07:47.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839318+0000", 2024-05-08T18:07:47.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0540000000000002e-06 2024-05-08T18:07:47.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839355+0000", 2024-05-08T18:07:47.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6541999999999997e-05 2024-05-08T18:07:47.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839400+0000", 2024-05-08T18:07:47.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4861999999999998e-05 2024-05-08T18:07:47.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:47.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839504+0000", 2024-05-08T18:07:47.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104169 2024-05-08T18:07:47.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:47.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.840046+0000", 2024-05-08T18:07:47.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054245400000000005 2024-05-08T18:07:47.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:47.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844075+0000", 2024-05-08T18:07:47.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040287559999999997 2024-05-08T18:07:47.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844108+0000", 2024-05-08T18:07:47.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2872e-05 2024-05-08T18:07:47.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844133+0000", 2024-05-08T18:07:47.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4998e-05 2024-05-08T18:07:47.511 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.511 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.511 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.511 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:544 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:47.511 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:07:47.511 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.562351138, 2024-05-08T18:07:47.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052743060000000003, 2024-05-08T18:07:47.511 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.511 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.511 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.511 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:47.511 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:47.511 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:47.512 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 544 2024-05-08T18:07:47.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.512 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:07:47.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:07:47.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852442+0000", 2024-05-08T18:07:47.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.88e-06 2024-05-08T18:07:47.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852450+0000", 2024-05-08T18:07:47.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1999999999999994e-06 2024-05-08T18:07:47.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852472+0000", 2024-05-08T18:07:47.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2160000000000001e-05 2024-05-08T18:07:47.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852487+0000", 2024-05-08T18:07:47.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5044e-05 2024-05-08T18:07:47.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852550+0000", 2024-05-08T18:07:47.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3152999999999997e-05 2024-05-08T18:07:47.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852608+0000", 2024-05-08T18:07:47.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8026000000000003e-05 2024-05-08T18:07:47.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:47.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852727+0000", 2024-05-08T18:07:47.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118919 2024-05-08T18:07:47.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:47.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.853180+0000", 2024-05-08T18:07:47.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045216599999999999 2024-05-08T18:07:47.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:47.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857638+0000", 2024-05-08T18:07:47.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044584510000000004 2024-05-08T18:07:47.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857672+0000", 2024-05-08T18:07:47.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3571000000000001e-05 2024-05-08T18:07:47.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857714+0000", 2024-05-08T18:07:47.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2735999999999999e-05 2024-05-08T18:07:47.516 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.516 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.516 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.516 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:47.516 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:07:47.516 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.234522359, 2024-05-08T18:07:47.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004733213, 2024-05-08T18:07:47.517 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.517 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.517 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.517 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:47.517 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:47.517 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:47.517 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 789 2024-05-08T18:07:47.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.517 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:07:47.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:07:47.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180271+0000", 2024-05-08T18:07:47.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8700000000000001e-06 2024-05-08T18:07:47.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180281+0000", 2024-05-08T18:07:47.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0067e-05 2024-05-08T18:07:47.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180311+0000", 2024-05-08T18:07:47.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0783e-05 2024-05-08T18:07:47.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180333+0000", 2024-05-08T18:07:47.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1509999999999999e-05 2024-05-08T18:07:47.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180450+0000", 2024-05-08T18:07:47.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116686 2024-05-08T18:07:47.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180581+0000", 2024-05-08T18:07:47.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013103499999999999 2024-05-08T18:07:47.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:47.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180848+0000", 2024-05-08T18:07:47.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026750199999999997 2024-05-08T18:07:47.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:47.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184268+0000", 2024-05-08T18:07:47.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034198319999999998 2024-05-08T18:07:47.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:47.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184844+0000", 2024-05-08T18:07:47.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057643899999999999 2024-05-08T18:07:47.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184933+0000", 2024-05-08T18:07:47.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8692999999999999e-05 2024-05-08T18:07:47.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.185002+0000", 2024-05-08T18:07:47.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8795999999999997e-05 2024-05-08T18:07:47.521 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.521 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.521 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.522 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.522 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.522 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:47.523 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:07:47.523 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:47.525+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:47.624 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:47.623+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:47.702 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:47.702 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:47.703 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:47.703 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:47.717 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:07:47.725 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:47.723+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:47.826 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:47.823+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:47.841 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:47.841 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:47.841 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:07:47.841 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:07:47.841 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:47.855 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:07:47.927 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:07:47.923+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:07:47.977 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:47.978 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:07:47.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:07:47.978 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:07:47.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.978 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-05-08T18:07:47.978 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:07:47.978 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.408918218, 2024-05-08T18:07:47.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035750999999999999, 2024-05-08T18:07:47.978 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.978 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.978 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.978 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:07:47.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:07:47.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570203+0000", 2024-05-08T18:07:47.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6749999999999996e-06 2024-05-08T18:07:47.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570213+0000", 2024-05-08T18:07:47.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0139999999999999e-05 2024-05-08T18:07:47.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570231+0000", 2024-05-08T18:07:47.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8402000000000001e-05 2024-05-08T18:07:47.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570245+0000", 2024-05-08T18:07:47.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3135e-05 2024-05-08T18:07:47.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570338+0000", 2024-05-08T18:07:47.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3498000000000005e-05 2024-05-08T18:07:47.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570373+0000", 2024-05-08T18:07:47.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5179999999999999e-05 2024-05-08T18:07:47.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573694+0000", 2024-05-08T18:07:47.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003320524 2024-05-08T18:07:47.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573771+0000", 2024-05-08T18:07:47.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7546000000000006e-05 2024-05-08T18:07:47.982 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.982 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.982 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.982 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-05-08T18:07:47.982 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:07:47.983 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.403605255999999, 2024-05-08T18:07:47.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038280229999999998, 2024-05-08T18:07:47.983 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.983 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.983 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.983 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:07:47.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:07:47.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575510+0000", 2024-05-08T18:07:47.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0979999999999999e-06 2024-05-08T18:07:47.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575527+0000", 2024-05-08T18:07:47.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6393999999999999e-05 2024-05-08T18:07:47.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575549+0000", 2024-05-08T18:07:47.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1843000000000001e-05 2024-05-08T18:07:47.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575560+0000", 2024-05-08T18:07:47.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.186e-05 2024-05-08T18:07:47.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575651+0000", 2024-05-08T18:07:47.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1068000000000003e-05 2024-05-08T18:07:47.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575685+0000", 2024-05-08T18:07:47.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3614e-05 2024-05-08T18:07:47.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579231+0000", 2024-05-08T18:07:47.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003546249 2024-05-08T18:07:47.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579337+0000", 2024-05-08T18:07:47.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010589700000000001 2024-05-08T18:07:47.986 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.986 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.986 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.987 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-05-08T18:07:47.987 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:07:47.987 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.401567965000002, 2024-05-08T18:07:47.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004223157, 2024-05-08T18:07:47.987 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.987 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.987 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.987 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:07:47.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:07:47.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577548+0000", 2024-05-08T18:07:47.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.66e-06 2024-05-08T18:07:47.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577561+0000", 2024-05-08T18:07:47.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2533e-05 2024-05-08T18:07:47.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577585+0000", 2024-05-08T18:07:47.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3873e-05 2024-05-08T18:07:47.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577605+0000", 2024-05-08T18:07:47.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0477000000000001e-05 2024-05-08T18:07:47.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577717+0000", 2024-05-08T18:07:47.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011229499999999999 2024-05-08T18:07:47.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577777+0000", 2024-05-08T18:07:47.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.944e-05 2024-05-08T18:07:47.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581704+0000", 2024-05-08T18:07:47.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039267800000000004 2024-05-08T18:07:47.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581770+0000", 2024-05-08T18:07:47.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6099000000000005e-05 2024-05-08T18:07:47.991 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.991 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.991 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.991 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:54 7.d e29/28 7:b4812045:::notify.4:head v 29'1, mlcod=0'0)", 2024-05-08T18:07:47.991 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:07:47.991 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.398755241, 2024-05-08T18:07:47.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003988503, 2024-05-08T18:07:47.992 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.992 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.992 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.992 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:07:47.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:07:47.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580368+0000", 2024-05-08T18:07:47.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3089999999999996e-06 2024-05-08T18:07:47.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580400+0000", 2024-05-08T18:07:47.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2580000000000003e-05 2024-05-08T18:07:47.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580427+0000", 2024-05-08T18:07:47.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6976999999999999e-05 2024-05-08T18:07:47.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580443+0000", 2024-05-08T18:07:47.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5585000000000001e-05 2024-05-08T18:07:47.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580555+0000", 2024-05-08T18:07:47.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112639 2024-05-08T18:07:47.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580601+0000", 2024-05-08T18:07:47.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6e-05 2024-05-08T18:07:47.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:47.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584229+0000", 2024-05-08T18:07:47.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036273659999999999 2024-05-08T18:07:47.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:47.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584348+0000", 2024-05-08T18:07:47.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119047 2024-05-08T18:07:47.995 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.995 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:47.995 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:47.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.996 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:47.996 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:07:47.996 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.289341970999999, 2024-05-08T18:07:47.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032136159999999999, 2024-05-08T18:07:47.996 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:47.996 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:47.996 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:47.996 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:47.996 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:47.996 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:47.996 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 193 2024-05-08T18:07:47.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.996 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:47.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:47.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:07:47.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:47.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:07:47.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:47.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:47.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689775+0000", 2024-05-08T18:07:47.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.357e-06 2024-05-08T18:07:47.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:47.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689788+0000", 2024-05-08T18:07:47.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3029e-05 2024-05-08T18:07:47.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:47.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689819+0000", 2024-05-08T18:07:47.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.065e-05 2024-05-08T18:07:47.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:47.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689833+0000", 2024-05-08T18:07:47.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4790000000000001e-05 2024-05-08T18:07:47.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:47.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689948+0000", 2024-05-08T18:07:47.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115089 2024-05-08T18:07:47.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:47.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:47.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:47.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690155+0000", 2024-05-08T18:07:47.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206932 2024-05-08T18:07:48.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:48.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690420+0000", 2024-05-08T18:07:48.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026450200000000001 2024-05-08T18:07:48.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692229+0000", 2024-05-08T18:07:48.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001808823 2024-05-08T18:07:48.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692816+0000", 2024-05-08T18:07:48.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058773199999999999 2024-05-08T18:07:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692915+0000", 2024-05-08T18:07:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8646000000000004e-05 2024-05-08T18:07:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692986+0000", 2024-05-08T18:07:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1066e-05 2024-05-08T18:07:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.001 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.002 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:07:48.002 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.390375752000001, 2024-05-08T18:07:48.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089431319999999995, 2024-05-08T18:07:48.002 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.002 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.002 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.002 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.002 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.002 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.002 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 208 2024-05-08T18:07:48.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.002 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588741+0000", 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588752+0000", 2024-05-08T18:07:48.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0813e-05 2024-05-08T18:07:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588782+0000", 2024-05-08T18:07:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0020000000000001e-05 2024-05-08T18:07:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588803+0000", 2024-05-08T18:07:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1115999999999999e-05 2024-05-08T18:07:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588943+0000", 2024-05-08T18:07:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013971599999999999 2024-05-08T18:07:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588954+0000", 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1365999999999999e-05 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594340+0000", 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053854910000000001 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594670+0000", 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000330055 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:48.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.595179+0000", 2024-05-08T18:07:48.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050879199999999999 2024-05-08T18:07:48.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.596408+0000", 2024-05-08T18:07:48.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012295209999999999 2024-05-08T18:07:48.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597532+0000", 2024-05-08T18:07:48.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011233860000000001 2024-05-08T18:07:48.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597619+0000", 2024-05-08T18:07:48.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7775999999999994e-05 2024-05-08T18:07:48.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597682+0000", 2024-05-08T18:07:48.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2522999999999998e-05 2024-05-08T18:07:48.007 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.007 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.007 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.007 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.007 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:07:48.007 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.361746773, 2024-05-08T18:07:48.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031262669999999998, 2024-05-08T18:07:48.008 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.008 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.008 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.008 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.008 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.008 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.008 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 212 2024-05-08T18:07:48.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.008 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:07:48.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:07:48.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617370+0000", 2024-05-08T18:07:48.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:07:48.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617379+0000", 2024-05-08T18:07:48.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2359999999999993e-06 2024-05-08T18:07:48.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617405+0000", 2024-05-08T18:07:48.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5639999999999998e-05 2024-05-08T18:07:48.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617425+0000", 2024-05-08T18:07:48.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0457000000000001e-05 2024-05-08T18:07:48.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617573+0000", 2024-05-08T18:07:48.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014776200000000001 2024-05-08T18:07:48.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617786+0000", 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212418 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.618177+0000", 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039161699999999997 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.619563+0000", 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013852999999999999 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620334+0000", 2024-05-08T18:07:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00077182200000000002 2024-05-08T18:07:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620426+0000", 2024-05-08T18:07:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1526000000000004e-05 2024-05-08T18:07:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620494+0000", 2024-05-08T18:07:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8078999999999997e-05 2024-05-08T18:07:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.013 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.013 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:07:48.013 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.33742822, 2024-05-08T18:07:48.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035230880000000002, 2024-05-08T18:07:48.013 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.013 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.013 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.013 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.013 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.013 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.013 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 219 2024-05-08T18:07:48.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.013 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:07:48.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:07:48.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641689+0000", 2024-05-08T18:07:48.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641700+0000", 2024-05-08T18:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1507e-05 2024-05-08T18:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641732+0000", 2024-05-08T18:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1585999999999999e-05 2024-05-08T18:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641754+0000", 2024-05-08T18:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1480000000000001e-05 2024-05-08T18:07:48.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641942+0000", 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018826300000000001 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642165+0000", 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022301100000000001 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642587+0000", 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042182400000000001 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.643767+0000", 2024-05-08T18:07:48.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001180675 2024-05-08T18:07:48.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645010+0000", 2024-05-08T18:07:48.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012427110000000001 2024-05-08T18:07:48.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645101+0000", 2024-05-08T18:07:48.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0871999999999993e-05 2024-05-08T18:07:48.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645209+0000", 2024-05-08T18:07:48.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108496 2024-05-08T18:07:48.018 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.018 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.018 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.018 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.018 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:07:48.018 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.317631233, 2024-05-08T18:07:48.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035793639999999998, 2024-05-08T18:07:48.018 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.018 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.018 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.019 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.019 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.019 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.019 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 224 2024-05-08T18:07:48.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.019 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:07:48.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:07:48.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661485+0000", 2024-05-08T18:07:48.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9759999999999998e-06 2024-05-08T18:07:48.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661494+0000", 2024-05-08T18:07:48.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3469999999999999e-06 2024-05-08T18:07:48.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661517+0000", 2024-05-08T18:07:48.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.389e-05 2024-05-08T18:07:48.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661537+0000", 2024-05-08T18:07:48.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9803e-05 2024-05-08T18:07:48.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661696+0000", 2024-05-08T18:07:48.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015865899999999999 2024-05-08T18:07:48.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661910+0000", 2024-05-08T18:07:48.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021434199999999999 2024-05-08T18:07:48.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:48.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.662336+0000", 2024-05-08T18:07:48.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042575300000000001 2024-05-08T18:07:48.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.663720+0000", 2024-05-08T18:07:48.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013843799999999999 2024-05-08T18:07:48.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.664909+0000", 2024-05-08T18:07:48.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011889019999999999 2024-05-08T18:07:48.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665001+0000", 2024-05-08T18:07:48.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1649000000000003e-05 2024-05-08T18:07:48.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665063+0000", 2024-05-08T18:07:48.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1662999999999996e-05 2024-05-08T18:07:48.024 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.024 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.024 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.024 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.024 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:07:48.024 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.285037959, 2024-05-08T18:07:48.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031551930000000001, 2024-05-08T18:07:48.024 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.024 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.024 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.025 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.025 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.025 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.025 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 233 2024-05-08T18:07:48.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.025 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:07:48.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:07:48.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694079+0000", 2024-05-08T18:07:48.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:07:48.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694090+0000", 2024-05-08T18:07:48.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1182999999999999e-05 2024-05-08T18:07:48.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694119+0000", 2024-05-08T18:07:48.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9076000000000001e-05 2024-05-08T18:07:48.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694143+0000", 2024-05-08T18:07:48.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4363e-05 2024-05-08T18:07:48.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694291+0000", 2024-05-08T18:07:48.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147849 2024-05-08T18:07:48.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694534+0000", 2024-05-08T18:07:48.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000242382 2024-05-08T18:07:48.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:48.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694957+0000", 2024-05-08T18:07:48.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042316700000000001 2024-05-08T18:07:48.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.696306+0000", 2024-05-08T18:07:48.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013489940000000001 2024-05-08T18:07:48.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697071+0000", 2024-05-08T18:07:48.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076482999999999998 2024-05-08T18:07:48.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697167+0000", 2024-05-08T18:07:48.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6773000000000003e-05 2024-05-08T18:07:48.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697232+0000", 2024-05-08T18:07:48.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4386000000000003e-05 2024-05-08T18:07:48.029 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.029 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.029 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.029 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:328 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.030 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:07:48.030 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.253319372, 2024-05-08T18:07:48.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029659439999999999, 2024-05-08T18:07:48.030 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.030 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.030 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.030 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.030 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.030 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.030 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 328 2024-05-08T18:07:48.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.030 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:07:48.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:07:48.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725796+0000", 2024-05-08T18:07:48.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-06 2024-05-08T18:07:48.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725802+0000", 2024-05-08T18:07:48.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7219999999999996e-06 2024-05-08T18:07:48.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725816+0000", 2024-05-08T18:07:48.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3886999999999999e-05 2024-05-08T18:07:48.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725824+0000", 2024-05-08T18:07:48.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5920000000000003e-06 2024-05-08T18:07:48.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725885+0000", 2024-05-08T18:07:48.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1526999999999996e-05 2024-05-08T18:07:48.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725972+0000", 2024-05-08T18:07:48.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7099000000000001e-05 2024-05-08T18:07:48.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:48.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726093+0000", 2024-05-08T18:07:48.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120383 2024-05-08T18:07:48.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726717+0000", 2024-05-08T18:07:48.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062435099999999999 2024-05-08T18:07:48.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728693+0000", 2024-05-08T18:07:48.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019758309999999999 2024-05-08T18:07:48.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728731+0000", 2024-05-08T18:07:48.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8591999999999999e-05 2024-05-08T18:07:48.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728761+0000", 2024-05-08T18:07:48.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9770000000000001e-05 2024-05-08T18:07:48.035 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.035 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.035 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.035 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:460 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.035 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:07:48.035 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.199502148000001, 2024-05-08T18:07:48.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040209540000000002, 2024-05-08T18:07:48.035 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.035 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.035 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.035 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 460 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779613+0000", 2024-05-08T18:07:48.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:07:48.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779619+0000", 2024-05-08T18:07:48.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3630000000000002e-06 2024-05-08T18:07:48.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779631+0000", 2024-05-08T18:07:48.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2211e-05 2024-05-08T18:07:48.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779637+0000", 2024-05-08T18:07:48.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0430000000000004e-06 2024-05-08T18:07:48.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779702+0000", 2024-05-08T18:07:48.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4481999999999997e-05 2024-05-08T18:07:48.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779848+0000", 2024-05-08T18:07:48.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014608500000000001 2024-05-08T18:07:48.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:48.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780056+0000", 2024-05-08T18:07:48.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020889699999999999 2024-05-08T18:07:48.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780700+0000", 2024-05-08T18:07:48.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064379300000000003 2024-05-08T18:07:48.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783576+0000", 2024-05-08T18:07:48.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028754919999999999 2024-05-08T18:07:48.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783608+0000", 2024-05-08T18:07:48.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2223e-05 2024-05-08T18:07:48.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:07:48.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5296e-05 2024-05-08T18:07:48.040 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.040 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.040 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.040 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:466 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.040 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:07:48.040 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.194963909999998, 2024-05-08T18:07:48.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028979520000000001, 2024-05-08T18:07:48.040 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.040 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.040 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.041 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 466 2024-05-08T18:07:48.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.041 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:07:48.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:07:48.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:07:48.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.61e-07 2024-05-08T18:07:48.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784155+0000", 2024-05-08T18:07:48.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9299999999999996e-06 2024-05-08T18:07:48.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784165+0000", 2024-05-08T18:07:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5680000000000005e-06 2024-05-08T18:07:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784170+0000", 2024-05-08T18:07:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1379999999999998e-06 2024-05-08T18:07:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784219+0000", 2024-05-08T18:07:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9231999999999999e-05 2024-05-08T18:07:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784310+0000", 2024-05-08T18:07:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0797000000000005e-05 2024-05-08T18:07:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784490+0000", 2024-05-08T18:07:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179705 2024-05-08T18:07:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.785090+0000", 2024-05-08T18:07:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060073899999999998 2024-05-08T18:07:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.786973+0000", 2024-05-08T18:07:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018824460000000001 2024-05-08T18:07:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787007+0000", 2024-05-08T18:07:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3779999999999998e-05 2024-05-08T18:07:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787049+0000", 2024-05-08T18:07:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1856e-05 2024-05-08T18:07:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:477 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:07:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.187821916000001, 2024-05-08T18:07:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046076989999999998, 2024-05-08T18:07:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 477 2024-05-08T18:07:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:07:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:07:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791294+0000", 2024-05-08T18:07:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-06 2024-05-08T18:07:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791300+0000", 2024-05-08T18:07:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5320000000000003e-06 2024-05-08T18:07:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791313+0000", 2024-05-08T18:07:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2576e-05 2024-05-08T18:07:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791319+0000", 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1720000000000004e-06 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791379+0000", 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0343000000000001e-05 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791477+0000", 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7662000000000001e-05 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791678+0000", 2024-05-08T18:07:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000200788 2024-05-08T18:07:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.792263+0000", 2024-05-08T18:07:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058525700000000005 2024-05-08T18:07:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795842+0000", 2024-05-08T18:07:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035787079999999999 2024-05-08T18:07:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795874+0000", 2024-05-08T18:07:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2205000000000001e-05 2024-05-08T18:07:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795900+0000", 2024-05-08T18:07:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6222000000000001e-05 2024-05-08T18:07:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:642 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:07:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.049062212999999, 2024-05-08T18:07:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030444059999999999, 2024-05-08T18:07:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 642 2024-05-08T18:07:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:07:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:07:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930055+0000", 2024-05-08T18:07:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7999999999999999e-06 2024-05-08T18:07:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930065+0000", 2024-05-08T18:07:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0176999999999999e-05 2024-05-08T18:07:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930092+0000", 2024-05-08T18:07:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6460000000000001e-05 2024-05-08T18:07:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930112+0000", 2024-05-08T18:07:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0043000000000001e-05 2024-05-08T18:07:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930219+0000", 2024-05-08T18:07:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010698500000000001 2024-05-08T18:07:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930345+0000", 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012620400000000001 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930579+0000", 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234145 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.931471+0000", 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00089161500000000001 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.932978+0000", 2024-05-08T18:07:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001507296 2024-05-08T18:07:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933044+0000", 2024-05-08T18:07:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6402000000000006e-05 2024-05-08T18:07:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933097+0000", 2024-05-08T18:07:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2278999999999999e-05 2024-05-08T18:07:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:681 6.e e32/26 6:748722ff:gc::gc.6:head v 32'7, mlcod=32'5)", 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.018266636, 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003318185, 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:07:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960849+0000", 2024-05-08T18:07:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.423e-06 2024-05-08T18:07:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960859+0000", 2024-05-08T18:07:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3170000000000008e-06 2024-05-08T18:07:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960874+0000", 2024-05-08T18:07:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5125e-05 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960884+0000", 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8120000000000002e-06 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960972+0000", 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8540000000000003e-05 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960996+0000", 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3479999999999999e-05 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964110+0000", 2024-05-08T18:07:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031142729999999999 2024-05-08T18:07:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964166+0000", 2024-05-08T18:07:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6215000000000003e-05 2024-05-08T18:07:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:07:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.927230541, 2024-05-08T18:07:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030648379999999999, 2024-05-08T18:07:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 733 2024-05-08T18:07:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:07:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:07:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051887+0000", 2024-05-08T18:07:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.74e-06 2024-05-08T18:07:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051900+0000", 2024-05-08T18:07:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3113e-05 2024-05-08T18:07:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051931+0000", 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1665999999999998e-05 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051946+0000", 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4780000000000001e-05 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052078+0000", 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013133200000000001 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052338+0000", 2024-05-08T18:07:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026056899999999999 2024-05-08T18:07:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052652+0000", 2024-05-08T18:07:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031396700000000001 2024-05-08T18:07:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.053668+0000", 2024-05-08T18:07:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00101574 2024-05-08T18:07:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054800+0000", 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011319819999999999 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054884+0000", 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4005999999999995e-05 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054949+0000", 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4943000000000005e-05 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:07:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.923375906, 2024-05-08T18:07:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029745919999999999, 2024-05-08T18:07:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 735 2024-05-08T18:07:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:07:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:07:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055741+0000", 2024-05-08T18:07:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.984e-06 2024-05-08T18:07:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055766+0000", 2024-05-08T18:07:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5253e-05 2024-05-08T18:07:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055785+0000", 2024-05-08T18:07:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9559999999999999e-05 2024-05-08T18:07:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055798+0000", 2024-05-08T18:07:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-05 2024-05-08T18:07:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055932+0000", 2024-05-08T18:07:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134609 2024-05-08T18:07:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056184+0000", 2024-05-08T18:07:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025167800000000003 2024-05-08T18:07:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056680+0000", 2024-05-08T18:07:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049576299999999998 2024-05-08T18:07:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058060+0000", 2024-05-08T18:07:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013801 2024-05-08T18:07:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058447+0000", 2024-05-08T18:07:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038695299999999999 2024-05-08T18:07:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058601+0000", 2024-05-08T18:07:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015396299999999999 2024-05-08T18:07:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058713+0000", 2024-05-08T18:07:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112389 2024-05-08T18:07:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:07:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.816360555999999, 2024-05-08T18:07:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029913650000000002, 2024-05-08T18:07:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 781 2024-05-08T18:07:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:07:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:07:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162757+0000", 2024-05-08T18:07:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:07:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162770+0000", 2024-05-08T18:07:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3406e-05 2024-05-08T18:07:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162799+0000", 2024-05-08T18:07:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-05 2024-05-08T18:07:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162813+0000", 2024-05-08T18:07:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:07:48.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162942+0000", 2024-05-08T18:07:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012902200000000001 2024-05-08T18:07:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163159+0000", 2024-05-08T18:07:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021738500000000001 2024-05-08T18:07:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163476+0000", 2024-05-08T18:07:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031666499999999999 2024-05-08T18:07:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.164533+0000", 2024-05-08T18:07:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010574219999999999 2024-05-08T18:07:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165587+0000", 2024-05-08T18:07:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001053476 2024-05-08T18:07:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165674+0000", 2024-05-08T18:07:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6725999999999996e-05 2024-05-08T18:07:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165745+0000", 2024-05-08T18:07:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1779000000000005e-05 2024-05-08T18:07:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:07:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.433770708000001, 2024-05-08T18:07:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029834750000000002, 2024-05-08T18:07:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 946 2024-05-08T18:07:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:07:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:07:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545346+0000", 2024-05-08T18:07:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6570000000000001e-06 2024-05-08T18:07:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545357+0000", 2024-05-08T18:07:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0740000000000001e-05 2024-05-08T18:07:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545384+0000", 2024-05-08T18:07:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6780000000000001e-05 2024-05-08T18:07:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545398+0000", 2024-05-08T18:07:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3936e-05 2024-05-08T18:07:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545515+0000", 2024-05-08T18:07:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117413 2024-05-08T18:07:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545751+0000", 2024-05-08T18:07:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023559500000000001 2024-05-08T18:07:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.546075+0000", 2024-05-08T18:07:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000324357 2024-05-08T18:07:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.547104+0000", 2024-05-08T18:07:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010285959999999999 2024-05-08T18:07:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548141+0000", 2024-05-08T18:07:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001036922 2024-05-08T18:07:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548223+0000", 2024-05-08T18:07:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2260000000000002e-05 2024-05-08T18:07:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548327+0000", 2024-05-08T18:07:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104219 2024-05-08T18:07:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.087 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:48.088 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:07:48.089 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:48.087+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:48.189 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:48.189+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:48.215 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:48.215 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:48.215 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:48.215 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:48.229 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:07:48.290 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:48.287+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:48.389 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:48.389 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:48.390 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:07:48.390 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:07:48.390 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:48.391 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:48.391+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:48.403 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:07:48.492 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:48.491+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:48.525 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:07:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:07:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:07:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:07:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.949396768, 2024-05-08T18:07:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002466088, 2024-05-08T18:07:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 52 2024-05-08T18:07:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:07:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:07:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577062+0000", 2024-05-08T18:07:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.994e-06 2024-05-08T18:07:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577075+0000", 2024-05-08T18:07:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2480000000000001e-05 2024-05-08T18:07:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577108+0000", 2024-05-08T18:07:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3096000000000003e-05 2024-05-08T18:07:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577131+0000", 2024-05-08T18:07:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2993000000000002e-05 2024-05-08T18:07:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577260+0000", 2024-05-08T18:07:48.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012912899999999999 2024-05-08T18:07:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577453+0000", 2024-05-08T18:07:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000193668 2024-05-08T18:07:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577634+0000", 2024-05-08T18:07:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180576 2024-05-08T18:07:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579082+0000", 2024-05-08T18:07:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001448083 2024-05-08T18:07:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579290+0000", 2024-05-08T18:07:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000208333 2024-05-08T18:07:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579403+0000", 2024-05-08T18:07:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011296800000000001 2024-05-08T18:07:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579525+0000", 2024-05-08T18:07:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121768 2024-05-08T18:07:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-05-08T18:07:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:07:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.937537002999999, 2024-05-08T18:07:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038858310000000002, 2024-05-08T18:07:48.532 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:07:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:07:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588920+0000", 2024-05-08T18:07:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.23e-07 2024-05-08T18:07:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588929+0000", 2024-05-08T18:07:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3659999999999998e-06 2024-05-08T18:07:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588948+0000", 2024-05-08T18:07:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8768000000000001e-05 2024-05-08T18:07:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588962+0000", 2024-05-08T18:07:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4e-05 2024-05-08T18:07:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589110+0000", 2024-05-08T18:07:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148047 2024-05-08T18:07:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589173+0000", 2024-05-08T18:07:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2766000000000002e-05 2024-05-08T18:07:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592728+0000", 2024-05-08T18:07:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035553300000000002 2024-05-08T18:07:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592805+0000", 2024-05-08T18:07:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6730999999999994e-05 2024-05-08T18:07:48.536 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:07:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.821468105000001, 2024-05-08T18:07:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034354310000000001, 2024-05-08T18:07:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.537 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 236 2024-05-08T18:07:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:07:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:07:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704991+0000", 2024-05-08T18:07:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1240000000000001e-06 2024-05-08T18:07:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705009+0000", 2024-05-08T18:07:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7819e-05 2024-05-08T18:07:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705048+0000", 2024-05-08T18:07:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9632999999999998e-05 2024-05-08T18:07:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705073+0000", 2024-05-08T18:07:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4686999999999999e-05 2024-05-08T18:07:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705241+0000", 2024-05-08T18:07:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759899999999999 2024-05-08T18:07:48.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705511+0000", 2024-05-08T18:07:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027018799999999998 2024-05-08T18:07:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705965+0000", 2024-05-08T18:07:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045433000000000002 2024-05-08T18:07:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.707487+0000", 2024-05-08T18:07:48.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015214810000000001 2024-05-08T18:07:48.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708125+0000", 2024-05-08T18:07:48.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063870300000000001 2024-05-08T18:07:48.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708298+0000", 2024-05-08T18:07:48.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172592 2024-05-08T18:07:48.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708423+0000", 2024-05-08T18:07:48.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125275 2024-05-08T18:07:48.543 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.543 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.543 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.543 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:308 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.543 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:07:48.543 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.804630202999999, 2024-05-08T18:07:48.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038707400000000001, 2024-05-08T18:07:48.543 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 308 2024-05-08T18:07:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:07:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:07:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721827+0000", 2024-05-08T18:07:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1519999999999999e-06 2024-05-08T18:07:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721840+0000", 2024-05-08T18:07:48.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.362e-05 2024-05-08T18:07:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721857+0000", 2024-05-08T18:07:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6901e-05 2024-05-08T18:07:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721867+0000", 2024-05-08T18:07:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0034000000000001e-05 2024-05-08T18:07:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721922+0000", 2024-05-08T18:07:48.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4450999999999998e-05 2024-05-08T18:07:48.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721981+0000", 2024-05-08T18:07:48.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9267e-05 2024-05-08T18:07:48.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:48.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722103+0000", 2024-05-08T18:07:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121502 2024-05-08T18:07:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722757+0000", 2024-05-08T18:07:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065419700000000003 2024-05-08T18:07:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725619+0000", 2024-05-08T18:07:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002862107 2024-05-08T18:07:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725654+0000", 2024-05-08T18:07:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:07:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725696+0000", 2024-05-08T18:07:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:07:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.550 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:604 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.550 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:07:48.550 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.627347496999999, 2024-05-08T18:07:48.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002741884, 2024-05-08T18:07:48.550 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.550 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.550 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.550 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.550 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.550 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.550 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 604 2024-05-08T18:07:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:07:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:07:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899111+0000", 2024-05-08T18:07:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0910000000000001e-06 2024-05-08T18:07:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899126+0000", 2024-05-08T18:07:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:07:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899159+0000", 2024-05-08T18:07:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3241999999999998e-05 2024-05-08T18:07:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899174+0000", 2024-05-08T18:07:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5235000000000001e-05 2024-05-08T18:07:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899316+0000", 2024-05-08T18:07:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014175599999999999 2024-05-08T18:07:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899525+0000", 2024-05-08T18:07:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020915300000000001 2024-05-08T18:07:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899872+0000", 2024-05-08T18:07:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034668299999999997 2024-05-08T18:07:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901064+0000", 2024-05-08T18:07:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001191473 2024-05-08T18:07:48.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901664+0000", 2024-05-08T18:07:48.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060054599999999998 2024-05-08T18:07:48.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901779+0000", 2024-05-08T18:07:48.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011452500000000001 2024-05-08T18:07:48.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901850+0000", 2024-05-08T18:07:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1580000000000002e-05 2024-05-08T18:07:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:612 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:07:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.621838933999999, 2024-05-08T18:07:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025904750000000001, 2024-05-08T18:07:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.556 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 612 2024-05-08T18:07:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:07:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:07:48.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904619+0000", 2024-05-08T18:07:48.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8479999999999999e-06 2024-05-08T18:07:48.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904628+0000", 2024-05-08T18:07:48.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8829999999999995e-06 2024-05-08T18:07:48.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904650+0000", 2024-05-08T18:07:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2467999999999999e-05 2024-05-08T18:07:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904669+0000", 2024-05-08T18:07:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9303000000000001e-05 2024-05-08T18:07:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904766+0000", 2024-05-08T18:07:48.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6917999999999996e-05 2024-05-08T18:07:48.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904935+0000", 2024-05-08T18:07:48.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000168441 2024-05-08T18:07:48.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:48.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.905288+0000", 2024-05-08T18:07:48.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035312199999999998 2024-05-08T18:07:48.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.906520+0000", 2024-05-08T18:07:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001232005 2024-05-08T18:07:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907086+0000", 2024-05-08T18:07:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056658900000000005 2024-05-08T18:07:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907154+0000", 2024-05-08T18:07:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7197000000000001e-05 2024-05-08T18:07:48.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907207+0000", 2024-05-08T18:07:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3701e-05 2024-05-08T18:07:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:07:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.453821341000001, 2024-05-08T18:07:48.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032464490000000002, 2024-05-08T18:07:48.563 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.563 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.563 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.563 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 742 2024-05-08T18:07:48.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.563 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:07:48.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:07:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072637+0000", 2024-05-08T18:07:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9059999999999998e-06 2024-05-08T18:07:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072651+0000", 2024-05-08T18:07:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3477e-05 2024-05-08T18:07:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072683+0000", 2024-05-08T18:07:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2116000000000002e-05 2024-05-08T18:07:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072698+0000", 2024-05-08T18:07:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5454000000000001e-05 2024-05-08T18:07:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072845+0000", 2024-05-08T18:07:48.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146532 2024-05-08T18:07:48.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073241+0000", 2024-05-08T18:07:48.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039580699999999997 2024-05-08T18:07:48.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:48.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073812+0000", 2024-05-08T18:07:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057164900000000003 2024-05-08T18:07:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075063+0000", 2024-05-08T18:07:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001250131 2024-05-08T18:07:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075723+0000", 2024-05-08T18:07:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00066039199999999999 2024-05-08T18:07:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075808+0000", 2024-05-08T18:07:48.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5458999999999996e-05 2024-05-08T18:07:48.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075881+0000", 2024-05-08T18:07:48.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2526000000000003e-05 2024-05-08T18:07:48.568 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.568 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.568 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.568 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.568 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:07:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.411412976000001, 2024-05-08T18:07:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029270590000000001, 2024-05-08T18:07:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 760 2024-05-08T18:07:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:07:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:07:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115045+0000", 2024-05-08T18:07:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0729999999999999e-06 2024-05-08T18:07:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115057+0000", 2024-05-08T18:07:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1617000000000001e-05 2024-05-08T18:07:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115088+0000", 2024-05-08T18:07:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1155999999999998e-05 2024-05-08T18:07:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115103+0000", 2024-05-08T18:07:48.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5067e-05 2024-05-08T18:07:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115289+0000", 2024-05-08T18:07:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186582 2024-05-08T18:07:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115506+0000", 2024-05-08T18:07:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021690500000000001 2024-05-08T18:07:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115832+0000", 2024-05-08T18:07:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032556799999999998 2024-05-08T18:07:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.116892+0000", 2024-05-08T18:07:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010597989999999999 2024-05-08T18:07:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117807+0000", 2024-05-08T18:07:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091502599999999999 2024-05-08T18:07:48.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117895+0000", 2024-05-08T18:07:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7977000000000001e-05 2024-05-08T18:07:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117970+0000", 2024-05-08T18:07:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5289000000000004e-05 2024-05-08T18:07:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:07:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.280415489999999, 2024-05-08T18:07:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028290730000000001, 2024-05-08T18:07:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.575 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 817 2024-05-08T18:07:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:07:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:07:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246043+0000", 2024-05-08T18:07:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.807e-06 2024-05-08T18:07:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246056+0000", 2024-05-08T18:07:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2383e-05 2024-05-08T18:07:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246087+0000", 2024-05-08T18:07:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1937000000000003e-05 2024-05-08T18:07:48.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246104+0000", 2024-05-08T18:07:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6643e-05 2024-05-08T18:07:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246225+0000", 2024-05-08T18:07:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012061900000000001 2024-05-08T18:07:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246510+0000", 2024-05-08T18:07:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028507100000000002 2024-05-08T18:07:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246881+0000", 2024-05-08T18:07:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037163799999999998 2024-05-08T18:07:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248078+0000", 2024-05-08T18:07:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011968969999999999 2024-05-08T18:07:48.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248715+0000", 2024-05-08T18:07:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063698599999999998 2024-05-08T18:07:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248801+0000", 2024-05-08T18:07:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5772999999999993e-05 2024-05-08T18:07:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248869+0000", 2024-05-08T18:07:48.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8318999999999994e-05 2024-05-08T18:07:48.581 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.581 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.581 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.581 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.581 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:07:48.581 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.226672006000001, 2024-05-08T18:07:48.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003281693, 2024-05-08T18:07:48.581 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.581 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.582 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.582 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.582 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.582 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.582 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 841 2024-05-08T18:07:48.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.582 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:07:48.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:07:48.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299786+0000", 2024-05-08T18:07:48.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4770000000000002e-06 2024-05-08T18:07:48.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299798+0000", 2024-05-08T18:07:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1493e-05 2024-05-08T18:07:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299827+0000", 2024-05-08T18:07:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9363e-05 2024-05-08T18:07:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299842+0000", 2024-05-08T18:07:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.448e-05 2024-05-08T18:07:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300001+0000", 2024-05-08T18:07:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015909600000000001 2024-05-08T18:07:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300384+0000", 2024-05-08T18:07:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038306000000000001 2024-05-08T18:07:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300929+0000", 2024-05-08T18:07:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054551299999999997 2024-05-08T18:07:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302151+0000", 2024-05-08T18:07:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012218540000000001 2024-05-08T18:07:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302918+0000", 2024-05-08T18:07:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076719099999999997 2024-05-08T18:07:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303000+0000", 2024-05-08T18:07:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1662999999999994e-05 2024-05-08T18:07:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303065+0000", 2024-05-08T18:07:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5502999999999999e-05 2024-05-08T18:07:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:07:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.22247655, 2024-05-08T18:07:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026179150000000002, 2024-05-08T18:07:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 843 2024-05-08T18:07:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:07:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:07:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303981+0000", 2024-05-08T18:07:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9740000000000001e-06 2024-05-08T18:07:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303990+0000", 2024-05-08T18:07:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9889999999999998e-06 2024-05-08T18:07:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304012+0000", 2024-05-08T18:07:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1537000000000001e-05 2024-05-08T18:07:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304023+0000", 2024-05-08T18:07:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:07:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304101+0000", 2024-05-08T18:07:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7732999999999996e-05 2024-05-08T18:07:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304210+0000", 2024-05-08T18:07:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010985299999999999 2024-05-08T18:07:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304490+0000", 2024-05-08T18:07:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000279564 2024-05-08T18:07:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.305542+0000", 2024-05-08T18:07:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051976 2024-05-08T18:07:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306451+0000", 2024-05-08T18:07:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00090901999999999997 2024-05-08T18:07:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306533+0000", 2024-05-08T18:07:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1790000000000001e-05 2024-05-08T18:07:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306597+0000", 2024-05-08T18:07:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4332999999999995e-05 2024-05-08T18:07:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:07:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.212780339999998, 2024-05-08T18:07:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00275537, 2024-05-08T18:07:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 847 2024-05-08T18:07:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:07:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:07:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313678+0000", 2024-05-08T18:07:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:07:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313689+0000", 2024-05-08T18:07:48.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1273e-05 2024-05-08T18:07:48.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313719+0000", 2024-05-08T18:07:48.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9726e-05 2024-05-08T18:07:48.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313733+0000", 2024-05-08T18:07:48.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4487e-05 2024-05-08T18:07:48.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313858+0000", 2024-05-08T18:07:48.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125172 2024-05-08T18:07:48.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314072+0000", 2024-05-08T18:07:48.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021314200000000001 2024-05-08T18:07:48.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:48.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314378+0000", 2024-05-08T18:07:48.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030653100000000002 2024-05-08T18:07:48.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.315524+0000", 2024-05-08T18:07:48.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011458950000000001 2024-05-08T18:07:48.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316213+0000", 2024-05-08T18:07:48.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068942199999999997 2024-05-08T18:07:48.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316314+0000", 2024-05-08T18:07:48.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100723 2024-05-08T18:07:48.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316431+0000", 2024-05-08T18:07:48.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116759 2024-05-08T18:07:48.600 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.600 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.601 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.601 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.601 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:07:48.601 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.209128403000001, 2024-05-08T18:07:48.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025522510000000002, 2024-05-08T18:07:48.601 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.601 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.601 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.601 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.602 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.602 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.602 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 849 2024-05-08T18:07:48.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.602 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:07:48.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:07:48.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317329+0000", 2024-05-08T18:07:48.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9530000000000002e-06 2024-05-08T18:07:48.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317340+0000", 2024-05-08T18:07:48.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.08e-05 2024-05-08T18:07:48.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317364+0000", 2024-05-08T18:07:48.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4142999999999999e-05 2024-05-08T18:07:48.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317377+0000", 2024-05-08T18:07:48.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2764e-05 2024-05-08T18:07:48.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317471+0000", 2024-05-08T18:07:48.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4289000000000005e-05 2024-05-08T18:07:48.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317600+0000", 2024-05-08T18:07:48.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012910499999999999 2024-05-08T18:07:48.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:48.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317868+0000", 2024-05-08T18:07:48.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000267562 2024-05-08T18:07:48.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319081+0000", 2024-05-08T18:07:48.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001213387 2024-05-08T18:07:48.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319723+0000", 2024-05-08T18:07:48.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064134200000000004 2024-05-08T18:07:48.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319808+0000", 2024-05-08T18:07:48.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:07:48.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319880+0000", 2024-05-08T18:07:48.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1426000000000004e-05 2024-05-08T18:07:48.607 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.607 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.607 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.607 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.607 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:07:48.607 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.165695922000001, 2024-05-08T18:07:48.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002815157, 2024-05-08T18:07:48.607 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.608 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.608 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.608 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 868 2024-05-08T18:07:48.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.608 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:07:48.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:07:48.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360762+0000", 2024-05-08T18:07:48.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:07:48.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360775+0000", 2024-05-08T18:07:48.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2840000000000001e-05 2024-05-08T18:07:48.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360805+0000", 2024-05-08T18:07:48.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9686e-05 2024-05-08T18:07:48.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360819+0000", 2024-05-08T18:07:48.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.434e-05 2024-05-08T18:07:48.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360948+0000", 2024-05-08T18:07:48.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000129033 2024-05-08T18:07:48.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361166+0000", 2024-05-08T18:07:48.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021747800000000001 2024-05-08T18:07:48.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:48.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361481+0000", 2024-05-08T18:07:48.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031515800000000001 2024-05-08T18:07:48.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.362546+0000", 2024-05-08T18:07:48.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010653889999999999 2024-05-08T18:07:48.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363365+0000", 2024-05-08T18:07:48.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081906100000000005 2024-05-08T18:07:48.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363450+0000", 2024-05-08T18:07:48.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5202000000000002e-05 2024-05-08T18:07:48.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363575+0000", 2024-05-08T18:07:48.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012460999999999999 2024-05-08T18:07:48.614 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.614 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.614 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.614 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.614 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:07:48.614 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.162003749, 2024-05-08T18:07:48.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024676260000000001, 2024-05-08T18:07:48.614 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.615 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.615 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.615 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.615 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.615 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.615 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 870 2024-05-08T18:07:48.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.615 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:07:48.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:07:48.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364454+0000", 2024-05-08T18:07:48.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7770000000000001e-06 2024-05-08T18:07:48.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364463+0000", 2024-05-08T18:07:48.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4800000000000007e-06 2024-05-08T18:07:48.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364487+0000", 2024-05-08T18:07:48.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3589999999999999e-05 2024-05-08T18:07:48.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364499+0000", 2024-05-08T18:07:48.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.241e-05 2024-05-08T18:07:48.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364607+0000", 2024-05-08T18:07:48.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010760900000000001 2024-05-08T18:07:48.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364750+0000", 2024-05-08T18:07:48.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014265600000000001 2024-05-08T18:07:48.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:48.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.365021+0000", 2024-05-08T18:07:48.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027115100000000002 2024-05-08T18:07:48.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366163+0000", 2024-05-08T18:07:48.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011419189999999999 2024-05-08T18:07:48.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366727+0000", 2024-05-08T18:07:48.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056400199999999997 2024-05-08T18:07:48.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366810+0000", 2024-05-08T18:07:48.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3133000000000005e-05 2024-05-08T18:07:48.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366920+0000", 2024-05-08T18:07:48.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109899 2024-05-08T18:07:48.621 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.621 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.621 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.621 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.621 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:07:48.621 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.072089570999999, 2024-05-08T18:07:48.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027893459999999998, 2024-05-08T18:07:48.621 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.621 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.621 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.622 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.622 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.622 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.622 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 907 2024-05-08T18:07:48.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.622 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:07:48.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:07:48.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454369+0000", 2024-05-08T18:07:48.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5730000000000002e-06 2024-05-08T18:07:48.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454381+0000", 2024-05-08T18:07:48.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.208e-05 2024-05-08T18:07:48.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454413+0000", 2024-05-08T18:07:48.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2493000000000002e-05 2024-05-08T18:07:48.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454432+0000", 2024-05-08T18:07:48.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8862999999999999e-05 2024-05-08T18:07:48.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454577+0000", 2024-05-08T18:07:48.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014477899999999999 2024-05-08T18:07:48.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454800+0000", 2024-05-08T18:07:48.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223425 2024-05-08T18:07:48.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:48.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.455168+0000", 2024-05-08T18:07:48.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036712799999999999 2024-05-08T18:07:48.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456282+0000", 2024-05-08T18:07:48.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011141580000000001 2024-05-08T18:07:48.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456953+0000", 2024-05-08T18:07:48.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000670956 2024-05-08T18:07:48.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457038+0000", 2024-05-08T18:07:48.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4828999999999997e-05 2024-05-08T18:07:48.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457156+0000", 2024-05-08T18:07:48.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118062 2024-05-08T18:07:48.627 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.627 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.627 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.627 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.627 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:07:48.628 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.068397208, 2024-05-08T18:07:48.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026891609999999998, 2024-05-08T18:07:48.628 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.628 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.628 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.628 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.628 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.628 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.628 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 909 2024-05-08T18:07:48.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.628 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:07:48.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:07:48.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458060+0000", 2024-05-08T18:07:48.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:07:48.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458069+0000", 2024-05-08T18:07:48.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6440000000000006e-06 2024-05-08T18:07:48.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458090+0000", 2024-05-08T18:07:48.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1089000000000001e-05 2024-05-08T18:07:48.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458102+0000", 2024-05-08T18:07:48.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2306999999999999e-05 2024-05-08T18:07:48.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458191+0000", 2024-05-08T18:07:48.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8213000000000004e-05 2024-05-08T18:07:48.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458313+0000", 2024-05-08T18:07:48.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012231500000000001 2024-05-08T18:07:48.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:48.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458581+0000", 2024-05-08T18:07:48.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026762500000000001 2024-05-08T18:07:48.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.459773+0000", 2024-05-08T18:07:48.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001192991 2024-05-08T18:07:48.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460590+0000", 2024-05-08T18:07:48.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081618100000000002 2024-05-08T18:07:48.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460681+0000", 2024-05-08T18:07:48.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0946000000000006e-05 2024-05-08T18:07:48.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460748+0000", 2024-05-08T18:07:48.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7139999999999998e-05 2024-05-08T18:07:48.633 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.633 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.633 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.633 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.633 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:07:48.634 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.974754189999999, 2024-05-08T18:07:48.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030359179999999999, 2024-05-08T18:07:48.634 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.634 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.634 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.634 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.634 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.634 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.634 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 949 2024-05-08T18:07:48.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.634 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:07:48.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:07:48.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551705+0000", 2024-05-08T18:07:48.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2770000000000001e-06 2024-05-08T18:07:48.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551717+0000", 2024-05-08T18:07:48.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.206e-05 2024-05-08T18:07:48.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551747+0000", 2024-05-08T18:07:48.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0168999999999999e-05 2024-05-08T18:07:48.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551763+0000", 2024-05-08T18:07:48.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:07:48.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551880+0000", 2024-05-08T18:07:48.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116976 2024-05-08T18:07:48.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552099+0000", 2024-05-08T18:07:48.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021910199999999999 2024-05-08T18:07:48.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:48.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552476+0000", 2024-05-08T18:07:48.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000376697 2024-05-08T18:07:48.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.553551+0000", 2024-05-08T18:07:48.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001074925 2024-05-08T18:07:48.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554588+0000", 2024-05-08T18:07:48.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010374099999999999 2024-05-08T18:07:48.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554671+0000", 2024-05-08T18:07:48.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3368999999999994e-05 2024-05-08T18:07:48.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554738+0000", 2024-05-08T18:07:48.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6043000000000004e-05 2024-05-08T18:07:48.639 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.639 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.639 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.639 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.640 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:07:48.640 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.961140751999999, 2024-05-08T18:07:48.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028304160000000001, 2024-05-08T18:07:48.640 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.640 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.640 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.640 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.640 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.640 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.640 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 955 2024-05-08T18:07:48.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.640 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:07:48.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:07:48.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565318+0000", 2024-05-08T18:07:48.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7030000000000002e-06 2024-05-08T18:07:48.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565330+0000", 2024-05-08T18:07:48.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.204e-05 2024-05-08T18:07:48.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565363+0000", 2024-05-08T18:07:48.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2722999999999998e-05 2024-05-08T18:07:48.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565389+0000", 2024-05-08T18:07:48.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6412999999999999e-05 2024-05-08T18:07:48.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565510+0000", 2024-05-08T18:07:48.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120932 2024-05-08T18:07:48.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565722+0000", 2024-05-08T18:07:48.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212139 2024-05-08T18:07:48.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:48.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.566034+0000", 2024-05-08T18:07:48.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000312038 2024-05-08T18:07:48.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567340+0000", 2024-05-08T18:07:48.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00130547 2024-05-08T18:07:48.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567998+0000", 2024-05-08T18:07:48.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000658382 2024-05-08T18:07:48.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568081+0000", 2024-05-08T18:07:48.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3269999999999994e-05 2024-05-08T18:07:48.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568145+0000", 2024-05-08T18:07:48.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4306000000000004e-05 2024-05-08T18:07:48.645 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.645 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.645 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.645 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:48.646 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:07:48.646 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.957421229000001, 2024-05-08T18:07:48.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027506660000000001, 2024-05-08T18:07:48.646 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:48.646 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:48.646 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:48.646 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:48.646 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:48.646 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:48.646 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 957 2024-05-08T18:07:48.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.646 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:48.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:48.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:07:48.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:48.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:07:48.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:48.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:48.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569036+0000", 2024-05-08T18:07:48.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.776e-06 2024-05-08T18:07:48.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:48.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569061+0000", 2024-05-08T18:07:48.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5097e-05 2024-05-08T18:07:48.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:48.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569084+0000", 2024-05-08T18:07:48.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.23e-05 2024-05-08T18:07:48.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:48.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569096+0000", 2024-05-08T18:07:48.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.22e-05 2024-05-08T18:07:48.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:48.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569180+0000", 2024-05-08T18:07:48.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4369000000000005e-05 2024-05-08T18:07:48.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:48.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569296+0000", 2024-05-08T18:07:48.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115999 2024-05-08T18:07:48.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:48.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569550+0000", 2024-05-08T18:07:48.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025397499999999998 2024-05-08T18:07:48.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:48.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.570963+0000", 2024-05-08T18:07:48.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001413023 2024-05-08T18:07:48.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:48.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571614+0000", 2024-05-08T18:07:48.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065041199999999995 2024-05-08T18:07:48.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:48.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571701+0000", 2024-05-08T18:07:48.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7569000000000001e-05 2024-05-08T18:07:48.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:48.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:48.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:48.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571785+0000", 2024-05-08T18:07:48.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3945999999999999e-05 2024-05-08T18:07:48.651 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.651 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.651 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.651 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:48.651 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:48.651 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:48.653 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:07:48.653 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:48.657+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:48.714 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:07:48.754 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:48.751+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:48.826 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:48.826 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:48.826 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:48.826 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:48.841 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:07:48.886 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:07:48.886 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:07:48.886 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:48.885+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:48.903 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:07:48.903 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:07:48.919 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:07:48.920 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:07:48.936 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:07:48.936 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:07:48.955 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:48.957+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:48.957 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:07:48.957 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:07:48.958 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:48.958 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:48.973 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:07:48.978 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:07:48.978 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:07:48.998 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:07:48.998 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:07:49.034 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:07:49.034 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:07:49.057 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:49.055+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:49.105 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:49.105 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:49.119 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:07:49.157 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:49.157+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:49.248 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:49.248 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:49.258 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:49.255+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:49.262 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:07:49.312 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:07:49.358 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:49.355+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:49.426 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:49.427 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:49.441 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:07:49.483 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:49.483+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:49.559 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:49.561+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:49.607 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:49.608 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:49.621 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:07:49.667 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:49.667+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:49.746 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:49.746 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:49.760 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:07:49.803 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:49.803+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:49.862 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:49.859+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:49.927 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:49.927 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:49.941 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:07:49.962 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:49.961+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:50.063 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:50.063+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:50.119 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:50.120 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:50.134 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:07:50.163 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:50.165+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:50.264 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:50.263+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:50.297 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:50.297 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:50.312 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-05-08T18:07:50.314 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:07:50.399 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:50.399+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:50.466 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:50.469+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:50.470 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:50.470 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:50.485 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:07:50.567 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:50.569+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:50.651 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:50.651 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:50.665 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:07:50.668 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:50.667+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:50.769 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:50.767+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:50.772 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:50.772 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:50.785 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:07:50.876 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:50.875+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:50.936 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:50.936 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:50.948 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:07:50.970 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:50.969+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:51.053 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:07:51.103 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:51.105+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:51.114 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:51.114 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:51.128 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:07:51.175 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:51.177+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:51.205 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:07:51.205 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:07:51.222 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:07:51.222 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:07:51.238 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:07:51.238 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:07:51.255 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:07:51.255 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:07:51.260 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:51.260 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:51.271 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:51.271+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:51.274 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:07:51.275 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:07:51.275 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:07:51.298 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:07:51.298 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:07:51.319 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:07:51.319 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:07:51.339 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:07:51.339 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:07:51.372 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:51.371+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:51.390 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:51.390 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:51.390 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:07:51.391 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:07:51.391 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:51.404 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:07:51.491 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:51.493+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:51.573 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:51.573 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:07:51.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:07:51.573 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:07:51.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.573 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:52 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'31)", 2024-05-08T18:07:51.573 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:07:51.574 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 48.449281964999997, 2024-05-08T18:07:51.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00409947, 2024-05-08T18:07:51.574 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.574 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.574 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.574 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:07:51.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:07:51.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127167+0000", 2024-05-08T18:07:51.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7800000000000001e-07 2024-05-08T18:07:51.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127172+0000", 2024-05-08T18:07:51.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1120000000000004e-06 2024-05-08T18:07:51.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127183+0000", 2024-05-08T18:07:51.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1107000000000001e-05 2024-05-08T18:07:51.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127189+0000", 2024-05-08T18:07:51.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0310000000000004e-06 2024-05-08T18:07:51.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127237+0000", 2024-05-08T18:07:51.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7907000000000001e-05 2024-05-08T18:07:51.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127252+0000", 2024-05-08T18:07:51.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5373e-05 2024-05-08T18:07:51.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131206+0000", 2024-05-08T18:07:51.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039540199999999999 2024-05-08T18:07:51.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131265+0000", 2024-05-08T18:07:51.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9141999999999997e-05 2024-05-08T18:07:51.578 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.578 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.578 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.578 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-05-08T18:07:51.578 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:07:51.578 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 48.440523560999999, 2024-05-08T18:07:51.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049265589999999996, 2024-05-08T18:07:51.578 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.578 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.579 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.579 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:07:51.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:07:51.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135925+0000", 2024-05-08T18:07:51.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8100000000000002e-07 2024-05-08T18:07:51.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136007+0000", 2024-05-08T18:07:51.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1864000000000001e-05 2024-05-08T18:07:51.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136019+0000", 2024-05-08T18:07:51.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2438e-05 2024-05-08T18:07:51.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136026+0000", 2024-05-08T18:07:51.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0809999999999996e-06 2024-05-08T18:07:51.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136093+0000", 2024-05-08T18:07:51.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6769999999999999e-05 2024-05-08T18:07:51.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136108+0000", 2024-05-08T18:07:51.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.465e-05 2024-05-08T18:07:51.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140800+0000", 2024-05-08T18:07:51.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046919450000000003 2024-05-08T18:07:51.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140851+0000", 2024-05-08T18:07:51.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.113e-05 2024-05-08T18:07:51.582 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.582 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.582 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.583 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-05-08T18:07:51.583 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:07:51.583 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 48.224038350999997, 2024-05-08T18:07:51.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042257299999999996, 2024-05-08T18:07:51.583 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.583 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.583 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.583 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:07:51.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:07:51.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352410+0000", 2024-05-08T18:07:51.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7599999999999997e-07 2024-05-08T18:07:51.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352489+0000", 2024-05-08T18:07:51.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8564000000000002e-05 2024-05-08T18:07:51.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352500+0000", 2024-05-08T18:07:51.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1411e-05 2024-05-08T18:07:51.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352506+0000", 2024-05-08T18:07:51.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7309999999999998e-06 2024-05-08T18:07:51.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352569+0000", 2024-05-08T18:07:51.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3173e-05 2024-05-08T18:07:51.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352598+0000", 2024-05-08T18:07:51.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8855000000000001e-05 2024-05-08T18:07:51.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356592+0000", 2024-05-08T18:07:51.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039941539999999998 2024-05-08T18:07:51.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356635+0000", 2024-05-08T18:07:51.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3166e-05 2024-05-08T18:07:51.586 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.586 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.587 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.587 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:75 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'53, mlcod=15'43)", 2024-05-08T18:07:51.587 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:51.587 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 48.215866933999997, 2024-05-08T18:07:51.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063708030000000004, 2024-05-08T18:07:51.587 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.587 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.587 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.587 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:51.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:51.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:51.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:07:51.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360641+0000", 2024-05-08T18:07:51.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9273e-05 2024-05-08T18:07:51.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360651+0000", 2024-05-08T18:07:51.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0353000000000001e-05 2024-05-08T18:07:51.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360659+0000", 2024-05-08T18:07:51.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4789999999999999e-06 2024-05-08T18:07:51.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360720+0000", 2024-05-08T18:07:51.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699000000000007e-05 2024-05-08T18:07:51.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360739+0000", 2024-05-08T18:07:51.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8913999999999999e-05 2024-05-08T18:07:51.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366883+0000", 2024-05-08T18:07:51.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061438229999999996 2024-05-08T18:07:51.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366952+0000", 2024-05-08T18:07:51.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8677000000000007e-05 2024-05-08T18:07:51.591 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.591 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.591 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.592 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:76 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'54, mlcod=15'49)", 2024-05-08T18:07:51.592 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:07:51.592 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 48.214130429000001, 2024-05-08T18:07:51.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046550610000000003, 2024-05-08T18:07:51.592 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.592 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.592 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.592 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:07:51.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:07:51.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362318+0000", 2024-05-08T18:07:51.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.99e-07 2024-05-08T18:07:51.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362323+0000", 2024-05-08T18:07:51.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.566e-06 2024-05-08T18:07:51.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362334+0000", 2024-05-08T18:07:51.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1403000000000001e-05 2024-05-08T18:07:51.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362342+0000", 2024-05-08T18:07:51.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3420000000000008e-06 2024-05-08T18:07:51.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362396+0000", 2024-05-08T18:07:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3476000000000001e-05 2024-05-08T18:07:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362415+0000", 2024-05-08T18:07:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8787000000000002e-05 2024-05-08T18:07:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366954+0000", 2024-05-08T18:07:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045388609999999999 2024-05-08T18:07:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366972+0000", 2024-05-08T18:07:51.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8927e-05 2024-05-08T18:07:51.596 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.596 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.596 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.596 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:79 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'57, mlcod=15'53)", 2024-05-08T18:07:51.596 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:07:51.596 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 48.206734501, 2024-05-08T18:07:51.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045322499999999998, 2024-05-08T18:07:51.596 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.596 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.596 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.596 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:07:51.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:07:51.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369714+0000", 2024-05-08T18:07:51.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:07:51.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369787+0000", 2024-05-08T18:07:51.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3317000000000003e-05 2024-05-08T18:07:51.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369797+0000", 2024-05-08T18:07:51.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9510000000000001e-06 2024-05-08T18:07:51.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369802+0000", 2024-05-08T18:07:51.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8210000000000001e-06 2024-05-08T18:07:51.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369854+0000", 2024-05-08T18:07:51.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1751e-05 2024-05-08T18:07:51.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369880+0000", 2024-05-08T18:07:51.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6577999999999999e-05 2024-05-08T18:07:51.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374202+0000", 2024-05-08T18:07:51.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217029999999997 2024-05-08T18:07:51.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374246+0000", 2024-05-08T18:07:51.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3544000000000002e-05 2024-05-08T18:07:51.600 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.600 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.600 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.600 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:89 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'63, mlcod=15'60)", 2024-05-08T18:07:51.600 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:51.600 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 47.873192336000002, 2024-05-08T18:07:51.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057729900000000004, 2024-05-08T18:07:51.600 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.600 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.600 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.600 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:51.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:51.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:51.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:07:51.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703261+0000", 2024-05-08T18:07:51.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2569999999999998e-06 2024-05-08T18:07:51.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703272+0000", 2024-05-08T18:07:51.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0739e-05 2024-05-08T18:07:51.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703282+0000", 2024-05-08T18:07:51.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6250000000000002e-06 2024-05-08T18:07:51.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703333+0000", 2024-05-08T18:07:51.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1588000000000001e-05 2024-05-08T18:07:51.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703358+0000", 2024-05-08T18:07:51.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4913999999999999e-05 2024-05-08T18:07:51.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708907+0000", 2024-05-08T18:07:51.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055484829999999999 2024-05-08T18:07:51.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.709028+0000", 2024-05-08T18:07:51.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121667 2024-05-08T18:07:51.604 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.604 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.604 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.604 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-05-08T18:07:51.604 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:07:51.604 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 47.872126819000002, 2024-05-08T18:07:51.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0074185579999999996, 2024-05-08T18:07:51.605 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.605 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.605 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.605 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:07:51.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:07:51.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704322+0000", 2024-05-08T18:07:51.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8299999999999997e-07 2024-05-08T18:07:51.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704410+0000", 2024-05-08T18:07:51.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8552000000000002e-05 2024-05-08T18:07:51.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704421+0000", 2024-05-08T18:07:51.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0794e-05 2024-05-08T18:07:51.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704427+0000", 2024-05-08T18:07:51.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8699999999999997e-06 2024-05-08T18:07:51.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704481+0000", 2024-05-08T18:07:51.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4410999999999998e-05 2024-05-08T18:07:51.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704511+0000", 2024-05-08T18:07:51.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9906000000000001e-05 2024-05-08T18:07:51.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711682+0000", 2024-05-08T18:07:51.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071710209999999996 2024-05-08T18:07:51.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711740+0000", 2024-05-08T18:07:51.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7521e-05 2024-05-08T18:07:51.609 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.609 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.609 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.609 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:91 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'65, mlcod=15'60)", 2024-05-08T18:07:51.609 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:07:51.609 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 47.870582626000001, 2024-05-08T18:07:51.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059345600000000002, 2024-05-08T18:07:51.609 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.609 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.609 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.609 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:07:51.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:07:51.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705866+0000", 2024-05-08T18:07:51.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0900000000000001e-07 2024-05-08T18:07:51.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705872+0000", 2024-05-08T18:07:51.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0580000000000003e-06 2024-05-08T18:07:51.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705883+0000", 2024-05-08T18:07:51.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0986e-05 2024-05-08T18:07:51.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705889+0000", 2024-05-08T18:07:51.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6400000000000002e-06 2024-05-08T18:07:51.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705942+0000", 2024-05-08T18:07:51.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3726e-05 2024-05-08T18:07:51.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705963+0000", 2024-05-08T18:07:51.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0713e-05 2024-05-08T18:07:51.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711744+0000", 2024-05-08T18:07:51.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057812669999999997 2024-05-08T18:07:51.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711800+0000", 2024-05-08T18:07:51.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5461000000000003e-05 2024-05-08T18:07:51.613 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.613 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.613 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.613 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:92 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'66, mlcod=15'61)", 2024-05-08T18:07:51.613 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:07:51.613 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 47.869258277999997, 2024-05-08T18:07:51.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046553640000000004, 2024-05-08T18:07:51.614 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.614 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.614 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.614 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:07:51.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:07:51.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707191+0000", 2024-05-08T18:07:51.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9300000000000006e-07 2024-05-08T18:07:51.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707198+0000", 2024-05-08T18:07:51.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4669999999999998e-06 2024-05-08T18:07:51.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707214+0000", 2024-05-08T18:07:51.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5911000000000001e-05 2024-05-08T18:07:51.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707221+0000", 2024-05-08T18:07:51.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.43e-06 2024-05-08T18:07:51.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707283+0000", 2024-05-08T18:07:51.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1974e-05 2024-05-08T18:07:51.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707308+0000", 2024-05-08T18:07:51.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4589000000000001e-05 2024-05-08T18:07:51.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711802+0000", 2024-05-08T18:07:51.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044944939999999999 2024-05-08T18:07:51.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711845+0000", 2024-05-08T18:07:51.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2506000000000003e-05 2024-05-08T18:07:51.617 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.617 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.617 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.617 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:93 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'67, mlcod=15'61)", 2024-05-08T18:07:51.618 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:07:51.618 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 47.868428021, 2024-05-08T18:07:51.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217760000000003, 2024-05-08T18:07:51.618 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.618 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.618 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.618 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:07:51.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:07:51.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708021+0000", 2024-05-08T18:07:51.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.92e-07 2024-05-08T18:07:51.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708106+0000", 2024-05-08T18:07:51.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5400000000000002e-05 2024-05-08T18:07:51.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708116+0000", 2024-05-08T18:07:51.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0482000000000001e-05 2024-05-08T18:07:51.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708124+0000", 2024-05-08T18:07:51.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5349999999999999e-06 2024-05-08T18:07:51.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708182+0000", 2024-05-08T18:07:51.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8130000000000001e-05 2024-05-08T18:07:51.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708203+0000", 2024-05-08T18:07:51.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1118e-05 2024-05-08T18:07:51.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712298+0000", 2024-05-08T18:07:51.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004094688 2024-05-08T18:07:51.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712342+0000", 2024-05-08T18:07:51.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3730999999999999e-05 2024-05-08T18:07:51.622 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.622 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.622 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.622 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:51.622 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:07:51.622 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.972001955, 2024-05-08T18:07:51.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087837890000000002, 2024-05-08T18:07:51.622 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.622 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.622 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.623 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:51.623 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:51.623 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:51.623 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210 2024-05-08T18:07:51.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.623 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:07:51.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:07:51.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604448+0000", 2024-05-08T18:07:51.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4229999999999999e-06 2024-05-08T18:07:51.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604460+0000", 2024-05-08T18:07:51.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:07:51.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604491+0000", 2024-05-08T18:07:51.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1004000000000003e-05 2024-05-08T18:07:51.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604513+0000", 2024-05-08T18:07:51.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1886e-05 2024-05-08T18:07:51.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604670+0000", 2024-05-08T18:07:51.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000156735 2024-05-08T18:07:51.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:07:51.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604680+0000", 2024-05-08T18:07:51.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0113e-05 2024-05-08T18:07:51.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609236+0000", 2024-05-08T18:07:51.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045557269999999999 2024-05-08T18:07:51.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609544+0000", 2024-05-08T18:07:51.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030863800000000002 2024-05-08T18:07:51.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:51.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.610952+0000", 2024-05-08T18:07:51.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014077269999999999 2024-05-08T18:07:51.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:51.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.612639+0000", 2024-05-08T18:07:51.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001686398 2024-05-08T18:07:51.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:51.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613101+0000", 2024-05-08T18:07:51.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00046249600000000001 2024-05-08T18:07:51.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613176+0000", 2024-05-08T18:07:51.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5032999999999998e-05 2024-05-08T18:07:51.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613230+0000", 2024-05-08T18:07:51.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3638999999999999e-05 2024-05-08T18:07:51.628 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.628 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.628 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.629 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:51.629 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:07:51.629 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.923413745000001, 2024-05-08T18:07:51.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046602199999999996, 2024-05-08T18:07:51.629 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.629 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.629 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.629 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:51.629 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:51.629 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:51.629 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 222 2024-05-08T18:07:51.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.629 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:07:51.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:07:51.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653037+0000", 2024-05-08T18:07:51.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:07:51.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653048+0000", 2024-05-08T18:07:51.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:07:51.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653077+0000", 2024-05-08T18:07:51.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9326e-05 2024-05-08T18:07:51.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653098+0000", 2024-05-08T18:07:51.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1327000000000001e-05 2024-05-08T18:07:51.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653230+0000", 2024-05-08T18:07:51.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013206599999999999 2024-05-08T18:07:51.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653444+0000", 2024-05-08T18:07:51.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000213401 2024-05-08T18:07:51.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:51.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653852+0000", 2024-05-08T18:07:51.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040808700000000001 2024-05-08T18:07:51.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:51.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.656108+0000", 2024-05-08T18:07:51.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022565739999999999 2024-05-08T18:07:51.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:51.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657533+0000", 2024-05-08T18:07:51.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014241799999999999 2024-05-08T18:07:51.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657629+0000", 2024-05-08T18:07:51.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6435999999999996e-05 2024-05-08T18:07:51.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657694+0000", 2024-05-08T18:07:51.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5349000000000001e-05 2024-05-08T18:07:51.634 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.634 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.634 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.635 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:461 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:51.635 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:07:51.635 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.796791938999998, 2024-05-08T18:07:51.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040933549999999999, 2024-05-08T18:07:51.635 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.635 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.635 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.635 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:51.635 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:51.635 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:51.635 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 461 2024-05-08T18:07:51.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.635 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:07:51.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:07:51.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779657+0000", 2024-05-08T18:07:51.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.252e-06 2024-05-08T18:07:51.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779663+0000", 2024-05-08T18:07:51.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0170000000000002e-06 2024-05-08T18:07:51.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779676+0000", 2024-05-08T18:07:51.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.296e-05 2024-05-08T18:07:51.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779684+0000", 2024-05-08T18:07:51.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4209999999999998e-06 2024-05-08T18:07:51.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779736+0000", 2024-05-08T18:07:51.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2296999999999998e-05 2024-05-08T18:07:51.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779787+0000", 2024-05-08T18:07:51.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0954e-05 2024-05-08T18:07:51.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:51.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779897+0000", 2024-05-08T18:07:51.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011001999999999999 2024-05-08T18:07:51.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:51.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780506+0000", 2024-05-08T18:07:51.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060872599999999997 2024-05-08T18:07:51.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:51.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783690+0000", 2024-05-08T18:07:51.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031847210000000002 2024-05-08T18:07:51.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783722+0000", 2024-05-08T18:07:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1608e-05 2024-05-08T18:07:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783749+0000", 2024-05-08T18:07:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7379e-05 2024-05-08T18:07:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:491 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:07:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.774528330999999, 2024-05-08T18:07:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059507570000000001, 2024-05-08T18:07:51.640 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 491 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:07:51.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801921+0000", 2024-05-08T18:07:51.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6959999999999999e-06 2024-05-08T18:07:51.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801928+0000", 2024-05-08T18:07:51.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0299999999999996e-06 2024-05-08T18:07:51.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801944+0000", 2024-05-08T18:07:51.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285e-05 2024-05-08T18:07:51.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801953+0000", 2024-05-08T18:07:51.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1849999999999993e-06 2024-05-08T18:07:51.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802008+0000", 2024-05-08T18:07:51.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5379e-05 2024-05-08T18:07:51.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802093+0000", 2024-05-08T18:07:51.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4907000000000005e-05 2024-05-08T18:07:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802217+0000", 2024-05-08T18:07:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000124253 2024-05-08T18:07:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802725+0000", 2024-05-08T18:07:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050758699999999999 2024-05-08T18:07:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807807+0000", 2024-05-08T18:07:51.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005082133 2024-05-08T18:07:51.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807840+0000", 2024-05-08T18:07:51.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3399000000000003e-05 2024-05-08T18:07:51.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807870+0000", 2024-05-08T18:07:51.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9903000000000002e-05 2024-05-08T18:07:51.645 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.645 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.645 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.646 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:51.646 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:07:51.646 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.768186127, 2024-05-08T18:07:51.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056057140000000004, 2024-05-08T18:07:51.646 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.646 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.646 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.646 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:51.646 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:51.646 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:51.646 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 502 2024-05-08T18:07:51.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.646 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:07:51.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:07:51.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808263+0000", 2024-05-08T18:07:51.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.054e-06 2024-05-08T18:07:51.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808268+0000", 2024-05-08T18:07:51.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4829999999999999e-06 2024-05-08T18:07:51.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808279+0000", 2024-05-08T18:07:51.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0710000000000001e-05 2024-05-08T18:07:51.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808285+0000", 2024-05-08T18:07:51.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0610000000000001e-06 2024-05-08T18:07:51.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808331+0000", 2024-05-08T18:07:51.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5939000000000002e-05 2024-05-08T18:07:51.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808380+0000", 2024-05-08T18:07:51.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9382999999999998e-05 2024-05-08T18:07:51.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:51.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808484+0000", 2024-05-08T18:07:51.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010410499999999999 2024-05-08T18:07:51.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:51.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.809035+0000", 2024-05-08T18:07:51.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000550969 2024-05-08T18:07:51.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:51.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813811+0000", 2024-05-08T18:07:51.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047759830000000001 2024-05-08T18:07:51.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813842+0000", 2024-05-08T18:07:51.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0778000000000002e-05 2024-05-08T18:07:51.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813867+0000", 2024-05-08T18:07:51.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5249000000000002e-05 2024-05-08T18:07:51.651 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.651 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.651 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.651 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:51.651 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:07:51.651 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.741655841, 2024-05-08T18:07:51.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041392019999999998, 2024-05-08T18:07:51.652 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.652 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.652 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.652 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:51.652 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:51.652 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:51.652 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 527 2024-05-08T18:07:51.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.652 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:07:51.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:07:51.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834793+0000", 2024-05-08T18:07:51.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.212e-06 2024-05-08T18:07:51.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834799+0000", 2024-05-08T18:07:51.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.468e-06 2024-05-08T18:07:51.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834811+0000", 2024-05-08T18:07:51.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2602000000000001e-05 2024-05-08T18:07:51.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834819+0000", 2024-05-08T18:07:51.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6660000000000008e-06 2024-05-08T18:07:51.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834871+0000", 2024-05-08T18:07:51.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2450000000000001e-05 2024-05-08T18:07:51.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834973+0000", 2024-05-08T18:07:51.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101778 2024-05-08T18:07:51.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:51.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835114+0000", 2024-05-08T18:07:51.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014053399999999999 2024-05-08T18:07:51.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:51.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835758+0000", 2024-05-08T18:07:51.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064386100000000002 2024-05-08T18:07:51.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:51.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838876+0000", 2024-05-08T18:07:51.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031188890000000001 2024-05-08T18:07:51.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838907+0000", 2024-05-08T18:07:51.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-08T18:07:51.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838931+0000", 2024-05-08T18:07:51.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3822999999999999e-05 2024-05-08T18:07:51.657 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.657 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.657 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.657 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:51.657 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:07:51.657 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.737150861, 2024-05-08T18:07:51.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048358089999999999, 2024-05-08T18:07:51.657 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.657 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.657 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.657 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:51.657 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:51.657 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:51.658 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 534 2024-05-08T18:07:51.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.658 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:07:51.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:07:51.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839298+0000", 2024-05-08T18:07:51.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1429999999999999e-06 2024-05-08T18:07:51.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839304+0000", 2024-05-08T18:07:51.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4380000000000003e-06 2024-05-08T18:07:51.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839313+0000", 2024-05-08T18:07:51.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5210000000000008e-06 2024-05-08T18:07:51.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839318+0000", 2024-05-08T18:07:51.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0540000000000002e-06 2024-05-08T18:07:51.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839355+0000", 2024-05-08T18:07:51.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6541999999999997e-05 2024-05-08T18:07:51.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839400+0000", 2024-05-08T18:07:51.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4861999999999998e-05 2024-05-08T18:07:51.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:51.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839504+0000", 2024-05-08T18:07:51.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104169 2024-05-08T18:07:51.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:51.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.840046+0000", 2024-05-08T18:07:51.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054245400000000005 2024-05-08T18:07:51.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:51.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844075+0000", 2024-05-08T18:07:51.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040287559999999997 2024-05-08T18:07:51.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844108+0000", 2024-05-08T18:07:51.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2872e-05 2024-05-08T18:07:51.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844133+0000", 2024-05-08T18:07:51.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4998e-05 2024-05-08T18:07:51.663 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.663 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.663 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.664 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:544 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:51.664 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:07:51.664 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.724007851, 2024-05-08T18:07:51.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052743060000000003, 2024-05-08T18:07:51.664 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.664 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.664 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.664 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:51.664 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:51.664 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:51.665 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 544 2024-05-08T18:07:51.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.665 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:07:51.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:07:51.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852442+0000", 2024-05-08T18:07:51.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.88e-06 2024-05-08T18:07:51.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852450+0000", 2024-05-08T18:07:51.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1999999999999994e-06 2024-05-08T18:07:51.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852472+0000", 2024-05-08T18:07:51.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2160000000000001e-05 2024-05-08T18:07:51.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852487+0000", 2024-05-08T18:07:51.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5044e-05 2024-05-08T18:07:51.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852550+0000", 2024-05-08T18:07:51.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3152999999999997e-05 2024-05-08T18:07:51.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852608+0000", 2024-05-08T18:07:51.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8026000000000003e-05 2024-05-08T18:07:51.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:51.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852727+0000", 2024-05-08T18:07:51.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118919 2024-05-08T18:07:51.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:51.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.853180+0000", 2024-05-08T18:07:51.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045216599999999999 2024-05-08T18:07:51.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:51.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857638+0000", 2024-05-08T18:07:51.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044584510000000004 2024-05-08T18:07:51.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857672+0000", 2024-05-08T18:07:51.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3571000000000001e-05 2024-05-08T18:07:51.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857714+0000", 2024-05-08T18:07:51.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2735999999999999e-05 2024-05-08T18:07:51.669 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.669 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.669 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.669 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:51.670 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:07:51.670 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.396179071999999, 2024-05-08T18:07:51.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004733213, 2024-05-08T18:07:51.670 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:51.670 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:51.670 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:51.670 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:51.670 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:51.670 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:51.670 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 789 2024-05-08T18:07:51.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.670 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:51.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:51.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:07:51.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:51.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:07:51.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:51.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:51.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180271+0000", 2024-05-08T18:07:51.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8700000000000001e-06 2024-05-08T18:07:51.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:51.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180281+0000", 2024-05-08T18:07:51.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0067e-05 2024-05-08T18:07:51.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:51.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180311+0000", 2024-05-08T18:07:51.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0783e-05 2024-05-08T18:07:51.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:51.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180333+0000", 2024-05-08T18:07:51.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1509999999999999e-05 2024-05-08T18:07:51.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:51.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180450+0000", 2024-05-08T18:07:51.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116686 2024-05-08T18:07:51.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:51.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180581+0000", 2024-05-08T18:07:51.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013103499999999999 2024-05-08T18:07:51.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:51.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180848+0000", 2024-05-08T18:07:51.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026750199999999997 2024-05-08T18:07:51.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:51.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184268+0000", 2024-05-08T18:07:51.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034198319999999998 2024-05-08T18:07:51.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:51.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184844+0000", 2024-05-08T18:07:51.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057643899999999999 2024-05-08T18:07:51.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:51.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184933+0000", 2024-05-08T18:07:51.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8692999999999999e-05 2024-05-08T18:07:51.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:51.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:51.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:51.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.185002+0000", 2024-05-08T18:07:51.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8795999999999997e-05 2024-05-08T18:07:51.675 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.675 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.675 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.675 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:51.675 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:51.675 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:51.676 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:07:51.571+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:07:51.677 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:07:51.678 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:51.675+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:51.777 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:51.777+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:51.848 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:51.848 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:51.848 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:51.848 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:51.864 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:07:51.878 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:51.875+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:51.979 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:51.981+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:52.030 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:52.030 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:52.030 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:07:52.030 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:07:52.030 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:52.044 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:07:52.087 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:52.089+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:52.182 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:52.179+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:52.215 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:52.216 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:07:52.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:07:52.216 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:07:52.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.216 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-05-08T18:07:52.216 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:07:52.216 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.647007247000001, 2024-05-08T18:07:52.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035750999999999999, 2024-05-08T18:07:52.216 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.216 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.216 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.216 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:07:52.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:07:52.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570203+0000", 2024-05-08T18:07:52.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6749999999999996e-06 2024-05-08T18:07:52.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570213+0000", 2024-05-08T18:07:52.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0139999999999999e-05 2024-05-08T18:07:52.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570231+0000", 2024-05-08T18:07:52.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8402000000000001e-05 2024-05-08T18:07:52.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570245+0000", 2024-05-08T18:07:52.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3135e-05 2024-05-08T18:07:52.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570338+0000", 2024-05-08T18:07:52.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3498000000000005e-05 2024-05-08T18:07:52.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570373+0000", 2024-05-08T18:07:52.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5179999999999999e-05 2024-05-08T18:07:52.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573694+0000", 2024-05-08T18:07:52.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003320524 2024-05-08T18:07:52.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573771+0000", 2024-05-08T18:07:52.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7546000000000006e-05 2024-05-08T18:07:52.220 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.220 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.220 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.220 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-05-08T18:07:52.220 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:07:52.220 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.641694285, 2024-05-08T18:07:52.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038280229999999998, 2024-05-08T18:07:52.220 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.221 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.221 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.221 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:07:52.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:07:52.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575510+0000", 2024-05-08T18:07:52.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0979999999999999e-06 2024-05-08T18:07:52.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575527+0000", 2024-05-08T18:07:52.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6393999999999999e-05 2024-05-08T18:07:52.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575549+0000", 2024-05-08T18:07:52.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1843000000000001e-05 2024-05-08T18:07:52.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575560+0000", 2024-05-08T18:07:52.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.186e-05 2024-05-08T18:07:52.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575651+0000", 2024-05-08T18:07:52.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1068000000000003e-05 2024-05-08T18:07:52.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575685+0000", 2024-05-08T18:07:52.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3614e-05 2024-05-08T18:07:52.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579231+0000", 2024-05-08T18:07:52.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003546249 2024-05-08T18:07:52.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579337+0000", 2024-05-08T18:07:52.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010589700000000001 2024-05-08T18:07:52.224 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.224 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.224 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.224 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-05-08T18:07:52.225 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:07:52.225 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.639656993999999, 2024-05-08T18:07:52.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004223157, 2024-05-08T18:07:52.225 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.225 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.225 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.225 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:07:52.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:07:52.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577548+0000", 2024-05-08T18:07:52.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.66e-06 2024-05-08T18:07:52.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577561+0000", 2024-05-08T18:07:52.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2533e-05 2024-05-08T18:07:52.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577585+0000", 2024-05-08T18:07:52.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3873e-05 2024-05-08T18:07:52.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577605+0000", 2024-05-08T18:07:52.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0477000000000001e-05 2024-05-08T18:07:52.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577717+0000", 2024-05-08T18:07:52.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011229499999999999 2024-05-08T18:07:52.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577777+0000", 2024-05-08T18:07:52.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.944e-05 2024-05-08T18:07:52.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581704+0000", 2024-05-08T18:07:52.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039267800000000004 2024-05-08T18:07:52.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581770+0000", 2024-05-08T18:07:52.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6099000000000005e-05 2024-05-08T18:07:52.229 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.229 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.229 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.229 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:54 7.d e29/28 7:b4812045:::notify.4:head v 29'1, mlcod=0'0)", 2024-05-08T18:07:52.229 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:07:52.229 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.636844270000001, 2024-05-08T18:07:52.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003988503, 2024-05-08T18:07:52.229 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.229 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.229 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.229 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:07:52.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:07:52.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580368+0000", 2024-05-08T18:07:52.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3089999999999996e-06 2024-05-08T18:07:52.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580400+0000", 2024-05-08T18:07:52.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2580000000000003e-05 2024-05-08T18:07:52.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580427+0000", 2024-05-08T18:07:52.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6976999999999999e-05 2024-05-08T18:07:52.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580443+0000", 2024-05-08T18:07:52.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5585000000000001e-05 2024-05-08T18:07:52.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580555+0000", 2024-05-08T18:07:52.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112639 2024-05-08T18:07:52.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580601+0000", 2024-05-08T18:07:52.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6e-05 2024-05-08T18:07:52.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584229+0000", 2024-05-08T18:07:52.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036273659999999999 2024-05-08T18:07:52.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584348+0000", 2024-05-08T18:07:52.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119047 2024-05-08T18:07:52.233 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.233 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.233 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.233 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:52.233 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:07:52.233 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.527431, 2024-05-08T18:07:52.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032136159999999999, 2024-05-08T18:07:52.233 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.234 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.234 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.234 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.234 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.234 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.234 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 193 2024-05-08T18:07:52.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.234 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:07:52.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:07:52.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689775+0000", 2024-05-08T18:07:52.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.357e-06 2024-05-08T18:07:52.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689788+0000", 2024-05-08T18:07:52.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3029e-05 2024-05-08T18:07:52.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689819+0000", 2024-05-08T18:07:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.065e-05 2024-05-08T18:07:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689833+0000", 2024-05-08T18:07:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4790000000000001e-05 2024-05-08T18:07:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689948+0000", 2024-05-08T18:07:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115089 2024-05-08T18:07:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690155+0000", 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206932 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690420+0000", 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026450200000000001 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692229+0000", 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001808823 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692816+0000", 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058773199999999999 2024-05-08T18:07:52.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692915+0000", 2024-05-08T18:07:52.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8646000000000004e-05 2024-05-08T18:07:52.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692986+0000", 2024-05-08T18:07:52.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1066e-05 2024-05-08T18:07:52.238 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.238 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.238 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.238 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.239 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:07:52.239 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.628464781000002, 2024-05-08T18:07:52.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089431319999999995, 2024-05-08T18:07:52.239 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.239 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.239 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.239 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.239 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.239 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.239 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 208 2024-05-08T18:07:52.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.239 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:07:52.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:07:52.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588741+0000", 2024-05-08T18:07:52.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:07:52.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588752+0000", 2024-05-08T18:07:52.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0813e-05 2024-05-08T18:07:52.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588782+0000", 2024-05-08T18:07:52.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0020000000000001e-05 2024-05-08T18:07:52.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588803+0000", 2024-05-08T18:07:52.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1115999999999999e-05 2024-05-08T18:07:52.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588943+0000", 2024-05-08T18:07:52.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013971599999999999 2024-05-08T18:07:52.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:07:52.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588954+0000", 2024-05-08T18:07:52.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1365999999999999e-05 2024-05-08T18:07:52.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594340+0000", 2024-05-08T18:07:52.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053854910000000001 2024-05-08T18:07:52.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594670+0000", 2024-05-08T18:07:52.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000330055 2024-05-08T18:07:52.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:52.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.595179+0000", 2024-05-08T18:07:52.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050879199999999999 2024-05-08T18:07:52.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.596408+0000", 2024-05-08T18:07:52.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012295209999999999 2024-05-08T18:07:52.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597532+0000", 2024-05-08T18:07:52.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011233860000000001 2024-05-08T18:07:52.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597619+0000", 2024-05-08T18:07:52.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7775999999999994e-05 2024-05-08T18:07:52.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597682+0000", 2024-05-08T18:07:52.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2522999999999998e-05 2024-05-08T18:07:52.244 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.244 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.244 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.245 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.245 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:07:52.245 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.599835802000001, 2024-05-08T18:07:52.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031262669999999998, 2024-05-08T18:07:52.245 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.245 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.245 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.245 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.245 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.245 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.245 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 212 2024-05-08T18:07:52.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.245 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:07:52.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:07:52.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617370+0000", 2024-05-08T18:07:52.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:07:52.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617379+0000", 2024-05-08T18:07:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2359999999999993e-06 2024-05-08T18:07:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617405+0000", 2024-05-08T18:07:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5639999999999998e-05 2024-05-08T18:07:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617425+0000", 2024-05-08T18:07:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0457000000000001e-05 2024-05-08T18:07:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617573+0000", 2024-05-08T18:07:52.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014776200000000001 2024-05-08T18:07:52.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617786+0000", 2024-05-08T18:07:52.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212418 2024-05-08T18:07:52.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:52.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.618177+0000", 2024-05-08T18:07:52.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039161699999999997 2024-05-08T18:07:52.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.619563+0000", 2024-05-08T18:07:52.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013852999999999999 2024-05-08T18:07:52.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620334+0000", 2024-05-08T18:07:52.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00077182200000000002 2024-05-08T18:07:52.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620426+0000", 2024-05-08T18:07:52.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1526000000000004e-05 2024-05-08T18:07:52.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620494+0000", 2024-05-08T18:07:52.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8078999999999997e-05 2024-05-08T18:07:52.250 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.250 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.250 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.250 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.250 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:07:52.250 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.575517249000001, 2024-05-08T18:07:52.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035230880000000002, 2024-05-08T18:07:52.250 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.250 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.250 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.250 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.250 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.250 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.251 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 219 2024-05-08T18:07:52.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.251 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:07:52.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:07:52.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641689+0000", 2024-05-08T18:07:52.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:07:52.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641700+0000", 2024-05-08T18:07:52.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1507e-05 2024-05-08T18:07:52.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641732+0000", 2024-05-08T18:07:52.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1585999999999999e-05 2024-05-08T18:07:52.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641754+0000", 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1480000000000001e-05 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641942+0000", 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018826300000000001 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642165+0000", 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022301100000000001 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:52.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642587+0000", 2024-05-08T18:07:52.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042182400000000001 2024-05-08T18:07:52.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.254 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.643767+0000", 2024-05-08T18:07:52.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001180675 2024-05-08T18:07:52.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.254 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645010+0000", 2024-05-08T18:07:52.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012427110000000001 2024-05-08T18:07:52.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.254 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645101+0000", 2024-05-08T18:07:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0871999999999993e-05 2024-05-08T18:07:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645209+0000", 2024-05-08T18:07:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108496 2024-05-08T18:07:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:07:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.555720262000001, 2024-05-08T18:07:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035793639999999998, 2024-05-08T18:07:52.255 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.256 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.256 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.256 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.256 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.256 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.256 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 224 2024-05-08T18:07:52.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.256 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:07:52.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:07:52.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661485+0000", 2024-05-08T18:07:52.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9759999999999998e-06 2024-05-08T18:07:52.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661494+0000", 2024-05-08T18:07:52.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3469999999999999e-06 2024-05-08T18:07:52.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661517+0000", 2024-05-08T18:07:52.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.389e-05 2024-05-08T18:07:52.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661537+0000", 2024-05-08T18:07:52.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9803e-05 2024-05-08T18:07:52.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661696+0000", 2024-05-08T18:07:52.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015865899999999999 2024-05-08T18:07:52.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661910+0000", 2024-05-08T18:07:52.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021434199999999999 2024-05-08T18:07:52.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:52.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.662336+0000", 2024-05-08T18:07:52.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042575300000000001 2024-05-08T18:07:52.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.663720+0000", 2024-05-08T18:07:52.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013843799999999999 2024-05-08T18:07:52.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.260 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.260 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.664909+0000", 2024-05-08T18:07:52.260 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011889019999999999 2024-05-08T18:07:52.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.260 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.260 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665001+0000", 2024-05-08T18:07:52.260 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1649000000000003e-05 2024-05-08T18:07:52.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.260 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.260 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665063+0000", 2024-05-08T18:07:52.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1662999999999996e-05 2024-05-08T18:07:52.261 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.261 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.261 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.261 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.261 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:07:52.261 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.523126988000001, 2024-05-08T18:07:52.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031551930000000001, 2024-05-08T18:07:52.261 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.261 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.261 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.262 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.262 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.262 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.262 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 233 2024-05-08T18:07:52.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.262 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:07:52.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:07:52.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694079+0000", 2024-05-08T18:07:52.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:07:52.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694090+0000", 2024-05-08T18:07:52.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1182999999999999e-05 2024-05-08T18:07:52.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694119+0000", 2024-05-08T18:07:52.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9076000000000001e-05 2024-05-08T18:07:52.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694143+0000", 2024-05-08T18:07:52.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4363e-05 2024-05-08T18:07:52.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694291+0000", 2024-05-08T18:07:52.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147849 2024-05-08T18:07:52.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694534+0000", 2024-05-08T18:07:52.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000242382 2024-05-08T18:07:52.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:52.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694957+0000", 2024-05-08T18:07:52.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042316700000000001 2024-05-08T18:07:52.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.696306+0000", 2024-05-08T18:07:52.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013489940000000001 2024-05-08T18:07:52.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.266 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.266 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697071+0000", 2024-05-08T18:07:52.266 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076482999999999998 2024-05-08T18:07:52.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.266 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.266 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697167+0000", 2024-05-08T18:07:52.266 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6773000000000003e-05 2024-05-08T18:07:52.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.266 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.266 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697232+0000", 2024-05-08T18:07:52.266 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4386000000000003e-05 2024-05-08T18:07:52.266 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.267 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.267 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.267 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:328 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.267 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:07:52.267 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.491408401000001, 2024-05-08T18:07:52.267 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029659439999999999, 2024-05-08T18:07:52.267 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.267 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.267 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.267 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.267 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.267 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.267 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 328 2024-05-08T18:07:52.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.268 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:07:52.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:07:52.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725796+0000", 2024-05-08T18:07:52.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-06 2024-05-08T18:07:52.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725802+0000", 2024-05-08T18:07:52.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7219999999999996e-06 2024-05-08T18:07:52.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725816+0000", 2024-05-08T18:07:52.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3886999999999999e-05 2024-05-08T18:07:52.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725824+0000", 2024-05-08T18:07:52.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5920000000000003e-06 2024-05-08T18:07:52.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725885+0000", 2024-05-08T18:07:52.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1526999999999996e-05 2024-05-08T18:07:52.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725972+0000", 2024-05-08T18:07:52.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7099000000000001e-05 2024-05-08T18:07:52.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.271 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:52.271 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726093+0000", 2024-05-08T18:07:52.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120383 2024-05-08T18:07:52.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.271 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.271 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726717+0000", 2024-05-08T18:07:52.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062435099999999999 2024-05-08T18:07:52.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.271 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.271 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728693+0000", 2024-05-08T18:07:52.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019758309999999999 2024-05-08T18:07:52.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.272 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728731+0000", 2024-05-08T18:07:52.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8591999999999999e-05 2024-05-08T18:07:52.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.272 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728761+0000", 2024-05-08T18:07:52.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9770000000000001e-05 2024-05-08T18:07:52.272 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.272 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.272 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.272 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:460 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.273 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:07:52.273 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.437591177000002, 2024-05-08T18:07:52.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040209540000000002, 2024-05-08T18:07:52.273 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.273 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.273 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.273 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.273 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.273 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.273 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 460 2024-05-08T18:07:52.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.273 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:07:52.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:07:52.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779613+0000", 2024-05-08T18:07:52.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:07:52.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779619+0000", 2024-05-08T18:07:52.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3630000000000002e-06 2024-05-08T18:07:52.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779631+0000", 2024-05-08T18:07:52.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2211e-05 2024-05-08T18:07:52.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779637+0000", 2024-05-08T18:07:52.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0430000000000004e-06 2024-05-08T18:07:52.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779702+0000", 2024-05-08T18:07:52.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4481999999999997e-05 2024-05-08T18:07:52.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.276 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779848+0000", 2024-05-08T18:07:52.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014608500000000001 2024-05-08T18:07:52.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:52.276 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780056+0000", 2024-05-08T18:07:52.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020889699999999999 2024-05-08T18:07:52.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780700+0000", 2024-05-08T18:07:52.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064379300000000003 2024-05-08T18:07:52.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.277 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783576+0000", 2024-05-08T18:07:52.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028754919999999999 2024-05-08T18:07:52.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.277 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783608+0000", 2024-05-08T18:07:52.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2223e-05 2024-05-08T18:07:52.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.277 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.278 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:07:52.278 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5296e-05 2024-05-08T18:07:52.278 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.278 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.278 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.278 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:466 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.278 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:07:52.278 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.433052939, 2024-05-08T18:07:52.278 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028979520000000001, 2024-05-08T18:07:52.278 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.278 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.279 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.279 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.279 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.279 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.279 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 466 2024-05-08T18:07:52.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.279 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:07:52.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:07:52.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:07:52.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.61e-07 2024-05-08T18:07:52.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784155+0000", 2024-05-08T18:07:52.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9299999999999996e-06 2024-05-08T18:07:52.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784165+0000", 2024-05-08T18:07:52.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5680000000000005e-06 2024-05-08T18:07:52.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.281 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784170+0000", 2024-05-08T18:07:52.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1379999999999998e-06 2024-05-08T18:07:52.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.281 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784219+0000", 2024-05-08T18:07:52.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9231999999999999e-05 2024-05-08T18:07:52.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.281 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784310+0000", 2024-05-08T18:07:52.282 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0797000000000005e-05 2024-05-08T18:07:52.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.282 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:52.282 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784490+0000", 2024-05-08T18:07:52.282 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179705 2024-05-08T18:07:52.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.282 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.282 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.785090+0000", 2024-05-08T18:07:52.282 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060073899999999998 2024-05-08T18:07:52.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.786973+0000", 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018824460000000001 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787007+0000", 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3779999999999998e-05 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787049+0000", 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1856e-05 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.284 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:477 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.284 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:07:52.284 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.425910944999998, 2024-05-08T18:07:52.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046076989999999998, 2024-05-08T18:07:52.284 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.284 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.284 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.284 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.284 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.284 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.284 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 477 2024-05-08T18:07:52.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.284 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:07:52.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:07:52.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791294+0000", 2024-05-08T18:07:52.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-06 2024-05-08T18:07:52.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.286 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791300+0000", 2024-05-08T18:07:52.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5320000000000003e-06 2024-05-08T18:07:52.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.286 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791313+0000", 2024-05-08T18:07:52.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2576e-05 2024-05-08T18:07:52.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.286 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791319+0000", 2024-05-08T18:07:52.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1720000000000004e-06 2024-05-08T18:07:52.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.287 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.287 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791379+0000", 2024-05-08T18:07:52.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0343000000000001e-05 2024-05-08T18:07:52.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.287 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.287 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791477+0000", 2024-05-08T18:07:52.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7662000000000001e-05 2024-05-08T18:07:52.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.287 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:52.287 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791678+0000", 2024-05-08T18:07:52.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000200788 2024-05-08T18:07:52.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.792263+0000", 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058525700000000005 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795842+0000", 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035787079999999999 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795874+0000", 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2205000000000001e-05 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795900+0000", 2024-05-08T18:07:52.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6222000000000001e-05 2024-05-08T18:07:52.289 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.289 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.289 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.289 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:642 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.289 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:07:52.289 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.287151242, 2024-05-08T18:07:52.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030444059999999999, 2024-05-08T18:07:52.289 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.289 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.289 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.289 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.290 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.290 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.290 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 642 2024-05-08T18:07:52.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.290 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:07:52.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:07:52.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930055+0000", 2024-05-08T18:07:52.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7999999999999999e-06 2024-05-08T18:07:52.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930065+0000", 2024-05-08T18:07:52.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0176999999999999e-05 2024-05-08T18:07:52.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930092+0000", 2024-05-08T18:07:52.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6460000000000001e-05 2024-05-08T18:07:52.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.292 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930112+0000", 2024-05-08T18:07:52.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0043000000000001e-05 2024-05-08T18:07:52.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.292 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.292 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930219+0000", 2024-05-08T18:07:52.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010698500000000001 2024-05-08T18:07:52.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.292 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.292 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930345+0000", 2024-05-08T18:07:52.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012620400000000001 2024-05-08T18:07:52.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.292 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:52.293 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930579+0000", 2024-05-08T18:07:52.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234145 2024-05-08T18:07:52.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.293 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.293 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.931471+0000", 2024-05-08T18:07:52.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00089161500000000001 2024-05-08T18:07:52.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.293 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.293 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.932978+0000", 2024-05-08T18:07:52.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001507296 2024-05-08T18:07:52.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.293 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.293 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933044+0000", 2024-05-08T18:07:52.294 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6402000000000006e-05 2024-05-08T18:07:52.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.294 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.294 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933097+0000", 2024-05-08T18:07:52.294 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2278999999999999e-05 2024-05-08T18:07:52.294 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.294 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.294 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.294 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:681 6.e e32/26 6:748722ff:gc::gc.6:head v 32'7, mlcod=32'5)", 2024-05-08T18:07:52.294 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:07:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.256355665000001, 2024-05-08T18:07:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003318185, 2024-05-08T18:07:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:07:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:07:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960849+0000", 2024-05-08T18:07:52.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.423e-06 2024-05-08T18:07:52.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960859+0000", 2024-05-08T18:07:52.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3170000000000008e-06 2024-05-08T18:07:52.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960874+0000", 2024-05-08T18:07:52.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5125e-05 2024-05-08T18:07:52.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960884+0000", 2024-05-08T18:07:52.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8120000000000002e-06 2024-05-08T18:07:52.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960972+0000", 2024-05-08T18:07:52.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8540000000000003e-05 2024-05-08T18:07:52.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960996+0000", 2024-05-08T18:07:52.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3479999999999999e-05 2024-05-08T18:07:52.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.298 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.298 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964110+0000", 2024-05-08T18:07:52.298 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031142729999999999 2024-05-08T18:07:52.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.298 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.298 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964166+0000", 2024-05-08T18:07:52.298 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6215000000000003e-05 2024-05-08T18:07:52.298 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.298 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.298 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.299 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.299 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:07:52.299 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.165319570000001, 2024-05-08T18:07:52.299 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030648379999999999, 2024-05-08T18:07:52.299 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.299 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.299 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.299 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.299 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.299 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.299 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 733 2024-05-08T18:07:52.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.299 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.300 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.300 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:07:52.300 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.300 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.300 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:07:52.300 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.300 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.300 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051887+0000", 2024-05-08T18:07:52.300 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.74e-06 2024-05-08T18:07:52.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.301 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.301 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051900+0000", 2024-05-08T18:07:52.301 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3113e-05 2024-05-08T18:07:52.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.301 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.301 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051931+0000", 2024-05-08T18:07:52.301 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1665999999999998e-05 2024-05-08T18:07:52.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.301 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.301 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051946+0000", 2024-05-08T18:07:52.302 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4780000000000001e-05 2024-05-08T18:07:52.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.302 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.302 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052078+0000", 2024-05-08T18:07:52.302 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013133200000000001 2024-05-08T18:07:52.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.302 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.302 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052338+0000", 2024-05-08T18:07:52.302 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026056899999999999 2024-05-08T18:07:52.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.303 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:52.303 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052652+0000", 2024-05-08T18:07:52.303 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031396700000000001 2024-05-08T18:07:52.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.303 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.303 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.053668+0000", 2024-05-08T18:07:52.303 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00101574 2024-05-08T18:07:52.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.303 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.303 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054800+0000", 2024-05-08T18:07:52.303 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011319819999999999 2024-05-08T18:07:52.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.304 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.304 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054884+0000", 2024-05-08T18:07:52.304 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4005999999999995e-05 2024-05-08T18:07:52.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.304 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.304 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054949+0000", 2024-05-08T18:07:52.304 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4943000000000005e-05 2024-05-08T18:07:52.304 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.304 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.304 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.304 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.304 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:07:52.305 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.161464935000001, 2024-05-08T18:07:52.305 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029745919999999999, 2024-05-08T18:07:52.305 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.305 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.305 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.305 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.305 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.305 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.305 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 735 2024-05-08T18:07:52.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.305 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.305 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.305 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:07:52.305 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.306 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.306 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:07:52.306 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.306 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.306 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055741+0000", 2024-05-08T18:07:52.306 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.984e-06 2024-05-08T18:07:52.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.306 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.307 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055766+0000", 2024-05-08T18:07:52.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5253e-05 2024-05-08T18:07:52.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.307 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055785+0000", 2024-05-08T18:07:52.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9559999999999999e-05 2024-05-08T18:07:52.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.307 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055798+0000", 2024-05-08T18:07:52.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-05 2024-05-08T18:07:52.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055932+0000", 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134609 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056184+0000", 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025167800000000003 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056680+0000", 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049576299999999998 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058060+0000", 2024-05-08T18:07:52.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013801 2024-05-08T18:07:52.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.309 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.309 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058447+0000", 2024-05-08T18:07:52.309 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038695299999999999 2024-05-08T18:07:52.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.309 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.309 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058601+0000", 2024-05-08T18:07:52.309 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015396299999999999 2024-05-08T18:07:52.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.309 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.309 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058713+0000", 2024-05-08T18:07:52.309 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112389 2024-05-08T18:07:52.309 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.310 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.310 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.310 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.310 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:07:52.310 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.054449585, 2024-05-08T18:07:52.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029913650000000002, 2024-05-08T18:07:52.310 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.310 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.310 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.310 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.310 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.310 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.311 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 781 2024-05-08T18:07:52.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.311 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.311 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.311 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:07:52.311 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.311 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.311 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:07:52.311 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.311 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.311 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162757+0000", 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162770+0000", 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3406e-05 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162799+0000", 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-05 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162813+0000", 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:07:52.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162942+0000", 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012902200000000001 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163159+0000", 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021738500000000001 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163476+0000", 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031666499999999999 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.314 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.164533+0000", 2024-05-08T18:07:52.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010574219999999999 2024-05-08T18:07:52.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.314 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.314 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165587+0000", 2024-05-08T18:07:52.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001053476 2024-05-08T18:07:52.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.314 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.314 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165674+0000", 2024-05-08T18:07:52.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6725999999999996e-05 2024-05-08T18:07:52.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.314 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165745+0000", 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1779000000000005e-05 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.671859736999998, 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029834750000000002, 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.315 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.316 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 946 2024-05-08T18:07:52.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.316 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.316 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.316 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:07:52.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.316 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.316 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:07:52.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.316 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545346+0000", 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6570000000000001e-06 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545357+0000", 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0740000000000001e-05 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545384+0000", 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6780000000000001e-05 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545398+0000", 2024-05-08T18:07:52.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3936e-05 2024-05-08T18:07:52.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545515+0000", 2024-05-08T18:07:52.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117413 2024-05-08T18:07:52.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545751+0000", 2024-05-08T18:07:52.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023559500000000001 2024-05-08T18:07:52.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:52.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.546075+0000", 2024-05-08T18:07:52.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000324357 2024-05-08T18:07:52.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.547104+0000", 2024-05-08T18:07:52.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010285959999999999 2024-05-08T18:07:52.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548141+0000", 2024-05-08T18:07:52.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001036922 2024-05-08T18:07:52.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548223+0000", 2024-05-08T18:07:52.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2260000000000002e-05 2024-05-08T18:07:52.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.320 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.320 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548327+0000", 2024-05-08T18:07:52.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104219 2024-05-08T18:07:52.320 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.320 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.320 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.320 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.320 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.320 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:52.321 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:07:52.322 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:52.321+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:52.336 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:07:52.421 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:52.421+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:52.489 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:52.490 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:52.504 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:07:52.522 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:07:52.519+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:07:52.623 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:52.625+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:52.661 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:52.661 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:52.661 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:07:52.661 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:07:52.661 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:52.675 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:07:52.725 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:52.725+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:52.825 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:52.823+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:52.845 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:52.846 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:07:52.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:07:52.846 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:07:52.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.846 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:52.846 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:07:52.846 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.269677996999999, 2024-05-08T18:07:52.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002466088, 2024-05-08T18:07:52.846 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.846 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.846 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.846 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.846 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.847 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.847 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 52 2024-05-08T18:07:52.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.847 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:07:52.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:07:52.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577062+0000", 2024-05-08T18:07:52.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.994e-06 2024-05-08T18:07:52.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577075+0000", 2024-05-08T18:07:52.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2480000000000001e-05 2024-05-08T18:07:52.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577108+0000", 2024-05-08T18:07:52.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3096000000000003e-05 2024-05-08T18:07:52.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577131+0000", 2024-05-08T18:07:52.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2993000000000002e-05 2024-05-08T18:07:52.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577260+0000", 2024-05-08T18:07:52.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012912899999999999 2024-05-08T18:07:52.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577453+0000", 2024-05-08T18:07:52.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000193668 2024-05-08T18:07:52.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:52.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577634+0000", 2024-05-08T18:07:52.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180576 2024-05-08T18:07:52.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579082+0000", 2024-05-08T18:07:52.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001448083 2024-05-08T18:07:52.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579290+0000", 2024-05-08T18:07:52.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000208333 2024-05-08T18:07:52.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579403+0000", 2024-05-08T18:07:52.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011296800000000001 2024-05-08T18:07:52.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579525+0000", 2024-05-08T18:07:52.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121768 2024-05-08T18:07:52.851 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.851 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.851 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.851 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-05-08T18:07:52.851 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:07:52.851 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.257818231999998, 2024-05-08T18:07:52.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038858310000000002, 2024-05-08T18:07:52.852 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.852 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.852 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.852 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:07:52.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:07:52.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588920+0000", 2024-05-08T18:07:52.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.23e-07 2024-05-08T18:07:52.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588929+0000", 2024-05-08T18:07:52.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3659999999999998e-06 2024-05-08T18:07:52.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588948+0000", 2024-05-08T18:07:52.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8768000000000001e-05 2024-05-08T18:07:52.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588962+0000", 2024-05-08T18:07:52.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4e-05 2024-05-08T18:07:52.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589110+0000", 2024-05-08T18:07:52.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148047 2024-05-08T18:07:52.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589173+0000", 2024-05-08T18:07:52.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2766000000000002e-05 2024-05-08T18:07:52.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592728+0000", 2024-05-08T18:07:52.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035553300000000002 2024-05-08T18:07:52.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592805+0000", 2024-05-08T18:07:52.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6730999999999994e-05 2024-05-08T18:07:52.855 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.855 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.855 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.855 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.855 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:07:52.855 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.141749334, 2024-05-08T18:07:52.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034354310000000001, 2024-05-08T18:07:52.856 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.856 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.856 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.856 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.856 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.856 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.856 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 236 2024-05-08T18:07:52.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.856 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:07:52.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:07:52.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704991+0000", 2024-05-08T18:07:52.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1240000000000001e-06 2024-05-08T18:07:52.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705009+0000", 2024-05-08T18:07:52.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7819e-05 2024-05-08T18:07:52.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705048+0000", 2024-05-08T18:07:52.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9632999999999998e-05 2024-05-08T18:07:52.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705073+0000", 2024-05-08T18:07:52.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4686999999999999e-05 2024-05-08T18:07:52.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705241+0000", 2024-05-08T18:07:52.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759899999999999 2024-05-08T18:07:52.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705511+0000", 2024-05-08T18:07:52.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027018799999999998 2024-05-08T18:07:52.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:52.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705965+0000", 2024-05-08T18:07:52.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045433000000000002 2024-05-08T18:07:52.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.707487+0000", 2024-05-08T18:07:52.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015214810000000001 2024-05-08T18:07:52.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708125+0000", 2024-05-08T18:07:52.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063870300000000001 2024-05-08T18:07:52.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708298+0000", 2024-05-08T18:07:52.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172592 2024-05-08T18:07:52.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708423+0000", 2024-05-08T18:07:52.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125275 2024-05-08T18:07:52.861 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.861 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.861 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.861 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:308 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.861 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:07:52.861 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.124911432000001, 2024-05-08T18:07:52.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038707400000000001, 2024-05-08T18:07:52.861 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.861 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.861 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.861 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.861 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.861 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.862 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 308 2024-05-08T18:07:52.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.862 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:07:52.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:07:52.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721827+0000", 2024-05-08T18:07:52.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1519999999999999e-06 2024-05-08T18:07:52.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721840+0000", 2024-05-08T18:07:52.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.362e-05 2024-05-08T18:07:52.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721857+0000", 2024-05-08T18:07:52.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6901e-05 2024-05-08T18:07:52.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721867+0000", 2024-05-08T18:07:52.864 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0034000000000001e-05 2024-05-08T18:07:52.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.864 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.864 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.864 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721922+0000", 2024-05-08T18:07:52.864 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4450999999999998e-05 2024-05-08T18:07:52.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.864 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.864 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.864 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721981+0000", 2024-05-08T18:07:52.864 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9267e-05 2024-05-08T18:07:52.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.864 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.864 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:52.864 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722103+0000", 2024-05-08T18:07:52.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121502 2024-05-08T18:07:52.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.865 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.865 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722757+0000", 2024-05-08T18:07:52.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065419700000000003 2024-05-08T18:07:52.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.865 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.865 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725619+0000", 2024-05-08T18:07:52.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002862107 2024-05-08T18:07:52.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.865 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.865 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725654+0000", 2024-05-08T18:07:52.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:07:52.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.866 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.866 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725696+0000", 2024-05-08T18:07:52.866 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:07:52.866 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.866 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.866 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.866 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:604 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.866 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:07:52.866 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.947628726000001, 2024-05-08T18:07:52.866 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002741884, 2024-05-08T18:07:52.866 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.866 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.867 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.867 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.867 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.867 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.867 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 604 2024-05-08T18:07:52.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.867 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:07:52.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:07:52.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899111+0000", 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0910000000000001e-06 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899126+0000", 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899159+0000", 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3241999999999998e-05 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.869 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.869 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899174+0000", 2024-05-08T18:07:52.869 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5235000000000001e-05 2024-05-08T18:07:52.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.869 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.869 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899316+0000", 2024-05-08T18:07:52.869 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014175599999999999 2024-05-08T18:07:52.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.869 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.869 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899525+0000", 2024-05-08T18:07:52.869 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020915300000000001 2024-05-08T18:07:52.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.869 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:52.870 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899872+0000", 2024-05-08T18:07:52.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034668299999999997 2024-05-08T18:07:52.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.870 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.870 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901064+0000", 2024-05-08T18:07:52.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001191473 2024-05-08T18:07:52.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.870 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.870 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901664+0000", 2024-05-08T18:07:52.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060054599999999998 2024-05-08T18:07:52.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.870 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.870 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901779+0000", 2024-05-08T18:07:52.871 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011452500000000001 2024-05-08T18:07:52.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.871 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.871 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901850+0000", 2024-05-08T18:07:52.871 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1580000000000002e-05 2024-05-08T18:07:52.871 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.871 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.871 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.871 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:612 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.871 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:07:52.871 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.942120162999998, 2024-05-08T18:07:52.871 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025904750000000001, 2024-05-08T18:07:52.871 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.872 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.872 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.872 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.872 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.872 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.872 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 612 2024-05-08T18:07:52.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.872 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.872 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.872 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:07:52.872 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.872 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:07:52.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904619+0000", 2024-05-08T18:07:52.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8479999999999999e-06 2024-05-08T18:07:52.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904628+0000", 2024-05-08T18:07:52.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8829999999999995e-06 2024-05-08T18:07:52.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904650+0000", 2024-05-08T18:07:52.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2467999999999999e-05 2024-05-08T18:07:52.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.874 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.874 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904669+0000", 2024-05-08T18:07:52.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9303000000000001e-05 2024-05-08T18:07:52.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.874 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.874 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904766+0000", 2024-05-08T18:07:52.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6917999999999996e-05 2024-05-08T18:07:52.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.874 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.875 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904935+0000", 2024-05-08T18:07:52.875 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000168441 2024-05-08T18:07:52.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.875 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:52.875 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.905288+0000", 2024-05-08T18:07:52.875 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035312199999999998 2024-05-08T18:07:52.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.875 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.875 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.906520+0000", 2024-05-08T18:07:52.875 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001232005 2024-05-08T18:07:52.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.875 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.876 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907086+0000", 2024-05-08T18:07:52.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056658900000000005 2024-05-08T18:07:52.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.876 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.876 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907154+0000", 2024-05-08T18:07:52.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7197000000000001e-05 2024-05-08T18:07:52.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.876 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.876 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907207+0000", 2024-05-08T18:07:52.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3701e-05 2024-05-08T18:07:52.876 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.876 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.876 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.877 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.877 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:07:52.877 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.77410257, 2024-05-08T18:07:52.877 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032464490000000002, 2024-05-08T18:07:52.877 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.877 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.877 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.877 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.877 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.877 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.877 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 742 2024-05-08T18:07:52.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.877 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:07:52.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:07:52.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072637+0000", 2024-05-08T18:07:52.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9059999999999998e-06 2024-05-08T18:07:52.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072651+0000", 2024-05-08T18:07:52.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3477e-05 2024-05-08T18:07:52.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072683+0000", 2024-05-08T18:07:52.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2116000000000002e-05 2024-05-08T18:07:52.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072698+0000", 2024-05-08T18:07:52.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5454000000000001e-05 2024-05-08T18:07:52.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072845+0000", 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146532 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073241+0000", 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039580699999999997 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073812+0000", 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057164900000000003 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075063+0000", 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001250131 2024-05-08T18:07:52.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.881 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.881 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075723+0000", 2024-05-08T18:07:52.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00066039199999999999 2024-05-08T18:07:52.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.881 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.881 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075808+0000", 2024-05-08T18:07:52.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5458999999999996e-05 2024-05-08T18:07:52.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.881 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.881 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075881+0000", 2024-05-08T18:07:52.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2526000000000003e-05 2024-05-08T18:07:52.882 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.882 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.882 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.882 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.882 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.882 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.882 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:07:52.882 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.731694205, 2024-05-08T18:07:52.882 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029270590000000001, 2024-05-08T18:07:52.882 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.882 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.882 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.882 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.882 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.882 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.882 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 760 2024-05-08T18:07:52.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.883 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:07:52.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:07:52.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115045+0000", 2024-05-08T18:07:52.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0729999999999999e-06 2024-05-08T18:07:52.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115057+0000", 2024-05-08T18:07:52.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1617000000000001e-05 2024-05-08T18:07:52.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115088+0000", 2024-05-08T18:07:52.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1155999999999998e-05 2024-05-08T18:07:52.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115103+0000", 2024-05-08T18:07:52.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5067e-05 2024-05-08T18:07:52.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115289+0000", 2024-05-08T18:07:52.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186582 2024-05-08T18:07:52.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115506+0000", 2024-05-08T18:07:52.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021690500000000001 2024-05-08T18:07:52.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:52.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115832+0000", 2024-05-08T18:07:52.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032556799999999998 2024-05-08T18:07:52.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.886 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.886 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.116892+0000", 2024-05-08T18:07:52.886 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010597989999999999 2024-05-08T18:07:52.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.886 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.886 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117807+0000", 2024-05-08T18:07:52.886 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091502599999999999 2024-05-08T18:07:52.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.886 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.886 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117895+0000", 2024-05-08T18:07:52.886 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7977000000000001e-05 2024-05-08T18:07:52.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.887 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.887 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117970+0000", 2024-05-08T18:07:52.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5289000000000004e-05 2024-05-08T18:07:52.887 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.887 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.887 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.887 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.887 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:07:52.887 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.600696718999998, 2024-05-08T18:07:52.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028290730000000001, 2024-05-08T18:07:52.887 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 817 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:07:52.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.889 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246043+0000", 2024-05-08T18:07:52.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.807e-06 2024-05-08T18:07:52.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.889 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246056+0000", 2024-05-08T18:07:52.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2383e-05 2024-05-08T18:07:52.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.889 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246087+0000", 2024-05-08T18:07:52.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1937000000000003e-05 2024-05-08T18:07:52.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246104+0000", 2024-05-08T18:07:52.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6643e-05 2024-05-08T18:07:52.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246225+0000", 2024-05-08T18:07:52.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012061900000000001 2024-05-08T18:07:52.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246510+0000", 2024-05-08T18:07:52.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028507100000000002 2024-05-08T18:07:52.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:52.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246881+0000", 2024-05-08T18:07:52.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037163799999999998 2024-05-08T18:07:52.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248078+0000", 2024-05-08T18:07:52.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011968969999999999 2024-05-08T18:07:52.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248715+0000", 2024-05-08T18:07:52.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063698599999999998 2024-05-08T18:07:52.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248801+0000", 2024-05-08T18:07:52.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5772999999999993e-05 2024-05-08T18:07:52.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248869+0000", 2024-05-08T18:07:52.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8318999999999994e-05 2024-05-08T18:07:52.892 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.892 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.892 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.546953235, 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003281693, 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 841 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:07:52.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:07:52.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299786+0000", 2024-05-08T18:07:52.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4770000000000002e-06 2024-05-08T18:07:52.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299798+0000", 2024-05-08T18:07:52.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1493e-05 2024-05-08T18:07:52.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299827+0000", 2024-05-08T18:07:52.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9363e-05 2024-05-08T18:07:52.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299842+0000", 2024-05-08T18:07:52.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.448e-05 2024-05-08T18:07:52.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300001+0000", 2024-05-08T18:07:52.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015909600000000001 2024-05-08T18:07:52.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300384+0000", 2024-05-08T18:07:52.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038306000000000001 2024-05-08T18:07:52.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:52.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300929+0000", 2024-05-08T18:07:52.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054551299999999997 2024-05-08T18:07:52.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302151+0000", 2024-05-08T18:07:52.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012218540000000001 2024-05-08T18:07:52.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302918+0000", 2024-05-08T18:07:52.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076719099999999997 2024-05-08T18:07:52.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303000+0000", 2024-05-08T18:07:52.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1662999999999994e-05 2024-05-08T18:07:52.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303065+0000", 2024-05-08T18:07:52.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5502999999999999e-05 2024-05-08T18:07:52.897 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.897 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.898 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.898 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.898 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:07:52.898 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.542757778999999, 2024-05-08T18:07:52.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026179150000000002, 2024-05-08T18:07:52.898 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.898 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.898 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.898 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.898 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.898 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.898 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 843 2024-05-08T18:07:52.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.899 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:07:52.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:07:52.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303981+0000", 2024-05-08T18:07:52.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9740000000000001e-06 2024-05-08T18:07:52.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303990+0000", 2024-05-08T18:07:52.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9889999999999998e-06 2024-05-08T18:07:52.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304012+0000", 2024-05-08T18:07:52.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1537000000000001e-05 2024-05-08T18:07:52.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304023+0000", 2024-05-08T18:07:52.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:07:52.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304101+0000", 2024-05-08T18:07:52.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7732999999999996e-05 2024-05-08T18:07:52.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304210+0000", 2024-05-08T18:07:52.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010985299999999999 2024-05-08T18:07:52.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:52.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304490+0000", 2024-05-08T18:07:52.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000279564 2024-05-08T18:07:52.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.305542+0000", 2024-05-08T18:07:52.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051976 2024-05-08T18:07:52.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306451+0000", 2024-05-08T18:07:52.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00090901999999999997 2024-05-08T18:07:52.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306533+0000", 2024-05-08T18:07:52.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1790000000000001e-05 2024-05-08T18:07:52.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306597+0000", 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4332999999999995e-05 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.533061569000001, 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00275537, 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.903 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.904 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 847 2024-05-08T18:07:52.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.904 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:07:52.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:07:52.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313678+0000", 2024-05-08T18:07:52.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:07:52.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313689+0000", 2024-05-08T18:07:52.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1273e-05 2024-05-08T18:07:52.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313719+0000", 2024-05-08T18:07:52.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9726e-05 2024-05-08T18:07:52.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313733+0000", 2024-05-08T18:07:52.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4487e-05 2024-05-08T18:07:52.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313858+0000", 2024-05-08T18:07:52.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125172 2024-05-08T18:07:52.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314072+0000", 2024-05-08T18:07:52.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021314200000000001 2024-05-08T18:07:52.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:52.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314378+0000", 2024-05-08T18:07:52.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030653100000000002 2024-05-08T18:07:52.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.315524+0000", 2024-05-08T18:07:52.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011458950000000001 2024-05-08T18:07:52.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316213+0000", 2024-05-08T18:07:52.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068942199999999997 2024-05-08T18:07:52.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316314+0000", 2024-05-08T18:07:52.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100723 2024-05-08T18:07:52.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316431+0000", 2024-05-08T18:07:52.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116759 2024-05-08T18:07:52.908 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.908 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.908 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.908 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.908 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:07:52.908 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.529409632, 2024-05-08T18:07:52.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025522510000000002, 2024-05-08T18:07:52.909 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.909 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.909 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.909 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.909 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.909 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.909 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 849 2024-05-08T18:07:52.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.909 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:07:52.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:07:52.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317329+0000", 2024-05-08T18:07:52.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9530000000000002e-06 2024-05-08T18:07:52.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317340+0000", 2024-05-08T18:07:52.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.08e-05 2024-05-08T18:07:52.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317364+0000", 2024-05-08T18:07:52.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4142999999999999e-05 2024-05-08T18:07:52.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317377+0000", 2024-05-08T18:07:52.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2764e-05 2024-05-08T18:07:52.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317471+0000", 2024-05-08T18:07:52.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4289000000000005e-05 2024-05-08T18:07:52.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317600+0000", 2024-05-08T18:07:52.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012910499999999999 2024-05-08T18:07:52.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:52.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317868+0000", 2024-05-08T18:07:52.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000267562 2024-05-08T18:07:52.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319081+0000", 2024-05-08T18:07:52.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001213387 2024-05-08T18:07:52.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319723+0000", 2024-05-08T18:07:52.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064134200000000004 2024-05-08T18:07:52.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319808+0000", 2024-05-08T18:07:52.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:07:52.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319880+0000", 2024-05-08T18:07:52.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1426000000000004e-05 2024-05-08T18:07:52.913 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.913 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.913 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.914 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.914 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:07:52.914 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.485977151, 2024-05-08T18:07:52.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002815157, 2024-05-08T18:07:52.914 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.914 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.914 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.914 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.914 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.914 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.914 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 868 2024-05-08T18:07:52.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.915 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:07:52.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:07:52.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360762+0000", 2024-05-08T18:07:52.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:07:52.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360775+0000", 2024-05-08T18:07:52.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2840000000000001e-05 2024-05-08T18:07:52.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360805+0000", 2024-05-08T18:07:52.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9686e-05 2024-05-08T18:07:52.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360819+0000", 2024-05-08T18:07:52.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.434e-05 2024-05-08T18:07:52.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360948+0000", 2024-05-08T18:07:52.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000129033 2024-05-08T18:07:52.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361166+0000", 2024-05-08T18:07:52.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021747800000000001 2024-05-08T18:07:52.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:52.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361481+0000", 2024-05-08T18:07:52.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031515800000000001 2024-05-08T18:07:52.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.362546+0000", 2024-05-08T18:07:52.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010653889999999999 2024-05-08T18:07:52.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363365+0000", 2024-05-08T18:07:52.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081906100000000005 2024-05-08T18:07:52.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363450+0000", 2024-05-08T18:07:52.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5202000000000002e-05 2024-05-08T18:07:52.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363575+0000", 2024-05-08T18:07:52.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012460999999999999 2024-05-08T18:07:52.919 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.919 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.919 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.919 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.920 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:07:52.920 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.482284977999999, 2024-05-08T18:07:52.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024676260000000001, 2024-05-08T18:07:52.920 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.920 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.920 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.920 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.920 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.920 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.920 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 870 2024-05-08T18:07:52.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.920 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:07:52.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:07:52.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364454+0000", 2024-05-08T18:07:52.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7770000000000001e-06 2024-05-08T18:07:52.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364463+0000", 2024-05-08T18:07:52.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4800000000000007e-06 2024-05-08T18:07:52.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364487+0000", 2024-05-08T18:07:52.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3589999999999999e-05 2024-05-08T18:07:52.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364499+0000", 2024-05-08T18:07:52.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.241e-05 2024-05-08T18:07:52.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364607+0000", 2024-05-08T18:07:52.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010760900000000001 2024-05-08T18:07:52.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364750+0000", 2024-05-08T18:07:52.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014265600000000001 2024-05-08T18:07:52.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:52.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.365021+0000", 2024-05-08T18:07:52.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027115100000000002 2024-05-08T18:07:52.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366163+0000", 2024-05-08T18:07:52.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011419189999999999 2024-05-08T18:07:52.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366727+0000", 2024-05-08T18:07:52.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056400199999999997 2024-05-08T18:07:52.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366810+0000", 2024-05-08T18:07:52.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3133000000000005e-05 2024-05-08T18:07:52.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366920+0000", 2024-05-08T18:07:52.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109899 2024-05-08T18:07:52.925 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.925 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.925 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.925 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.925 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:07:52.925 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.392370799999998, 2024-05-08T18:07:52.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027893459999999998, 2024-05-08T18:07:52.925 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 907 2024-05-08T18:07:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:07:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:07:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454369+0000", 2024-05-08T18:07:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5730000000000002e-06 2024-05-08T18:07:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454381+0000", 2024-05-08T18:07:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.208e-05 2024-05-08T18:07:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454413+0000", 2024-05-08T18:07:52.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2493000000000002e-05 2024-05-08T18:07:52.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454432+0000", 2024-05-08T18:07:52.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8862999999999999e-05 2024-05-08T18:07:52.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454577+0000", 2024-05-08T18:07:52.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014477899999999999 2024-05-08T18:07:52.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454800+0000", 2024-05-08T18:07:52.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223425 2024-05-08T18:07:52.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:52.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.455168+0000", 2024-05-08T18:07:52.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036712799999999999 2024-05-08T18:07:52.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456282+0000", 2024-05-08T18:07:52.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011141580000000001 2024-05-08T18:07:52.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456953+0000", 2024-05-08T18:07:52.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000670956 2024-05-08T18:07:52.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457038+0000", 2024-05-08T18:07:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4828999999999997e-05 2024-05-08T18:07:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457156+0000", 2024-05-08T18:07:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118062 2024-05-08T18:07:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:07:52.930 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.388678436999999, 2024-05-08T18:07:52.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026891609999999998, 2024-05-08T18:07:52.931 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.931 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.931 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.931 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.931 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.931 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.931 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 909 2024-05-08T18:07:52.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.931 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:07:52.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:07:52.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458060+0000", 2024-05-08T18:07:52.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:07:52.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458069+0000", 2024-05-08T18:07:52.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6440000000000006e-06 2024-05-08T18:07:52.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458090+0000", 2024-05-08T18:07:52.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1089000000000001e-05 2024-05-08T18:07:52.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458102+0000", 2024-05-08T18:07:52.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2306999999999999e-05 2024-05-08T18:07:52.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458191+0000", 2024-05-08T18:07:52.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8213000000000004e-05 2024-05-08T18:07:52.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458313+0000", 2024-05-08T18:07:52.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012231500000000001 2024-05-08T18:07:52.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:52.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458581+0000", 2024-05-08T18:07:52.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026762500000000001 2024-05-08T18:07:52.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.459773+0000", 2024-05-08T18:07:52.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001192991 2024-05-08T18:07:52.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460590+0000", 2024-05-08T18:07:52.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081618100000000002 2024-05-08T18:07:52.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460681+0000", 2024-05-08T18:07:52.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0946000000000006e-05 2024-05-08T18:07:52.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460748+0000", 2024-05-08T18:07:52.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7139999999999998e-05 2024-05-08T18:07:52.935 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.935 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.935 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.936 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.936 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:07:52.936 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.295035419000001, 2024-05-08T18:07:52.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030359179999999999, 2024-05-08T18:07:52.936 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.936 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.936 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.936 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.936 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.936 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.936 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 949 2024-05-08T18:07:52.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.936 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:07:52.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:07:52.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551705+0000", 2024-05-08T18:07:52.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2770000000000001e-06 2024-05-08T18:07:52.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551717+0000", 2024-05-08T18:07:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.206e-05 2024-05-08T18:07:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551747+0000", 2024-05-08T18:07:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0168999999999999e-05 2024-05-08T18:07:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551763+0000", 2024-05-08T18:07:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:07:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551880+0000", 2024-05-08T18:07:52.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116976 2024-05-08T18:07:52.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552099+0000", 2024-05-08T18:07:52.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021910199999999999 2024-05-08T18:07:52.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:52.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552476+0000", 2024-05-08T18:07:52.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000376697 2024-05-08T18:07:52.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.553551+0000", 2024-05-08T18:07:52.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001074925 2024-05-08T18:07:52.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554588+0000", 2024-05-08T18:07:52.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010374099999999999 2024-05-08T18:07:52.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554671+0000", 2024-05-08T18:07:52.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3368999999999994e-05 2024-05-08T18:07:52.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554738+0000", 2024-05-08T18:07:52.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6043000000000004e-05 2024-05-08T18:07:52.940 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.281421981000001, 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028304160000000001, 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 955 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:07:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:07:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565318+0000", 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7030000000000002e-06 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565330+0000", 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.204e-05 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565363+0000", 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2722999999999998e-05 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565389+0000", 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6412999999999999e-05 2024-05-08T18:07:52.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565510+0000", 2024-05-08T18:07:52.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120932 2024-05-08T18:07:52.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565722+0000", 2024-05-08T18:07:52.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212139 2024-05-08T18:07:52.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:52.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.566034+0000", 2024-05-08T18:07:52.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000312038 2024-05-08T18:07:52.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567340+0000", 2024-05-08T18:07:52.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00130547 2024-05-08T18:07:52.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567998+0000", 2024-05-08T18:07:52.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000658382 2024-05-08T18:07:52.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568081+0000", 2024-05-08T18:07:52.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3269999999999994e-05 2024-05-08T18:07:52.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568145+0000", 2024-05-08T18:07:52.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4306000000000004e-05 2024-05-08T18:07:52.946 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.946 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.946 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.946 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:52.946 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:07:52.946 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.277702458, 2024-05-08T18:07:52.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027506660000000001, 2024-05-08T18:07:52.946 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:52.946 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:52.946 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:52.947 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:52.947 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:52.947 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:52.947 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 957 2024-05-08T18:07:52.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.947 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:52.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:52.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:07:52.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:52.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:07:52.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:52.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:52.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569036+0000", 2024-05-08T18:07:52.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.776e-06 2024-05-08T18:07:52.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:52.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569061+0000", 2024-05-08T18:07:52.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5097e-05 2024-05-08T18:07:52.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:52.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569084+0000", 2024-05-08T18:07:52.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.23e-05 2024-05-08T18:07:52.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:52.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569096+0000", 2024-05-08T18:07:52.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.22e-05 2024-05-08T18:07:52.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:52.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569180+0000", 2024-05-08T18:07:52.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4369000000000005e-05 2024-05-08T18:07:52.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:52.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569296+0000", 2024-05-08T18:07:52.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115999 2024-05-08T18:07:52.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:52.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569550+0000", 2024-05-08T18:07:52.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025397499999999998 2024-05-08T18:07:52.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:52.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.570963+0000", 2024-05-08T18:07:52.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001413023 2024-05-08T18:07:52.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:52.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571614+0000", 2024-05-08T18:07:52.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065041199999999995 2024-05-08T18:07:52.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:52.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571701+0000", 2024-05-08T18:07:52.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7569000000000001e-05 2024-05-08T18:07:52.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:52.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:52.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:52.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571785+0000", 2024-05-08T18:07:52.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3945999999999999e-05 2024-05-08T18:07:52.951 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.951 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.951 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.951 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:52.952 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:52.952 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:52.953 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:07:52.953 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:52.951+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:53.054 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:53.053+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:53.080 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:53.080 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:53.081 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:53.081 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:53.094 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:07:53.186 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:53.185+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:53.256 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:53.257+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:53.261 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:07:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:07:53.262 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:53.275 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:07:53.317 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-05-08T18:07:53.356 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:53.355+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:53.358 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:07:53.449 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:53.449 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:07:53.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:07:53.449 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:07:53.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.449 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:07:53.449 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:07:53.449 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 31.898990915999999, 2024-05-08T18:07:53.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049710090000000002, 2024-05-08T18:07:53.449 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.449 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.449 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-08T18:07:53.450 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.450 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.450 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.450 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 44 2024-05-08T18:07:53.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.450 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:07:53.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:07:53.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552775+0000", 2024-05-08T18:07:53.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4450000000000001e-06 2024-05-08T18:07:53.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552790+0000", 2024-05-08T18:07:53.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4363e-05 2024-05-08T18:07:53.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552820+0000", 2024-05-08T18:07:53.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0485999999999999e-05 2024-05-08T18:07:53.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552843+0000", 2024-05-08T18:07:53.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2985000000000001e-05 2024-05-08T18:07:53.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554350+0000", 2024-05-08T18:07:53.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015065149999999999 2024-05-08T18:07:53.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-08T18:07:53.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554374+0000", 2024-05-08T18:07:53.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4097e-05 2024-05-08T18:07:53.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557531+0000", 2024-05-08T18:07:53.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031567169999999999 2024-05-08T18:07:53.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557743+0000", 2024-05-08T18:07:53.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212401 2024-05-08T18:07:53.453 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.454 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.454 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.454 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:53.454 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:07:53.454 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.863639038999999, 2024-05-08T18:07:53.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050241879999999997, 2024-05-08T18:07:53.454 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.454 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.454 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.454 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.454 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.454 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.455 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 58 2024-05-08T18:07:53.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.455 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:07:53.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:07:53.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588125+0000", 2024-05-08T18:07:53.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1399999999999995e-07 2024-05-08T18:07:53.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588129+0000", 2024-05-08T18:07:53.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6779999999999999e-06 2024-05-08T18:07:53.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588142+0000", 2024-05-08T18:07:53.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3047999999999999e-05 2024-05-08T18:07:53.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588174+0000", 2024-05-08T18:07:53.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1270999999999999e-05 2024-05-08T18:07:53.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588307+0000", 2024-05-08T18:07:53.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013307600000000001 2024-05-08T18:07:53.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588477+0000", 2024-05-08T18:07:53.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000170213 2024-05-08T18:07:53.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:07:53.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588669+0000", 2024-05-08T18:07:53.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019211599999999999 2024-05-08T18:07:53.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.590228+0000", 2024-05-08T18:07:53.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015590059999999999 2024-05-08T18:07:53.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593029+0000", 2024-05-08T18:07:53.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028006400000000001 2024-05-08T18:07:53.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593099+0000", 2024-05-08T18:07:53.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0300000000000001e-05 2024-05-08T18:07:53.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593148+0000", 2024-05-08T18:07:53.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8925999999999999e-05 2024-05-08T18:07:53.459 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.459 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.459 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.459 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:07:53.460 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:07:53.460 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.867100878999999, 2024-05-08T18:07:53.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00385587, 2024-05-08T18:07:53.460 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.460 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.460 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.460 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.460 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.460 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.460 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207 2024-05-08T18:07:53.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.460 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:07:53.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:07:53.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584665+0000", 2024-05-08T18:07:53.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0570000000000001e-06 2024-05-08T18:07:53.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584679+0000", 2024-05-08T18:07:53.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3713000000000001e-05 2024-05-08T18:07:53.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584712+0000", 2024-05-08T18:07:53.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3213999999999997e-05 2024-05-08T18:07:53.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584728+0000", 2024-05-08T18:07:53.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5936000000000001e-05 2024-05-08T18:07:53.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584951+0000", 2024-05-08T18:07:53.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000222955 2024-05-08T18:07:53.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585196+0000", 2024-05-08T18:07:53.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024550800000000002 2024-05-08T18:07:53.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:53.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585643+0000", 2024-05-08T18:07:53.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00044644699999999999 2024-05-08T18:07:53.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.587110+0000", 2024-05-08T18:07:53.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001467323 2024-05-08T18:07:53.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588371+0000", 2024-05-08T18:07:53.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012607180000000001 2024-05-08T18:07:53.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588452+0000", 2024-05-08T18:07:53.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1216000000000003e-05 2024-05-08T18:07:53.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588518+0000", 2024-05-08T18:07:53.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5783000000000004e-05 2024-05-08T18:07:53.465 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.465 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.465 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.465 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:53.465 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:07:53.465 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.820925476999999, 2024-05-08T18:07:53.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003249994, 2024-05-08T18:07:53.465 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.465 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.466 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.466 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.466 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.466 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.466 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216 2024-05-08T18:07:53.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.466 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:07:53.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:07:53.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630840+0000", 2024-05-08T18:07:53.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0730000000000001e-06 2024-05-08T18:07:53.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630854+0000", 2024-05-08T18:07:53.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3360000000000001e-05 2024-05-08T18:07:53.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630889+0000", 2024-05-08T18:07:53.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5176999999999999e-05 2024-05-08T18:07:53.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630911+0000", 2024-05-08T18:07:53.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.247e-05 2024-05-08T18:07:53.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631046+0000", 2024-05-08T18:07:53.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013484599999999999 2024-05-08T18:07:53.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631272+0000", 2024-05-08T18:07:53.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000225694 2024-05-08T18:07:53.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:53.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631703+0000", 2024-05-08T18:07:53.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000431144 2024-05-08T18:07:53.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633244+0000", 2024-05-08T18:07:53.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001540622 2024-05-08T18:07:53.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633926+0000", 2024-05-08T18:07:53.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068244200000000001 2024-05-08T18:07:53.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634019+0000", 2024-05-08T18:07:53.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3148999999999999e-05 2024-05-08T18:07:53.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634087+0000", 2024-05-08T18:07:53.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8016999999999996e-05 2024-05-08T18:07:53.470 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.471 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.471 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.471 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:53.471 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:07:53.471 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.779381428000001, 2024-05-08T18:07:53.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003119854, 2024-05-08T18:07:53.471 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.471 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.471 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.471 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.471 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.471 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.471 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 227 2024-05-08T18:07:53.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.472 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:07:53.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:07:53.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672384+0000", 2024-05-08T18:07:53.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7470000000000001e-06 2024-05-08T18:07:53.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672396+0000", 2024-05-08T18:07:53.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.154e-05 2024-05-08T18:07:53.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672427+0000", 2024-05-08T18:07:53.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1676e-05 2024-05-08T18:07:53.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672443+0000", 2024-05-08T18:07:53.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5214e-05 2024-05-08T18:07:53.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672563+0000", 2024-05-08T18:07:53.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120535 2024-05-08T18:07:53.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672778+0000", 2024-05-08T18:07:53.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021446200000000001 2024-05-08T18:07:53.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:53.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.673205+0000", 2024-05-08T18:07:53.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042750699999999998 2024-05-08T18:07:53.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.674848+0000", 2024-05-08T18:07:53.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016432980000000001 2024-05-08T18:07:53.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675346+0000", 2024-05-08T18:07:53.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049711999999999998 2024-05-08T18:07:53.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675432+0000", 2024-05-08T18:07:53.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6798999999999993e-05 2024-05-08T18:07:53.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675501+0000", 2024-05-08T18:07:53.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8955999999999995e-05 2024-05-08T18:07:53.476 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.477 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.477 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.477 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:53.477 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:07:53.477 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.772440640999999, 2024-05-08T18:07:53.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034322110000000001, 2024-05-08T18:07:53.477 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.477 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.477 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.477 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.477 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.478 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.478 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 229 2024-05-08T18:07:53.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.478 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:07:53.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:07:53.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679325+0000", 2024-05-08T18:07:53.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:07:53.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679339+0000", 2024-05-08T18:07:53.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:07:53.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679370+0000", 2024-05-08T18:07:53.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0280000000000001e-05 2024-05-08T18:07:53.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679385+0000", 2024-05-08T18:07:53.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5026e-05 2024-05-08T18:07:53.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679504+0000", 2024-05-08T18:07:53.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119023 2024-05-08T18:07:53.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679711+0000", 2024-05-08T18:07:53.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020705499999999999 2024-05-08T18:07:53.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:53.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.680115+0000", 2024-05-08T18:07:53.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040396699999999998 2024-05-08T18:07:53.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.681424+0000", 2024-05-08T18:07:53.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001309387 2024-05-08T18:07:53.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682488+0000", 2024-05-08T18:07:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010642519999999999 2024-05-08T18:07:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682640+0000", 2024-05-08T18:07:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015123599999999999 2024-05-08T18:07:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682754+0000", 2024-05-08T18:07:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011482200000000001 2024-05-08T18:07:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.483 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:53.483 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:07:53.483 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.765056432000002, 2024-05-08T18:07:53.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033353329999999998, 2024-05-08T18:07:53.483 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.483 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.483 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.483 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.483 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.483 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.483 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 231 2024-05-08T18:07:53.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.483 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:07:53.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:07:53.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686709+0000", 2024-05-08T18:07:53.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4729999999999999e-06 2024-05-08T18:07:53.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686720+0000", 2024-05-08T18:07:53.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1157e-05 2024-05-08T18:07:53.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686750+0000", 2024-05-08T18:07:53.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0417e-05 2024-05-08T18:07:53.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686765+0000", 2024-05-08T18:07:53.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.487e-05 2024-05-08T18:07:53.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686872+0000", 2024-05-08T18:07:53.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010703499999999999 2024-05-08T18:07:53.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687085+0000", 2024-05-08T18:07:53.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021279599999999999 2024-05-08T18:07:53.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:53.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687501+0000", 2024-05-08T18:07:53.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041554 2024-05-08T18:07:53.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.688886+0000", 2024-05-08T18:07:53.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00138565 2024-05-08T18:07:53.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689899+0000", 2024-05-08T18:07:53.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010128190000000001 2024-05-08T18:07:53.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689978+0000", 2024-05-08T18:07:53.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8490000000000002e-05 2024-05-08T18:07:53.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.690042+0000", 2024-05-08T18:07:53.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4085999999999996e-05 2024-05-08T18:07:53.488 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.488 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.488 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.488 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:394 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:53.489 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:07:53.489 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.707983355, 2024-05-08T18:07:53.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034384960000000001, 2024-05-08T18:07:53.489 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.489 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.489 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.489 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.489 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.489 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.489 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 394 2024-05-08T18:07:53.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.489 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:07:53.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:07:53.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743781+0000", 2024-05-08T18:07:53.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3e-06 2024-05-08T18:07:53.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743788+0000", 2024-05-08T18:07:53.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7399999999999998e-06 2024-05-08T18:07:53.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743801+0000", 2024-05-08T18:07:53.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3757000000000001e-05 2024-05-08T18:07:53.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743808+0000", 2024-05-08T18:07:53.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6579999999999996e-06 2024-05-08T18:07:53.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743875+0000", 2024-05-08T18:07:53.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6740000000000001e-05 2024-05-08T18:07:53.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743971+0000", 2024-05-08T18:07:53.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6175000000000007e-05 2024-05-08T18:07:53.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:53.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744100+0000", 2024-05-08T18:07:53.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012954899999999999 2024-05-08T18:07:53.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744863+0000", 2024-05-08T18:07:53.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076300100000000002 2024-05-08T18:07:53.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747089+0000", 2024-05-08T18:07:53.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022258540000000002 2024-05-08T18:07:53.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747162+0000", 2024-05-08T18:07:53.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2632000000000005e-05 2024-05-08T18:07:53.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747218+0000", 2024-05-08T18:07:53.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.609e-05 2024-05-08T18:07:53.494 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.494 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.494 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.495 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:535 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:53.495 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:07:53.495 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.610270278000002, 2024-05-08T18:07:53.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055640899999999998, 2024-05-08T18:07:53.495 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.495 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.495 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.495 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.495 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.495 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.495 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 535 2024-05-08T18:07:53.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.495 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:07:53.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:07:53.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841494+0000", 2024-05-08T18:07:53.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0899999999999999e-06 2024-05-08T18:07:53.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841500+0000", 2024-05-08T18:07:53.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0249999999999999e-06 2024-05-08T18:07:53.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841513+0000", 2024-05-08T18:07:53.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3658e-05 2024-05-08T18:07:53.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841522+0000", 2024-05-08T18:07:53.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3410000000000003e-06 2024-05-08T18:07:53.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841574+0000", 2024-05-08T18:07:53.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2794000000000003e-05 2024-05-08T18:07:53.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841633+0000", 2024-05-08T18:07:53.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8595999999999999e-05 2024-05-08T18:07:53.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:53.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841755+0000", 2024-05-08T18:07:53.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012227399999999999 2024-05-08T18:07:53.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.842349+0000", 2024-05-08T18:07:53.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00059377699999999998 2024-05-08T18:07:53.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.846949+0000", 2024-05-08T18:07:53.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004599723 2024-05-08T18:07:53.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847008+0000", 2024-05-08T18:07:53.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8854999999999998e-05 2024-05-08T18:07:53.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847057+0000", 2024-05-08T18:07:53.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8956999999999999e-05 2024-05-08T18:07:53.500 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.500 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.500 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.500 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:541 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:53.500 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:07:53.500 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.603240748000001, 2024-05-08T18:07:53.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037829790000000001, 2024-05-08T18:07:53.501 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.501 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.501 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.501 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.501 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.501 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.501 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 541 2024-05-08T18:07:53.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.501 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:07:53.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:07:53.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848523+0000", 2024-05-08T18:07:53.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8599999999999997e-07 2024-05-08T18:07:53.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848526+0000", 2024-05-08T18:07:53.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4690000000000002e-06 2024-05-08T18:07:53.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848536+0000", 2024-05-08T18:07:53.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2029999999999998e-06 2024-05-08T18:07:53.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848540+0000", 2024-05-08T18:07:53.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9169999999999997e-06 2024-05-08T18:07:53.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848591+0000", 2024-05-08T18:07:53.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0328000000000003e-05 2024-05-08T18:07:53.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848646+0000", 2024-05-08T18:07:53.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5281999999999997e-05 2024-05-08T18:07:53.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:53.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848759+0000", 2024-05-08T18:07:53.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011278899999999999 2024-05-08T18:07:53.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.849323+0000", 2024-05-08T18:07:53.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056433999999999998 2024-05-08T18:07:53.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852225+0000", 2024-05-08T18:07:53.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029017320000000002 2024-05-08T18:07:53.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852277+0000", 2024-05-08T18:07:53.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2460999999999998e-05 2024-05-08T18:07:53.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852305+0000", 2024-05-08T18:07:53.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7671999999999999e-05 2024-05-08T18:07:53.506 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.506 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.506 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.506 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:53.506 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:07:53.506 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.470093671000001, 2024-05-08T18:07:53.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002973084, 2024-05-08T18:07:53.506 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.506 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.506 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.507 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.507 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.507 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.507 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 703 2024-05-08T18:07:53.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.507 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:07:53.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:07:53.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981672+0000", 2024-05-08T18:07:53.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5799999999999999e-06 2024-05-08T18:07:53.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981683+0000", 2024-05-08T18:07:53.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1270000000000001e-05 2024-05-08T18:07:53.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981715+0000", 2024-05-08T18:07:53.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1470000000000002e-05 2024-05-08T18:07:53.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981730+0000", 2024-05-08T18:07:53.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5262999999999999e-05 2024-05-08T18:07:53.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981864+0000", 2024-05-08T18:07:53.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134043 2024-05-08T18:07:53.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982168+0000", 2024-05-08T18:07:53.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030453799999999998 2024-05-08T18:07:53.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:53.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982620+0000", 2024-05-08T18:07:53.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045170900000000001 2024-05-08T18:07:53.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.983648+0000", 2024-05-08T18:07:53.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010276009999999999 2024-05-08T18:07:53.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984486+0000", 2024-05-08T18:07:53.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083874600000000002 2024-05-08T18:07:53.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984571+0000", 2024-05-08T18:07:53.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4370999999999996e-05 2024-05-08T18:07:53.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984642+0000", 2024-05-08T18:07:53.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1493000000000001e-05 2024-05-08T18:07:53.511 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.511 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.511 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.512 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:789 6.0 e32/26 6:0216b5b6:::obj_delete_at_hint.0000000070:head v 32'14, mlcod=32'12)", 2024-05-08T18:07:53.512 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:07:53.512 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.270666898000002, 2024-05-08T18:07:53.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034621420000000001, 2024-05-08T18:07:53.512 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.512 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.512 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.512 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:07:53.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:07:53.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181098+0000", 2024-05-08T18:07:53.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8029999999999999e-06 2024-05-08T18:07:53.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181109+0000", 2024-05-08T18:07:53.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1219999999999999e-05 2024-05-08T18:07:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181138+0000", 2024-05-08T18:07:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.898e-05 2024-05-08T18:07:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181151+0000", 2024-05-08T18:07:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.308e-05 2024-05-08T18:07:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181268+0000", 2024-05-08T18:07:53.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116629 2024-05-08T18:07:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181321+0000", 2024-05-08T18:07:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3325999999999997e-05 2024-05-08T18:07:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184477+0000", 2024-05-08T18:07:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003156458 2024-05-08T18:07:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184558+0000", 2024-05-08T18:07:53.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0646e-05 2024-05-08T18:07:53.516 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.516 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.516 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.516 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:53.516 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:07:53.516 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.239493394, 2024-05-08T18:07:53.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031146310000000001, 2024-05-08T18:07:53.516 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.516 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.516 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.516 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.517 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.517 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.517 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 802 2024-05-08T18:07:53.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.517 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:07:53.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:07:53.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212272+0000", 2024-05-08T18:07:53.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.943e-06 2024-05-08T18:07:53.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212284+0000", 2024-05-08T18:07:53.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1747e-05 2024-05-08T18:07:53.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212315+0000", 2024-05-08T18:07:53.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0579e-05 2024-05-08T18:07:53.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212336+0000", 2024-05-08T18:07:53.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1639999999999999e-05 2024-05-08T18:07:53.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212488+0000", 2024-05-08T18:07:53.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151192 2024-05-08T18:07:53.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212703+0000", 2024-05-08T18:07:53.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000215439 2024-05-08T18:07:53.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:53.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.213033+0000", 2024-05-08T18:07:53.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032992699999999999 2024-05-08T18:07:53.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.214306+0000", 2024-05-08T18:07:53.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012726949999999999 2024-05-08T18:07:53.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215232+0000", 2024-05-08T18:07:53.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092652999999999995 2024-05-08T18:07:53.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215321+0000", 2024-05-08T18:07:53.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9272999999999997e-05 2024-05-08T18:07:53.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215384+0000", 2024-05-08T18:07:53.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2665999999999999e-05 2024-05-08T18:07:53.521 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.521 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.521 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.522 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:53.522 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:07:53.522 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.158948987999999, 2024-05-08T18:07:53.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030150250000000002, 2024-05-08T18:07:53.522 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.522 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.522 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.522 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.522 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.522 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.522 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 838 2024-05-08T18:07:53.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.522 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:07:53.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:07:53.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292816+0000", 2024-05-08T18:07:53.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:07:53.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292828+0000", 2024-05-08T18:07:53.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.184e-05 2024-05-08T18:07:53.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292857+0000", 2024-05-08T18:07:53.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8960000000000001e-05 2024-05-08T18:07:53.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292871+0000", 2024-05-08T18:07:53.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.45e-05 2024-05-08T18:07:53.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293000+0000", 2024-05-08T18:07:53.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128875 2024-05-08T18:07:53.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293231+0000", 2024-05-08T18:07:53.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023030500000000001 2024-05-08T18:07:53.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:53.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293563+0000", 2024-05-08T18:07:53.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000332648 2024-05-08T18:07:53.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.294882+0000", 2024-05-08T18:07:53.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001319183 2024-05-08T18:07:53.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295664+0000", 2024-05-08T18:07:53.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000781991 2024-05-08T18:07:53.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295754+0000", 2024-05-08T18:07:53.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9176000000000001e-05 2024-05-08T18:07:53.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295829+0000", 2024-05-08T18:07:53.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.525e-05 2024-05-08T18:07:53.527 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.527 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.527 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.527 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:53.527 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:07:53.527 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.097815318999999, 2024-05-08T18:07:53.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029338929999999999, 2024-05-08T18:07:53.527 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.528 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.528 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.528 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.528 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.528 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.528 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 865 2024-05-08T18:07:53.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.528 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:07:53.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:07:53.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353950+0000", 2024-05-08T18:07:53.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2469999999999998e-06 2024-05-08T18:07:53.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353961+0000", 2024-05-08T18:07:53.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1523e-05 2024-05-08T18:07:53.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353991+0000", 2024-05-08T18:07:53.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9920000000000002e-05 2024-05-08T18:07:53.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354013+0000", 2024-05-08T18:07:53.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1590000000000002e-05 2024-05-08T18:07:53.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354206+0000", 2024-05-08T18:07:53.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019273900000000001 2024-05-08T18:07:53.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354418+0000", 2024-05-08T18:07:53.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212518 2024-05-08T18:07:53.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:53.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354720+0000", 2024-05-08T18:07:53.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030151800000000002 2024-05-08T18:07:53.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.355983+0000", 2024-05-08T18:07:53.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012636780000000001 2024-05-08T18:07:53.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356733+0000", 2024-05-08T18:07:53.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074988400000000003 2024-05-08T18:07:53.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356819+0000", 2024-05-08T18:07:53.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5690000000000001e-05 2024-05-08T18:07:53.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356881+0000", 2024-05-08T18:07:53.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2586e-05 2024-05-08T18:07:53.533 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.533 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.533 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.533 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:53.533 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:07:53.533 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.084691954, 2024-05-08T18:07:53.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004954511, 2024-05-08T18:07:53.533 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.533 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.533 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.533 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.533 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.534 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.534 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 871 2024-05-08T18:07:53.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.534 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:07:53.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:07:53.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367073+0000", 2024-05-08T18:07:53.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2340000000000001e-06 2024-05-08T18:07:53.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367085+0000", 2024-05-08T18:07:53.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1483e-05 2024-05-08T18:07:53.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367111+0000", 2024-05-08T18:07:53.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5890000000000001e-05 2024-05-08T18:07:53.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367130+0000", 2024-05-08T18:07:53.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9700000000000001e-05 2024-05-08T18:07:53.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367284+0000", 2024-05-08T18:07:53.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015411799999999999 2024-05-08T18:07:53.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367516+0000", 2024-05-08T18:07:53.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000231272 2024-05-08T18:07:53.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:53.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367837+0000", 2024-05-08T18:07:53.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032173400000000001 2024-05-08T18:07:53.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371395+0000", 2024-05-08T18:07:53.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035574719999999999 2024-05-08T18:07:53.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371882+0000", 2024-05-08T18:07:53.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048693899999999998 2024-05-08T18:07:53.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371962+0000", 2024-05-08T18:07:53.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.975e-05 2024-05-08T18:07:53.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372025+0000", 2024-05-08T18:07:53.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3918999999999996e-05 2024-05-08T18:07:53.538 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.538 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.538 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:07:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.078804250000001, 2024-05-08T18:07:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045233640000000002, 2024-05-08T18:07:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 873 2024-05-08T18:07:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:07:53.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:07:53.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372961+0000", 2024-05-08T18:07:53.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:07:53.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372969+0000", 2024-05-08T18:07:53.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2940000000000006e-06 2024-05-08T18:07:53.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372991+0000", 2024-05-08T18:07:53.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1829000000000001e-05 2024-05-08T18:07:53.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373009+0000", 2024-05-08T18:07:53.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8607e-05 2024-05-08T18:07:53.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373127+0000", 2024-05-08T18:07:53.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011728899999999999 2024-05-08T18:07:53.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373260+0000", 2024-05-08T18:07:53.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013301200000000001 2024-05-08T18:07:53.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:53.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373526+0000", 2024-05-08T18:07:53.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026613500000000003 2024-05-08T18:07:53.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.374558+0000", 2024-05-08T18:07:53.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001032156 2024-05-08T18:07:53.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377333+0000", 2024-05-08T18:07:53.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027749329999999998 2024-05-08T18:07:53.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377421+0000", 2024-05-08T18:07:53.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8679999999999998e-05 2024-05-08T18:07:53.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377482+0000", 2024-05-08T18:07:53.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0538999999999998e-05 2024-05-08T18:07:53.544 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.544 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.544 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.544 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:53.544 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:07:53.544 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.019195096000001, 2024-05-08T18:07:53.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035261009999999998, 2024-05-08T18:07:53.545 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.545 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.545 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.545 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.545 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.545 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.545 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 898 2024-05-08T18:07:53.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.545 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:07:53.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:07:53.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432570+0000", 2024-05-08T18:07:53.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.26e-06 2024-05-08T18:07:53.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432580+0000", 2024-05-08T18:07:53.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8570000000000007e-06 2024-05-08T18:07:53.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432605+0000", 2024-05-08T18:07:53.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5273e-05 2024-05-08T18:07:53.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432618+0000", 2024-05-08T18:07:53.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2999999999999999e-05 2024-05-08T18:07:53.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432742+0000", 2024-05-08T18:07:53.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012369200000000001 2024-05-08T18:07:53.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433109+0000", 2024-05-08T18:07:53.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036760500000000002 2024-05-08T18:07:53.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:53.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433645+0000", 2024-05-08T18:07:53.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053599599999999996 2024-05-08T18:07:53.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435050+0000", 2024-05-08T18:07:53.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001404696 2024-05-08T18:07:53.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435834+0000", 2024-05-08T18:07:53.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078381100000000003 2024-05-08T18:07:53.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435984+0000", 2024-05-08T18:07:53.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015006899999999999 2024-05-08T18:07:53.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.436094+0000", 2024-05-08T18:07:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109842 2024-05-08T18:07:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:07:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.014442247000002, 2024-05-08T18:07:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031481899999999999, 2024-05-08T18:07:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.550 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 900 2024-05-08T18:07:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:07:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:07:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437323+0000", 2024-05-08T18:07:53.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.447e-06 2024-05-08T18:07:53.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437334+0000", 2024-05-08T18:07:53.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0835999999999999e-05 2024-05-08T18:07:53.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437364+0000", 2024-05-08T18:07:53.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0463999999999998e-05 2024-05-08T18:07:53.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437379+0000", 2024-05-08T18:07:53.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4806e-05 2024-05-08T18:07:53.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437500+0000", 2024-05-08T18:07:53.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121309 2024-05-08T18:07:53.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437729+0000", 2024-05-08T18:07:53.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022818200000000001 2024-05-08T18:07:53.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:53.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.438199+0000", 2024-05-08T18:07:53.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047025300000000001 2024-05-08T18:07:53.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.439418+0000", 2024-05-08T18:07:53.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012193849999999999 2024-05-08T18:07:53.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440217+0000", 2024-05-08T18:07:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00079905999999999998 2024-05-08T18:07:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440352+0000", 2024-05-08T18:07:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013485299999999999 2024-05-08T18:07:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440469+0000", 2024-05-08T18:07:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116595 2024-05-08T18:07:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.556 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:53.556 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:07:53.556 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.928206242000002, 2024-05-08T18:07:53.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003477894, 2024-05-08T18:07:53.556 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:53.556 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:53.556 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:53.556 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:53.556 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:53.556 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:53.556 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 937 2024-05-08T18:07:53.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.556 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:53.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:53.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:07:53.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:53.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:07:53.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:53.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:53.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523559+0000", 2024-05-08T18:07:53.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.95e-06 2024-05-08T18:07:53.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:53.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523567+0000", 2024-05-08T18:07:53.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6799999999999999e-06 2024-05-08T18:07:53.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:53.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523591+0000", 2024-05-08T18:07:53.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3269e-05 2024-05-08T18:07:53.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:53.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523611+0000", 2024-05-08T18:07:53.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0100000000000001e-05 2024-05-08T18:07:53.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523767+0000", 2024-05-08T18:07:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015604900000000001 2024-05-08T18:07:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523994+0000", 2024-05-08T18:07:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022764199999999999 2024-05-08T18:07:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.524338+0000", 2024-05-08T18:07:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034388700000000002 2024-05-08T18:07:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.525707+0000", 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001368544 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526843+0000", 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001136501 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526957+0000", 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011359 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.527035+0000", 2024-05-08T18:07:53.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7682000000000006e-05 2024-05-08T18:07:53.561 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.561 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.561 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.561 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:53.561 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:53.561 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:53.562 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:07:53.563 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:07:53.563 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:07:53.563 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:07:53.564 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:07:53.564 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:53.561+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:53.569 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:07:53.569 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:07:53.585 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:07:53.586 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:07:53.604 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:07:53.605 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:07:53.623 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:07:53.624 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:07:53.644 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:07:53.644 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:07:53.663 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:53.663+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:53.664 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:07:53.664 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:07:53.694 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:53.694 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:53.709 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:07:53.800 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:53.799+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:53.864 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:07:53.863+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:07:53.877 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:53.877 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:53.892 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:07:53.966 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:53.965+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:54.055 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:54.056 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:54.066 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:54.065+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:54.070 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:07:54.167 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:54.167+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:54.195 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:54.195 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:54.209 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:07:54.295 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:54.295+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:54.369 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:54.367+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:54.378 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:54.378 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:54.393 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:07:54.479 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:54.479+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:54.557 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:54.558 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:54.571 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:54.571+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:54.572 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:07:54.672 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:54.673+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:54.739 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:54.739 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:54.753 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:07:54.773 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:54.777+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:54.869 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:54.869 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:54.873 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:54.871+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:54.883 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:07:54.975 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:54.977+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:55.045 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:55.045 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:55.059 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:07:55.103 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:55.103+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:55.176 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:55.177+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:55.181 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:55.181 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:55.195 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:07:55.283 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:55.283+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:55.342 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:07:55.367 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:55.368 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:55.382 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:07:55.387 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:55.389+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:55.478 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:55.475+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:55.544 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:55.544 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:55.558 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:07:55.607 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:55.609+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:55.678 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:55.678 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:55.679 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:55.679+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:55.683 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:07:55.692 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:07:55.780 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:55.779+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:55.825 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:07:55.826 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:07:55.842 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:07:55.843 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:07:55.851 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:55.851 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:55.851 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:07:55.851 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:07:55.851 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:55.859 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:07:55.859 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:07:55.865 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:07:55.877 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:07:55.877 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:07:55.882 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:07:55.879+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:07:55.898 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:07:55.898 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:07:55.919 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:07:55.919 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:07:55.939 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:07:55.939 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:07:55.960 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:07:55.960 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:07:55.983 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:55.983 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:07:55.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:07:55.984 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:07:55.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.984 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:52 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'31)", 2024-05-08T18:07:55.984 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:07:55.984 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 52.859690911000001, 2024-05-08T18:07:55.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00409947, 2024-05-08T18:07:55.984 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:55.984 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:55.984 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:55.984 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:55.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:55.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:07:55.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:55.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:55.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:07:55.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:55.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:55.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127167+0000", 2024-05-08T18:07:55.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7800000000000001e-07 2024-05-08T18:07:55.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:55.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127172+0000", 2024-05-08T18:07:55.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1120000000000004e-06 2024-05-08T18:07:55.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:55.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127183+0000", 2024-05-08T18:07:55.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1107000000000001e-05 2024-05-08T18:07:55.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:55.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127189+0000", 2024-05-08T18:07:55.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0310000000000004e-06 2024-05-08T18:07:55.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:55.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127237+0000", 2024-05-08T18:07:55.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7907000000000001e-05 2024-05-08T18:07:55.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:55.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127252+0000", 2024-05-08T18:07:55.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5373e-05 2024-05-08T18:07:55.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:55.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131206+0000", 2024-05-08T18:07:55.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039540199999999999 2024-05-08T18:07:55.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:55.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131265+0000", 2024-05-08T18:07:55.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9141999999999997e-05 2024-05-08T18:07:55.988 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:55.988 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:55.988 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:55.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.988 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-05-08T18:07:55.988 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:07:55.988 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 52.850932507000003, 2024-05-08T18:07:55.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049265589999999996, 2024-05-08T18:07:55.988 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:55.989 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:55.989 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:55.989 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:55.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:55.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:07:55.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:55.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:55.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:07:55.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:55.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:55.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135925+0000", 2024-05-08T18:07:55.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8100000000000002e-07 2024-05-08T18:07:55.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:55.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136007+0000", 2024-05-08T18:07:55.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1864000000000001e-05 2024-05-08T18:07:55.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:55.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136019+0000", 2024-05-08T18:07:55.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2438e-05 2024-05-08T18:07:55.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:55.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136026+0000", 2024-05-08T18:07:55.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0809999999999996e-06 2024-05-08T18:07:55.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:55.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136093+0000", 2024-05-08T18:07:55.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6769999999999999e-05 2024-05-08T18:07:55.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:55.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136108+0000", 2024-05-08T18:07:55.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.465e-05 2024-05-08T18:07:55.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:55.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140800+0000", 2024-05-08T18:07:55.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046919450000000003 2024-05-08T18:07:55.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:55.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140851+0000", 2024-05-08T18:07:55.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.113e-05 2024-05-08T18:07:55.992 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:55.992 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:55.992 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:55.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.992 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-05-08T18:07:55.993 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:07:55.993 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 52.634447297000001, 2024-05-08T18:07:55.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042257299999999996, 2024-05-08T18:07:55.993 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:55.993 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:55.993 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:55.993 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:55.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:55.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:07:55.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:55.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:55.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:07:55.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:55.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:55.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352410+0000", 2024-05-08T18:07:55.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7599999999999997e-07 2024-05-08T18:07:55.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:55.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352489+0000", 2024-05-08T18:07:55.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8564000000000002e-05 2024-05-08T18:07:55.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:55.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352500+0000", 2024-05-08T18:07:55.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1411e-05 2024-05-08T18:07:55.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:55.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352506+0000", 2024-05-08T18:07:55.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7309999999999998e-06 2024-05-08T18:07:55.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:55.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352569+0000", 2024-05-08T18:07:55.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3173e-05 2024-05-08T18:07:55.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:55.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352598+0000", 2024-05-08T18:07:55.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8855000000000001e-05 2024-05-08T18:07:55.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:55.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356592+0000", 2024-05-08T18:07:55.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039941539999999998 2024-05-08T18:07:55.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:55.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356635+0000", 2024-05-08T18:07:55.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3166e-05 2024-05-08T18:07:55.996 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:55.996 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:55.997 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:55.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.997 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:75 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'53, mlcod=15'43)", 2024-05-08T18:07:55.997 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:55.997 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 52.626275880000001, 2024-05-08T18:07:55.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063708030000000004, 2024-05-08T18:07:55.997 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:55.997 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:55.997 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:55.997 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:55.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:55.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:55.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:55.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:55.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:55.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:55.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:55.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:07:55.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:07:55.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:55.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360641+0000", 2024-05-08T18:07:55.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9273e-05 2024-05-08T18:07:55.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:55.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360651+0000", 2024-05-08T18:07:55.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0353000000000001e-05 2024-05-08T18:07:55.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:55.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:55.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:55.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360659+0000", 2024-05-08T18:07:55.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4789999999999999e-06 2024-05-08T18:07:55.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360720+0000", 2024-05-08T18:07:56.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699000000000007e-05 2024-05-08T18:07:56.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360739+0000", 2024-05-08T18:07:56.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8913999999999999e-05 2024-05-08T18:07:56.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366883+0000", 2024-05-08T18:07:56.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061438229999999996 2024-05-08T18:07:56.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366952+0000", 2024-05-08T18:07:56.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8677000000000007e-05 2024-05-08T18:07:56.001 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.001 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.001 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.001 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:76 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'54, mlcod=15'49)", 2024-05-08T18:07:56.001 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:07:56.001 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 52.624539374999998, 2024-05-08T18:07:56.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046550610000000003, 2024-05-08T18:07:56.001 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.002 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.002 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.002 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:07:56.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:07:56.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362318+0000", 2024-05-08T18:07:56.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.99e-07 2024-05-08T18:07:56.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362323+0000", 2024-05-08T18:07:56.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.566e-06 2024-05-08T18:07:56.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362334+0000", 2024-05-08T18:07:56.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1403000000000001e-05 2024-05-08T18:07:56.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362342+0000", 2024-05-08T18:07:56.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3420000000000008e-06 2024-05-08T18:07:56.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362396+0000", 2024-05-08T18:07:56.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3476000000000001e-05 2024-05-08T18:07:56.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362415+0000", 2024-05-08T18:07:56.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8787000000000002e-05 2024-05-08T18:07:56.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366954+0000", 2024-05-08T18:07:56.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045388609999999999 2024-05-08T18:07:56.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366972+0000", 2024-05-08T18:07:56.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8927e-05 2024-05-08T18:07:56.005 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.005 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.005 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.006 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:79 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'57, mlcod=15'53)", 2024-05-08T18:07:56.006 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:07:56.006 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 52.617143446999997, 2024-05-08T18:07:56.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045322499999999998, 2024-05-08T18:07:56.006 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.006 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.006 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.006 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:07:56.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:07:56.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369714+0000", 2024-05-08T18:07:56.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:07:56.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369787+0000", 2024-05-08T18:07:56.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3317000000000003e-05 2024-05-08T18:07:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369797+0000", 2024-05-08T18:07:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9510000000000001e-06 2024-05-08T18:07:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369802+0000", 2024-05-08T18:07:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8210000000000001e-06 2024-05-08T18:07:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369854+0000", 2024-05-08T18:07:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1751e-05 2024-05-08T18:07:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369880+0000", 2024-05-08T18:07:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6577999999999999e-05 2024-05-08T18:07:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374202+0000", 2024-05-08T18:07:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217029999999997 2024-05-08T18:07:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374246+0000", 2024-05-08T18:07:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3544000000000002e-05 2024-05-08T18:07:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:89 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'63, mlcod=15'60)", 2024-05-08T18:07:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 52.283601281999999, 2024-05-08T18:07:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057729900000000004, 2024-05-08T18:07:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.010 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:07:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:07:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703261+0000", 2024-05-08T18:07:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2569999999999998e-06 2024-05-08T18:07:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703272+0000", 2024-05-08T18:07:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0739e-05 2024-05-08T18:07:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703282+0000", 2024-05-08T18:07:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6250000000000002e-06 2024-05-08T18:07:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703333+0000", 2024-05-08T18:07:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1588000000000001e-05 2024-05-08T18:07:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703358+0000", 2024-05-08T18:07:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4913999999999999e-05 2024-05-08T18:07:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708907+0000", 2024-05-08T18:07:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055484829999999999 2024-05-08T18:07:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.709028+0000", 2024-05-08T18:07:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121667 2024-05-08T18:07:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-05-08T18:07:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:07:56.014 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 52.282535764999999, 2024-05-08T18:07:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0074185579999999996, 2024-05-08T18:07:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:07:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:07:56.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704322+0000", 2024-05-08T18:07:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8299999999999997e-07 2024-05-08T18:07:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704410+0000", 2024-05-08T18:07:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8552000000000002e-05 2024-05-08T18:07:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704421+0000", 2024-05-08T18:07:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0794e-05 2024-05-08T18:07:56.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704427+0000", 2024-05-08T18:07:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8699999999999997e-06 2024-05-08T18:07:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704481+0000", 2024-05-08T18:07:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4410999999999998e-05 2024-05-08T18:07:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704511+0000", 2024-05-08T18:07:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9906000000000001e-05 2024-05-08T18:07:56.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711682+0000", 2024-05-08T18:07:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071710209999999996 2024-05-08T18:07:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711740+0000", 2024-05-08T18:07:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7521e-05 2024-05-08T18:07:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:91 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'65, mlcod=15'60)", 2024-05-08T18:07:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:07:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 52.280991571999998, 2024-05-08T18:07:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059345600000000002, 2024-05-08T18:07:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:07:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:07:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705866+0000", 2024-05-08T18:07:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0900000000000001e-07 2024-05-08T18:07:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705872+0000", 2024-05-08T18:07:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0580000000000003e-06 2024-05-08T18:07:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705883+0000", 2024-05-08T18:07:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0986e-05 2024-05-08T18:07:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705889+0000", 2024-05-08T18:07:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6400000000000002e-06 2024-05-08T18:07:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705942+0000", 2024-05-08T18:07:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3726e-05 2024-05-08T18:07:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705963+0000", 2024-05-08T18:07:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0713e-05 2024-05-08T18:07:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711744+0000", 2024-05-08T18:07:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057812669999999997 2024-05-08T18:07:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711800+0000", 2024-05-08T18:07:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5461000000000003e-05 2024-05-08T18:07:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.022 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:92 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'66, mlcod=15'61)", 2024-05-08T18:07:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:07:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 52.279667224000001, 2024-05-08T18:07:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046553640000000004, 2024-05-08T18:07:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:07:56.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:07:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707191+0000", 2024-05-08T18:07:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9300000000000006e-07 2024-05-08T18:07:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707198+0000", 2024-05-08T18:07:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4669999999999998e-06 2024-05-08T18:07:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707214+0000", 2024-05-08T18:07:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5911000000000001e-05 2024-05-08T18:07:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707221+0000", 2024-05-08T18:07:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.43e-06 2024-05-08T18:07:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707283+0000", 2024-05-08T18:07:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1974e-05 2024-05-08T18:07:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707308+0000", 2024-05-08T18:07:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4589000000000001e-05 2024-05-08T18:07:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711802+0000", 2024-05-08T18:07:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044944939999999999 2024-05-08T18:07:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711845+0000", 2024-05-08T18:07:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2506000000000003e-05 2024-05-08T18:07:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:93 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'67, mlcod=15'61)", 2024-05-08T18:07:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:07:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 52.278836966999997, 2024-05-08T18:07:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217760000000003, 2024-05-08T18:07:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.027 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:07:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:07:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708021+0000", 2024-05-08T18:07:56.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.92e-07 2024-05-08T18:07:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708106+0000", 2024-05-08T18:07:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5400000000000002e-05 2024-05-08T18:07:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708116+0000", 2024-05-08T18:07:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0482000000000001e-05 2024-05-08T18:07:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708124+0000", 2024-05-08T18:07:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5349999999999999e-06 2024-05-08T18:07:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708182+0000", 2024-05-08T18:07:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8130000000000001e-05 2024-05-08T18:07:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708203+0000", 2024-05-08T18:07:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1118e-05 2024-05-08T18:07:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712298+0000", 2024-05-08T18:07:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004094688 2024-05-08T18:07:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712342+0000", 2024-05-08T18:07:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3730999999999999e-05 2024-05-08T18:07:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:07:56.031 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.382410901, 2024-05-08T18:07:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087837890000000002, 2024-05-08T18:07:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210 2024-05-08T18:07:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:07:56.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:07:56.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604448+0000", 2024-05-08T18:07:56.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4229999999999999e-06 2024-05-08T18:07:56.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604460+0000", 2024-05-08T18:07:56.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:07:56.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604491+0000", 2024-05-08T18:07:56.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1004000000000003e-05 2024-05-08T18:07:56.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604513+0000", 2024-05-08T18:07:56.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1886e-05 2024-05-08T18:07:56.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604670+0000", 2024-05-08T18:07:56.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000156735 2024-05-08T18:07:56.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:07:56.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604680+0000", 2024-05-08T18:07:56.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0113e-05 2024-05-08T18:07:56.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609236+0000", 2024-05-08T18:07:56.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045557269999999999 2024-05-08T18:07:56.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609544+0000", 2024-05-08T18:07:56.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030863800000000002 2024-05-08T18:07:56.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:56.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.610952+0000", 2024-05-08T18:07:56.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014077269999999999 2024-05-08T18:07:56.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.612639+0000", 2024-05-08T18:07:56.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001686398 2024-05-08T18:07:56.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613101+0000", 2024-05-08T18:07:56.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00046249600000000001 2024-05-08T18:07:56.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613176+0000", 2024-05-08T18:07:56.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5032999999999998e-05 2024-05-08T18:07:56.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613230+0000", 2024-05-08T18:07:56.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3638999999999999e-05 2024-05-08T18:07:56.037 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.038 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.038 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.038 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.038 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:07:56.038 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.333822691000002, 2024-05-08T18:07:56.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046602199999999996, 2024-05-08T18:07:56.038 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.038 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.038 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.038 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.038 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.038 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.039 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 222 2024-05-08T18:07:56.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.039 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:07:56.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:07:56.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653037+0000", 2024-05-08T18:07:56.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:07:56.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653048+0000", 2024-05-08T18:07:56.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:07:56.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653077+0000", 2024-05-08T18:07:56.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9326e-05 2024-05-08T18:07:56.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653098+0000", 2024-05-08T18:07:56.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1327000000000001e-05 2024-05-08T18:07:56.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653230+0000", 2024-05-08T18:07:56.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013206599999999999 2024-05-08T18:07:56.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653444+0000", 2024-05-08T18:07:56.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000213401 2024-05-08T18:07:56.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:56.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653852+0000", 2024-05-08T18:07:56.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040808700000000001 2024-05-08T18:07:56.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.656108+0000", 2024-05-08T18:07:56.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022565739999999999 2024-05-08T18:07:56.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657533+0000", 2024-05-08T18:07:56.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014241799999999999 2024-05-08T18:07:56.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657629+0000", 2024-05-08T18:07:56.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6435999999999996e-05 2024-05-08T18:07:56.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657694+0000", 2024-05-08T18:07:56.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5349000000000001e-05 2024-05-08T18:07:56.044 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.044 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.044 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.045 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:461 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.045 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:07:56.045 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.207200884999999, 2024-05-08T18:07:56.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040933549999999999, 2024-05-08T18:07:56.045 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.045 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.045 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.045 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.045 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.045 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.045 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 461 2024-05-08T18:07:56.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.045 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:07:56.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:07:56.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779657+0000", 2024-05-08T18:07:56.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.252e-06 2024-05-08T18:07:56.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779663+0000", 2024-05-08T18:07:56.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0170000000000002e-06 2024-05-08T18:07:56.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779676+0000", 2024-05-08T18:07:56.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.296e-05 2024-05-08T18:07:56.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779684+0000", 2024-05-08T18:07:56.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4209999999999998e-06 2024-05-08T18:07:56.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779736+0000", 2024-05-08T18:07:56.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2296999999999998e-05 2024-05-08T18:07:56.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779787+0000", 2024-05-08T18:07:56.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0954e-05 2024-05-08T18:07:56.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:56.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779897+0000", 2024-05-08T18:07:56.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011001999999999999 2024-05-08T18:07:56.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780506+0000", 2024-05-08T18:07:56.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060872599999999997 2024-05-08T18:07:56.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783690+0000", 2024-05-08T18:07:56.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031847210000000002 2024-05-08T18:07:56.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783722+0000", 2024-05-08T18:07:56.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1608e-05 2024-05-08T18:07:56.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783749+0000", 2024-05-08T18:07:56.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7379e-05 2024-05-08T18:07:56.050 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.050 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.050 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.050 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:491 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.050 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:07:56.050 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.184937277, 2024-05-08T18:07:56.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059507570000000001, 2024-05-08T18:07:56.051 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.051 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.051 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.051 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.051 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.051 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.051 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 491 2024-05-08T18:07:56.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.051 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:07:56.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:07:56.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801921+0000", 2024-05-08T18:07:56.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6959999999999999e-06 2024-05-08T18:07:56.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801928+0000", 2024-05-08T18:07:56.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0299999999999996e-06 2024-05-08T18:07:56.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801944+0000", 2024-05-08T18:07:56.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285e-05 2024-05-08T18:07:56.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801953+0000", 2024-05-08T18:07:56.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1849999999999993e-06 2024-05-08T18:07:56.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802008+0000", 2024-05-08T18:07:56.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5379e-05 2024-05-08T18:07:56.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802093+0000", 2024-05-08T18:07:56.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4907000000000005e-05 2024-05-08T18:07:56.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:56.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802217+0000", 2024-05-08T18:07:56.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000124253 2024-05-08T18:07:56.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802725+0000", 2024-05-08T18:07:56.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050758699999999999 2024-05-08T18:07:56.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807807+0000", 2024-05-08T18:07:56.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005082133 2024-05-08T18:07:56.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807840+0000", 2024-05-08T18:07:56.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3399000000000003e-05 2024-05-08T18:07:56.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807870+0000", 2024-05-08T18:07:56.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9903000000000002e-05 2024-05-08T18:07:56.056 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.056 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.056 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.056 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.056 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:07:56.056 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.178595073, 2024-05-08T18:07:56.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056057140000000004, 2024-05-08T18:07:56.056 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.056 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.056 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.057 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.057 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.057 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.057 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 502 2024-05-08T18:07:56.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.057 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:07:56.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:07:56.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808263+0000", 2024-05-08T18:07:56.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.054e-06 2024-05-08T18:07:56.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808268+0000", 2024-05-08T18:07:56.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4829999999999999e-06 2024-05-08T18:07:56.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808279+0000", 2024-05-08T18:07:56.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0710000000000001e-05 2024-05-08T18:07:56.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808285+0000", 2024-05-08T18:07:56.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0610000000000001e-06 2024-05-08T18:07:56.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808331+0000", 2024-05-08T18:07:56.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5939000000000002e-05 2024-05-08T18:07:56.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808380+0000", 2024-05-08T18:07:56.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9382999999999998e-05 2024-05-08T18:07:56.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:56.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808484+0000", 2024-05-08T18:07:56.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010410499999999999 2024-05-08T18:07:56.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.809035+0000", 2024-05-08T18:07:56.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000550969 2024-05-08T18:07:56.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813811+0000", 2024-05-08T18:07:56.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047759830000000001 2024-05-08T18:07:56.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813842+0000", 2024-05-08T18:07:56.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0778000000000002e-05 2024-05-08T18:07:56.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813867+0000", 2024-05-08T18:07:56.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5249000000000002e-05 2024-05-08T18:07:56.062 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.062 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.062 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.062 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.062 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:07:56.062 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.152064787, 2024-05-08T18:07:56.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041392019999999998, 2024-05-08T18:07:56.062 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.062 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.062 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.062 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.062 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.063 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.063 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 527 2024-05-08T18:07:56.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.063 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:07:56.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:07:56.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834793+0000", 2024-05-08T18:07:56.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.212e-06 2024-05-08T18:07:56.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834799+0000", 2024-05-08T18:07:56.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.468e-06 2024-05-08T18:07:56.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834811+0000", 2024-05-08T18:07:56.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2602000000000001e-05 2024-05-08T18:07:56.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834819+0000", 2024-05-08T18:07:56.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6660000000000008e-06 2024-05-08T18:07:56.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834871+0000", 2024-05-08T18:07:56.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2450000000000001e-05 2024-05-08T18:07:56.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834973+0000", 2024-05-08T18:07:56.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101778 2024-05-08T18:07:56.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:56.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835114+0000", 2024-05-08T18:07:56.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014053399999999999 2024-05-08T18:07:56.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835758+0000", 2024-05-08T18:07:56.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064386100000000002 2024-05-08T18:07:56.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838876+0000", 2024-05-08T18:07:56.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031188890000000001 2024-05-08T18:07:56.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838907+0000", 2024-05-08T18:07:56.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-08T18:07:56.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838931+0000", 2024-05-08T18:07:56.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3822999999999999e-05 2024-05-08T18:07:56.067 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.067 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.067 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.068 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.068 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:07:56.068 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.147559807, 2024-05-08T18:07:56.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048358089999999999, 2024-05-08T18:07:56.068 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.068 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.068 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.068 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.068 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.068 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.068 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 534 2024-05-08T18:07:56.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.068 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:07:56.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:07:56.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839298+0000", 2024-05-08T18:07:56.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1429999999999999e-06 2024-05-08T18:07:56.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839304+0000", 2024-05-08T18:07:56.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4380000000000003e-06 2024-05-08T18:07:56.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839313+0000", 2024-05-08T18:07:56.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5210000000000008e-06 2024-05-08T18:07:56.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839318+0000", 2024-05-08T18:07:56.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0540000000000002e-06 2024-05-08T18:07:56.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839355+0000", 2024-05-08T18:07:56.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6541999999999997e-05 2024-05-08T18:07:56.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839400+0000", 2024-05-08T18:07:56.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4861999999999998e-05 2024-05-08T18:07:56.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:56.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839504+0000", 2024-05-08T18:07:56.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104169 2024-05-08T18:07:56.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.840046+0000", 2024-05-08T18:07:56.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054245400000000005 2024-05-08T18:07:56.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844075+0000", 2024-05-08T18:07:56.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040287559999999997 2024-05-08T18:07:56.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844108+0000", 2024-05-08T18:07:56.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2872e-05 2024-05-08T18:07:56.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844133+0000", 2024-05-08T18:07:56.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4998e-05 2024-05-08T18:07:56.073 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.073 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.073 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.073 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:544 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.073 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:07:56.073 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.134416797, 2024-05-08T18:07:56.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052743060000000003, 2024-05-08T18:07:56.074 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.074 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.074 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.074 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.074 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.074 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.074 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 544 2024-05-08T18:07:56.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.074 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:07:56.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:07:56.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852442+0000", 2024-05-08T18:07:56.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.88e-06 2024-05-08T18:07:56.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852450+0000", 2024-05-08T18:07:56.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1999999999999994e-06 2024-05-08T18:07:56.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852472+0000", 2024-05-08T18:07:56.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2160000000000001e-05 2024-05-08T18:07:56.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852487+0000", 2024-05-08T18:07:56.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5044e-05 2024-05-08T18:07:56.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852550+0000", 2024-05-08T18:07:56.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3152999999999997e-05 2024-05-08T18:07:56.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852608+0000", 2024-05-08T18:07:56.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8026000000000003e-05 2024-05-08T18:07:56.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:56.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852727+0000", 2024-05-08T18:07:56.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118919 2024-05-08T18:07:56.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.853180+0000", 2024-05-08T18:07:56.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045216599999999999 2024-05-08T18:07:56.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857638+0000", 2024-05-08T18:07:56.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044584510000000004 2024-05-08T18:07:56.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857672+0000", 2024-05-08T18:07:56.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3571000000000001e-05 2024-05-08T18:07:56.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857714+0000", 2024-05-08T18:07:56.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2735999999999999e-05 2024-05-08T18:07:56.079 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.079 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.079 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.079 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.079 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:07:56.079 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.806588017999999, 2024-05-08T18:07:56.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004733213, 2024-05-08T18:07:56.079 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.079 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.079 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.079 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.080 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.080 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.080 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 789 2024-05-08T18:07:56.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.080 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:07:56.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:07:56.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180271+0000", 2024-05-08T18:07:56.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8700000000000001e-06 2024-05-08T18:07:56.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180281+0000", 2024-05-08T18:07:56.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0067e-05 2024-05-08T18:07:56.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180311+0000", 2024-05-08T18:07:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0783e-05 2024-05-08T18:07:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180333+0000", 2024-05-08T18:07:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1509999999999999e-05 2024-05-08T18:07:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180450+0000", 2024-05-08T18:07:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116686 2024-05-08T18:07:56.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180581+0000", 2024-05-08T18:07:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013103499999999999 2024-05-08T18:07:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180848+0000", 2024-05-08T18:07:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026750199999999997 2024-05-08T18:07:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184268+0000", 2024-05-08T18:07:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034198319999999998 2024-05-08T18:07:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184844+0000", 2024-05-08T18:07:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057643899999999999 2024-05-08T18:07:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184933+0000", 2024-05-08T18:07:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8692999999999999e-05 2024-05-08T18:07:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.185002+0000", 2024-05-08T18:07:56.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8795999999999997e-05 2024-05-08T18:07:56.085 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.085 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.085 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.085 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.085 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.085 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:56.085 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:55.985+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:56.086 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:07:56.131 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:56.133+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:56.188 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:56.187+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:56.257 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:56.257 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:56.257 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:56.257 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:56.271 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:07:56.289 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:56.287+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:56.364 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-05-08T18:07:56.390 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:07:56.387+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:07:56.399 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:56.399 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:56.399 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:07:56.399 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:07:56.399 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:56.413 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:07:56.491 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:56.491+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:56.579 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:07:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:07:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:07:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-05-08T18:07:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:07:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.010834895000002, 2024-05-08T18:07:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035750999999999999, 2024-05-08T18:07:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:07:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:07:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570203+0000", 2024-05-08T18:07:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6749999999999996e-06 2024-05-08T18:07:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570213+0000", 2024-05-08T18:07:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0139999999999999e-05 2024-05-08T18:07:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570231+0000", 2024-05-08T18:07:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8402000000000001e-05 2024-05-08T18:07:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570245+0000", 2024-05-08T18:07:56.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3135e-05 2024-05-08T18:07:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570338+0000", 2024-05-08T18:07:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3498000000000005e-05 2024-05-08T18:07:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570373+0000", 2024-05-08T18:07:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5179999999999999e-05 2024-05-08T18:07:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573694+0000", 2024-05-08T18:07:56.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003320524 2024-05-08T18:07:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573771+0000", 2024-05-08T18:07:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7546000000000006e-05 2024-05-08T18:07:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-05-08T18:07:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:07:56.584 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.005521932999997, 2024-05-08T18:07:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038280229999999998, 2024-05-08T18:07:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:07:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:07:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575510+0000", 2024-05-08T18:07:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0979999999999999e-06 2024-05-08T18:07:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575527+0000", 2024-05-08T18:07:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6393999999999999e-05 2024-05-08T18:07:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575549+0000", 2024-05-08T18:07:56.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1843000000000001e-05 2024-05-08T18:07:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575560+0000", 2024-05-08T18:07:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.186e-05 2024-05-08T18:07:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575651+0000", 2024-05-08T18:07:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1068000000000003e-05 2024-05-08T18:07:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575685+0000", 2024-05-08T18:07:56.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3614e-05 2024-05-08T18:07:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579231+0000", 2024-05-08T18:07:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003546249 2024-05-08T18:07:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579337+0000", 2024-05-08T18:07:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010589700000000001 2024-05-08T18:07:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-05-08T18:07:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:07:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.003484641999997, 2024-05-08T18:07:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004223157, 2024-05-08T18:07:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:07:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:07:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577548+0000", 2024-05-08T18:07:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.66e-06 2024-05-08T18:07:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577561+0000", 2024-05-08T18:07:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2533e-05 2024-05-08T18:07:56.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577585+0000", 2024-05-08T18:07:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3873e-05 2024-05-08T18:07:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577605+0000", 2024-05-08T18:07:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0477000000000001e-05 2024-05-08T18:07:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577717+0000", 2024-05-08T18:07:56.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011229499999999999 2024-05-08T18:07:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577777+0000", 2024-05-08T18:07:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.944e-05 2024-05-08T18:07:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581704+0000", 2024-05-08T18:07:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039267800000000004 2024-05-08T18:07:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581770+0000", 2024-05-08T18:07:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6099000000000005e-05 2024-05-08T18:07:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:54 7.d e29/28 7:b4812045:::notify.4:head v 29'1, mlcod=0'0)", 2024-05-08T18:07:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:07:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.000671918000002, 2024-05-08T18:07:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003988503, 2024-05-08T18:07:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.593 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:07:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:07:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580368+0000", 2024-05-08T18:07:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3089999999999996e-06 2024-05-08T18:07:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580400+0000", 2024-05-08T18:07:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2580000000000003e-05 2024-05-08T18:07:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580427+0000", 2024-05-08T18:07:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6976999999999999e-05 2024-05-08T18:07:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580443+0000", 2024-05-08T18:07:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5585000000000001e-05 2024-05-08T18:07:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580555+0000", 2024-05-08T18:07:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112639 2024-05-08T18:07:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580601+0000", 2024-05-08T18:07:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6e-05 2024-05-08T18:07:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584229+0000", 2024-05-08T18:07:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036273659999999999 2024-05-08T18:07:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584348+0000", 2024-05-08T18:07:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119047 2024-05-08T18:07:56.597 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:07:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.891258647999997, 2024-05-08T18:07:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032136159999999999, 2024-05-08T18:07:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.598 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 193 2024-05-08T18:07:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:07:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:07:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689775+0000", 2024-05-08T18:07:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.357e-06 2024-05-08T18:07:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689788+0000", 2024-05-08T18:07:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3029e-05 2024-05-08T18:07:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689819+0000", 2024-05-08T18:07:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.065e-05 2024-05-08T18:07:56.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689833+0000", 2024-05-08T18:07:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4790000000000001e-05 2024-05-08T18:07:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689948+0000", 2024-05-08T18:07:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115089 2024-05-08T18:07:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690155+0000", 2024-05-08T18:07:56.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206932 2024-05-08T18:07:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690420+0000", 2024-05-08T18:07:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026450200000000001 2024-05-08T18:07:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692229+0000", 2024-05-08T18:07:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001808823 2024-05-08T18:07:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692816+0000", 2024-05-08T18:07:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058773199999999999 2024-05-08T18:07:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692915+0000", 2024-05-08T18:07:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8646000000000004e-05 2024-05-08T18:07:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692986+0000", 2024-05-08T18:07:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1066e-05 2024-05-08T18:07:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.603 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:07:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.992292428999999, 2024-05-08T18:07:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089431319999999995, 2024-05-08T18:07:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 208 2024-05-08T18:07:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:07:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:07:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588741+0000", 2024-05-08T18:07:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:07:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588752+0000", 2024-05-08T18:07:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0813e-05 2024-05-08T18:07:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588782+0000", 2024-05-08T18:07:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0020000000000001e-05 2024-05-08T18:07:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588803+0000", 2024-05-08T18:07:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1115999999999999e-05 2024-05-08T18:07:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588943+0000", 2024-05-08T18:07:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013971599999999999 2024-05-08T18:07:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:07:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588954+0000", 2024-05-08T18:07:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1365999999999999e-05 2024-05-08T18:07:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594340+0000", 2024-05-08T18:07:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053854910000000001 2024-05-08T18:07:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594670+0000", 2024-05-08T18:07:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000330055 2024-05-08T18:07:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.595179+0000", 2024-05-08T18:07:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050879199999999999 2024-05-08T18:07:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.596408+0000", 2024-05-08T18:07:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012295209999999999 2024-05-08T18:07:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597532+0000", 2024-05-08T18:07:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011233860000000001 2024-05-08T18:07:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597619+0000", 2024-05-08T18:07:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7775999999999994e-05 2024-05-08T18:07:56.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597682+0000", 2024-05-08T18:07:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2522999999999998e-05 2024-05-08T18:07:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:07:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.963663449999999, 2024-05-08T18:07:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031262669999999998, 2024-05-08T18:07:56.610 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 212 2024-05-08T18:07:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:07:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:07:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617370+0000", 2024-05-08T18:07:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:07:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617379+0000", 2024-05-08T18:07:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2359999999999993e-06 2024-05-08T18:07:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617405+0000", 2024-05-08T18:07:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5639999999999998e-05 2024-05-08T18:07:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617425+0000", 2024-05-08T18:07:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0457000000000001e-05 2024-05-08T18:07:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617573+0000", 2024-05-08T18:07:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014776200000000001 2024-05-08T18:07:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617786+0000", 2024-05-08T18:07:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212418 2024-05-08T18:07:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.618177+0000", 2024-05-08T18:07:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039161699999999997 2024-05-08T18:07:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.619563+0000", 2024-05-08T18:07:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013852999999999999 2024-05-08T18:07:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620334+0000", 2024-05-08T18:07:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00077182200000000002 2024-05-08T18:07:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620426+0000", 2024-05-08T18:07:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1526000000000004e-05 2024-05-08T18:07:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620494+0000", 2024-05-08T18:07:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8078999999999997e-05 2024-05-08T18:07:56.615 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:07:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.939344897000002, 2024-05-08T18:07:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035230880000000002, 2024-05-08T18:07:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.616 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 219 2024-05-08T18:07:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:07:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:07:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641689+0000", 2024-05-08T18:07:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:07:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641700+0000", 2024-05-08T18:07:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1507e-05 2024-05-08T18:07:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641732+0000", 2024-05-08T18:07:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1585999999999999e-05 2024-05-08T18:07:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641754+0000", 2024-05-08T18:07:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1480000000000001e-05 2024-05-08T18:07:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641942+0000", 2024-05-08T18:07:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018826300000000001 2024-05-08T18:07:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642165+0000", 2024-05-08T18:07:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022301100000000001 2024-05-08T18:07:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642587+0000", 2024-05-08T18:07:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042182400000000001 2024-05-08T18:07:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.643767+0000", 2024-05-08T18:07:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001180675 2024-05-08T18:07:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645010+0000", 2024-05-08T18:07:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012427110000000001 2024-05-08T18:07:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645101+0000", 2024-05-08T18:07:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0871999999999993e-05 2024-05-08T18:07:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645209+0000", 2024-05-08T18:07:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108496 2024-05-08T18:07:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.621 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:07:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.919547909999999, 2024-05-08T18:07:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035793639999999998, 2024-05-08T18:07:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 224 2024-05-08T18:07:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:07:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:07:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661485+0000", 2024-05-08T18:07:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9759999999999998e-06 2024-05-08T18:07:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661494+0000", 2024-05-08T18:07:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3469999999999999e-06 2024-05-08T18:07:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661517+0000", 2024-05-08T18:07:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.389e-05 2024-05-08T18:07:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661537+0000", 2024-05-08T18:07:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9803e-05 2024-05-08T18:07:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661696+0000", 2024-05-08T18:07:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015865899999999999 2024-05-08T18:07:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661910+0000", 2024-05-08T18:07:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021434199999999999 2024-05-08T18:07:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.662336+0000", 2024-05-08T18:07:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042575300000000001 2024-05-08T18:07:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.663720+0000", 2024-05-08T18:07:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013843799999999999 2024-05-08T18:07:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.664909+0000", 2024-05-08T18:07:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011889019999999999 2024-05-08T18:07:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665001+0000", 2024-05-08T18:07:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1649000000000003e-05 2024-05-08T18:07:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665063+0000", 2024-05-08T18:07:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1662999999999996e-05 2024-05-08T18:07:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:07:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.886954635999999, 2024-05-08T18:07:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031551930000000001, 2024-05-08T18:07:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.627 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 233 2024-05-08T18:07:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:07:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:07:56.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694079+0000", 2024-05-08T18:07:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:07:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694090+0000", 2024-05-08T18:07:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1182999999999999e-05 2024-05-08T18:07:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694119+0000", 2024-05-08T18:07:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9076000000000001e-05 2024-05-08T18:07:56.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694143+0000", 2024-05-08T18:07:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4363e-05 2024-05-08T18:07:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694291+0000", 2024-05-08T18:07:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147849 2024-05-08T18:07:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694534+0000", 2024-05-08T18:07:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000242382 2024-05-08T18:07:56.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694957+0000", 2024-05-08T18:07:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042316700000000001 2024-05-08T18:07:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.696306+0000", 2024-05-08T18:07:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013489940000000001 2024-05-08T18:07:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697071+0000", 2024-05-08T18:07:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076482999999999998 2024-05-08T18:07:56.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697167+0000", 2024-05-08T18:07:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6773000000000003e-05 2024-05-08T18:07:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697232+0000", 2024-05-08T18:07:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4386000000000003e-05 2024-05-08T18:07:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:328 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:07:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.855236048999998, 2024-05-08T18:07:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029659439999999999, 2024-05-08T18:07:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 328 2024-05-08T18:07:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:07:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:07:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725796+0000", 2024-05-08T18:07:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-06 2024-05-08T18:07:56.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725802+0000", 2024-05-08T18:07:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7219999999999996e-06 2024-05-08T18:07:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725816+0000", 2024-05-08T18:07:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3886999999999999e-05 2024-05-08T18:07:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725824+0000", 2024-05-08T18:07:56.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5920000000000003e-06 2024-05-08T18:07:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725885+0000", 2024-05-08T18:07:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1526999999999996e-05 2024-05-08T18:07:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725972+0000", 2024-05-08T18:07:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7099000000000001e-05 2024-05-08T18:07:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726093+0000", 2024-05-08T18:07:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120383 2024-05-08T18:07:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726717+0000", 2024-05-08T18:07:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062435099999999999 2024-05-08T18:07:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728693+0000", 2024-05-08T18:07:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019758309999999999 2024-05-08T18:07:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728731+0000", 2024-05-08T18:07:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8591999999999999e-05 2024-05-08T18:07:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728761+0000", 2024-05-08T18:07:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9770000000000001e-05 2024-05-08T18:07:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:460 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:07:56.638 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.801418824999999, 2024-05-08T18:07:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040209540000000002, 2024-05-08T18:07:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 460 2024-05-08T18:07:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:07:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:07:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779613+0000", 2024-05-08T18:07:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:07:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779619+0000", 2024-05-08T18:07:56.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3630000000000002e-06 2024-05-08T18:07:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779631+0000", 2024-05-08T18:07:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2211e-05 2024-05-08T18:07:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779637+0000", 2024-05-08T18:07:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0430000000000004e-06 2024-05-08T18:07:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779702+0000", 2024-05-08T18:07:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4481999999999997e-05 2024-05-08T18:07:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779848+0000", 2024-05-08T18:07:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014608500000000001 2024-05-08T18:07:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780056+0000", 2024-05-08T18:07:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020889699999999999 2024-05-08T18:07:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780700+0000", 2024-05-08T18:07:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064379300000000003 2024-05-08T18:07:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783576+0000", 2024-05-08T18:07:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028754919999999999 2024-05-08T18:07:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783608+0000", 2024-05-08T18:07:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2223e-05 2024-05-08T18:07:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:07:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5296e-05 2024-05-08T18:07:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:466 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:07:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.796880587, 2024-05-08T18:07:56.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028979520000000001, 2024-05-08T18:07:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 466 2024-05-08T18:07:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:07:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:07:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:07:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.61e-07 2024-05-08T18:07:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784155+0000", 2024-05-08T18:07:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9299999999999996e-06 2024-05-08T18:07:56.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784165+0000", 2024-05-08T18:07:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5680000000000005e-06 2024-05-08T18:07:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784170+0000", 2024-05-08T18:07:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1379999999999998e-06 2024-05-08T18:07:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784219+0000", 2024-05-08T18:07:56.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9231999999999999e-05 2024-05-08T18:07:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784310+0000", 2024-05-08T18:07:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0797000000000005e-05 2024-05-08T18:07:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784490+0000", 2024-05-08T18:07:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179705 2024-05-08T18:07:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.785090+0000", 2024-05-08T18:07:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060073899999999998 2024-05-08T18:07:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.786973+0000", 2024-05-08T18:07:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018824460000000001 2024-05-08T18:07:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787007+0000", 2024-05-08T18:07:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3779999999999998e-05 2024-05-08T18:07:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787049+0000", 2024-05-08T18:07:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1856e-05 2024-05-08T18:07:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:477 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:07:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.789738592999999, 2024-05-08T18:07:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046076989999999998, 2024-05-08T18:07:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.650 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 477 2024-05-08T18:07:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:07:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:07:56.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791294+0000", 2024-05-08T18:07:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-06 2024-05-08T18:07:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791300+0000", 2024-05-08T18:07:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5320000000000003e-06 2024-05-08T18:07:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791313+0000", 2024-05-08T18:07:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2576e-05 2024-05-08T18:07:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791319+0000", 2024-05-08T18:07:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1720000000000004e-06 2024-05-08T18:07:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791379+0000", 2024-05-08T18:07:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0343000000000001e-05 2024-05-08T18:07:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791477+0000", 2024-05-08T18:07:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7662000000000001e-05 2024-05-08T18:07:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791678+0000", 2024-05-08T18:07:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000200788 2024-05-08T18:07:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.792263+0000", 2024-05-08T18:07:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058525700000000005 2024-05-08T18:07:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795842+0000", 2024-05-08T18:07:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035787079999999999 2024-05-08T18:07:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795874+0000", 2024-05-08T18:07:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2205000000000001e-05 2024-05-08T18:07:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795900+0000", 2024-05-08T18:07:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6222000000000001e-05 2024-05-08T18:07:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.655 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:642 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:07:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.650978890000001, 2024-05-08T18:07:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030444059999999999, 2024-05-08T18:07:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 642 2024-05-08T18:07:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.656 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:07:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:07:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930055+0000", 2024-05-08T18:07:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7999999999999999e-06 2024-05-08T18:07:56.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930065+0000", 2024-05-08T18:07:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0176999999999999e-05 2024-05-08T18:07:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930092+0000", 2024-05-08T18:07:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6460000000000001e-05 2024-05-08T18:07:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930112+0000", 2024-05-08T18:07:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0043000000000001e-05 2024-05-08T18:07:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930219+0000", 2024-05-08T18:07:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010698500000000001 2024-05-08T18:07:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930345+0000", 2024-05-08T18:07:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012620400000000001 2024-05-08T18:07:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:56.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930579+0000", 2024-05-08T18:07:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234145 2024-05-08T18:07:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.931471+0000", 2024-05-08T18:07:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00089161500000000001 2024-05-08T18:07:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.932978+0000", 2024-05-08T18:07:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001507296 2024-05-08T18:07:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933044+0000", 2024-05-08T18:07:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6402000000000006e-05 2024-05-08T18:07:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933097+0000", 2024-05-08T18:07:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2278999999999999e-05 2024-05-08T18:07:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:681 6.e e32/26 6:748722ff:gc::gc.6:head v 32'7, mlcod=32'5)", 2024-05-08T18:07:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:07:56.661 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.620183312999998, 2024-05-08T18:07:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003318185, 2024-05-08T18:07:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:07:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:07:56.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960849+0000", 2024-05-08T18:07:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.423e-06 2024-05-08T18:07:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960859+0000", 2024-05-08T18:07:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3170000000000008e-06 2024-05-08T18:07:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960874+0000", 2024-05-08T18:07:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5125e-05 2024-05-08T18:07:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960884+0000", 2024-05-08T18:07:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8120000000000002e-06 2024-05-08T18:07:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960972+0000", 2024-05-08T18:07:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8540000000000003e-05 2024-05-08T18:07:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960996+0000", 2024-05-08T18:07:56.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3479999999999999e-05 2024-05-08T18:07:56.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964110+0000", 2024-05-08T18:07:56.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031142729999999999 2024-05-08T18:07:56.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964166+0000", 2024-05-08T18:07:56.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6215000000000003e-05 2024-05-08T18:07:56.665 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.665 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.666 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.666 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.666 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:07:56.666 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.529147217999999, 2024-05-08T18:07:56.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030648379999999999, 2024-05-08T18:07:56.666 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.666 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.666 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.666 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.666 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.666 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.666 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 733 2024-05-08T18:07:56.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.667 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:07:56.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:07:56.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051887+0000", 2024-05-08T18:07:56.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.74e-06 2024-05-08T18:07:56.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051900+0000", 2024-05-08T18:07:56.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3113e-05 2024-05-08T18:07:56.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051931+0000", 2024-05-08T18:07:56.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1665999999999998e-05 2024-05-08T18:07:56.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051946+0000", 2024-05-08T18:07:56.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4780000000000001e-05 2024-05-08T18:07:56.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052078+0000", 2024-05-08T18:07:56.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013133200000000001 2024-05-08T18:07:56.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052338+0000", 2024-05-08T18:07:56.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026056899999999999 2024-05-08T18:07:56.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:56.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052652+0000", 2024-05-08T18:07:56.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031396700000000001 2024-05-08T18:07:56.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.053668+0000", 2024-05-08T18:07:56.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00101574 2024-05-08T18:07:56.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054800+0000", 2024-05-08T18:07:56.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011319819999999999 2024-05-08T18:07:56.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054884+0000", 2024-05-08T18:07:56.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4005999999999995e-05 2024-05-08T18:07:56.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054949+0000", 2024-05-08T18:07:56.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4943000000000005e-05 2024-05-08T18:07:56.671 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.671 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.671 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.671 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.671 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:07:56.672 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.525292582999999, 2024-05-08T18:07:56.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029745919999999999, 2024-05-08T18:07:56.672 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.672 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.672 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.672 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.672 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.672 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.672 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 735 2024-05-08T18:07:56.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.672 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:07:56.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:07:56.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055741+0000", 2024-05-08T18:07:56.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.984e-06 2024-05-08T18:07:56.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055766+0000", 2024-05-08T18:07:56.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5253e-05 2024-05-08T18:07:56.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055785+0000", 2024-05-08T18:07:56.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9559999999999999e-05 2024-05-08T18:07:56.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055798+0000", 2024-05-08T18:07:56.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-05 2024-05-08T18:07:56.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055932+0000", 2024-05-08T18:07:56.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134609 2024-05-08T18:07:56.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056184+0000", 2024-05-08T18:07:56.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025167800000000003 2024-05-08T18:07:56.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:56.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056680+0000", 2024-05-08T18:07:56.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049576299999999998 2024-05-08T18:07:56.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058060+0000", 2024-05-08T18:07:56.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013801 2024-05-08T18:07:56.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058447+0000", 2024-05-08T18:07:56.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038695299999999999 2024-05-08T18:07:56.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058601+0000", 2024-05-08T18:07:56.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015396299999999999 2024-05-08T18:07:56.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058713+0000", 2024-05-08T18:07:56.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112389 2024-05-08T18:07:56.677 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.677 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.677 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.677 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.677 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:07:56.677 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.418277233000001, 2024-05-08T18:07:56.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029913650000000002, 2024-05-08T18:07:56.677 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.677 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.678 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.678 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.678 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.678 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.678 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 781 2024-05-08T18:07:56.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.678 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:07:56.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:07:56.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162757+0000", 2024-05-08T18:07:56.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:07:56.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162770+0000", 2024-05-08T18:07:56.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3406e-05 2024-05-08T18:07:56.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162799+0000", 2024-05-08T18:07:56.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-05 2024-05-08T18:07:56.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162813+0000", 2024-05-08T18:07:56.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:07:56.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162942+0000", 2024-05-08T18:07:56.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012902200000000001 2024-05-08T18:07:56.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163159+0000", 2024-05-08T18:07:56.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021738500000000001 2024-05-08T18:07:56.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:56.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163476+0000", 2024-05-08T18:07:56.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031666499999999999 2024-05-08T18:07:56.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.164533+0000", 2024-05-08T18:07:56.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010574219999999999 2024-05-08T18:07:56.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165587+0000", 2024-05-08T18:07:56.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001053476 2024-05-08T18:07:56.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165674+0000", 2024-05-08T18:07:56.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6725999999999996e-05 2024-05-08T18:07:56.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165745+0000", 2024-05-08T18:07:56.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1779000000000005e-05 2024-05-08T18:07:56.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.683 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.683 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:56.683 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:07:56.683 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.035687384999999, 2024-05-08T18:07:56.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029834750000000002, 2024-05-08T18:07:56.683 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:56.683 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:56.683 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:56.684 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:56.684 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:56.684 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:56.684 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 946 2024-05-08T18:07:56.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.684 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:56.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:56.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:07:56.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:56.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:07:56.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:56.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:56.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545346+0000", 2024-05-08T18:07:56.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6570000000000001e-06 2024-05-08T18:07:56.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:56.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545357+0000", 2024-05-08T18:07:56.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0740000000000001e-05 2024-05-08T18:07:56.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:56.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545384+0000", 2024-05-08T18:07:56.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6780000000000001e-05 2024-05-08T18:07:56.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:56.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545398+0000", 2024-05-08T18:07:56.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3936e-05 2024-05-08T18:07:56.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:56.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545515+0000", 2024-05-08T18:07:56.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117413 2024-05-08T18:07:56.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:56.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545751+0000", 2024-05-08T18:07:56.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023559500000000001 2024-05-08T18:07:56.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:56.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.546075+0000", 2024-05-08T18:07:56.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000324357 2024-05-08T18:07:56.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:56.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.547104+0000", 2024-05-08T18:07:56.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010285959999999999 2024-05-08T18:07:56.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:56.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548141+0000", 2024-05-08T18:07:56.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001036922 2024-05-08T18:07:56.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:56.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548223+0000", 2024-05-08T18:07:56.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2260000000000002e-05 2024-05-08T18:07:56.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:56.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:56.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:56.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548327+0000", 2024-05-08T18:07:56.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104219 2024-05-08T18:07:56.688 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.688 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.689 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.689 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:56.689 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:56.689 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:56.690 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:07:56.691 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:56.691+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:56.791 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:56.793+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:56.817 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:56.817 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:56.817 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:56.817 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:56.832 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:07:56.892 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:56.891+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:56.993 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:56.991+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:56.997 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:07:56.997 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:07:56.997 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:57.011 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:07:57.095 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:57.091+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:57.138 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:57.138 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:07:57.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:07:57.138 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:07:57.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.138 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:57.138 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:07:57.138 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.561861327000003, 2024-05-08T18:07:57.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002466088, 2024-05-08T18:07:57.138 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.139 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.139 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.139 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.139 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.139 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.139 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 52 2024-05-08T18:07:57.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.139 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:07:57.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:07:57.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577062+0000", 2024-05-08T18:07:57.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.994e-06 2024-05-08T18:07:57.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577075+0000", 2024-05-08T18:07:57.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2480000000000001e-05 2024-05-08T18:07:57.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577108+0000", 2024-05-08T18:07:57.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3096000000000003e-05 2024-05-08T18:07:57.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577131+0000", 2024-05-08T18:07:57.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2993000000000002e-05 2024-05-08T18:07:57.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577260+0000", 2024-05-08T18:07:57.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012912899999999999 2024-05-08T18:07:57.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577453+0000", 2024-05-08T18:07:57.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000193668 2024-05-08T18:07:57.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:07:57.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577634+0000", 2024-05-08T18:07:57.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180576 2024-05-08T18:07:57.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579082+0000", 2024-05-08T18:07:57.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001448083 2024-05-08T18:07:57.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579290+0000", 2024-05-08T18:07:57.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000208333 2024-05-08T18:07:57.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579403+0000", 2024-05-08T18:07:57.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011296800000000001 2024-05-08T18:07:57.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579525+0000", 2024-05-08T18:07:57.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121768 2024-05-08T18:07:57.143 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.143 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.144 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.144 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-05-08T18:07:57.144 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:07:57.144 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.550001561999999, 2024-05-08T18:07:57.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038858310000000002, 2024-05-08T18:07:57.144 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.144 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.144 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.144 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:07:57.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:07:57.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588920+0000", 2024-05-08T18:07:57.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.23e-07 2024-05-08T18:07:57.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588929+0000", 2024-05-08T18:07:57.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3659999999999998e-06 2024-05-08T18:07:57.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588948+0000", 2024-05-08T18:07:57.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8768000000000001e-05 2024-05-08T18:07:57.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588962+0000", 2024-05-08T18:07:57.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4e-05 2024-05-08T18:07:57.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589110+0000", 2024-05-08T18:07:57.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148047 2024-05-08T18:07:57.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589173+0000", 2024-05-08T18:07:57.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2766000000000002e-05 2024-05-08T18:07:57.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592728+0000", 2024-05-08T18:07:57.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035553300000000002 2024-05-08T18:07:57.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592805+0000", 2024-05-08T18:07:57.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6730999999999994e-05 2024-05-08T18:07:57.148 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.148 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.148 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.148 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.148 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:07:57.148 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.433932664, 2024-05-08T18:07:57.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034354310000000001, 2024-05-08T18:07:57.148 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.148 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.148 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.148 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.148 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.149 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.149 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 236 2024-05-08T18:07:57.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.149 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:07:57.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:07:57.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704991+0000", 2024-05-08T18:07:57.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1240000000000001e-06 2024-05-08T18:07:57.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705009+0000", 2024-05-08T18:07:57.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7819e-05 2024-05-08T18:07:57.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705048+0000", 2024-05-08T18:07:57.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9632999999999998e-05 2024-05-08T18:07:57.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705073+0000", 2024-05-08T18:07:57.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4686999999999999e-05 2024-05-08T18:07:57.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705241+0000", 2024-05-08T18:07:57.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759899999999999 2024-05-08T18:07:57.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705511+0000", 2024-05-08T18:07:57.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027018799999999998 2024-05-08T18:07:57.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:57.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705965+0000", 2024-05-08T18:07:57.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045433000000000002 2024-05-08T18:07:57.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.707487+0000", 2024-05-08T18:07:57.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015214810000000001 2024-05-08T18:07:57.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708125+0000", 2024-05-08T18:07:57.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063870300000000001 2024-05-08T18:07:57.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708298+0000", 2024-05-08T18:07:57.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172592 2024-05-08T18:07:57.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708423+0000", 2024-05-08T18:07:57.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125275 2024-05-08T18:07:57.153 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.153 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.153 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.154 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:308 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.154 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:07:57.154 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.417094762000001, 2024-05-08T18:07:57.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038707400000000001, 2024-05-08T18:07:57.154 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.154 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.154 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.154 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.154 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.154 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.154 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 308 2024-05-08T18:07:57.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.154 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:07:57.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:07:57.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721827+0000", 2024-05-08T18:07:57.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1519999999999999e-06 2024-05-08T18:07:57.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721840+0000", 2024-05-08T18:07:57.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.362e-05 2024-05-08T18:07:57.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721857+0000", 2024-05-08T18:07:57.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6901e-05 2024-05-08T18:07:57.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721867+0000", 2024-05-08T18:07:57.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0034000000000001e-05 2024-05-08T18:07:57.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721922+0000", 2024-05-08T18:07:57.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4450999999999998e-05 2024-05-08T18:07:57.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721981+0000", 2024-05-08T18:07:57.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9267e-05 2024-05-08T18:07:57.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:57.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722103+0000", 2024-05-08T18:07:57.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121502 2024-05-08T18:07:57.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722757+0000", 2024-05-08T18:07:57.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065419700000000003 2024-05-08T18:07:57.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725619+0000", 2024-05-08T18:07:57.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002862107 2024-05-08T18:07:57.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725654+0000", 2024-05-08T18:07:57.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:07:57.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725696+0000", 2024-05-08T18:07:57.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:07:57.159 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.159 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.159 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.159 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:604 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.159 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:07:57.159 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.239812056000002, 2024-05-08T18:07:57.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002741884, 2024-05-08T18:07:57.159 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.160 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.160 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.160 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.160 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.160 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.160 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 604 2024-05-08T18:07:57.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.160 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:07:57.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:07:57.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899111+0000", 2024-05-08T18:07:57.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0910000000000001e-06 2024-05-08T18:07:57.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899126+0000", 2024-05-08T18:07:57.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:07:57.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899159+0000", 2024-05-08T18:07:57.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3241999999999998e-05 2024-05-08T18:07:57.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899174+0000", 2024-05-08T18:07:57.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5235000000000001e-05 2024-05-08T18:07:57.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899316+0000", 2024-05-08T18:07:57.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014175599999999999 2024-05-08T18:07:57.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899525+0000", 2024-05-08T18:07:57.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020915300000000001 2024-05-08T18:07:57.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:57.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899872+0000", 2024-05-08T18:07:57.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034668299999999997 2024-05-08T18:07:57.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901064+0000", 2024-05-08T18:07:57.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001191473 2024-05-08T18:07:57.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901664+0000", 2024-05-08T18:07:57.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060054599999999998 2024-05-08T18:07:57.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901779+0000", 2024-05-08T18:07:57.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011452500000000001 2024-05-08T18:07:57.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901850+0000", 2024-05-08T18:07:57.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1580000000000002e-05 2024-05-08T18:07:57.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.164 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.165 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.165 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:612 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.165 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:07:57.165 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.234303492999999, 2024-05-08T18:07:57.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025904750000000001, 2024-05-08T18:07:57.165 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.165 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.165 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.165 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.165 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.165 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.165 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 612 2024-05-08T18:07:57.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.166 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:07:57.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:07:57.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904619+0000", 2024-05-08T18:07:57.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8479999999999999e-06 2024-05-08T18:07:57.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904628+0000", 2024-05-08T18:07:57.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8829999999999995e-06 2024-05-08T18:07:57.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904650+0000", 2024-05-08T18:07:57.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2467999999999999e-05 2024-05-08T18:07:57.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904669+0000", 2024-05-08T18:07:57.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9303000000000001e-05 2024-05-08T18:07:57.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904766+0000", 2024-05-08T18:07:57.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6917999999999996e-05 2024-05-08T18:07:57.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904935+0000", 2024-05-08T18:07:57.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000168441 2024-05-08T18:07:57.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:57.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.905288+0000", 2024-05-08T18:07:57.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035312199999999998 2024-05-08T18:07:57.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.906520+0000", 2024-05-08T18:07:57.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001232005 2024-05-08T18:07:57.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907086+0000", 2024-05-08T18:07:57.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056658900000000005 2024-05-08T18:07:57.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907154+0000", 2024-05-08T18:07:57.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7197000000000001e-05 2024-05-08T18:07:57.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907207+0000", 2024-05-08T18:07:57.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3701e-05 2024-05-08T18:07:57.170 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.170 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.170 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.170 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.170 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:07:57.171 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.0662859, 2024-05-08T18:07:57.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032464490000000002, 2024-05-08T18:07:57.171 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.171 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.171 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.171 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.171 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.171 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.171 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 742 2024-05-08T18:07:57.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.171 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:07:57.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:07:57.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072637+0000", 2024-05-08T18:07:57.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9059999999999998e-06 2024-05-08T18:07:57.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072651+0000", 2024-05-08T18:07:57.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3477e-05 2024-05-08T18:07:57.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072683+0000", 2024-05-08T18:07:57.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2116000000000002e-05 2024-05-08T18:07:57.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072698+0000", 2024-05-08T18:07:57.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5454000000000001e-05 2024-05-08T18:07:57.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072845+0000", 2024-05-08T18:07:57.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146532 2024-05-08T18:07:57.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073241+0000", 2024-05-08T18:07:57.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039580699999999997 2024-05-08T18:07:57.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:57.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073812+0000", 2024-05-08T18:07:57.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057164900000000003 2024-05-08T18:07:57.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075063+0000", 2024-05-08T18:07:57.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001250131 2024-05-08T18:07:57.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075723+0000", 2024-05-08T18:07:57.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00066039199999999999 2024-05-08T18:07:57.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075808+0000", 2024-05-08T18:07:57.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5458999999999996e-05 2024-05-08T18:07:57.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075881+0000", 2024-05-08T18:07:57.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2526000000000003e-05 2024-05-08T18:07:57.175 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.176 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.176 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.176 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.176 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:07:57.176 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.023877535, 2024-05-08T18:07:57.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029270590000000001, 2024-05-08T18:07:57.176 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.176 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.176 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.176 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.176 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.176 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.176 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 760 2024-05-08T18:07:57.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.177 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:07:57.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:07:57.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115045+0000", 2024-05-08T18:07:57.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0729999999999999e-06 2024-05-08T18:07:57.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115057+0000", 2024-05-08T18:07:57.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1617000000000001e-05 2024-05-08T18:07:57.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115088+0000", 2024-05-08T18:07:57.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1155999999999998e-05 2024-05-08T18:07:57.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115103+0000", 2024-05-08T18:07:57.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5067e-05 2024-05-08T18:07:57.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115289+0000", 2024-05-08T18:07:57.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186582 2024-05-08T18:07:57.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115506+0000", 2024-05-08T18:07:57.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021690500000000001 2024-05-08T18:07:57.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:57.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115832+0000", 2024-05-08T18:07:57.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032556799999999998 2024-05-08T18:07:57.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.116892+0000", 2024-05-08T18:07:57.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010597989999999999 2024-05-08T18:07:57.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117807+0000", 2024-05-08T18:07:57.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091502599999999999 2024-05-08T18:07:57.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117895+0000", 2024-05-08T18:07:57.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7977000000000001e-05 2024-05-08T18:07:57.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117970+0000", 2024-05-08T18:07:57.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5289000000000004e-05 2024-05-08T18:07:57.181 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.181 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.181 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.181 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.181 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:07:57.181 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.892880048999999, 2024-05-08T18:07:57.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028290730000000001, 2024-05-08T18:07:57.182 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.182 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.182 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.182 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.182 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.182 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.182 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 817 2024-05-08T18:07:57.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.182 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:07:57.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:07:57.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246043+0000", 2024-05-08T18:07:57.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.807e-06 2024-05-08T18:07:57.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246056+0000", 2024-05-08T18:07:57.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2383e-05 2024-05-08T18:07:57.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246087+0000", 2024-05-08T18:07:57.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1937000000000003e-05 2024-05-08T18:07:57.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246104+0000", 2024-05-08T18:07:57.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6643e-05 2024-05-08T18:07:57.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246225+0000", 2024-05-08T18:07:57.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012061900000000001 2024-05-08T18:07:57.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246510+0000", 2024-05-08T18:07:57.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028507100000000002 2024-05-08T18:07:57.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:57.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246881+0000", 2024-05-08T18:07:57.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037163799999999998 2024-05-08T18:07:57.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248078+0000", 2024-05-08T18:07:57.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011968969999999999 2024-05-08T18:07:57.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248715+0000", 2024-05-08T18:07:57.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063698599999999998 2024-05-08T18:07:57.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248801+0000", 2024-05-08T18:07:57.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5772999999999993e-05 2024-05-08T18:07:57.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248869+0000", 2024-05-08T18:07:57.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8318999999999994e-05 2024-05-08T18:07:57.187 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.187 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.187 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.187 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.187 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:07:57.187 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.839136565, 2024-05-08T18:07:57.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003281693, 2024-05-08T18:07:57.187 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.187 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.187 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.187 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.187 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.188 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.188 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 841 2024-05-08T18:07:57.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.188 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:07:57.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:07:57.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299786+0000", 2024-05-08T18:07:57.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4770000000000002e-06 2024-05-08T18:07:57.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299798+0000", 2024-05-08T18:07:57.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1493e-05 2024-05-08T18:07:57.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299827+0000", 2024-05-08T18:07:57.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9363e-05 2024-05-08T18:07:57.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299842+0000", 2024-05-08T18:07:57.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.448e-05 2024-05-08T18:07:57.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300001+0000", 2024-05-08T18:07:57.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015909600000000001 2024-05-08T18:07:57.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300384+0000", 2024-05-08T18:07:57.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038306000000000001 2024-05-08T18:07:57.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:57.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300929+0000", 2024-05-08T18:07:57.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054551299999999997 2024-05-08T18:07:57.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302151+0000", 2024-05-08T18:07:57.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012218540000000001 2024-05-08T18:07:57.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302918+0000", 2024-05-08T18:07:57.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076719099999999997 2024-05-08T18:07:57.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303000+0000", 2024-05-08T18:07:57.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1662999999999994e-05 2024-05-08T18:07:57.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303065+0000", 2024-05-08T18:07:57.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5502999999999999e-05 2024-05-08T18:07:57.192 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.192 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.192 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.193 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.193 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:07:57.193 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.834941108999999, 2024-05-08T18:07:57.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026179150000000002, 2024-05-08T18:07:57.193 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.193 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.193 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.193 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.193 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.193 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.193 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 843 2024-05-08T18:07:57.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.193 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:07:57.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:07:57.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303981+0000", 2024-05-08T18:07:57.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9740000000000001e-06 2024-05-08T18:07:57.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303990+0000", 2024-05-08T18:07:57.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9889999999999998e-06 2024-05-08T18:07:57.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304012+0000", 2024-05-08T18:07:57.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1537000000000001e-05 2024-05-08T18:07:57.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304023+0000", 2024-05-08T18:07:57.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:07:57.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304101+0000", 2024-05-08T18:07:57.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7732999999999996e-05 2024-05-08T18:07:57.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304210+0000", 2024-05-08T18:07:57.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010985299999999999 2024-05-08T18:07:57.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:57.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304490+0000", 2024-05-08T18:07:57.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000279564 2024-05-08T18:07:57.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.305542+0000", 2024-05-08T18:07:57.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051976 2024-05-08T18:07:57.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306451+0000", 2024-05-08T18:07:57.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00090901999999999997 2024-05-08T18:07:57.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306533+0000", 2024-05-08T18:07:57.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1790000000000001e-05 2024-05-08T18:07:57.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306597+0000", 2024-05-08T18:07:57.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4332999999999995e-05 2024-05-08T18:07:57.198 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.198 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.198 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.198 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.198 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:07:57.198 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.825244899000001, 2024-05-08T18:07:57.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00275537, 2024-05-08T18:07:57.199 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.199 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.199 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.199 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.199 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.199 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.199 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 847 2024-05-08T18:07:57.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.199 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:07:57.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:07:57.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313678+0000", 2024-05-08T18:07:57.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:07:57.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313689+0000", 2024-05-08T18:07:57.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1273e-05 2024-05-08T18:07:57.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313719+0000", 2024-05-08T18:07:57.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9726e-05 2024-05-08T18:07:57.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313733+0000", 2024-05-08T18:07:57.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4487e-05 2024-05-08T18:07:57.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313858+0000", 2024-05-08T18:07:57.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125172 2024-05-08T18:07:57.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314072+0000", 2024-05-08T18:07:57.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021314200000000001 2024-05-08T18:07:57.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:57.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314378+0000", 2024-05-08T18:07:57.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030653100000000002 2024-05-08T18:07:57.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.315524+0000", 2024-05-08T18:07:57.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011458950000000001 2024-05-08T18:07:57.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316213+0000", 2024-05-08T18:07:57.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068942199999999997 2024-05-08T18:07:57.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316314+0000", 2024-05-08T18:07:57.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100723 2024-05-08T18:07:57.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316431+0000", 2024-05-08T18:07:57.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116759 2024-05-08T18:07:57.203 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.204 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.204 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.204 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.204 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:07:57.204 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.821592962, 2024-05-08T18:07:57.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025522510000000002, 2024-05-08T18:07:57.204 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.204 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.204 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.204 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.204 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.204 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.204 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 849 2024-05-08T18:07:57.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.205 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:07:57.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:07:57.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317329+0000", 2024-05-08T18:07:57.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9530000000000002e-06 2024-05-08T18:07:57.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317340+0000", 2024-05-08T18:07:57.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.08e-05 2024-05-08T18:07:57.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317364+0000", 2024-05-08T18:07:57.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4142999999999999e-05 2024-05-08T18:07:57.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317377+0000", 2024-05-08T18:07:57.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2764e-05 2024-05-08T18:07:57.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317471+0000", 2024-05-08T18:07:57.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4289000000000005e-05 2024-05-08T18:07:57.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317600+0000", 2024-05-08T18:07:57.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012910499999999999 2024-05-08T18:07:57.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:57.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317868+0000", 2024-05-08T18:07:57.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000267562 2024-05-08T18:07:57.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319081+0000", 2024-05-08T18:07:57.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001213387 2024-05-08T18:07:57.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319723+0000", 2024-05-08T18:07:57.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064134200000000004 2024-05-08T18:07:57.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319808+0000", 2024-05-08T18:07:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:07:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319880+0000", 2024-05-08T18:07:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1426000000000004e-05 2024-05-08T18:07:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.209 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:07:57.210 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.778160481, 2024-05-08T18:07:57.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002815157, 2024-05-08T18:07:57.210 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.210 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.210 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.210 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.210 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.210 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.210 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 868 2024-05-08T18:07:57.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.210 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:07:57.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:07:57.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360762+0000", 2024-05-08T18:07:57.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:07:57.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360775+0000", 2024-05-08T18:07:57.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2840000000000001e-05 2024-05-08T18:07:57.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360805+0000", 2024-05-08T18:07:57.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9686e-05 2024-05-08T18:07:57.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360819+0000", 2024-05-08T18:07:57.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.434e-05 2024-05-08T18:07:57.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360948+0000", 2024-05-08T18:07:57.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000129033 2024-05-08T18:07:57.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361166+0000", 2024-05-08T18:07:57.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021747800000000001 2024-05-08T18:07:57.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:57.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361481+0000", 2024-05-08T18:07:57.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031515800000000001 2024-05-08T18:07:57.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.362546+0000", 2024-05-08T18:07:57.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010653889999999999 2024-05-08T18:07:57.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363365+0000", 2024-05-08T18:07:57.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081906100000000005 2024-05-08T18:07:57.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363450+0000", 2024-05-08T18:07:57.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5202000000000002e-05 2024-05-08T18:07:57.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363575+0000", 2024-05-08T18:07:57.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012460999999999999 2024-05-08T18:07:57.215 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.215 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.215 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.215 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.215 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:07:57.215 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.774468307999999, 2024-05-08T18:07:57.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024676260000000001, 2024-05-08T18:07:57.215 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.215 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.215 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.215 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.216 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.216 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.216 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 870 2024-05-08T18:07:57.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.216 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:07:57.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:07:57.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364454+0000", 2024-05-08T18:07:57.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7770000000000001e-06 2024-05-08T18:07:57.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364463+0000", 2024-05-08T18:07:57.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4800000000000007e-06 2024-05-08T18:07:57.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364487+0000", 2024-05-08T18:07:57.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3589999999999999e-05 2024-05-08T18:07:57.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364499+0000", 2024-05-08T18:07:57.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.241e-05 2024-05-08T18:07:57.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364607+0000", 2024-05-08T18:07:57.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010760900000000001 2024-05-08T18:07:57.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364750+0000", 2024-05-08T18:07:57.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014265600000000001 2024-05-08T18:07:57.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:57.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.365021+0000", 2024-05-08T18:07:57.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027115100000000002 2024-05-08T18:07:57.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366163+0000", 2024-05-08T18:07:57.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011419189999999999 2024-05-08T18:07:57.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366727+0000", 2024-05-08T18:07:57.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056400199999999997 2024-05-08T18:07:57.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366810+0000", 2024-05-08T18:07:57.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3133000000000005e-05 2024-05-08T18:07:57.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366920+0000", 2024-05-08T18:07:57.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109899 2024-05-08T18:07:57.220 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.220 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.220 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.221 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.221 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:07:57.221 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.684554129999999, 2024-05-08T18:07:57.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027893459999999998, 2024-05-08T18:07:57.221 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.221 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.221 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.221 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.221 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.221 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.221 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 907 2024-05-08T18:07:57.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.221 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:07:57.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:07:57.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454369+0000", 2024-05-08T18:07:57.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5730000000000002e-06 2024-05-08T18:07:57.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454381+0000", 2024-05-08T18:07:57.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.208e-05 2024-05-08T18:07:57.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454413+0000", 2024-05-08T18:07:57.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2493000000000002e-05 2024-05-08T18:07:57.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454432+0000", 2024-05-08T18:07:57.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8862999999999999e-05 2024-05-08T18:07:57.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454577+0000", 2024-05-08T18:07:57.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014477899999999999 2024-05-08T18:07:57.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454800+0000", 2024-05-08T18:07:57.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223425 2024-05-08T18:07:57.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:57.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.455168+0000", 2024-05-08T18:07:57.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036712799999999999 2024-05-08T18:07:57.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456282+0000", 2024-05-08T18:07:57.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011141580000000001 2024-05-08T18:07:57.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456953+0000", 2024-05-08T18:07:57.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000670956 2024-05-08T18:07:57.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457038+0000", 2024-05-08T18:07:57.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4828999999999997e-05 2024-05-08T18:07:57.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457156+0000", 2024-05-08T18:07:57.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118062 2024-05-08T18:07:57.226 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.226 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.226 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.226 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.226 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:07:57.226 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.680861767, 2024-05-08T18:07:57.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026891609999999998, 2024-05-08T18:07:57.227 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.227 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.227 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.227 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.227 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.227 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.227 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 909 2024-05-08T18:07:57.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.227 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:07:57.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:07:57.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458060+0000", 2024-05-08T18:07:57.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:07:57.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458069+0000", 2024-05-08T18:07:57.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6440000000000006e-06 2024-05-08T18:07:57.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458090+0000", 2024-05-08T18:07:57.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1089000000000001e-05 2024-05-08T18:07:57.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458102+0000", 2024-05-08T18:07:57.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2306999999999999e-05 2024-05-08T18:07:57.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458191+0000", 2024-05-08T18:07:57.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8213000000000004e-05 2024-05-08T18:07:57.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458313+0000", 2024-05-08T18:07:57.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012231500000000001 2024-05-08T18:07:57.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:07:57.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458581+0000", 2024-05-08T18:07:57.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026762500000000001 2024-05-08T18:07:57.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.459773+0000", 2024-05-08T18:07:57.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001192991 2024-05-08T18:07:57.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460590+0000", 2024-05-08T18:07:57.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081618100000000002 2024-05-08T18:07:57.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460681+0000", 2024-05-08T18:07:57.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0946000000000006e-05 2024-05-08T18:07:57.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460748+0000", 2024-05-08T18:07:57.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7139999999999998e-05 2024-05-08T18:07:57.232 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.232 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.232 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.232 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.232 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:07:57.232 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.587218749000002, 2024-05-08T18:07:57.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030359179999999999, 2024-05-08T18:07:57.232 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.232 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.232 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.233 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.233 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.233 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.233 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 949 2024-05-08T18:07:57.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.233 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:07:57.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:07:57.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551705+0000", 2024-05-08T18:07:57.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2770000000000001e-06 2024-05-08T18:07:57.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551717+0000", 2024-05-08T18:07:57.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.206e-05 2024-05-08T18:07:57.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551747+0000", 2024-05-08T18:07:57.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0168999999999999e-05 2024-05-08T18:07:57.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551763+0000", 2024-05-08T18:07:57.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:07:57.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551880+0000", 2024-05-08T18:07:57.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116976 2024-05-08T18:07:57.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552099+0000", 2024-05-08T18:07:57.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021910199999999999 2024-05-08T18:07:57.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:57.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552476+0000", 2024-05-08T18:07:57.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000376697 2024-05-08T18:07:57.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.553551+0000", 2024-05-08T18:07:57.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001074925 2024-05-08T18:07:57.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554588+0000", 2024-05-08T18:07:57.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010374099999999999 2024-05-08T18:07:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554671+0000", 2024-05-08T18:07:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3368999999999994e-05 2024-05-08T18:07:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554738+0000", 2024-05-08T18:07:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6043000000000004e-05 2024-05-08T18:07:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:07:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.573605311000001, 2024-05-08T18:07:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028304160000000001, 2024-05-08T18:07:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 955 2024-05-08T18:07:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:07:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:07:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565318+0000", 2024-05-08T18:07:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7030000000000002e-06 2024-05-08T18:07:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565330+0000", 2024-05-08T18:07:57.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.204e-05 2024-05-08T18:07:57.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565363+0000", 2024-05-08T18:07:57.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2722999999999998e-05 2024-05-08T18:07:57.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565389+0000", 2024-05-08T18:07:57.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6412999999999999e-05 2024-05-08T18:07:57.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565510+0000", 2024-05-08T18:07:57.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120932 2024-05-08T18:07:57.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565722+0000", 2024-05-08T18:07:57.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212139 2024-05-08T18:07:57.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:57.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.566034+0000", 2024-05-08T18:07:57.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000312038 2024-05-08T18:07:57.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567340+0000", 2024-05-08T18:07:57.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00130547 2024-05-08T18:07:57.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567998+0000", 2024-05-08T18:07:57.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000658382 2024-05-08T18:07:57.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568081+0000", 2024-05-08T18:07:57.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3269999999999994e-05 2024-05-08T18:07:57.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568145+0000", 2024-05-08T18:07:57.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4306000000000004e-05 2024-05-08T18:07:57.243 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.243 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.243 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.243 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.243 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:07:57.243 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.569885788000001, 2024-05-08T18:07:57.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027506660000000001, 2024-05-08T18:07:57.243 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.243 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.243 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.243 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.243 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.244 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.244 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 957 2024-05-08T18:07:57.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.244 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:07:57.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:07:57.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569036+0000", 2024-05-08T18:07:57.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.776e-06 2024-05-08T18:07:57.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569061+0000", 2024-05-08T18:07:57.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5097e-05 2024-05-08T18:07:57.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569084+0000", 2024-05-08T18:07:57.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.23e-05 2024-05-08T18:07:57.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569096+0000", 2024-05-08T18:07:57.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.22e-05 2024-05-08T18:07:57.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569180+0000", 2024-05-08T18:07:57.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4369000000000005e-05 2024-05-08T18:07:57.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569296+0000", 2024-05-08T18:07:57.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115999 2024-05-08T18:07:57.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:07:57.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569550+0000", 2024-05-08T18:07:57.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025397499999999998 2024-05-08T18:07:57.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.570963+0000", 2024-05-08T18:07:57.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001413023 2024-05-08T18:07:57.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571614+0000", 2024-05-08T18:07:57.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065041199999999995 2024-05-08T18:07:57.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571701+0000", 2024-05-08T18:07:57.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7569000000000001e-05 2024-05-08T18:07:57.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571785+0000", 2024-05-08T18:07:57.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3945999999999999e-05 2024-05-08T18:07:57.248 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.248 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.248 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.248 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.248 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.248 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:57.250 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:07:57.250 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:57.249+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:57.351 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:57.351+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:57.419 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:57.420 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:57.420 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:07:57.420 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:57.434 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:07:57.452 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:57.451+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:57.552 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:57.553+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:07:57.557 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:57.557 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:07:57.557 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:07:57.557 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:07:57.557 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:57.571 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:07:57.654 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:07:57.651+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:07:57.742 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:07:57.743 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:07:57.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:07:57.743 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:07:57.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.743 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:07:57.743 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:07:57.743 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.190832868999998, 2024-05-08T18:07:57.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049710090000000002, 2024-05-08T18:07:57.743 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.743 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.744 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-08T18:07:57.744 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.744 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.744 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.744 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 44 2024-05-08T18:07:57.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.744 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:07:57.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:07:57.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552775+0000", 2024-05-08T18:07:57.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4450000000000001e-06 2024-05-08T18:07:57.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552790+0000", 2024-05-08T18:07:57.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4363e-05 2024-05-08T18:07:57.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552820+0000", 2024-05-08T18:07:57.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0485999999999999e-05 2024-05-08T18:07:57.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552843+0000", 2024-05-08T18:07:57.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2985000000000001e-05 2024-05-08T18:07:57.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554350+0000", 2024-05-08T18:07:57.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015065149999999999 2024-05-08T18:07:57.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-08T18:07:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554374+0000", 2024-05-08T18:07:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4097e-05 2024-05-08T18:07:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557531+0000", 2024-05-08T18:07:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031567169999999999 2024-05-08T18:07:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557743+0000", 2024-05-08T18:07:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212401 2024-05-08T18:07:57.747 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:07:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:07:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.155480992000001, 2024-05-08T18:07:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050241879999999997, 2024-05-08T18:07:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.748 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 58 2024-05-08T18:07:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:07:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:07:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588125+0000", 2024-05-08T18:07:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1399999999999995e-07 2024-05-08T18:07:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588129+0000", 2024-05-08T18:07:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6779999999999999e-06 2024-05-08T18:07:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588142+0000", 2024-05-08T18:07:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3047999999999999e-05 2024-05-08T18:07:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588174+0000", 2024-05-08T18:07:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1270999999999999e-05 2024-05-08T18:07:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588307+0000", 2024-05-08T18:07:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013307600000000001 2024-05-08T18:07:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588477+0000", 2024-05-08T18:07:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000170213 2024-05-08T18:07:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:07:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588669+0000", 2024-05-08T18:07:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019211599999999999 2024-05-08T18:07:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.590228+0000", 2024-05-08T18:07:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015590059999999999 2024-05-08T18:07:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593029+0000", 2024-05-08T18:07:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028006400000000001 2024-05-08T18:07:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593099+0000", 2024-05-08T18:07:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0300000000000001e-05 2024-05-08T18:07:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593148+0000", 2024-05-08T18:07:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8925999999999999e-05 2024-05-08T18:07:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.753 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:07:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:07:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 31.158942832000001, 2024-05-08T18:07:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00385587, 2024-05-08T18:07:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207 2024-05-08T18:07:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:07:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:07:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584665+0000", 2024-05-08T18:07:57.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0570000000000001e-06 2024-05-08T18:07:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584679+0000", 2024-05-08T18:07:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3713000000000001e-05 2024-05-08T18:07:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584712+0000", 2024-05-08T18:07:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3213999999999997e-05 2024-05-08T18:07:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584728+0000", 2024-05-08T18:07:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5936000000000001e-05 2024-05-08T18:07:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584951+0000", 2024-05-08T18:07:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000222955 2024-05-08T18:07:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585196+0000", 2024-05-08T18:07:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024550800000000002 2024-05-08T18:07:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585643+0000", 2024-05-08T18:07:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00044644699999999999 2024-05-08T18:07:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.587110+0000", 2024-05-08T18:07:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001467323 2024-05-08T18:07:57.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588371+0000", 2024-05-08T18:07:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012607180000000001 2024-05-08T18:07:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588452+0000", 2024-05-08T18:07:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1216000000000003e-05 2024-05-08T18:07:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588518+0000", 2024-05-08T18:07:57.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5783000000000004e-05 2024-05-08T18:07:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:07:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 31.112767430000002, 2024-05-08T18:07:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003249994, 2024-05-08T18:07:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.761 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216 2024-05-08T18:07:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:07:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:07:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630840+0000", 2024-05-08T18:07:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0730000000000001e-06 2024-05-08T18:07:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630854+0000", 2024-05-08T18:07:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3360000000000001e-05 2024-05-08T18:07:57.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630889+0000", 2024-05-08T18:07:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5176999999999999e-05 2024-05-08T18:07:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630911+0000", 2024-05-08T18:07:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.247e-05 2024-05-08T18:07:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631046+0000", 2024-05-08T18:07:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013484599999999999 2024-05-08T18:07:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631272+0000", 2024-05-08T18:07:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000225694 2024-05-08T18:07:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631703+0000", 2024-05-08T18:07:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000431144 2024-05-08T18:07:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633244+0000", 2024-05-08T18:07:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001540622 2024-05-08T18:07:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633926+0000", 2024-05-08T18:07:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068244200000000001 2024-05-08T18:07:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634019+0000", 2024-05-08T18:07:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3148999999999999e-05 2024-05-08T18:07:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634087+0000", 2024-05-08T18:07:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8016999999999996e-05 2024-05-08T18:07:57.767 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:07:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 31.071223380999999, 2024-05-08T18:07:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003119854, 2024-05-08T18:07:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.768 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 227 2024-05-08T18:07:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:07:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:07:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672384+0000", 2024-05-08T18:07:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7470000000000001e-06 2024-05-08T18:07:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672396+0000", 2024-05-08T18:07:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.154e-05 2024-05-08T18:07:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672427+0000", 2024-05-08T18:07:57.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1676e-05 2024-05-08T18:07:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672443+0000", 2024-05-08T18:07:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5214e-05 2024-05-08T18:07:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672563+0000", 2024-05-08T18:07:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120535 2024-05-08T18:07:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672778+0000", 2024-05-08T18:07:57.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021446200000000001 2024-05-08T18:07:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.673205+0000", 2024-05-08T18:07:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042750699999999998 2024-05-08T18:07:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.674848+0000", 2024-05-08T18:07:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016432980000000001 2024-05-08T18:07:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675346+0000", 2024-05-08T18:07:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049711999999999998 2024-05-08T18:07:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675432+0000", 2024-05-08T18:07:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6798999999999993e-05 2024-05-08T18:07:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675501+0000", 2024-05-08T18:07:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8955999999999995e-05 2024-05-08T18:07:57.774 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:07:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 31.064282594000002, 2024-05-08T18:07:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034322110000000001, 2024-05-08T18:07:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.775 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 229 2024-05-08T18:07:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:07:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:07:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679325+0000", 2024-05-08T18:07:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:07:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679339+0000", 2024-05-08T18:07:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:07:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679370+0000", 2024-05-08T18:07:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0280000000000001e-05 2024-05-08T18:07:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679385+0000", 2024-05-08T18:07:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5026e-05 2024-05-08T18:07:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679504+0000", 2024-05-08T18:07:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119023 2024-05-08T18:07:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679711+0000", 2024-05-08T18:07:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020705499999999999 2024-05-08T18:07:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.680115+0000", 2024-05-08T18:07:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040396699999999998 2024-05-08T18:07:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.681424+0000", 2024-05-08T18:07:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001309387 2024-05-08T18:07:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682488+0000", 2024-05-08T18:07:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010642519999999999 2024-05-08T18:07:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682640+0000", 2024-05-08T18:07:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015123599999999999 2024-05-08T18:07:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682754+0000", 2024-05-08T18:07:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011482200000000001 2024-05-08T18:07:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:07:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 31.056898385, 2024-05-08T18:07:57.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033353329999999998, 2024-05-08T18:07:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 231 2024-05-08T18:07:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:07:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:07:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686709+0000", 2024-05-08T18:07:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4729999999999999e-06 2024-05-08T18:07:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686720+0000", 2024-05-08T18:07:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1157e-05 2024-05-08T18:07:57.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686750+0000", 2024-05-08T18:07:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0417e-05 2024-05-08T18:07:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686765+0000", 2024-05-08T18:07:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.487e-05 2024-05-08T18:07:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686872+0000", 2024-05-08T18:07:57.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010703499999999999 2024-05-08T18:07:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687085+0000", 2024-05-08T18:07:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021279599999999999 2024-05-08T18:07:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687501+0000", 2024-05-08T18:07:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041554 2024-05-08T18:07:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.688886+0000", 2024-05-08T18:07:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00138565 2024-05-08T18:07:57.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689899+0000", 2024-05-08T18:07:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010128190000000001 2024-05-08T18:07:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689978+0000", 2024-05-08T18:07:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8490000000000002e-05 2024-05-08T18:07:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.690042+0000", 2024-05-08T18:07:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4085999999999996e-05 2024-05-08T18:07:57.785 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:394 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:07:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.999825307999998, 2024-05-08T18:07:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034384960000000001, 2024-05-08T18:07:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.786 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 394 2024-05-08T18:07:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:07:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:07:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743781+0000", 2024-05-08T18:07:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3e-06 2024-05-08T18:07:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743788+0000", 2024-05-08T18:07:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7399999999999998e-06 2024-05-08T18:07:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743801+0000", 2024-05-08T18:07:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3757000000000001e-05 2024-05-08T18:07:57.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743808+0000", 2024-05-08T18:07:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6579999999999996e-06 2024-05-08T18:07:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743875+0000", 2024-05-08T18:07:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6740000000000001e-05 2024-05-08T18:07:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743971+0000", 2024-05-08T18:07:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6175000000000007e-05 2024-05-08T18:07:57.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744100+0000", 2024-05-08T18:07:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012954899999999999 2024-05-08T18:07:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744863+0000", 2024-05-08T18:07:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076300100000000002 2024-05-08T18:07:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747089+0000", 2024-05-08T18:07:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022258540000000002 2024-05-08T18:07:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747162+0000", 2024-05-08T18:07:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2632000000000005e-05 2024-05-08T18:07:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747218+0000", 2024-05-08T18:07:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.609e-05 2024-05-08T18:07:57.791 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:535 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:07:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.902112231, 2024-05-08T18:07:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055640899999999998, 2024-05-08T18:07:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.792 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 535 2024-05-08T18:07:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:07:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:07:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841494+0000", 2024-05-08T18:07:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0899999999999999e-06 2024-05-08T18:07:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841500+0000", 2024-05-08T18:07:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0249999999999999e-06 2024-05-08T18:07:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841513+0000", 2024-05-08T18:07:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3658e-05 2024-05-08T18:07:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841522+0000", 2024-05-08T18:07:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3410000000000003e-06 2024-05-08T18:07:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841574+0000", 2024-05-08T18:07:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2794000000000003e-05 2024-05-08T18:07:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841633+0000", 2024-05-08T18:07:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8595999999999999e-05 2024-05-08T18:07:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841755+0000", 2024-05-08T18:07:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012227399999999999 2024-05-08T18:07:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.842349+0000", 2024-05-08T18:07:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00059377699999999998 2024-05-08T18:07:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.846949+0000", 2024-05-08T18:07:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004599723 2024-05-08T18:07:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847008+0000", 2024-05-08T18:07:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8854999999999998e-05 2024-05-08T18:07:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847057+0000", 2024-05-08T18:07:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8956999999999999e-05 2024-05-08T18:07:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:541 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:07:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.895082701, 2024-05-08T18:07:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037829790000000001, 2024-05-08T18:07:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 541 2024-05-08T18:07:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:07:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:07:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848523+0000", 2024-05-08T18:07:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8599999999999997e-07 2024-05-08T18:07:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848526+0000", 2024-05-08T18:07:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4690000000000002e-06 2024-05-08T18:07:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848536+0000", 2024-05-08T18:07:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2029999999999998e-06 2024-05-08T18:07:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848540+0000", 2024-05-08T18:07:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9169999999999997e-06 2024-05-08T18:07:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848591+0000", 2024-05-08T18:07:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0328000000000003e-05 2024-05-08T18:07:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848646+0000", 2024-05-08T18:07:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5281999999999997e-05 2024-05-08T18:07:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848759+0000", 2024-05-08T18:07:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011278899999999999 2024-05-08T18:07:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.849323+0000", 2024-05-08T18:07:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056433999999999998 2024-05-08T18:07:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852225+0000", 2024-05-08T18:07:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029017320000000002 2024-05-08T18:07:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852277+0000", 2024-05-08T18:07:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2460999999999998e-05 2024-05-08T18:07:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852305+0000", 2024-05-08T18:07:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7671999999999999e-05 2024-05-08T18:07:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:07:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.761935623999999, 2024-05-08T18:07:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002973084, 2024-05-08T18:07:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 703 2024-05-08T18:07:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:07:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:07:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981672+0000", 2024-05-08T18:07:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5799999999999999e-06 2024-05-08T18:07:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981683+0000", 2024-05-08T18:07:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1270000000000001e-05 2024-05-08T18:07:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981715+0000", 2024-05-08T18:07:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1470000000000002e-05 2024-05-08T18:07:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981730+0000", 2024-05-08T18:07:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5262999999999999e-05 2024-05-08T18:07:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981864+0000", 2024-05-08T18:07:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134043 2024-05-08T18:07:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982168+0000", 2024-05-08T18:07:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030453799999999998 2024-05-08T18:07:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982620+0000", 2024-05-08T18:07:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045170900000000001 2024-05-08T18:07:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.983648+0000", 2024-05-08T18:07:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010276009999999999 2024-05-08T18:07:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984486+0000", 2024-05-08T18:07:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083874600000000002 2024-05-08T18:07:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984571+0000", 2024-05-08T18:07:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4370999999999996e-05 2024-05-08T18:07:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984642+0000", 2024-05-08T18:07:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1493000000000001e-05 2024-05-08T18:07:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:789 6.0 e32/26 6:0216b5b6:::obj_delete_at_hint.0000000070:head v 32'14, mlcod=32'12)", 2024-05-08T18:07:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:07:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.562508851, 2024-05-08T18:07:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034621420000000001, 2024-05-08T18:07:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:07:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:07:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181098+0000", 2024-05-08T18:07:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8029999999999999e-06 2024-05-08T18:07:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181109+0000", 2024-05-08T18:07:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1219999999999999e-05 2024-05-08T18:07:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181138+0000", 2024-05-08T18:07:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.898e-05 2024-05-08T18:07:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181151+0000", 2024-05-08T18:07:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.308e-05 2024-05-08T18:07:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181268+0000", 2024-05-08T18:07:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116629 2024-05-08T18:07:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181321+0000", 2024-05-08T18:07:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3325999999999997e-05 2024-05-08T18:07:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184477+0000", 2024-05-08T18:07:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003156458 2024-05-08T18:07:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184558+0000", 2024-05-08T18:07:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0646e-05 2024-05-08T18:07:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:07:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.531335346999999, 2024-05-08T18:07:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031146310000000001, 2024-05-08T18:07:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 802 2024-05-08T18:07:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:07:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:07:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212272+0000", 2024-05-08T18:07:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.943e-06 2024-05-08T18:07:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212284+0000", 2024-05-08T18:07:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1747e-05 2024-05-08T18:07:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212315+0000", 2024-05-08T18:07:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0579e-05 2024-05-08T18:07:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212336+0000", 2024-05-08T18:07:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1639999999999999e-05 2024-05-08T18:07:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212488+0000", 2024-05-08T18:07:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151192 2024-05-08T18:07:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212703+0000", 2024-05-08T18:07:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000215439 2024-05-08T18:07:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.213033+0000", 2024-05-08T18:07:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032992699999999999 2024-05-08T18:07:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.214306+0000", 2024-05-08T18:07:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012726949999999999 2024-05-08T18:07:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215232+0000", 2024-05-08T18:07:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092652999999999995 2024-05-08T18:07:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215321+0000", 2024-05-08T18:07:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9272999999999997e-05 2024-05-08T18:07:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215384+0000", 2024-05-08T18:07:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2665999999999999e-05 2024-05-08T18:07:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:07:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.450790941000001, 2024-05-08T18:07:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030150250000000002, 2024-05-08T18:07:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 838 2024-05-08T18:07:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:07:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:07:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292816+0000", 2024-05-08T18:07:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:07:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292828+0000", 2024-05-08T18:07:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.184e-05 2024-05-08T18:07:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292857+0000", 2024-05-08T18:07:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8960000000000001e-05 2024-05-08T18:07:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292871+0000", 2024-05-08T18:07:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.45e-05 2024-05-08T18:07:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293000+0000", 2024-05-08T18:07:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128875 2024-05-08T18:07:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293231+0000", 2024-05-08T18:07:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023030500000000001 2024-05-08T18:07:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293563+0000", 2024-05-08T18:07:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000332648 2024-05-08T18:07:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.294882+0000", 2024-05-08T18:07:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001319183 2024-05-08T18:07:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295664+0000", 2024-05-08T18:07:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000781991 2024-05-08T18:07:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295754+0000", 2024-05-08T18:07:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9176000000000001e-05 2024-05-08T18:07:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295829+0000", 2024-05-08T18:07:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.525e-05 2024-05-08T18:07:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:07:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.389657272000001, 2024-05-08T18:07:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029338929999999999, 2024-05-08T18:07:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 865 2024-05-08T18:07:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:07:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:07:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353950+0000", 2024-05-08T18:07:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2469999999999998e-06 2024-05-08T18:07:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353961+0000", 2024-05-08T18:07:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1523e-05 2024-05-08T18:07:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353991+0000", 2024-05-08T18:07:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9920000000000002e-05 2024-05-08T18:07:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354013+0000", 2024-05-08T18:07:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1590000000000002e-05 2024-05-08T18:07:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354206+0000", 2024-05-08T18:07:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019273900000000001 2024-05-08T18:07:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354418+0000", 2024-05-08T18:07:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212518 2024-05-08T18:07:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354720+0000", 2024-05-08T18:07:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030151800000000002 2024-05-08T18:07:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.355983+0000", 2024-05-08T18:07:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012636780000000001 2024-05-08T18:07:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356733+0000", 2024-05-08T18:07:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074988400000000003 2024-05-08T18:07:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356819+0000", 2024-05-08T18:07:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5690000000000001e-05 2024-05-08T18:07:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356881+0000", 2024-05-08T18:07:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2586e-05 2024-05-08T18:07:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:07:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.376533906999999, 2024-05-08T18:07:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004954511, 2024-05-08T18:07:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 871 2024-05-08T18:07:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:07:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:07:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367073+0000", 2024-05-08T18:07:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2340000000000001e-06 2024-05-08T18:07:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367085+0000", 2024-05-08T18:07:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1483e-05 2024-05-08T18:07:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367111+0000", 2024-05-08T18:07:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5890000000000001e-05 2024-05-08T18:07:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367130+0000", 2024-05-08T18:07:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9700000000000001e-05 2024-05-08T18:07:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367284+0000", 2024-05-08T18:07:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015411799999999999 2024-05-08T18:07:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367516+0000", 2024-05-08T18:07:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000231272 2024-05-08T18:07:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367837+0000", 2024-05-08T18:07:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032173400000000001 2024-05-08T18:07:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371395+0000", 2024-05-08T18:07:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035574719999999999 2024-05-08T18:07:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371882+0000", 2024-05-08T18:07:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048693899999999998 2024-05-08T18:07:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371962+0000", 2024-05-08T18:07:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.975e-05 2024-05-08T18:07:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372025+0000", 2024-05-08T18:07:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3918999999999996e-05 2024-05-08T18:07:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:07:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.370646203, 2024-05-08T18:07:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045233640000000002, 2024-05-08T18:07:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 873 2024-05-08T18:07:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:07:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:07:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372961+0000", 2024-05-08T18:07:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:07:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372969+0000", 2024-05-08T18:07:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2940000000000006e-06 2024-05-08T18:07:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372991+0000", 2024-05-08T18:07:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1829000000000001e-05 2024-05-08T18:07:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373009+0000", 2024-05-08T18:07:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8607e-05 2024-05-08T18:07:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373127+0000", 2024-05-08T18:07:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011728899999999999 2024-05-08T18:07:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373260+0000", 2024-05-08T18:07:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013301200000000001 2024-05-08T18:07:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:07:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373526+0000", 2024-05-08T18:07:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026613500000000003 2024-05-08T18:07:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.374558+0000", 2024-05-08T18:07:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001032156 2024-05-08T18:07:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377333+0000", 2024-05-08T18:07:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027749329999999998 2024-05-08T18:07:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377421+0000", 2024-05-08T18:07:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8679999999999998e-05 2024-05-08T18:07:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377482+0000", 2024-05-08T18:07:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0538999999999998e-05 2024-05-08T18:07:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:07:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.311037048999999, 2024-05-08T18:07:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035261009999999998, 2024-05-08T18:07:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 898 2024-05-08T18:07:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:07:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:07:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432570+0000", 2024-05-08T18:07:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.26e-06 2024-05-08T18:07:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432580+0000", 2024-05-08T18:07:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8570000000000007e-06 2024-05-08T18:07:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432605+0000", 2024-05-08T18:07:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5273e-05 2024-05-08T18:07:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432618+0000", 2024-05-08T18:07:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2999999999999999e-05 2024-05-08T18:07:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432742+0000", 2024-05-08T18:07:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012369200000000001 2024-05-08T18:07:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433109+0000", 2024-05-08T18:07:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036760500000000002 2024-05-08T18:07:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433645+0000", 2024-05-08T18:07:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053599599999999996 2024-05-08T18:07:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435050+0000", 2024-05-08T18:07:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001404696 2024-05-08T18:07:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435834+0000", 2024-05-08T18:07:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078381100000000003 2024-05-08T18:07:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435984+0000", 2024-05-08T18:07:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015006899999999999 2024-05-08T18:07:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.436094+0000", 2024-05-08T18:07:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109842 2024-05-08T18:07:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:07:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.3062842, 2024-05-08T18:07:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031481899999999999, 2024-05-08T18:07:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 900 2024-05-08T18:07:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:07:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:07:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437323+0000", 2024-05-08T18:07:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.447e-06 2024-05-08T18:07:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437334+0000", 2024-05-08T18:07:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0835999999999999e-05 2024-05-08T18:07:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437364+0000", 2024-05-08T18:07:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0463999999999998e-05 2024-05-08T18:07:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437379+0000", 2024-05-08T18:07:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4806e-05 2024-05-08T18:07:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437500+0000", 2024-05-08T18:07:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121309 2024-05-08T18:07:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437729+0000", 2024-05-08T18:07:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022818200000000001 2024-05-08T18:07:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:07:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.438199+0000", 2024-05-08T18:07:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047025300000000001 2024-05-08T18:07:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.439418+0000", 2024-05-08T18:07:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012193849999999999 2024-05-08T18:07:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440217+0000", 2024-05-08T18:07:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00079905999999999998 2024-05-08T18:07:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440352+0000", 2024-05-08T18:07:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013485299999999999 2024-05-08T18:07:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440469+0000", 2024-05-08T18:07:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116595 2024-05-08T18:07:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:07:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:07:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.220048195, 2024-05-08T18:07:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003477894, 2024-05-08T18:07:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:07:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:07:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:07:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:07:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:07:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:07:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 937 2024-05-08T18:07:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:07:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:07:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:07:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:07:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:07:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:07:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:07:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523559+0000", 2024-05-08T18:07:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.95e-06 2024-05-08T18:07:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:07:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523567+0000", 2024-05-08T18:07:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6799999999999999e-06 2024-05-08T18:07:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:07:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523591+0000", 2024-05-08T18:07:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3269e-05 2024-05-08T18:07:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:07:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523611+0000", 2024-05-08T18:07:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0100000000000001e-05 2024-05-08T18:07:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:07:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523767+0000", 2024-05-08T18:07:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015604900000000001 2024-05-08T18:07:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:07:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523994+0000", 2024-05-08T18:07:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022764199999999999 2024-05-08T18:07:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:07:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.524338+0000", 2024-05-08T18:07:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034388700000000002 2024-05-08T18:07:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:07:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.525707+0000", 2024-05-08T18:07:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001368544 2024-05-08T18:07:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:07:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526843+0000", 2024-05-08T18:07:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001136501 2024-05-08T18:07:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:07:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526957+0000", 2024-05-08T18:07:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011359 2024-05-08T18:07:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:07:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:07:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:07:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.527035+0000", 2024-05-08T18:07:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7682000000000006e-05 2024-05-08T18:07:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:07:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:07:57.863 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:07:57.865 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:07:57.865 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:57.863+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:57.966 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:57.965+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:57.979 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:07:57.997 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:07:57.997 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:07:57.997 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:07:57.998 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:07:58.013 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:07:58.067 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:58.063+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:58.128 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:07:58.129 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:07:58.129 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:07:58.129 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:07:58.129 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:07:58.134 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:07:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:07:58.142 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:07:58.151 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:07:58.151 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:07:58.167 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:07:58.167 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:07:58.183 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:58.183+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:58.184 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:07:58.184 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:07:58.204 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:07:58.205 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:07:58.224 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:07:58.224 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:07:58.242 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:07:58.243 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:07:58.262 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:07:58.263 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:07:58.268 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:58.267+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:58.301 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:58.301 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:58.315 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:07:58.387 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:07:58.407 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:07:58.407+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:07:58.470 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:58.469+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:58.482 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:58.483 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:58.496 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:07:58.587 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:58.587+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:58.662 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:58.663 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:58.671 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:07:58.673+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:07:58.677 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:07:58.772 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:58.773+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:58.837 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:58.837 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:58.851 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:07:58.873 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:58.873+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:58.973 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:58.973 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:58.974 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:58.973+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:58.987 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:07:59.075 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:07:59.071+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:07:59.110 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:59.110 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:59.123 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:07:59.176 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:59.177+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:59.276 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:59.275+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:59.291 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:59.291 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:59.305 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:07:59.377 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:59.377+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:59.386 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-05-08T18:07:59.474 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:59.474 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:59.478 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:59.481+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:59.488 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:07:59.580 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:07:59.581+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:07:59.611 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:59.611 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:59.625 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:07:59.681 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:07:59.681+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:07:59.748 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:59.748 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:59.762 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:07:59.781 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:07:59.779+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:07:59.882 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:07:59.882+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:07:59.895 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:07:59.896 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:07:59.910 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:07:59.983 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:07:59.985+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:00.032 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:00.032 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:00.047 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:08:00.095 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:00.097+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:00.185 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:00.182+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:00.215 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:00.215 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:00.229 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:08:00.281 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:08:00.327 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:00.329+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:00.357 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:00.358 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:00.373 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:08:00.386 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:00.382+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:00.427 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:00.428 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:00.444 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:00.445 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:00.462 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:00.462 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:00.479 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:00.487 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:00.489+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:00.500 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:00.500 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:00.521 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:00.529 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:00.529 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:00.541 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:00.541 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:00.543 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:08:00.562 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:00.563 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:00.587 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:00.582+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:00.681 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:00.681 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:00.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:00.681 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:00.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.681 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:00.681 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:00.682 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.112445672, 2024-05-08T18:08:00.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035750999999999999, 2024-05-08T18:08:00.682 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.682 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.682 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.682 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:00.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:00.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570203+0000", 2024-05-08T18:08:00.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6749999999999996e-06 2024-05-08T18:08:00.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570213+0000", 2024-05-08T18:08:00.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0139999999999999e-05 2024-05-08T18:08:00.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570231+0000", 2024-05-08T18:08:00.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8402000000000001e-05 2024-05-08T18:08:00.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570245+0000", 2024-05-08T18:08:00.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3135e-05 2024-05-08T18:08:00.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570338+0000", 2024-05-08T18:08:00.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3498000000000005e-05 2024-05-08T18:08:00.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570373+0000", 2024-05-08T18:08:00.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5179999999999999e-05 2024-05-08T18:08:00.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573694+0000", 2024-05-08T18:08:00.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003320524 2024-05-08T18:08:00.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573771+0000", 2024-05-08T18:08:00.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7546000000000006e-05 2024-05-08T18:08:00.685 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.686 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.686 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.686 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-05-08T18:08:00.686 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:00.686 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.107132710000002, 2024-05-08T18:08:00.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038280229999999998, 2024-05-08T18:08:00.686 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.686 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.686 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.686 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:00.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:00.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575510+0000", 2024-05-08T18:08:00.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0979999999999999e-06 2024-05-08T18:08:00.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575527+0000", 2024-05-08T18:08:00.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6393999999999999e-05 2024-05-08T18:08:00.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575549+0000", 2024-05-08T18:08:00.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1843000000000001e-05 2024-05-08T18:08:00.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575560+0000", 2024-05-08T18:08:00.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.186e-05 2024-05-08T18:08:00.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575651+0000", 2024-05-08T18:08:00.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1068000000000003e-05 2024-05-08T18:08:00.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575685+0000", 2024-05-08T18:08:00.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3614e-05 2024-05-08T18:08:00.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579231+0000", 2024-05-08T18:08:00.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003546249 2024-05-08T18:08:00.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579337+0000", 2024-05-08T18:08:00.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010589700000000001 2024-05-08T18:08:00.690 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.690 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.690 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.690 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-05-08T18:08:00.690 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:00.690 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.105095419000001, 2024-05-08T18:08:00.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004223157, 2024-05-08T18:08:00.691 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.691 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.691 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.691 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:00.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:00.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577548+0000", 2024-05-08T18:08:00.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.66e-06 2024-05-08T18:08:00.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577561+0000", 2024-05-08T18:08:00.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2533e-05 2024-05-08T18:08:00.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577585+0000", 2024-05-08T18:08:00.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3873e-05 2024-05-08T18:08:00.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577605+0000", 2024-05-08T18:08:00.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0477000000000001e-05 2024-05-08T18:08:00.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577717+0000", 2024-05-08T18:08:00.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011229499999999999 2024-05-08T18:08:00.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577777+0000", 2024-05-08T18:08:00.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.944e-05 2024-05-08T18:08:00.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581704+0000", 2024-05-08T18:08:00.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039267800000000004 2024-05-08T18:08:00.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581770+0000", 2024-05-08T18:08:00.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6099000000000005e-05 2024-05-08T18:08:00.695 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.695 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.695 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.695 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:54 7.d e29/28 7:b4812045:::notify.4:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:00.695 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:00.695 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.102282695, 2024-05-08T18:08:00.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003988503, 2024-05-08T18:08:00.695 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.695 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.695 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.695 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:00.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:00.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580368+0000", 2024-05-08T18:08:00.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3089999999999996e-06 2024-05-08T18:08:00.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580400+0000", 2024-05-08T18:08:00.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2580000000000003e-05 2024-05-08T18:08:00.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580427+0000", 2024-05-08T18:08:00.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6976999999999999e-05 2024-05-08T18:08:00.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580443+0000", 2024-05-08T18:08:00.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5585000000000001e-05 2024-05-08T18:08:00.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580555+0000", 2024-05-08T18:08:00.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112639 2024-05-08T18:08:00.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580601+0000", 2024-05-08T18:08:00.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6e-05 2024-05-08T18:08:00.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584229+0000", 2024-05-08T18:08:00.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036273659999999999 2024-05-08T18:08:00.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584348+0000", 2024-05-08T18:08:00.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119047 2024-05-08T18:08:00.699 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.699 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.699 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.699 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:00.699 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:00.699 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.992869425000002, 2024-05-08T18:08:00.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032136159999999999, 2024-05-08T18:08:00.700 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.700 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.700 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.700 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:00.700 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:00.700 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:00.700 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 193 2024-05-08T18:08:00.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.700 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:00.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:00.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689775+0000", 2024-05-08T18:08:00.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.357e-06 2024-05-08T18:08:00.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689788+0000", 2024-05-08T18:08:00.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3029e-05 2024-05-08T18:08:00.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689819+0000", 2024-05-08T18:08:00.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.065e-05 2024-05-08T18:08:00.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689833+0000", 2024-05-08T18:08:00.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4790000000000001e-05 2024-05-08T18:08:00.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689948+0000", 2024-05-08T18:08:00.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115089 2024-05-08T18:08:00.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690155+0000", 2024-05-08T18:08:00.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206932 2024-05-08T18:08:00.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:00.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690420+0000", 2024-05-08T18:08:00.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026450200000000001 2024-05-08T18:08:00.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:00.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692229+0000", 2024-05-08T18:08:00.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001808823 2024-05-08T18:08:00.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:00.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692816+0000", 2024-05-08T18:08:00.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058773199999999999 2024-05-08T18:08:00.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692915+0000", 2024-05-08T18:08:00.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8646000000000004e-05 2024-05-08T18:08:00.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692986+0000", 2024-05-08T18:08:00.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1066e-05 2024-05-08T18:08:00.705 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.705 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.705 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.705 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:00.705 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:00.705 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.093903206, 2024-05-08T18:08:00.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089431319999999995, 2024-05-08T18:08:00.705 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.705 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.706 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.706 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:00.706 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:00.706 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:00.706 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 208 2024-05-08T18:08:00.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.706 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:00.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:00.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588741+0000", 2024-05-08T18:08:00.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:08:00.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588752+0000", 2024-05-08T18:08:00.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0813e-05 2024-05-08T18:08:00.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588782+0000", 2024-05-08T18:08:00.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0020000000000001e-05 2024-05-08T18:08:00.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588803+0000", 2024-05-08T18:08:00.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1115999999999999e-05 2024-05-08T18:08:00.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588943+0000", 2024-05-08T18:08:00.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013971599999999999 2024-05-08T18:08:00.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:08:00.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588954+0000", 2024-05-08T18:08:00.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1365999999999999e-05 2024-05-08T18:08:00.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594340+0000", 2024-05-08T18:08:00.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053854910000000001 2024-05-08T18:08:00.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594670+0000", 2024-05-08T18:08:00.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000330055 2024-05-08T18:08:00.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:00.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.595179+0000", 2024-05-08T18:08:00.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050879199999999999 2024-05-08T18:08:00.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:00.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.596408+0000", 2024-05-08T18:08:00.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012295209999999999 2024-05-08T18:08:00.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:00.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597532+0000", 2024-05-08T18:08:00.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011233860000000001 2024-05-08T18:08:00.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597619+0000", 2024-05-08T18:08:00.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7775999999999994e-05 2024-05-08T18:08:00.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597682+0000", 2024-05-08T18:08:00.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2522999999999998e-05 2024-05-08T18:08:00.713 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.713 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.713 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.714 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:00.714 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:00.714 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.065274227000003, 2024-05-08T18:08:00.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031262669999999998, 2024-05-08T18:08:00.714 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.714 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.714 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.714 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:00.714 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:00.715 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:00.715 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 212 2024-05-08T18:08:00.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.715 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:00.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:00.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617370+0000", 2024-05-08T18:08:00.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:08:00.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617379+0000", 2024-05-08T18:08:00.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2359999999999993e-06 2024-05-08T18:08:00.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617405+0000", 2024-05-08T18:08:00.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5639999999999998e-05 2024-05-08T18:08:00.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617425+0000", 2024-05-08T18:08:00.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0457000000000001e-05 2024-05-08T18:08:00.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617573+0000", 2024-05-08T18:08:00.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014776200000000001 2024-05-08T18:08:00.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617786+0000", 2024-05-08T18:08:00.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212418 2024-05-08T18:08:00.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:00.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.618177+0000", 2024-05-08T18:08:00.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039161699999999997 2024-05-08T18:08:00.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:00.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.619563+0000", 2024-05-08T18:08:00.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013852999999999999 2024-05-08T18:08:00.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:00.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620334+0000", 2024-05-08T18:08:00.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00077182200000000002 2024-05-08T18:08:00.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620426+0000", 2024-05-08T18:08:00.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1526000000000004e-05 2024-05-08T18:08:00.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620494+0000", 2024-05-08T18:08:00.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8078999999999997e-05 2024-05-08T18:08:00.721 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.721 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.721 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.722 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:00.722 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:00.722 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.040955674000003, 2024-05-08T18:08:00.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035230880000000002, 2024-05-08T18:08:00.722 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.722 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.722 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.722 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:00.722 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:00.723 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:00.723 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 219 2024-05-08T18:08:00.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.723 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:00.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:00.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641689+0000", 2024-05-08T18:08:00.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:08:00.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641700+0000", 2024-05-08T18:08:00.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1507e-05 2024-05-08T18:08:00.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641732+0000", 2024-05-08T18:08:00.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1585999999999999e-05 2024-05-08T18:08:00.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641754+0000", 2024-05-08T18:08:00.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1480000000000001e-05 2024-05-08T18:08:00.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641942+0000", 2024-05-08T18:08:00.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018826300000000001 2024-05-08T18:08:00.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642165+0000", 2024-05-08T18:08:00.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022301100000000001 2024-05-08T18:08:00.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:00.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642587+0000", 2024-05-08T18:08:00.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042182400000000001 2024-05-08T18:08:00.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:00.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.643767+0000", 2024-05-08T18:08:00.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001180675 2024-05-08T18:08:00.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:00.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645010+0000", 2024-05-08T18:08:00.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012427110000000001 2024-05-08T18:08:00.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645101+0000", 2024-05-08T18:08:00.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0871999999999993e-05 2024-05-08T18:08:00.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645209+0000", 2024-05-08T18:08:00.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108496 2024-05-08T18:08:00.730 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.730 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.730 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.731 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:00.731 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:00.731 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.021158687000003, 2024-05-08T18:08:00.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035793639999999998, 2024-05-08T18:08:00.731 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.731 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.731 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.731 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:00.731 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:00.732 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:00.732 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 224 2024-05-08T18:08:00.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.732 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:00.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:00.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661485+0000", 2024-05-08T18:08:00.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9759999999999998e-06 2024-05-08T18:08:00.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661494+0000", 2024-05-08T18:08:00.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3469999999999999e-06 2024-05-08T18:08:00.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661517+0000", 2024-05-08T18:08:00.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.389e-05 2024-05-08T18:08:00.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661537+0000", 2024-05-08T18:08:00.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9803e-05 2024-05-08T18:08:00.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661696+0000", 2024-05-08T18:08:00.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015865899999999999 2024-05-08T18:08:00.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661910+0000", 2024-05-08T18:08:00.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021434199999999999 2024-05-08T18:08:00.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:00.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.662336+0000", 2024-05-08T18:08:00.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042575300000000001 2024-05-08T18:08:00.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:00.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.663720+0000", 2024-05-08T18:08:00.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013843799999999999 2024-05-08T18:08:00.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:00.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.664909+0000", 2024-05-08T18:08:00.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011889019999999999 2024-05-08T18:08:00.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665001+0000", 2024-05-08T18:08:00.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1649000000000003e-05 2024-05-08T18:08:00.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665063+0000", 2024-05-08T18:08:00.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1662999999999996e-05 2024-05-08T18:08:00.737 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.737 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.737 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.738 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:00.738 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:00.738 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.988565413000003, 2024-05-08T18:08:00.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031551930000000001, 2024-05-08T18:08:00.738 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.738 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.738 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.738 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:00.738 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:00.739 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:00.739 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 233 2024-05-08T18:08:00.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.739 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:00.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:00.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694079+0000", 2024-05-08T18:08:00.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:00.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694090+0000", 2024-05-08T18:08:00.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1182999999999999e-05 2024-05-08T18:08:00.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694119+0000", 2024-05-08T18:08:00.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9076000000000001e-05 2024-05-08T18:08:00.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694143+0000", 2024-05-08T18:08:00.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4363e-05 2024-05-08T18:08:00.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694291+0000", 2024-05-08T18:08:00.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147849 2024-05-08T18:08:00.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694534+0000", 2024-05-08T18:08:00.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000242382 2024-05-08T18:08:00.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:00.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694957+0000", 2024-05-08T18:08:00.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042316700000000001 2024-05-08T18:08:00.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:00.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.696306+0000", 2024-05-08T18:08:00.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013489940000000001 2024-05-08T18:08:00.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:00.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697071+0000", 2024-05-08T18:08:00.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076482999999999998 2024-05-08T18:08:00.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697167+0000", 2024-05-08T18:08:00.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6773000000000003e-05 2024-05-08T18:08:00.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697232+0000", 2024-05-08T18:08:00.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4386000000000003e-05 2024-05-08T18:08:00.745 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.745 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.745 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.745 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:328 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:00.745 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:00.746 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.956846826000003, 2024-05-08T18:08:00.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029659439999999999, 2024-05-08T18:08:00.746 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.746 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.746 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.746 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:00.746 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:00.746 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:00.746 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 328 2024-05-08T18:08:00.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.746 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:00.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:00.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725796+0000", 2024-05-08T18:08:00.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-06 2024-05-08T18:08:00.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725802+0000", 2024-05-08T18:08:00.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7219999999999996e-06 2024-05-08T18:08:00.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725816+0000", 2024-05-08T18:08:00.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3886999999999999e-05 2024-05-08T18:08:00.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725824+0000", 2024-05-08T18:08:00.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5920000000000003e-06 2024-05-08T18:08:00.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725885+0000", 2024-05-08T18:08:00.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1526999999999996e-05 2024-05-08T18:08:00.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725972+0000", 2024-05-08T18:08:00.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7099000000000001e-05 2024-05-08T18:08:00.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:00.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726093+0000", 2024-05-08T18:08:00.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120383 2024-05-08T18:08:00.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:00.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726717+0000", 2024-05-08T18:08:00.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062435099999999999 2024-05-08T18:08:00.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:00.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728693+0000", 2024-05-08T18:08:00.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019758309999999999 2024-05-08T18:08:00.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728731+0000", 2024-05-08T18:08:00.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8591999999999999e-05 2024-05-08T18:08:00.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728761+0000", 2024-05-08T18:08:00.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9770000000000001e-05 2024-05-08T18:08:00.754 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.754 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.754 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.754 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:460 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:00.754 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:00.755 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.903029601999997, 2024-05-08T18:08:00.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040209540000000002, 2024-05-08T18:08:00.755 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.755 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.755 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.755 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:00.755 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:00.755 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:00.755 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 460 2024-05-08T18:08:00.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.756 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:00.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:00.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779613+0000", 2024-05-08T18:08:00.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:08:00.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779619+0000", 2024-05-08T18:08:00.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3630000000000002e-06 2024-05-08T18:08:00.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779631+0000", 2024-05-08T18:08:00.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2211e-05 2024-05-08T18:08:00.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779637+0000", 2024-05-08T18:08:00.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0430000000000004e-06 2024-05-08T18:08:00.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779702+0000", 2024-05-08T18:08:00.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4481999999999997e-05 2024-05-08T18:08:00.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779848+0000", 2024-05-08T18:08:00.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014608500000000001 2024-05-08T18:08:00.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:00.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780056+0000", 2024-05-08T18:08:00.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020889699999999999 2024-05-08T18:08:00.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:00.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780700+0000", 2024-05-08T18:08:00.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064379300000000003 2024-05-08T18:08:00.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:00.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783576+0000", 2024-05-08T18:08:00.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028754919999999999 2024-05-08T18:08:00.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783608+0000", 2024-05-08T18:08:00.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2223e-05 2024-05-08T18:08:00.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:08:00.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5296e-05 2024-05-08T18:08:00.762 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.762 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.762 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.763 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:466 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:00.763 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:00.763 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.898491364000002, 2024-05-08T18:08:00.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028979520000000001, 2024-05-08T18:08:00.763 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.763 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.763 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.763 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:00.763 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:00.763 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:00.763 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 466 2024-05-08T18:08:00.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.764 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:00.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:00.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:00.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.61e-07 2024-05-08T18:08:00.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784155+0000", 2024-05-08T18:08:00.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9299999999999996e-06 2024-05-08T18:08:00.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784165+0000", 2024-05-08T18:08:00.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5680000000000005e-06 2024-05-08T18:08:00.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784170+0000", 2024-05-08T18:08:00.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1379999999999998e-06 2024-05-08T18:08:00.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784219+0000", 2024-05-08T18:08:00.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9231999999999999e-05 2024-05-08T18:08:00.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784310+0000", 2024-05-08T18:08:00.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0797000000000005e-05 2024-05-08T18:08:00.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:00.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784490+0000", 2024-05-08T18:08:00.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179705 2024-05-08T18:08:00.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:00.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.785090+0000", 2024-05-08T18:08:00.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060073899999999998 2024-05-08T18:08:00.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:00.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.786973+0000", 2024-05-08T18:08:00.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018824460000000001 2024-05-08T18:08:00.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787007+0000", 2024-05-08T18:08:00.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3779999999999998e-05 2024-05-08T18:08:00.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787049+0000", 2024-05-08T18:08:00.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1856e-05 2024-05-08T18:08:00.769 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.769 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.769 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.770 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:477 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:00.770 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:00.770 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.89134937, 2024-05-08T18:08:00.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046076989999999998, 2024-05-08T18:08:00.770 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.770 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.770 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.770 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:00.770 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:00.770 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:00.771 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 477 2024-05-08T18:08:00.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.771 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:00.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:00.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791294+0000", 2024-05-08T18:08:00.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-06 2024-05-08T18:08:00.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791300+0000", 2024-05-08T18:08:00.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5320000000000003e-06 2024-05-08T18:08:00.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791313+0000", 2024-05-08T18:08:00.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2576e-05 2024-05-08T18:08:00.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791319+0000", 2024-05-08T18:08:00.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1720000000000004e-06 2024-05-08T18:08:00.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791379+0000", 2024-05-08T18:08:00.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0343000000000001e-05 2024-05-08T18:08:00.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791477+0000", 2024-05-08T18:08:00.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7662000000000001e-05 2024-05-08T18:08:00.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:00.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791678+0000", 2024-05-08T18:08:00.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000200788 2024-05-08T18:08:00.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:00.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.792263+0000", 2024-05-08T18:08:00.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058525700000000005 2024-05-08T18:08:00.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:00.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795842+0000", 2024-05-08T18:08:00.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035787079999999999 2024-05-08T18:08:00.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795874+0000", 2024-05-08T18:08:00.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2205000000000001e-05 2024-05-08T18:08:00.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795900+0000", 2024-05-08T18:08:00.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6222000000000001e-05 2024-05-08T18:08:00.777 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.777 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.777 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.777 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:642 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:00.777 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:00.778 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.752589667000002, 2024-05-08T18:08:00.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030444059999999999, 2024-05-08T18:08:00.778 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.778 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.778 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.778 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:00.778 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:00.778 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:00.778 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 642 2024-05-08T18:08:00.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.779 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:00.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:00.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930055+0000", 2024-05-08T18:08:00.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7999999999999999e-06 2024-05-08T18:08:00.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930065+0000", 2024-05-08T18:08:00.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0176999999999999e-05 2024-05-08T18:08:00.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930092+0000", 2024-05-08T18:08:00.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6460000000000001e-05 2024-05-08T18:08:00.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930112+0000", 2024-05-08T18:08:00.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0043000000000001e-05 2024-05-08T18:08:00.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930219+0000", 2024-05-08T18:08:00.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010698500000000001 2024-05-08T18:08:00.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930345+0000", 2024-05-08T18:08:00.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012620400000000001 2024-05-08T18:08:00.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:00.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930579+0000", 2024-05-08T18:08:00.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234145 2024-05-08T18:08:00.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:00.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.931471+0000", 2024-05-08T18:08:00.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00089161500000000001 2024-05-08T18:08:00.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:00.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.932978+0000", 2024-05-08T18:08:00.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001507296 2024-05-08T18:08:00.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933044+0000", 2024-05-08T18:08:00.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6402000000000006e-05 2024-05-08T18:08:00.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933097+0000", 2024-05-08T18:08:00.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2278999999999999e-05 2024-05-08T18:08:00.785 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.785 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.785 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.785 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:681 6.e e32/26 6:748722ff:gc::gc.6:head v 32'7, mlcod=32'5)", 2024-05-08T18:08:00.785 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:00.786 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.721794090000003, 2024-05-08T18:08:00.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003318185, 2024-05-08T18:08:00.786 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.786 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.786 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.786 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:00.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:00.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960849+0000", 2024-05-08T18:08:00.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.423e-06 2024-05-08T18:08:00.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960859+0000", 2024-05-08T18:08:00.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3170000000000008e-06 2024-05-08T18:08:00.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960874+0000", 2024-05-08T18:08:00.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5125e-05 2024-05-08T18:08:00.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960884+0000", 2024-05-08T18:08:00.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8120000000000002e-06 2024-05-08T18:08:00.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960972+0000", 2024-05-08T18:08:00.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8540000000000003e-05 2024-05-08T18:08:00.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960996+0000", 2024-05-08T18:08:00.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3479999999999999e-05 2024-05-08T18:08:00.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964110+0000", 2024-05-08T18:08:00.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031142729999999999 2024-05-08T18:08:00.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964166+0000", 2024-05-08T18:08:00.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6215000000000003e-05 2024-05-08T18:08:00.791 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.792 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.792 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.792 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:00.792 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:00.792 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.630757995000003, 2024-05-08T18:08:00.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030648379999999999, 2024-05-08T18:08:00.792 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.793 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.793 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:00.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:00.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:00.793 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 733 2024-05-08T18:08:00.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.793 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:00.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:00.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051887+0000", 2024-05-08T18:08:00.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.74e-06 2024-05-08T18:08:00.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051900+0000", 2024-05-08T18:08:00.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3113e-05 2024-05-08T18:08:00.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051931+0000", 2024-05-08T18:08:00.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1665999999999998e-05 2024-05-08T18:08:00.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051946+0000", 2024-05-08T18:08:00.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4780000000000001e-05 2024-05-08T18:08:00.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052078+0000", 2024-05-08T18:08:00.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013133200000000001 2024-05-08T18:08:00.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052338+0000", 2024-05-08T18:08:00.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026056899999999999 2024-05-08T18:08:00.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:00.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052652+0000", 2024-05-08T18:08:00.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031396700000000001 2024-05-08T18:08:00.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:00.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.053668+0000", 2024-05-08T18:08:00.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00101574 2024-05-08T18:08:00.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:00.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054800+0000", 2024-05-08T18:08:00.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011319819999999999 2024-05-08T18:08:00.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054884+0000", 2024-05-08T18:08:00.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4005999999999995e-05 2024-05-08T18:08:00.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054949+0000", 2024-05-08T18:08:00.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4943000000000005e-05 2024-05-08T18:08:00.799 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.799 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.799 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.799 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:00.800 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:00.800 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.62690336, 2024-05-08T18:08:00.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029745919999999999, 2024-05-08T18:08:00.800 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.800 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.800 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.800 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:00.800 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:00.800 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:00.800 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 735 2024-05-08T18:08:00.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.801 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:00.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:00.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055741+0000", 2024-05-08T18:08:00.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.984e-06 2024-05-08T18:08:00.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055766+0000", 2024-05-08T18:08:00.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5253e-05 2024-05-08T18:08:00.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055785+0000", 2024-05-08T18:08:00.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9559999999999999e-05 2024-05-08T18:08:00.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055798+0000", 2024-05-08T18:08:00.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-05 2024-05-08T18:08:00.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055932+0000", 2024-05-08T18:08:00.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134609 2024-05-08T18:08:00.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056184+0000", 2024-05-08T18:08:00.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025167800000000003 2024-05-08T18:08:00.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:00.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056680+0000", 2024-05-08T18:08:00.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049576299999999998 2024-05-08T18:08:00.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:00.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058060+0000", 2024-05-08T18:08:00.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013801 2024-05-08T18:08:00.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:00.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058447+0000", 2024-05-08T18:08:00.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038695299999999999 2024-05-08T18:08:00.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058601+0000", 2024-05-08T18:08:00.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015396299999999999 2024-05-08T18:08:00.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058713+0000", 2024-05-08T18:08:00.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112389 2024-05-08T18:08:00.806 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.806 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.806 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.806 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:00.807 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:00.807 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.519888010000003, 2024-05-08T18:08:00.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029913650000000002, 2024-05-08T18:08:00.807 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.807 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.807 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.807 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:00.807 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:00.807 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:00.808 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 781 2024-05-08T18:08:00.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.808 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:00.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:00.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162757+0000", 2024-05-08T18:08:00.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:08:00.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162770+0000", 2024-05-08T18:08:00.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3406e-05 2024-05-08T18:08:00.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162799+0000", 2024-05-08T18:08:00.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-05 2024-05-08T18:08:00.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162813+0000", 2024-05-08T18:08:00.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:08:00.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162942+0000", 2024-05-08T18:08:00.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012902200000000001 2024-05-08T18:08:00.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163159+0000", 2024-05-08T18:08:00.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021738500000000001 2024-05-08T18:08:00.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:00.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163476+0000", 2024-05-08T18:08:00.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031666499999999999 2024-05-08T18:08:00.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:00.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.164533+0000", 2024-05-08T18:08:00.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010574219999999999 2024-05-08T18:08:00.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:00.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165587+0000", 2024-05-08T18:08:00.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001053476 2024-05-08T18:08:00.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165674+0000", 2024-05-08T18:08:00.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6725999999999996e-05 2024-05-08T18:08:00.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165745+0000", 2024-05-08T18:08:00.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1779000000000005e-05 2024-05-08T18:08:00.814 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.815 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.815 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.815 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:00.815 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:00.815 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.137298162, 2024-05-08T18:08:00.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029834750000000002, 2024-05-08T18:08:00.815 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:00.816 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:00.816 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:00.816 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:00.816 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:00.816 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:00.816 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 946 2024-05-08T18:08:00.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.816 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:00.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:00.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:00.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:00.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:00.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:00.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:00.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545346+0000", 2024-05-08T18:08:00.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6570000000000001e-06 2024-05-08T18:08:00.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:00.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545357+0000", 2024-05-08T18:08:00.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0740000000000001e-05 2024-05-08T18:08:00.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:00.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545384+0000", 2024-05-08T18:08:00.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6780000000000001e-05 2024-05-08T18:08:00.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:00.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545398+0000", 2024-05-08T18:08:00.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3936e-05 2024-05-08T18:08:00.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:00.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545515+0000", 2024-05-08T18:08:00.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117413 2024-05-08T18:08:00.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:00.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545751+0000", 2024-05-08T18:08:00.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023559500000000001 2024-05-08T18:08:00.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:00.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.546075+0000", 2024-05-08T18:08:00.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000324357 2024-05-08T18:08:00.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:00.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.547104+0000", 2024-05-08T18:08:00.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010285959999999999 2024-05-08T18:08:00.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:00.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548141+0000", 2024-05-08T18:08:00.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001036922 2024-05-08T18:08:00.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:00.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548223+0000", 2024-05-08T18:08:00.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2260000000000002e-05 2024-05-08T18:08:00.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:00.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:00.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:00.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548327+0000", 2024-05-08T18:08:00.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104219 2024-05-08T18:08:00.823 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.823 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.823 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.823 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:00.823 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:00.823 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:00.825 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:08:00.826 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:00.829+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:00.926 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:00.926+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:00.994 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:00.994 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:00.994 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:00.994 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:01.008 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:08:01.055 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:01.057+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:01.125 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:01.125 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:01.125 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:01.125 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:01.126 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:01.139 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:08:01.208 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:01.122+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:01.228 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:01.226+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:01.303 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:01.303 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:01.304 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:01.304 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:01.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.304 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:01.304 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:01.304 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.727950112000002, 2024-05-08T18:08:01.304 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002466088, 2024-05-08T18:08:01.304 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.304 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.305 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.305 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.305 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.305 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.305 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 52 2024-05-08T18:08:01.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.305 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.305 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.305 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:01.305 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.306 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.306 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:01.306 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.306 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.306 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577062+0000", 2024-05-08T18:08:01.306 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.994e-06 2024-05-08T18:08:01.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.306 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.306 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577075+0000", 2024-05-08T18:08:01.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2480000000000001e-05 2024-05-08T18:08:01.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.307 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577108+0000", 2024-05-08T18:08:01.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3096000000000003e-05 2024-05-08T18:08:01.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.307 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577131+0000", 2024-05-08T18:08:01.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2993000000000002e-05 2024-05-08T18:08:01.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.308 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577260+0000", 2024-05-08T18:08:01.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012912899999999999 2024-05-08T18:08:01.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.308 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577453+0000", 2024-05-08T18:08:01.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000193668 2024-05-08T18:08:01.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.309 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:01.309 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577634+0000", 2024-05-08T18:08:01.309 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180576 2024-05-08T18:08:01.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.309 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.309 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579082+0000", 2024-05-08T18:08:01.309 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001448083 2024-05-08T18:08:01.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.309 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.310 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579290+0000", 2024-05-08T18:08:01.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000208333 2024-05-08T18:08:01.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.310 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.310 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579403+0000", 2024-05-08T18:08:01.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011296800000000001 2024-05-08T18:08:01.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.310 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.310 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579525+0000", 2024-05-08T18:08:01.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121768 2024-05-08T18:08:01.310 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.311 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.311 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.311 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:01.311 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:01.311 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.716090346999998, 2024-05-08T18:08:01.311 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038858310000000002, 2024-05-08T18:08:01.311 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.311 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.311 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.311 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.311 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:01.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:01.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588920+0000", 2024-05-08T18:08:01.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.23e-07 2024-05-08T18:08:01.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588929+0000", 2024-05-08T18:08:01.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3659999999999998e-06 2024-05-08T18:08:01.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588948+0000", 2024-05-08T18:08:01.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8768000000000001e-05 2024-05-08T18:08:01.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588962+0000", 2024-05-08T18:08:01.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4e-05 2024-05-08T18:08:01.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.314 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.314 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589110+0000", 2024-05-08T18:08:01.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148047 2024-05-08T18:08:01.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.314 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.314 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589173+0000", 2024-05-08T18:08:01.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2766000000000002e-05 2024-05-08T18:08:01.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.314 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.314 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592728+0000", 2024-05-08T18:08:01.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035553300000000002 2024-05-08T18:08:01.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.315 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.315 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592805+0000", 2024-05-08T18:08:01.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6730999999999994e-05 2024-05-08T18:08:01.315 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.315 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.315 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.315 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.315 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:01.315 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.600021449000003, 2024-05-08T18:08:01.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034354310000000001, 2024-05-08T18:08:01.315 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.315 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.315 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.316 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.316 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.316 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.316 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 236 2024-05-08T18:08:01.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.316 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.316 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.316 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:01.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.316 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.316 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:01.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704991+0000", 2024-05-08T18:08:01.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1240000000000001e-06 2024-05-08T18:08:01.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705009+0000", 2024-05-08T18:08:01.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7819e-05 2024-05-08T18:08:01.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705048+0000", 2024-05-08T18:08:01.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9632999999999998e-05 2024-05-08T18:08:01.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705073+0000", 2024-05-08T18:08:01.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4686999999999999e-05 2024-05-08T18:08:01.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705241+0000", 2024-05-08T18:08:01.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759899999999999 2024-05-08T18:08:01.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705511+0000", 2024-05-08T18:08:01.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027018799999999998 2024-05-08T18:08:01.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:01.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705965+0000", 2024-05-08T18:08:01.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045433000000000002 2024-05-08T18:08:01.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.707487+0000", 2024-05-08T18:08:01.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015214810000000001 2024-05-08T18:08:01.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708125+0000", 2024-05-08T18:08:01.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063870300000000001 2024-05-08T18:08:01.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.320 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.320 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708298+0000", 2024-05-08T18:08:01.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172592 2024-05-08T18:08:01.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.320 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.320 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708423+0000", 2024-05-08T18:08:01.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125275 2024-05-08T18:08:01.320 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.320 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.320 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.321 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:308 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.321 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:01.321 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.583183546999997, 2024-05-08T18:08:01.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038707400000000001, 2024-05-08T18:08:01.321 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.321 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.321 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.321 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.321 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.321 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.321 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 308 2024-05-08T18:08:01.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.321 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:01.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:01.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721827+0000", 2024-05-08T18:08:01.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1519999999999999e-06 2024-05-08T18:08:01.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721840+0000", 2024-05-08T18:08:01.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.362e-05 2024-05-08T18:08:01.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721857+0000", 2024-05-08T18:08:01.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6901e-05 2024-05-08T18:08:01.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721867+0000", 2024-05-08T18:08:01.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0034000000000001e-05 2024-05-08T18:08:01.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721922+0000", 2024-05-08T18:08:01.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4450999999999998e-05 2024-05-08T18:08:01.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721981+0000", 2024-05-08T18:08:01.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9267e-05 2024-05-08T18:08:01.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:01.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722103+0000", 2024-05-08T18:08:01.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121502 2024-05-08T18:08:01.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722757+0000", 2024-05-08T18:08:01.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065419700000000003 2024-05-08T18:08:01.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725619+0000", 2024-05-08T18:08:01.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002862107 2024-05-08T18:08:01.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725654+0000", 2024-05-08T18:08:01.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:08:01.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725696+0000", 2024-05-08T18:08:01.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:08:01.326 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.326 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.326 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.327 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:604 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.327 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:01.327 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.405900840999998, 2024-05-08T18:08:01.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002741884, 2024-05-08T18:08:01.327 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.327 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.327 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.327 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.327 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.327 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.327 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 604 2024-05-08T18:08:01.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.328 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:01.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:01.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.329 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899111+0000", 2024-05-08T18:08:01.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0910000000000001e-06 2024-05-08T18:08:01.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.329 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899126+0000", 2024-05-08T18:08:01.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:08:01.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899159+0000", 2024-05-08T18:08:01.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3241999999999998e-05 2024-05-08T18:08:01.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899174+0000", 2024-05-08T18:08:01.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5235000000000001e-05 2024-05-08T18:08:01.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899316+0000", 2024-05-08T18:08:01.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014175599999999999 2024-05-08T18:08:01.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.331 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.331 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899525+0000", 2024-05-08T18:08:01.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020915300000000001 2024-05-08T18:08:01.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.331 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:01.331 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899872+0000", 2024-05-08T18:08:01.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034668299999999997 2024-05-08T18:08:01.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901064+0000", 2024-05-08T18:08:01.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001191473 2024-05-08T18:08:01.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901664+0000", 2024-05-08T18:08:01.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060054599999999998 2024-05-08T18:08:01.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901779+0000", 2024-05-08T18:08:01.333 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011452500000000001 2024-05-08T18:08:01.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.333 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901850+0000", 2024-05-08T18:08:01.333 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1580000000000002e-05 2024-05-08T18:08:01.333 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.333 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.333 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.334 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:612 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.334 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:01.334 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.400392277999998, 2024-05-08T18:08:01.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025904750000000001, 2024-05-08T18:08:01.334 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.334 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.334 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.334 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.334 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.334 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.334 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 612 2024-05-08T18:08:01.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.335 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.335 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.335 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:01.335 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.335 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.335 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:01.335 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.336 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.336 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904619+0000", 2024-05-08T18:08:01.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8479999999999999e-06 2024-05-08T18:08:01.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.336 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.336 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904628+0000", 2024-05-08T18:08:01.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8829999999999995e-06 2024-05-08T18:08:01.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.337 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.337 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904650+0000", 2024-05-08T18:08:01.337 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2467999999999999e-05 2024-05-08T18:08:01.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.337 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.337 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904669+0000", 2024-05-08T18:08:01.337 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9303000000000001e-05 2024-05-08T18:08:01.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.338 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.338 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904766+0000", 2024-05-08T18:08:01.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6917999999999996e-05 2024-05-08T18:08:01.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.338 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.338 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904935+0000", 2024-05-08T18:08:01.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000168441 2024-05-08T18:08:01.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.338 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:01.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.905288+0000", 2024-05-08T18:08:01.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035312199999999998 2024-05-08T18:08:01.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.906520+0000", 2024-05-08T18:08:01.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001232005 2024-05-08T18:08:01.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907086+0000", 2024-05-08T18:08:01.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056658900000000005 2024-05-08T18:08:01.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907154+0000", 2024-05-08T18:08:01.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7197000000000001e-05 2024-05-08T18:08:01.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907207+0000", 2024-05-08T18:08:01.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3701e-05 2024-05-08T18:08:01.340 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.341 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.341 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.341 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.341 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:01.341 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.232374685000003, 2024-05-08T18:08:01.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032464490000000002, 2024-05-08T18:08:01.341 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.341 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.341 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.342 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.342 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.342 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.342 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 742 2024-05-08T18:08:01.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.342 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:01.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:01.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072637+0000", 2024-05-08T18:08:01.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9059999999999998e-06 2024-05-08T18:08:01.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072651+0000", 2024-05-08T18:08:01.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3477e-05 2024-05-08T18:08:01.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072683+0000", 2024-05-08T18:08:01.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2116000000000002e-05 2024-05-08T18:08:01.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072698+0000", 2024-05-08T18:08:01.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5454000000000001e-05 2024-05-08T18:08:01.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072845+0000", 2024-05-08T18:08:01.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146532 2024-05-08T18:08:01.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073241+0000", 2024-05-08T18:08:01.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039580699999999997 2024-05-08T18:08:01.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.345 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:01.345 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073812+0000", 2024-05-08T18:08:01.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057164900000000003 2024-05-08T18:08:01.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.345 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.345 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075063+0000", 2024-05-08T18:08:01.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001250131 2024-05-08T18:08:01.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.345 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.345 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075723+0000", 2024-05-08T18:08:01.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00066039199999999999 2024-05-08T18:08:01.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075808+0000", 2024-05-08T18:08:01.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5458999999999996e-05 2024-05-08T18:08:01.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075881+0000", 2024-05-08T18:08:01.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2526000000000003e-05 2024-05-08T18:08:01.346 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.346 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.346 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.347 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.347 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:01.347 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.189966320000003, 2024-05-08T18:08:01.347 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029270590000000001, 2024-05-08T18:08:01.347 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.347 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.347 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.347 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.347 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.347 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.347 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 760 2024-05-08T18:08:01.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.347 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.347 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:01.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:01.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115045+0000", 2024-05-08T18:08:01.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0729999999999999e-06 2024-05-08T18:08:01.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115057+0000", 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1617000000000001e-05 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115088+0000", 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1155999999999998e-05 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115103+0000", 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5067e-05 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115289+0000", 2024-05-08T18:08:01.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186582 2024-05-08T18:08:01.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.350 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115506+0000", 2024-05-08T18:08:01.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021690500000000001 2024-05-08T18:08:01.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:01.350 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115832+0000", 2024-05-08T18:08:01.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032556799999999998 2024-05-08T18:08:01.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.350 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.116892+0000", 2024-05-08T18:08:01.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010597989999999999 2024-05-08T18:08:01.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117807+0000", 2024-05-08T18:08:01.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091502599999999999 2024-05-08T18:08:01.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117895+0000", 2024-05-08T18:08:01.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7977000000000001e-05 2024-05-08T18:08:01.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.352 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117970+0000", 2024-05-08T18:08:01.352 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5289000000000004e-05 2024-05-08T18:08:01.352 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.352 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.352 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.352 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.352 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:01.352 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.058968833999998, 2024-05-08T18:08:01.352 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028290730000000001, 2024-05-08T18:08:01.353 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.353 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.353 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.353 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.353 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.353 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.353 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 817 2024-05-08T18:08:01.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.353 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.353 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.353 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:01.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:01.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246043+0000", 2024-05-08T18:08:01.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.807e-06 2024-05-08T18:08:01.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246056+0000", 2024-05-08T18:08:01.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2383e-05 2024-05-08T18:08:01.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246087+0000", 2024-05-08T18:08:01.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1937000000000003e-05 2024-05-08T18:08:01.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246104+0000", 2024-05-08T18:08:01.356 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6643e-05 2024-05-08T18:08:01.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.356 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246225+0000", 2024-05-08T18:08:01.356 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012061900000000001 2024-05-08T18:08:01.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.356 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246510+0000", 2024-05-08T18:08:01.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028507100000000002 2024-05-08T18:08:01.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:01.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246881+0000", 2024-05-08T18:08:01.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037163799999999998 2024-05-08T18:08:01.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248078+0000", 2024-05-08T18:08:01.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011968969999999999 2024-05-08T18:08:01.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.358 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.358 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248715+0000", 2024-05-08T18:08:01.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063698599999999998 2024-05-08T18:08:01.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.358 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.358 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248801+0000", 2024-05-08T18:08:01.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5772999999999993e-05 2024-05-08T18:08:01.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248869+0000", 2024-05-08T18:08:01.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8318999999999994e-05 2024-05-08T18:08:01.359 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.359 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.359 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.359 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.359 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:01.359 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.005225350000003, 2024-05-08T18:08:01.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003281693, 2024-05-08T18:08:01.360 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.360 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.360 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.360 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.360 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.360 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.360 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 841 2024-05-08T18:08:01.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.360 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:01.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.361 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.361 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:01.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.361 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.361 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299786+0000", 2024-05-08T18:08:01.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4770000000000002e-06 2024-05-08T18:08:01.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.362 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.362 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299798+0000", 2024-05-08T18:08:01.362 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1493e-05 2024-05-08T18:08:01.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.362 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.362 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299827+0000", 2024-05-08T18:08:01.362 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9363e-05 2024-05-08T18:08:01.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299842+0000", 2024-05-08T18:08:01.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.448e-05 2024-05-08T18:08:01.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300001+0000", 2024-05-08T18:08:01.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015909600000000001 2024-05-08T18:08:01.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300384+0000", 2024-05-08T18:08:01.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038306000000000001 2024-05-08T18:08:01.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:01.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300929+0000", 2024-05-08T18:08:01.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054551299999999997 2024-05-08T18:08:01.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302151+0000", 2024-05-08T18:08:01.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012218540000000001 2024-05-08T18:08:01.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302918+0000", 2024-05-08T18:08:01.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076719099999999997 2024-05-08T18:08:01.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303000+0000", 2024-05-08T18:08:01.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1662999999999994e-05 2024-05-08T18:08:01.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303065+0000", 2024-05-08T18:08:01.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5502999999999999e-05 2024-05-08T18:08:01.366 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.366 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.366 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.366 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.366 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:01.367 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.001029893999998, 2024-05-08T18:08:01.367 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026179150000000002, 2024-05-08T18:08:01.367 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.367 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.367 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.367 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.367 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.367 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.367 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 843 2024-05-08T18:08:01.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.367 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:01.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:01.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303981+0000", 2024-05-08T18:08:01.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9740000000000001e-06 2024-05-08T18:08:01.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303990+0000", 2024-05-08T18:08:01.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9889999999999998e-06 2024-05-08T18:08:01.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304012+0000", 2024-05-08T18:08:01.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1537000000000001e-05 2024-05-08T18:08:01.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304023+0000", 2024-05-08T18:08:01.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:08:01.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304101+0000", 2024-05-08T18:08:01.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7732999999999996e-05 2024-05-08T18:08:01.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304210+0000", 2024-05-08T18:08:01.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010985299999999999 2024-05-08T18:08:01.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:01.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304490+0000", 2024-05-08T18:08:01.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000279564 2024-05-08T18:08:01.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.305542+0000", 2024-05-08T18:08:01.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051976 2024-05-08T18:08:01.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306451+0000", 2024-05-08T18:08:01.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00090901999999999997 2024-05-08T18:08:01.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306533+0000", 2024-05-08T18:08:01.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1790000000000001e-05 2024-05-08T18:08:01.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306597+0000", 2024-05-08T18:08:01.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4332999999999995e-05 2024-05-08T18:08:01.372 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.372 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.372 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.373 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.373 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:01.373 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.991333683999997, 2024-05-08T18:08:01.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00275537, 2024-05-08T18:08:01.373 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.373 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.373 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.373 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.373 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.373 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.373 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 847 2024-05-08T18:08:01.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.374 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:01.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:01.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313678+0000", 2024-05-08T18:08:01.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:08:01.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313689+0000", 2024-05-08T18:08:01.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1273e-05 2024-05-08T18:08:01.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313719+0000", 2024-05-08T18:08:01.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9726e-05 2024-05-08T18:08:01.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313733+0000", 2024-05-08T18:08:01.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4487e-05 2024-05-08T18:08:01.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313858+0000", 2024-05-08T18:08:01.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125172 2024-05-08T18:08:01.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314072+0000", 2024-05-08T18:08:01.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021314200000000001 2024-05-08T18:08:01.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:01.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314378+0000", 2024-05-08T18:08:01.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030653100000000002 2024-05-08T18:08:01.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.315524+0000", 2024-05-08T18:08:01.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011458950000000001 2024-05-08T18:08:01.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316213+0000", 2024-05-08T18:08:01.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068942199999999997 2024-05-08T18:08:01.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316314+0000", 2024-05-08T18:08:01.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100723 2024-05-08T18:08:01.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316431+0000", 2024-05-08T18:08:01.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116759 2024-05-08T18:08:01.382 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.382 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.383 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.383 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.383 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:01.383 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.987681747000003, 2024-05-08T18:08:01.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025522510000000002, 2024-05-08T18:08:01.383 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.383 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.383 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.383 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.383 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.383 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.383 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 849 2024-05-08T18:08:01.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.384 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:01.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:01.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317329+0000", 2024-05-08T18:08:01.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9530000000000002e-06 2024-05-08T18:08:01.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317340+0000", 2024-05-08T18:08:01.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.08e-05 2024-05-08T18:08:01.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317364+0000", 2024-05-08T18:08:01.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4142999999999999e-05 2024-05-08T18:08:01.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317377+0000", 2024-05-08T18:08:01.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2764e-05 2024-05-08T18:08:01.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317471+0000", 2024-05-08T18:08:01.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4289000000000005e-05 2024-05-08T18:08:01.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317600+0000", 2024-05-08T18:08:01.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012910499999999999 2024-05-08T18:08:01.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:01.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317868+0000", 2024-05-08T18:08:01.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000267562 2024-05-08T18:08:01.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319081+0000", 2024-05-08T18:08:01.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001213387 2024-05-08T18:08:01.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319723+0000", 2024-05-08T18:08:01.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064134200000000004 2024-05-08T18:08:01.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319808+0000", 2024-05-08T18:08:01.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:01.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319880+0000", 2024-05-08T18:08:01.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1426000000000004e-05 2024-05-08T18:08:01.388 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.388 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.389 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.389 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.389 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:01.389 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.944249266, 2024-05-08T18:08:01.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002815157, 2024-05-08T18:08:01.389 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.389 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.389 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.389 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.389 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.389 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.389 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 868 2024-05-08T18:08:01.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.390 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:01.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:01.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360762+0000", 2024-05-08T18:08:01.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:08:01.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360775+0000", 2024-05-08T18:08:01.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2840000000000001e-05 2024-05-08T18:08:01.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360805+0000", 2024-05-08T18:08:01.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9686e-05 2024-05-08T18:08:01.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360819+0000", 2024-05-08T18:08:01.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.434e-05 2024-05-08T18:08:01.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360948+0000", 2024-05-08T18:08:01.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000129033 2024-05-08T18:08:01.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361166+0000", 2024-05-08T18:08:01.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021747800000000001 2024-05-08T18:08:01.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:01.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361481+0000", 2024-05-08T18:08:01.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031515800000000001 2024-05-08T18:08:01.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.362546+0000", 2024-05-08T18:08:01.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010653889999999999 2024-05-08T18:08:01.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363365+0000", 2024-05-08T18:08:01.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081906100000000005 2024-05-08T18:08:01.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363450+0000", 2024-05-08T18:08:01.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5202000000000002e-05 2024-05-08T18:08:01.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363575+0000", 2024-05-08T18:08:01.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012460999999999999 2024-05-08T18:08:01.395 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.395 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.395 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.395 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.396 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:01.396 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.940557093000002, 2024-05-08T18:08:01.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024676260000000001, 2024-05-08T18:08:01.396 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.396 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.396 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.396 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.396 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.396 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.396 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 870 2024-05-08T18:08:01.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.397 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:01.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:01.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364454+0000", 2024-05-08T18:08:01.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7770000000000001e-06 2024-05-08T18:08:01.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364463+0000", 2024-05-08T18:08:01.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4800000000000007e-06 2024-05-08T18:08:01.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364487+0000", 2024-05-08T18:08:01.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3589999999999999e-05 2024-05-08T18:08:01.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364499+0000", 2024-05-08T18:08:01.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.241e-05 2024-05-08T18:08:01.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364607+0000", 2024-05-08T18:08:01.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010760900000000001 2024-05-08T18:08:01.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364750+0000", 2024-05-08T18:08:01.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014265600000000001 2024-05-08T18:08:01.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:01.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.365021+0000", 2024-05-08T18:08:01.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027115100000000002 2024-05-08T18:08:01.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366163+0000", 2024-05-08T18:08:01.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011419189999999999 2024-05-08T18:08:01.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366727+0000", 2024-05-08T18:08:01.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056400199999999997 2024-05-08T18:08:01.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366810+0000", 2024-05-08T18:08:01.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3133000000000005e-05 2024-05-08T18:08:01.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366920+0000", 2024-05-08T18:08:01.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109899 2024-05-08T18:08:01.402 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.402 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.402 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.403 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.403 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:01.403 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.850642915000002, 2024-05-08T18:08:01.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027893459999999998, 2024-05-08T18:08:01.403 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.403 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.403 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.403 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.403 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.403 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.404 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 907 2024-05-08T18:08:01.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.404 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:01.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:01.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454369+0000", 2024-05-08T18:08:01.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5730000000000002e-06 2024-05-08T18:08:01.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454381+0000", 2024-05-08T18:08:01.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.208e-05 2024-05-08T18:08:01.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454413+0000", 2024-05-08T18:08:01.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2493000000000002e-05 2024-05-08T18:08:01.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454432+0000", 2024-05-08T18:08:01.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8862999999999999e-05 2024-05-08T18:08:01.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454577+0000", 2024-05-08T18:08:01.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014477899999999999 2024-05-08T18:08:01.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454800+0000", 2024-05-08T18:08:01.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223425 2024-05-08T18:08:01.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:01.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.455168+0000", 2024-05-08T18:08:01.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036712799999999999 2024-05-08T18:08:01.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456282+0000", 2024-05-08T18:08:01.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011141580000000001 2024-05-08T18:08:01.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456953+0000", 2024-05-08T18:08:01.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000670956 2024-05-08T18:08:01.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457038+0000", 2024-05-08T18:08:01.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4828999999999997e-05 2024-05-08T18:08:01.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457156+0000", 2024-05-08T18:08:01.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118062 2024-05-08T18:08:01.409 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.409 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.409 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.409 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.409 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:01.409 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.846950552000003, 2024-05-08T18:08:01.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026891609999999998, 2024-05-08T18:08:01.409 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.409 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.410 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.410 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.410 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.410 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.410 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 909 2024-05-08T18:08:01.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.410 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:01.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:01.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458060+0000", 2024-05-08T18:08:01.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:01.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458069+0000", 2024-05-08T18:08:01.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6440000000000006e-06 2024-05-08T18:08:01.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458090+0000", 2024-05-08T18:08:01.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1089000000000001e-05 2024-05-08T18:08:01.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458102+0000", 2024-05-08T18:08:01.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2306999999999999e-05 2024-05-08T18:08:01.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458191+0000", 2024-05-08T18:08:01.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8213000000000004e-05 2024-05-08T18:08:01.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458313+0000", 2024-05-08T18:08:01.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012231500000000001 2024-05-08T18:08:01.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:01.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458581+0000", 2024-05-08T18:08:01.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026762500000000001 2024-05-08T18:08:01.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.459773+0000", 2024-05-08T18:08:01.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001192991 2024-05-08T18:08:01.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460590+0000", 2024-05-08T18:08:01.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081618100000000002 2024-05-08T18:08:01.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460681+0000", 2024-05-08T18:08:01.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0946000000000006e-05 2024-05-08T18:08:01.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460748+0000", 2024-05-08T18:08:01.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7139999999999998e-05 2024-05-08T18:08:01.415 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.415 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.415 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.415 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.415 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:01.415 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.753307534000001, 2024-05-08T18:08:01.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030359179999999999, 2024-05-08T18:08:01.415 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.415 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.416 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.416 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.416 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.416 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.416 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 949 2024-05-08T18:08:01.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.416 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:01.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:01.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551705+0000", 2024-05-08T18:08:01.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2770000000000001e-06 2024-05-08T18:08:01.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551717+0000", 2024-05-08T18:08:01.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.206e-05 2024-05-08T18:08:01.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551747+0000", 2024-05-08T18:08:01.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0168999999999999e-05 2024-05-08T18:08:01.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551763+0000", 2024-05-08T18:08:01.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:08:01.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551880+0000", 2024-05-08T18:08:01.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116976 2024-05-08T18:08:01.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552099+0000", 2024-05-08T18:08:01.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021910199999999999 2024-05-08T18:08:01.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:01.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552476+0000", 2024-05-08T18:08:01.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000376697 2024-05-08T18:08:01.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.553551+0000", 2024-05-08T18:08:01.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001074925 2024-05-08T18:08:01.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554588+0000", 2024-05-08T18:08:01.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010374099999999999 2024-05-08T18:08:01.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554671+0000", 2024-05-08T18:08:01.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3368999999999994e-05 2024-05-08T18:08:01.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554738+0000", 2024-05-08T18:08:01.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6043000000000004e-05 2024-05-08T18:08:01.421 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.421 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.421 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.422 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.422 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:01.422 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.739694096000001, 2024-05-08T18:08:01.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028304160000000001, 2024-05-08T18:08:01.422 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.422 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.422 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.422 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.422 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.422 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.422 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 955 2024-05-08T18:08:01.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.423 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:01.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:01.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565318+0000", 2024-05-08T18:08:01.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7030000000000002e-06 2024-05-08T18:08:01.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565330+0000", 2024-05-08T18:08:01.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.204e-05 2024-05-08T18:08:01.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565363+0000", 2024-05-08T18:08:01.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2722999999999998e-05 2024-05-08T18:08:01.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565389+0000", 2024-05-08T18:08:01.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6412999999999999e-05 2024-05-08T18:08:01.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565510+0000", 2024-05-08T18:08:01.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120932 2024-05-08T18:08:01.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565722+0000", 2024-05-08T18:08:01.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212139 2024-05-08T18:08:01.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:01.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.566034+0000", 2024-05-08T18:08:01.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000312038 2024-05-08T18:08:01.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567340+0000", 2024-05-08T18:08:01.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00130547 2024-05-08T18:08:01.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567998+0000", 2024-05-08T18:08:01.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000658382 2024-05-08T18:08:01.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568081+0000", 2024-05-08T18:08:01.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3269999999999994e-05 2024-05-08T18:08:01.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568145+0000", 2024-05-08T18:08:01.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4306000000000004e-05 2024-05-08T18:08:01.428 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.428 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.428 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.429 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.429 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:01.429 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.735974573, 2024-05-08T18:08:01.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027506660000000001, 2024-05-08T18:08:01.429 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.429 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.429 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.429 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.430 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.430 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.430 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 957 2024-05-08T18:08:01.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.430 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:01.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:01.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569036+0000", 2024-05-08T18:08:01.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.776e-06 2024-05-08T18:08:01.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569061+0000", 2024-05-08T18:08:01.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5097e-05 2024-05-08T18:08:01.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569084+0000", 2024-05-08T18:08:01.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.23e-05 2024-05-08T18:08:01.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569096+0000", 2024-05-08T18:08:01.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.22e-05 2024-05-08T18:08:01.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569180+0000", 2024-05-08T18:08:01.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4369000000000005e-05 2024-05-08T18:08:01.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569296+0000", 2024-05-08T18:08:01.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115999 2024-05-08T18:08:01.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:01.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569550+0000", 2024-05-08T18:08:01.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025397499999999998 2024-05-08T18:08:01.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.570963+0000", 2024-05-08T18:08:01.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001413023 2024-05-08T18:08:01.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571614+0000", 2024-05-08T18:08:01.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065041199999999995 2024-05-08T18:08:01.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571701+0000", 2024-05-08T18:08:01.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7569000000000001e-05 2024-05-08T18:08:01.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571785+0000", 2024-05-08T18:08:01.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3945999999999999e-05 2024-05-08T18:08:01.435 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.436 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.436 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.436 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.436 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.436 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:01.436 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:08:01.438 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:08:01.438 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:01.437+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:01.538 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:01.537+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:01.614 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:01.615 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:01.615 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:01.615 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:01.629 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:08:01.639 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:01.638+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:01.740 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:01.742+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:01.788 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:01.788 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:01.788 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:01.788 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:01.788 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:01.801 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:08:01.842 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:01.838+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:01.911 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:01.911 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:01.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:01.911 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:01.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.911 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:01.911 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:01.912 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 40.359277290999998, 2024-05-08T18:08:01.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049710090000000002, 2024-05-08T18:08:01.912 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.912 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.912 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-08T18:08:01.912 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.912 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.912 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.912 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 44 2024-05-08T18:08:01.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.912 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:01.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:01.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552775+0000", 2024-05-08T18:08:01.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4450000000000001e-06 2024-05-08T18:08:01.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552790+0000", 2024-05-08T18:08:01.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4363e-05 2024-05-08T18:08:01.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552820+0000", 2024-05-08T18:08:01.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0485999999999999e-05 2024-05-08T18:08:01.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552843+0000", 2024-05-08T18:08:01.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2985000000000001e-05 2024-05-08T18:08:01.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554350+0000", 2024-05-08T18:08:01.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015065149999999999 2024-05-08T18:08:01.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-08T18:08:01.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554374+0000", 2024-05-08T18:08:01.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4097e-05 2024-05-08T18:08:01.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557531+0000", 2024-05-08T18:08:01.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031567169999999999 2024-05-08T18:08:01.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557743+0000", 2024-05-08T18:08:01.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212401 2024-05-08T18:08:01.917 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.917 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.917 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.917 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:01.917 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:01.917 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.323925414000001, 2024-05-08T18:08:01.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050241879999999997, 2024-05-08T18:08:01.917 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.917 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.918 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.918 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.918 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.918 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.918 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 58 2024-05-08T18:08:01.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.918 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:01.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:01.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588125+0000", 2024-05-08T18:08:01.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1399999999999995e-07 2024-05-08T18:08:01.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588129+0000", 2024-05-08T18:08:01.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6779999999999999e-06 2024-05-08T18:08:01.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588142+0000", 2024-05-08T18:08:01.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3047999999999999e-05 2024-05-08T18:08:01.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588174+0000", 2024-05-08T18:08:01.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1270999999999999e-05 2024-05-08T18:08:01.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588307+0000", 2024-05-08T18:08:01.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013307600000000001 2024-05-08T18:08:01.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588477+0000", 2024-05-08T18:08:01.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000170213 2024-05-08T18:08:01.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:01.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588669+0000", 2024-05-08T18:08:01.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019211599999999999 2024-05-08T18:08:01.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.590228+0000", 2024-05-08T18:08:01.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015590059999999999 2024-05-08T18:08:01.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593029+0000", 2024-05-08T18:08:01.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028006400000000001 2024-05-08T18:08:01.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593099+0000", 2024-05-08T18:08:01.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0300000000000001e-05 2024-05-08T18:08:01.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593148+0000", 2024-05-08T18:08:01.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8925999999999999e-05 2024-05-08T18:08:01.924 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.924 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.924 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.924 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:08:01.924 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:01.924 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.327387254000001, 2024-05-08T18:08:01.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00385587, 2024-05-08T18:08:01.924 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.924 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.924 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.924 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.924 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.924 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.925 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207 2024-05-08T18:08:01.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.925 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:01.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:01.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584665+0000", 2024-05-08T18:08:01.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0570000000000001e-06 2024-05-08T18:08:01.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584679+0000", 2024-05-08T18:08:01.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3713000000000001e-05 2024-05-08T18:08:01.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584712+0000", 2024-05-08T18:08:01.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3213999999999997e-05 2024-05-08T18:08:01.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584728+0000", 2024-05-08T18:08:01.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5936000000000001e-05 2024-05-08T18:08:01.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584951+0000", 2024-05-08T18:08:01.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000222955 2024-05-08T18:08:01.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585196+0000", 2024-05-08T18:08:01.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024550800000000002 2024-05-08T18:08:01.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:01.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585643+0000", 2024-05-08T18:08:01.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00044644699999999999 2024-05-08T18:08:01.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.587110+0000", 2024-05-08T18:08:01.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001467323 2024-05-08T18:08:01.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588371+0000", 2024-05-08T18:08:01.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012607180000000001 2024-05-08T18:08:01.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588452+0000", 2024-05-08T18:08:01.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1216000000000003e-05 2024-05-08T18:08:01.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588518+0000", 2024-05-08T18:08:01.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5783000000000004e-05 2024-05-08T18:08:01.929 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.929 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.929 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.930 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.930 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:01.930 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.281211851999998, 2024-05-08T18:08:01.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003249994, 2024-05-08T18:08:01.930 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.930 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.930 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.930 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.930 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.930 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.930 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216 2024-05-08T18:08:01.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.930 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:01.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:01.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630840+0000", 2024-05-08T18:08:01.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0730000000000001e-06 2024-05-08T18:08:01.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630854+0000", 2024-05-08T18:08:01.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3360000000000001e-05 2024-05-08T18:08:01.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630889+0000", 2024-05-08T18:08:01.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5176999999999999e-05 2024-05-08T18:08:01.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630911+0000", 2024-05-08T18:08:01.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.247e-05 2024-05-08T18:08:01.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631046+0000", 2024-05-08T18:08:01.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013484599999999999 2024-05-08T18:08:01.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631272+0000", 2024-05-08T18:08:01.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000225694 2024-05-08T18:08:01.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:01.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631703+0000", 2024-05-08T18:08:01.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000431144 2024-05-08T18:08:01.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633244+0000", 2024-05-08T18:08:01.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001540622 2024-05-08T18:08:01.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633926+0000", 2024-05-08T18:08:01.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068244200000000001 2024-05-08T18:08:01.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634019+0000", 2024-05-08T18:08:01.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3148999999999999e-05 2024-05-08T18:08:01.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634087+0000", 2024-05-08T18:08:01.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8016999999999996e-05 2024-05-08T18:08:01.935 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.935 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.936 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.936 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.936 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:01.936 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.239667803000003, 2024-05-08T18:08:01.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003119854, 2024-05-08T18:08:01.936 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.936 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.936 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.936 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.936 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.937 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.937 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 227 2024-05-08T18:08:01.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.937 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:01.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:01.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672384+0000", 2024-05-08T18:08:01.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7470000000000001e-06 2024-05-08T18:08:01.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672396+0000", 2024-05-08T18:08:01.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.154e-05 2024-05-08T18:08:01.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672427+0000", 2024-05-08T18:08:01.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1676e-05 2024-05-08T18:08:01.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672443+0000", 2024-05-08T18:08:01.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5214e-05 2024-05-08T18:08:01.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672563+0000", 2024-05-08T18:08:01.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120535 2024-05-08T18:08:01.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672778+0000", 2024-05-08T18:08:01.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021446200000000001 2024-05-08T18:08:01.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:01.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.673205+0000", 2024-05-08T18:08:01.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042750699999999998 2024-05-08T18:08:01.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.674848+0000", 2024-05-08T18:08:01.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016432980000000001 2024-05-08T18:08:01.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675346+0000", 2024-05-08T18:08:01.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049711999999999998 2024-05-08T18:08:01.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675432+0000", 2024-05-08T18:08:01.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6798999999999993e-05 2024-05-08T18:08:01.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675501+0000", 2024-05-08T18:08:01.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8955999999999995e-05 2024-05-08T18:08:01.942 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.943 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.943 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.943 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.943 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:01.943 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.232727015999998, 2024-05-08T18:08:01.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034322110000000001, 2024-05-08T18:08:01.943 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.943 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.943 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.944 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.944 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.944 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.944 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 229 2024-05-08T18:08:01.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.944 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:01.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:01.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679325+0000", 2024-05-08T18:08:01.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:08:01.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679339+0000", 2024-05-08T18:08:01.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:08:01.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679370+0000", 2024-05-08T18:08:01.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0280000000000001e-05 2024-05-08T18:08:01.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679385+0000", 2024-05-08T18:08:01.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5026e-05 2024-05-08T18:08:01.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679504+0000", 2024-05-08T18:08:01.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119023 2024-05-08T18:08:01.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679711+0000", 2024-05-08T18:08:01.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020705499999999999 2024-05-08T18:08:01.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:01.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.680115+0000", 2024-05-08T18:08:01.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040396699999999998 2024-05-08T18:08:01.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.681424+0000", 2024-05-08T18:08:01.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001309387 2024-05-08T18:08:01.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682488+0000", 2024-05-08T18:08:01.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010642519999999999 2024-05-08T18:08:01.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682640+0000", 2024-05-08T18:08:01.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015123599999999999 2024-05-08T18:08:01.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682754+0000", 2024-05-08T18:08:01.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011482200000000001 2024-05-08T18:08:01.949 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.949 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.949 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.950 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.950 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:01.950 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.225342806999997, 2024-05-08T18:08:01.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033353329999999998, 2024-05-08T18:08:01.950 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.950 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.950 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.950 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.950 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.950 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.951 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 231 2024-05-08T18:08:01.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.951 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:01.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:01.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686709+0000", 2024-05-08T18:08:01.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4729999999999999e-06 2024-05-08T18:08:01.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686720+0000", 2024-05-08T18:08:01.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1157e-05 2024-05-08T18:08:01.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686750+0000", 2024-05-08T18:08:01.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0417e-05 2024-05-08T18:08:01.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686765+0000", 2024-05-08T18:08:01.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.487e-05 2024-05-08T18:08:01.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686872+0000", 2024-05-08T18:08:01.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010703499999999999 2024-05-08T18:08:01.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687085+0000", 2024-05-08T18:08:01.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021279599999999999 2024-05-08T18:08:01.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:01.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687501+0000", 2024-05-08T18:08:01.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041554 2024-05-08T18:08:01.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.688886+0000", 2024-05-08T18:08:01.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00138565 2024-05-08T18:08:01.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689899+0000", 2024-05-08T18:08:01.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010128190000000001 2024-05-08T18:08:01.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689978+0000", 2024-05-08T18:08:01.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8490000000000002e-05 2024-05-08T18:08:01.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.690042+0000", 2024-05-08T18:08:01.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4085999999999996e-05 2024-05-08T18:08:01.955 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.955 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.956 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.956 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:394 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.956 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:01.956 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.168269729999999, 2024-05-08T18:08:01.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034384960000000001, 2024-05-08T18:08:01.956 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.956 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.956 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.956 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.956 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.956 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.956 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 394 2024-05-08T18:08:01.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.957 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:01.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:01.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743781+0000", 2024-05-08T18:08:01.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3e-06 2024-05-08T18:08:01.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743788+0000", 2024-05-08T18:08:01.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7399999999999998e-06 2024-05-08T18:08:01.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743801+0000", 2024-05-08T18:08:01.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3757000000000001e-05 2024-05-08T18:08:01.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743808+0000", 2024-05-08T18:08:01.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6579999999999996e-06 2024-05-08T18:08:01.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743875+0000", 2024-05-08T18:08:01.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6740000000000001e-05 2024-05-08T18:08:01.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743971+0000", 2024-05-08T18:08:01.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6175000000000007e-05 2024-05-08T18:08:01.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:01.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744100+0000", 2024-05-08T18:08:01.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012954899999999999 2024-05-08T18:08:01.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744863+0000", 2024-05-08T18:08:01.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076300100000000002 2024-05-08T18:08:01.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747089+0000", 2024-05-08T18:08:01.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022258540000000002 2024-05-08T18:08:01.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747162+0000", 2024-05-08T18:08:01.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2632000000000005e-05 2024-05-08T18:08:01.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747218+0000", 2024-05-08T18:08:01.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.609e-05 2024-05-08T18:08:01.961 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.961 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.961 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.961 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:535 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.961 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:01.961 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.070556652999997, 2024-05-08T18:08:01.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055640899999999998, 2024-05-08T18:08:01.962 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.962 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.962 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.962 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.962 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.962 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.962 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 535 2024-05-08T18:08:01.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.962 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:01.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:01.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841494+0000", 2024-05-08T18:08:01.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0899999999999999e-06 2024-05-08T18:08:01.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841500+0000", 2024-05-08T18:08:01.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0249999999999999e-06 2024-05-08T18:08:01.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841513+0000", 2024-05-08T18:08:01.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3658e-05 2024-05-08T18:08:01.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841522+0000", 2024-05-08T18:08:01.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3410000000000003e-06 2024-05-08T18:08:01.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841574+0000", 2024-05-08T18:08:01.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2794000000000003e-05 2024-05-08T18:08:01.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841633+0000", 2024-05-08T18:08:01.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8595999999999999e-05 2024-05-08T18:08:01.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:01.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841755+0000", 2024-05-08T18:08:01.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012227399999999999 2024-05-08T18:08:01.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.842349+0000", 2024-05-08T18:08:01.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00059377699999999998 2024-05-08T18:08:01.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.846949+0000", 2024-05-08T18:08:01.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004599723 2024-05-08T18:08:01.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847008+0000", 2024-05-08T18:08:01.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8854999999999998e-05 2024-05-08T18:08:01.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847057+0000", 2024-05-08T18:08:01.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8956999999999999e-05 2024-05-08T18:08:01.970 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.970 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.970 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.970 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:541 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.970 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:01.970 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.063527123, 2024-05-08T18:08:01.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037829790000000001, 2024-05-08T18:08:01.970 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.970 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.971 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.971 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.971 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.971 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.971 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 541 2024-05-08T18:08:01.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.971 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:01.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:01.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848523+0000", 2024-05-08T18:08:01.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8599999999999997e-07 2024-05-08T18:08:01.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848526+0000", 2024-05-08T18:08:01.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4690000000000002e-06 2024-05-08T18:08:01.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848536+0000", 2024-05-08T18:08:01.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2029999999999998e-06 2024-05-08T18:08:01.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848540+0000", 2024-05-08T18:08:01.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9169999999999997e-06 2024-05-08T18:08:01.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848591+0000", 2024-05-08T18:08:01.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0328000000000003e-05 2024-05-08T18:08:01.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848646+0000", 2024-05-08T18:08:01.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5281999999999997e-05 2024-05-08T18:08:01.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:01.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848759+0000", 2024-05-08T18:08:01.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011278899999999999 2024-05-08T18:08:01.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.849323+0000", 2024-05-08T18:08:01.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056433999999999998 2024-05-08T18:08:01.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852225+0000", 2024-05-08T18:08:01.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029017320000000002 2024-05-08T18:08:01.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852277+0000", 2024-05-08T18:08:01.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2460999999999998e-05 2024-05-08T18:08:01.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852305+0000", 2024-05-08T18:08:01.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7671999999999999e-05 2024-05-08T18:08:01.976 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.976 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.976 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.976 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.976 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:01.977 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.930380046000003, 2024-05-08T18:08:01.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002973084, 2024-05-08T18:08:01.977 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.977 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.977 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.977 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.977 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.977 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.977 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 703 2024-05-08T18:08:01.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.977 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:01.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:01.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981672+0000", 2024-05-08T18:08:01.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5799999999999999e-06 2024-05-08T18:08:01.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981683+0000", 2024-05-08T18:08:01.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1270000000000001e-05 2024-05-08T18:08:01.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981715+0000", 2024-05-08T18:08:01.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1470000000000002e-05 2024-05-08T18:08:01.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981730+0000", 2024-05-08T18:08:01.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5262999999999999e-05 2024-05-08T18:08:01.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981864+0000", 2024-05-08T18:08:01.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134043 2024-05-08T18:08:01.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982168+0000", 2024-05-08T18:08:01.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030453799999999998 2024-05-08T18:08:01.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:01.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982620+0000", 2024-05-08T18:08:01.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045170900000000001 2024-05-08T18:08:01.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.983648+0000", 2024-05-08T18:08:01.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010276009999999999 2024-05-08T18:08:01.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984486+0000", 2024-05-08T18:08:01.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083874600000000002 2024-05-08T18:08:01.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984571+0000", 2024-05-08T18:08:01.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4370999999999996e-05 2024-05-08T18:08:01.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984642+0000", 2024-05-08T18:08:01.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1493000000000001e-05 2024-05-08T18:08:01.983 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.983 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.983 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.983 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:789 6.0 e32/26 6:0216b5b6:::obj_delete_at_hint.0000000070:head v 32'14, mlcod=32'12)", 2024-05-08T18:08:01.983 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:01.983 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.730953272999997, 2024-05-08T18:08:01.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034621420000000001, 2024-05-08T18:08:01.983 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.983 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.984 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.984 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:01.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:01.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181098+0000", 2024-05-08T18:08:01.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8029999999999999e-06 2024-05-08T18:08:01.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181109+0000", 2024-05-08T18:08:01.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1219999999999999e-05 2024-05-08T18:08:01.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181138+0000", 2024-05-08T18:08:01.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.898e-05 2024-05-08T18:08:01.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181151+0000", 2024-05-08T18:08:01.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.308e-05 2024-05-08T18:08:01.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181268+0000", 2024-05-08T18:08:01.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116629 2024-05-08T18:08:01.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181321+0000", 2024-05-08T18:08:01.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3325999999999997e-05 2024-05-08T18:08:01.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184477+0000", 2024-05-08T18:08:01.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003156458 2024-05-08T18:08:01.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184558+0000", 2024-05-08T18:08:01.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0646e-05 2024-05-08T18:08:01.987 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.987 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.987 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.988 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.988 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:01.988 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.699779769000003, 2024-05-08T18:08:01.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031146310000000001, 2024-05-08T18:08:01.988 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.988 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.988 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.988 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 802 2024-05-08T18:08:01.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.988 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:01.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:01.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212272+0000", 2024-05-08T18:08:01.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.943e-06 2024-05-08T18:08:01.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212284+0000", 2024-05-08T18:08:01.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1747e-05 2024-05-08T18:08:01.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212315+0000", 2024-05-08T18:08:01.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0579e-05 2024-05-08T18:08:01.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212336+0000", 2024-05-08T18:08:01.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1639999999999999e-05 2024-05-08T18:08:01.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212488+0000", 2024-05-08T18:08:01.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151192 2024-05-08T18:08:01.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212703+0000", 2024-05-08T18:08:01.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000215439 2024-05-08T18:08:01.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:01.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.213033+0000", 2024-05-08T18:08:01.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032992699999999999 2024-05-08T18:08:01.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.214306+0000", 2024-05-08T18:08:01.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012726949999999999 2024-05-08T18:08:01.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215232+0000", 2024-05-08T18:08:01.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092652999999999995 2024-05-08T18:08:01.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215321+0000", 2024-05-08T18:08:01.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9272999999999997e-05 2024-05-08T18:08:01.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215384+0000", 2024-05-08T18:08:01.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2665999999999999e-05 2024-05-08T18:08:01.993 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.993 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.993 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.993 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.993 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:01.993 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.619235363000001, 2024-05-08T18:08:01.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030150250000000002, 2024-05-08T18:08:01.993 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:01.993 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:01.994 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:01.994 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:01.994 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:01.994 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:01.994 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 838 2024-05-08T18:08:01.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.994 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:01.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:01.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:01.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:01.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:01.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:01.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:01.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292816+0000", 2024-05-08T18:08:01.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:08:01.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:01.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292828+0000", 2024-05-08T18:08:01.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.184e-05 2024-05-08T18:08:01.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:01.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292857+0000", 2024-05-08T18:08:01.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8960000000000001e-05 2024-05-08T18:08:01.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:01.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292871+0000", 2024-05-08T18:08:01.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.45e-05 2024-05-08T18:08:01.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:01.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293000+0000", 2024-05-08T18:08:01.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128875 2024-05-08T18:08:01.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:01.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293231+0000", 2024-05-08T18:08:01.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023030500000000001 2024-05-08T18:08:01.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:01.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293563+0000", 2024-05-08T18:08:01.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000332648 2024-05-08T18:08:01.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:01.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.294882+0000", 2024-05-08T18:08:01.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001319183 2024-05-08T18:08:01.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:01.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295664+0000", 2024-05-08T18:08:01.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000781991 2024-05-08T18:08:01.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:01.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295754+0000", 2024-05-08T18:08:01.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9176000000000001e-05 2024-05-08T18:08:01.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:01.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295829+0000", 2024-05-08T18:08:01.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.525e-05 2024-05-08T18:08:01.999 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.999 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:01.999 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:01.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:01.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:01.999 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:01.999 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:01.999 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.558101694000001, 2024-05-08T18:08:01.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029338929999999999, 2024-05-08T18:08:02.000 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:02.000 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:02.000 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.000 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:02.000 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:02.000 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.000 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 865 2024-05-08T18:08:02.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.000 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:02.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:02.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:02.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:02.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:02.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:02.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:02.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:02.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353950+0000", 2024-05-08T18:08:02.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2469999999999998e-06 2024-05-08T18:08:02.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:02.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353961+0000", 2024-05-08T18:08:02.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1523e-05 2024-05-08T18:08:02.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:02.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353991+0000", 2024-05-08T18:08:02.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9920000000000002e-05 2024-05-08T18:08:02.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354013+0000", 2024-05-08T18:08:02.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1590000000000002e-05 2024-05-08T18:08:02.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:02.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354206+0000", 2024-05-08T18:08:02.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019273900000000001 2024-05-08T18:08:02.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:02.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354418+0000", 2024-05-08T18:08:02.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212518 2024-05-08T18:08:02.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:02.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354720+0000", 2024-05-08T18:08:02.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030151800000000002 2024-05-08T18:08:02.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:02.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.355983+0000", 2024-05-08T18:08:02.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012636780000000001 2024-05-08T18:08:02.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356733+0000", 2024-05-08T18:08:02.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074988400000000003 2024-05-08T18:08:02.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:02.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356819+0000", 2024-05-08T18:08:02.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5690000000000001e-05 2024-05-08T18:08:02.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:02.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356881+0000", 2024-05-08T18:08:02.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2586e-05 2024-05-08T18:08:02.006 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:02.006 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:02.006 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:02.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.006 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.006 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:02.007 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.544978329000003, 2024-05-08T18:08:02.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004954511, 2024-05-08T18:08:02.007 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:02.007 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:02.007 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.007 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:02.007 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:02.007 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.007 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 871 2024-05-08T18:08:02.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.007 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:02.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:02.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:02.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:02.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:02.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:02.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:02.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:02.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367073+0000", 2024-05-08T18:08:02.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2340000000000001e-06 2024-05-08T18:08:02.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:02.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367085+0000", 2024-05-08T18:08:02.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1483e-05 2024-05-08T18:08:02.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:02.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367111+0000", 2024-05-08T18:08:02.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5890000000000001e-05 2024-05-08T18:08:02.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367130+0000", 2024-05-08T18:08:02.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9700000000000001e-05 2024-05-08T18:08:02.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:02.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367284+0000", 2024-05-08T18:08:02.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015411799999999999 2024-05-08T18:08:02.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:02.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367516+0000", 2024-05-08T18:08:02.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000231272 2024-05-08T18:08:02.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:02.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367837+0000", 2024-05-08T18:08:02.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032173400000000001 2024-05-08T18:08:02.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:02.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371395+0000", 2024-05-08T18:08:02.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035574719999999999 2024-05-08T18:08:02.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371882+0000", 2024-05-08T18:08:02.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048693899999999998 2024-05-08T18:08:02.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:02.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371962+0000", 2024-05-08T18:08:02.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.975e-05 2024-05-08T18:08:02.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:02.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372025+0000", 2024-05-08T18:08:02.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3918999999999996e-05 2024-05-08T18:08:02.013 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:02.013 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:02.013 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:02.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.013 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.014 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:02.014 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.539090625, 2024-05-08T18:08:02.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045233640000000002, 2024-05-08T18:08:02.014 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:02.014 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:02.014 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.014 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:02.014 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:02.014 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.014 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 873 2024-05-08T18:08:02.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.014 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:02.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:02.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:02.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:02.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:02.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:02.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:02.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:02.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372961+0000", 2024-05-08T18:08:02.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:08:02.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:02.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372969+0000", 2024-05-08T18:08:02.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2940000000000006e-06 2024-05-08T18:08:02.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:02.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372991+0000", 2024-05-08T18:08:02.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1829000000000001e-05 2024-05-08T18:08:02.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373009+0000", 2024-05-08T18:08:02.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8607e-05 2024-05-08T18:08:02.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:02.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373127+0000", 2024-05-08T18:08:02.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011728899999999999 2024-05-08T18:08:02.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:02.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373260+0000", 2024-05-08T18:08:02.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013301200000000001 2024-05-08T18:08:02.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:02.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373526+0000", 2024-05-08T18:08:02.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026613500000000003 2024-05-08T18:08:02.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:02.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.374558+0000", 2024-05-08T18:08:02.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001032156 2024-05-08T18:08:02.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377333+0000", 2024-05-08T18:08:02.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027749329999999998 2024-05-08T18:08:02.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:02.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377421+0000", 2024-05-08T18:08:02.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8679999999999998e-05 2024-05-08T18:08:02.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:02.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377482+0000", 2024-05-08T18:08:02.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0538999999999998e-05 2024-05-08T18:08:02.019 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:02.019 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:02.019 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:02.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.019 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.019 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:02.020 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.479481471, 2024-05-08T18:08:02.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035261009999999998, 2024-05-08T18:08:02.020 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:02.020 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:02.020 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.020 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:02.020 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:02.020 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.020 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 898 2024-05-08T18:08:02.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.020 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:02.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:02.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:02.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:02.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:02.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:02.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:02.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:02.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432570+0000", 2024-05-08T18:08:02.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.26e-06 2024-05-08T18:08:02.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:02.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432580+0000", 2024-05-08T18:08:02.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8570000000000007e-06 2024-05-08T18:08:02.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:02.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432605+0000", 2024-05-08T18:08:02.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5273e-05 2024-05-08T18:08:02.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432618+0000", 2024-05-08T18:08:02.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2999999999999999e-05 2024-05-08T18:08:02.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:02.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432742+0000", 2024-05-08T18:08:02.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012369200000000001 2024-05-08T18:08:02.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:02.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433109+0000", 2024-05-08T18:08:02.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036760500000000002 2024-05-08T18:08:02.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:02.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433645+0000", 2024-05-08T18:08:02.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053599599999999996 2024-05-08T18:08:02.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:02.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435050+0000", 2024-05-08T18:08:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001404696 2024-05-08T18:08:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435834+0000", 2024-05-08T18:08:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078381100000000003 2024-05-08T18:08:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435984+0000", 2024-05-08T18:08:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015006899999999999 2024-05-08T18:08:02.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:02.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.436094+0000", 2024-05-08T18:08:02.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109842 2024-05-08T18:08:02.025 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:02.025 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:02.025 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:02.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.025 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.025 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:02.026 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.474728622000001, 2024-05-08T18:08:02.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031481899999999999, 2024-05-08T18:08:02.026 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:02.026 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:02.026 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.026 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:02.026 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:02.026 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.026 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 900 2024-05-08T18:08:02.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.026 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:02.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:02.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:02.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:02.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:02.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:02.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:02.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:02.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437323+0000", 2024-05-08T18:08:02.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.447e-06 2024-05-08T18:08:02.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:02.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437334+0000", 2024-05-08T18:08:02.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0835999999999999e-05 2024-05-08T18:08:02.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:02.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437364+0000", 2024-05-08T18:08:02.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0463999999999998e-05 2024-05-08T18:08:02.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437379+0000", 2024-05-08T18:08:02.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4806e-05 2024-05-08T18:08:02.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:02.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437500+0000", 2024-05-08T18:08:02.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121309 2024-05-08T18:08:02.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:02.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437729+0000", 2024-05-08T18:08:02.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022818200000000001 2024-05-08T18:08:02.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:02.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.438199+0000", 2024-05-08T18:08:02.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047025300000000001 2024-05-08T18:08:02.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:02.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.439418+0000", 2024-05-08T18:08:02.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012193849999999999 2024-05-08T18:08:02.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440217+0000", 2024-05-08T18:08:02.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00079905999999999998 2024-05-08T18:08:02.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:02.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440352+0000", 2024-05-08T18:08:02.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013485299999999999 2024-05-08T18:08:02.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:02.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440469+0000", 2024-05-08T18:08:02.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116595 2024-05-08T18:08:02.032 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:02.032 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:02.032 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:02.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.033 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.033 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:02.033 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.388492616999997, 2024-05-08T18:08:02.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003477894, 2024-05-08T18:08:02.033 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:02.033 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:02.033 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.033 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:02.033 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:02.033 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.033 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 937 2024-05-08T18:08:02.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.034 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:02.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:02.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:02.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:02.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:02.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:02.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:02.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:02.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523559+0000", 2024-05-08T18:08:02.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.95e-06 2024-05-08T18:08:02.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:02.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523567+0000", 2024-05-08T18:08:02.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6799999999999999e-06 2024-05-08T18:08:02.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:02.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523591+0000", 2024-05-08T18:08:02.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3269e-05 2024-05-08T18:08:02.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523611+0000", 2024-05-08T18:08:02.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0100000000000001e-05 2024-05-08T18:08:02.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:02.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523767+0000", 2024-05-08T18:08:02.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015604900000000001 2024-05-08T18:08:02.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:02.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523994+0000", 2024-05-08T18:08:02.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022764199999999999 2024-05-08T18:08:02.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:02.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.524338+0000", 2024-05-08T18:08:02.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034388700000000002 2024-05-08T18:08:02.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:02.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.525707+0000", 2024-05-08T18:08:02.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001368544 2024-05-08T18:08:02.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526843+0000", 2024-05-08T18:08:02.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001136501 2024-05-08T18:08:02.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:02.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526957+0000", 2024-05-08T18:08:02.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011359 2024-05-08T18:08:02.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:02.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:02.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:02.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.527035+0000", 2024-05-08T18:08:02.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7682000000000006e-05 2024-05-08T18:08:02.039 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:02.039 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:02.039 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:02.039 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:02.039 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:02.039 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:02.041 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:08:02.042 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:02.038+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:02.142 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:02.138+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:02.173 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:02.173 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:02.173 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:02.173 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:02.187 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:08:02.243 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:02.245+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:02.344 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:02.342+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:02.350 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:02.350 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:02.350 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:02.350 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:02.350 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:02.364 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:08:02.387 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-05-08T18:08:02.459 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:02.461+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:02.534 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:02.534 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:02.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:02.534 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:02.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.534 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:36 5.e 5:71234df9:::zone_info.d0a95a6c-3c84-4d52-915c-e8ea581dfb9b:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:08:02.534 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:02.534 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.960822122000003, 2024-05-08T18:08:02.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028394430000000001, 2024-05-08T18:08:02.535 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.535 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.535 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.535 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.535 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:08:02.535 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:08:02.535 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 36 2024-05-08T18:08:02.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.535 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:02.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:02.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573456+0000", 2024-05-08T18:08:02.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:02.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573467+0000", 2024-05-08T18:08:02.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1243999999999999e-05 2024-05-08T18:08:02.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573499+0000", 2024-05-08T18:08:02.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1343000000000001e-05 2024-05-08T18:08:02.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573522+0000", 2024-05-08T18:08:02.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3540000000000002e-05 2024-05-08T18:08:02.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573634+0000", 2024-05-08T18:08:02.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112249 2024-05-08T18:08:02.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573841+0000", 2024-05-08T18:08:02.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000206407 2024-05-08T18:08:02.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:02.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.574122+0000", 2024-05-08T18:08:02.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000281475 2024-05-08T18:08:02.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.575489+0000", 2024-05-08T18:08:02.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001366391 2024-05-08T18:08:02.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576157+0000", 2024-05-08T18:08:02.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00066776200000000002 2024-05-08T18:08:02.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576234+0000", 2024-05-08T18:08:02.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7285000000000003e-05 2024-05-08T18:08:02.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576293+0000", 2024-05-08T18:08:02.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9556999999999999e-05 2024-05-08T18:08:02.540 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.540 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.540 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.540 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:02.540 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:02.540 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 41.004062929, 2024-05-08T18:08:02.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018560765, 2024-05-08T18:08:02.540 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.540 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.541 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:08:02.541 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.541 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.541 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.541 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 43 2024-05-08T18:08:02.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.541 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:02.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:02.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530217+0000", 2024-05-08T18:08:02.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:08:02.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530253+0000", 2024-05-08T18:08:02.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5621999999999999e-05 2024-05-08T18:08:02.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530288+0000", 2024-05-08T18:08:02.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5846999999999997e-05 2024-05-08T18:08:02.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530314+0000", 2024-05-08T18:08:02.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5732e-05 2024-05-08T18:08:02.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530952+0000", 2024-05-08T18:08:02.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00063739999999999999 2024-05-08T18:08:02.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530977+0000", 2024-05-08T18:08:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5375e-05 2024-05-08T18:08:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548506+0000", 2024-05-08T18:08:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017528781 2024-05-08T18:08:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548774+0000", 2024-05-08T18:08:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026821199999999999 2024-05-08T18:08:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.544 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.921749005000002, 2024-05-08T18:08:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003496893, 2024-05-08T18:08:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 211 2024-05-08T18:08:02.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.546 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:02.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:02.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612530+0000", 2024-05-08T18:08:02.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9490000000000001e-06 2024-05-08T18:08:02.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612544+0000", 2024-05-08T18:08:02.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3779e-05 2024-05-08T18:08:02.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612578+0000", 2024-05-08T18:08:02.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4421000000000001e-05 2024-05-08T18:08:02.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612596+0000", 2024-05-08T18:08:02.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7435000000000002e-05 2024-05-08T18:08:02.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612718+0000", 2024-05-08T18:08:02.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012218600000000001 2024-05-08T18:08:02.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612951+0000", 2024-05-08T18:08:02.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000232768 2024-05-08T18:08:02.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:02.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.613370+0000", 2024-05-08T18:08:02.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041921200000000002 2024-05-08T18:08:02.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.614840+0000", 2024-05-08T18:08:02.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014703679999999999 2024-05-08T18:08:02.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615860+0000", 2024-05-08T18:08:02.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010198220000000001 2024-05-08T18:08:02.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615954+0000", 2024-05-08T18:08:02.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4419000000000005e-05 2024-05-08T18:08:02.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.616024+0000", 2024-05-08T18:08:02.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9534000000000002e-05 2024-05-08T18:08:02.550 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.550 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.550 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.550 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.551 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:02.551 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.845059323000001, 2024-05-08T18:08:02.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035800939999999998, 2024-05-08T18:08:02.551 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.551 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.551 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.551 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.551 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.551 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.551 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 232 2024-05-08T18:08:02.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.551 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:02.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:02.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689219+0000", 2024-05-08T18:08:02.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4490000000000002e-06 2024-05-08T18:08:02.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689232+0000", 2024-05-08T18:08:02.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3183000000000001e-05 2024-05-08T18:08:02.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689263+0000", 2024-05-08T18:08:02.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400999999999999e-05 2024-05-08T18:08:02.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689279+0000", 2024-05-08T18:08:02.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6078000000000001e-05 2024-05-08T18:08:02.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689401+0000", 2024-05-08T18:08:02.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012243000000000001 2024-05-08T18:08:02.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689656+0000", 2024-05-08T18:08:02.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431899999999998 2024-05-08T18:08:02.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:02.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.690103+0000", 2024-05-08T18:08:02.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044706299999999999 2024-05-08T18:08:02.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.691780+0000", 2024-05-08T18:08:02.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016774209999999999 2024-05-08T18:08:02.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692634+0000", 2024-05-08T18:08:02.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085346 2024-05-08T18:08:02.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692728+0000", 2024-05-08T18:08:02.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4429e-05 2024-05-08T18:08:02.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692797+0000", 2024-05-08T18:08:02.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8861000000000004e-05 2024-05-08T18:08:02.556 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.556 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.556 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.556 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:267 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.556 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:02.556 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.820414345000003, 2024-05-08T18:08:02.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040291739999999999, 2024-05-08T18:08:02.557 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.557 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.557 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.557 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.557 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.557 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.557 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 267 2024-05-08T18:08:02.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.557 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:02.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:02.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713863+0000", 2024-05-08T18:08:02.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5200000000000001e-06 2024-05-08T18:08:02.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713873+0000", 2024-05-08T18:08:02.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9089999999999995e-06 2024-05-08T18:08:02.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713896+0000", 2024-05-08T18:08:02.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2595e-05 2024-05-08T18:08:02.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713914+0000", 2024-05-08T18:08:02.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7869000000000001e-05 2024-05-08T18:08:02.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714048+0000", 2024-05-08T18:08:02.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134802 2024-05-08T18:08:02.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714278+0000", 2024-05-08T18:08:02.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022994399999999999 2024-05-08T18:08:02.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:02.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714777+0000", 2024-05-08T18:08:02.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049880499999999995 2024-05-08T18:08:02.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.715976+0000", 2024-05-08T18:08:02.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011991110000000001 2024-05-08T18:08:02.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717646+0000", 2024-05-08T18:08:02.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016699989999999999 2024-05-08T18:08:02.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717790+0000", 2024-05-08T18:08:02.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014359799999999999 2024-05-08T18:08:02.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717891+0000", 2024-05-08T18:08:02.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101022 2024-05-08T18:08:02.562 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.562 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.562 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.562 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:308 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:02.562 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:02.562 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.813047105000003, 2024-05-08T18:08:02.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031672779999999999, 2024-05-08T18:08:02.562 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.563 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.563 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.563 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:02.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:02.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721230+0000", 2024-05-08T18:08:02.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:08:02.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721241+0000", 2024-05-08T18:08:02.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0942e-05 2024-05-08T18:08:02.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721265+0000", 2024-05-08T18:08:02.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3371e-05 2024-05-08T18:08:02.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721278+0000", 2024-05-08T18:08:02.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3586e-05 2024-05-08T18:08:02.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721399+0000", 2024-05-08T18:08:02.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012092 2024-05-08T18:08:02.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721507+0000", 2024-05-08T18:08:02.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107651 2024-05-08T18:08:02.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724292+0000", 2024-05-08T18:08:02.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027851870000000002 2024-05-08T18:08:02.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724396+0000", 2024-05-08T18:08:02.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000104114 2024-05-08T18:08:02.566 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.566 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.567 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.567 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:495 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.567 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:02.567 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.730429204000004, 2024-05-08T18:08:02.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005951001, 2024-05-08T18:08:02.567 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.567 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.567 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.567 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.567 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.568 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.568 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 495 2024-05-08T18:08:02.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.568 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:02.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:02.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803849+0000", 2024-05-08T18:08:02.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3580000000000001e-06 2024-05-08T18:08:02.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803864+0000", 2024-05-08T18:08:02.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4742999999999999e-05 2024-05-08T18:08:02.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803895+0000", 2024-05-08T18:08:02.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0970000000000003e-05 2024-05-08T18:08:02.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803908+0000", 2024-05-08T18:08:02.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2588999999999999e-05 2024-05-08T18:08:02.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804005+0000", 2024-05-08T18:08:02.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7107000000000004e-05 2024-05-08T18:08:02.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804291+0000", 2024-05-08T18:08:02.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028626900000000002 2024-05-08T18:08:02.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:02.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804648+0000", 2024-05-08T18:08:02.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000356955 2024-05-08T18:08:02.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805740+0000", 2024-05-08T18:08:02.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001091905 2024-05-08T18:08:02.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809636+0000", 2024-05-08T18:08:02.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389661 2024-05-08T18:08:02.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809722+0000", 2024-05-08T18:08:02.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:08:02.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809798+0000", 2024-05-08T18:08:02.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5462000000000004e-05 2024-05-08T18:08:02.573 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.574 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.574 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.574 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.574 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:02.574 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.723817885999999, 2024-05-08T18:08:02.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051396380000000002, 2024-05-08T18:08:02.574 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.574 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.574 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.574 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.575 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.575 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.575 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 504 2024-05-08T18:08:02.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.575 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:02.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:02.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810460+0000", 2024-05-08T18:08:02.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:08:02.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810470+0000", 2024-05-08T18:08:02.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0222e-05 2024-05-08T18:08:02.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810495+0000", 2024-05-08T18:08:02.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4508999999999999e-05 2024-05-08T18:08:02.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810515+0000", 2024-05-08T18:08:02.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9998999999999999e-05 2024-05-08T18:08:02.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810653+0000", 2024-05-08T18:08:02.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013851099999999999 2024-05-08T18:08:02.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810782+0000", 2024-05-08T18:08:02.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128152 2024-05-08T18:08:02.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:02.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811043+0000", 2024-05-08T18:08:02.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026172400000000002 2024-05-08T18:08:02.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812164+0000", 2024-05-08T18:08:02.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001121024 2024-05-08T18:08:02.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815415+0000", 2024-05-08T18:08:02.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032510270000000001 2024-05-08T18:08:02.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815538+0000", 2024-05-08T18:08:02.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012256999999999999 2024-05-08T18:08:02.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815598+0000", 2024-05-08T18:08:02.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9923000000000002e-05 2024-05-08T18:08:02.581 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.581 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.581 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.581 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:629 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.581 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:02.581 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.615513145999998, 2024-05-08T18:08:02.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611169999999998, 2024-05-08T18:08:02.581 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.581 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.581 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.581 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.582 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.582 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.582 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 629 2024-05-08T18:08:02.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.582 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:02.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:02.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918765+0000", 2024-05-08T18:08:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5670000000000002e-06 2024-05-08T18:08:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918777+0000", 2024-05-08T18:08:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1635e-05 2024-05-08T18:08:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918808+0000", 2024-05-08T18:08:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1024e-05 2024-05-08T18:08:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918823+0000", 2024-05-08T18:08:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4939e-05 2024-05-08T18:08:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918930+0000", 2024-05-08T18:08:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107144 2024-05-08T18:08:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919147+0000", 2024-05-08T18:08:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021682599999999999 2024-05-08T18:08:02.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919464+0000", 2024-05-08T18:08:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031716699999999998 2024-05-08T18:08:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.920561+0000", 2024-05-08T18:08:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010970229999999999 2024-05-08T18:08:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921468+0000", 2024-05-08T18:08:02.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00090726800000000003 2024-05-08T18:08:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921549+0000", 2024-05-08T18:08:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0430000000000001e-05 2024-05-08T18:08:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921624+0000", 2024-05-08T18:08:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5093999999999996e-05 2024-05-08T18:08:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:681 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.575192397999999, 2024-05-08T18:08:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044793259999999996, 2024-05-08T18:08:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 681 2024-05-08T18:08:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.587 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959085+0000", 2024-05-08T18:08:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.353e-06 2024-05-08T18:08:02.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959092+0000", 2024-05-08T18:08:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999999e-06 2024-05-08T18:08:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959113+0000", 2024-05-08T18:08:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0744e-05 2024-05-08T18:08:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959130+0000", 2024-05-08T18:08:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7679000000000001e-05 2024-05-08T18:08:02.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959217+0000", 2024-05-08T18:08:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6487000000000001e-05 2024-05-08T18:08:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959335+0000", 2024-05-08T18:08:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118476 2024-05-08T18:08:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959598+0000", 2024-05-08T18:08:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000263045 2024-05-08T18:08:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.960551+0000", 2024-05-08T18:08:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095251500000000002 2024-05-08T18:08:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963412+0000", 2024-05-08T18:08:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611800000000001 2024-05-08T18:08:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963498+0000", 2024-05-08T18:08:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6145999999999998e-05 2024-05-08T18:08:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963563+0000", 2024-05-08T18:08:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4701000000000003e-05 2024-05-08T18:08:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.540243961999998, 2024-05-08T18:08:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031621710000000001, 2024-05-08T18:08:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 709 2024-05-08T18:08:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.593 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994035+0000", 2024-05-08T18:08:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6460000000000002e-06 2024-05-08T18:08:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994047+0000", 2024-05-08T18:08:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999e-05 2024-05-08T18:08:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994076+0000", 2024-05-08T18:08:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9564e-05 2024-05-08T18:08:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994091+0000", 2024-05-08T18:08:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4696e-05 2024-05-08T18:08:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994239+0000", 2024-05-08T18:08:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014779699999999999 2024-05-08T18:08:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994585+0000", 2024-05-08T18:08:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034605900000000002 2024-05-08T18:08:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.995084+0000", 2024-05-08T18:08:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049904799999999998 2024-05-08T18:08:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.996558+0000", 2024-05-08T18:08:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001474532 2024-05-08T18:08:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997045+0000", 2024-05-08T18:08:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048685900000000002 2024-05-08T18:08:02.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997127+0000", 2024-05-08T18:08:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1280999999999996e-05 2024-05-08T18:08:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997194+0000", 2024-05-08T18:08:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7689999999999997e-05 2024-05-08T18:08:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.504854576, 2024-05-08T18:08:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003066236, 2024-05-08T18:08:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 724 2024-05-08T18:08:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029424+0000", 2024-05-08T18:08:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.503e-06 2024-05-08T18:08:02.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029437+0000", 2024-05-08T18:08:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3309000000000001e-05 2024-05-08T18:08:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029467+0000", 2024-05-08T18:08:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9677999999999999e-05 2024-05-08T18:08:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029489+0000", 2024-05-08T18:08:02.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2314999999999999e-05 2024-05-08T18:08:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029600+0000", 2024-05-08T18:08:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110561 2024-05-08T18:08:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029896+0000", 2024-05-08T18:08:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029632200000000001 2024-05-08T18:08:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:02.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.030468+0000", 2024-05-08T18:08:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00057224700000000001 2024-05-08T18:08:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.031728+0000", 2024-05-08T18:08:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012595429999999999 2024-05-08T18:08:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032338+0000", 2024-05-08T18:08:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00061006700000000005 2024-05-08T18:08:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032424+0000", 2024-05-08T18:08:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032488+0000", 2024-05-08T18:08:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4210999999999999e-05 2024-05-08T18:08:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.604 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.500204162000003, 2024-05-08T18:08:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029269769999999999, 2024-05-08T18:08:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 726 2024-05-08T18:08:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034074+0000", 2024-05-08T18:08:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5900000000000002e-06 2024-05-08T18:08:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034086+0000", 2024-05-08T18:08:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1265e-05 2024-05-08T18:08:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034118+0000", 2024-05-08T18:08:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2341000000000001e-05 2024-05-08T18:08:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034133+0000", 2024-05-08T18:08:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5166e-05 2024-05-08T18:08:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034254+0000", 2024-05-08T18:08:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121033 2024-05-08T18:08:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034492+0000", 2024-05-08T18:08:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023727700000000001 2024-05-08T18:08:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034967+0000", 2024-05-08T18:08:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047522100000000001 2024-05-08T18:08:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036353+0000", 2024-05-08T18:08:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013865800000000001 2024-05-08T18:08:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036841+0000", 2024-05-08T18:08:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048788999999999999 2024-05-08T18:08:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036929+0000", 2024-05-08T18:08:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:08:02.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036999+0000", 2024-05-08T18:08:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9448000000000003e-05 2024-05-08T18:08:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.496909332000001, 2024-05-08T18:08:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003040662, 2024-05-08T18:08:02.610 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 727 2024-05-08T18:08:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:02.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037369+0000", 2024-05-08T18:08:02.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:08:02.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037378+0000", 2024-05-08T18:08:02.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5359999999999998e-06 2024-05-08T18:08:02.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037405+0000", 2024-05-08T18:08:02.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6588e-05 2024-05-08T18:08:02.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037418+0000", 2024-05-08T18:08:02.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3642000000000001e-05 2024-05-08T18:08:02.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037531+0000", 2024-05-08T18:08:02.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112304 2024-05-08T18:08:02.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037785+0000", 2024-05-08T18:08:02.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025391299999999998 2024-05-08T18:08:02.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:02.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.038112+0000", 2024-05-08T18:08:02.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000326946 2024-05-08T18:08:02.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.039316+0000", 2024-05-08T18:08:02.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012043990000000001 2024-05-08T18:08:02.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040257+0000", 2024-05-08T18:08:02.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000941083 2024-05-08T18:08:02.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040345+0000", 2024-05-08T18:08:02.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8368999999999994e-05 2024-05-08T18:08:02.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040407+0000", 2024-05-08T18:08:02.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1941999999999997e-05 2024-05-08T18:08:02.615 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.615 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.616 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.616 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.616 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:02.616 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.382243942999999, 2024-05-08T18:08:02.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028797779999999999, 2024-05-08T18:08:02.616 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.616 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.616 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.616 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.616 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.616 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.616 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 777 2024-05-08T18:08:02.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.616 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:02.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:02.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152034+0000", 2024-05-08T18:08:02.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2299999999999998e-06 2024-05-08T18:08:02.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152045+0000", 2024-05-08T18:08:02.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0266e-05 2024-05-08T18:08:02.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152076+0000", 2024-05-08T18:08:02.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1007000000000003e-05 2024-05-08T18:08:02.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152094+0000", 2024-05-08T18:08:02.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8148999999999999e-05 2024-05-08T18:08:02.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152183+0000", 2024-05-08T18:08:02.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8845999999999996e-05 2024-05-08T18:08:02.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152308+0000", 2024-05-08T18:08:02.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012502999999999999 2024-05-08T18:08:02.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:02.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152578+0000", 2024-05-08T18:08:02.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027080099999999998 2024-05-08T18:08:02.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154238+0000", 2024-05-08T18:08:02.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016600180000000001 2024-05-08T18:08:02.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154714+0000", 2024-05-08T18:08:02.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000475341 2024-05-08T18:08:02.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154803+0000", 2024-05-08T18:08:02.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9566000000000003e-05 2024-05-08T18:08:02.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154912+0000", 2024-05-08T18:08:02.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010852400000000001 2024-05-08T18:08:02.621 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.621 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.621 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.621 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.621 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:02.622 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.13902805, 2024-05-08T18:08:02.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002844437, 2024-05-08T18:08:02.622 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.622 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.622 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.622 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.622 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.622 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.622 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 882 2024-05-08T18:08:02.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.622 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:02.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:02.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395250+0000", 2024-05-08T18:08:02.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-06 2024-05-08T18:08:02.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395261+0000", 2024-05-08T18:08:02.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1046000000000001e-05 2024-05-08T18:08:02.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395293+0000", 2024-05-08T18:08:02.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1473999999999997e-05 2024-05-08T18:08:02.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395307+0000", 2024-05-08T18:08:02.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4599e-05 2024-05-08T18:08:02.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395481+0000", 2024-05-08T18:08:02.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173499 2024-05-08T18:08:02.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395626+0000", 2024-05-08T18:08:02.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000145351 2024-05-08T18:08:02.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:02.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395902+0000", 2024-05-08T18:08:02.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027534499999999997 2024-05-08T18:08:02.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397118+0000", 2024-05-08T18:08:02.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012168929999999999 2024-05-08T18:08:02.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397951+0000", 2024-05-08T18:08:02.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000832272 2024-05-08T18:08:02.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398028+0000", 2024-05-08T18:08:02.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6921000000000004e-05 2024-05-08T18:08:02.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398092+0000", 2024-05-08T18:08:02.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4783999999999995e-05 2024-05-08T18:08:02.627 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.627 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.627 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.627 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.627 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:02.627 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.13596733, 2024-05-08T18:08:02.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002853894, 2024-05-08T18:08:02.627 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.627 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.628 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.628 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.628 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.628 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.628 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 883 2024-05-08T18:08:02.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.628 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:02.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:02.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398311+0000", 2024-05-08T18:08:02.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:02.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398321+0000", 2024-05-08T18:08:02.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9189999999999994e-06 2024-05-08T18:08:02.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398346+0000", 2024-05-08T18:08:02.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5065000000000001e-05 2024-05-08T18:08:02.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398360+0000", 2024-05-08T18:08:02.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4171999999999999e-05 2024-05-08T18:08:02.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398495+0000", 2024-05-08T18:08:02.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013503199999999999 2024-05-08T18:08:02.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398716+0000", 2024-05-08T18:08:02.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220459 2024-05-08T18:08:02.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:02.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.399054+0000", 2024-05-08T18:08:02.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033806199999999998 2024-05-08T18:08:02.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.400192+0000", 2024-05-08T18:08:02.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011389169999999999 2024-05-08T18:08:02.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401020+0000", 2024-05-08T18:08:02.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082746199999999995 2024-05-08T18:08:02.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401099+0000", 2024-05-08T18:08:02.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9157000000000001e-05 2024-05-08T18:08:02.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401163+0000", 2024-05-08T18:08:02.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3498999999999996e-05 2024-05-08T18:08:02.633 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.633 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.633 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.633 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.633 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:02.633 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.132178492999998, 2024-05-08T18:08:02.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031354040000000001, 2024-05-08T18:08:02.633 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.633 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.633 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.634 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.634 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.634 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.634 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 885 2024-05-08T18:08:02.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.634 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:02.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:02.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402100+0000", 2024-05-08T18:08:02.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.063e-06 2024-05-08T18:08:02.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402110+0000", 2024-05-08T18:08:02.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0453e-05 2024-05-08T18:08:02.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402141+0000", 2024-05-08T18:08:02.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0651000000000002e-05 2024-05-08T18:08:02.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402162+0000", 2024-05-08T18:08:02.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1373999999999999e-05 2024-05-08T18:08:02.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402306+0000", 2024-05-08T18:08:02.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143492 2024-05-08T18:08:02.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402562+0000", 2024-05-08T18:08:02.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025671899999999998 2024-05-08T18:08:02.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:02.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.403047+0000", 2024-05-08T18:08:02.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048419100000000003 2024-05-08T18:08:02.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404370+0000", 2024-05-08T18:08:02.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013231580000000001 2024-05-08T18:08:02.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404966+0000", 2024-05-08T18:08:02.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00059601100000000002 2024-05-08T18:08:02.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405115+0000", 2024-05-08T18:08:02.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149665 2024-05-08T18:08:02.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405233+0000", 2024-05-08T18:08:02.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117627 2024-05-08T18:08:02.638 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.639 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.639 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.639 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.639 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:02.639 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.034880958000002, 2024-05-08T18:08:02.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003251168, 2024-05-08T18:08:02.639 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.639 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.639 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.639 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.639 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.639 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.640 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 927 2024-05-08T18:08:02.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.640 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:02.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:02.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499396+0000", 2024-05-08T18:08:02.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:08:02.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499404+0000", 2024-05-08T18:08:02.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2629999999999997e-06 2024-05-08T18:08:02.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499423+0000", 2024-05-08T18:08:02.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9695e-05 2024-05-08T18:08:02.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499435+0000", 2024-05-08T18:08:02.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1542999999999999e-05 2024-05-08T18:08:02.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499545+0000", 2024-05-08T18:08:02.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110064 2024-05-08T18:08:02.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499764+0000", 2024-05-08T18:08:02.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021856499999999999 2024-05-08T18:08:02.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:02.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.500237+0000", 2024-05-08T18:08:02.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047359499999999999 2024-05-08T18:08:02.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.501627+0000", 2024-05-08T18:08:02.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013897860000000001 2024-05-08T18:08:02.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502484+0000", 2024-05-08T18:08:02.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085733300000000005 2024-05-08T18:08:02.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502574+0000", 2024-05-08T18:08:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9939999999999996e-05 2024-05-08T18:08:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502646+0000", 2024-05-08T18:08:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2064000000000007e-05 2024-05-08T18:08:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.031381416999999, 2024-05-08T18:08:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031881129999999998, 2024-05-08T18:08:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 928 2024-05-08T18:08:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502897+0000", 2024-05-08T18:08:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.916e-06 2024-05-08T18:08:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502906+0000", 2024-05-08T18:08:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2699999999999993e-06 2024-05-08T18:08:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502933+0000", 2024-05-08T18:08:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6823999999999999e-05 2024-05-08T18:08:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502946+0000", 2024-05-08T18:08:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3439e-05 2024-05-08T18:08:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503066+0000", 2024-05-08T18:08:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012013700000000001 2024-05-08T18:08:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503399+0000", 2024-05-08T18:08:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033298600000000001 2024-05-08T18:08:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503928+0000", 2024-05-08T18:08:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052877299999999996 2024-05-08T18:08:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505291+0000", 2024-05-08T18:08:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001363319 2024-05-08T18:08:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505933+0000", 2024-05-08T18:08:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064135799999999997 2024-05-08T18:08:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506019+0000", 2024-05-08T18:08:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6649000000000003e-05 2024-05-08T18:08:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506083+0000", 2024-05-08T18:08:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3441999999999993e-05 2024-05-08T18:08:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.650 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.650 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.650 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:02.650 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:02.650 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:02.650 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:08:02.652 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:02.653+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:02.652 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:08:02.752 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:02.753+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:02.780 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:02.780 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:02.780 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:02.780 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:02.794 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:08:02.805 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:02.806 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:02.821 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:02.821 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:02.836 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:02.836 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:02.851 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:02.852 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:02.852 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:02.853+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:02.868 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:02.868 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:02.884 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:02.885 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:02.904 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:02.904 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:02.917 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:02.917 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:02.924 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:02.924 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:02.931 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:08:02.976 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:02.974+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:03.054 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:03.053+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:03.054 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:03.054 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:03.067 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:08:03.156 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:03.154+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:03.235 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:03.235 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:03.249 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:08:03.292 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:03.290+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:03.356 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:03.354+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:03.409 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:03.409 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:03.425 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:08:03.457 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:03.461+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:03.558 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:03.557+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:03.590 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:03.591 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:03.605 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:08:03.659 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:03.654+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:03.725 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:03.726 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:03.740 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:08:03.784 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:03.782+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:03.860 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:03.861+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:03.903 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:03.903 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:03.917 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:08:03.964 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:03.962+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:04.043 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:04.043 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:04.057 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:08:04.107 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:04.109+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:04.163 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:04.162+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:04.189 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:04.189 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:04.204 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:08:04.264 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:04.262+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:04.364 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:04.364 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:04.365 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:04.362+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:04.378 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:08:04.417 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:08:04.466 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:04.462+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:04.495 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:04.495 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:04.510 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:08:04.567 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:04.569+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:04.632 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:04.632 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:04.646 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:08:04.668 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:04.670+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:04.770 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:04.770+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:04.806 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:04.807 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:04.820 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:08:04.870 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:04.873+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:04.941 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:08:04.944 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:04.944 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:04.958 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:08:04.972 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:04.970+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:05.072 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:05.073+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:05.084 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:05.084 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:05.100 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:05.101 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:05.117 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:05.118 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:05.124 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:05.124 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:05.125 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:05.125 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:05.135 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:05.135 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:05.138 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:08:05.156 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:05.156 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:05.177 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:05.177 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:05.177 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:05.177+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:05.197 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:05.198 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:05.218 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:05.219 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:05.274 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:05.270+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:05.276 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:05.276 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:05.277 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:05.277 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:05.277 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:05.290 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:08:05.375 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:05.374+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:05.406 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-05-08T18:08:05.457 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:05.457 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:05.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:05.457 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:05.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.457 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:05.458 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:05.458 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 41.883701856999998, 2024-05-08T18:08:05.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002466088, 2024-05-08T18:08:05.458 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.458 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.458 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.458 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.458 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.458 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.458 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 52 2024-05-08T18:08:05.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.458 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:05.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:05.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577062+0000", 2024-05-08T18:08:05.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.994e-06 2024-05-08T18:08:05.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577075+0000", 2024-05-08T18:08:05.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2480000000000001e-05 2024-05-08T18:08:05.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577108+0000", 2024-05-08T18:08:05.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3096000000000003e-05 2024-05-08T18:08:05.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577131+0000", 2024-05-08T18:08:05.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2993000000000002e-05 2024-05-08T18:08:05.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577260+0000", 2024-05-08T18:08:05.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012912899999999999 2024-05-08T18:08:05.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577453+0000", 2024-05-08T18:08:05.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000193668 2024-05-08T18:08:05.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:05.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577634+0000", 2024-05-08T18:08:05.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180576 2024-05-08T18:08:05.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579082+0000", 2024-05-08T18:08:05.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001448083 2024-05-08T18:08:05.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579290+0000", 2024-05-08T18:08:05.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000208333 2024-05-08T18:08:05.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579403+0000", 2024-05-08T18:08:05.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011296800000000001 2024-05-08T18:08:05.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579525+0000", 2024-05-08T18:08:05.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121768 2024-05-08T18:08:05.463 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.463 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.463 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.463 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:05.463 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:05.463 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 41.871842092000001, 2024-05-08T18:08:05.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038858310000000002, 2024-05-08T18:08:05.463 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.463 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.463 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.463 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:05.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:05.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588920+0000", 2024-05-08T18:08:05.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.23e-07 2024-05-08T18:08:05.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588929+0000", 2024-05-08T18:08:05.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3659999999999998e-06 2024-05-08T18:08:05.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588948+0000", 2024-05-08T18:08:05.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8768000000000001e-05 2024-05-08T18:08:05.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588962+0000", 2024-05-08T18:08:05.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4e-05 2024-05-08T18:08:05.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589110+0000", 2024-05-08T18:08:05.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148047 2024-05-08T18:08:05.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589173+0000", 2024-05-08T18:08:05.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2766000000000002e-05 2024-05-08T18:08:05.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592728+0000", 2024-05-08T18:08:05.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035553300000000002 2024-05-08T18:08:05.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592805+0000", 2024-05-08T18:08:05.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6730999999999994e-05 2024-05-08T18:08:05.467 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.467 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.467 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.467 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.467 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:05.467 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.755773194, 2024-05-08T18:08:05.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034354310000000001, 2024-05-08T18:08:05.468 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.468 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.468 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.468 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.468 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.468 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.468 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 236 2024-05-08T18:08:05.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.468 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:05.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:05.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704991+0000", 2024-05-08T18:08:05.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1240000000000001e-06 2024-05-08T18:08:05.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705009+0000", 2024-05-08T18:08:05.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7819e-05 2024-05-08T18:08:05.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705048+0000", 2024-05-08T18:08:05.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9632999999999998e-05 2024-05-08T18:08:05.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705073+0000", 2024-05-08T18:08:05.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4686999999999999e-05 2024-05-08T18:08:05.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705241+0000", 2024-05-08T18:08:05.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759899999999999 2024-05-08T18:08:05.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705511+0000", 2024-05-08T18:08:05.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027018799999999998 2024-05-08T18:08:05.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:05.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705965+0000", 2024-05-08T18:08:05.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045433000000000002 2024-05-08T18:08:05.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.707487+0000", 2024-05-08T18:08:05.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015214810000000001 2024-05-08T18:08:05.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708125+0000", 2024-05-08T18:08:05.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063870300000000001 2024-05-08T18:08:05.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708298+0000", 2024-05-08T18:08:05.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172592 2024-05-08T18:08:05.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708423+0000", 2024-05-08T18:08:05.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125275 2024-05-08T18:08:05.472 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.473 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.473 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:308 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.473 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:05.473 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.738935292000001, 2024-05-08T18:08:05.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038707400000000001, 2024-05-08T18:08:05.473 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.473 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.473 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.473 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.473 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.473 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.473 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 308 2024-05-08T18:08:05.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.474 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:05.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:05.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721827+0000", 2024-05-08T18:08:05.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1519999999999999e-06 2024-05-08T18:08:05.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721840+0000", 2024-05-08T18:08:05.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.362e-05 2024-05-08T18:08:05.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721857+0000", 2024-05-08T18:08:05.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6901e-05 2024-05-08T18:08:05.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721867+0000", 2024-05-08T18:08:05.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0034000000000001e-05 2024-05-08T18:08:05.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721922+0000", 2024-05-08T18:08:05.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4450999999999998e-05 2024-05-08T18:08:05.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721981+0000", 2024-05-08T18:08:05.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9267e-05 2024-05-08T18:08:05.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:05.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722103+0000", 2024-05-08T18:08:05.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121502 2024-05-08T18:08:05.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722757+0000", 2024-05-08T18:08:05.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065419700000000003 2024-05-08T18:08:05.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725619+0000", 2024-05-08T18:08:05.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002862107 2024-05-08T18:08:05.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725654+0000", 2024-05-08T18:08:05.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:08:05.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725696+0000", 2024-05-08T18:08:05.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:08:05.478 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.478 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.478 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.478 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:604 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.479 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:05.479 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.561652586000001, 2024-05-08T18:08:05.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002741884, 2024-05-08T18:08:05.479 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.479 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.479 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.479 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.479 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.479 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.479 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 604 2024-05-08T18:08:05.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.479 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:05.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:05.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899111+0000", 2024-05-08T18:08:05.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0910000000000001e-06 2024-05-08T18:08:05.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899126+0000", 2024-05-08T18:08:05.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:08:05.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899159+0000", 2024-05-08T18:08:05.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3241999999999998e-05 2024-05-08T18:08:05.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899174+0000", 2024-05-08T18:08:05.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5235000000000001e-05 2024-05-08T18:08:05.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899316+0000", 2024-05-08T18:08:05.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014175599999999999 2024-05-08T18:08:05.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899525+0000", 2024-05-08T18:08:05.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020915300000000001 2024-05-08T18:08:05.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:05.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899872+0000", 2024-05-08T18:08:05.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034668299999999997 2024-05-08T18:08:05.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901064+0000", 2024-05-08T18:08:05.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001191473 2024-05-08T18:08:05.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901664+0000", 2024-05-08T18:08:05.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060054599999999998 2024-05-08T18:08:05.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901779+0000", 2024-05-08T18:08:05.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011452500000000001 2024-05-08T18:08:05.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901850+0000", 2024-05-08T18:08:05.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1580000000000002e-05 2024-05-08T18:08:05.484 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.484 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.484 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.484 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:612 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.484 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:05.484 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.556144023000002, 2024-05-08T18:08:05.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025904750000000001, 2024-05-08T18:08:05.484 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.484 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.484 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.484 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.484 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.484 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.485 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 612 2024-05-08T18:08:05.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.485 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:05.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:05.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904619+0000", 2024-05-08T18:08:05.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8479999999999999e-06 2024-05-08T18:08:05.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904628+0000", 2024-05-08T18:08:05.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8829999999999995e-06 2024-05-08T18:08:05.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904650+0000", 2024-05-08T18:08:05.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2467999999999999e-05 2024-05-08T18:08:05.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904669+0000", 2024-05-08T18:08:05.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9303000000000001e-05 2024-05-08T18:08:05.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904766+0000", 2024-05-08T18:08:05.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6917999999999996e-05 2024-05-08T18:08:05.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904935+0000", 2024-05-08T18:08:05.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000168441 2024-05-08T18:08:05.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:05.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.905288+0000", 2024-05-08T18:08:05.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035312199999999998 2024-05-08T18:08:05.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.906520+0000", 2024-05-08T18:08:05.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001232005 2024-05-08T18:08:05.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907086+0000", 2024-05-08T18:08:05.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056658900000000005 2024-05-08T18:08:05.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907154+0000", 2024-05-08T18:08:05.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7197000000000001e-05 2024-05-08T18:08:05.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907207+0000", 2024-05-08T18:08:05.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3701e-05 2024-05-08T18:08:05.489 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.489 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.489 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.489 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.489 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:05.489 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.38812643, 2024-05-08T18:08:05.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032464490000000002, 2024-05-08T18:08:05.490 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.490 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.490 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.490 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.490 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.490 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.490 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 742 2024-05-08T18:08:05.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.490 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:05.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:05.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072637+0000", 2024-05-08T18:08:05.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9059999999999998e-06 2024-05-08T18:08:05.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072651+0000", 2024-05-08T18:08:05.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3477e-05 2024-05-08T18:08:05.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072683+0000", 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2116000000000002e-05 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072698+0000", 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5454000000000001e-05 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072845+0000", 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146532 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073241+0000", 2024-05-08T18:08:05.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039580699999999997 2024-05-08T18:08:05.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:05.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073812+0000", 2024-05-08T18:08:05.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057164900000000003 2024-05-08T18:08:05.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075063+0000", 2024-05-08T18:08:05.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001250131 2024-05-08T18:08:05.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075723+0000", 2024-05-08T18:08:05.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00066039199999999999 2024-05-08T18:08:05.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075808+0000", 2024-05-08T18:08:05.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5458999999999996e-05 2024-05-08T18:08:05.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075881+0000", 2024-05-08T18:08:05.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2526000000000003e-05 2024-05-08T18:08:05.494 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.494 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.494 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.495 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.495 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:05.495 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.345718065, 2024-05-08T18:08:05.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029270590000000001, 2024-05-08T18:08:05.495 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.495 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.495 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.495 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.495 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.495 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.495 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 760 2024-05-08T18:08:05.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.495 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:05.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:05.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115045+0000", 2024-05-08T18:08:05.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0729999999999999e-06 2024-05-08T18:08:05.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115057+0000", 2024-05-08T18:08:05.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1617000000000001e-05 2024-05-08T18:08:05.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115088+0000", 2024-05-08T18:08:05.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1155999999999998e-05 2024-05-08T18:08:05.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115103+0000", 2024-05-08T18:08:05.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5067e-05 2024-05-08T18:08:05.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115289+0000", 2024-05-08T18:08:05.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186582 2024-05-08T18:08:05.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115506+0000", 2024-05-08T18:08:05.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021690500000000001 2024-05-08T18:08:05.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:05.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115832+0000", 2024-05-08T18:08:05.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032556799999999998 2024-05-08T18:08:05.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.116892+0000", 2024-05-08T18:08:05.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010597989999999999 2024-05-08T18:08:05.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117807+0000", 2024-05-08T18:08:05.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091502599999999999 2024-05-08T18:08:05.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117895+0000", 2024-05-08T18:08:05.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7977000000000001e-05 2024-05-08T18:08:05.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117970+0000", 2024-05-08T18:08:05.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5289000000000004e-05 2024-05-08T18:08:05.500 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.500 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.500 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.500 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.500 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:05.500 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.214720579000002, 2024-05-08T18:08:05.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028290730000000001, 2024-05-08T18:08:05.501 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.501 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.501 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.501 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.501 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.501 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.501 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 817 2024-05-08T18:08:05.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.501 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:05.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:05.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246043+0000", 2024-05-08T18:08:05.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.807e-06 2024-05-08T18:08:05.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246056+0000", 2024-05-08T18:08:05.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2383e-05 2024-05-08T18:08:05.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246087+0000", 2024-05-08T18:08:05.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1937000000000003e-05 2024-05-08T18:08:05.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246104+0000", 2024-05-08T18:08:05.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6643e-05 2024-05-08T18:08:05.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246225+0000", 2024-05-08T18:08:05.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012061900000000001 2024-05-08T18:08:05.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246510+0000", 2024-05-08T18:08:05.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028507100000000002 2024-05-08T18:08:05.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:05.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246881+0000", 2024-05-08T18:08:05.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037163799999999998 2024-05-08T18:08:05.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248078+0000", 2024-05-08T18:08:05.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011968969999999999 2024-05-08T18:08:05.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248715+0000", 2024-05-08T18:08:05.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063698599999999998 2024-05-08T18:08:05.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248801+0000", 2024-05-08T18:08:05.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5772999999999993e-05 2024-05-08T18:08:05.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248869+0000", 2024-05-08T18:08:05.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8318999999999994e-05 2024-05-08T18:08:05.506 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.506 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.506 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.506 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.506 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:05.506 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.160977095, 2024-05-08T18:08:05.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003281693, 2024-05-08T18:08:05.506 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.506 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.506 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.506 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.507 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.507 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.507 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 841 2024-05-08T18:08:05.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.507 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:05.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:05.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299786+0000", 2024-05-08T18:08:05.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4770000000000002e-06 2024-05-08T18:08:05.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299798+0000", 2024-05-08T18:08:05.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1493e-05 2024-05-08T18:08:05.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299827+0000", 2024-05-08T18:08:05.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9363e-05 2024-05-08T18:08:05.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299842+0000", 2024-05-08T18:08:05.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.448e-05 2024-05-08T18:08:05.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300001+0000", 2024-05-08T18:08:05.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015909600000000001 2024-05-08T18:08:05.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300384+0000", 2024-05-08T18:08:05.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038306000000000001 2024-05-08T18:08:05.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:05.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300929+0000", 2024-05-08T18:08:05.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054551299999999997 2024-05-08T18:08:05.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302151+0000", 2024-05-08T18:08:05.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012218540000000001 2024-05-08T18:08:05.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302918+0000", 2024-05-08T18:08:05.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076719099999999997 2024-05-08T18:08:05.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303000+0000", 2024-05-08T18:08:05.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1662999999999994e-05 2024-05-08T18:08:05.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303065+0000", 2024-05-08T18:08:05.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5502999999999999e-05 2024-05-08T18:08:05.511 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.511 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.511 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.512 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.512 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:05.512 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.156781639000002, 2024-05-08T18:08:05.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026179150000000002, 2024-05-08T18:08:05.512 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.512 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.512 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.512 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.512 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.512 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.512 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 843 2024-05-08T18:08:05.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.512 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:05.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:05.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303981+0000", 2024-05-08T18:08:05.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9740000000000001e-06 2024-05-08T18:08:05.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303990+0000", 2024-05-08T18:08:05.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9889999999999998e-06 2024-05-08T18:08:05.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304012+0000", 2024-05-08T18:08:05.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1537000000000001e-05 2024-05-08T18:08:05.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304023+0000", 2024-05-08T18:08:05.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:08:05.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304101+0000", 2024-05-08T18:08:05.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7732999999999996e-05 2024-05-08T18:08:05.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304210+0000", 2024-05-08T18:08:05.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010985299999999999 2024-05-08T18:08:05.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:05.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304490+0000", 2024-05-08T18:08:05.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000279564 2024-05-08T18:08:05.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.305542+0000", 2024-05-08T18:08:05.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051976 2024-05-08T18:08:05.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306451+0000", 2024-05-08T18:08:05.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00090901999999999997 2024-05-08T18:08:05.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306533+0000", 2024-05-08T18:08:05.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1790000000000001e-05 2024-05-08T18:08:05.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306597+0000", 2024-05-08T18:08:05.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4332999999999995e-05 2024-05-08T18:08:05.517 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.517 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.517 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.517 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.517 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:05.517 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.147085429000001, 2024-05-08T18:08:05.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00275537, 2024-05-08T18:08:05.517 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.517 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.517 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.517 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.518 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.518 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.518 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 847 2024-05-08T18:08:05.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.518 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:05.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:05.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313678+0000", 2024-05-08T18:08:05.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:08:05.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313689+0000", 2024-05-08T18:08:05.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1273e-05 2024-05-08T18:08:05.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313719+0000", 2024-05-08T18:08:05.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9726e-05 2024-05-08T18:08:05.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313733+0000", 2024-05-08T18:08:05.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4487e-05 2024-05-08T18:08:05.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313858+0000", 2024-05-08T18:08:05.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125172 2024-05-08T18:08:05.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314072+0000", 2024-05-08T18:08:05.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021314200000000001 2024-05-08T18:08:05.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:05.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314378+0000", 2024-05-08T18:08:05.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030653100000000002 2024-05-08T18:08:05.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.315524+0000", 2024-05-08T18:08:05.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011458950000000001 2024-05-08T18:08:05.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316213+0000", 2024-05-08T18:08:05.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068942199999999997 2024-05-08T18:08:05.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316314+0000", 2024-05-08T18:08:05.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100723 2024-05-08T18:08:05.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316431+0000", 2024-05-08T18:08:05.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116759 2024-05-08T18:08:05.522 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.522 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.522 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.522 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.522 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:05.522 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.143433492, 2024-05-08T18:08:05.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025522510000000002, 2024-05-08T18:08:05.523 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.523 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.523 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.523 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.523 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.523 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.523 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 849 2024-05-08T18:08:05.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.523 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:05.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:05.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317329+0000", 2024-05-08T18:08:05.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9530000000000002e-06 2024-05-08T18:08:05.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317340+0000", 2024-05-08T18:08:05.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.08e-05 2024-05-08T18:08:05.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317364+0000", 2024-05-08T18:08:05.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4142999999999999e-05 2024-05-08T18:08:05.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317377+0000", 2024-05-08T18:08:05.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2764e-05 2024-05-08T18:08:05.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317471+0000", 2024-05-08T18:08:05.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4289000000000005e-05 2024-05-08T18:08:05.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317600+0000", 2024-05-08T18:08:05.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012910499999999999 2024-05-08T18:08:05.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:05.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317868+0000", 2024-05-08T18:08:05.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000267562 2024-05-08T18:08:05.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319081+0000", 2024-05-08T18:08:05.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001213387 2024-05-08T18:08:05.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319723+0000", 2024-05-08T18:08:05.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064134200000000004 2024-05-08T18:08:05.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319808+0000", 2024-05-08T18:08:05.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:05.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319880+0000", 2024-05-08T18:08:05.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1426000000000004e-05 2024-05-08T18:08:05.527 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.528 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.528 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.528 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.528 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:05.528 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.100001011000003, 2024-05-08T18:08:05.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002815157, 2024-05-08T18:08:05.528 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.528 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.528 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.528 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.528 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.528 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.528 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 868 2024-05-08T18:08:05.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.529 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:05.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:05.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360762+0000", 2024-05-08T18:08:05.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:08:05.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360775+0000", 2024-05-08T18:08:05.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2840000000000001e-05 2024-05-08T18:08:05.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360805+0000", 2024-05-08T18:08:05.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9686e-05 2024-05-08T18:08:05.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360819+0000", 2024-05-08T18:08:05.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.434e-05 2024-05-08T18:08:05.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360948+0000", 2024-05-08T18:08:05.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000129033 2024-05-08T18:08:05.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361166+0000", 2024-05-08T18:08:05.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021747800000000001 2024-05-08T18:08:05.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:05.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361481+0000", 2024-05-08T18:08:05.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031515800000000001 2024-05-08T18:08:05.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.362546+0000", 2024-05-08T18:08:05.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010653889999999999 2024-05-08T18:08:05.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363365+0000", 2024-05-08T18:08:05.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081906100000000005 2024-05-08T18:08:05.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363450+0000", 2024-05-08T18:08:05.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5202000000000002e-05 2024-05-08T18:08:05.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363575+0000", 2024-05-08T18:08:05.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012460999999999999 2024-05-08T18:08:05.533 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.533 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.533 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.533 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.533 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:05.534 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.096308837999999, 2024-05-08T18:08:05.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024676260000000001, 2024-05-08T18:08:05.534 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.534 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.534 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.534 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.534 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.534 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.534 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 870 2024-05-08T18:08:05.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.534 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:05.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:05.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364454+0000", 2024-05-08T18:08:05.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7770000000000001e-06 2024-05-08T18:08:05.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364463+0000", 2024-05-08T18:08:05.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4800000000000007e-06 2024-05-08T18:08:05.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364487+0000", 2024-05-08T18:08:05.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3589999999999999e-05 2024-05-08T18:08:05.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364499+0000", 2024-05-08T18:08:05.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.241e-05 2024-05-08T18:08:05.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364607+0000", 2024-05-08T18:08:05.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010760900000000001 2024-05-08T18:08:05.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364750+0000", 2024-05-08T18:08:05.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014265600000000001 2024-05-08T18:08:05.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:05.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.365021+0000", 2024-05-08T18:08:05.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027115100000000002 2024-05-08T18:08:05.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366163+0000", 2024-05-08T18:08:05.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011419189999999999 2024-05-08T18:08:05.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366727+0000", 2024-05-08T18:08:05.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056400199999999997 2024-05-08T18:08:05.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366810+0000", 2024-05-08T18:08:05.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3133000000000005e-05 2024-05-08T18:08:05.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366920+0000", 2024-05-08T18:08:05.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109899 2024-05-08T18:08:05.538 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.538 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.538 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.539 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.539 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:05.539 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.006394659999998, 2024-05-08T18:08:05.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027893459999999998, 2024-05-08T18:08:05.539 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.539 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.539 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.539 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.539 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.539 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.539 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 907 2024-05-08T18:08:05.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.539 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:05.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:05.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454369+0000", 2024-05-08T18:08:05.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5730000000000002e-06 2024-05-08T18:08:05.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454381+0000", 2024-05-08T18:08:05.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.208e-05 2024-05-08T18:08:05.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454413+0000", 2024-05-08T18:08:05.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2493000000000002e-05 2024-05-08T18:08:05.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454432+0000", 2024-05-08T18:08:05.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8862999999999999e-05 2024-05-08T18:08:05.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454577+0000", 2024-05-08T18:08:05.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014477899999999999 2024-05-08T18:08:05.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454800+0000", 2024-05-08T18:08:05.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223425 2024-05-08T18:08:05.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:05.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.455168+0000", 2024-05-08T18:08:05.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036712799999999999 2024-05-08T18:08:05.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456282+0000", 2024-05-08T18:08:05.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011141580000000001 2024-05-08T18:08:05.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456953+0000", 2024-05-08T18:08:05.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000670956 2024-05-08T18:08:05.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457038+0000", 2024-05-08T18:08:05.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4828999999999997e-05 2024-05-08T18:08:05.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457156+0000", 2024-05-08T18:08:05.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118062 2024-05-08T18:08:05.544 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.544 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.544 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.544 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.544 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:05.544 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.002702296999999, 2024-05-08T18:08:05.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026891609999999998, 2024-05-08T18:08:05.544 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.544 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.544 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.544 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.544 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.545 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.545 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 909 2024-05-08T18:08:05.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.545 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:05.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:05.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458060+0000", 2024-05-08T18:08:05.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:05.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458069+0000", 2024-05-08T18:08:05.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6440000000000006e-06 2024-05-08T18:08:05.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458090+0000", 2024-05-08T18:08:05.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1089000000000001e-05 2024-05-08T18:08:05.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458102+0000", 2024-05-08T18:08:05.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2306999999999999e-05 2024-05-08T18:08:05.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458191+0000", 2024-05-08T18:08:05.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8213000000000004e-05 2024-05-08T18:08:05.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458313+0000", 2024-05-08T18:08:05.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012231500000000001 2024-05-08T18:08:05.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:05.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458581+0000", 2024-05-08T18:08:05.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026762500000000001 2024-05-08T18:08:05.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.459773+0000", 2024-05-08T18:08:05.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001192991 2024-05-08T18:08:05.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460590+0000", 2024-05-08T18:08:05.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081618100000000002 2024-05-08T18:08:05.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460681+0000", 2024-05-08T18:08:05.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0946000000000006e-05 2024-05-08T18:08:05.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460748+0000", 2024-05-08T18:08:05.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7139999999999998e-05 2024-05-08T18:08:05.549 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.549 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.549 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.549 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.549 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:05.549 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.909059278999997, 2024-05-08T18:08:05.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030359179999999999, 2024-05-08T18:08:05.550 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.550 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.550 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.550 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.550 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.550 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.550 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 949 2024-05-08T18:08:05.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.550 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:05.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551705+0000", 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2770000000000001e-06 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551717+0000", 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.206e-05 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551747+0000", 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0168999999999999e-05 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551763+0000", 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551880+0000", 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116976 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552099+0000", 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021910199999999999 2024-05-08T18:08:05.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:05.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552476+0000", 2024-05-08T18:08:05.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000376697 2024-05-08T18:08:05.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.553551+0000", 2024-05-08T18:08:05.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001074925 2024-05-08T18:08:05.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554588+0000", 2024-05-08T18:08:05.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010374099999999999 2024-05-08T18:08:05.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554671+0000", 2024-05-08T18:08:05.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3368999999999994e-05 2024-05-08T18:08:05.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554738+0000", 2024-05-08T18:08:05.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6043000000000004e-05 2024-05-08T18:08:05.554 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.554 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.554 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.554 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.555 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:05.555 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.895445840999997, 2024-05-08T18:08:05.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028304160000000001, 2024-05-08T18:08:05.555 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.555 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.555 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.555 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.555 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.555 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.555 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 955 2024-05-08T18:08:05.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.555 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:05.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:05.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565318+0000", 2024-05-08T18:08:05.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7030000000000002e-06 2024-05-08T18:08:05.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565330+0000", 2024-05-08T18:08:05.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.204e-05 2024-05-08T18:08:05.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565363+0000", 2024-05-08T18:08:05.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2722999999999998e-05 2024-05-08T18:08:05.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565389+0000", 2024-05-08T18:08:05.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6412999999999999e-05 2024-05-08T18:08:05.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565510+0000", 2024-05-08T18:08:05.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120932 2024-05-08T18:08:05.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565722+0000", 2024-05-08T18:08:05.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212139 2024-05-08T18:08:05.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:05.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.566034+0000", 2024-05-08T18:08:05.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000312038 2024-05-08T18:08:05.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567340+0000", 2024-05-08T18:08:05.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00130547 2024-05-08T18:08:05.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567998+0000", 2024-05-08T18:08:05.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000658382 2024-05-08T18:08:05.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568081+0000", 2024-05-08T18:08:05.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3269999999999994e-05 2024-05-08T18:08:05.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568145+0000", 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4306000000000004e-05 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.891726318000003, 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027506660000000001, 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 957 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:05.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:05.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569036+0000", 2024-05-08T18:08:05.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.776e-06 2024-05-08T18:08:05.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:05.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569061+0000", 2024-05-08T18:08:05.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5097e-05 2024-05-08T18:08:05.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:05.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569084+0000", 2024-05-08T18:08:05.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.23e-05 2024-05-08T18:08:05.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:05.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569096+0000", 2024-05-08T18:08:05.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.22e-05 2024-05-08T18:08:05.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:05.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569180+0000", 2024-05-08T18:08:05.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4369000000000005e-05 2024-05-08T18:08:05.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:05.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569296+0000", 2024-05-08T18:08:05.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115999 2024-05-08T18:08:05.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:05.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569550+0000", 2024-05-08T18:08:05.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025397499999999998 2024-05-08T18:08:05.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:05.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.570963+0000", 2024-05-08T18:08:05.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001413023 2024-05-08T18:08:05.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:05.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571614+0000", 2024-05-08T18:08:05.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065041199999999995 2024-05-08T18:08:05.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:05.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571701+0000", 2024-05-08T18:08:05.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7569000000000001e-05 2024-05-08T18:08:05.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:05.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:05.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:05.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571785+0000", 2024-05-08T18:08:05.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3945999999999999e-05 2024-05-08T18:08:05.565 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.565 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.565 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.565 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:05.565 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:05.566 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:05.567 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:08:05.567 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:05.569+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:05.668 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:05.669+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:05.741 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:05.742 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:05.742 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:05.742 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:05.755 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:08:05.799 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:05.801+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:05.870 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:05.869+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:05.920 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:05.920 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:05.920 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:05.934 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:08:05.979 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:05.981+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:06.073 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:06.074+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:06.105 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:06.106 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:06.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:06.106 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:06.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.106 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:06.106 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:06.106 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 44.556131594, 2024-05-08T18:08:06.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049710090000000002, 2024-05-08T18:08:06.106 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.106 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.106 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-08T18:08:06.106 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.107 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.107 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.107 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 44 2024-05-08T18:08:06.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.107 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:06.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:06.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552775+0000", 2024-05-08T18:08:06.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4450000000000001e-06 2024-05-08T18:08:06.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552790+0000", 2024-05-08T18:08:06.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4363e-05 2024-05-08T18:08:06.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552820+0000", 2024-05-08T18:08:06.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0485999999999999e-05 2024-05-08T18:08:06.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552843+0000", 2024-05-08T18:08:06.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2985000000000001e-05 2024-05-08T18:08:06.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554350+0000", 2024-05-08T18:08:06.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015065149999999999 2024-05-08T18:08:06.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-08T18:08:06.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554374+0000", 2024-05-08T18:08:06.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4097e-05 2024-05-08T18:08:06.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557531+0000", 2024-05-08T18:08:06.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031567169999999999 2024-05-08T18:08:06.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557743+0000", 2024-05-08T18:08:06.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212401 2024-05-08T18:08:06.111 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.111 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.111 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.112 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:06.112 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:06.112 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.520779717000003, 2024-05-08T18:08:06.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050241879999999997, 2024-05-08T18:08:06.112 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.112 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.112 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.112 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.112 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.112 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.112 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 58 2024-05-08T18:08:06.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.113 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:06.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:06.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588125+0000", 2024-05-08T18:08:06.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1399999999999995e-07 2024-05-08T18:08:06.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588129+0000", 2024-05-08T18:08:06.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6779999999999999e-06 2024-05-08T18:08:06.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588142+0000", 2024-05-08T18:08:06.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3047999999999999e-05 2024-05-08T18:08:06.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588174+0000", 2024-05-08T18:08:06.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1270999999999999e-05 2024-05-08T18:08:06.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588307+0000", 2024-05-08T18:08:06.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013307600000000001 2024-05-08T18:08:06.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588477+0000", 2024-05-08T18:08:06.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000170213 2024-05-08T18:08:06.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:06.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588669+0000", 2024-05-08T18:08:06.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019211599999999999 2024-05-08T18:08:06.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.590228+0000", 2024-05-08T18:08:06.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015590059999999999 2024-05-08T18:08:06.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593029+0000", 2024-05-08T18:08:06.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028006400000000001 2024-05-08T18:08:06.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593099+0000", 2024-05-08T18:08:06.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0300000000000001e-05 2024-05-08T18:08:06.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593148+0000", 2024-05-08T18:08:06.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8925999999999999e-05 2024-05-08T18:08:06.118 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.118 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.118 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.118 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:08:06.118 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:06.119 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.524241557000003, 2024-05-08T18:08:06.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00385587, 2024-05-08T18:08:06.119 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.119 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.119 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.119 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.119 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.119 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.119 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207 2024-05-08T18:08:06.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.119 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:06.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:06.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584665+0000", 2024-05-08T18:08:06.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0570000000000001e-06 2024-05-08T18:08:06.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584679+0000", 2024-05-08T18:08:06.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3713000000000001e-05 2024-05-08T18:08:06.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584712+0000", 2024-05-08T18:08:06.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3213999999999997e-05 2024-05-08T18:08:06.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584728+0000", 2024-05-08T18:08:06.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5936000000000001e-05 2024-05-08T18:08:06.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584951+0000", 2024-05-08T18:08:06.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000222955 2024-05-08T18:08:06.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585196+0000", 2024-05-08T18:08:06.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024550800000000002 2024-05-08T18:08:06.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:06.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585643+0000", 2024-05-08T18:08:06.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00044644699999999999 2024-05-08T18:08:06.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.587110+0000", 2024-05-08T18:08:06.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001467323 2024-05-08T18:08:06.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588371+0000", 2024-05-08T18:08:06.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012607180000000001 2024-05-08T18:08:06.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588452+0000", 2024-05-08T18:08:06.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1216000000000003e-05 2024-05-08T18:08:06.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588518+0000", 2024-05-08T18:08:06.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5783000000000004e-05 2024-05-08T18:08:06.125 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.125 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.125 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.125 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.125 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:06.125 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.478066155, 2024-05-08T18:08:06.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003249994, 2024-05-08T18:08:06.125 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.125 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.125 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.125 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.125 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.125 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.125 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216 2024-05-08T18:08:06.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.126 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:06.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:06.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630840+0000", 2024-05-08T18:08:06.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0730000000000001e-06 2024-05-08T18:08:06.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630854+0000", 2024-05-08T18:08:06.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3360000000000001e-05 2024-05-08T18:08:06.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630889+0000", 2024-05-08T18:08:06.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5176999999999999e-05 2024-05-08T18:08:06.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630911+0000", 2024-05-08T18:08:06.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.247e-05 2024-05-08T18:08:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631046+0000", 2024-05-08T18:08:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013484599999999999 2024-05-08T18:08:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631272+0000", 2024-05-08T18:08:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000225694 2024-05-08T18:08:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631703+0000", 2024-05-08T18:08:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000431144 2024-05-08T18:08:06.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633244+0000", 2024-05-08T18:08:06.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001540622 2024-05-08T18:08:06.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633926+0000", 2024-05-08T18:08:06.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068244200000000001 2024-05-08T18:08:06.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634019+0000", 2024-05-08T18:08:06.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3148999999999999e-05 2024-05-08T18:08:06.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634087+0000", 2024-05-08T18:08:06.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8016999999999996e-05 2024-05-08T18:08:06.130 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.130 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.130 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.130 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.130 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:06.130 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.436522105999998, 2024-05-08T18:08:06.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003119854, 2024-05-08T18:08:06.130 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.131 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.131 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.131 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.131 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.131 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.131 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 227 2024-05-08T18:08:06.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.131 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:06.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:06.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672384+0000", 2024-05-08T18:08:06.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7470000000000001e-06 2024-05-08T18:08:06.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672396+0000", 2024-05-08T18:08:06.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.154e-05 2024-05-08T18:08:06.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672427+0000", 2024-05-08T18:08:06.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1676e-05 2024-05-08T18:08:06.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672443+0000", 2024-05-08T18:08:06.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5214e-05 2024-05-08T18:08:06.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672563+0000", 2024-05-08T18:08:06.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120535 2024-05-08T18:08:06.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672778+0000", 2024-05-08T18:08:06.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021446200000000001 2024-05-08T18:08:06.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:06.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.673205+0000", 2024-05-08T18:08:06.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042750699999999998 2024-05-08T18:08:06.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.674848+0000", 2024-05-08T18:08:06.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016432980000000001 2024-05-08T18:08:06.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675346+0000", 2024-05-08T18:08:06.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049711999999999998 2024-05-08T18:08:06.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675432+0000", 2024-05-08T18:08:06.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6798999999999993e-05 2024-05-08T18:08:06.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675501+0000", 2024-05-08T18:08:06.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8955999999999995e-05 2024-05-08T18:08:06.136 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.136 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.136 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.136 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.136 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:06.136 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.429581319, 2024-05-08T18:08:06.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034322110000000001, 2024-05-08T18:08:06.136 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.137 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.137 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.137 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.137 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.137 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.137 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 229 2024-05-08T18:08:06.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.137 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:06.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:06.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679325+0000", 2024-05-08T18:08:06.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:08:06.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679339+0000", 2024-05-08T18:08:06.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:08:06.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679370+0000", 2024-05-08T18:08:06.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0280000000000001e-05 2024-05-08T18:08:06.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679385+0000", 2024-05-08T18:08:06.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5026e-05 2024-05-08T18:08:06.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679504+0000", 2024-05-08T18:08:06.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119023 2024-05-08T18:08:06.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679711+0000", 2024-05-08T18:08:06.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020705499999999999 2024-05-08T18:08:06.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:06.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.680115+0000", 2024-05-08T18:08:06.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040396699999999998 2024-05-08T18:08:06.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.681424+0000", 2024-05-08T18:08:06.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001309387 2024-05-08T18:08:06.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682488+0000", 2024-05-08T18:08:06.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010642519999999999 2024-05-08T18:08:06.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682640+0000", 2024-05-08T18:08:06.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015123599999999999 2024-05-08T18:08:06.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682754+0000", 2024-05-08T18:08:06.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011482200000000001 2024-05-08T18:08:06.142 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.142 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.143 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.143 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.143 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:06.143 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.422197109999999, 2024-05-08T18:08:06.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033353329999999998, 2024-05-08T18:08:06.143 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.143 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.143 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.143 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.143 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.143 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.144 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 231 2024-05-08T18:08:06.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.144 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:06.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:06.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686709+0000", 2024-05-08T18:08:06.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4729999999999999e-06 2024-05-08T18:08:06.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686720+0000", 2024-05-08T18:08:06.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1157e-05 2024-05-08T18:08:06.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686750+0000", 2024-05-08T18:08:06.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0417e-05 2024-05-08T18:08:06.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686765+0000", 2024-05-08T18:08:06.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.487e-05 2024-05-08T18:08:06.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686872+0000", 2024-05-08T18:08:06.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010703499999999999 2024-05-08T18:08:06.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687085+0000", 2024-05-08T18:08:06.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021279599999999999 2024-05-08T18:08:06.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:06.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687501+0000", 2024-05-08T18:08:06.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041554 2024-05-08T18:08:06.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.688886+0000", 2024-05-08T18:08:06.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00138565 2024-05-08T18:08:06.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689899+0000", 2024-05-08T18:08:06.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010128190000000001 2024-05-08T18:08:06.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689978+0000", 2024-05-08T18:08:06.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8490000000000002e-05 2024-05-08T18:08:06.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.690042+0000", 2024-05-08T18:08:06.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4085999999999996e-05 2024-05-08T18:08:06.148 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.148 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.149 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.149 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:394 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.149 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:06.149 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.365124033000001, 2024-05-08T18:08:06.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034384960000000001, 2024-05-08T18:08:06.149 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.149 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.149 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.149 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.149 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.150 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.150 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 394 2024-05-08T18:08:06.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.150 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:06.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:06.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743781+0000", 2024-05-08T18:08:06.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3e-06 2024-05-08T18:08:06.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743788+0000", 2024-05-08T18:08:06.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7399999999999998e-06 2024-05-08T18:08:06.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743801+0000", 2024-05-08T18:08:06.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3757000000000001e-05 2024-05-08T18:08:06.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743808+0000", 2024-05-08T18:08:06.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6579999999999996e-06 2024-05-08T18:08:06.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743875+0000", 2024-05-08T18:08:06.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6740000000000001e-05 2024-05-08T18:08:06.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743971+0000", 2024-05-08T18:08:06.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6175000000000007e-05 2024-05-08T18:08:06.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:06.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744100+0000", 2024-05-08T18:08:06.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012954899999999999 2024-05-08T18:08:06.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744863+0000", 2024-05-08T18:08:06.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076300100000000002 2024-05-08T18:08:06.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747089+0000", 2024-05-08T18:08:06.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022258540000000002 2024-05-08T18:08:06.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747162+0000", 2024-05-08T18:08:06.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2632000000000005e-05 2024-05-08T18:08:06.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747218+0000", 2024-05-08T18:08:06.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.609e-05 2024-05-08T18:08:06.155 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.155 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.155 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.156 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:535 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.156 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:06.156 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.267410955999999, 2024-05-08T18:08:06.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055640899999999998, 2024-05-08T18:08:06.156 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.156 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.156 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.156 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.156 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.156 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.156 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 535 2024-05-08T18:08:06.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.157 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:06.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:06.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841494+0000", 2024-05-08T18:08:06.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0899999999999999e-06 2024-05-08T18:08:06.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841500+0000", 2024-05-08T18:08:06.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0249999999999999e-06 2024-05-08T18:08:06.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841513+0000", 2024-05-08T18:08:06.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3658e-05 2024-05-08T18:08:06.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841522+0000", 2024-05-08T18:08:06.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3410000000000003e-06 2024-05-08T18:08:06.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841574+0000", 2024-05-08T18:08:06.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2794000000000003e-05 2024-05-08T18:08:06.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841633+0000", 2024-05-08T18:08:06.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8595999999999999e-05 2024-05-08T18:08:06.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:06.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841755+0000", 2024-05-08T18:08:06.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012227399999999999 2024-05-08T18:08:06.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.842349+0000", 2024-05-08T18:08:06.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00059377699999999998 2024-05-08T18:08:06.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.846949+0000", 2024-05-08T18:08:06.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004599723 2024-05-08T18:08:06.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847008+0000", 2024-05-08T18:08:06.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8854999999999998e-05 2024-05-08T18:08:06.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847057+0000", 2024-05-08T18:08:06.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8956999999999999e-05 2024-05-08T18:08:06.161 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.161 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.161 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.161 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:541 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.161 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:06.161 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.260381426000002, 2024-05-08T18:08:06.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037829790000000001, 2024-05-08T18:08:06.162 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.162 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.162 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.162 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.162 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.162 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.162 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 541 2024-05-08T18:08:06.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.162 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:06.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:06.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848523+0000", 2024-05-08T18:08:06.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8599999999999997e-07 2024-05-08T18:08:06.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848526+0000", 2024-05-08T18:08:06.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4690000000000002e-06 2024-05-08T18:08:06.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848536+0000", 2024-05-08T18:08:06.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2029999999999998e-06 2024-05-08T18:08:06.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848540+0000", 2024-05-08T18:08:06.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9169999999999997e-06 2024-05-08T18:08:06.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848591+0000", 2024-05-08T18:08:06.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0328000000000003e-05 2024-05-08T18:08:06.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848646+0000", 2024-05-08T18:08:06.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5281999999999997e-05 2024-05-08T18:08:06.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:06.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848759+0000", 2024-05-08T18:08:06.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011278899999999999 2024-05-08T18:08:06.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.849323+0000", 2024-05-08T18:08:06.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056433999999999998 2024-05-08T18:08:06.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852225+0000", 2024-05-08T18:08:06.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029017320000000002 2024-05-08T18:08:06.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852277+0000", 2024-05-08T18:08:06.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2460999999999998e-05 2024-05-08T18:08:06.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852305+0000", 2024-05-08T18:08:06.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7671999999999999e-05 2024-05-08T18:08:06.167 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.167 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.167 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.167 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.167 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:06.167 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.127234348999998, 2024-05-08T18:08:06.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002973084, 2024-05-08T18:08:06.167 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.167 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.167 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.168 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.168 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.168 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.168 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 703 2024-05-08T18:08:06.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.168 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:06.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:06.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981672+0000", 2024-05-08T18:08:06.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5799999999999999e-06 2024-05-08T18:08:06.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981683+0000", 2024-05-08T18:08:06.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1270000000000001e-05 2024-05-08T18:08:06.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981715+0000", 2024-05-08T18:08:06.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1470000000000002e-05 2024-05-08T18:08:06.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981730+0000", 2024-05-08T18:08:06.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5262999999999999e-05 2024-05-08T18:08:06.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981864+0000", 2024-05-08T18:08:06.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134043 2024-05-08T18:08:06.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982168+0000", 2024-05-08T18:08:06.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030453799999999998 2024-05-08T18:08:06.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:06.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982620+0000", 2024-05-08T18:08:06.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045170900000000001 2024-05-08T18:08:06.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.983648+0000", 2024-05-08T18:08:06.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010276009999999999 2024-05-08T18:08:06.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984486+0000", 2024-05-08T18:08:06.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083874600000000002 2024-05-08T18:08:06.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984571+0000", 2024-05-08T18:08:06.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4370999999999996e-05 2024-05-08T18:08:06.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984642+0000", 2024-05-08T18:08:06.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1493000000000001e-05 2024-05-08T18:08:06.173 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.173 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.173 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.174 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:789 6.0 e32/26 6:0216b5b6:::obj_delete_at_hint.0000000070:head v 32'14, mlcod=32'12)", 2024-05-08T18:08:06.174 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:06.174 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.927807575999999, 2024-05-08T18:08:06.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034621420000000001, 2024-05-08T18:08:06.174 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.174 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.174 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.174 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:06.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:06.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181098+0000", 2024-05-08T18:08:06.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8029999999999999e-06 2024-05-08T18:08:06.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181109+0000", 2024-05-08T18:08:06.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1219999999999999e-05 2024-05-08T18:08:06.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181138+0000", 2024-05-08T18:08:06.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.898e-05 2024-05-08T18:08:06.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181151+0000", 2024-05-08T18:08:06.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.308e-05 2024-05-08T18:08:06.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181268+0000", 2024-05-08T18:08:06.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116629 2024-05-08T18:08:06.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181321+0000", 2024-05-08T18:08:06.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3325999999999997e-05 2024-05-08T18:08:06.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184477+0000", 2024-05-08T18:08:06.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003156458 2024-05-08T18:08:06.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184558+0000", 2024-05-08T18:08:06.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0646e-05 2024-05-08T18:08:06.179 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.179 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.179 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.179 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.179 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:06.179 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.896634071999998, 2024-05-08T18:08:06.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031146310000000001, 2024-05-08T18:08:06.179 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.179 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.180 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.180 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.180 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.180 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.180 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 802 2024-05-08T18:08:06.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.180 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:06.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:06.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212272+0000", 2024-05-08T18:08:06.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.943e-06 2024-05-08T18:08:06.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212284+0000", 2024-05-08T18:08:06.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1747e-05 2024-05-08T18:08:06.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212315+0000", 2024-05-08T18:08:06.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0579e-05 2024-05-08T18:08:06.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212336+0000", 2024-05-08T18:08:06.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1639999999999999e-05 2024-05-08T18:08:06.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212488+0000", 2024-05-08T18:08:06.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151192 2024-05-08T18:08:06.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212703+0000", 2024-05-08T18:08:06.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000215439 2024-05-08T18:08:06.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:06.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.213033+0000", 2024-05-08T18:08:06.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032992699999999999 2024-05-08T18:08:06.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.214306+0000", 2024-05-08T18:08:06.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012726949999999999 2024-05-08T18:08:06.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215232+0000", 2024-05-08T18:08:06.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092652999999999995 2024-05-08T18:08:06.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215321+0000", 2024-05-08T18:08:06.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9272999999999997e-05 2024-05-08T18:08:06.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215384+0000", 2024-05-08T18:08:06.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2665999999999999e-05 2024-05-08T18:08:06.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.185 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.186 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.186 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:06.186 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.816089666000003, 2024-05-08T18:08:06.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030150250000000002, 2024-05-08T18:08:06.186 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.186 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.186 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.186 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.186 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.186 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.186 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 838 2024-05-08T18:08:06.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.186 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:06.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:06.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292816+0000", 2024-05-08T18:08:06.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:08:06.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292828+0000", 2024-05-08T18:08:06.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.184e-05 2024-05-08T18:08:06.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292857+0000", 2024-05-08T18:08:06.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8960000000000001e-05 2024-05-08T18:08:06.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292871+0000", 2024-05-08T18:08:06.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.45e-05 2024-05-08T18:08:06.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293000+0000", 2024-05-08T18:08:06.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128875 2024-05-08T18:08:06.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293231+0000", 2024-05-08T18:08:06.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023030500000000001 2024-05-08T18:08:06.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:06.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293563+0000", 2024-05-08T18:08:06.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000332648 2024-05-08T18:08:06.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.294882+0000", 2024-05-08T18:08:06.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001319183 2024-05-08T18:08:06.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295664+0000", 2024-05-08T18:08:06.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000781991 2024-05-08T18:08:06.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295754+0000", 2024-05-08T18:08:06.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9176000000000001e-05 2024-05-08T18:08:06.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295829+0000", 2024-05-08T18:08:06.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.525e-05 2024-05-08T18:08:06.191 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.191 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.191 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.191 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.191 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:06.191 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.754955997000003, 2024-05-08T18:08:06.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029338929999999999, 2024-05-08T18:08:06.191 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.191 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.192 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.192 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.192 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.192 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.192 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 865 2024-05-08T18:08:06.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.192 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:06.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:06.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353950+0000", 2024-05-08T18:08:06.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2469999999999998e-06 2024-05-08T18:08:06.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353961+0000", 2024-05-08T18:08:06.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1523e-05 2024-05-08T18:08:06.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353991+0000", 2024-05-08T18:08:06.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9920000000000002e-05 2024-05-08T18:08:06.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354013+0000", 2024-05-08T18:08:06.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1590000000000002e-05 2024-05-08T18:08:06.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354206+0000", 2024-05-08T18:08:06.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019273900000000001 2024-05-08T18:08:06.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354418+0000", 2024-05-08T18:08:06.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212518 2024-05-08T18:08:06.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:06.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354720+0000", 2024-05-08T18:08:06.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030151800000000002 2024-05-08T18:08:06.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.355983+0000", 2024-05-08T18:08:06.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012636780000000001 2024-05-08T18:08:06.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356733+0000", 2024-05-08T18:08:06.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074988400000000003 2024-05-08T18:08:06.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356819+0000", 2024-05-08T18:08:06.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5690000000000001e-05 2024-05-08T18:08:06.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356881+0000", 2024-05-08T18:08:06.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2586e-05 2024-05-08T18:08:06.197 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.197 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.197 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.197 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.197 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:06.197 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.741832631999998, 2024-05-08T18:08:06.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004954511, 2024-05-08T18:08:06.198 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.198 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.198 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.198 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.198 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.198 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.198 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 871 2024-05-08T18:08:06.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.198 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:06.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:06.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367073+0000", 2024-05-08T18:08:06.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2340000000000001e-06 2024-05-08T18:08:06.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367085+0000", 2024-05-08T18:08:06.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1483e-05 2024-05-08T18:08:06.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367111+0000", 2024-05-08T18:08:06.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5890000000000001e-05 2024-05-08T18:08:06.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367130+0000", 2024-05-08T18:08:06.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9700000000000001e-05 2024-05-08T18:08:06.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367284+0000", 2024-05-08T18:08:06.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015411799999999999 2024-05-08T18:08:06.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367516+0000", 2024-05-08T18:08:06.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000231272 2024-05-08T18:08:06.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:06.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367837+0000", 2024-05-08T18:08:06.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032173400000000001 2024-05-08T18:08:06.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371395+0000", 2024-05-08T18:08:06.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035574719999999999 2024-05-08T18:08:06.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371882+0000", 2024-05-08T18:08:06.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048693899999999998 2024-05-08T18:08:06.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371962+0000", 2024-05-08T18:08:06.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.975e-05 2024-05-08T18:08:06.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372025+0000", 2024-05-08T18:08:06.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3918999999999996e-05 2024-05-08T18:08:06.204 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.204 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.204 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.204 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.204 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:06.204 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.735944928000002, 2024-05-08T18:08:06.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045233640000000002, 2024-05-08T18:08:06.204 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.205 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.205 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.205 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.205 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.205 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.205 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 873 2024-05-08T18:08:06.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.205 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:06.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:06.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372961+0000", 2024-05-08T18:08:06.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:08:06.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372969+0000", 2024-05-08T18:08:06.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2940000000000006e-06 2024-05-08T18:08:06.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372991+0000", 2024-05-08T18:08:06.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1829000000000001e-05 2024-05-08T18:08:06.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373009+0000", 2024-05-08T18:08:06.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8607e-05 2024-05-08T18:08:06.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373127+0000", 2024-05-08T18:08:06.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011728899999999999 2024-05-08T18:08:06.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373260+0000", 2024-05-08T18:08:06.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013301200000000001 2024-05-08T18:08:06.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:06.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373526+0000", 2024-05-08T18:08:06.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026613500000000003 2024-05-08T18:08:06.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.374558+0000", 2024-05-08T18:08:06.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001032156 2024-05-08T18:08:06.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377333+0000", 2024-05-08T18:08:06.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027749329999999998 2024-05-08T18:08:06.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377421+0000", 2024-05-08T18:08:06.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8679999999999998e-05 2024-05-08T18:08:06.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377482+0000", 2024-05-08T18:08:06.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0538999999999998e-05 2024-05-08T18:08:06.210 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.210 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.210 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.211 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.211 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:06.211 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.676335774000002, 2024-05-08T18:08:06.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035261009999999998, 2024-05-08T18:08:06.211 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.211 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.211 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.211 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.211 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.211 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.211 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 898 2024-05-08T18:08:06.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.212 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:06.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:06.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432570+0000", 2024-05-08T18:08:06.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.26e-06 2024-05-08T18:08:06.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432580+0000", 2024-05-08T18:08:06.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8570000000000007e-06 2024-05-08T18:08:06.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432605+0000", 2024-05-08T18:08:06.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5273e-05 2024-05-08T18:08:06.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432618+0000", 2024-05-08T18:08:06.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2999999999999999e-05 2024-05-08T18:08:06.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432742+0000", 2024-05-08T18:08:06.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012369200000000001 2024-05-08T18:08:06.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433109+0000", 2024-05-08T18:08:06.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036760500000000002 2024-05-08T18:08:06.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:06.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433645+0000", 2024-05-08T18:08:06.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053599599999999996 2024-05-08T18:08:06.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435050+0000", 2024-05-08T18:08:06.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001404696 2024-05-08T18:08:06.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435834+0000", 2024-05-08T18:08:06.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078381100000000003 2024-05-08T18:08:06.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435984+0000", 2024-05-08T18:08:06.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015006899999999999 2024-05-08T18:08:06.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.436094+0000", 2024-05-08T18:08:06.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109842 2024-05-08T18:08:06.217 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.217 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.217 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.217 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.217 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:06.217 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.671582925000003, 2024-05-08T18:08:06.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031481899999999999, 2024-05-08T18:08:06.217 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.217 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.218 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.218 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.218 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.218 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.218 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 900 2024-05-08T18:08:06.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.218 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:06.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:06.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437323+0000", 2024-05-08T18:08:06.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.447e-06 2024-05-08T18:08:06.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437334+0000", 2024-05-08T18:08:06.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0835999999999999e-05 2024-05-08T18:08:06.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437364+0000", 2024-05-08T18:08:06.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0463999999999998e-05 2024-05-08T18:08:06.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437379+0000", 2024-05-08T18:08:06.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4806e-05 2024-05-08T18:08:06.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437500+0000", 2024-05-08T18:08:06.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121309 2024-05-08T18:08:06.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437729+0000", 2024-05-08T18:08:06.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022818200000000001 2024-05-08T18:08:06.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:06.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.438199+0000", 2024-05-08T18:08:06.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047025300000000001 2024-05-08T18:08:06.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.439418+0000", 2024-05-08T18:08:06.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012193849999999999 2024-05-08T18:08:06.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440217+0000", 2024-05-08T18:08:06.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00079905999999999998 2024-05-08T18:08:06.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440352+0000", 2024-05-08T18:08:06.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013485299999999999 2024-05-08T18:08:06.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440469+0000", 2024-05-08T18:08:06.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116595 2024-05-08T18:08:06.223 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.223 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.223 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.223 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.223 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:06.223 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.585346919999999, 2024-05-08T18:08:06.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003477894, 2024-05-08T18:08:06.223 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:06.223 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:06.224 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.224 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:06.224 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:06.224 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.224 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 937 2024-05-08T18:08:06.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.224 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:06.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:06.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:06.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:06.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:06.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:06.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:06.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523559+0000", 2024-05-08T18:08:06.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.95e-06 2024-05-08T18:08:06.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:06.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523567+0000", 2024-05-08T18:08:06.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6799999999999999e-06 2024-05-08T18:08:06.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:06.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523591+0000", 2024-05-08T18:08:06.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3269e-05 2024-05-08T18:08:06.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523611+0000", 2024-05-08T18:08:06.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0100000000000001e-05 2024-05-08T18:08:06.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:06.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523767+0000", 2024-05-08T18:08:06.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015604900000000001 2024-05-08T18:08:06.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:06.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523994+0000", 2024-05-08T18:08:06.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022764199999999999 2024-05-08T18:08:06.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:06.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.524338+0000", 2024-05-08T18:08:06.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034388700000000002 2024-05-08T18:08:06.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:06.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.525707+0000", 2024-05-08T18:08:06.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001368544 2024-05-08T18:08:06.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526843+0000", 2024-05-08T18:08:06.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001136501 2024-05-08T18:08:06.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:06.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526957+0000", 2024-05-08T18:08:06.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011359 2024-05-08T18:08:06.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:06.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:06.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:06.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.527035+0000", 2024-05-08T18:08:06.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7682000000000006e-05 2024-05-08T18:08:06.228 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.228 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.228 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.228 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:06.229 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:06.229 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:06.230 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:08:06.231 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:06.226+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:06.331 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:06.326+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:06.361 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:06.362 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:06.362 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:06.362 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:06.376 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:08:06.468 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:06.466+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:06.532 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:06.530+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:06.544 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:06.544 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:06.544 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:06.544 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:06.544 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:06.558 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:08:06.644 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:06.642+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:06.728 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:06.729 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:06.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:06.729 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:06.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.729 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:36 5.e 5:71234df9:::zone_info.d0a95a6c-3c84-4d52-915c-e8ea581dfb9b:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:08:06.729 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:06.729 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.154057700000003, 2024-05-08T18:08:06.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028394430000000001, 2024-05-08T18:08:06.729 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.729 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.729 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.729 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.729 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:08:06.729 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:08:06.730 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 36 2024-05-08T18:08:06.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.730 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:06.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:06.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573456+0000", 2024-05-08T18:08:06.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:06.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573467+0000", 2024-05-08T18:08:06.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1243999999999999e-05 2024-05-08T18:08:06.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573499+0000", 2024-05-08T18:08:06.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1343000000000001e-05 2024-05-08T18:08:06.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573522+0000", 2024-05-08T18:08:06.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3540000000000002e-05 2024-05-08T18:08:06.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573634+0000", 2024-05-08T18:08:06.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112249 2024-05-08T18:08:06.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573841+0000", 2024-05-08T18:08:06.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000206407 2024-05-08T18:08:06.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:06.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.574122+0000", 2024-05-08T18:08:06.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000281475 2024-05-08T18:08:06.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.575489+0000", 2024-05-08T18:08:06.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001366391 2024-05-08T18:08:06.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576157+0000", 2024-05-08T18:08:06.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00066776200000000002 2024-05-08T18:08:06.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576234+0000", 2024-05-08T18:08:06.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7285000000000003e-05 2024-05-08T18:08:06.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576293+0000", 2024-05-08T18:08:06.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9556999999999999e-05 2024-05-08T18:08:06.734 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.734 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.734 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.734 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:06.735 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:06.735 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.197298506999999, 2024-05-08T18:08:06.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018560765, 2024-05-08T18:08:06.735 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.735 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.735 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:08:06.735 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.735 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.735 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.735 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 43 2024-05-08T18:08:06.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.735 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:06.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530217+0000", 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530253+0000", 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5621999999999999e-05 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530288+0000", 2024-05-08T18:08:06.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5846999999999997e-05 2024-05-08T18:08:06.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530314+0000", 2024-05-08T18:08:06.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5732e-05 2024-05-08T18:08:06.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530952+0000", 2024-05-08T18:08:06.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00063739999999999999 2024-05-08T18:08:06.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:06.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530977+0000", 2024-05-08T18:08:06.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5375e-05 2024-05-08T18:08:06.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548506+0000", 2024-05-08T18:08:06.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017528781 2024-05-08T18:08:06.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548774+0000", 2024-05-08T18:08:06.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026821199999999999 2024-05-08T18:08:06.738 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.738 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.738 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.739 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.739 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:06.739 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.114984583000002, 2024-05-08T18:08:06.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003496893, 2024-05-08T18:08:06.739 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.739 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.739 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.739 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.739 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.739 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.739 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 211 2024-05-08T18:08:06.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.739 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612530+0000", 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9490000000000001e-06 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612544+0000", 2024-05-08T18:08:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3779e-05 2024-05-08T18:08:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612578+0000", 2024-05-08T18:08:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4421000000000001e-05 2024-05-08T18:08:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612596+0000", 2024-05-08T18:08:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7435000000000002e-05 2024-05-08T18:08:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612718+0000", 2024-05-08T18:08:06.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012218600000000001 2024-05-08T18:08:06.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612951+0000", 2024-05-08T18:08:06.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000232768 2024-05-08T18:08:06.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:06.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.613370+0000", 2024-05-08T18:08:06.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041921200000000002 2024-05-08T18:08:06.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.614840+0000", 2024-05-08T18:08:06.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014703679999999999 2024-05-08T18:08:06.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615860+0000", 2024-05-08T18:08:06.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010198220000000001 2024-05-08T18:08:06.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615954+0000", 2024-05-08T18:08:06.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4419000000000005e-05 2024-05-08T18:08:06.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.616024+0000", 2024-05-08T18:08:06.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9534000000000002e-05 2024-05-08T18:08:06.743 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.744 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.744 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.744 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.744 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:06.744 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.038294901, 2024-05-08T18:08:06.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035800939999999998, 2024-05-08T18:08:06.744 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.744 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.744 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.744 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.744 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.744 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.744 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 232 2024-05-08T18:08:06.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.745 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:06.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:06.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689219+0000", 2024-05-08T18:08:06.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4490000000000002e-06 2024-05-08T18:08:06.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689232+0000", 2024-05-08T18:08:06.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3183000000000001e-05 2024-05-08T18:08:06.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689263+0000", 2024-05-08T18:08:06.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400999999999999e-05 2024-05-08T18:08:06.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689279+0000", 2024-05-08T18:08:06.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6078000000000001e-05 2024-05-08T18:08:06.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689401+0000", 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012243000000000001 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689656+0000", 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431899999999998 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.690103+0000", 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044706299999999999 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.691780+0000", 2024-05-08T18:08:06.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016774209999999999 2024-05-08T18:08:06.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692634+0000", 2024-05-08T18:08:06.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085346 2024-05-08T18:08:06.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692728+0000", 2024-05-08T18:08:06.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4429e-05 2024-05-08T18:08:06.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692797+0000", 2024-05-08T18:08:06.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8861000000000004e-05 2024-05-08T18:08:06.749 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.749 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.749 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.749 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:267 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.749 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:06.749 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.013649923000003, 2024-05-08T18:08:06.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040291739999999999, 2024-05-08T18:08:06.749 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.749 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.749 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.749 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.749 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.749 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.750 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 267 2024-05-08T18:08:06.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.750 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:06.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:06.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713863+0000", 2024-05-08T18:08:06.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5200000000000001e-06 2024-05-08T18:08:06.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713873+0000", 2024-05-08T18:08:06.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9089999999999995e-06 2024-05-08T18:08:06.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713896+0000", 2024-05-08T18:08:06.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2595e-05 2024-05-08T18:08:06.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713914+0000", 2024-05-08T18:08:06.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7869000000000001e-05 2024-05-08T18:08:06.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714048+0000", 2024-05-08T18:08:06.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134802 2024-05-08T18:08:06.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714278+0000", 2024-05-08T18:08:06.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022994399999999999 2024-05-08T18:08:06.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:06.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714777+0000", 2024-05-08T18:08:06.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049880499999999995 2024-05-08T18:08:06.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.715976+0000", 2024-05-08T18:08:06.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011991110000000001 2024-05-08T18:08:06.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717646+0000", 2024-05-08T18:08:06.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016699989999999999 2024-05-08T18:08:06.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717790+0000", 2024-05-08T18:08:06.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014359799999999999 2024-05-08T18:08:06.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717891+0000", 2024-05-08T18:08:06.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101022 2024-05-08T18:08:06.754 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.754 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.754 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.754 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:308 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:06.754 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:06.755 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.006282683000002, 2024-05-08T18:08:06.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031672779999999999, 2024-05-08T18:08:06.755 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.755 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.755 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.755 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:06.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:06.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721230+0000", 2024-05-08T18:08:06.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:08:06.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721241+0000", 2024-05-08T18:08:06.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0942e-05 2024-05-08T18:08:06.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721265+0000", 2024-05-08T18:08:06.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3371e-05 2024-05-08T18:08:06.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721278+0000", 2024-05-08T18:08:06.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3586e-05 2024-05-08T18:08:06.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721399+0000", 2024-05-08T18:08:06.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012092 2024-05-08T18:08:06.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721507+0000", 2024-05-08T18:08:06.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107651 2024-05-08T18:08:06.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724292+0000", 2024-05-08T18:08:06.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027851870000000002 2024-05-08T18:08:06.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724396+0000", 2024-05-08T18:08:06.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000104114 2024-05-08T18:08:06.758 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.758 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.758 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.759 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:495 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.759 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:06.759 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.923664782000003, 2024-05-08T18:08:06.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005951001, 2024-05-08T18:08:06.759 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.759 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.759 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.759 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.759 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.759 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.759 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 495 2024-05-08T18:08:06.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.759 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:06.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:06.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803849+0000", 2024-05-08T18:08:06.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3580000000000001e-06 2024-05-08T18:08:06.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803864+0000", 2024-05-08T18:08:06.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4742999999999999e-05 2024-05-08T18:08:06.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803895+0000", 2024-05-08T18:08:06.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0970000000000003e-05 2024-05-08T18:08:06.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803908+0000", 2024-05-08T18:08:06.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2588999999999999e-05 2024-05-08T18:08:06.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804005+0000", 2024-05-08T18:08:06.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7107000000000004e-05 2024-05-08T18:08:06.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804291+0000", 2024-05-08T18:08:06.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028626900000000002 2024-05-08T18:08:06.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:06.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804648+0000", 2024-05-08T18:08:06.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000356955 2024-05-08T18:08:06.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805740+0000", 2024-05-08T18:08:06.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001091905 2024-05-08T18:08:06.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809636+0000", 2024-05-08T18:08:06.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389661 2024-05-08T18:08:06.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809722+0000", 2024-05-08T18:08:06.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:08:06.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809798+0000", 2024-05-08T18:08:06.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5462000000000004e-05 2024-05-08T18:08:06.763 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.917053463999999, 2024-05-08T18:08:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051396380000000002, 2024-05-08T18:08:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 504 2024-05-08T18:08:06.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.765 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:06.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:06.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810460+0000", 2024-05-08T18:08:06.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:08:06.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810470+0000", 2024-05-08T18:08:06.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0222e-05 2024-05-08T18:08:06.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810495+0000", 2024-05-08T18:08:06.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4508999999999999e-05 2024-05-08T18:08:06.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810515+0000", 2024-05-08T18:08:06.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9998999999999999e-05 2024-05-08T18:08:06.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810653+0000", 2024-05-08T18:08:06.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013851099999999999 2024-05-08T18:08:06.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810782+0000", 2024-05-08T18:08:06.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128152 2024-05-08T18:08:06.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:06.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811043+0000", 2024-05-08T18:08:06.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026172400000000002 2024-05-08T18:08:06.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812164+0000", 2024-05-08T18:08:06.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001121024 2024-05-08T18:08:06.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815415+0000", 2024-05-08T18:08:06.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032510270000000001 2024-05-08T18:08:06.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815538+0000", 2024-05-08T18:08:06.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012256999999999999 2024-05-08T18:08:06.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815598+0000", 2024-05-08T18:08:06.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9923000000000002e-05 2024-05-08T18:08:06.769 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.769 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.769 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.769 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:629 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.769 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:06.769 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.808748723999997, 2024-05-08T18:08:06.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611169999999998, 2024-05-08T18:08:06.769 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.769 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.769 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.770 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.770 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.770 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.770 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 629 2024-05-08T18:08:06.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.770 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:06.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:06.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918765+0000", 2024-05-08T18:08:06.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5670000000000002e-06 2024-05-08T18:08:06.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918777+0000", 2024-05-08T18:08:06.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1635e-05 2024-05-08T18:08:06.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918808+0000", 2024-05-08T18:08:06.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1024e-05 2024-05-08T18:08:06.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918823+0000", 2024-05-08T18:08:06.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4939e-05 2024-05-08T18:08:06.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918930+0000", 2024-05-08T18:08:06.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107144 2024-05-08T18:08:06.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919147+0000", 2024-05-08T18:08:06.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021682599999999999 2024-05-08T18:08:06.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:06.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919464+0000", 2024-05-08T18:08:06.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031716699999999998 2024-05-08T18:08:06.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.920561+0000", 2024-05-08T18:08:06.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010970229999999999 2024-05-08T18:08:06.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921468+0000", 2024-05-08T18:08:06.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00090726800000000003 2024-05-08T18:08:06.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921549+0000", 2024-05-08T18:08:06.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0430000000000001e-05 2024-05-08T18:08:06.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921624+0000", 2024-05-08T18:08:06.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5093999999999996e-05 2024-05-08T18:08:06.774 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.774 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.774 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.774 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:681 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.774 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:06.774 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.768427975999998, 2024-05-08T18:08:06.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044793259999999996, 2024-05-08T18:08:06.775 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.775 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.775 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.775 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.775 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.775 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.775 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 681 2024-05-08T18:08:06.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.775 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:06.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959085+0000", 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.353e-06 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959092+0000", 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999999e-06 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959113+0000", 2024-05-08T18:08:06.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0744e-05 2024-05-08T18:08:06.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959130+0000", 2024-05-08T18:08:06.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7679000000000001e-05 2024-05-08T18:08:06.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959217+0000", 2024-05-08T18:08:06.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6487000000000001e-05 2024-05-08T18:08:06.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959335+0000", 2024-05-08T18:08:06.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118476 2024-05-08T18:08:06.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:06.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959598+0000", 2024-05-08T18:08:06.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000263045 2024-05-08T18:08:06.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.960551+0000", 2024-05-08T18:08:06.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095251500000000002 2024-05-08T18:08:06.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963412+0000", 2024-05-08T18:08:06.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611800000000001 2024-05-08T18:08:06.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963498+0000", 2024-05-08T18:08:06.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6145999999999998e-05 2024-05-08T18:08:06.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963563+0000", 2024-05-08T18:08:06.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4701000000000003e-05 2024-05-08T18:08:06.779 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.779 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.779 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.780 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.780 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:06.780 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.733479539999998, 2024-05-08T18:08:06.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031621710000000001, 2024-05-08T18:08:06.780 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.780 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.780 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.780 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.780 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.780 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.780 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 709 2024-05-08T18:08:06.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.780 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:06.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:06.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994035+0000", 2024-05-08T18:08:06.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6460000000000002e-06 2024-05-08T18:08:06.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994047+0000", 2024-05-08T18:08:06.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999e-05 2024-05-08T18:08:06.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994076+0000", 2024-05-08T18:08:06.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9564e-05 2024-05-08T18:08:06.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994091+0000", 2024-05-08T18:08:06.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4696e-05 2024-05-08T18:08:06.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994239+0000", 2024-05-08T18:08:06.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014779699999999999 2024-05-08T18:08:06.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994585+0000", 2024-05-08T18:08:06.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034605900000000002 2024-05-08T18:08:06.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:06.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.995084+0000", 2024-05-08T18:08:06.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049904799999999998 2024-05-08T18:08:06.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.996558+0000", 2024-05-08T18:08:06.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001474532 2024-05-08T18:08:06.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997045+0000", 2024-05-08T18:08:06.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048685900000000002 2024-05-08T18:08:06.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997127+0000", 2024-05-08T18:08:06.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1280999999999996e-05 2024-05-08T18:08:06.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997194+0000", 2024-05-08T18:08:06.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7689999999999997e-05 2024-05-08T18:08:06.785 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.785 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.785 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.785 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.785 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:06.785 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.698090153999999, 2024-05-08T18:08:06.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003066236, 2024-05-08T18:08:06.785 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.785 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.785 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.785 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.785 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.786 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.786 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 724 2024-05-08T18:08:06.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.786 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:06.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:06.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029424+0000", 2024-05-08T18:08:06.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.503e-06 2024-05-08T18:08:06.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029437+0000", 2024-05-08T18:08:06.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3309000000000001e-05 2024-05-08T18:08:06.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029467+0000", 2024-05-08T18:08:06.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9677999999999999e-05 2024-05-08T18:08:06.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029489+0000", 2024-05-08T18:08:06.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2314999999999999e-05 2024-05-08T18:08:06.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029600+0000", 2024-05-08T18:08:06.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110561 2024-05-08T18:08:06.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029896+0000", 2024-05-08T18:08:06.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029632200000000001 2024-05-08T18:08:06.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:06.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.030468+0000", 2024-05-08T18:08:06.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00057224700000000001 2024-05-08T18:08:06.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.031728+0000", 2024-05-08T18:08:06.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012595429999999999 2024-05-08T18:08:06.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032338+0000", 2024-05-08T18:08:06.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00061006700000000005 2024-05-08T18:08:06.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032424+0000", 2024-05-08T18:08:06.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:06.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032488+0000", 2024-05-08T18:08:06.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4210999999999999e-05 2024-05-08T18:08:06.790 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.790 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.790 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.790 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.790 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:06.790 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.693439740000002, 2024-05-08T18:08:06.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029269769999999999, 2024-05-08T18:08:06.790 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.791 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.791 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.791 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.791 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.791 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.791 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 726 2024-05-08T18:08:06.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.791 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:06.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:06.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034074+0000", 2024-05-08T18:08:06.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5900000000000002e-06 2024-05-08T18:08:06.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034086+0000", 2024-05-08T18:08:06.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1265e-05 2024-05-08T18:08:06.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034118+0000", 2024-05-08T18:08:06.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2341000000000001e-05 2024-05-08T18:08:06.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034133+0000", 2024-05-08T18:08:06.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5166e-05 2024-05-08T18:08:06.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034254+0000", 2024-05-08T18:08:06.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121033 2024-05-08T18:08:06.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034492+0000", 2024-05-08T18:08:06.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023727700000000001 2024-05-08T18:08:06.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:06.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034967+0000", 2024-05-08T18:08:06.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047522100000000001 2024-05-08T18:08:06.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036353+0000", 2024-05-08T18:08:06.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013865800000000001 2024-05-08T18:08:06.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036841+0000", 2024-05-08T18:08:06.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048788999999999999 2024-05-08T18:08:06.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036929+0000", 2024-05-08T18:08:06.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:08:06.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036999+0000", 2024-05-08T18:08:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9448000000000003e-05 2024-05-08T18:08:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.690144910000001, 2024-05-08T18:08:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003040662, 2024-05-08T18:08:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.797 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.797 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.797 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 727 2024-05-08T18:08:06.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.797 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:06.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:06.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037369+0000", 2024-05-08T18:08:06.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:08:06.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037378+0000", 2024-05-08T18:08:06.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5359999999999998e-06 2024-05-08T18:08:06.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037405+0000", 2024-05-08T18:08:06.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6588e-05 2024-05-08T18:08:06.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037418+0000", 2024-05-08T18:08:06.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3642000000000001e-05 2024-05-08T18:08:06.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037531+0000", 2024-05-08T18:08:06.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112304 2024-05-08T18:08:06.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037785+0000", 2024-05-08T18:08:06.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025391299999999998 2024-05-08T18:08:06.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:06.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.038112+0000", 2024-05-08T18:08:06.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000326946 2024-05-08T18:08:06.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.039316+0000", 2024-05-08T18:08:06.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012043990000000001 2024-05-08T18:08:06.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040257+0000", 2024-05-08T18:08:06.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000941083 2024-05-08T18:08:06.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040345+0000", 2024-05-08T18:08:06.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8368999999999994e-05 2024-05-08T18:08:06.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040407+0000", 2024-05-08T18:08:06.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1941999999999997e-05 2024-05-08T18:08:06.801 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.801 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.802 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.802 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.802 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:06.802 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.575479520999998, 2024-05-08T18:08:06.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028797779999999999, 2024-05-08T18:08:06.802 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.802 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.802 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.802 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.802 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.802 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.802 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 777 2024-05-08T18:08:06.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.803 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:06.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:06.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152034+0000", 2024-05-08T18:08:06.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2299999999999998e-06 2024-05-08T18:08:06.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152045+0000", 2024-05-08T18:08:06.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0266e-05 2024-05-08T18:08:06.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152076+0000", 2024-05-08T18:08:06.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1007000000000003e-05 2024-05-08T18:08:06.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152094+0000", 2024-05-08T18:08:06.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8148999999999999e-05 2024-05-08T18:08:06.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152183+0000", 2024-05-08T18:08:06.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8845999999999996e-05 2024-05-08T18:08:06.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152308+0000", 2024-05-08T18:08:06.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012502999999999999 2024-05-08T18:08:06.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:06.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152578+0000", 2024-05-08T18:08:06.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027080099999999998 2024-05-08T18:08:06.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154238+0000", 2024-05-08T18:08:06.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016600180000000001 2024-05-08T18:08:06.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154714+0000", 2024-05-08T18:08:06.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000475341 2024-05-08T18:08:06.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154803+0000", 2024-05-08T18:08:06.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9566000000000003e-05 2024-05-08T18:08:06.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154912+0000", 2024-05-08T18:08:06.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010852400000000001 2024-05-08T18:08:06.807 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.807 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.807 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.807 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.807 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:06.807 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.332263628, 2024-05-08T18:08:06.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002844437, 2024-05-08T18:08:06.808 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.808 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.808 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.808 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.808 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.808 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.808 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 882 2024-05-08T18:08:06.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.808 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:06.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395250+0000", 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-06 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395261+0000", 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1046000000000001e-05 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395293+0000", 2024-05-08T18:08:06.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1473999999999997e-05 2024-05-08T18:08:06.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395307+0000", 2024-05-08T18:08:06.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4599e-05 2024-05-08T18:08:06.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395481+0000", 2024-05-08T18:08:06.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173499 2024-05-08T18:08:06.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395626+0000", 2024-05-08T18:08:06.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000145351 2024-05-08T18:08:06.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:06.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395902+0000", 2024-05-08T18:08:06.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027534499999999997 2024-05-08T18:08:06.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397118+0000", 2024-05-08T18:08:06.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012168929999999999 2024-05-08T18:08:06.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397951+0000", 2024-05-08T18:08:06.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000832272 2024-05-08T18:08:06.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398028+0000", 2024-05-08T18:08:06.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6921000000000004e-05 2024-05-08T18:08:06.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398092+0000", 2024-05-08T18:08:06.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4783999999999995e-05 2024-05-08T18:08:06.812 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.812 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.812 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.813 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.813 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:06.813 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.329202907999999, 2024-05-08T18:08:06.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002853894, 2024-05-08T18:08:06.813 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.813 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.813 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.813 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.813 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.813 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.813 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 883 2024-05-08T18:08:06.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.813 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:06.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:06.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398311+0000", 2024-05-08T18:08:06.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398321+0000", 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9189999999999994e-06 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398346+0000", 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5065000000000001e-05 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398360+0000", 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4171999999999999e-05 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398495+0000", 2024-05-08T18:08:06.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013503199999999999 2024-05-08T18:08:06.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398716+0000", 2024-05-08T18:08:06.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220459 2024-05-08T18:08:06.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:06.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.399054+0000", 2024-05-08T18:08:06.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033806199999999998 2024-05-08T18:08:06.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.400192+0000", 2024-05-08T18:08:06.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011389169999999999 2024-05-08T18:08:06.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401020+0000", 2024-05-08T18:08:06.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082746199999999995 2024-05-08T18:08:06.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401099+0000", 2024-05-08T18:08:06.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9157000000000001e-05 2024-05-08T18:08:06.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401163+0000", 2024-05-08T18:08:06.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3498999999999996e-05 2024-05-08T18:08:06.818 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.818 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.818 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.818 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.818 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:06.818 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.325414070999997, 2024-05-08T18:08:06.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031354040000000001, 2024-05-08T18:08:06.818 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.819 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.819 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.819 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.819 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.819 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.819 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 885 2024-05-08T18:08:06.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.819 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:06.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:06.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402100+0000", 2024-05-08T18:08:06.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.063e-06 2024-05-08T18:08:06.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402110+0000", 2024-05-08T18:08:06.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0453e-05 2024-05-08T18:08:06.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402141+0000", 2024-05-08T18:08:06.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0651000000000002e-05 2024-05-08T18:08:06.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402162+0000", 2024-05-08T18:08:06.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1373999999999999e-05 2024-05-08T18:08:06.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402306+0000", 2024-05-08T18:08:06.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143492 2024-05-08T18:08:06.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402562+0000", 2024-05-08T18:08:06.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025671899999999998 2024-05-08T18:08:06.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:06.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.403047+0000", 2024-05-08T18:08:06.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048419100000000003 2024-05-08T18:08:06.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404370+0000", 2024-05-08T18:08:06.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013231580000000001 2024-05-08T18:08:06.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404966+0000", 2024-05-08T18:08:06.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00059601100000000002 2024-05-08T18:08:06.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405115+0000", 2024-05-08T18:08:06.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149665 2024-05-08T18:08:06.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405233+0000", 2024-05-08T18:08:06.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117627 2024-05-08T18:08:06.823 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.823 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.228116536000002, 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003251168, 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 927 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:06.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:06.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499396+0000", 2024-05-08T18:08:06.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:08:06.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499404+0000", 2024-05-08T18:08:06.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2629999999999997e-06 2024-05-08T18:08:06.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499423+0000", 2024-05-08T18:08:06.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9695e-05 2024-05-08T18:08:06.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499435+0000", 2024-05-08T18:08:06.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1542999999999999e-05 2024-05-08T18:08:06.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499545+0000", 2024-05-08T18:08:06.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110064 2024-05-08T18:08:06.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499764+0000", 2024-05-08T18:08:06.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021856499999999999 2024-05-08T18:08:06.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:06.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.500237+0000", 2024-05-08T18:08:06.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047359499999999999 2024-05-08T18:08:06.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.501627+0000", 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013897860000000001 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502484+0000", 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085733300000000005 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502574+0000", 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9939999999999996e-05 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502646+0000", 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2064000000000007e-05 2024-05-08T18:08:06.828 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.829 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.829 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.829 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:06.829 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:06.829 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.224616994999998, 2024-05-08T18:08:06.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031881129999999998, 2024-05-08T18:08:06.829 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:06.829 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:06.829 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:06.829 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:06.829 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:06.829 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:06.829 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 928 2024-05-08T18:08:06.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.830 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:06.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:06.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:06.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:06.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:06.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:06.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:06.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502897+0000", 2024-05-08T18:08:06.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.916e-06 2024-05-08T18:08:06.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:06.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502906+0000", 2024-05-08T18:08:06.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2699999999999993e-06 2024-05-08T18:08:06.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:06.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502933+0000", 2024-05-08T18:08:06.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6823999999999999e-05 2024-05-08T18:08:06.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:06.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502946+0000", 2024-05-08T18:08:06.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3439e-05 2024-05-08T18:08:06.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:06.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503066+0000", 2024-05-08T18:08:06.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012013700000000001 2024-05-08T18:08:06.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:06.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503399+0000", 2024-05-08T18:08:06.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033298600000000001 2024-05-08T18:08:06.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:06.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503928+0000", 2024-05-08T18:08:06.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052877299999999996 2024-05-08T18:08:06.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:06.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505291+0000", 2024-05-08T18:08:06.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001363319 2024-05-08T18:08:06.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:06.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505933+0000", 2024-05-08T18:08:06.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064135799999999997 2024-05-08T18:08:06.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:06.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506019+0000", 2024-05-08T18:08:06.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6649000000000003e-05 2024-05-08T18:08:06.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:06.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:06.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:06.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506083+0000", 2024-05-08T18:08:06.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3441999999999993e-05 2024-05-08T18:08:06.834 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.834 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.834 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.834 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:06.834 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:06.834 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:06.835 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:08:06.836 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:06.834+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:06.936 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:06.934+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:07.006 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:07.006 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:07.021 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:08:07.064 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:07.062+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:07.139 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:07.141+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:07.183 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:07.183 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:07.183 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:07.183 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:07.183 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:07.197 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:08:07.237 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:08:07.240 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:07.241+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:07.315 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:07.315 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:07.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:07.315 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:07.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.315 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:3 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:08:07.315 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:07.316 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.780897361999997, 2024-05-08T18:08:07.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046964590000000001, 2024-05-08T18:08:07.316 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.316 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.316 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:08:07.316 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:07.316 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:08:07.316 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:08:07.316 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 3 2024-05-08T18:08:07.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.316 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:07.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:07.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534906+0000", 2024-05-08T18:08:07.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1030000000000002e-06 2024-05-08T18:08:07.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534918+0000", 2024-05-08T18:08:07.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1732999999999999e-05 2024-05-08T18:08:07.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534950+0000", 2024-05-08T18:08:07.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1420000000000001e-05 2024-05-08T18:08:07.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534974+0000", 2024-05-08T18:08:07.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4473000000000001e-05 2024-05-08T18:08:07.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.539338+0000", 2024-05-08T18:08:07.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043636719999999999 2024-05-08T18:08:07.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.539600+0000", 2024-05-08T18:08:07.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026205800000000002 2024-05-08T18:08:07.319 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.319 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.319 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.320 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:07.320 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:07.320 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.747823697999998, 2024-05-08T18:08:07.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054299370000000001, 2024-05-08T18:08:07.320 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.320 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.320 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.320 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:07.320 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:07.320 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:07.320 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 48 2024-05-08T18:08:07.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.321 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:07.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:07.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567980+0000", 2024-05-08T18:08:07.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.554e-06 2024-05-08T18:08:07.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567990+0000", 2024-05-08T18:08:07.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0961999999999999e-05 2024-05-08T18:08:07.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568023+0000", 2024-05-08T18:08:07.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441999999999999e-05 2024-05-08T18:08:07.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568042+0000", 2024-05-08T18:08:07.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8760999999999999e-05 2024-05-08T18:08:07.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568165+0000", 2024-05-08T18:08:07.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012333400000000001 2024-05-08T18:08:07.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568426+0000", 2024-05-08T18:08:07.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026132999999999999 2024-05-08T18:08:07.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:07.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568666+0000", 2024-05-08T18:08:07.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024009500000000001 2024-05-08T18:08:07.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:07.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.569886+0000", 2024-05-08T18:08:07.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012194790000000001 2024-05-08T18:08:07.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:07.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573254+0000", 2024-05-08T18:08:07.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033677109999999998 2024-05-08T18:08:07.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573339+0000", 2024-05-08T18:08:07.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5666000000000003e-05 2024-05-08T18:08:07.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573407+0000", 2024-05-08T18:08:07.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7602999999999996e-05 2024-05-08T18:08:07.325 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.325 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.325 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.326 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94206896343168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:07.326 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:07.326 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.742143536, 2024-05-08T18:08:07.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054113640000000001, 2024-05-08T18:08:07.326 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.326 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.326 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.326 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:07.326 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:07.326 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:07.326 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 49 2024-05-08T18:08:07.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.326 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:07.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:07.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573659+0000", 2024-05-08T18:08:07.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.762e-06 2024-05-08T18:08:07.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573667+0000", 2024-05-08T18:08:07.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8120000000000008e-06 2024-05-08T18:08:07.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573693+0000", 2024-05-08T18:08:07.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6057000000000001e-05 2024-05-08T18:08:07.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573710+0000", 2024-05-08T18:08:07.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7555999999999999e-05 2024-05-08T18:08:07.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573851+0000", 2024-05-08T18:08:07.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014109800000000001 2024-05-08T18:08:07.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.574072+0000", 2024-05-08T18:08:07.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022062899999999999 2024-05-08T18:08:07.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:07.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.574500+0000", 2024-05-08T18:08:07.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042798100000000002 2024-05-08T18:08:07.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:07.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.575719+0000", 2024-05-08T18:08:07.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001218717 2024-05-08T18:08:07.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:07.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578840+0000", 2024-05-08T18:08:07.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031215380000000001 2024-05-08T18:08:07.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578925+0000", 2024-05-08T18:08:07.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5191999999999993e-05 2024-05-08T18:08:07.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579069+0000", 2024-05-08T18:08:07.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143022 2024-05-08T18:08:07.332 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.332 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.332 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.332 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:08:07.332 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:07.332 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.739355557000003, 2024-05-08T18:08:07.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034814389999999998, 2024-05-08T18:08:07.333 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.333 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.333 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.333 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:07.333 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:07.333 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:07.333 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 205 2024-05-08T18:08:07.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.333 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:07.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:07.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576448+0000", 2024-05-08T18:08:07.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7839999999999999e-06 2024-05-08T18:08:07.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576462+0000", 2024-05-08T18:08:07.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4348999999999999e-05 2024-05-08T18:08:07.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576500+0000", 2024-05-08T18:08:07.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7252999999999997e-05 2024-05-08T18:08:07.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576528+0000", 2024-05-08T18:08:07.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8691e-05 2024-05-08T18:08:07.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576686+0000", 2024-05-08T18:08:07.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015810999999999999 2024-05-08T18:08:07.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576927+0000", 2024-05-08T18:08:07.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000240337 2024-05-08T18:08:07.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:07.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.577354+0000", 2024-05-08T18:08:07.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042767499999999997 2024-05-08T18:08:07.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:07.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.578866+0000", 2024-05-08T18:08:07.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001511271 2024-05-08T18:08:07.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:07.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579762+0000", 2024-05-08T18:08:07.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089618599999999999 2024-05-08T18:08:07.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579858+0000", 2024-05-08T18:08:07.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6686000000000002e-05 2024-05-08T18:08:07.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579927+0000", 2024-05-08T18:08:07.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8096999999999995e-05 2024-05-08T18:08:07.338 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.338 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.338 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.338 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:07.338 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:07.338 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.671359717000001, 2024-05-08T18:08:07.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035139590000000001, 2024-05-08T18:08:07.338 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.338 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.338 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.339 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:07.339 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:07.339 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:07.339 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 220 2024-05-08T18:08:07.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.339 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:07.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:07.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644444+0000", 2024-05-08T18:08:07.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6759999999999999e-06 2024-05-08T18:08:07.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644455+0000", 2024-05-08T18:08:07.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:08:07.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644487+0000", 2024-05-08T18:08:07.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2199999999999997e-05 2024-05-08T18:08:07.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644503+0000", 2024-05-08T18:08:07.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5452e-05 2024-05-08T18:08:07.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644689+0000", 2024-05-08T18:08:07.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000186541 2024-05-08T18:08:07.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644902+0000", 2024-05-08T18:08:07.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021321299999999999 2024-05-08T18:08:07.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:07.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.645299+0000", 2024-05-08T18:08:07.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039702699999999999 2024-05-08T18:08:07.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:07.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647459+0000", 2024-05-08T18:08:07.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021598279999999999 2024-05-08T18:08:07.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:07.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647803+0000", 2024-05-08T18:08:07.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034338199999999999 2024-05-08T18:08:07.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647888+0000", 2024-05-08T18:08:07.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5125999999999998e-05 2024-05-08T18:08:07.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647955+0000", 2024-05-08T18:08:07.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7280999999999995e-05 2024-05-08T18:08:07.343 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.344 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.344 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.344 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:07.344 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:07.344 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.651495197999999, 2024-05-08T18:08:07.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003220367, 2024-05-08T18:08:07.344 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.344 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.344 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.344 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:07.344 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:07.344 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:07.345 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 225 2024-05-08T18:08:07.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.345 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:07.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:07.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664308+0000", 2024-05-08T18:08:07.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:07.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664333+0000", 2024-05-08T18:08:07.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5361e-05 2024-05-08T18:08:07.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664362+0000", 2024-05-08T18:08:07.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8671999999999999e-05 2024-05-08T18:08:07.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664376+0000", 2024-05-08T18:08:07.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4741e-05 2024-05-08T18:08:07.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664541+0000", 2024-05-08T18:08:07.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016484400000000001 2024-05-08T18:08:07.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664767+0000", 2024-05-08T18:08:07.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000226061 2024-05-08T18:08:07.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.665199+0000", 2024-05-08T18:08:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000431674 2024-05-08T18:08:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.666428+0000", 2024-05-08T18:08:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001228605 2024-05-08T18:08:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667367+0000", 2024-05-08T18:08:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093924199999999996 2024-05-08T18:08:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667461+0000", 2024-05-08T18:08:07.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3762000000000001e-05 2024-05-08T18:08:07.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667526+0000", 2024-05-08T18:08:07.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5254999999999998e-05 2024-05-08T18:08:07.349 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.349 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.349 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.350 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:07.350 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:07.350 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.619267700000002, 2024-05-08T18:08:07.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037451559999999999, 2024-05-08T18:08:07.350 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.350 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.350 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.350 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:07.350 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:07.350 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:07.350 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 234 2024-05-08T18:08:07.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.350 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:07.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:07.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696535+0000", 2024-05-08T18:08:07.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0760000000000001e-06 2024-05-08T18:08:07.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696546+0000", 2024-05-08T18:08:07.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0556e-05 2024-05-08T18:08:07.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696577+0000", 2024-05-08T18:08:07.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0904000000000001e-05 2024-05-08T18:08:07.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696592+0000", 2024-05-08T18:08:07.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5316e-05 2024-05-08T18:08:07.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696731+0000", 2024-05-08T18:08:07.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138818 2024-05-08T18:08:07.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.697085+0000", 2024-05-08T18:08:07.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00035397800000000002 2024-05-08T18:08:07.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:07.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.697838+0000", 2024-05-08T18:08:07.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00075314800000000003 2024-05-08T18:08:07.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:07.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.699440+0000", 2024-05-08T18:08:07.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016023470000000001 2024-05-08T18:08:07.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:07.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700067+0000", 2024-05-08T18:08:07.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062698400000000003 2024-05-08T18:08:07.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700161+0000", 2024-05-08T18:08:07.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3762000000000001e-05 2024-05-08T18:08:07.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700278+0000", 2024-05-08T18:08:07.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117267 2024-05-08T18:08:07.355 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.355 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.355 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.355 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:431 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:07.355 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:07.355 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.553775688000002, 2024-05-08T18:08:07.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040957049999999998, 2024-05-08T18:08:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 431 2024-05-08T18:08:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762027+0000", 2024-05-08T18:08:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7889999999999999e-06 2024-05-08T18:08:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762036+0000", 2024-05-08T18:08:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6029999999999994e-06 2024-05-08T18:08:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762061+0000", 2024-05-08T18:08:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4831e-05 2024-05-08T18:08:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762076+0000", 2024-05-08T18:08:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4996e-05 2024-05-08T18:08:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.763559+0000", 2024-05-08T18:08:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001482501 2024-05-08T18:08:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.763747+0000", 2024-05-08T18:08:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018864399999999999 2024-05-08T18:08:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.764172+0000", 2024-05-08T18:08:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042445900000000002 2024-05-08T18:08:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.765292+0000", 2024-05-08T18:08:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001120196 2024-05-08T18:08:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.765812+0000", 2024-05-08T18:08:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052044000000000005 2024-05-08T18:08:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.766007+0000", 2024-05-08T18:08:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019423500000000001 2024-05-08T18:08:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.766121+0000", 2024-05-08T18:08:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114011 2024-05-08T18:08:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.547118216999998, 2024-05-08T18:08:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031982880000000001, 2024-05-08T18:08:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 438 2024-05-08T18:08:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768684+0000", 2024-05-08T18:08:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0049999999999999e-06 2024-05-08T18:08:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768697+0000", 2024-05-08T18:08:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2211e-05 2024-05-08T18:08:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768726+0000", 2024-05-08T18:08:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8949e-05 2024-05-08T18:08:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768743+0000", 2024-05-08T18:08:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7478000000000001e-05 2024-05-08T18:08:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768852+0000", 2024-05-08T18:08:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010889499999999999 2024-05-08T18:08:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.769168+0000", 2024-05-08T18:08:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031610900000000002 2024-05-08T18:08:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.769542+0000", 2024-05-08T18:08:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037368299999999998 2024-05-08T18:08:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.770721+0000", 2024-05-08T18:08:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001179591 2024-05-08T18:08:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771722+0000", 2024-05-08T18:08:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001000463 2024-05-08T18:08:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771819+0000", 2024-05-08T18:08:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6909000000000003e-05 2024-05-08T18:08:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771881+0000", 2024-05-08T18:08:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1995000000000005e-05 2024-05-08T18:08:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:477 6.4 e32/26 6:24c8e1ae:gc::gc.19:head v 32'12, mlcod=32'10)", 2024-05-08T18:08:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.525023189000002, 2024-05-08T18:08:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038511489999999999, 2024-05-08T18:08:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790779+0000", 2024-05-08T18:08:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4559999999999999e-06 2024-05-08T18:08:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790791+0000", 2024-05-08T18:08:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1780000000000001e-05 2024-05-08T18:08:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790817+0000", 2024-05-08T18:08:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5874999999999999e-05 2024-05-08T18:08:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790832+0000", 2024-05-08T18:08:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4909000000000001e-05 2024-05-08T18:08:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790959+0000", 2024-05-08T18:08:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012728199999999999 2024-05-08T18:08:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791007+0000", 2024-05-08T18:08:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7766000000000003e-05 2024-05-08T18:08:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794549+0000", 2024-05-08T18:08:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035422959999999999 2024-05-08T18:08:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794629+0000", 2024-05-08T18:08:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9784999999999996e-05 2024-05-08T18:08:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:487 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.519685940999999, 2024-05-08T18:08:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046865559999999997, 2024-05-08T18:08:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 487 2024-05-08T18:08:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796116+0000", 2024-05-08T18:08:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5650000000000001e-06 2024-05-08T18:08:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796124+0000", 2024-05-08T18:08:07.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6909999999999997e-06 2024-05-08T18:08:07.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796143+0000", 2024-05-08T18:08:07.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9483999999999998e-05 2024-05-08T18:08:07.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796154+0000", 2024-05-08T18:08:07.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0416e-05 2024-05-08T18:08:07.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796266+0000", 2024-05-08T18:08:07.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112011 2024-05-08T18:08:07.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796432+0000", 2024-05-08T18:08:07.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016641799999999999 2024-05-08T18:08:07.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:07.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796718+0000", 2024-05-08T18:08:07.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028548000000000001 2024-05-08T18:08:07.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:07.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798117+0000", 2024-05-08T18:08:07.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001399151 2024-05-08T18:08:07.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:07.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800656+0000", 2024-05-08T18:08:07.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025392689999999998 2024-05-08T18:08:07.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800733+0000", 2024-05-08T18:08:07.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6508000000000007e-05 2024-05-08T18:08:07.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800801+0000", 2024-05-08T18:08:07.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8563000000000001e-05 2024-05-08T18:08:07.377 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.377 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.377 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.377 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:489 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:07.377 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:07.378 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.517739442999996, 2024-05-08T18:08:07.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058220679999999997, 2024-05-08T18:08:07.378 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.378 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.378 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.378 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:07.378 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:07.378 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:07.378 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 489 2024-05-08T18:08:07.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.378 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:07.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:07.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798064+0000", 2024-05-08T18:08:07.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:08:07.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798074+0000", 2024-05-08T18:08:07.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0438999999999999e-05 2024-05-08T18:08:07.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798097+0000", 2024-05-08T18:08:07.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3019000000000001e-05 2024-05-08T18:08:07.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798115+0000", 2024-05-08T18:08:07.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7638e-05 2024-05-08T18:08:07.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798230+0000", 2024-05-08T18:08:07.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115375 2024-05-08T18:08:07.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798395+0000", 2024-05-08T18:08:07.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016542099999999999 2024-05-08T18:08:07.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:07.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798633+0000", 2024-05-08T18:08:07.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000237977 2024-05-08T18:08:07.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:07.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.799628+0000", 2024-05-08T18:08:07.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00099459099999999996 2024-05-08T18:08:07.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:07.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803706+0000", 2024-05-08T18:08:07.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040776199999999997 2024-05-08T18:08:07.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803796+0000", 2024-05-08T18:08:07.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0704000000000004e-05 2024-05-08T18:08:07.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803883+0000", 2024-05-08T18:08:07.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6923999999999996e-05 2024-05-08T18:08:07.383 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.383 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.383 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.383 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:491 6.10 e32/26 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:07.383 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:07.383 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.514515983999999, 2024-05-08T18:08:07.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052480360000000002, 2024-05-08T18:08:07.383 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.383 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.383 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.383 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:07.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:07.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801286+0000", 2024-05-08T18:08:07.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.085e-06 2024-05-08T18:08:07.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801293+0000", 2024-05-08T18:08:07.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.627e-06 2024-05-08T18:08:07.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801311+0000", 2024-05-08T18:08:07.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-05-08T18:08:07.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801320+0000", 2024-05-08T18:08:07.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5710000000000004e-06 2024-05-08T18:08:07.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801401+0000", 2024-05-08T18:08:07.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0798999999999997e-05 2024-05-08T18:08:07.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801439+0000", 2024-05-08T18:08:07.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7994000000000002e-05 2024-05-08T18:08:07.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806447+0000", 2024-05-08T18:08:07.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050077339999999998 2024-05-08T18:08:07.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806533+0000", 2024-05-08T18:08:07.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.577e-05 2024-05-08T18:08:07.387 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.387 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.387 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.387 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:495 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:07.387 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:07.387 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.510979093000003, 2024-05-08T18:08:07.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045481219999999999, 2024-05-08T18:08:07.388 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.388 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.388 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.388 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:07.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:07.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804823+0000", 2024-05-08T18:08:07.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.42e-06 2024-05-08T18:08:07.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804834+0000", 2024-05-08T18:08:07.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0584999999999999e-05 2024-05-08T18:08:07.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804848+0000", 2024-05-08T18:08:07.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:08:07.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804857+0000", 2024-05-08T18:08:07.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.302e-06 2024-05-08T18:08:07.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804967+0000", 2024-05-08T18:08:07.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109543 2024-05-08T18:08:07.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805018+0000", 2024-05-08T18:08:07.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0924000000000002e-05 2024-05-08T18:08:07.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809281+0000", 2024-05-08T18:08:07.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042631479999999996 2024-05-08T18:08:07.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809370+0000", 2024-05-08T18:08:07.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8787000000000002e-05 2024-05-08T18:08:07.391 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.391 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.391 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.392 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:500 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:07.392 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:07.392 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.509420679000002, 2024-05-08T18:08:07.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061595829999999997, 2024-05-08T18:08:07.392 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.392 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.392 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.392 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:07.392 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:07.392 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:07.392 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 500 2024-05-08T18:08:07.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.392 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806382+0000", 2024-05-08T18:08:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2709999999999999e-06 2024-05-08T18:08:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806395+0000", 2024-05-08T18:08:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2782000000000001e-05 2024-05-08T18:08:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806419+0000", 2024-05-08T18:08:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3841000000000001e-05 2024-05-08T18:08:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806437+0000", 2024-05-08T18:08:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8318999999999999e-05 2024-05-08T18:08:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806554+0000", 2024-05-08T18:08:07.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116507 2024-05-08T18:08:07.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806732+0000", 2024-05-08T18:08:07.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017828200000000001 2024-05-08T18:08:07.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:07.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806986+0000", 2024-05-08T18:08:07.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431100000000001 2024-05-08T18:08:07.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:07.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.808032+0000", 2024-05-08T18:08:07.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010455530000000001 2024-05-08T18:08:07.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:07.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812373+0000", 2024-05-08T18:08:07.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043410139999999998 2024-05-08T18:08:07.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812485+0000", 2024-05-08T18:08:07.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011234999999999999 2024-05-08T18:08:07.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812540+0000", 2024-05-08T18:08:07.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4353e-05 2024-05-08T18:08:07.397 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.397 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.397 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.397 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:502 6.10 e32/26 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:07.397 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:07.397 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.508247076000004, 2024-05-08T18:08:07.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049263659999999997, 2024-05-08T18:08:07.397 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.397 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.398 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.398 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:07.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:07.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807555+0000", 2024-05-08T18:08:07.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2079999999999999e-06 2024-05-08T18:08:07.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807563+0000", 2024-05-08T18:08:07.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3280000000000006e-06 2024-05-08T18:08:07.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807585+0000", 2024-05-08T18:08:07.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2361000000000002e-05 2024-05-08T18:08:07.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807596+0000", 2024-05-08T18:08:07.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0968000000000001e-05 2024-05-08T18:08:07.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807700+0000", 2024-05-08T18:08:07.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103232 2024-05-08T18:08:07.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807732+0000", 2024-05-08T18:08:07.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2373999999999999e-05 2024-05-08T18:08:07.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812391+0000", 2024-05-08T18:08:07.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046590140000000004 2024-05-08T18:08:07.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812480+0000", 2024-05-08T18:08:07.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8881000000000005e-05 2024-05-08T18:08:07.401 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.401 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.401 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.401 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:504 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'3, mlcod=32'1)", 2024-05-08T18:08:07.402 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:07.402 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.504574271000003, 2024-05-08T18:08:07.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389472, 2024-05-08T18:08:07.402 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.402 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.402 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.402 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:07.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:07.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811228+0000", 2024-05-08T18:08:07.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8819999999999999e-06 2024-05-08T18:08:07.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811240+0000", 2024-05-08T18:08:07.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1276e-05 2024-05-08T18:08:07.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811266+0000", 2024-05-08T18:08:07.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.601e-05 2024-05-08T18:08:07.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811283+0000", 2024-05-08T18:08:07.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7473e-05 2024-05-08T18:08:07.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811444+0000", 2024-05-08T18:08:07.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000161249 2024-05-08T18:08:07.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811501+0000", 2024-05-08T18:08:07.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6394999999999998e-05 2024-05-08T18:08:07.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815025+0000", 2024-05-08T18:08:07.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003524335 2024-05-08T18:08:07.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815121+0000", 2024-05-08T18:08:07.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6100000000000005e-05 2024-05-08T18:08:07.405 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.405 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.406 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.406 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:505 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:07.406 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:07.406 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.502944976000002, 2024-05-08T18:08:07.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007675075, 2024-05-08T18:08:07.406 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.406 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.406 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.406 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:07.406 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:07.406 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:07.407 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 505 2024-05-08T18:08:07.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.407 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:07.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:07.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812857+0000", 2024-05-08T18:08:07.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.621e-06 2024-05-08T18:08:07.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812865+0000", 2024-05-08T18:08:07.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0600000000000008e-06 2024-05-08T18:08:07.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812889+0000", 2024-05-08T18:08:07.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3569000000000001e-05 2024-05-08T18:08:07.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812901+0000", 2024-05-08T18:08:07.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1610000000000001e-05 2024-05-08T18:08:07.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813025+0000", 2024-05-08T18:08:07.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012430399999999999 2024-05-08T18:08:07.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813168+0000", 2024-05-08T18:08:07.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014329699999999999 2024-05-08T18:08:07.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:07.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813419+0000", 2024-05-08T18:08:07.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000250788 2024-05-08T18:08:07.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:07.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815462+0000", 2024-05-08T18:08:07.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002042865 2024-05-08T18:08:07.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:07.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820385+0000", 2024-05-08T18:08:07.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049229529999999999 2024-05-08T18:08:07.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820462+0000", 2024-05-08T18:08:07.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7101000000000006e-05 2024-05-08T18:08:07.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820531+0000", 2024-05-08T18:08:07.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8906999999999996e-05 2024-05-08T18:08:07.411 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.411 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.411 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.411 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:506 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:07.412 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:07.412 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.501722133000001, 2024-05-08T18:08:07.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006383143, 2024-05-08T18:08:07.412 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.412 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.412 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.412 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:07.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:07.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814081+0000", 2024-05-08T18:08:07.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0080000000000001e-06 2024-05-08T18:08:07.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814094+0000", 2024-05-08T18:08:07.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3407999999999999e-05 2024-05-08T18:08:07.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814125+0000", 2024-05-08T18:08:07.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0688999999999997e-05 2024-05-08T18:08:07.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814142+0000", 2024-05-08T18:08:07.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7192000000000001e-05 2024-05-08T18:08:07.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814245+0000", 2024-05-08T18:08:07.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103164 2024-05-08T18:08:07.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814302+0000", 2024-05-08T18:08:07.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6613999999999997e-05 2024-05-08T18:08:07.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820398+0000", 2024-05-08T18:08:07.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060967620000000004 2024-05-08T18:08:07.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820462+0000", 2024-05-08T18:08:07.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3305999999999993e-05 2024-05-08T18:08:07.415 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.416 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.416 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.416 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:750 6.19 6:9fecf831:::obj_delete_at_hint.0000000057:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:07.416 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:07.416 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.226483762000001, 2024-05-08T18:08:07.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035713440000000002, 2024-05-08T18:08:07.416 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:07.416 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:07.416 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:07.416 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:07.416 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:07.416 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:07.416 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 750 2024-05-08T18:08:07.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.417 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:07.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:07.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:07.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:07.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:07.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:07.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:07.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089318+0000", 2024-05-08T18:08:07.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.446e-06 2024-05-08T18:08:07.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:07.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089325+0000", 2024-05-08T18:08:07.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8560000000000001e-06 2024-05-08T18:08:07.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:07.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089345+0000", 2024-05-08T18:08:07.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9641999999999999e-05 2024-05-08T18:08:07.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:07.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089355+0000", 2024-05-08T18:08:07.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0586e-05 2024-05-08T18:08:07.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:07.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089469+0000", 2024-05-08T18:08:07.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113324 2024-05-08T18:08:07.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:07.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089692+0000", 2024-05-08T18:08:07.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022334500000000001 2024-05-08T18:08:07.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:07.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.090160+0000", 2024-05-08T18:08:07.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00046827799999999998 2024-05-08T18:08:07.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:07.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.091322+0000", 2024-05-08T18:08:07.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001161282 2024-05-08T18:08:07.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:07.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092750+0000", 2024-05-08T18:08:07.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014281299999999999 2024-05-08T18:08:07.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:07.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092829+0000", 2024-05-08T18:08:07.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9376999999999996e-05 2024-05-08T18:08:07.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:07.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:07.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:07.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092888+0000", 2024-05-08T18:08:07.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9077999999999999e-05 2024-05-08T18:08:07.421 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.421 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.421 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.421 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:07.421 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:07.421 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:07.422 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:07.423 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:07.423 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:07.424 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:07.425 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:08:07.425 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:07.425+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:07.425 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:07.426 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:07.427 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:08:07.441 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:07.441 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:07.462 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:07.462 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:07.481 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:07.481 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:07.499 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:07.500 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:07.517 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:07.518 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:07.524 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:07.525+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:07.554 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:07.554 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:07.568 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:08:07.625 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:07.625+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:07.690 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:07.690 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:07.704 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:08:07.726 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:07.725+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:07.823 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:07.823 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:07.826 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:07.829+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:07.838 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:08:07.928 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:07.926+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:07.955 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:07.956 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:07.970 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:08:08.029 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:08.029+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:08.130 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:08.129+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:08.136 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:08.137 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:08.151 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:08:08.231 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:08.226+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:08.272 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:08.272 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:08.286 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:08:08.332 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:08.330+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:08.415 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:08.415 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:08.426 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-05-08T18:08:08.434 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:08:08.434 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:08.433+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:08.533 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:08.530+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:08.548 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:08.548 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:08.562 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:08:08.634 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:08.630+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:08.681 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:08.681 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:08.693 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:08:08.735 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:08.734+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:08.812 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:08.813 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:08.827 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:08:08.874 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:08.877+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:08.937 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:08.934+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:08.941 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:08.941 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:08.954 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:08:09.043 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:09.045+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:09.121 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:09.121 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:09.136 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:08:09.139 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:09.138+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:09.241 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:09.238+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:09.304 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:09.304 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:09.318 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:08:09.341 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:09.338+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:09.436 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:09.436 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:09.442 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:09.441+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:09.449 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:08:09.537 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:08:09.583 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:09.585+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:09.608 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:09.608 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:09.622 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:08:09.644 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:09.642+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:09.669 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:09.669 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:09.686 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:09.686 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:09.716 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:09.716 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:09.745 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:09.746+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:09.745 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:09.745 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:09.780 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:09.780 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:09.811 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:09.812 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:09.816 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:09.816 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:09.816 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:09.816 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:09.834 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:08:09.841 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:09.841 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:09.846 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:09.842+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:09.861 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:09.861 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:09.947 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:09.949+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:09.956 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:09.956 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:09.956 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:09.956 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:09.956 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:09.970 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:08:10.055 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:10.057+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:10.121 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:10.121 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:10.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:10.121 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:10.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.121 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:10.121 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:10.121 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 48.569755495999999, 2024-05-08T18:08:10.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049710090000000002, 2024-05-08T18:08:10.121 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.122 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.122 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-08T18:08:10.122 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.122 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.122 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.122 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 44 2024-05-08T18:08:10.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.122 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:10.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:10.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552775+0000", 2024-05-08T18:08:10.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4450000000000001e-06 2024-05-08T18:08:10.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552790+0000", 2024-05-08T18:08:10.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4363e-05 2024-05-08T18:08:10.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552820+0000", 2024-05-08T18:08:10.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0485999999999999e-05 2024-05-08T18:08:10.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552843+0000", 2024-05-08T18:08:10.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2985000000000001e-05 2024-05-08T18:08:10.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554350+0000", 2024-05-08T18:08:10.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015065149999999999 2024-05-08T18:08:10.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-08T18:08:10.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554374+0000", 2024-05-08T18:08:10.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4097e-05 2024-05-08T18:08:10.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557531+0000", 2024-05-08T18:08:10.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031567169999999999 2024-05-08T18:08:10.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557743+0000", 2024-05-08T18:08:10.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212401 2024-05-08T18:08:10.125 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.125 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.126 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.126 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:10.126 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:10.126 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.534403619000003, 2024-05-08T18:08:10.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050241879999999997, 2024-05-08T18:08:10.126 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.126 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.126 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.126 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.126 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.126 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.126 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 58 2024-05-08T18:08:10.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.127 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:10.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:10.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588125+0000", 2024-05-08T18:08:10.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1399999999999995e-07 2024-05-08T18:08:10.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588129+0000", 2024-05-08T18:08:10.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6779999999999999e-06 2024-05-08T18:08:10.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588142+0000", 2024-05-08T18:08:10.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3047999999999999e-05 2024-05-08T18:08:10.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588174+0000", 2024-05-08T18:08:10.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1270999999999999e-05 2024-05-08T18:08:10.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588307+0000", 2024-05-08T18:08:10.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013307600000000001 2024-05-08T18:08:10.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588477+0000", 2024-05-08T18:08:10.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000170213 2024-05-08T18:08:10.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:10.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588669+0000", 2024-05-08T18:08:10.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019211599999999999 2024-05-08T18:08:10.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.590228+0000", 2024-05-08T18:08:10.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015590059999999999 2024-05-08T18:08:10.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593029+0000", 2024-05-08T18:08:10.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028006400000000001 2024-05-08T18:08:10.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593099+0000", 2024-05-08T18:08:10.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0300000000000001e-05 2024-05-08T18:08:10.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593148+0000", 2024-05-08T18:08:10.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8925999999999999e-05 2024-05-08T18:08:10.131 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.131 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.131 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.131 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:08:10.131 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:10.131 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.537865459000002, 2024-05-08T18:08:10.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00385587, 2024-05-08T18:08:10.132 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.132 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.132 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.132 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.132 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.132 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.132 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207 2024-05-08T18:08:10.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.132 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:10.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:10.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584665+0000", 2024-05-08T18:08:10.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0570000000000001e-06 2024-05-08T18:08:10.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584679+0000", 2024-05-08T18:08:10.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3713000000000001e-05 2024-05-08T18:08:10.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584712+0000", 2024-05-08T18:08:10.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3213999999999997e-05 2024-05-08T18:08:10.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584728+0000", 2024-05-08T18:08:10.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5936000000000001e-05 2024-05-08T18:08:10.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584951+0000", 2024-05-08T18:08:10.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000222955 2024-05-08T18:08:10.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585196+0000", 2024-05-08T18:08:10.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024550800000000002 2024-05-08T18:08:10.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:10.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585643+0000", 2024-05-08T18:08:10.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00044644699999999999 2024-05-08T18:08:10.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.587110+0000", 2024-05-08T18:08:10.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001467323 2024-05-08T18:08:10.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588371+0000", 2024-05-08T18:08:10.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012607180000000001 2024-05-08T18:08:10.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588452+0000", 2024-05-08T18:08:10.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1216000000000003e-05 2024-05-08T18:08:10.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588518+0000", 2024-05-08T18:08:10.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5783000000000004e-05 2024-05-08T18:08:10.136 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.136 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.137 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.137 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.137 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:10.137 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.491690057, 2024-05-08T18:08:10.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003249994, 2024-05-08T18:08:10.137 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.137 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.137 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.137 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.137 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.137 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.137 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216 2024-05-08T18:08:10.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.137 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:10.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:10.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630840+0000", 2024-05-08T18:08:10.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0730000000000001e-06 2024-05-08T18:08:10.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630854+0000", 2024-05-08T18:08:10.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3360000000000001e-05 2024-05-08T18:08:10.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630889+0000", 2024-05-08T18:08:10.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5176999999999999e-05 2024-05-08T18:08:10.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630911+0000", 2024-05-08T18:08:10.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.247e-05 2024-05-08T18:08:10.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631046+0000", 2024-05-08T18:08:10.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013484599999999999 2024-05-08T18:08:10.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631272+0000", 2024-05-08T18:08:10.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000225694 2024-05-08T18:08:10.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:10.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631703+0000", 2024-05-08T18:08:10.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000431144 2024-05-08T18:08:10.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633244+0000", 2024-05-08T18:08:10.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001540622 2024-05-08T18:08:10.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633926+0000", 2024-05-08T18:08:10.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068244200000000001 2024-05-08T18:08:10.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634019+0000", 2024-05-08T18:08:10.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3148999999999999e-05 2024-05-08T18:08:10.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634087+0000", 2024-05-08T18:08:10.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8016999999999996e-05 2024-05-08T18:08:10.142 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.142 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.142 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.142 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.142 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:10.142 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.450146007999997, 2024-05-08T18:08:10.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003119854, 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 227 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:10.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672384+0000", 2024-05-08T18:08:10.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7470000000000001e-06 2024-05-08T18:08:10.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672396+0000", 2024-05-08T18:08:10.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.154e-05 2024-05-08T18:08:10.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672427+0000", 2024-05-08T18:08:10.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1676e-05 2024-05-08T18:08:10.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672443+0000", 2024-05-08T18:08:10.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5214e-05 2024-05-08T18:08:10.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672563+0000", 2024-05-08T18:08:10.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120535 2024-05-08T18:08:10.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672778+0000", 2024-05-08T18:08:10.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021446200000000001 2024-05-08T18:08:10.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:10.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.673205+0000", 2024-05-08T18:08:10.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042750699999999998 2024-05-08T18:08:10.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.674848+0000", 2024-05-08T18:08:10.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016432980000000001 2024-05-08T18:08:10.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675346+0000", 2024-05-08T18:08:10.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049711999999999998 2024-05-08T18:08:10.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675432+0000", 2024-05-08T18:08:10.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6798999999999993e-05 2024-05-08T18:08:10.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675501+0000", 2024-05-08T18:08:10.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8955999999999995e-05 2024-05-08T18:08:10.148 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.148 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.148 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.148 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.148 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:10.148 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.443205220999999, 2024-05-08T18:08:10.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034322110000000001, 2024-05-08T18:08:10.148 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.148 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.148 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.148 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.149 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.149 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.149 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 229 2024-05-08T18:08:10.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.149 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:10.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:10.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679325+0000", 2024-05-08T18:08:10.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:08:10.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679339+0000", 2024-05-08T18:08:10.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:08:10.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679370+0000", 2024-05-08T18:08:10.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0280000000000001e-05 2024-05-08T18:08:10.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679385+0000", 2024-05-08T18:08:10.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5026e-05 2024-05-08T18:08:10.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679504+0000", 2024-05-08T18:08:10.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119023 2024-05-08T18:08:10.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679711+0000", 2024-05-08T18:08:10.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020705499999999999 2024-05-08T18:08:10.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:10.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.680115+0000", 2024-05-08T18:08:10.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040396699999999998 2024-05-08T18:08:10.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.681424+0000", 2024-05-08T18:08:10.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001309387 2024-05-08T18:08:10.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682488+0000", 2024-05-08T18:08:10.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010642519999999999 2024-05-08T18:08:10.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682640+0000", 2024-05-08T18:08:10.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015123599999999999 2024-05-08T18:08:10.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682754+0000", 2024-05-08T18:08:10.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011482200000000001 2024-05-08T18:08:10.153 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.153 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.153 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.153 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.154 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:10.154 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.435821011999998, 2024-05-08T18:08:10.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033353329999999998, 2024-05-08T18:08:10.154 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.154 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.154 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.154 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.154 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.154 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.154 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 231 2024-05-08T18:08:10.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.154 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:10.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:10.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686709+0000", 2024-05-08T18:08:10.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4729999999999999e-06 2024-05-08T18:08:10.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686720+0000", 2024-05-08T18:08:10.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1157e-05 2024-05-08T18:08:10.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686750+0000", 2024-05-08T18:08:10.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0417e-05 2024-05-08T18:08:10.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686765+0000", 2024-05-08T18:08:10.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.487e-05 2024-05-08T18:08:10.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686872+0000", 2024-05-08T18:08:10.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010703499999999999 2024-05-08T18:08:10.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687085+0000", 2024-05-08T18:08:10.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021279599999999999 2024-05-08T18:08:10.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:10.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687501+0000", 2024-05-08T18:08:10.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041554 2024-05-08T18:08:10.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.688886+0000", 2024-05-08T18:08:10.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00138565 2024-05-08T18:08:10.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689899+0000", 2024-05-08T18:08:10.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010128190000000001 2024-05-08T18:08:10.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689978+0000", 2024-05-08T18:08:10.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8490000000000002e-05 2024-05-08T18:08:10.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.690042+0000", 2024-05-08T18:08:10.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4085999999999996e-05 2024-05-08T18:08:10.159 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.159 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.159 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.159 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:394 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.159 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:10.159 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.378747935, 2024-05-08T18:08:10.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034384960000000001, 2024-05-08T18:08:10.159 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.159 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.159 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.159 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.159 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.159 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.160 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 394 2024-05-08T18:08:10.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.160 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:10.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:10.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743781+0000", 2024-05-08T18:08:10.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3e-06 2024-05-08T18:08:10.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743788+0000", 2024-05-08T18:08:10.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7399999999999998e-06 2024-05-08T18:08:10.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743801+0000", 2024-05-08T18:08:10.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3757000000000001e-05 2024-05-08T18:08:10.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743808+0000", 2024-05-08T18:08:10.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6579999999999996e-06 2024-05-08T18:08:10.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743875+0000", 2024-05-08T18:08:10.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6740000000000001e-05 2024-05-08T18:08:10.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743971+0000", 2024-05-08T18:08:10.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6175000000000007e-05 2024-05-08T18:08:10.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:10.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744100+0000", 2024-05-08T18:08:10.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012954899999999999 2024-05-08T18:08:10.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744863+0000", 2024-05-08T18:08:10.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076300100000000002 2024-05-08T18:08:10.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747089+0000", 2024-05-08T18:08:10.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022258540000000002 2024-05-08T18:08:10.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747162+0000", 2024-05-08T18:08:10.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2632000000000005e-05 2024-05-08T18:08:10.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747218+0000", 2024-05-08T18:08:10.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.609e-05 2024-05-08T18:08:10.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.164 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.164 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:535 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.164 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:10.165 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.281034857999998, 2024-05-08T18:08:10.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055640899999999998, 2024-05-08T18:08:10.165 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.165 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.165 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.165 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.165 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.165 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.165 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 535 2024-05-08T18:08:10.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.165 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:10.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:10.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841494+0000", 2024-05-08T18:08:10.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0899999999999999e-06 2024-05-08T18:08:10.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841500+0000", 2024-05-08T18:08:10.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0249999999999999e-06 2024-05-08T18:08:10.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841513+0000", 2024-05-08T18:08:10.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3658e-05 2024-05-08T18:08:10.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841522+0000", 2024-05-08T18:08:10.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3410000000000003e-06 2024-05-08T18:08:10.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841574+0000", 2024-05-08T18:08:10.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2794000000000003e-05 2024-05-08T18:08:10.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841633+0000", 2024-05-08T18:08:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8595999999999999e-05 2024-05-08T18:08:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841755+0000", 2024-05-08T18:08:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012227399999999999 2024-05-08T18:08:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.842349+0000", 2024-05-08T18:08:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00059377699999999998 2024-05-08T18:08:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.846949+0000", 2024-05-08T18:08:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004599723 2024-05-08T18:08:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847008+0000", 2024-05-08T18:08:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8854999999999998e-05 2024-05-08T18:08:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847057+0000", 2024-05-08T18:08:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8956999999999999e-05 2024-05-08T18:08:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.169 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.170 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:541 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.170 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:10.170 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.274005328000001, 2024-05-08T18:08:10.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037829790000000001, 2024-05-08T18:08:10.170 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.170 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.170 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.170 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.170 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.170 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.170 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 541 2024-05-08T18:08:10.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.171 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:10.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:10.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848523+0000", 2024-05-08T18:08:10.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8599999999999997e-07 2024-05-08T18:08:10.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848526+0000", 2024-05-08T18:08:10.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4690000000000002e-06 2024-05-08T18:08:10.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848536+0000", 2024-05-08T18:08:10.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2029999999999998e-06 2024-05-08T18:08:10.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848540+0000", 2024-05-08T18:08:10.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9169999999999997e-06 2024-05-08T18:08:10.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848591+0000", 2024-05-08T18:08:10.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0328000000000003e-05 2024-05-08T18:08:10.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848646+0000", 2024-05-08T18:08:10.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5281999999999997e-05 2024-05-08T18:08:10.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:10.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848759+0000", 2024-05-08T18:08:10.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011278899999999999 2024-05-08T18:08:10.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.849323+0000", 2024-05-08T18:08:10.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056433999999999998 2024-05-08T18:08:10.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852225+0000", 2024-05-08T18:08:10.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029017320000000002 2024-05-08T18:08:10.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852277+0000", 2024-05-08T18:08:10.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2460999999999998e-05 2024-05-08T18:08:10.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852305+0000", 2024-05-08T18:08:10.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7671999999999999e-05 2024-05-08T18:08:10.176 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.176 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.176 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.176 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.176 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:10.176 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.140858250999997, 2024-05-08T18:08:10.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002973084, 2024-05-08T18:08:10.176 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.176 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.176 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.177 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.177 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.177 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.177 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 703 2024-05-08T18:08:10.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.177 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:10.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:10.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981672+0000", 2024-05-08T18:08:10.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5799999999999999e-06 2024-05-08T18:08:10.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981683+0000", 2024-05-08T18:08:10.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1270000000000001e-05 2024-05-08T18:08:10.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981715+0000", 2024-05-08T18:08:10.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1470000000000002e-05 2024-05-08T18:08:10.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981730+0000", 2024-05-08T18:08:10.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5262999999999999e-05 2024-05-08T18:08:10.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981864+0000", 2024-05-08T18:08:10.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134043 2024-05-08T18:08:10.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982168+0000", 2024-05-08T18:08:10.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030453799999999998 2024-05-08T18:08:10.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:10.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982620+0000", 2024-05-08T18:08:10.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045170900000000001 2024-05-08T18:08:10.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.983648+0000", 2024-05-08T18:08:10.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010276009999999999 2024-05-08T18:08:10.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984486+0000", 2024-05-08T18:08:10.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083874600000000002 2024-05-08T18:08:10.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984571+0000", 2024-05-08T18:08:10.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4370999999999996e-05 2024-05-08T18:08:10.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984642+0000", 2024-05-08T18:08:10.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1493000000000001e-05 2024-05-08T18:08:10.181 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.181 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.181 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.182 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:789 6.0 e32/26 6:0216b5b6:::obj_delete_at_hint.0000000070:head v 32'14, mlcod=32'12)", 2024-05-08T18:08:10.182 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:10.182 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.941431477999998, 2024-05-08T18:08:10.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034621420000000001, 2024-05-08T18:08:10.182 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.182 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.182 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.182 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:10.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:10.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181098+0000", 2024-05-08T18:08:10.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8029999999999999e-06 2024-05-08T18:08:10.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181109+0000", 2024-05-08T18:08:10.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1219999999999999e-05 2024-05-08T18:08:10.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181138+0000", 2024-05-08T18:08:10.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.898e-05 2024-05-08T18:08:10.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181151+0000", 2024-05-08T18:08:10.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.308e-05 2024-05-08T18:08:10.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181268+0000", 2024-05-08T18:08:10.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116629 2024-05-08T18:08:10.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181321+0000", 2024-05-08T18:08:10.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3325999999999997e-05 2024-05-08T18:08:10.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184477+0000", 2024-05-08T18:08:10.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003156458 2024-05-08T18:08:10.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184558+0000", 2024-05-08T18:08:10.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0646e-05 2024-05-08T18:08:10.186 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.186 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.186 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.186 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.186 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:10.186 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.910257973999997, 2024-05-08T18:08:10.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031146310000000001, 2024-05-08T18:08:10.186 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.186 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.186 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.186 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.186 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.187 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.187 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 802 2024-05-08T18:08:10.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.187 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:10.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:10.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212272+0000", 2024-05-08T18:08:10.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.943e-06 2024-05-08T18:08:10.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212284+0000", 2024-05-08T18:08:10.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1747e-05 2024-05-08T18:08:10.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212315+0000", 2024-05-08T18:08:10.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0579e-05 2024-05-08T18:08:10.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212336+0000", 2024-05-08T18:08:10.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1639999999999999e-05 2024-05-08T18:08:10.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212488+0000", 2024-05-08T18:08:10.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151192 2024-05-08T18:08:10.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212703+0000", 2024-05-08T18:08:10.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000215439 2024-05-08T18:08:10.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:10.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.213033+0000", 2024-05-08T18:08:10.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032992699999999999 2024-05-08T18:08:10.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.214306+0000", 2024-05-08T18:08:10.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012726949999999999 2024-05-08T18:08:10.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215232+0000", 2024-05-08T18:08:10.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092652999999999995 2024-05-08T18:08:10.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215321+0000", 2024-05-08T18:08:10.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9272999999999997e-05 2024-05-08T18:08:10.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215384+0000", 2024-05-08T18:08:10.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2665999999999999e-05 2024-05-08T18:08:10.191 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.191 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.191 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.192 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.192 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:10.192 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.829713568000003, 2024-05-08T18:08:10.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030150250000000002, 2024-05-08T18:08:10.192 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.192 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.192 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.192 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.192 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.192 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.192 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 838 2024-05-08T18:08:10.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.193 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:10.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:10.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292816+0000", 2024-05-08T18:08:10.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:08:10.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292828+0000", 2024-05-08T18:08:10.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.184e-05 2024-05-08T18:08:10.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292857+0000", 2024-05-08T18:08:10.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8960000000000001e-05 2024-05-08T18:08:10.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292871+0000", 2024-05-08T18:08:10.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.45e-05 2024-05-08T18:08:10.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293000+0000", 2024-05-08T18:08:10.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128875 2024-05-08T18:08:10.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293231+0000", 2024-05-08T18:08:10.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023030500000000001 2024-05-08T18:08:10.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:10.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293563+0000", 2024-05-08T18:08:10.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000332648 2024-05-08T18:08:10.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.294882+0000", 2024-05-08T18:08:10.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001319183 2024-05-08T18:08:10.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295664+0000", 2024-05-08T18:08:10.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000781991 2024-05-08T18:08:10.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295754+0000", 2024-05-08T18:08:10.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9176000000000001e-05 2024-05-08T18:08:10.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295829+0000", 2024-05-08T18:08:10.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.525e-05 2024-05-08T18:08:10.197 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.197 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.197 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.197 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.197 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:10.197 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.768579899000002, 2024-05-08T18:08:10.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029338929999999999, 2024-05-08T18:08:10.197 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.197 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.198 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.198 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.198 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.198 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.198 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 865 2024-05-08T18:08:10.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.198 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:10.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:10.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353950+0000", 2024-05-08T18:08:10.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2469999999999998e-06 2024-05-08T18:08:10.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353961+0000", 2024-05-08T18:08:10.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1523e-05 2024-05-08T18:08:10.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353991+0000", 2024-05-08T18:08:10.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9920000000000002e-05 2024-05-08T18:08:10.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354013+0000", 2024-05-08T18:08:10.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1590000000000002e-05 2024-05-08T18:08:10.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354206+0000", 2024-05-08T18:08:10.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019273900000000001 2024-05-08T18:08:10.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354418+0000", 2024-05-08T18:08:10.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212518 2024-05-08T18:08:10.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:10.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354720+0000", 2024-05-08T18:08:10.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030151800000000002 2024-05-08T18:08:10.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.355983+0000", 2024-05-08T18:08:10.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012636780000000001 2024-05-08T18:08:10.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356733+0000", 2024-05-08T18:08:10.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074988400000000003 2024-05-08T18:08:10.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356819+0000", 2024-05-08T18:08:10.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5690000000000001e-05 2024-05-08T18:08:10.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356881+0000", 2024-05-08T18:08:10.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2586e-05 2024-05-08T18:08:10.202 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.202 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.202 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.203 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.203 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:10.203 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.755456533999997, 2024-05-08T18:08:10.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004954511, 2024-05-08T18:08:10.203 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.203 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.203 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.203 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.203 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.203 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.203 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 871 2024-05-08T18:08:10.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.203 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:10.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:10.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367073+0000", 2024-05-08T18:08:10.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2340000000000001e-06 2024-05-08T18:08:10.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367085+0000", 2024-05-08T18:08:10.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1483e-05 2024-05-08T18:08:10.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367111+0000", 2024-05-08T18:08:10.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5890000000000001e-05 2024-05-08T18:08:10.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367130+0000", 2024-05-08T18:08:10.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9700000000000001e-05 2024-05-08T18:08:10.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367284+0000", 2024-05-08T18:08:10.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015411799999999999 2024-05-08T18:08:10.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367516+0000", 2024-05-08T18:08:10.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000231272 2024-05-08T18:08:10.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:10.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367837+0000", 2024-05-08T18:08:10.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032173400000000001 2024-05-08T18:08:10.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371395+0000", 2024-05-08T18:08:10.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035574719999999999 2024-05-08T18:08:10.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371882+0000", 2024-05-08T18:08:10.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048693899999999998 2024-05-08T18:08:10.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371962+0000", 2024-05-08T18:08:10.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.975e-05 2024-05-08T18:08:10.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372025+0000", 2024-05-08T18:08:10.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3918999999999996e-05 2024-05-08T18:08:10.208 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.208 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.208 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.208 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.208 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:10.208 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.749568830000001, 2024-05-08T18:08:10.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045233640000000002, 2024-05-08T18:08:10.208 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.208 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.208 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.209 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.209 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.209 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.209 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 873 2024-05-08T18:08:10.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.209 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:10.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:10.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372961+0000", 2024-05-08T18:08:10.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:08:10.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372969+0000", 2024-05-08T18:08:10.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2940000000000006e-06 2024-05-08T18:08:10.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372991+0000", 2024-05-08T18:08:10.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1829000000000001e-05 2024-05-08T18:08:10.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373009+0000", 2024-05-08T18:08:10.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8607e-05 2024-05-08T18:08:10.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373127+0000", 2024-05-08T18:08:10.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011728899999999999 2024-05-08T18:08:10.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373260+0000", 2024-05-08T18:08:10.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013301200000000001 2024-05-08T18:08:10.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:10.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373526+0000", 2024-05-08T18:08:10.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026613500000000003 2024-05-08T18:08:10.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.374558+0000", 2024-05-08T18:08:10.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001032156 2024-05-08T18:08:10.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377333+0000", 2024-05-08T18:08:10.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027749329999999998 2024-05-08T18:08:10.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377421+0000", 2024-05-08T18:08:10.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8679999999999998e-05 2024-05-08T18:08:10.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377482+0000", 2024-05-08T18:08:10.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0538999999999998e-05 2024-05-08T18:08:10.213 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.213 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.213 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.214 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.214 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:10.214 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.689959676000001, 2024-05-08T18:08:10.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035261009999999998, 2024-05-08T18:08:10.214 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.214 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.214 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.214 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.214 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.214 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.214 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 898 2024-05-08T18:08:10.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.214 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:10.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:10.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432570+0000", 2024-05-08T18:08:10.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.26e-06 2024-05-08T18:08:10.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432580+0000", 2024-05-08T18:08:10.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8570000000000007e-06 2024-05-08T18:08:10.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432605+0000", 2024-05-08T18:08:10.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5273e-05 2024-05-08T18:08:10.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432618+0000", 2024-05-08T18:08:10.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2999999999999999e-05 2024-05-08T18:08:10.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432742+0000", 2024-05-08T18:08:10.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012369200000000001 2024-05-08T18:08:10.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433109+0000", 2024-05-08T18:08:10.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036760500000000002 2024-05-08T18:08:10.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:10.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433645+0000", 2024-05-08T18:08:10.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053599599999999996 2024-05-08T18:08:10.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435050+0000", 2024-05-08T18:08:10.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001404696 2024-05-08T18:08:10.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435834+0000", 2024-05-08T18:08:10.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078381100000000003 2024-05-08T18:08:10.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435984+0000", 2024-05-08T18:08:10.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015006899999999999 2024-05-08T18:08:10.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.436094+0000", 2024-05-08T18:08:10.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109842 2024-05-08T18:08:10.219 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.219 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.219 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.219 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.219 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:10.219 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.685206827000002, 2024-05-08T18:08:10.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031481899999999999, 2024-05-08T18:08:10.219 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 900 2024-05-08T18:08:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:10.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437323+0000", 2024-05-08T18:08:10.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.447e-06 2024-05-08T18:08:10.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437334+0000", 2024-05-08T18:08:10.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0835999999999999e-05 2024-05-08T18:08:10.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437364+0000", 2024-05-08T18:08:10.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0463999999999998e-05 2024-05-08T18:08:10.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437379+0000", 2024-05-08T18:08:10.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4806e-05 2024-05-08T18:08:10.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437500+0000", 2024-05-08T18:08:10.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121309 2024-05-08T18:08:10.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437729+0000", 2024-05-08T18:08:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022818200000000001 2024-05-08T18:08:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.438199+0000", 2024-05-08T18:08:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047025300000000001 2024-05-08T18:08:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.439418+0000", 2024-05-08T18:08:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012193849999999999 2024-05-08T18:08:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440217+0000", 2024-05-08T18:08:10.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00079905999999999998 2024-05-08T18:08:10.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440352+0000", 2024-05-08T18:08:10.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013485299999999999 2024-05-08T18:08:10.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440469+0000", 2024-05-08T18:08:10.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116595 2024-05-08T18:08:10.224 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.224 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.224 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.225 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.225 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:10.225 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.598970821999998, 2024-05-08T18:08:10.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003477894, 2024-05-08T18:08:10.225 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:10.225 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:10.225 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.225 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:10.225 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:10.225 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.225 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 937 2024-05-08T18:08:10.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.225 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:10.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:10.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:10.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:10.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:10.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:10.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:10.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523559+0000", 2024-05-08T18:08:10.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.95e-06 2024-05-08T18:08:10.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:10.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523567+0000", 2024-05-08T18:08:10.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6799999999999999e-06 2024-05-08T18:08:10.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:10.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523591+0000", 2024-05-08T18:08:10.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3269e-05 2024-05-08T18:08:10.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523611+0000", 2024-05-08T18:08:10.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0100000000000001e-05 2024-05-08T18:08:10.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:10.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523767+0000", 2024-05-08T18:08:10.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015604900000000001 2024-05-08T18:08:10.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:10.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523994+0000", 2024-05-08T18:08:10.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022764199999999999 2024-05-08T18:08:10.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:10.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.524338+0000", 2024-05-08T18:08:10.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034388700000000002 2024-05-08T18:08:10.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:10.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.525707+0000", 2024-05-08T18:08:10.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001368544 2024-05-08T18:08:10.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526843+0000", 2024-05-08T18:08:10.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001136501 2024-05-08T18:08:10.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:10.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526957+0000", 2024-05-08T18:08:10.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011359 2024-05-08T18:08:10.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:10.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:10.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:10.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.527035+0000", 2024-05-08T18:08:10.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7682000000000006e-05 2024-05-08T18:08:10.230 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.230 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.230 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.230 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:10.230 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:10.230 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:10.231 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:08:10.232 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:10.233+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:10.333 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:10.330+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:10.361 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:10.361 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:10.362 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:10.362 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:10.376 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:08:10.433 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:10.433+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:10.450 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:08:10.535 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:10.537+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:10.543 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:10.544 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:10.557 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:08:10.635 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:10.637+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:10.684 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:10.684 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:10.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:10.684 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:10.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.684 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:36 5.e 5:71234df9:::zone_info.d0a95a6c-3c84-4d52-915c-e8ea581dfb9b:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:08:10.685 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:10.685 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.109455271000002, 2024-05-08T18:08:10.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028394430000000001, 2024-05-08T18:08:10.685 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.685 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.685 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.685 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.685 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:08:10.685 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:08:10.685 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 36 2024-05-08T18:08:10.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.685 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:10.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:10.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573456+0000", 2024-05-08T18:08:10.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:10.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573467+0000", 2024-05-08T18:08:10.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1243999999999999e-05 2024-05-08T18:08:10.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573499+0000", 2024-05-08T18:08:10.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1343000000000001e-05 2024-05-08T18:08:10.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573522+0000", 2024-05-08T18:08:10.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3540000000000002e-05 2024-05-08T18:08:10.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573634+0000", 2024-05-08T18:08:10.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112249 2024-05-08T18:08:10.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573841+0000", 2024-05-08T18:08:10.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000206407 2024-05-08T18:08:10.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:10.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.574122+0000", 2024-05-08T18:08:10.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000281475 2024-05-08T18:08:10.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.575489+0000", 2024-05-08T18:08:10.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001366391 2024-05-08T18:08:10.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576157+0000", 2024-05-08T18:08:10.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00066776200000000002 2024-05-08T18:08:10.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576234+0000", 2024-05-08T18:08:10.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7285000000000003e-05 2024-05-08T18:08:10.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576293+0000", 2024-05-08T18:08:10.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9556999999999999e-05 2024-05-08T18:08:10.690 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.690 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.690 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.690 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:10.690 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:10.690 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 49.152696077999998, 2024-05-08T18:08:10.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018560765, 2024-05-08T18:08:10.690 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.690 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.690 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:08:10.690 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 43 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530217+0000", 2024-05-08T18:08:10.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:08:10.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530253+0000", 2024-05-08T18:08:10.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5621999999999999e-05 2024-05-08T18:08:10.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530288+0000", 2024-05-08T18:08:10.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5846999999999997e-05 2024-05-08T18:08:10.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530314+0000", 2024-05-08T18:08:10.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5732e-05 2024-05-08T18:08:10.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530952+0000", 2024-05-08T18:08:10.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00063739999999999999 2024-05-08T18:08:10.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:10.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530977+0000", 2024-05-08T18:08:10.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5375e-05 2024-05-08T18:08:10.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548506+0000", 2024-05-08T18:08:10.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017528781 2024-05-08T18:08:10.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548774+0000", 2024-05-08T18:08:10.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026821199999999999 2024-05-08T18:08:10.694 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.694 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.694 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.694 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.694 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:10.695 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.070382154000001, 2024-05-08T18:08:10.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003496893, 2024-05-08T18:08:10.695 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.695 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.695 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.695 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.695 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.695 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.695 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 211 2024-05-08T18:08:10.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.695 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:10.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:10.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612530+0000", 2024-05-08T18:08:10.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9490000000000001e-06 2024-05-08T18:08:10.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612544+0000", 2024-05-08T18:08:10.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3779e-05 2024-05-08T18:08:10.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612578+0000", 2024-05-08T18:08:10.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4421000000000001e-05 2024-05-08T18:08:10.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612596+0000", 2024-05-08T18:08:10.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7435000000000002e-05 2024-05-08T18:08:10.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612718+0000", 2024-05-08T18:08:10.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012218600000000001 2024-05-08T18:08:10.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612951+0000", 2024-05-08T18:08:10.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000232768 2024-05-08T18:08:10.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:10.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.613370+0000", 2024-05-08T18:08:10.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041921200000000002 2024-05-08T18:08:10.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.614840+0000", 2024-05-08T18:08:10.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014703679999999999 2024-05-08T18:08:10.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615860+0000", 2024-05-08T18:08:10.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010198220000000001 2024-05-08T18:08:10.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615954+0000", 2024-05-08T18:08:10.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4419000000000005e-05 2024-05-08T18:08:10.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.616024+0000", 2024-05-08T18:08:10.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9534000000000002e-05 2024-05-08T18:08:10.699 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.700 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.700 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.700 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.700 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:10.700 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.993692471999999, 2024-05-08T18:08:10.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035800939999999998, 2024-05-08T18:08:10.700 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.700 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.700 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.700 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.700 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.700 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.700 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 232 2024-05-08T18:08:10.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.701 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:10.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:10.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689219+0000", 2024-05-08T18:08:10.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4490000000000002e-06 2024-05-08T18:08:10.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689232+0000", 2024-05-08T18:08:10.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3183000000000001e-05 2024-05-08T18:08:10.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689263+0000", 2024-05-08T18:08:10.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400999999999999e-05 2024-05-08T18:08:10.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689279+0000", 2024-05-08T18:08:10.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6078000000000001e-05 2024-05-08T18:08:10.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689401+0000", 2024-05-08T18:08:10.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012243000000000001 2024-05-08T18:08:10.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689656+0000", 2024-05-08T18:08:10.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431899999999998 2024-05-08T18:08:10.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:10.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.690103+0000", 2024-05-08T18:08:10.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044706299999999999 2024-05-08T18:08:10.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.691780+0000", 2024-05-08T18:08:10.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016774209999999999 2024-05-08T18:08:10.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692634+0000", 2024-05-08T18:08:10.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085346 2024-05-08T18:08:10.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692728+0000", 2024-05-08T18:08:10.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4429e-05 2024-05-08T18:08:10.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692797+0000", 2024-05-08T18:08:10.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8861000000000004e-05 2024-05-08T18:08:10.705 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.705 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.705 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.705 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:267 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.705 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:10.705 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.969047494000002, 2024-05-08T18:08:10.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040291739999999999, 2024-05-08T18:08:10.705 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.706 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.706 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.706 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.706 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.706 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.706 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 267 2024-05-08T18:08:10.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.706 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:10.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:10.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713863+0000", 2024-05-08T18:08:10.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5200000000000001e-06 2024-05-08T18:08:10.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713873+0000", 2024-05-08T18:08:10.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9089999999999995e-06 2024-05-08T18:08:10.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713896+0000", 2024-05-08T18:08:10.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2595e-05 2024-05-08T18:08:10.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713914+0000", 2024-05-08T18:08:10.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7869000000000001e-05 2024-05-08T18:08:10.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714048+0000", 2024-05-08T18:08:10.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134802 2024-05-08T18:08:10.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714278+0000", 2024-05-08T18:08:10.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022994399999999999 2024-05-08T18:08:10.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:10.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714777+0000", 2024-05-08T18:08:10.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049880499999999995 2024-05-08T18:08:10.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.715976+0000", 2024-05-08T18:08:10.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011991110000000001 2024-05-08T18:08:10.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717646+0000", 2024-05-08T18:08:10.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016699989999999999 2024-05-08T18:08:10.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717790+0000", 2024-05-08T18:08:10.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014359799999999999 2024-05-08T18:08:10.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717891+0000", 2024-05-08T18:08:10.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101022 2024-05-08T18:08:10.710 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.711 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.711 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.711 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:308 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:10.711 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:10.711 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.961680254000001, 2024-05-08T18:08:10.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031672779999999999, 2024-05-08T18:08:10.711 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.711 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.711 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.711 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:10.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:10.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721230+0000", 2024-05-08T18:08:10.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:08:10.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721241+0000", 2024-05-08T18:08:10.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0942e-05 2024-05-08T18:08:10.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721265+0000", 2024-05-08T18:08:10.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3371e-05 2024-05-08T18:08:10.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721278+0000", 2024-05-08T18:08:10.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3586e-05 2024-05-08T18:08:10.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721399+0000", 2024-05-08T18:08:10.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012092 2024-05-08T18:08:10.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721507+0000", 2024-05-08T18:08:10.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107651 2024-05-08T18:08:10.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724292+0000", 2024-05-08T18:08:10.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027851870000000002 2024-05-08T18:08:10.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724396+0000", 2024-05-08T18:08:10.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000104114 2024-05-08T18:08:10.715 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.715 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.715 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.715 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:495 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.715 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:10.715 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.879062353000002, 2024-05-08T18:08:10.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005951001, 2024-05-08T18:08:10.715 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.715 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.715 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.715 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.715 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.715 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 495 2024-05-08T18:08:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803849+0000", 2024-05-08T18:08:10.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3580000000000001e-06 2024-05-08T18:08:10.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803864+0000", 2024-05-08T18:08:10.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4742999999999999e-05 2024-05-08T18:08:10.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803895+0000", 2024-05-08T18:08:10.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0970000000000003e-05 2024-05-08T18:08:10.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803908+0000", 2024-05-08T18:08:10.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2588999999999999e-05 2024-05-08T18:08:10.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804005+0000", 2024-05-08T18:08:10.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7107000000000004e-05 2024-05-08T18:08:10.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804291+0000", 2024-05-08T18:08:10.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028626900000000002 2024-05-08T18:08:10.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:10.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804648+0000", 2024-05-08T18:08:10.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000356955 2024-05-08T18:08:10.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805740+0000", 2024-05-08T18:08:10.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001091905 2024-05-08T18:08:10.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809636+0000", 2024-05-08T18:08:10.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389661 2024-05-08T18:08:10.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809722+0000", 2024-05-08T18:08:10.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809798+0000", 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5462000000000004e-05 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.872451034999997, 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051396380000000002, 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.720 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.721 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.721 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.721 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.721 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 504 2024-05-08T18:08:10.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.721 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:10.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:10.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810460+0000", 2024-05-08T18:08:10.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:08:10.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810470+0000", 2024-05-08T18:08:10.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0222e-05 2024-05-08T18:08:10.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810495+0000", 2024-05-08T18:08:10.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4508999999999999e-05 2024-05-08T18:08:10.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810515+0000", 2024-05-08T18:08:10.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9998999999999999e-05 2024-05-08T18:08:10.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810653+0000", 2024-05-08T18:08:10.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013851099999999999 2024-05-08T18:08:10.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810782+0000", 2024-05-08T18:08:10.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128152 2024-05-08T18:08:10.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:10.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811043+0000", 2024-05-08T18:08:10.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026172400000000002 2024-05-08T18:08:10.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812164+0000", 2024-05-08T18:08:10.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001121024 2024-05-08T18:08:10.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815415+0000", 2024-05-08T18:08:10.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032510270000000001 2024-05-08T18:08:10.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815538+0000", 2024-05-08T18:08:10.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012256999999999999 2024-05-08T18:08:10.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815598+0000", 2024-05-08T18:08:10.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9923000000000002e-05 2024-05-08T18:08:10.725 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.725 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.725 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.725 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:629 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.725 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:10.725 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.764146295000003, 2024-05-08T18:08:10.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611169999999998, 2024-05-08T18:08:10.726 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.726 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.726 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.726 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.726 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.726 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.726 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 629 2024-05-08T18:08:10.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.726 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:10.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:10.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918765+0000", 2024-05-08T18:08:10.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5670000000000002e-06 2024-05-08T18:08:10.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918777+0000", 2024-05-08T18:08:10.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1635e-05 2024-05-08T18:08:10.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918808+0000", 2024-05-08T18:08:10.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1024e-05 2024-05-08T18:08:10.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918823+0000", 2024-05-08T18:08:10.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4939e-05 2024-05-08T18:08:10.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918930+0000", 2024-05-08T18:08:10.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107144 2024-05-08T18:08:10.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919147+0000", 2024-05-08T18:08:10.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021682599999999999 2024-05-08T18:08:10.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:10.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919464+0000", 2024-05-08T18:08:10.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031716699999999998 2024-05-08T18:08:10.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.920561+0000", 2024-05-08T18:08:10.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010970229999999999 2024-05-08T18:08:10.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921468+0000", 2024-05-08T18:08:10.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00090726800000000003 2024-05-08T18:08:10.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921549+0000", 2024-05-08T18:08:10.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0430000000000001e-05 2024-05-08T18:08:10.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921624+0000", 2024-05-08T18:08:10.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5093999999999996e-05 2024-05-08T18:08:10.731 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.731 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.731 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.731 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:681 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.731 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:10.731 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.723825546999997, 2024-05-08T18:08:10.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044793259999999996, 2024-05-08T18:08:10.731 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.731 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.731 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.731 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.732 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.732 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.732 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 681 2024-05-08T18:08:10.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.732 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:10.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:10.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959085+0000", 2024-05-08T18:08:10.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.353e-06 2024-05-08T18:08:10.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959092+0000", 2024-05-08T18:08:10.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999999e-06 2024-05-08T18:08:10.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959113+0000", 2024-05-08T18:08:10.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0744e-05 2024-05-08T18:08:10.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959130+0000", 2024-05-08T18:08:10.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7679000000000001e-05 2024-05-08T18:08:10.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959217+0000", 2024-05-08T18:08:10.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6487000000000001e-05 2024-05-08T18:08:10.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959335+0000", 2024-05-08T18:08:10.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118476 2024-05-08T18:08:10.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:10.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959598+0000", 2024-05-08T18:08:10.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000263045 2024-05-08T18:08:10.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.960551+0000", 2024-05-08T18:08:10.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095251500000000002 2024-05-08T18:08:10.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963412+0000", 2024-05-08T18:08:10.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611800000000001 2024-05-08T18:08:10.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963498+0000", 2024-05-08T18:08:10.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6145999999999998e-05 2024-05-08T18:08:10.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963563+0000", 2024-05-08T18:08:10.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4701000000000003e-05 2024-05-08T18:08:10.736 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.736 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.736 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.736 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.736 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:10.736 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.688877110999996, 2024-05-08T18:08:10.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031621710000000001, 2024-05-08T18:08:10.737 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.737 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.737 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.737 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.737 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.737 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.737 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 709 2024-05-08T18:08:10.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.737 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:10.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:10.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994035+0000", 2024-05-08T18:08:10.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6460000000000002e-06 2024-05-08T18:08:10.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994047+0000", 2024-05-08T18:08:10.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999e-05 2024-05-08T18:08:10.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994076+0000", 2024-05-08T18:08:10.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9564e-05 2024-05-08T18:08:10.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994091+0000", 2024-05-08T18:08:10.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4696e-05 2024-05-08T18:08:10.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994239+0000", 2024-05-08T18:08:10.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014779699999999999 2024-05-08T18:08:10.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994585+0000", 2024-05-08T18:08:10.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034605900000000002 2024-05-08T18:08:10.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:10.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.995084+0000", 2024-05-08T18:08:10.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049904799999999998 2024-05-08T18:08:10.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.996558+0000", 2024-05-08T18:08:10.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001474532 2024-05-08T18:08:10.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997045+0000", 2024-05-08T18:08:10.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048685900000000002 2024-05-08T18:08:10.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997127+0000", 2024-05-08T18:08:10.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1280999999999996e-05 2024-05-08T18:08:10.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997194+0000", 2024-05-08T18:08:10.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7689999999999997e-05 2024-05-08T18:08:10.742 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.742 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.742 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.742 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.742 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:10.742 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.653487724999998, 2024-05-08T18:08:10.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003066236, 2024-05-08T18:08:10.742 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.742 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.742 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.742 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.743 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.743 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.743 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 724 2024-05-08T18:08:10.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.743 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:10.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:10.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029424+0000", 2024-05-08T18:08:10.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.503e-06 2024-05-08T18:08:10.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029437+0000", 2024-05-08T18:08:10.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3309000000000001e-05 2024-05-08T18:08:10.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029467+0000", 2024-05-08T18:08:10.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9677999999999999e-05 2024-05-08T18:08:10.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029489+0000", 2024-05-08T18:08:10.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2314999999999999e-05 2024-05-08T18:08:10.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029600+0000", 2024-05-08T18:08:10.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110561 2024-05-08T18:08:10.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029896+0000", 2024-05-08T18:08:10.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029632200000000001 2024-05-08T18:08:10.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:10.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.030468+0000", 2024-05-08T18:08:10.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00057224700000000001 2024-05-08T18:08:10.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.031728+0000", 2024-05-08T18:08:10.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012595429999999999 2024-05-08T18:08:10.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032338+0000", 2024-05-08T18:08:10.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00061006700000000005 2024-05-08T18:08:10.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032424+0000", 2024-05-08T18:08:10.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:10.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032488+0000", 2024-05-08T18:08:10.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4210999999999999e-05 2024-05-08T18:08:10.747 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.747 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.747 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.747 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.747 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:10.747 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.648837311000001, 2024-05-08T18:08:10.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029269769999999999, 2024-05-08T18:08:10.748 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.748 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.748 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.748 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.748 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.748 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.748 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 726 2024-05-08T18:08:10.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.748 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:10.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:10.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034074+0000", 2024-05-08T18:08:10.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5900000000000002e-06 2024-05-08T18:08:10.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034086+0000", 2024-05-08T18:08:10.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1265e-05 2024-05-08T18:08:10.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034118+0000", 2024-05-08T18:08:10.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2341000000000001e-05 2024-05-08T18:08:10.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034133+0000", 2024-05-08T18:08:10.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5166e-05 2024-05-08T18:08:10.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034254+0000", 2024-05-08T18:08:10.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121033 2024-05-08T18:08:10.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034492+0000", 2024-05-08T18:08:10.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023727700000000001 2024-05-08T18:08:10.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:10.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034967+0000", 2024-05-08T18:08:10.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047522100000000001 2024-05-08T18:08:10.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036353+0000", 2024-05-08T18:08:10.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013865800000000001 2024-05-08T18:08:10.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036841+0000", 2024-05-08T18:08:10.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048788999999999999 2024-05-08T18:08:10.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036929+0000", 2024-05-08T18:08:10.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:08:10.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036999+0000", 2024-05-08T18:08:10.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9448000000000003e-05 2024-05-08T18:08:10.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.752 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.753 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.753 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:10.753 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.645542481, 2024-05-08T18:08:10.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003040662, 2024-05-08T18:08:10.753 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.753 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.753 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.753 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.753 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.753 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.753 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 727 2024-05-08T18:08:10.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.753 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:10.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:10.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037369+0000", 2024-05-08T18:08:10.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:08:10.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037378+0000", 2024-05-08T18:08:10.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5359999999999998e-06 2024-05-08T18:08:10.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037405+0000", 2024-05-08T18:08:10.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6588e-05 2024-05-08T18:08:10.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037418+0000", 2024-05-08T18:08:10.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3642000000000001e-05 2024-05-08T18:08:10.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037531+0000", 2024-05-08T18:08:10.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112304 2024-05-08T18:08:10.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037785+0000", 2024-05-08T18:08:10.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025391299999999998 2024-05-08T18:08:10.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:10.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.038112+0000", 2024-05-08T18:08:10.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000326946 2024-05-08T18:08:10.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.039316+0000", 2024-05-08T18:08:10.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012043990000000001 2024-05-08T18:08:10.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040257+0000", 2024-05-08T18:08:10.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000941083 2024-05-08T18:08:10.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040345+0000", 2024-05-08T18:08:10.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8368999999999994e-05 2024-05-08T18:08:10.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040407+0000", 2024-05-08T18:08:10.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1941999999999997e-05 2024-05-08T18:08:10.758 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.758 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.758 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.758 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.758 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:10.758 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.530877091999997, 2024-05-08T18:08:10.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028797779999999999, 2024-05-08T18:08:10.758 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.758 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.759 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.759 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.759 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.759 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.759 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 777 2024-05-08T18:08:10.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.759 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:10.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:10.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152034+0000", 2024-05-08T18:08:10.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2299999999999998e-06 2024-05-08T18:08:10.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152045+0000", 2024-05-08T18:08:10.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0266e-05 2024-05-08T18:08:10.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152076+0000", 2024-05-08T18:08:10.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1007000000000003e-05 2024-05-08T18:08:10.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152094+0000", 2024-05-08T18:08:10.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8148999999999999e-05 2024-05-08T18:08:10.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152183+0000", 2024-05-08T18:08:10.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8845999999999996e-05 2024-05-08T18:08:10.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152308+0000", 2024-05-08T18:08:10.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012502999999999999 2024-05-08T18:08:10.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:10.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152578+0000", 2024-05-08T18:08:10.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027080099999999998 2024-05-08T18:08:10.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154238+0000", 2024-05-08T18:08:10.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016600180000000001 2024-05-08T18:08:10.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154714+0000", 2024-05-08T18:08:10.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000475341 2024-05-08T18:08:10.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154803+0000", 2024-05-08T18:08:10.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9566000000000003e-05 2024-05-08T18:08:10.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154912+0000", 2024-05-08T18:08:10.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010852400000000001 2024-05-08T18:08:10.764 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.764 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.764 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.764 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.764 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:10.764 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.287661198999999, 2024-05-08T18:08:10.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002844437, 2024-05-08T18:08:10.764 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.764 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.764 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.764 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.764 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.765 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.765 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 882 2024-05-08T18:08:10.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.765 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:10.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:10.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395250+0000", 2024-05-08T18:08:10.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-06 2024-05-08T18:08:10.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395261+0000", 2024-05-08T18:08:10.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1046000000000001e-05 2024-05-08T18:08:10.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395293+0000", 2024-05-08T18:08:10.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1473999999999997e-05 2024-05-08T18:08:10.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395307+0000", 2024-05-08T18:08:10.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4599e-05 2024-05-08T18:08:10.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395481+0000", 2024-05-08T18:08:10.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173499 2024-05-08T18:08:10.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395626+0000", 2024-05-08T18:08:10.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000145351 2024-05-08T18:08:10.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:10.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395902+0000", 2024-05-08T18:08:10.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027534499999999997 2024-05-08T18:08:10.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397118+0000", 2024-05-08T18:08:10.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012168929999999999 2024-05-08T18:08:10.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397951+0000", 2024-05-08T18:08:10.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000832272 2024-05-08T18:08:10.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398028+0000", 2024-05-08T18:08:10.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6921000000000004e-05 2024-05-08T18:08:10.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398092+0000", 2024-05-08T18:08:10.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4783999999999995e-05 2024-05-08T18:08:10.769 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.769 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.769 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.769 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.769 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:10.769 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.284600478999998, 2024-05-08T18:08:10.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002853894, 2024-05-08T18:08:10.770 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.770 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.770 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.770 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.770 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.770 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.770 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 883 2024-05-08T18:08:10.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.770 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:10.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:10.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398311+0000", 2024-05-08T18:08:10.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:10.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398321+0000", 2024-05-08T18:08:10.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9189999999999994e-06 2024-05-08T18:08:10.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398346+0000", 2024-05-08T18:08:10.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5065000000000001e-05 2024-05-08T18:08:10.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398360+0000", 2024-05-08T18:08:10.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4171999999999999e-05 2024-05-08T18:08:10.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398495+0000", 2024-05-08T18:08:10.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013503199999999999 2024-05-08T18:08:10.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398716+0000", 2024-05-08T18:08:10.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220459 2024-05-08T18:08:10.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:10.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.399054+0000", 2024-05-08T18:08:10.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033806199999999998 2024-05-08T18:08:10.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.400192+0000", 2024-05-08T18:08:10.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011389169999999999 2024-05-08T18:08:10.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401020+0000", 2024-05-08T18:08:10.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082746199999999995 2024-05-08T18:08:10.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401099+0000", 2024-05-08T18:08:10.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9157000000000001e-05 2024-05-08T18:08:10.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401163+0000", 2024-05-08T18:08:10.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3498999999999996e-05 2024-05-08T18:08:10.774 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.280811642000003, 2024-05-08T18:08:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031354040000000001, 2024-05-08T18:08:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.775 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 885 2024-05-08T18:08:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402100+0000", 2024-05-08T18:08:10.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.063e-06 2024-05-08T18:08:10.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402110+0000", 2024-05-08T18:08:10.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0453e-05 2024-05-08T18:08:10.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402141+0000", 2024-05-08T18:08:10.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0651000000000002e-05 2024-05-08T18:08:10.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402162+0000", 2024-05-08T18:08:10.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1373999999999999e-05 2024-05-08T18:08:10.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402306+0000", 2024-05-08T18:08:10.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143492 2024-05-08T18:08:10.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402562+0000", 2024-05-08T18:08:10.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025671899999999998 2024-05-08T18:08:10.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:10.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.403047+0000", 2024-05-08T18:08:10.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048419100000000003 2024-05-08T18:08:10.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404370+0000", 2024-05-08T18:08:10.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013231580000000001 2024-05-08T18:08:10.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404966+0000", 2024-05-08T18:08:10.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00059601100000000002 2024-05-08T18:08:10.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405115+0000", 2024-05-08T18:08:10.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149665 2024-05-08T18:08:10.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405233+0000", 2024-05-08T18:08:10.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117627 2024-05-08T18:08:10.780 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.780 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.780 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.780 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.780 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:10.780 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.183514107000001, 2024-05-08T18:08:10.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003251168, 2024-05-08T18:08:10.781 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.781 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.781 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.781 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.781 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.781 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.781 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 927 2024-05-08T18:08:10.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.781 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:10.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:10.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499396+0000", 2024-05-08T18:08:10.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:08:10.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499404+0000", 2024-05-08T18:08:10.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2629999999999997e-06 2024-05-08T18:08:10.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499423+0000", 2024-05-08T18:08:10.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9695e-05 2024-05-08T18:08:10.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499435+0000", 2024-05-08T18:08:10.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1542999999999999e-05 2024-05-08T18:08:10.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499545+0000", 2024-05-08T18:08:10.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110064 2024-05-08T18:08:10.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499764+0000", 2024-05-08T18:08:10.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021856499999999999 2024-05-08T18:08:10.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:10.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.500237+0000", 2024-05-08T18:08:10.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047359499999999999 2024-05-08T18:08:10.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.501627+0000", 2024-05-08T18:08:10.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013897860000000001 2024-05-08T18:08:10.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502484+0000", 2024-05-08T18:08:10.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085733300000000005 2024-05-08T18:08:10.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502574+0000", 2024-05-08T18:08:10.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9939999999999996e-05 2024-05-08T18:08:10.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502646+0000", 2024-05-08T18:08:10.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2064000000000007e-05 2024-05-08T18:08:10.785 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.785 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.785 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.786 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:10.786 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:10.786 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.180014565999997, 2024-05-08T18:08:10.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031881129999999998, 2024-05-08T18:08:10.786 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:10.786 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:10.786 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:10.786 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:10.786 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:10.786 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:10.786 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 928 2024-05-08T18:08:10.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.787 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:10.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:10.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:10.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:10.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:10.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:10.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:10.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502897+0000", 2024-05-08T18:08:10.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.916e-06 2024-05-08T18:08:10.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:10.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502906+0000", 2024-05-08T18:08:10.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2699999999999993e-06 2024-05-08T18:08:10.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:10.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502933+0000", 2024-05-08T18:08:10.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6823999999999999e-05 2024-05-08T18:08:10.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:10.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502946+0000", 2024-05-08T18:08:10.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3439e-05 2024-05-08T18:08:10.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:10.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503066+0000", 2024-05-08T18:08:10.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012013700000000001 2024-05-08T18:08:10.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:10.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503399+0000", 2024-05-08T18:08:10.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033298600000000001 2024-05-08T18:08:10.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:10.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503928+0000", 2024-05-08T18:08:10.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052877299999999996 2024-05-08T18:08:10.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:10.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505291+0000", 2024-05-08T18:08:10.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001363319 2024-05-08T18:08:10.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:10.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505933+0000", 2024-05-08T18:08:10.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064135799999999997 2024-05-08T18:08:10.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:10.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506019+0000", 2024-05-08T18:08:10.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6649000000000003e-05 2024-05-08T18:08:10.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:10.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:10.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:10.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506083+0000", 2024-05-08T18:08:10.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3441999999999993e-05 2024-05-08T18:08:10.791 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.791 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.791 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.791 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:10.791 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:10.791 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:10.793 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:08:10.793 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:10.793+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:10.894 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:10.890+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:10.918 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:10.919 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:10.919 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:10.919 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:10.934 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:08:10.994 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:10.997+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:11.095 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:11.097+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:11.096 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:11.097 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:11.097 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:11.097 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:11.097 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:11.111 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:08:11.196 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:11.194+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:11.232 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:11.232 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:11.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:11.232 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:11.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.232 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:3 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:08:11.232 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:11.232 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.697674501000002, 2024-05-08T18:08:11.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046964590000000001, 2024-05-08T18:08:11.233 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.233 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.233 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:08:11.233 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.233 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:08:11.233 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:08:11.233 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 3 2024-05-08T18:08:11.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.233 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:11.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:11.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534906+0000", 2024-05-08T18:08:11.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1030000000000002e-06 2024-05-08T18:08:11.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534918+0000", 2024-05-08T18:08:11.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1732999999999999e-05 2024-05-08T18:08:11.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534950+0000", 2024-05-08T18:08:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1420000000000001e-05 2024-05-08T18:08:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534974+0000", 2024-05-08T18:08:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4473000000000001e-05 2024-05-08T18:08:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.539338+0000", 2024-05-08T18:08:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043636719999999999 2024-05-08T18:08:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.539600+0000", 2024-05-08T18:08:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026205800000000002 2024-05-08T18:08:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.664600837000002, 2024-05-08T18:08:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054299370000000001, 2024-05-08T18:08:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 48 2024-05-08T18:08:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567980+0000", 2024-05-08T18:08:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.554e-06 2024-05-08T18:08:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567990+0000", 2024-05-08T18:08:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0961999999999999e-05 2024-05-08T18:08:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568023+0000", 2024-05-08T18:08:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441999999999999e-05 2024-05-08T18:08:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568042+0000", 2024-05-08T18:08:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8760999999999999e-05 2024-05-08T18:08:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568165+0000", 2024-05-08T18:08:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012333400000000001 2024-05-08T18:08:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568426+0000", 2024-05-08T18:08:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026132999999999999 2024-05-08T18:08:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:11.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568666+0000", 2024-05-08T18:08:11.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024009500000000001 2024-05-08T18:08:11.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.569886+0000", 2024-05-08T18:08:11.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012194790000000001 2024-05-08T18:08:11.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573254+0000", 2024-05-08T18:08:11.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033677109999999998 2024-05-08T18:08:11.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573339+0000", 2024-05-08T18:08:11.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5666000000000003e-05 2024-05-08T18:08:11.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573407+0000", 2024-05-08T18:08:11.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7602999999999996e-05 2024-05-08T18:08:11.241 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.241 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.241 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.241 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94206896343168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:11.241 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:11.242 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.658920674999997, 2024-05-08T18:08:11.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054113640000000001, 2024-05-08T18:08:11.242 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.242 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.242 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.242 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.242 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.242 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.242 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 49 2024-05-08T18:08:11.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.242 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:11.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:11.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573659+0000", 2024-05-08T18:08:11.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.762e-06 2024-05-08T18:08:11.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573667+0000", 2024-05-08T18:08:11.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8120000000000008e-06 2024-05-08T18:08:11.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573693+0000", 2024-05-08T18:08:11.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6057000000000001e-05 2024-05-08T18:08:11.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573710+0000", 2024-05-08T18:08:11.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7555999999999999e-05 2024-05-08T18:08:11.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573851+0000", 2024-05-08T18:08:11.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014109800000000001 2024-05-08T18:08:11.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.574072+0000", 2024-05-08T18:08:11.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022062899999999999 2024-05-08T18:08:11.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:11.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.574500+0000", 2024-05-08T18:08:11.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042798100000000002 2024-05-08T18:08:11.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.575719+0000", 2024-05-08T18:08:11.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001218717 2024-05-08T18:08:11.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578840+0000", 2024-05-08T18:08:11.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031215380000000001 2024-05-08T18:08:11.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578925+0000", 2024-05-08T18:08:11.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5191999999999993e-05 2024-05-08T18:08:11.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579069+0000", 2024-05-08T18:08:11.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143022 2024-05-08T18:08:11.246 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.246 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.246 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.247 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:08:11.247 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:11.247 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.656132696, 2024-05-08T18:08:11.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034814389999999998, 2024-05-08T18:08:11.247 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.247 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.247 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.247 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.247 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.247 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.247 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 205 2024-05-08T18:08:11.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.247 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:11.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:11.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576448+0000", 2024-05-08T18:08:11.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7839999999999999e-06 2024-05-08T18:08:11.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576462+0000", 2024-05-08T18:08:11.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4348999999999999e-05 2024-05-08T18:08:11.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576500+0000", 2024-05-08T18:08:11.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7252999999999997e-05 2024-05-08T18:08:11.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576528+0000", 2024-05-08T18:08:11.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8691e-05 2024-05-08T18:08:11.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576686+0000", 2024-05-08T18:08:11.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015810999999999999 2024-05-08T18:08:11.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576927+0000", 2024-05-08T18:08:11.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000240337 2024-05-08T18:08:11.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:11.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.577354+0000", 2024-05-08T18:08:11.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042767499999999997 2024-05-08T18:08:11.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.578866+0000", 2024-05-08T18:08:11.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001511271 2024-05-08T18:08:11.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579762+0000", 2024-05-08T18:08:11.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089618599999999999 2024-05-08T18:08:11.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579858+0000", 2024-05-08T18:08:11.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6686000000000002e-05 2024-05-08T18:08:11.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579927+0000", 2024-05-08T18:08:11.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8096999999999995e-05 2024-05-08T18:08:11.252 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.252 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.252 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.252 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:11.252 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:11.252 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.588136855999998, 2024-05-08T18:08:11.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035139590000000001, 2024-05-08T18:08:11.252 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.252 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.252 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.252 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.253 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.253 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.253 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 220 2024-05-08T18:08:11.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.253 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:11.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:11.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644444+0000", 2024-05-08T18:08:11.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6759999999999999e-06 2024-05-08T18:08:11.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644455+0000", 2024-05-08T18:08:11.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:08:11.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644487+0000", 2024-05-08T18:08:11.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2199999999999997e-05 2024-05-08T18:08:11.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644503+0000", 2024-05-08T18:08:11.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5452e-05 2024-05-08T18:08:11.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644689+0000", 2024-05-08T18:08:11.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000186541 2024-05-08T18:08:11.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644902+0000", 2024-05-08T18:08:11.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021321299999999999 2024-05-08T18:08:11.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:11.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.645299+0000", 2024-05-08T18:08:11.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039702699999999999 2024-05-08T18:08:11.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647459+0000", 2024-05-08T18:08:11.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021598279999999999 2024-05-08T18:08:11.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647803+0000", 2024-05-08T18:08:11.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034338199999999999 2024-05-08T18:08:11.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647888+0000", 2024-05-08T18:08:11.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5125999999999998e-05 2024-05-08T18:08:11.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647955+0000", 2024-05-08T18:08:11.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7280999999999995e-05 2024-05-08T18:08:11.257 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.257 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.257 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.257 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:11.257 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:11.258 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.568272337000003, 2024-05-08T18:08:11.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003220367, 2024-05-08T18:08:11.258 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.258 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.258 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.258 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.258 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.258 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.258 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 225 2024-05-08T18:08:11.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.258 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:11.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:11.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664308+0000", 2024-05-08T18:08:11.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:11.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664333+0000", 2024-05-08T18:08:11.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5361e-05 2024-05-08T18:08:11.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664362+0000", 2024-05-08T18:08:11.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8671999999999999e-05 2024-05-08T18:08:11.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664376+0000", 2024-05-08T18:08:11.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4741e-05 2024-05-08T18:08:11.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664541+0000", 2024-05-08T18:08:11.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016484400000000001 2024-05-08T18:08:11.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664767+0000", 2024-05-08T18:08:11.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000226061 2024-05-08T18:08:11.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:11.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.665199+0000", 2024-05-08T18:08:11.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000431674 2024-05-08T18:08:11.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.666428+0000", 2024-05-08T18:08:11.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001228605 2024-05-08T18:08:11.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667367+0000", 2024-05-08T18:08:11.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093924199999999996 2024-05-08T18:08:11.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667461+0000", 2024-05-08T18:08:11.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3762000000000001e-05 2024-05-08T18:08:11.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667526+0000", 2024-05-08T18:08:11.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5254999999999998e-05 2024-05-08T18:08:11.262 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.263 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.263 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.263 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:11.263 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:11.263 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.536044838999999, 2024-05-08T18:08:11.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037451559999999999, 2024-05-08T18:08:11.263 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.263 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.263 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.263 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.263 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.263 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.263 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 234 2024-05-08T18:08:11.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.264 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:11.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:11.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696535+0000", 2024-05-08T18:08:11.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0760000000000001e-06 2024-05-08T18:08:11.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696546+0000", 2024-05-08T18:08:11.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0556e-05 2024-05-08T18:08:11.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696577+0000", 2024-05-08T18:08:11.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0904000000000001e-05 2024-05-08T18:08:11.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696592+0000", 2024-05-08T18:08:11.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5316e-05 2024-05-08T18:08:11.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696731+0000", 2024-05-08T18:08:11.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138818 2024-05-08T18:08:11.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.697085+0000", 2024-05-08T18:08:11.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00035397800000000002 2024-05-08T18:08:11.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:11.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.697838+0000", 2024-05-08T18:08:11.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00075314800000000003 2024-05-08T18:08:11.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.699440+0000", 2024-05-08T18:08:11.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016023470000000001 2024-05-08T18:08:11.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700067+0000", 2024-05-08T18:08:11.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062698400000000003 2024-05-08T18:08:11.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700161+0000", 2024-05-08T18:08:11.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3762000000000001e-05 2024-05-08T18:08:11.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700278+0000", 2024-05-08T18:08:11.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117267 2024-05-08T18:08:11.268 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.268 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.268 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.268 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:431 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:11.268 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:11.268 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.470552826999999, 2024-05-08T18:08:11.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040957049999999998, 2024-05-08T18:08:11.268 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.268 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.269 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.269 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.269 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.269 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.269 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 431 2024-05-08T18:08:11.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.269 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:11.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:11.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762027+0000", 2024-05-08T18:08:11.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7889999999999999e-06 2024-05-08T18:08:11.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762036+0000", 2024-05-08T18:08:11.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6029999999999994e-06 2024-05-08T18:08:11.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762061+0000", 2024-05-08T18:08:11.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4831e-05 2024-05-08T18:08:11.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762076+0000", 2024-05-08T18:08:11.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4996e-05 2024-05-08T18:08:11.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.763559+0000", 2024-05-08T18:08:11.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001482501 2024-05-08T18:08:11.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.763747+0000", 2024-05-08T18:08:11.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018864399999999999 2024-05-08T18:08:11.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:11.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.764172+0000", 2024-05-08T18:08:11.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042445900000000002 2024-05-08T18:08:11.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.765292+0000", 2024-05-08T18:08:11.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001120196 2024-05-08T18:08:11.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.765812+0000", 2024-05-08T18:08:11.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052044000000000005 2024-05-08T18:08:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.766007+0000", 2024-05-08T18:08:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019423500000000001 2024-05-08T18:08:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.766121+0000", 2024-05-08T18:08:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114011 2024-05-08T18:08:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:11.274 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:11.274 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.463895356000002, 2024-05-08T18:08:11.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031982880000000001, 2024-05-08T18:08:11.274 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.274 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.274 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.274 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.274 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.274 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.274 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 438 2024-05-08T18:08:11.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.274 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:11.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:11.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768684+0000", 2024-05-08T18:08:11.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0049999999999999e-06 2024-05-08T18:08:11.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768697+0000", 2024-05-08T18:08:11.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2211e-05 2024-05-08T18:08:11.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768726+0000", 2024-05-08T18:08:11.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8949e-05 2024-05-08T18:08:11.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768743+0000", 2024-05-08T18:08:11.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7478000000000001e-05 2024-05-08T18:08:11.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768852+0000", 2024-05-08T18:08:11.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010889499999999999 2024-05-08T18:08:11.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.769168+0000", 2024-05-08T18:08:11.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031610900000000002 2024-05-08T18:08:11.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:11.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.769542+0000", 2024-05-08T18:08:11.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037368299999999998 2024-05-08T18:08:11.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.770721+0000", 2024-05-08T18:08:11.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001179591 2024-05-08T18:08:11.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771722+0000", 2024-05-08T18:08:11.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001000463 2024-05-08T18:08:11.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771819+0000", 2024-05-08T18:08:11.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6909000000000003e-05 2024-05-08T18:08:11.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771881+0000", 2024-05-08T18:08:11.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1995000000000005e-05 2024-05-08T18:08:11.279 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.279 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.279 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.279 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:477 6.4 e32/26 6:24c8e1ae:gc::gc.19:head v 32'12, mlcod=32'10)", 2024-05-08T18:08:11.279 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:11.279 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.441800327999999, 2024-05-08T18:08:11.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038511489999999999, 2024-05-08T18:08:11.280 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.280 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.280 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.280 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:11.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:11.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790779+0000", 2024-05-08T18:08:11.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4559999999999999e-06 2024-05-08T18:08:11.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790791+0000", 2024-05-08T18:08:11.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1780000000000001e-05 2024-05-08T18:08:11.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790817+0000", 2024-05-08T18:08:11.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5874999999999999e-05 2024-05-08T18:08:11.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790832+0000", 2024-05-08T18:08:11.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4909000000000001e-05 2024-05-08T18:08:11.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790959+0000", 2024-05-08T18:08:11.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012728199999999999 2024-05-08T18:08:11.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791007+0000", 2024-05-08T18:08:11.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7766000000000003e-05 2024-05-08T18:08:11.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794549+0000", 2024-05-08T18:08:11.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035422959999999999 2024-05-08T18:08:11.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794629+0000", 2024-05-08T18:08:11.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9784999999999996e-05 2024-05-08T18:08:11.283 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.283 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.283 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.284 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:487 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:11.284 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:11.284 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.436463080000003, 2024-05-08T18:08:11.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046865559999999997, 2024-05-08T18:08:11.284 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.284 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.284 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.284 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.284 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.284 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.284 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 487 2024-05-08T18:08:11.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.284 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:11.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:11.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796116+0000", 2024-05-08T18:08:11.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5650000000000001e-06 2024-05-08T18:08:11.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796124+0000", 2024-05-08T18:08:11.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6909999999999997e-06 2024-05-08T18:08:11.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796143+0000", 2024-05-08T18:08:11.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9483999999999998e-05 2024-05-08T18:08:11.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796154+0000", 2024-05-08T18:08:11.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0416e-05 2024-05-08T18:08:11.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796266+0000", 2024-05-08T18:08:11.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112011 2024-05-08T18:08:11.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796432+0000", 2024-05-08T18:08:11.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016641799999999999 2024-05-08T18:08:11.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:11.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796718+0000", 2024-05-08T18:08:11.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028548000000000001 2024-05-08T18:08:11.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798117+0000", 2024-05-08T18:08:11.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001399151 2024-05-08T18:08:11.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800656+0000", 2024-05-08T18:08:11.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025392689999999998 2024-05-08T18:08:11.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800733+0000", 2024-05-08T18:08:11.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6508000000000007e-05 2024-05-08T18:08:11.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800801+0000", 2024-05-08T18:08:11.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8563000000000001e-05 2024-05-08T18:08:11.289 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.289 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.289 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.289 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:489 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:11.289 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:11.289 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.434516582000001, 2024-05-08T18:08:11.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058220679999999997, 2024-05-08T18:08:11.289 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.289 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.290 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.290 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.290 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.290 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.290 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 489 2024-05-08T18:08:11.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.290 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:11.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:11.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798064+0000", 2024-05-08T18:08:11.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:08:11.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798074+0000", 2024-05-08T18:08:11.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0438999999999999e-05 2024-05-08T18:08:11.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798097+0000", 2024-05-08T18:08:11.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3019000000000001e-05 2024-05-08T18:08:11.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798115+0000", 2024-05-08T18:08:11.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7638e-05 2024-05-08T18:08:11.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798230+0000", 2024-05-08T18:08:11.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115375 2024-05-08T18:08:11.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798395+0000", 2024-05-08T18:08:11.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016542099999999999 2024-05-08T18:08:11.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:11.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798633+0000", 2024-05-08T18:08:11.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000237977 2024-05-08T18:08:11.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.799628+0000", 2024-05-08T18:08:11.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00099459099999999996 2024-05-08T18:08:11.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803706+0000", 2024-05-08T18:08:11.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040776199999999997 2024-05-08T18:08:11.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803796+0000", 2024-05-08T18:08:11.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0704000000000004e-05 2024-05-08T18:08:11.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803883+0000", 2024-05-08T18:08:11.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6923999999999996e-05 2024-05-08T18:08:11.294 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.294 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.294 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.295 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:491 6.10 e32/26 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:11.295 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:11.295 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.431293123000003, 2024-05-08T18:08:11.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052480360000000002, 2024-05-08T18:08:11.295 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.295 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.295 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.295 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:11.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:11.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801286+0000", 2024-05-08T18:08:11.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.085e-06 2024-05-08T18:08:11.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801293+0000", 2024-05-08T18:08:11.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.627e-06 2024-05-08T18:08:11.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801311+0000", 2024-05-08T18:08:11.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-05-08T18:08:11.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801320+0000", 2024-05-08T18:08:11.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5710000000000004e-06 2024-05-08T18:08:11.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801401+0000", 2024-05-08T18:08:11.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0798999999999997e-05 2024-05-08T18:08:11.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801439+0000", 2024-05-08T18:08:11.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7994000000000002e-05 2024-05-08T18:08:11.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806447+0000", 2024-05-08T18:08:11.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050077339999999998 2024-05-08T18:08:11.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806533+0000", 2024-05-08T18:08:11.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.577e-05 2024-05-08T18:08:11.298 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.299 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.299 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.299 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:495 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:11.299 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:11.299 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.427756232, 2024-05-08T18:08:11.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045481219999999999, 2024-05-08T18:08:11.299 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.299 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.299 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.299 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:11.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:11.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804823+0000", 2024-05-08T18:08:11.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.42e-06 2024-05-08T18:08:11.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804834+0000", 2024-05-08T18:08:11.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0584999999999999e-05 2024-05-08T18:08:11.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804848+0000", 2024-05-08T18:08:11.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:08:11.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804857+0000", 2024-05-08T18:08:11.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.302e-06 2024-05-08T18:08:11.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804967+0000", 2024-05-08T18:08:11.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109543 2024-05-08T18:08:11.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805018+0000", 2024-05-08T18:08:11.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0924000000000002e-05 2024-05-08T18:08:11.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809281+0000", 2024-05-08T18:08:11.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042631479999999996 2024-05-08T18:08:11.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809370+0000", 2024-05-08T18:08:11.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8787000000000002e-05 2024-05-08T18:08:11.303 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.303 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.303 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.303 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:500 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:11.303 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:11.303 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.426197817999999, 2024-05-08T18:08:11.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061595829999999997, 2024-05-08T18:08:11.303 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.303 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.303 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.303 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.304 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.304 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.304 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 500 2024-05-08T18:08:11.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.304 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:11.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:11.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806382+0000", 2024-05-08T18:08:11.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2709999999999999e-06 2024-05-08T18:08:11.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806395+0000", 2024-05-08T18:08:11.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2782000000000001e-05 2024-05-08T18:08:11.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806419+0000", 2024-05-08T18:08:11.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3841000000000001e-05 2024-05-08T18:08:11.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806437+0000", 2024-05-08T18:08:11.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8318999999999999e-05 2024-05-08T18:08:11.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806554+0000", 2024-05-08T18:08:11.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116507 2024-05-08T18:08:11.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806732+0000", 2024-05-08T18:08:11.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017828200000000001 2024-05-08T18:08:11.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:11.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806986+0000", 2024-05-08T18:08:11.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431100000000001 2024-05-08T18:08:11.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.808032+0000", 2024-05-08T18:08:11.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010455530000000001 2024-05-08T18:08:11.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812373+0000", 2024-05-08T18:08:11.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043410139999999998 2024-05-08T18:08:11.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812485+0000", 2024-05-08T18:08:11.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011234999999999999 2024-05-08T18:08:11.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812540+0000", 2024-05-08T18:08:11.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4353e-05 2024-05-08T18:08:11.308 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.308 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.308 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.309 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:502 6.10 e32/26 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:11.309 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:11.309 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.425024215000001, 2024-05-08T18:08:11.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049263659999999997, 2024-05-08T18:08:11.309 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.309 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.309 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.309 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:11.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:11.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807555+0000", 2024-05-08T18:08:11.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2079999999999999e-06 2024-05-08T18:08:11.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807563+0000", 2024-05-08T18:08:11.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3280000000000006e-06 2024-05-08T18:08:11.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807585+0000", 2024-05-08T18:08:11.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2361000000000002e-05 2024-05-08T18:08:11.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807596+0000", 2024-05-08T18:08:11.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0968000000000001e-05 2024-05-08T18:08:11.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807700+0000", 2024-05-08T18:08:11.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103232 2024-05-08T18:08:11.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807732+0000", 2024-05-08T18:08:11.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2373999999999999e-05 2024-05-08T18:08:11.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812391+0000", 2024-05-08T18:08:11.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046590140000000004 2024-05-08T18:08:11.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812480+0000", 2024-05-08T18:08:11.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8881000000000005e-05 2024-05-08T18:08:11.313 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.313 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.313 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.313 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:504 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'3, mlcod=32'1)", 2024-05-08T18:08:11.313 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:11.313 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.42135141, 2024-05-08T18:08:11.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389472, 2024-05-08T18:08:11.313 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.313 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.313 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.313 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:11.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:11.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811228+0000", 2024-05-08T18:08:11.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8819999999999999e-06 2024-05-08T18:08:11.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811240+0000", 2024-05-08T18:08:11.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1276e-05 2024-05-08T18:08:11.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811266+0000", 2024-05-08T18:08:11.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.601e-05 2024-05-08T18:08:11.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811283+0000", 2024-05-08T18:08:11.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7473e-05 2024-05-08T18:08:11.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811444+0000", 2024-05-08T18:08:11.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000161249 2024-05-08T18:08:11.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811501+0000", 2024-05-08T18:08:11.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6394999999999998e-05 2024-05-08T18:08:11.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815025+0000", 2024-05-08T18:08:11.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003524335 2024-05-08T18:08:11.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815121+0000", 2024-05-08T18:08:11.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6100000000000005e-05 2024-05-08T18:08:11.317 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.317 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.317 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.317 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:505 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:11.317 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:11.317 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.419722114999999, 2024-05-08T18:08:11.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007675075, 2024-05-08T18:08:11.317 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.317 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.318 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.318 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.318 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.318 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.318 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 505 2024-05-08T18:08:11.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.318 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:11.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:11.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812857+0000", 2024-05-08T18:08:11.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.621e-06 2024-05-08T18:08:11.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812865+0000", 2024-05-08T18:08:11.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0600000000000008e-06 2024-05-08T18:08:11.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812889+0000", 2024-05-08T18:08:11.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3569000000000001e-05 2024-05-08T18:08:11.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812901+0000", 2024-05-08T18:08:11.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1610000000000001e-05 2024-05-08T18:08:11.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813025+0000", 2024-05-08T18:08:11.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012430399999999999 2024-05-08T18:08:11.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813168+0000", 2024-05-08T18:08:11.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014329699999999999 2024-05-08T18:08:11.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:11.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813419+0000", 2024-05-08T18:08:11.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000250788 2024-05-08T18:08:11.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815462+0000", 2024-05-08T18:08:11.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002042865 2024-05-08T18:08:11.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820385+0000", 2024-05-08T18:08:11.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049229529999999999 2024-05-08T18:08:11.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820462+0000", 2024-05-08T18:08:11.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7101000000000006e-05 2024-05-08T18:08:11.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820531+0000", 2024-05-08T18:08:11.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8906999999999996e-05 2024-05-08T18:08:11.322 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.322 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.323 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.323 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:506 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:11.323 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:11.323 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.418499271999998, 2024-05-08T18:08:11.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006383143, 2024-05-08T18:08:11.323 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.323 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.323 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.323 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:11.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:11.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814081+0000", 2024-05-08T18:08:11.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0080000000000001e-06 2024-05-08T18:08:11.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814094+0000", 2024-05-08T18:08:11.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3407999999999999e-05 2024-05-08T18:08:11.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814125+0000", 2024-05-08T18:08:11.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0688999999999997e-05 2024-05-08T18:08:11.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814142+0000", 2024-05-08T18:08:11.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7192000000000001e-05 2024-05-08T18:08:11.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814245+0000", 2024-05-08T18:08:11.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103164 2024-05-08T18:08:11.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814302+0000", 2024-05-08T18:08:11.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6613999999999997e-05 2024-05-08T18:08:11.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820398+0000", 2024-05-08T18:08:11.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060967620000000004 2024-05-08T18:08:11.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820462+0000", 2024-05-08T18:08:11.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3305999999999993e-05 2024-05-08T18:08:11.327 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.327 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.327 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.327 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:750 6.19 6:9fecf831:::obj_delete_at_hint.0000000057:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:11.327 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:11.327 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.143260900999998, 2024-05-08T18:08:11.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035713440000000002, 2024-05-08T18:08:11.327 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.327 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.327 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.327 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.328 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.328 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.328 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 750 2024-05-08T18:08:11.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.328 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:11.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:11.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089318+0000", 2024-05-08T18:08:11.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.446e-06 2024-05-08T18:08:11.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089325+0000", 2024-05-08T18:08:11.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8560000000000001e-06 2024-05-08T18:08:11.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089345+0000", 2024-05-08T18:08:11.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9641999999999999e-05 2024-05-08T18:08:11.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089355+0000", 2024-05-08T18:08:11.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0586e-05 2024-05-08T18:08:11.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089469+0000", 2024-05-08T18:08:11.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113324 2024-05-08T18:08:11.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089692+0000", 2024-05-08T18:08:11.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022334500000000001 2024-05-08T18:08:11.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:11.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.090160+0000", 2024-05-08T18:08:11.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00046827799999999998 2024-05-08T18:08:11.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.091322+0000", 2024-05-08T18:08:11.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001161282 2024-05-08T18:08:11.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092750+0000", 2024-05-08T18:08:11.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014281299999999999 2024-05-08T18:08:11.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092829+0000", 2024-05-08T18:08:11.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9376999999999996e-05 2024-05-08T18:08:11.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092888+0000", 2024-05-08T18:08:11.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9077999999999999e-05 2024-05-08T18:08:11.332 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.332 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.332 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.332 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.332 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.332 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:11.334 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:08:11.334 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:11.333+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:11.434 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:11.430+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:11.447 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-05-08T18:08:11.507 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:11.508 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:11.508 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:11.508 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:11.523 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:08:11.535 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:11.537+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:11.637 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:11.637+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:11.685 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:11.685 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:11.685 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:11.685 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:11.686 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:11.699 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:08:11.744 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:11.742+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:11.819 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:11.819 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:11.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:11.819 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:11.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.819 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:11.819 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:08:11.820 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.283134273000002, 2024-05-08T18:08:11.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.032012946, 2024-05-08T18:08:11.820 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.820 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.820 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.820 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.820 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.820 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.820 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:08:11.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.820 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:08:11.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:08:11.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535484+0000", 2024-05-08T18:08:11.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7929999999999999e-06 2024-05-08T18:08:11.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535500+0000", 2024-05-08T18:08:11.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5226e-05 2024-05-08T18:08:11.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535535+0000", 2024-05-08T18:08:11.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5213000000000003e-05 2024-05-08T18:08:11.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535564+0000", 2024-05-08T18:08:11.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9360999999999999e-05 2024-05-08T18:08:11.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535757+0000", 2024-05-08T18:08:11.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000193229 2024-05-08T18:08:11.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:08:11.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535775+0000", 2024-05-08T18:08:11.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7098000000000001e-05 2024-05-08T18:08:11.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556004+0000", 2024-05-08T18:08:11.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020229068999999999 2024-05-08T18:08:11.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:11.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556036+0000", 2024-05-08T18:08:11.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1943000000000002e-05 2024-05-08T18:08:11.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.564721+0000", 2024-05-08T18:08:11.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086853320000000005 2024-05-08T18:08:11.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565032+0000", 2024-05-08T18:08:11.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031121799999999999 2024-05-08T18:08:11.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:11.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565365+0000", 2024-05-08T18:08:11.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000332744 2024-05-08T18:08:11.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567305+0000", 2024-05-08T18:08:11.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00194016 2024-05-08T18:08:11.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567368+0000", 2024-05-08T18:08:11.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3342000000000004e-05 2024-05-08T18:08:11.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567433+0000", 2024-05-08T18:08:11.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4726000000000003e-05 2024-05-08T18:08:11.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567494+0000", 2024-05-08T18:08:11.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0492000000000003e-05 2024-05-08T18:08:11.827 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.827 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.828 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.828 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206896342016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:11.828 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:08:11.828 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.250717180999999, 2024-05-08T18:08:11.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026490820000000001, 2024-05-08T18:08:11.829 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.829 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.829 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.829 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.829 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.829 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.829 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 47 2024-05-08T18:08:11.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.830 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:08:11.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:08:11.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567900+0000", 2024-05-08T18:08:11.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.03e-06 2024-05-08T18:08:11.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567909+0000", 2024-05-08T18:08:11.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0389999999999993e-06 2024-05-08T18:08:11.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567947+0000", 2024-05-08T18:08:11.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8013999999999999e-05 2024-05-08T18:08:11.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567961+0000", 2024-05-08T18:08:11.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3777999999999999e-05 2024-05-08T18:08:11.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568066+0000", 2024-05-08T18:08:11.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105208 2024-05-08T18:08:11.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568176+0000", 2024-05-08T18:08:11.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011041599999999999 2024-05-08T18:08:11.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:11.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568443+0000", 2024-05-08T18:08:11.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000266846 2024-05-08T18:08:11.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.569612+0000", 2024-05-08T18:08:11.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001169156 2024-05-08T18:08:11.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570378+0000", 2024-05-08T18:08:11.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00076617799999999995 2024-05-08T18:08:11.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570457+0000", 2024-05-08T18:08:11.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8750000000000003e-05 2024-05-08T18:08:11.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570547+0000", 2024-05-08T18:08:11.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9666999999999994e-05 2024-05-08T18:08:11.838 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.838 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.838 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.839 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:11.839 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:08:11.839 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.239669909, 2024-05-08T18:08:11.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051182119999999996, 2024-05-08T18:08:11.839 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.839 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.840 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.840 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.840 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.840 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.840 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 54 2024-05-08T18:08:11.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.840 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:08:11.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:08:11.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578947+0000", 2024-05-08T18:08:11.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:11.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578957+0000", 2024-05-08T18:08:11.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6020000000000006e-06 2024-05-08T18:08:11.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578997+0000", 2024-05-08T18:08:11.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0663e-05 2024-05-08T18:08:11.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579016+0000", 2024-05-08T18:08:11.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8185e-05 2024-05-08T18:08:11.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579117+0000", 2024-05-08T18:08:11.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010117599999999999 2024-05-08T18:08:11.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579252+0000", 2024-05-08T18:08:11.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013552 2024-05-08T18:08:11.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:11.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579393+0000", 2024-05-08T18:08:11.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140605 2024-05-08T18:08:11.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.580414+0000", 2024-05-08T18:08:11.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010214219999999999 2024-05-08T18:08:11.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.583866+0000", 2024-05-08T18:08:11.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034512840000000002 2024-05-08T18:08:11.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.583946+0000", 2024-05-08T18:08:11.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0406000000000002e-05 2024-05-08T18:08:11.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584063+0000", 2024-05-08T18:08:11.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117199 2024-05-08T18:08:11.846 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.846 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.846 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.846 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206896337408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:11.846 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:08:11.846 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.234383182000002, 2024-05-08T18:08:11.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027716910000000002, 2024-05-08T18:08:11.846 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.847 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.847 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.847 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:11.847 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:11.847 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:11.847 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 55 2024-05-08T18:08:11.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.847 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:08:11.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:08:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584234+0000", 2024-05-08T18:08:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9259999999999999e-06 2024-05-08T18:08:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584244+0000", 2024-05-08T18:08:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0369e-05 2024-05-08T18:08:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584270+0000", 2024-05-08T18:08:11.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5554999999999998e-05 2024-05-08T18:08:11.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584283+0000", 2024-05-08T18:08:11.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3039e-05 2024-05-08T18:08:11.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584384+0000", 2024-05-08T18:08:11.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000100881 2024-05-08T18:08:11.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584510+0000", 2024-05-08T18:08:11.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012627100000000001 2024-05-08T18:08:11.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:11.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584741+0000", 2024-05-08T18:08:11.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023162899999999999 2024-05-08T18:08:11.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:11.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.585714+0000", 2024-05-08T18:08:11.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00097270500000000003 2024-05-08T18:08:11.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:11.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.586818+0000", 2024-05-08T18:08:11.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00110403 2024-05-08T18:08:11.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.586908+0000", 2024-05-08T18:08:11.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9641000000000005e-05 2024-05-08T18:08:11.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.587003+0000", 2024-05-08T18:08:11.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5644999999999997e-05 2024-05-08T18:08:11.851 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.851 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.852 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.852 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:191 6.5 e29/26 6:a2ace8b3:::data_log.0:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:11.852 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:08:11.852 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.134555613000003, 2024-05-08T18:08:11.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001855095, 2024-05-08T18:08:11.852 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.852 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.852 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.852 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:08:11.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:08:11.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684061+0000", 2024-05-08T18:08:11.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:08:11.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684074+0000", 2024-05-08T18:08:11.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2479e-05 2024-05-08T18:08:11.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684104+0000", 2024-05-08T18:08:11.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0689999999999999e-05 2024-05-08T18:08:11.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684120+0000", 2024-05-08T18:08:11.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5996000000000001e-05 2024-05-08T18:08:11.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684221+0000", 2024-05-08T18:08:11.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000100647 2024-05-08T18:08:11.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684273+0000", 2024-05-08T18:08:11.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2074999999999999e-05 2024-05-08T18:08:11.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.685828+0000", 2024-05-08T18:08:11.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015553030000000001 2024-05-08T18:08:11.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.685914+0000", 2024-05-08T18:08:11.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5927999999999995e-05 2024-05-08T18:08:11.856 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.856 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.856 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.856 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:11.856 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:11.856 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.219517349999997, 2024-05-08T18:08:11.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003347367, 2024-05-08T18:08:11.856 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.856 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.856 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.856 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:11.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:11.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:11.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5300000000000003e-07 2024-05-08T18:08:11.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599110+0000", 2024-05-08T18:08:11.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1826e-05 2024-05-08T18:08:11.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599159+0000", 2024-05-08T18:08:11.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8322000000000003e-05 2024-05-08T18:08:11.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599180+0000", 2024-05-08T18:08:11.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1682e-05 2024-05-08T18:08:11.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599427+0000", 2024-05-08T18:08:11.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024721299999999998 2024-05-08T18:08:11.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599475+0000", 2024-05-08T18:08:11.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7299000000000002e-05 2024-05-08T18:08:11.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.602326+0000", 2024-05-08T18:08:11.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028516409999999998 2024-05-08T18:08:11.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.602445+0000", 2024-05-08T18:08:11.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011853099999999999 2024-05-08T18:08:11.860 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.860 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.860 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.860 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:231 6.1f e32/26 6:fde4dd55:gc::gc.26:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:11.860 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:11.860 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.131864252, 2024-05-08T18:08:11.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017909390000000001, 2024-05-08T18:08:11.861 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.861 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.861 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.861 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:11.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:11.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:11.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5000000000000002e-07 2024-05-08T18:08:11.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686785+0000", 2024-05-08T18:08:11.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3438000000000001e-05 2024-05-08T18:08:11.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686810+0000", 2024-05-08T18:08:11.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4858000000000002e-05 2024-05-08T18:08:11.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686823+0000", 2024-05-08T18:08:11.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3417999999999999e-05 2024-05-08T18:08:11.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686989+0000", 2024-05-08T18:08:11.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016624700000000001 2024-05-08T18:08:11.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.687023+0000", 2024-05-08T18:08:11.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3396999999999999e-05 2024-05-08T18:08:11.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.688453+0000", 2024-05-08T18:08:11.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001430675 2024-05-08T18:08:11.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.688542+0000", 2024-05-08T18:08:11.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8256000000000003e-05 2024-05-08T18:08:11.864 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.864 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.864 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.865 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:292 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:11.865 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:08:11.865 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.098477533000001, 2024-05-08T18:08:11.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020064839999999998, 2024-05-08T18:08:11.865 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.865 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.865 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.865 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:08:11.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:08:11.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720170+0000", 2024-05-08T18:08:11.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3090999999999999e-05 2024-05-08T18:08:11.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720189+0000", 2024-05-08T18:08:11.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8077999999999999e-05 2024-05-08T18:08:11.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720222+0000", 2024-05-08T18:08:11.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3111000000000002e-05 2024-05-08T18:08:11.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720241+0000", 2024-05-08T18:08:11.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9528e-05 2024-05-08T18:08:11.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720452+0000", 2024-05-08T18:08:11.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021077300000000001 2024-05-08T18:08:11.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720505+0000", 2024-05-08T18:08:11.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2605000000000002e-05 2024-05-08T18:08:11.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.722038+0000", 2024-05-08T18:08:11.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015334630000000001 2024-05-08T18:08:11.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.722144+0000", 2024-05-08T18:08:11.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010583500000000001 2024-05-08T18:08:11.869 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.869 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.869 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.869 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:328 6.1 e32/26 6:856b9b26:reshard::reshard.0000000002:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:11.869 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:11.869 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.093049241999999, 2024-05-08T18:08:11.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0018910070000000001, 2024-05-08T18:08:11.869 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.870 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.870 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.870 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:11.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:11.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:11.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3e-07 2024-05-08T18:08:11.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725576+0000", 2024-05-08T18:08:11.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5759999999999995e-06 2024-05-08T18:08:11.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725622+0000", 2024-05-08T18:08:11.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6196000000000003e-05 2024-05-08T18:08:11.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725642+0000", 2024-05-08T18:08:11.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9947999999999999e-05 2024-05-08T18:08:11.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.726011+0000", 2024-05-08T18:08:11.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036876699999999999 2024-05-08T18:08:11.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.726062+0000", 2024-05-08T18:08:11.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1062e-05 2024-05-08T18:08:11.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.727367+0000", 2024-05-08T18:08:11.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001304869 2024-05-08T18:08:11.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.727457+0000", 2024-05-08T18:08:11.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9858999999999995e-05 2024-05-08T18:08:11.873 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.874 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.874 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.874 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:382 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'6, mlcod=32'4)", 2024-05-08T18:08:11.874 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:08:11.874 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.080084638000002, 2024-05-08T18:08:11.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023570779999999999, 2024-05-08T18:08:11.874 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.874 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.874 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.874 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:08:11.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:08:11.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738532+0000", 2024-05-08T18:08:11.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.95e-06 2024-05-08T18:08:11.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738548+0000", 2024-05-08T18:08:11.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5911000000000001e-05 2024-05-08T18:08:11.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738583+0000", 2024-05-08T18:08:11.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4830999999999999e-05 2024-05-08T18:08:11.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738605+0000", 2024-05-08T18:08:11.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2005e-05 2024-05-08T18:08:11.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738747+0000", 2024-05-08T18:08:11.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014162800000000001 2024-05-08T18:08:11.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738800+0000", 2024-05-08T18:08:11.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2918999999999999e-05 2024-05-08T18:08:11.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.740802+0000", 2024-05-08T18:08:11.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020026150000000001 2024-05-08T18:08:11.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.740887+0000", 2024-05-08T18:08:11.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5218999999999998e-05 2024-05-08T18:08:11.878 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.878 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.878 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.878 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:394 6.c e32/26 6:3677c228:::obj_delete_at_hint.0000000006:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:11.878 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:08:11.879 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.075419427, 2024-05-08T18:08:11.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026335320000000001, 2024-05-08T18:08:11.879 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.879 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.879 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.879 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:08:11.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:08:11.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743197+0000", 2024-05-08T18:08:11.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.81e-06 2024-05-08T18:08:11.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743210+0000", 2024-05-08T18:08:11.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2354999999999999e-05 2024-05-08T18:08:11.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743237+0000", 2024-05-08T18:08:11.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7328e-05 2024-05-08T18:08:11.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743256+0000", 2024-05-08T18:08:11.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8712e-05 2024-05-08T18:08:11.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743394+0000", 2024-05-08T18:08:11.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138009 2024-05-08T18:08:11.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743449+0000", 2024-05-08T18:08:11.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5371000000000002e-05 2024-05-08T18:08:11.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745754+0000", 2024-05-08T18:08:11.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002304567 2024-05-08T18:08:11.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745829+0000", 2024-05-08T18:08:11.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.538e-05 2024-05-08T18:08:11.882 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.882 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.883 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.883 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:392 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'7, mlcod=32'5)", 2024-05-08T18:08:11.883 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:08:11.883 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.074966908, 2024-05-08T18:08:11.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022345389999999998, 2024-05-08T18:08:11.883 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.883 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.883 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.883 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:08:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:08:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743650+0000", 2024-05-08T18:08:11.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1260000000000001e-06 2024-05-08T18:08:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743666+0000", 2024-05-08T18:08:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5696e-05 2024-05-08T18:08:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743696+0000", 2024-05-08T18:08:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0037999999999999e-05 2024-05-08T18:08:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743716+0000", 2024-05-08T18:08:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0251e-05 2024-05-08T18:08:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743838+0000", 2024-05-08T18:08:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012187 2024-05-08T18:08:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743886+0000", 2024-05-08T18:08:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8053000000000002e-05 2024-05-08T18:08:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745805+0000", 2024-05-08T18:08:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019189509999999999 2024-05-08T18:08:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745883+0000", 2024-05-08T18:08:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7553999999999996e-05 2024-05-08T18:08:11.887 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.888 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.888 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.888 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:453 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:11.888 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:08:11.888 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.040801727999998, 2024-05-08T18:08:11.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017625729999999999, 2024-05-08T18:08:11.888 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.888 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.888 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.888 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:08:11.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:08:11.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777815+0000", 2024-05-08T18:08:11.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6130000000000001e-06 2024-05-08T18:08:11.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777826+0000", 2024-05-08T18:08:11.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:08:11.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777852+0000", 2024-05-08T18:08:11.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6787999999999998e-05 2024-05-08T18:08:11.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777865+0000", 2024-05-08T18:08:11.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2882e-05 2024-05-08T18:08:11.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777961+0000", 2024-05-08T18:08:11.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5280999999999998e-05 2024-05-08T18:08:11.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777993+0000", 2024-05-08T18:08:11.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1931999999999999e-05 2024-05-08T18:08:11.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779496+0000", 2024-05-08T18:08:11.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001503307 2024-05-08T18:08:11.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779576+0000", 2024-05-08T18:08:11.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9887000000000003e-05 2024-05-08T18:08:11.892 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.892 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.892 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.892 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:460 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'3, mlcod=32'1)", 2024-05-08T18:08:11.892 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:08:11.892 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.039466357999999, 2024-05-08T18:08:11.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032252579999999999, 2024-05-08T18:08:11.892 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.893 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.893 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.893 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:08:11.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:08:11.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779150+0000", 2024-05-08T18:08:11.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:11.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779161+0000", 2024-05-08T18:08:11.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0906e-05 2024-05-08T18:08:11.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779186+0000", 2024-05-08T18:08:11.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4861000000000001e-05 2024-05-08T18:08:11.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779198+0000", 2024-05-08T18:08:11.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1969e-05 2024-05-08T18:08:11.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779334+0000", 2024-05-08T18:08:11.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000135513 2024-05-08T18:08:11.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779396+0000", 2024-05-08T18:08:11.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2815000000000001e-05 2024-05-08T18:08:11.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.782247+0000", 2024-05-08T18:08:11.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028502200000000001 2024-05-08T18:08:11.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.782374+0000", 2024-05-08T18:08:11.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012726400000000001 2024-05-08T18:08:11.896 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.896 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.897 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.897 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:463 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-05-08T18:08:11.897 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:08:11.897 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.037120252999998, 2024-05-08T18:08:11.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0036423610000000002, 2024-05-08T18:08:11.897 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.897 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.897 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.897 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:08:11.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:08:11.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781497+0000", 2024-05-08T18:08:11.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.917e-06 2024-05-08T18:08:11.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781509+0000", 2024-05-08T18:08:11.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2227e-05 2024-05-08T18:08:11.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781539+0000", 2024-05-08T18:08:11.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0218000000000001e-05 2024-05-08T18:08:11.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781558+0000", 2024-05-08T18:08:11.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8918000000000001e-05 2024-05-08T18:08:11.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781660+0000", 2024-05-08T18:08:11.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101584 2024-05-08T18:08:11.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781697+0000", 2024-05-08T18:08:11.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7360000000000001e-05 2024-05-08T18:08:11.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785059+0000", 2024-05-08T18:08:11.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033618810000000002 2024-05-08T18:08:11.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785137+0000", 2024-05-08T18:08:11.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8256000000000004e-05 2024-05-08T18:08:11.901 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.901 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.901 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.901 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:466 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:11.902 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:08:11.902 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.035000001, 2024-05-08T18:08:11.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002137496, 2024-05-08T18:08:11.902 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.902 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.902 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.902 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:08:11.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:08:11.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783617+0000", 2024-05-08T18:08:11.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8330000000000001e-06 2024-05-08T18:08:11.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:08:11.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5872e-05 2024-05-08T18:08:11.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783668+0000", 2024-05-08T18:08:11.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5880999999999997e-05 2024-05-08T18:08:11.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783688+0000", 2024-05-08T18:08:11.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9485000000000001e-05 2024-05-08T18:08:11.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783819+0000", 2024-05-08T18:08:11.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013098600000000001 2024-05-08T18:08:11.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783865+0000", 2024-05-08T18:08:11.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5711000000000003e-05 2024-05-08T18:08:11.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785680+0000", 2024-05-08T18:08:11.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001815374 2024-05-08T18:08:11.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785752+0000", 2024-05-08T18:08:11.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2354000000000006e-05 2024-05-08T18:08:11.906 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.906 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.906 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.906 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:469 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'10, mlcod=32'8)", 2024-05-08T18:08:11.906 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:08:11.906 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.031709012, 2024-05-08T18:08:11.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002120242, 2024-05-08T18:08:11.907 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.907 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.907 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.907 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:08:11.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:08:11.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786907+0000", 2024-05-08T18:08:11.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.412e-06 2024-05-08T18:08:11.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786917+0000", 2024-05-08T18:08:11.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3489999999999998e-06 2024-05-08T18:08:11.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786940+0000", 2024-05-08T18:08:11.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3019000000000001e-05 2024-05-08T18:08:11.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786951+0000", 2024-05-08T18:08:11.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0956e-05 2024-05-08T18:08:11.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.787229+0000", 2024-05-08T18:08:11.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027875000000000003 2024-05-08T18:08:11.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.787263+0000", 2024-05-08T18:08:11.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3563999999999999e-05 2024-05-08T18:08:11.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.788886+0000", 2024-05-08T18:08:11.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016228320000000001 2024-05-08T18:08:11.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.789026+0000", 2024-05-08T18:08:11.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014035999999999999 2024-05-08T18:08:11.911 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.911 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.911 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.911 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:478 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'11, mlcod=32'9)", 2024-05-08T18:08:11.911 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:08:11.911 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.027597399000001, 2024-05-08T18:08:11.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037403340000000001, 2024-05-08T18:08:11.911 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.911 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.911 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.911 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:08:11.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:08:11.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791019+0000", 2024-05-08T18:08:11.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5999999999999999e-06 2024-05-08T18:08:11.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791032+0000", 2024-05-08T18:08:11.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3021e-05 2024-05-08T18:08:11.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791057+0000", 2024-05-08T18:08:11.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4600000000000002e-05 2024-05-08T18:08:11.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791071+0000", 2024-05-08T18:08:11.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4756000000000001e-05 2024-05-08T18:08:11.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791185+0000", 2024-05-08T18:08:11.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011333200000000001 2024-05-08T18:08:11.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791234+0000", 2024-05-08T18:08:11.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8695e-05 2024-05-08T18:08:11.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794662+0000", 2024-05-08T18:08:11.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034282520000000001 2024-05-08T18:08:11.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794758+0000", 2024-05-08T18:08:11.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6077999999999997e-05 2024-05-08T18:08:11.915 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.915 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.915 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.915 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:829 6.5 e32/26 6:a77c5545:::obj_delete_at_hint.0000000084:head v 32'12, mlcod=32'10)", 2024-05-08T18:08:11.915 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:08:11.915 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.546428384999999, 2024-05-08T18:08:11.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017254, 2024-05-08T18:08:11.916 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.916 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.916 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.916 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:08:11.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:08:11.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272188+0000", 2024-05-08T18:08:11.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7269999999999999e-06 2024-05-08T18:08:11.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272229+0000", 2024-05-08T18:08:11.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0256999999999998e-05 2024-05-08T18:08:11.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272261+0000", 2024-05-08T18:08:11.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2017000000000002e-05 2024-05-08T18:08:11.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272275+0000", 2024-05-08T18:08:11.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4532000000000001e-05 2024-05-08T18:08:11.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272437+0000", 2024-05-08T18:08:11.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016199699999999999 2024-05-08T18:08:11.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272501+0000", 2024-05-08T18:08:11.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3805000000000003e-05 2024-05-08T18:08:11.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.273824+0000", 2024-05-08T18:08:11.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001323039 2024-05-08T18:08:11.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.273912+0000", 2024-05-08T18:08:11.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8026000000000001e-05 2024-05-08T18:08:11.919 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.919 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.919 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.920 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:937 6.1f e32/26 6:fd6b5df8:::obj_delete_at_hint.0000000120:head v 32'10, mlcod=32'8)", 2024-05-08T18:08:11.920 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:08:11.920 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.295192270000001, 2024-05-08T18:08:11.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019919009999999999, 2024-05-08T18:08:11.920 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:11.920 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:11.920 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:11.920 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:11.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:11.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:08:11.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:11.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:08:11.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:11.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:11.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523425+0000", 2024-05-08T18:08:11.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8560000000000001e-06 2024-05-08T18:08:11.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:11.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523437+0000", 2024-05-08T18:08:11.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2833000000000001e-05 2024-05-08T18:08:11.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:11.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523464+0000", 2024-05-08T18:08:11.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6621000000000001e-05 2024-05-08T18:08:11.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:11.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523477+0000", 2024-05-08T18:08:11.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2758999999999999e-05 2024-05-08T18:08:11.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:11.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523612+0000", 2024-05-08T18:08:11.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013525899999999999 2024-05-08T18:08:11.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:11.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523679+0000", 2024-05-08T18:08:11.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6964000000000005e-05 2024-05-08T18:08:11.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:11.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.525312+0000", 2024-05-08T18:08:11.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016331 2024-05-08T18:08:11.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:11.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:11.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:11.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.525415+0000", 2024-05-08T18:08:11.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000102509 2024-05-08T18:08:11.924 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.924 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.924 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.924 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:11.924 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:11.924 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:11.924 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:08:11.926 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:08:11.926 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:11.922+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:12.026 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:12.025+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:12.078 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:12.078 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:12.094 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:12.094 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:12.096 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:12.096 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:12.096 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:12.096 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:12.109 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:12.110 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:12.110 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:08:12.125 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:12.126 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:12.144 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:12.144 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:12.155 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:12.154+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:12.161 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:12.162 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:12.179 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:12.179 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:12.196 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:12.196 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:12.229 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:12.229 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:12.243 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:08:12.259 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:12.261+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:12.328 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:12.329+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:12.413 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:12.413 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:12.427 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:08:12.428 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:12.426+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:12.529 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:12.529+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:12.553 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:12.553 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:12.567 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:08:12.629 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:12.630+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:12.730 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:12.733+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:12.733 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:12.733 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:12.747 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:08:12.832 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:12.830+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:12.912 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:12.913 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:12.927 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:08:12.970 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:12.973+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:13.033 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:13.034+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:13.046 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:13.046 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:13.061 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:08:13.150 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:13.153+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:13.223 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:13.223 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:13.235 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:13.237+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:13.238 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:08:13.336 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:13.337+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:13.403 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:13.403 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:13.417 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:08:13.436 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:13.434+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:13.471 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:08:13.546 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:13.549+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:13.589 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:13.589 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:13.604 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:08:13.647 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:13.649+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:13.739 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:13.741+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:13.762 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:13.762 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:13.776 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:08:13.840 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:13.838+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:13.936 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:13.937 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:13.940 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:13.938+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:13.950 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:08:14.041 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:14.038+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:14.071 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:14.071 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:14.087 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:08:14.142 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:14.145+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:14.207 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:14.207 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:14.213 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:08:14.221 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:08:14.263 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:14.265+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:14.343 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:14.345+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:14.357 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:14.357 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:14.373 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:14.374 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:14.384 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:14.384 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:14.390 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:14.390 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:14.399 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:08:14.407 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:14.407 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:14.426 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:14.426 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:14.444 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:14.444 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:14.448 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:14.446+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:14.464 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:14.465 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:14.483 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:14.483 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:14.531 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:14.531 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:14.532 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:14.532 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:14.545 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:08:14.546 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:14.545+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:14.646 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:14.649+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:14.709 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:14.709 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:14.709 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:14.709 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:14.709 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:14.723 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:08:14.751 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-05-08T18:08:14.754 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:14.753+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:14.848 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:14.846+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:14.854 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:14.854 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:36 5.e 5:71234df9:::zone_info.d0a95a6c-3c84-4d52-915c-e8ea581dfb9b:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:08:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 55.279582441000002, 2024-05-08T18:08:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028394430000000001, 2024-05-08T18:08:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:08:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:08:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 36 2024-05-08T18:08:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573456+0000", 2024-05-08T18:08:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573467+0000", 2024-05-08T18:08:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1243999999999999e-05 2024-05-08T18:08:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573499+0000", 2024-05-08T18:08:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1343000000000001e-05 2024-05-08T18:08:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573522+0000", 2024-05-08T18:08:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3540000000000002e-05 2024-05-08T18:08:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573634+0000", 2024-05-08T18:08:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112249 2024-05-08T18:08:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573841+0000", 2024-05-08T18:08:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000206407 2024-05-08T18:08:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.574122+0000", 2024-05-08T18:08:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000281475 2024-05-08T18:08:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.575489+0000", 2024-05-08T18:08:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001366391 2024-05-08T18:08:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576157+0000", 2024-05-08T18:08:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00066776200000000002 2024-05-08T18:08:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576234+0000", 2024-05-08T18:08:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7285000000000003e-05 2024-05-08T18:08:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576293+0000", 2024-05-08T18:08:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9556999999999999e-05 2024-05-08T18:08:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.322823247999999, 2024-05-08T18:08:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018560765, 2024-05-08T18:08:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:08:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 43 2024-05-08T18:08:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530217+0000", 2024-05-08T18:08:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:08:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530253+0000", 2024-05-08T18:08:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5621999999999999e-05 2024-05-08T18:08:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530288+0000", 2024-05-08T18:08:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5846999999999997e-05 2024-05-08T18:08:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530314+0000", 2024-05-08T18:08:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5732e-05 2024-05-08T18:08:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530952+0000", 2024-05-08T18:08:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00063739999999999999 2024-05-08T18:08:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530977+0000", 2024-05-08T18:08:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5375e-05 2024-05-08T18:08:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548506+0000", 2024-05-08T18:08:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017528781 2024-05-08T18:08:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548774+0000", 2024-05-08T18:08:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026821199999999999 2024-05-08T18:08:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.240509324000001, 2024-05-08T18:08:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003496893, 2024-05-08T18:08:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 211 2024-05-08T18:08:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612530+0000", 2024-05-08T18:08:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9490000000000001e-06 2024-05-08T18:08:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612544+0000", 2024-05-08T18:08:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3779e-05 2024-05-08T18:08:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612578+0000", 2024-05-08T18:08:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4421000000000001e-05 2024-05-08T18:08:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612596+0000", 2024-05-08T18:08:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7435000000000002e-05 2024-05-08T18:08:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612718+0000", 2024-05-08T18:08:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012218600000000001 2024-05-08T18:08:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612951+0000", 2024-05-08T18:08:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000232768 2024-05-08T18:08:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.613370+0000", 2024-05-08T18:08:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041921200000000002 2024-05-08T18:08:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.614840+0000", 2024-05-08T18:08:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014703679999999999 2024-05-08T18:08:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615860+0000", 2024-05-08T18:08:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010198220000000001 2024-05-08T18:08:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615954+0000", 2024-05-08T18:08:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4419000000000005e-05 2024-05-08T18:08:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.616024+0000", 2024-05-08T18:08:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9534000000000002e-05 2024-05-08T18:08:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.163819642, 2024-05-08T18:08:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035800939999999998, 2024-05-08T18:08:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 232 2024-05-08T18:08:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689219+0000", 2024-05-08T18:08:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4490000000000002e-06 2024-05-08T18:08:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689232+0000", 2024-05-08T18:08:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3183000000000001e-05 2024-05-08T18:08:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689263+0000", 2024-05-08T18:08:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400999999999999e-05 2024-05-08T18:08:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689279+0000", 2024-05-08T18:08:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6078000000000001e-05 2024-05-08T18:08:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689401+0000", 2024-05-08T18:08:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012243000000000001 2024-05-08T18:08:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689656+0000", 2024-05-08T18:08:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431899999999998 2024-05-08T18:08:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.690103+0000", 2024-05-08T18:08:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044706299999999999 2024-05-08T18:08:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.691780+0000", 2024-05-08T18:08:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016774209999999999 2024-05-08T18:08:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692634+0000", 2024-05-08T18:08:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085346 2024-05-08T18:08:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692728+0000", 2024-05-08T18:08:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4429e-05 2024-05-08T18:08:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692797+0000", 2024-05-08T18:08:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8861000000000004e-05 2024-05-08T18:08:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:267 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.139174664000002, 2024-05-08T18:08:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040291739999999999, 2024-05-08T18:08:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 267 2024-05-08T18:08:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713863+0000", 2024-05-08T18:08:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5200000000000001e-06 2024-05-08T18:08:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713873+0000", 2024-05-08T18:08:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9089999999999995e-06 2024-05-08T18:08:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713896+0000", 2024-05-08T18:08:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2595e-05 2024-05-08T18:08:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713914+0000", 2024-05-08T18:08:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7869000000000001e-05 2024-05-08T18:08:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714048+0000", 2024-05-08T18:08:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134802 2024-05-08T18:08:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714278+0000", 2024-05-08T18:08:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022994399999999999 2024-05-08T18:08:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714777+0000", 2024-05-08T18:08:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049880499999999995 2024-05-08T18:08:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.715976+0000", 2024-05-08T18:08:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011991110000000001 2024-05-08T18:08:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717646+0000", 2024-05-08T18:08:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016699989999999999 2024-05-08T18:08:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717790+0000", 2024-05-08T18:08:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014359799999999999 2024-05-08T18:08:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717891+0000", 2024-05-08T18:08:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101022 2024-05-08T18:08:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:308 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.131807424000002, 2024-05-08T18:08:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031672779999999999, 2024-05-08T18:08:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721230+0000", 2024-05-08T18:08:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:08:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721241+0000", 2024-05-08T18:08:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0942e-05 2024-05-08T18:08:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721265+0000", 2024-05-08T18:08:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3371e-05 2024-05-08T18:08:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721278+0000", 2024-05-08T18:08:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3586e-05 2024-05-08T18:08:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721399+0000", 2024-05-08T18:08:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012092 2024-05-08T18:08:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721507+0000", 2024-05-08T18:08:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107651 2024-05-08T18:08:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724292+0000", 2024-05-08T18:08:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027851870000000002 2024-05-08T18:08:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724396+0000", 2024-05-08T18:08:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000104114 2024-05-08T18:08:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:495 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.049189523000003, 2024-05-08T18:08:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005951001, 2024-05-08T18:08:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 495 2024-05-08T18:08:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803849+0000", 2024-05-08T18:08:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3580000000000001e-06 2024-05-08T18:08:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803864+0000", 2024-05-08T18:08:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4742999999999999e-05 2024-05-08T18:08:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803895+0000", 2024-05-08T18:08:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0970000000000003e-05 2024-05-08T18:08:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803908+0000", 2024-05-08T18:08:14.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2588999999999999e-05 2024-05-08T18:08:14.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804005+0000", 2024-05-08T18:08:14.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7107000000000004e-05 2024-05-08T18:08:14.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804291+0000", 2024-05-08T18:08:14.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028626900000000002 2024-05-08T18:08:14.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:14.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804648+0000", 2024-05-08T18:08:14.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000356955 2024-05-08T18:08:14.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805740+0000", 2024-05-08T18:08:14.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001091905 2024-05-08T18:08:14.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809636+0000", 2024-05-08T18:08:14.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389661 2024-05-08T18:08:14.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809722+0000", 2024-05-08T18:08:14.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:08:14.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809798+0000", 2024-05-08T18:08:14.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5462000000000004e-05 2024-05-08T18:08:14.892 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.892 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.892 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.892 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.893 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:14.893 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.042578204999998, 2024-05-08T18:08:14.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051396380000000002, 2024-05-08T18:08:14.893 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.893 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.893 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.893 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.893 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.893 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.893 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 504 2024-05-08T18:08:14.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.893 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:14.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:14.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810460+0000", 2024-05-08T18:08:14.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:08:14.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810470+0000", 2024-05-08T18:08:14.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0222e-05 2024-05-08T18:08:14.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810495+0000", 2024-05-08T18:08:14.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4508999999999999e-05 2024-05-08T18:08:14.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810515+0000", 2024-05-08T18:08:14.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9998999999999999e-05 2024-05-08T18:08:14.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810653+0000", 2024-05-08T18:08:14.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013851099999999999 2024-05-08T18:08:14.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810782+0000", 2024-05-08T18:08:14.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128152 2024-05-08T18:08:14.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:14.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811043+0000", 2024-05-08T18:08:14.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026172400000000002 2024-05-08T18:08:14.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812164+0000", 2024-05-08T18:08:14.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001121024 2024-05-08T18:08:14.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815415+0000", 2024-05-08T18:08:14.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032510270000000001 2024-05-08T18:08:14.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815538+0000", 2024-05-08T18:08:14.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012256999999999999 2024-05-08T18:08:14.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815598+0000", 2024-05-08T18:08:14.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9923000000000002e-05 2024-05-08T18:08:14.898 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.898 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.898 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.898 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:629 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.898 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:14.898 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.934273464999997, 2024-05-08T18:08:14.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611169999999998, 2024-05-08T18:08:14.898 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.898 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.898 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.899 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.899 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.899 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.899 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 629 2024-05-08T18:08:14.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.899 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:14.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:14.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918765+0000", 2024-05-08T18:08:14.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5670000000000002e-06 2024-05-08T18:08:14.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918777+0000", 2024-05-08T18:08:14.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1635e-05 2024-05-08T18:08:14.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918808+0000", 2024-05-08T18:08:14.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1024e-05 2024-05-08T18:08:14.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918823+0000", 2024-05-08T18:08:14.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4939e-05 2024-05-08T18:08:14.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918930+0000", 2024-05-08T18:08:14.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107144 2024-05-08T18:08:14.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919147+0000", 2024-05-08T18:08:14.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021682599999999999 2024-05-08T18:08:14.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:14.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919464+0000", 2024-05-08T18:08:14.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031716699999999998 2024-05-08T18:08:14.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.920561+0000", 2024-05-08T18:08:14.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010970229999999999 2024-05-08T18:08:14.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921468+0000", 2024-05-08T18:08:14.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00090726800000000003 2024-05-08T18:08:14.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921549+0000", 2024-05-08T18:08:14.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0430000000000001e-05 2024-05-08T18:08:14.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921624+0000", 2024-05-08T18:08:14.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5093999999999996e-05 2024-05-08T18:08:14.903 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.904 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.904 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.904 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:681 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.904 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:14.904 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.893952716999998, 2024-05-08T18:08:14.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044793259999999996, 2024-05-08T18:08:14.904 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.904 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.904 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.904 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.904 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.904 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.905 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 681 2024-05-08T18:08:14.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.905 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:14.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:14.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959085+0000", 2024-05-08T18:08:14.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.353e-06 2024-05-08T18:08:14.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959092+0000", 2024-05-08T18:08:14.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999999e-06 2024-05-08T18:08:14.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959113+0000", 2024-05-08T18:08:14.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0744e-05 2024-05-08T18:08:14.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959130+0000", 2024-05-08T18:08:14.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7679000000000001e-05 2024-05-08T18:08:14.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959217+0000", 2024-05-08T18:08:14.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6487000000000001e-05 2024-05-08T18:08:14.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959335+0000", 2024-05-08T18:08:14.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118476 2024-05-08T18:08:14.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:14.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959598+0000", 2024-05-08T18:08:14.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000263045 2024-05-08T18:08:14.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.960551+0000", 2024-05-08T18:08:14.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095251500000000002 2024-05-08T18:08:14.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963412+0000", 2024-05-08T18:08:14.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611800000000001 2024-05-08T18:08:14.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963498+0000", 2024-05-08T18:08:14.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6145999999999998e-05 2024-05-08T18:08:14.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963563+0000", 2024-05-08T18:08:14.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4701000000000003e-05 2024-05-08T18:08:14.909 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.909 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.909 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.910 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.910 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:14.910 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.859004280999997, 2024-05-08T18:08:14.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031621710000000001, 2024-05-08T18:08:14.910 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.910 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.910 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.910 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.910 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.910 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.910 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 709 2024-05-08T18:08:14.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.910 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:14.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:14.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994035+0000", 2024-05-08T18:08:14.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6460000000000002e-06 2024-05-08T18:08:14.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994047+0000", 2024-05-08T18:08:14.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999e-05 2024-05-08T18:08:14.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994076+0000", 2024-05-08T18:08:14.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9564e-05 2024-05-08T18:08:14.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994091+0000", 2024-05-08T18:08:14.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4696e-05 2024-05-08T18:08:14.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994239+0000", 2024-05-08T18:08:14.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014779699999999999 2024-05-08T18:08:14.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994585+0000", 2024-05-08T18:08:14.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034605900000000002 2024-05-08T18:08:14.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:14.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.995084+0000", 2024-05-08T18:08:14.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049904799999999998 2024-05-08T18:08:14.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.996558+0000", 2024-05-08T18:08:14.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001474532 2024-05-08T18:08:14.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997045+0000", 2024-05-08T18:08:14.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048685900000000002 2024-05-08T18:08:14.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997127+0000", 2024-05-08T18:08:14.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1280999999999996e-05 2024-05-08T18:08:14.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997194+0000", 2024-05-08T18:08:14.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7689999999999997e-05 2024-05-08T18:08:14.915 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.915 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.915 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.915 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.915 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:14.915 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.823614894999999, 2024-05-08T18:08:14.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003066236, 2024-05-08T18:08:14.916 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.916 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.916 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.916 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.916 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.916 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.916 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 724 2024-05-08T18:08:14.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.916 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:14.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:14.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029424+0000", 2024-05-08T18:08:14.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.503e-06 2024-05-08T18:08:14.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029437+0000", 2024-05-08T18:08:14.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3309000000000001e-05 2024-05-08T18:08:14.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029467+0000", 2024-05-08T18:08:14.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9677999999999999e-05 2024-05-08T18:08:14.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029489+0000", 2024-05-08T18:08:14.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2314999999999999e-05 2024-05-08T18:08:14.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029600+0000", 2024-05-08T18:08:14.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110561 2024-05-08T18:08:14.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029896+0000", 2024-05-08T18:08:14.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029632200000000001 2024-05-08T18:08:14.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:14.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.030468+0000", 2024-05-08T18:08:14.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00057224700000000001 2024-05-08T18:08:14.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.031728+0000", 2024-05-08T18:08:14.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012595429999999999 2024-05-08T18:08:14.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032338+0000", 2024-05-08T18:08:14.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00061006700000000005 2024-05-08T18:08:14.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032424+0000", 2024-05-08T18:08:14.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:14.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032488+0000", 2024-05-08T18:08:14.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4210999999999999e-05 2024-05-08T18:08:14.921 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.921 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.921 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.921 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.921 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:14.921 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.818964481000002, 2024-05-08T18:08:14.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029269769999999999, 2024-05-08T18:08:14.921 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.921 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.921 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.921 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.921 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.922 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.922 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 726 2024-05-08T18:08:14.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.922 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:14.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:14.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034074+0000", 2024-05-08T18:08:14.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5900000000000002e-06 2024-05-08T18:08:14.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034086+0000", 2024-05-08T18:08:14.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1265e-05 2024-05-08T18:08:14.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034118+0000", 2024-05-08T18:08:14.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2341000000000001e-05 2024-05-08T18:08:14.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034133+0000", 2024-05-08T18:08:14.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5166e-05 2024-05-08T18:08:14.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034254+0000", 2024-05-08T18:08:14.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121033 2024-05-08T18:08:14.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034492+0000", 2024-05-08T18:08:14.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023727700000000001 2024-05-08T18:08:14.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:14.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034967+0000", 2024-05-08T18:08:14.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047522100000000001 2024-05-08T18:08:14.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036353+0000", 2024-05-08T18:08:14.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013865800000000001 2024-05-08T18:08:14.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036841+0000", 2024-05-08T18:08:14.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048788999999999999 2024-05-08T18:08:14.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036929+0000", 2024-05-08T18:08:14.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:08:14.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036999+0000", 2024-05-08T18:08:14.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9448000000000003e-05 2024-05-08T18:08:14.926 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.926 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.926 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.927 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.927 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:14.927 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.815669651, 2024-05-08T18:08:14.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003040662, 2024-05-08T18:08:14.927 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.927 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.927 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.927 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.927 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.927 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.927 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 727 2024-05-08T18:08:14.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.927 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:14.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:14.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037369+0000", 2024-05-08T18:08:14.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:08:14.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037378+0000", 2024-05-08T18:08:14.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5359999999999998e-06 2024-05-08T18:08:14.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037405+0000", 2024-05-08T18:08:14.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6588e-05 2024-05-08T18:08:14.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037418+0000", 2024-05-08T18:08:14.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3642000000000001e-05 2024-05-08T18:08:14.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037531+0000", 2024-05-08T18:08:14.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112304 2024-05-08T18:08:14.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037785+0000", 2024-05-08T18:08:14.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025391299999999998 2024-05-08T18:08:14.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:14.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.038112+0000", 2024-05-08T18:08:14.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000326946 2024-05-08T18:08:14.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.039316+0000", 2024-05-08T18:08:14.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012043990000000001 2024-05-08T18:08:14.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040257+0000", 2024-05-08T18:08:14.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000941083 2024-05-08T18:08:14.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040345+0000", 2024-05-08T18:08:14.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8368999999999994e-05 2024-05-08T18:08:14.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040407+0000", 2024-05-08T18:08:14.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1941999999999997e-05 2024-05-08T18:08:14.932 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.932 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.932 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.932 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.932 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:14.932 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.701004261999998, 2024-05-08T18:08:14.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028797779999999999, 2024-05-08T18:08:14.933 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.933 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.933 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.933 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.933 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.933 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.933 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 777 2024-05-08T18:08:14.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.933 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:14.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:14.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152034+0000", 2024-05-08T18:08:14.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2299999999999998e-06 2024-05-08T18:08:14.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152045+0000", 2024-05-08T18:08:14.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0266e-05 2024-05-08T18:08:14.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152076+0000", 2024-05-08T18:08:14.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1007000000000003e-05 2024-05-08T18:08:14.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152094+0000", 2024-05-08T18:08:14.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8148999999999999e-05 2024-05-08T18:08:14.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152183+0000", 2024-05-08T18:08:14.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8845999999999996e-05 2024-05-08T18:08:14.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152308+0000", 2024-05-08T18:08:14.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012502999999999999 2024-05-08T18:08:14.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:14.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152578+0000", 2024-05-08T18:08:14.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027080099999999998 2024-05-08T18:08:14.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154238+0000", 2024-05-08T18:08:14.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016600180000000001 2024-05-08T18:08:14.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154714+0000", 2024-05-08T18:08:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000475341 2024-05-08T18:08:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154803+0000", 2024-05-08T18:08:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9566000000000003e-05 2024-05-08T18:08:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154912+0000", 2024-05-08T18:08:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010852400000000001 2024-05-08T18:08:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.457788368999999, 2024-05-08T18:08:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002844437, 2024-05-08T18:08:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 882 2024-05-08T18:08:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395250+0000", 2024-05-08T18:08:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-06 2024-05-08T18:08:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395261+0000", 2024-05-08T18:08:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1046000000000001e-05 2024-05-08T18:08:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395293+0000", 2024-05-08T18:08:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1473999999999997e-05 2024-05-08T18:08:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395307+0000", 2024-05-08T18:08:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4599e-05 2024-05-08T18:08:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395481+0000", 2024-05-08T18:08:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173499 2024-05-08T18:08:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395626+0000", 2024-05-08T18:08:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000145351 2024-05-08T18:08:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395902+0000", 2024-05-08T18:08:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027534499999999997 2024-05-08T18:08:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397118+0000", 2024-05-08T18:08:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012168929999999999 2024-05-08T18:08:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397951+0000", 2024-05-08T18:08:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000832272 2024-05-08T18:08:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398028+0000", 2024-05-08T18:08:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6921000000000004e-05 2024-05-08T18:08:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398092+0000", 2024-05-08T18:08:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4783999999999995e-05 2024-05-08T18:08:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.454727648999999, 2024-05-08T18:08:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002853894, 2024-05-08T18:08:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 883 2024-05-08T18:08:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398311+0000", 2024-05-08T18:08:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398321+0000", 2024-05-08T18:08:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9189999999999994e-06 2024-05-08T18:08:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398346+0000", 2024-05-08T18:08:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5065000000000001e-05 2024-05-08T18:08:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398360+0000", 2024-05-08T18:08:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4171999999999999e-05 2024-05-08T18:08:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398495+0000", 2024-05-08T18:08:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013503199999999999 2024-05-08T18:08:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398716+0000", 2024-05-08T18:08:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220459 2024-05-08T18:08:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.399054+0000", 2024-05-08T18:08:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033806199999999998 2024-05-08T18:08:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.400192+0000", 2024-05-08T18:08:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011389169999999999 2024-05-08T18:08:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401020+0000", 2024-05-08T18:08:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082746199999999995 2024-05-08T18:08:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401099+0000", 2024-05-08T18:08:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9157000000000001e-05 2024-05-08T18:08:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401163+0000", 2024-05-08T18:08:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3498999999999996e-05 2024-05-08T18:08:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.450938811999997, 2024-05-08T18:08:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031354040000000001, 2024-05-08T18:08:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 885 2024-05-08T18:08:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402100+0000", 2024-05-08T18:08:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.063e-06 2024-05-08T18:08:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402110+0000", 2024-05-08T18:08:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0453e-05 2024-05-08T18:08:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402141+0000", 2024-05-08T18:08:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0651000000000002e-05 2024-05-08T18:08:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402162+0000", 2024-05-08T18:08:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1373999999999999e-05 2024-05-08T18:08:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402306+0000", 2024-05-08T18:08:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143492 2024-05-08T18:08:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402562+0000", 2024-05-08T18:08:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025671899999999998 2024-05-08T18:08:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.403047+0000", 2024-05-08T18:08:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048419100000000003 2024-05-08T18:08:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404370+0000", 2024-05-08T18:08:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013231580000000001 2024-05-08T18:08:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404966+0000", 2024-05-08T18:08:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00059601100000000002 2024-05-08T18:08:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405115+0000", 2024-05-08T18:08:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149665 2024-05-08T18:08:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405233+0000", 2024-05-08T18:08:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117627 2024-05-08T18:08:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.353641277000001, 2024-05-08T18:08:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003251168, 2024-05-08T18:08:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 927 2024-05-08T18:08:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499396+0000", 2024-05-08T18:08:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:08:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499404+0000", 2024-05-08T18:08:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2629999999999997e-06 2024-05-08T18:08:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499423+0000", 2024-05-08T18:08:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9695e-05 2024-05-08T18:08:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499435+0000", 2024-05-08T18:08:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1542999999999999e-05 2024-05-08T18:08:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499545+0000", 2024-05-08T18:08:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110064 2024-05-08T18:08:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499764+0000", 2024-05-08T18:08:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021856499999999999 2024-05-08T18:08:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.500237+0000", 2024-05-08T18:08:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047359499999999999 2024-05-08T18:08:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.501627+0000", 2024-05-08T18:08:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013897860000000001 2024-05-08T18:08:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502484+0000", 2024-05-08T18:08:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085733300000000005 2024-05-08T18:08:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502574+0000", 2024-05-08T18:08:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9939999999999996e-05 2024-05-08T18:08:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502646+0000", 2024-05-08T18:08:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2064000000000007e-05 2024-05-08T18:08:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.350141735999998, 2024-05-08T18:08:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031881129999999998, 2024-05-08T18:08:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 928 2024-05-08T18:08:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502897+0000", 2024-05-08T18:08:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.916e-06 2024-05-08T18:08:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502906+0000", 2024-05-08T18:08:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2699999999999993e-06 2024-05-08T18:08:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502933+0000", 2024-05-08T18:08:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6823999999999999e-05 2024-05-08T18:08:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502946+0000", 2024-05-08T18:08:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3439e-05 2024-05-08T18:08:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503066+0000", 2024-05-08T18:08:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012013700000000001 2024-05-08T18:08:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503399+0000", 2024-05-08T18:08:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033298600000000001 2024-05-08T18:08:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503928+0000", 2024-05-08T18:08:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052877299999999996 2024-05-08T18:08:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505291+0000", 2024-05-08T18:08:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001363319 2024-05-08T18:08:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505933+0000", 2024-05-08T18:08:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064135799999999997 2024-05-08T18:08:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506019+0000", 2024-05-08T18:08:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6649000000000003e-05 2024-05-08T18:08:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506083+0000", 2024-05-08T18:08:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3441999999999993e-05 2024-05-08T18:08:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:14.966 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:14.967 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:08:14.968 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:14.962+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:15.068 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:15.073+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:15.140 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:15.140 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:15.140 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:15.155 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:08:15.169 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:15.169+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:15.270 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:15.269+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:15.272 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:15.272 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:15.272 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:15.272 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:15.272 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:15.286 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:08:15.296 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-08T18:08:15.296 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-08T18:08:15.370 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:15.366+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:15.413 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:15.413 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:15.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:15.414 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:15.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.414 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:3 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:08:15.414 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:15.414 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 55.877335139000003, 2024-05-08T18:08:15.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046964590000000001, 2024-05-08T18:08:15.414 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.414 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.414 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:08:15.414 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:15.414 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:08:15.414 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:08:15.414 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 3 2024-05-08T18:08:15.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.415 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:15.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:15.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534906+0000", 2024-05-08T18:08:15.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1030000000000002e-06 2024-05-08T18:08:15.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534918+0000", 2024-05-08T18:08:15.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1732999999999999e-05 2024-05-08T18:08:15.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534950+0000", 2024-05-08T18:08:15.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1420000000000001e-05 2024-05-08T18:08:15.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534974+0000", 2024-05-08T18:08:15.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4473000000000001e-05 2024-05-08T18:08:15.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.539338+0000", 2024-05-08T18:08:15.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043636719999999999 2024-05-08T18:08:15.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.539600+0000", 2024-05-08T18:08:15.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026205800000000002 2024-05-08T18:08:15.417 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.418 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.418 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.418 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:15.418 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:15.418 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.844261475000003, 2024-05-08T18:08:15.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054299370000000001, 2024-05-08T18:08:15.418 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.418 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.418 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.418 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:15.418 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:15.419 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:15.419 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 48 2024-05-08T18:08:15.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.419 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:15.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:15.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567980+0000", 2024-05-08T18:08:15.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.554e-06 2024-05-08T18:08:15.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567990+0000", 2024-05-08T18:08:15.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0961999999999999e-05 2024-05-08T18:08:15.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568023+0000", 2024-05-08T18:08:15.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441999999999999e-05 2024-05-08T18:08:15.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568042+0000", 2024-05-08T18:08:15.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8760999999999999e-05 2024-05-08T18:08:15.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568165+0000", 2024-05-08T18:08:15.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012333400000000001 2024-05-08T18:08:15.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568426+0000", 2024-05-08T18:08:15.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026132999999999999 2024-05-08T18:08:15.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:15.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568666+0000", 2024-05-08T18:08:15.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024009500000000001 2024-05-08T18:08:15.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:15.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.569886+0000", 2024-05-08T18:08:15.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012194790000000001 2024-05-08T18:08:15.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:15.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573254+0000", 2024-05-08T18:08:15.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033677109999999998 2024-05-08T18:08:15.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573339+0000", 2024-05-08T18:08:15.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5666000000000003e-05 2024-05-08T18:08:15.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573407+0000", 2024-05-08T18:08:15.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7602999999999996e-05 2024-05-08T18:08:15.424 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.424 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.424 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.424 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94206896343168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:15.424 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:15.424 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.838581312999999, 2024-05-08T18:08:15.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054113640000000001, 2024-05-08T18:08:15.424 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.424 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.424 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.424 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:15.424 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:15.424 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:15.424 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 49 2024-05-08T18:08:15.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.425 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:15.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:15.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573659+0000", 2024-05-08T18:08:15.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.762e-06 2024-05-08T18:08:15.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573667+0000", 2024-05-08T18:08:15.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8120000000000008e-06 2024-05-08T18:08:15.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573693+0000", 2024-05-08T18:08:15.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6057000000000001e-05 2024-05-08T18:08:15.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573710+0000", 2024-05-08T18:08:15.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7555999999999999e-05 2024-05-08T18:08:15.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573851+0000", 2024-05-08T18:08:15.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014109800000000001 2024-05-08T18:08:15.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.574072+0000", 2024-05-08T18:08:15.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022062899999999999 2024-05-08T18:08:15.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:15.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.574500+0000", 2024-05-08T18:08:15.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042798100000000002 2024-05-08T18:08:15.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:15.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.575719+0000", 2024-05-08T18:08:15.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001218717 2024-05-08T18:08:15.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:15.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578840+0000", 2024-05-08T18:08:15.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031215380000000001 2024-05-08T18:08:15.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578925+0000", 2024-05-08T18:08:15.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5191999999999993e-05 2024-05-08T18:08:15.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579069+0000", 2024-05-08T18:08:15.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143022 2024-05-08T18:08:15.429 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.429 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.429 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.430 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:08:15.430 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:15.430 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.835793334000002, 2024-05-08T18:08:15.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034814389999999998, 2024-05-08T18:08:15.430 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.430 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.430 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.430 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:15.430 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:15.430 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:15.430 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 205 2024-05-08T18:08:15.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.430 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:15.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:15.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576448+0000", 2024-05-08T18:08:15.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7839999999999999e-06 2024-05-08T18:08:15.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576462+0000", 2024-05-08T18:08:15.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4348999999999999e-05 2024-05-08T18:08:15.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576500+0000", 2024-05-08T18:08:15.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7252999999999997e-05 2024-05-08T18:08:15.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576528+0000", 2024-05-08T18:08:15.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8691e-05 2024-05-08T18:08:15.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576686+0000", 2024-05-08T18:08:15.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015810999999999999 2024-05-08T18:08:15.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576927+0000", 2024-05-08T18:08:15.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000240337 2024-05-08T18:08:15.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:15.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.577354+0000", 2024-05-08T18:08:15.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042767499999999997 2024-05-08T18:08:15.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:15.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.578866+0000", 2024-05-08T18:08:15.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001511271 2024-05-08T18:08:15.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:15.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579762+0000", 2024-05-08T18:08:15.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089618599999999999 2024-05-08T18:08:15.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579858+0000", 2024-05-08T18:08:15.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6686000000000002e-05 2024-05-08T18:08:15.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579927+0000", 2024-05-08T18:08:15.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8096999999999995e-05 2024-05-08T18:08:15.436 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.436 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.436 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.436 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:15.436 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:15.436 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.767797494, 2024-05-08T18:08:15.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035139590000000001, 2024-05-08T18:08:15.436 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.437 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.437 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.437 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:15.437 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:15.437 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:15.437 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 220 2024-05-08T18:08:15.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.437 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:15.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:15.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644444+0000", 2024-05-08T18:08:15.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6759999999999999e-06 2024-05-08T18:08:15.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644455+0000", 2024-05-08T18:08:15.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:08:15.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644487+0000", 2024-05-08T18:08:15.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2199999999999997e-05 2024-05-08T18:08:15.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644503+0000", 2024-05-08T18:08:15.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5452e-05 2024-05-08T18:08:15.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644689+0000", 2024-05-08T18:08:15.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000186541 2024-05-08T18:08:15.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644902+0000", 2024-05-08T18:08:15.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021321299999999999 2024-05-08T18:08:15.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:15.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.645299+0000", 2024-05-08T18:08:15.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039702699999999999 2024-05-08T18:08:15.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:15.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647459+0000", 2024-05-08T18:08:15.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021598279999999999 2024-05-08T18:08:15.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:15.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647803+0000", 2024-05-08T18:08:15.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034338199999999999 2024-05-08T18:08:15.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647888+0000", 2024-05-08T18:08:15.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5125999999999998e-05 2024-05-08T18:08:15.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647955+0000", 2024-05-08T18:08:15.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7280999999999995e-05 2024-05-08T18:08:15.442 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.442 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.442 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.443 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:15.443 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:15.443 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.747932974999998, 2024-05-08T18:08:15.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003220367, 2024-05-08T18:08:15.443 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.443 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.443 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.443 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:15.443 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:15.443 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:15.443 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 225 2024-05-08T18:08:15.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.443 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:15.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:15.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664308+0000", 2024-05-08T18:08:15.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:15.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664333+0000", 2024-05-08T18:08:15.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5361e-05 2024-05-08T18:08:15.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664362+0000", 2024-05-08T18:08:15.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8671999999999999e-05 2024-05-08T18:08:15.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664376+0000", 2024-05-08T18:08:15.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4741e-05 2024-05-08T18:08:15.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664541+0000", 2024-05-08T18:08:15.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016484400000000001 2024-05-08T18:08:15.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664767+0000", 2024-05-08T18:08:15.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000226061 2024-05-08T18:08:15.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:15.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.665199+0000", 2024-05-08T18:08:15.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000431674 2024-05-08T18:08:15.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:15.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.666428+0000", 2024-05-08T18:08:15.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001228605 2024-05-08T18:08:15.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:15.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667367+0000", 2024-05-08T18:08:15.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093924199999999996 2024-05-08T18:08:15.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667461+0000", 2024-05-08T18:08:15.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3762000000000001e-05 2024-05-08T18:08:15.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667526+0000", 2024-05-08T18:08:15.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5254999999999998e-05 2024-05-08T18:08:15.448 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.448 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.448 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.448 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:15.448 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:15.448 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.715705477, 2024-05-08T18:08:15.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037451559999999999, 2024-05-08T18:08:15.449 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.449 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.449 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.449 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:15.449 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:15.449 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:15.449 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 234 2024-05-08T18:08:15.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.449 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:15.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:15.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696535+0000", 2024-05-08T18:08:15.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0760000000000001e-06 2024-05-08T18:08:15.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696546+0000", 2024-05-08T18:08:15.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0556e-05 2024-05-08T18:08:15.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696577+0000", 2024-05-08T18:08:15.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0904000000000001e-05 2024-05-08T18:08:15.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696592+0000", 2024-05-08T18:08:15.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5316e-05 2024-05-08T18:08:15.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696731+0000", 2024-05-08T18:08:15.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138818 2024-05-08T18:08:15.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.697085+0000", 2024-05-08T18:08:15.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00035397800000000002 2024-05-08T18:08:15.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:15.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.697838+0000", 2024-05-08T18:08:15.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00075314800000000003 2024-05-08T18:08:15.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:15.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.699440+0000", 2024-05-08T18:08:15.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016023470000000001 2024-05-08T18:08:15.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:15.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700067+0000", 2024-05-08T18:08:15.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062698400000000003 2024-05-08T18:08:15.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700161+0000", 2024-05-08T18:08:15.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3762000000000001e-05 2024-05-08T18:08:15.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700278+0000", 2024-05-08T18:08:15.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117267 2024-05-08T18:08:15.454 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.454 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.454 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.454 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:431 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:15.454 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:15.454 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.650213465, 2024-05-08T18:08:15.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040957049999999998, 2024-05-08T18:08:15.455 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.455 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.455 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.455 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:15.455 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:15.455 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:15.455 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 431 2024-05-08T18:08:15.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.455 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:15.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:15.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762027+0000", 2024-05-08T18:08:15.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7889999999999999e-06 2024-05-08T18:08:15.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762036+0000", 2024-05-08T18:08:15.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6029999999999994e-06 2024-05-08T18:08:15.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762061+0000", 2024-05-08T18:08:15.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4831e-05 2024-05-08T18:08:15.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762076+0000", 2024-05-08T18:08:15.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4996e-05 2024-05-08T18:08:15.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.763559+0000", 2024-05-08T18:08:15.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001482501 2024-05-08T18:08:15.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.763747+0000", 2024-05-08T18:08:15.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018864399999999999 2024-05-08T18:08:15.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:15.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.764172+0000", 2024-05-08T18:08:15.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042445900000000002 2024-05-08T18:08:15.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:15.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.765292+0000", 2024-05-08T18:08:15.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001120196 2024-05-08T18:08:15.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:15.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.765812+0000", 2024-05-08T18:08:15.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052044000000000005 2024-05-08T18:08:15.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.766007+0000", 2024-05-08T18:08:15.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019423500000000001 2024-05-08T18:08:15.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.766121+0000", 2024-05-08T18:08:15.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114011 2024-05-08T18:08:15.460 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.460 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.460 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.460 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:15.460 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:15.460 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.643555994000003, 2024-05-08T18:08:15.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031982880000000001, 2024-05-08T18:08:15.460 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.460 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.460 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.460 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:15.460 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:15.461 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:15.461 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 438 2024-05-08T18:08:15.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.461 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:15.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:15.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768684+0000", 2024-05-08T18:08:15.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0049999999999999e-06 2024-05-08T18:08:15.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768697+0000", 2024-05-08T18:08:15.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2211e-05 2024-05-08T18:08:15.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768726+0000", 2024-05-08T18:08:15.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8949e-05 2024-05-08T18:08:15.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768743+0000", 2024-05-08T18:08:15.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7478000000000001e-05 2024-05-08T18:08:15.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768852+0000", 2024-05-08T18:08:15.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010889499999999999 2024-05-08T18:08:15.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.769168+0000", 2024-05-08T18:08:15.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031610900000000002 2024-05-08T18:08:15.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:15.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.769542+0000", 2024-05-08T18:08:15.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037368299999999998 2024-05-08T18:08:15.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:15.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.770721+0000", 2024-05-08T18:08:15.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001179591 2024-05-08T18:08:15.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:15.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771722+0000", 2024-05-08T18:08:15.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001000463 2024-05-08T18:08:15.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771819+0000", 2024-05-08T18:08:15.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6909000000000003e-05 2024-05-08T18:08:15.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771881+0000", 2024-05-08T18:08:15.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1995000000000005e-05 2024-05-08T18:08:15.466 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.466 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.466 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.467 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:477 6.4 e32/26 6:24c8e1ae:gc::gc.19:head v 32'12, mlcod=32'10)", 2024-05-08T18:08:15.467 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:15.467 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.621460966000001, 2024-05-08T18:08:15.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038511489999999999, 2024-05-08T18:08:15.467 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.467 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.467 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.467 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:15.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:15.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790779+0000", 2024-05-08T18:08:15.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4559999999999999e-06 2024-05-08T18:08:15.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790791+0000", 2024-05-08T18:08:15.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1780000000000001e-05 2024-05-08T18:08:15.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790817+0000", 2024-05-08T18:08:15.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5874999999999999e-05 2024-05-08T18:08:15.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790832+0000", 2024-05-08T18:08:15.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4909000000000001e-05 2024-05-08T18:08:15.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790959+0000", 2024-05-08T18:08:15.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012728199999999999 2024-05-08T18:08:15.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791007+0000", 2024-05-08T18:08:15.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7766000000000003e-05 2024-05-08T18:08:15.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794549+0000", 2024-05-08T18:08:15.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035422959999999999 2024-05-08T18:08:15.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794629+0000", 2024-05-08T18:08:15.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9784999999999996e-05 2024-05-08T18:08:15.471 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.471 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.471 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.471 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:487 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:15.471 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:15.471 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.616123717999997, 2024-05-08T18:08:15.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046865559999999997, 2024-05-08T18:08:15.471 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.471 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.472 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.472 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:15.472 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:15.472 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:15.472 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 487 2024-05-08T18:08:15.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.472 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:15.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:15.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796116+0000", 2024-05-08T18:08:15.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5650000000000001e-06 2024-05-08T18:08:15.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796124+0000", 2024-05-08T18:08:15.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6909999999999997e-06 2024-05-08T18:08:15.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796143+0000", 2024-05-08T18:08:15.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9483999999999998e-05 2024-05-08T18:08:15.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796154+0000", 2024-05-08T18:08:15.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0416e-05 2024-05-08T18:08:15.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796266+0000", 2024-05-08T18:08:15.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112011 2024-05-08T18:08:15.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796432+0000", 2024-05-08T18:08:15.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016641799999999999 2024-05-08T18:08:15.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:15.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796718+0000", 2024-05-08T18:08:15.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028548000000000001 2024-05-08T18:08:15.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:15.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798117+0000", 2024-05-08T18:08:15.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001399151 2024-05-08T18:08:15.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:15.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800656+0000", 2024-05-08T18:08:15.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025392689999999998 2024-05-08T18:08:15.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800733+0000", 2024-05-08T18:08:15.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6508000000000007e-05 2024-05-08T18:08:15.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800801+0000", 2024-05-08T18:08:15.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8563000000000001e-05 2024-05-08T18:08:15.477 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.477 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.477 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.477 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:489 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:15.477 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:15.477 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.614177220000002, 2024-05-08T18:08:15.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058220679999999997, 2024-05-08T18:08:15.477 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.478 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.478 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.478 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:15.478 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:15.478 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:15.478 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 489 2024-05-08T18:08:15.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.478 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:15.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:15.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798064+0000", 2024-05-08T18:08:15.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:08:15.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798074+0000", 2024-05-08T18:08:15.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0438999999999999e-05 2024-05-08T18:08:15.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798097+0000", 2024-05-08T18:08:15.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3019000000000001e-05 2024-05-08T18:08:15.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798115+0000", 2024-05-08T18:08:15.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7638e-05 2024-05-08T18:08:15.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798230+0000", 2024-05-08T18:08:15.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115375 2024-05-08T18:08:15.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798395+0000", 2024-05-08T18:08:15.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016542099999999999 2024-05-08T18:08:15.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:15.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798633+0000", 2024-05-08T18:08:15.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000237977 2024-05-08T18:08:15.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:15.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.799628+0000", 2024-05-08T18:08:15.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00099459099999999996 2024-05-08T18:08:15.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:15.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803706+0000", 2024-05-08T18:08:15.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040776199999999997 2024-05-08T18:08:15.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803796+0000", 2024-05-08T18:08:15.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0704000000000004e-05 2024-05-08T18:08:15.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803883+0000", 2024-05-08T18:08:15.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6923999999999996e-05 2024-05-08T18:08:15.483 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.483 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.483 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.483 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:491 6.10 e32/26 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:15.484 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:15.484 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.610953760999998, 2024-05-08T18:08:15.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052480360000000002, 2024-05-08T18:08:15.484 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.484 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.484 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.484 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:15.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:15.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.485 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.485 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.485 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801286+0000", 2024-05-08T18:08:15.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.085e-06 2024-05-08T18:08:15.485 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.485 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.485 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801293+0000", 2024-05-08T18:08:15.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.627e-06 2024-05-08T18:08:15.485 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.485 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801311+0000", 2024-05-08T18:08:15.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-05-08T18:08:15.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801320+0000", 2024-05-08T18:08:15.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5710000000000004e-06 2024-05-08T18:08:15.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801401+0000", 2024-05-08T18:08:15.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0798999999999997e-05 2024-05-08T18:08:15.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801439+0000", 2024-05-08T18:08:15.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7994000000000002e-05 2024-05-08T18:08:15.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806447+0000", 2024-05-08T18:08:15.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050077339999999998 2024-05-08T18:08:15.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806533+0000", 2024-05-08T18:08:15.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.577e-05 2024-05-08T18:08:15.487 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.487 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.488 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.488 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:495 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:15.488 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:15.488 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.607416870000002, 2024-05-08T18:08:15.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045481219999999999, 2024-05-08T18:08:15.488 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.488 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.488 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.488 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:15.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:15.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804823+0000", 2024-05-08T18:08:15.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.42e-06 2024-05-08T18:08:15.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.490 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804834+0000", 2024-05-08T18:08:15.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0584999999999999e-05 2024-05-08T18:08:15.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.490 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804848+0000", 2024-05-08T18:08:15.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:08:15.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.490 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804857+0000", 2024-05-08T18:08:15.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.302e-06 2024-05-08T18:08:15.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804967+0000", 2024-05-08T18:08:15.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109543 2024-05-08T18:08:15.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805018+0000", 2024-05-08T18:08:15.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0924000000000002e-05 2024-05-08T18:08:15.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809281+0000", 2024-05-08T18:08:15.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042631479999999996 2024-05-08T18:08:15.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809370+0000", 2024-05-08T18:08:15.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8787000000000002e-05 2024-05-08T18:08:15.492 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.492 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.492 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.492 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:500 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:15.492 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:15.492 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.605858456, 2024-05-08T18:08:15.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061595829999999997, 2024-05-08T18:08:15.493 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.493 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.493 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.493 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:15.493 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:15.493 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:15.493 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 500 2024-05-08T18:08:15.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.493 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:15.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.494 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:15.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.494 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.494 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806382+0000", 2024-05-08T18:08:15.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2709999999999999e-06 2024-05-08T18:08:15.494 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.494 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806395+0000", 2024-05-08T18:08:15.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2782000000000001e-05 2024-05-08T18:08:15.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806419+0000", 2024-05-08T18:08:15.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3841000000000001e-05 2024-05-08T18:08:15.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806437+0000", 2024-05-08T18:08:15.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8318999999999999e-05 2024-05-08T18:08:15.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806554+0000", 2024-05-08T18:08:15.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116507 2024-05-08T18:08:15.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806732+0000", 2024-05-08T18:08:15.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017828200000000001 2024-05-08T18:08:15.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:15.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806986+0000", 2024-05-08T18:08:15.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431100000000001 2024-05-08T18:08:15.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:15.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.808032+0000", 2024-05-08T18:08:15.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010455530000000001 2024-05-08T18:08:15.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:15.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812373+0000", 2024-05-08T18:08:15.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043410139999999998 2024-05-08T18:08:15.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812485+0000", 2024-05-08T18:08:15.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011234999999999999 2024-05-08T18:08:15.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812540+0000", 2024-05-08T18:08:15.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4353e-05 2024-05-08T18:08:15.498 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.498 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.498 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.499 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:502 6.10 e32/26 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:15.499 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:15.499 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.604684853000002, 2024-05-08T18:08:15.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049263659999999997, 2024-05-08T18:08:15.499 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.499 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.499 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.499 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:15.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:15.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807555+0000", 2024-05-08T18:08:15.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2079999999999999e-06 2024-05-08T18:08:15.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807563+0000", 2024-05-08T18:08:15.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3280000000000006e-06 2024-05-08T18:08:15.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807585+0000", 2024-05-08T18:08:15.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2361000000000002e-05 2024-05-08T18:08:15.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807596+0000", 2024-05-08T18:08:15.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0968000000000001e-05 2024-05-08T18:08:15.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807700+0000", 2024-05-08T18:08:15.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103232 2024-05-08T18:08:15.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807732+0000", 2024-05-08T18:08:15.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2373999999999999e-05 2024-05-08T18:08:15.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812391+0000", 2024-05-08T18:08:15.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046590140000000004 2024-05-08T18:08:15.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812480+0000", 2024-05-08T18:08:15.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8881000000000005e-05 2024-05-08T18:08:15.503 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.503 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.503 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.503 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:504 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'3, mlcod=32'1)", 2024-05-08T18:08:15.503 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:15.503 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.601012048000001, 2024-05-08T18:08:15.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389472, 2024-05-08T18:08:15.503 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.503 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.503 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.503 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:15.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:15.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811228+0000", 2024-05-08T18:08:15.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8819999999999999e-06 2024-05-08T18:08:15.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811240+0000", 2024-05-08T18:08:15.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1276e-05 2024-05-08T18:08:15.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811266+0000", 2024-05-08T18:08:15.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.601e-05 2024-05-08T18:08:15.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811283+0000", 2024-05-08T18:08:15.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7473e-05 2024-05-08T18:08:15.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811444+0000", 2024-05-08T18:08:15.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000161249 2024-05-08T18:08:15.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811501+0000", 2024-05-08T18:08:15.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6394999999999998e-05 2024-05-08T18:08:15.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815025+0000", 2024-05-08T18:08:15.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003524335 2024-05-08T18:08:15.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815121+0000", 2024-05-08T18:08:15.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6100000000000005e-05 2024-05-08T18:08:15.507 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.507 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.507 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.507 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:505 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:15.507 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:15.507 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.599382753, 2024-05-08T18:08:15.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007675075, 2024-05-08T18:08:15.507 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.508 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.508 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.508 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:15.508 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:15.508 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:15.508 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 505 2024-05-08T18:08:15.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.508 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:15.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:15.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812857+0000", 2024-05-08T18:08:15.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.621e-06 2024-05-08T18:08:15.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812865+0000", 2024-05-08T18:08:15.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0600000000000008e-06 2024-05-08T18:08:15.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812889+0000", 2024-05-08T18:08:15.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3569000000000001e-05 2024-05-08T18:08:15.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812901+0000", 2024-05-08T18:08:15.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1610000000000001e-05 2024-05-08T18:08:15.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813025+0000", 2024-05-08T18:08:15.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012430399999999999 2024-05-08T18:08:15.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813168+0000", 2024-05-08T18:08:15.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014329699999999999 2024-05-08T18:08:15.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:15.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813419+0000", 2024-05-08T18:08:15.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000250788 2024-05-08T18:08:15.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:15.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815462+0000", 2024-05-08T18:08:15.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002042865 2024-05-08T18:08:15.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:15.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820385+0000", 2024-05-08T18:08:15.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049229529999999999 2024-05-08T18:08:15.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820462+0000", 2024-05-08T18:08:15.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7101000000000006e-05 2024-05-08T18:08:15.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820531+0000", 2024-05-08T18:08:15.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8906999999999996e-05 2024-05-08T18:08:15.513 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.513 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.514 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.514 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:506 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:15.514 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:15.514 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.59815991, 2024-05-08T18:08:15.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006383143, 2024-05-08T18:08:15.514 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.514 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.514 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.514 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:15.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:15.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814081+0000", 2024-05-08T18:08:15.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0080000000000001e-06 2024-05-08T18:08:15.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814094+0000", 2024-05-08T18:08:15.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3407999999999999e-05 2024-05-08T18:08:15.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814125+0000", 2024-05-08T18:08:15.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0688999999999997e-05 2024-05-08T18:08:15.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814142+0000", 2024-05-08T18:08:15.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7192000000000001e-05 2024-05-08T18:08:15.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814245+0000", 2024-05-08T18:08:15.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103164 2024-05-08T18:08:15.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814302+0000", 2024-05-08T18:08:15.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6613999999999997e-05 2024-05-08T18:08:15.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820398+0000", 2024-05-08T18:08:15.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060967620000000004 2024-05-08T18:08:15.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820462+0000", 2024-05-08T18:08:15.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3305999999999993e-05 2024-05-08T18:08:15.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.519 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.519 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:750 6.19 6:9fecf831:::obj_delete_at_hint.0000000057:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:15.520 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:15.520 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.322921538999999, 2024-05-08T18:08:15.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035713440000000002, 2024-05-08T18:08:15.520 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:15.520 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:15.520 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:15.520 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:15.520 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:15.520 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:15.520 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 750 2024-05-08T18:08:15.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.521 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:15.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:15.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:15.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:15.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:15.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:15.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:15.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089318+0000", 2024-05-08T18:08:15.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.446e-06 2024-05-08T18:08:15.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:15.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089325+0000", 2024-05-08T18:08:15.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8560000000000001e-06 2024-05-08T18:08:15.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:15.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089345+0000", 2024-05-08T18:08:15.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9641999999999999e-05 2024-05-08T18:08:15.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:15.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089355+0000", 2024-05-08T18:08:15.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0586e-05 2024-05-08T18:08:15.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:15.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089469+0000", 2024-05-08T18:08:15.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113324 2024-05-08T18:08:15.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:15.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089692+0000", 2024-05-08T18:08:15.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022334500000000001 2024-05-08T18:08:15.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:15.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.090160+0000", 2024-05-08T18:08:15.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00046827799999999998 2024-05-08T18:08:15.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:15.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.091322+0000", 2024-05-08T18:08:15.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001161282 2024-05-08T18:08:15.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:15.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092750+0000", 2024-05-08T18:08:15.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014281299999999999 2024-05-08T18:08:15.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:15.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092829+0000", 2024-05-08T18:08:15.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9376999999999996e-05 2024-05-08T18:08:15.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:15.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:15.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:15.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092888+0000", 2024-05-08T18:08:15.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9077999999999999e-05 2024-05-08T18:08:15.526 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.526 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.527 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.527 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:15.527 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:15.527 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:15.528 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:08:15.529 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:15.526+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:15.629 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:15.629+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:15.700 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:15.701 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:15.701 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:15.701 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:15.715 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:08:15.757 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.0 to 1 (10000) 2024-05-08T18:08:15.759 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:15.758+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:15.782 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-08T18:08:15.830 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:15.826+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:15.834 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:15.834 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:15.834 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:15.834 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:15.834 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:15.848 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:08:15.940 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:15.938+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:16.015 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:08:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.478793240999998, 2024-05-08T18:08:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.032012946, 2024-05-08T18:08:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:08:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:08:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:08:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535484+0000", 2024-05-08T18:08:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7929999999999999e-06 2024-05-08T18:08:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535500+0000", 2024-05-08T18:08:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5226e-05 2024-05-08T18:08:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535535+0000", 2024-05-08T18:08:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5213000000000003e-05 2024-05-08T18:08:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535564+0000", 2024-05-08T18:08:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9360999999999999e-05 2024-05-08T18:08:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535757+0000", 2024-05-08T18:08:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000193229 2024-05-08T18:08:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:08:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535775+0000", 2024-05-08T18:08:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7098000000000001e-05 2024-05-08T18:08:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556004+0000", 2024-05-08T18:08:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020229068999999999 2024-05-08T18:08:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556036+0000", 2024-05-08T18:08:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1943000000000002e-05 2024-05-08T18:08:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.564721+0000", 2024-05-08T18:08:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086853320000000005 2024-05-08T18:08:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565032+0000", 2024-05-08T18:08:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031121799999999999 2024-05-08T18:08:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565365+0000", 2024-05-08T18:08:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000332744 2024-05-08T18:08:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567305+0000", 2024-05-08T18:08:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00194016 2024-05-08T18:08:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567368+0000", 2024-05-08T18:08:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3342000000000004e-05 2024-05-08T18:08:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567433+0000", 2024-05-08T18:08:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4726000000000003e-05 2024-05-08T18:08:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567494+0000", 2024-05-08T18:08:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0492000000000003e-05 2024-05-08T18:08:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206896342016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:08:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.446376149000002, 2024-05-08T18:08:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026490820000000001, 2024-05-08T18:08:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 47 2024-05-08T18:08:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:08:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:08:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567900+0000", 2024-05-08T18:08:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.03e-06 2024-05-08T18:08:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567909+0000", 2024-05-08T18:08:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0389999999999993e-06 2024-05-08T18:08:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567947+0000", 2024-05-08T18:08:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8013999999999999e-05 2024-05-08T18:08:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567961+0000", 2024-05-08T18:08:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3777999999999999e-05 2024-05-08T18:08:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568066+0000", 2024-05-08T18:08:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105208 2024-05-08T18:08:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568176+0000", 2024-05-08T18:08:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011041599999999999 2024-05-08T18:08:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568443+0000", 2024-05-08T18:08:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000266846 2024-05-08T18:08:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.569612+0000", 2024-05-08T18:08:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001169156 2024-05-08T18:08:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570378+0000", 2024-05-08T18:08:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00076617799999999995 2024-05-08T18:08:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570457+0000", 2024-05-08T18:08:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8750000000000003e-05 2024-05-08T18:08:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570547+0000", 2024-05-08T18:08:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9666999999999994e-05 2024-05-08T18:08:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:08:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.435328877000003, 2024-05-08T18:08:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051182119999999996, 2024-05-08T18:08:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 54 2024-05-08T18:08:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:08:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:08:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578947+0000", 2024-05-08T18:08:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578957+0000", 2024-05-08T18:08:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6020000000000006e-06 2024-05-08T18:08:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578997+0000", 2024-05-08T18:08:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0663e-05 2024-05-08T18:08:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579016+0000", 2024-05-08T18:08:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8185e-05 2024-05-08T18:08:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579117+0000", 2024-05-08T18:08:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010117599999999999 2024-05-08T18:08:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579252+0000", 2024-05-08T18:08:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013552 2024-05-08T18:08:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579393+0000", 2024-05-08T18:08:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140605 2024-05-08T18:08:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.580414+0000", 2024-05-08T18:08:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010214219999999999 2024-05-08T18:08:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.583866+0000", 2024-05-08T18:08:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034512840000000002 2024-05-08T18:08:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.583946+0000", 2024-05-08T18:08:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0406000000000002e-05 2024-05-08T18:08:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584063+0000", 2024-05-08T18:08:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117199 2024-05-08T18:08:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206896337408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:08:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.430042149999998, 2024-05-08T18:08:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027716910000000002, 2024-05-08T18:08:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 55 2024-05-08T18:08:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:08:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:08:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584234+0000", 2024-05-08T18:08:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9259999999999999e-06 2024-05-08T18:08:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584244+0000", 2024-05-08T18:08:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0369e-05 2024-05-08T18:08:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584270+0000", 2024-05-08T18:08:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5554999999999998e-05 2024-05-08T18:08:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584283+0000", 2024-05-08T18:08:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3039e-05 2024-05-08T18:08:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584384+0000", 2024-05-08T18:08:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000100881 2024-05-08T18:08:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584510+0000", 2024-05-08T18:08:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012627100000000001 2024-05-08T18:08:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584741+0000", 2024-05-08T18:08:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023162899999999999 2024-05-08T18:08:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.585714+0000", 2024-05-08T18:08:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00097270500000000003 2024-05-08T18:08:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.586818+0000", 2024-05-08T18:08:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00110403 2024-05-08T18:08:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.586908+0000", 2024-05-08T18:08:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9641000000000005e-05 2024-05-08T18:08:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.587003+0000", 2024-05-08T18:08:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5644999999999997e-05 2024-05-08T18:08:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:191 6.5 e29/26 6:a2ace8b3:::data_log.0:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:08:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.330214581, 2024-05-08T18:08:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001855095, 2024-05-08T18:08:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:08:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:08:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684061+0000", 2024-05-08T18:08:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:08:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684074+0000", 2024-05-08T18:08:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2479e-05 2024-05-08T18:08:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684104+0000", 2024-05-08T18:08:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0689999999999999e-05 2024-05-08T18:08:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684120+0000", 2024-05-08T18:08:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5996000000000001e-05 2024-05-08T18:08:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684221+0000", 2024-05-08T18:08:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000100647 2024-05-08T18:08:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684273+0000", 2024-05-08T18:08:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2074999999999999e-05 2024-05-08T18:08:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.685828+0000", 2024-05-08T18:08:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015553030000000001 2024-05-08T18:08:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.685914+0000", 2024-05-08T18:08:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5927999999999995e-05 2024-05-08T18:08:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 49.415176318, 2024-05-08T18:08:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003347367, 2024-05-08T18:08:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:16.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:16.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:16.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5300000000000003e-07 2024-05-08T18:08:16.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599110+0000", 2024-05-08T18:08:16.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1826e-05 2024-05-08T18:08:16.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599159+0000", 2024-05-08T18:08:16.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8322000000000003e-05 2024-05-08T18:08:16.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599180+0000", 2024-05-08T18:08:16.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1682e-05 2024-05-08T18:08:16.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599427+0000", 2024-05-08T18:08:16.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024721299999999998 2024-05-08T18:08:16.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599475+0000", 2024-05-08T18:08:16.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7299000000000002e-05 2024-05-08T18:08:16.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.602326+0000", 2024-05-08T18:08:16.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028516409999999998 2024-05-08T18:08:16.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.602445+0000", 2024-05-08T18:08:16.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011853099999999999 2024-05-08T18:08:16.048 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.048 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.048 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.048 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:231 6.1f e32/26 6:fde4dd55:gc::gc.26:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:16.048 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:16.048 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 49.327523220000003, 2024-05-08T18:08:16.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017909390000000001, 2024-05-08T18:08:16.048 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.048 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.048 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.049 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:16.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:16.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:16.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5000000000000002e-07 2024-05-08T18:08:16.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686785+0000", 2024-05-08T18:08:16.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3438000000000001e-05 2024-05-08T18:08:16.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686810+0000", 2024-05-08T18:08:16.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4858000000000002e-05 2024-05-08T18:08:16.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686823+0000", 2024-05-08T18:08:16.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3417999999999999e-05 2024-05-08T18:08:16.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686989+0000", 2024-05-08T18:08:16.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016624700000000001 2024-05-08T18:08:16.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.687023+0000", 2024-05-08T18:08:16.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3396999999999999e-05 2024-05-08T18:08:16.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.688453+0000", 2024-05-08T18:08:16.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001430675 2024-05-08T18:08:16.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.688542+0000", 2024-05-08T18:08:16.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8256000000000003e-05 2024-05-08T18:08:16.052 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.052 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.052 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.052 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:292 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:16.052 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:08:16.052 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 49.294136500999997, 2024-05-08T18:08:16.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020064839999999998, 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720170+0000", 2024-05-08T18:08:16.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3090999999999999e-05 2024-05-08T18:08:16.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720189+0000", 2024-05-08T18:08:16.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8077999999999999e-05 2024-05-08T18:08:16.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720222+0000", 2024-05-08T18:08:16.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3111000000000002e-05 2024-05-08T18:08:16.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720241+0000", 2024-05-08T18:08:16.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9528e-05 2024-05-08T18:08:16.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720452+0000", 2024-05-08T18:08:16.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021077300000000001 2024-05-08T18:08:16.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720505+0000", 2024-05-08T18:08:16.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2605000000000002e-05 2024-05-08T18:08:16.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.722038+0000", 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015334630000000001 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.722144+0000", 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010583500000000001 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:328 6.1 e32/26 6:856b9b26:reshard::reshard.0000000002:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 49.288708210000003, 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0018910070000000001, 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.056 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.057 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.057 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:16.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:16.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:16.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3e-07 2024-05-08T18:08:16.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725576+0000", 2024-05-08T18:08:16.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5759999999999995e-06 2024-05-08T18:08:16.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725622+0000", 2024-05-08T18:08:16.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6196000000000003e-05 2024-05-08T18:08:16.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725642+0000", 2024-05-08T18:08:16.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9947999999999999e-05 2024-05-08T18:08:16.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.726011+0000", 2024-05-08T18:08:16.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036876699999999999 2024-05-08T18:08:16.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.726062+0000", 2024-05-08T18:08:16.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1062e-05 2024-05-08T18:08:16.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.727367+0000", 2024-05-08T18:08:16.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001304869 2024-05-08T18:08:16.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.727457+0000", 2024-05-08T18:08:16.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9858999999999995e-05 2024-05-08T18:08:16.060 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.060 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.060 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.060 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:382 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'6, mlcod=32'4)", 2024-05-08T18:08:16.060 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:08:16.060 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 49.275743605999999, 2024-05-08T18:08:16.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023570779999999999, 2024-05-08T18:08:16.060 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.060 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.061 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.061 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:08:16.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:08:16.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738532+0000", 2024-05-08T18:08:16.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.95e-06 2024-05-08T18:08:16.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738548+0000", 2024-05-08T18:08:16.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5911000000000001e-05 2024-05-08T18:08:16.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738583+0000", 2024-05-08T18:08:16.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4830999999999999e-05 2024-05-08T18:08:16.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738605+0000", 2024-05-08T18:08:16.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2005e-05 2024-05-08T18:08:16.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738747+0000", 2024-05-08T18:08:16.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014162800000000001 2024-05-08T18:08:16.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738800+0000", 2024-05-08T18:08:16.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2918999999999999e-05 2024-05-08T18:08:16.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.740802+0000", 2024-05-08T18:08:16.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020026150000000001 2024-05-08T18:08:16.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.740887+0000", 2024-05-08T18:08:16.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5218999999999998e-05 2024-05-08T18:08:16.066 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.066 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.066 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.066 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:394 6.c e32/26 6:3677c228:::obj_delete_at_hint.0000000006:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:16.066 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:08:16.066 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 49.271078395000004, 2024-05-08T18:08:16.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026335320000000001, 2024-05-08T18:08:16.067 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.067 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.067 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.067 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:08:16.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:08:16.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743197+0000", 2024-05-08T18:08:16.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.81e-06 2024-05-08T18:08:16.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743210+0000", 2024-05-08T18:08:16.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2354999999999999e-05 2024-05-08T18:08:16.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743237+0000", 2024-05-08T18:08:16.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7328e-05 2024-05-08T18:08:16.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743256+0000", 2024-05-08T18:08:16.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8712e-05 2024-05-08T18:08:16.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743394+0000", 2024-05-08T18:08:16.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138009 2024-05-08T18:08:16.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743449+0000", 2024-05-08T18:08:16.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5371000000000002e-05 2024-05-08T18:08:16.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745754+0000", 2024-05-08T18:08:16.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002304567 2024-05-08T18:08:16.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745829+0000", 2024-05-08T18:08:16.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.538e-05 2024-05-08T18:08:16.070 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.070 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.070 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.071 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:392 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'7, mlcod=32'5)", 2024-05-08T18:08:16.071 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:08:16.071 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 49.270625875999997, 2024-05-08T18:08:16.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022345389999999998, 2024-05-08T18:08:16.071 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.071 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.071 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.071 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:08:16.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:08:16.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743650+0000", 2024-05-08T18:08:16.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1260000000000001e-06 2024-05-08T18:08:16.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743666+0000", 2024-05-08T18:08:16.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5696e-05 2024-05-08T18:08:16.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743696+0000", 2024-05-08T18:08:16.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0037999999999999e-05 2024-05-08T18:08:16.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743716+0000", 2024-05-08T18:08:16.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0251e-05 2024-05-08T18:08:16.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743838+0000", 2024-05-08T18:08:16.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012187 2024-05-08T18:08:16.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743886+0000", 2024-05-08T18:08:16.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8053000000000002e-05 2024-05-08T18:08:16.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745805+0000", 2024-05-08T18:08:16.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019189509999999999 2024-05-08T18:08:16.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745883+0000", 2024-05-08T18:08:16.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7553999999999996e-05 2024-05-08T18:08:16.075 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.075 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.075 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.075 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:453 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:16.075 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:08:16.075 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 49.236460696000002, 2024-05-08T18:08:16.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017625729999999999, 2024-05-08T18:08:16.075 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.075 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.075 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.075 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:08:16.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:08:16.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777815+0000", 2024-05-08T18:08:16.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6130000000000001e-06 2024-05-08T18:08:16.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777826+0000", 2024-05-08T18:08:16.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:08:16.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777852+0000", 2024-05-08T18:08:16.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6787999999999998e-05 2024-05-08T18:08:16.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777865+0000", 2024-05-08T18:08:16.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2882e-05 2024-05-08T18:08:16.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777961+0000", 2024-05-08T18:08:16.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5280999999999998e-05 2024-05-08T18:08:16.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777993+0000", 2024-05-08T18:08:16.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1931999999999999e-05 2024-05-08T18:08:16.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779496+0000", 2024-05-08T18:08:16.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001503307 2024-05-08T18:08:16.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779576+0000", 2024-05-08T18:08:16.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9887000000000003e-05 2024-05-08T18:08:16.079 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.079 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.079 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.080 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:460 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'3, mlcod=32'1)", 2024-05-08T18:08:16.080 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:08:16.080 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 49.235125326000002, 2024-05-08T18:08:16.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032252579999999999, 2024-05-08T18:08:16.080 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.080 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.080 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.080 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:08:16.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:08:16.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779150+0000", 2024-05-08T18:08:16.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:16.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779161+0000", 2024-05-08T18:08:16.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0906e-05 2024-05-08T18:08:16.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779186+0000", 2024-05-08T18:08:16.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4861000000000001e-05 2024-05-08T18:08:16.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779198+0000", 2024-05-08T18:08:16.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1969e-05 2024-05-08T18:08:16.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779334+0000", 2024-05-08T18:08:16.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000135513 2024-05-08T18:08:16.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779396+0000", 2024-05-08T18:08:16.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2815000000000001e-05 2024-05-08T18:08:16.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.782247+0000", 2024-05-08T18:08:16.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028502200000000001 2024-05-08T18:08:16.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.782374+0000", 2024-05-08T18:08:16.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012726400000000001 2024-05-08T18:08:16.084 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.084 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.084 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.084 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:463 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-05-08T18:08:16.084 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:08:16.084 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 49.232779221000001, 2024-05-08T18:08:16.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0036423610000000002, 2024-05-08T18:08:16.084 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.084 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.084 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.085 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:08:16.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:08:16.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781497+0000", 2024-05-08T18:08:16.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.917e-06 2024-05-08T18:08:16.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781509+0000", 2024-05-08T18:08:16.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2227e-05 2024-05-08T18:08:16.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781539+0000", 2024-05-08T18:08:16.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0218000000000001e-05 2024-05-08T18:08:16.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781558+0000", 2024-05-08T18:08:16.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8918000000000001e-05 2024-05-08T18:08:16.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781660+0000", 2024-05-08T18:08:16.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101584 2024-05-08T18:08:16.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781697+0000", 2024-05-08T18:08:16.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7360000000000001e-05 2024-05-08T18:08:16.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785059+0000", 2024-05-08T18:08:16.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033618810000000002 2024-05-08T18:08:16.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785137+0000", 2024-05-08T18:08:16.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8256000000000004e-05 2024-05-08T18:08:16.088 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.088 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.088 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.088 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:466 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:16.088 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:08:16.089 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 49.230658968999997, 2024-05-08T18:08:16.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002137496, 2024-05-08T18:08:16.089 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.089 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.089 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.089 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:08:16.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:08:16.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783617+0000", 2024-05-08T18:08:16.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8330000000000001e-06 2024-05-08T18:08:16.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:08:16.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5872e-05 2024-05-08T18:08:16.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783668+0000", 2024-05-08T18:08:16.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5880999999999997e-05 2024-05-08T18:08:16.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783688+0000", 2024-05-08T18:08:16.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9485000000000001e-05 2024-05-08T18:08:16.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783819+0000", 2024-05-08T18:08:16.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013098600000000001 2024-05-08T18:08:16.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783865+0000", 2024-05-08T18:08:16.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5711000000000003e-05 2024-05-08T18:08:16.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785680+0000", 2024-05-08T18:08:16.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001815374 2024-05-08T18:08:16.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785752+0000", 2024-05-08T18:08:16.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2354000000000006e-05 2024-05-08T18:08:16.092 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.093 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.093 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.093 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:469 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'10, mlcod=32'8)", 2024-05-08T18:08:16.093 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:08:16.093 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 49.227367979999997, 2024-05-08T18:08:16.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002120242, 2024-05-08T18:08:16.093 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.093 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.093 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.093 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:08:16.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:08:16.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786907+0000", 2024-05-08T18:08:16.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.412e-06 2024-05-08T18:08:16.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786917+0000", 2024-05-08T18:08:16.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3489999999999998e-06 2024-05-08T18:08:16.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786940+0000", 2024-05-08T18:08:16.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3019000000000001e-05 2024-05-08T18:08:16.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786951+0000", 2024-05-08T18:08:16.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0956e-05 2024-05-08T18:08:16.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.787229+0000", 2024-05-08T18:08:16.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027875000000000003 2024-05-08T18:08:16.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.787263+0000", 2024-05-08T18:08:16.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3563999999999999e-05 2024-05-08T18:08:16.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.788886+0000", 2024-05-08T18:08:16.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016228320000000001 2024-05-08T18:08:16.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.789026+0000", 2024-05-08T18:08:16.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014035999999999999 2024-05-08T18:08:16.097 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.097 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.097 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.097 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:478 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'11, mlcod=32'9)", 2024-05-08T18:08:16.097 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:08:16.097 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 49.223256366999998, 2024-05-08T18:08:16.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037403340000000001, 2024-05-08T18:08:16.097 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.097 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.097 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.098 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:08:16.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:08:16.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791019+0000", 2024-05-08T18:08:16.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5999999999999999e-06 2024-05-08T18:08:16.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791032+0000", 2024-05-08T18:08:16.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3021e-05 2024-05-08T18:08:16.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791057+0000", 2024-05-08T18:08:16.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4600000000000002e-05 2024-05-08T18:08:16.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791071+0000", 2024-05-08T18:08:16.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4756000000000001e-05 2024-05-08T18:08:16.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791185+0000", 2024-05-08T18:08:16.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011333200000000001 2024-05-08T18:08:16.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791234+0000", 2024-05-08T18:08:16.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8695e-05 2024-05-08T18:08:16.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794662+0000", 2024-05-08T18:08:16.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034282520000000001 2024-05-08T18:08:16.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794758+0000", 2024-05-08T18:08:16.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6077999999999997e-05 2024-05-08T18:08:16.101 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.101 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.101 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.102 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:829 6.5 e32/26 6:a77c5545:::obj_delete_at_hint.0000000084:head v 32'12, mlcod=32'10)", 2024-05-08T18:08:16.102 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:08:16.102 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.742087353000002, 2024-05-08T18:08:16.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017254, 2024-05-08T18:08:16.102 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.102 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.102 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.102 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:08:16.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:08:16.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272188+0000", 2024-05-08T18:08:16.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7269999999999999e-06 2024-05-08T18:08:16.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272229+0000", 2024-05-08T18:08:16.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0256999999999998e-05 2024-05-08T18:08:16.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272261+0000", 2024-05-08T18:08:16.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2017000000000002e-05 2024-05-08T18:08:16.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272275+0000", 2024-05-08T18:08:16.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4532000000000001e-05 2024-05-08T18:08:16.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272437+0000", 2024-05-08T18:08:16.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016199699999999999 2024-05-08T18:08:16.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272501+0000", 2024-05-08T18:08:16.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3805000000000003e-05 2024-05-08T18:08:16.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.273824+0000", 2024-05-08T18:08:16.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001323039 2024-05-08T18:08:16.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.273912+0000", 2024-05-08T18:08:16.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8026000000000001e-05 2024-05-08T18:08:16.106 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.106 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.106 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.106 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:937 6.1f e32/26 6:fd6b5df8:::obj_delete_at_hint.0000000120:head v 32'10, mlcod=32'8)", 2024-05-08T18:08:16.106 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:08:16.106 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.490851237999998, 2024-05-08T18:08:16.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019919009999999999, 2024-05-08T18:08:16.106 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.106 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.107 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.107 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:08:16.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:08:16.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523425+0000", 2024-05-08T18:08:16.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8560000000000001e-06 2024-05-08T18:08:16.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523437+0000", 2024-05-08T18:08:16.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2833000000000001e-05 2024-05-08T18:08:16.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523464+0000", 2024-05-08T18:08:16.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6621000000000001e-05 2024-05-08T18:08:16.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523477+0000", 2024-05-08T18:08:16.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2758999999999999e-05 2024-05-08T18:08:16.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523612+0000", 2024-05-08T18:08:16.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013525899999999999 2024-05-08T18:08:16.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523679+0000", 2024-05-08T18:08:16.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6964000000000005e-05 2024-05-08T18:08:16.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.525312+0000", 2024-05-08T18:08:16.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016331 2024-05-08T18:08:16.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.525415+0000", 2024-05-08T18:08:16.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000102509 2024-05-08T18:08:16.110 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.110 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.110 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.110 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.110 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.110 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:16.112 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:08:16.112 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:16.113+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:16.213 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:16.213+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:16.281 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:16.281 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:16.281 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:16.281 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:16.296 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:08:16.313 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:16.313+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:16.414 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:16.410+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:16.417 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:16.418 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:16.418 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:16.418 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:16.418 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:16.432 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:08:16.502 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:08:16.520 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:16.518+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:16.601 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:16.601 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:16.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:16.601 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:16.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.601 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.601 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:08:16.601 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.784754500000005, 2024-05-08T18:08:16.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.16213206199999999, 2024-05-08T18:08:16.601 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.601 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.602 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.602 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.602 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.602 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.602 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1 2024-05-08T18:08:16.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.602 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:08:16.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:08:16.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814494+0000", 2024-05-08T18:08:16.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:08:16.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814520+0000", 2024-05-08T18:08:16.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-05 2024-05-08T18:08:16.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814543+0000", 2024-05-08T18:08:16.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2353000000000001e-05 2024-05-08T18:08:16.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814563+0000", 2024-05-08T18:08:16.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.048e-05 2024-05-08T18:08:16.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814677+0000", 2024-05-08T18:08:16.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113632 2024-05-08T18:08:16.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:16.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814705+0000", 2024-05-08T18:08:16.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8626999999999999e-05 2024-05-08T18:08:16.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971115+0000", 2024-05-08T18:08:16.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.156409825 2024-05-08T18:08:16.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971438+0000", 2024-05-08T18:08:16.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00032289200000000002 2024-05-08T18:08:16.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971849+0000", 2024-05-08T18:08:16.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041139300000000002 2024-05-08T18:08:16.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.975364+0000", 2024-05-08T18:08:16.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035148390000000001 2024-05-08T18:08:16.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976474+0000", 2024-05-08T18:08:16.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001110099 2024-05-08T18:08:16.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976564+0000", 2024-05-08T18:08:16.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9522000000000001e-05 2024-05-08T18:08:16.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976624+0000", 2024-05-08T18:08:16.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9616e-05 2024-05-08T18:08:16.607 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.607 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.607 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.608 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.608 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:08:16.608 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.586805053999996, 2024-05-08T18:08:16.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010762776999999999, 2024-05-08T18:08:16.608 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.608 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.608 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.608 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.608 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.608 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.608 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 24 2024-05-08T18:08:16.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.609 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:08:16.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:08:16.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012442+0000", 2024-05-08T18:08:16.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.4300000000000002e-07 2024-05-08T18:08:16.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012573+0000", 2024-05-08T18:08:16.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013108299999999999 2024-05-08T18:08:16.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012592+0000", 2024-05-08T18:08:16.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9009e-05 2024-05-08T18:08:16.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012610+0000", 2024-05-08T18:08:16.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.789e-05 2024-05-08T18:08:16.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019108+0000", 2024-05-08T18:08:16.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064981470000000001 2024-05-08T18:08:16.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019348+0000", 2024-05-08T18:08:16.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024006099999999999 2024-05-08T18:08:16.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019751+0000", 2024-05-08T18:08:16.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040324099999999998 2024-05-08T18:08:16.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.022727+0000", 2024-05-08T18:08:16.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002976107 2024-05-08T18:08:16.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.022826+0000", 2024-05-08T18:08:16.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8626000000000001e-05 2024-05-08T18:08:16.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023036+0000", 2024-05-08T18:08:16.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000209578 2024-05-08T18:08:16.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023204+0000", 2024-05-08T18:08:16.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016819200000000001 2024-05-08T18:08:16.613 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.613 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.613 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.613 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.613 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:08:16.614 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.586617958999994, 2024-05-08T18:08:16.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011074977999999999, 2024-05-08T18:08:16.614 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.614 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.614 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.614 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.614 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.614 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.614 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 25 2024-05-08T18:08:16.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.614 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:08:16.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:08:16.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012629+0000", 2024-05-08T18:08:16.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7700000000000004e-07 2024-05-08T18:08:16.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012636+0000", 2024-05-08T18:08:16.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-05-08T18:08:16.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012646+0000", 2024-05-08T18:08:16.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0147e-05 2024-05-08T18:08:16.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012657+0000", 2024-05-08T18:08:16.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0473e-05 2024-05-08T18:08:16.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021198+0000", 2024-05-08T18:08:16.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0085417510000000002 2024-05-08T18:08:16.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021445+0000", 2024-05-08T18:08:16.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024665100000000002 2024-05-08T18:08:16.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021820+0000", 2024-05-08T18:08:16.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037519400000000003 2024-05-08T18:08:16.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023231+0000", 2024-05-08T18:08:16.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001410412 2024-05-08T18:08:16.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023550+0000", 2024-05-08T18:08:16.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000319368 2024-05-08T18:08:16.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023632+0000", 2024-05-08T18:08:16.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2366000000000004e-05 2024-05-08T18:08:16.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023703+0000", 2024-05-08T18:08:16.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0568999999999995e-05 2024-05-08T18:08:16.619 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.619 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.619 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.619 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.619 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:08:16.619 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.490272172000005, 2024-05-08T18:08:16.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011460965, 2024-05-08T18:08:16.619 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.619 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.619 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.619 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.619 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.620 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.620 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 45 2024-05-08T18:08:16.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.620 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:08:16.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:08:16.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108975+0000", 2024-05-08T18:08:16.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:08:16.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108983+0000", 2024-05-08T18:08:16.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6669999999999996e-06 2024-05-08T18:08:16.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109005+0000", 2024-05-08T18:08:16.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2787000000000001e-05 2024-05-08T18:08:16.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109020+0000", 2024-05-08T18:08:16.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4192999999999999e-05 2024-05-08T18:08:16.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116378+0000", 2024-05-08T18:08:16.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073585600000000001 2024-05-08T18:08:16.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116516+0000", 2024-05-08T18:08:16.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000137739 2024-05-08T18:08:16.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116747+0000", 2024-05-08T18:08:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023132799999999999 2024-05-08T18:08:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120140+0000", 2024-05-08T18:08:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033931439999999998 2024-05-08T18:08:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120290+0000", 2024-05-08T18:08:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149765 2024-05-08T18:08:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120369+0000", 2024-05-08T18:08:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.907e-05 2024-05-08T18:08:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120435+0000", 2024-05-08T18:08:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5642999999999995e-05 2024-05-08T18:08:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.625 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.625 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:08:16.625 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.490208078999999, 2024-05-08T18:08:16.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013705973999999999, 2024-05-08T18:08:16.625 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.625 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.625 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.625 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.625 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.625 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.625 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:08:16.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.625 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:08:16.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:08:16.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109039+0000", 2024-05-08T18:08:16.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:08:16.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109044+0000", 2024-05-08T18:08:16.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6699999999999999e-06 2024-05-08T18:08:16.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109054+0000", 2024-05-08T18:08:16.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7100000000000002e-06 2024-05-08T18:08:16.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109064+0000", 2024-05-08T18:08:16.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5740000000000002e-06 2024-05-08T18:08:16.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.117676+0000", 2024-05-08T18:08:16.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086126060000000001 2024-05-08T18:08:16.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.117828+0000", 2024-05-08T18:08:16.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151552 2024-05-08T18:08:16.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118041+0000", 2024-05-08T18:08:16.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000212692 2024-05-08T18:08:16.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120269+0000", 2024-05-08T18:08:16.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022281860000000001 2024-05-08T18:08:16.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122593+0000", 2024-05-08T18:08:16.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023239419999999998 2024-05-08T18:08:16.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122672+0000", 2024-05-08T18:08:16.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9579999999999994e-05 2024-05-08T18:08:16.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122744+0000", 2024-05-08T18:08:16.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1695999999999999e-05 2024-05-08T18:08:16.630 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.630 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.630 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.630 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.630 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:08:16.630 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.490164235999998, 2024-05-08T18:08:16.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016228664, 2024-05-08T18:08:16.630 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.630 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.630 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.631 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.631 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.631 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.631 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 47 2024-05-08T18:08:16.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.631 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:08:16.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:08:16.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109083+0000", 2024-05-08T18:08:16.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4600000000000004e-07 2024-05-08T18:08:16.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109232+0000", 2024-05-08T18:08:16.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149782 2024-05-08T18:08:16.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109257+0000", 2024-05-08T18:08:16.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4856999999999999e-05 2024-05-08T18:08:16.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109272+0000", 2024-05-08T18:08:16.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.503e-05 2024-05-08T18:08:16.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118799+0000", 2024-05-08T18:08:16.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0095264400000000006 2024-05-08T18:08:16.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118947+0000", 2024-05-08T18:08:16.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014848199999999999 2024-05-08T18:08:16.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.119151+0000", 2024-05-08T18:08:16.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020350500000000001 2024-05-08T18:08:16.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121458+0000", 2024-05-08T18:08:16.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002307749 2024-05-08T18:08:16.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125170+0000", 2024-05-08T18:08:16.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037113409999999999 2024-05-08T18:08:16.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125246+0000", 2024-05-08T18:08:16.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6029e-05 2024-05-08T18:08:16.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125310+0000", 2024-05-08T18:08:16.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4702999999999994e-05 2024-05-08T18:08:16.635 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.635 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.635 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.636 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.636 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:08:16.636 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.489944718000004, 2024-05-08T18:08:16.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016305097000000001, 2024-05-08T18:08:16.636 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.636 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.636 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.636 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.636 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.636 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.636 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 48 2024-05-08T18:08:16.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.637 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:08:16.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:08:16.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109303+0000", 2024-05-08T18:08:16.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:16.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109332+0000", 2024-05-08T18:08:16.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9220000000000001e-05 2024-05-08T18:08:16.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109375+0000", 2024-05-08T18:08:16.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2765999999999997e-05 2024-05-08T18:08:16.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109394+0000", 2024-05-08T18:08:16.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8603000000000001e-05 2024-05-08T18:08:16.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120508+0000", 2024-05-08T18:08:16.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011114811 2024-05-08T18:08:16.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120663+0000", 2024-05-08T18:08:16.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000154332 2024-05-08T18:08:16.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120863+0000", 2024-05-08T18:08:16.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019995599999999999 2024-05-08T18:08:16.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125326+0000", 2024-05-08T18:08:16.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044631180000000003 2024-05-08T18:08:16.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125431+0000", 2024-05-08T18:08:16.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010522900000000001 2024-05-08T18:08:16.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125541+0000", 2024-05-08T18:08:16.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109802 2024-05-08T18:08:16.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125606+0000", 2024-05-08T18:08:16.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5549999999999994e-05 2024-05-08T18:08:16.641 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.641 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.641 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.641 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.641 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:08:16.641 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.489824399, 2024-05-08T18:08:16.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016563135, 2024-05-08T18:08:16.642 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.642 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.642 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.642 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.642 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.642 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.642 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 49 2024-05-08T18:08:16.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.642 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:08:16.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:08:16.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109423+0000", 2024-05-08T18:08:16.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5969999999999999e-06 2024-05-08T18:08:16.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109434+0000", 2024-05-08T18:08:16.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.113e-05 2024-05-08T18:08:16.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109455+0000", 2024-05-08T18:08:16.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0873000000000002e-05 2024-05-08T18:08:16.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109469+0000", 2024-05-08T18:08:16.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4039999999999999e-05 2024-05-08T18:08:16.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121566+0000", 2024-05-08T18:08:16.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012096325999999999 2024-05-08T18:08:16.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121725+0000", 2024-05-08T18:08:16.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015932899999999999 2024-05-08T18:08:16.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121981+0000", 2024-05-08T18:08:16.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025583799999999999 2024-05-08T18:08:16.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125680+0000", 2024-05-08T18:08:16.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0036995579999999999 2024-05-08T18:08:16.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125838+0000", 2024-05-08T18:08:16.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015731499999999999 2024-05-08T18:08:16.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125914+0000", 2024-05-08T18:08:16.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6686000000000004e-05 2024-05-08T18:08:16.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125985+0000", 2024-05-08T18:08:16.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0443000000000003e-05 2024-05-08T18:08:16.647 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.647 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.647 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.647 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.647 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:08:16.647 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.489752019999997, 2024-05-08T18:08:16.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016620291999999998, 2024-05-08T18:08:16.647 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.647 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.647 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.647 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.647 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.647 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.647 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 50 2024-05-08T18:08:16.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.648 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:08:16.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:08:16.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109495+0000", 2024-05-08T18:08:16.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.477e-06 2024-05-08T18:08:16.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109692+0000", 2024-05-08T18:08:16.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019638199999999999 2024-05-08T18:08:16.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109733+0000", 2024-05-08T18:08:16.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1093000000000001e-05 2024-05-08T18:08:16.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109745+0000", 2024-05-08T18:08:16.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1715999999999999e-05 2024-05-08T18:08:16.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122839+0000", 2024-05-08T18:08:16.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013094809000000001 2024-05-08T18:08:16.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122980+0000", 2024-05-08T18:08:16.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140829 2024-05-08T18:08:16.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.123239+0000", 2024-05-08T18:08:16.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025834799999999999 2024-05-08T18:08:16.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125810+0000", 2024-05-08T18:08:16.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025717729999999999 2024-05-08T18:08:16.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126001+0000", 2024-05-08T18:08:16.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019013600000000001 2024-05-08T18:08:16.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126064+0000", 2024-05-08T18:08:16.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3301999999999998e-05 2024-05-08T18:08:16.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126114+0000", 2024-05-08T18:08:16.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0426999999999997e-05 2024-05-08T18:08:16.652 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.652 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.652 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.652 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.652 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:08:16.653 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.489472871999993, 2024-05-08T18:08:16.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018305669, 2024-05-08T18:08:16.653 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.653 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.653 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.653 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.653 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.653 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.653 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 51 2024-05-08T18:08:16.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.653 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:08:16.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:08:16.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109775+0000", 2024-05-08T18:08:16.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5269999999999999e-06 2024-05-08T18:08:16.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109786+0000", 2024-05-08T18:08:16.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1296e-05 2024-05-08T18:08:16.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109806+0000", 2024-05-08T18:08:16.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0114000000000001e-05 2024-05-08T18:08:16.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109823+0000", 2024-05-08T18:08:16.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6665999999999999e-05 2024-05-08T18:08:16.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124193+0000", 2024-05-08T18:08:16.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014369916 2024-05-08T18:08:16.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124354+0000", 2024-05-08T18:08:16.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016167899999999999 2024-05-08T18:08:16.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124571+0000", 2024-05-08T18:08:16.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021652800000000001 2024-05-08T18:08:16.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126978+0000", 2024-05-08T18:08:16.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024071679999999999 2024-05-08T18:08:16.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127921+0000", 2024-05-08T18:08:16.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00094277599999999999 2024-05-08T18:08:16.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.128012+0000", 2024-05-08T18:08:16.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0818999999999999e-05 2024-05-08T18:08:16.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.128079+0000", 2024-05-08T18:08:16.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7180000000000004e-05 2024-05-08T18:08:16.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.658 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.658 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.658 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:08:16.658 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.489397765999996, 2024-05-08T18:08:16.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021440811000000001, 2024-05-08T18:08:16.658 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.658 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.658 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.659 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.659 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.659 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.659 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 52 2024-05-08T18:08:16.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.659 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:08:16.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:08:16.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109849+0000", 2024-05-08T18:08:16.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1370000000000001e-06 2024-05-08T18:08:16.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109861+0000", 2024-05-08T18:08:16.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1559999999999999e-05 2024-05-08T18:08:16.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109878+0000", 2024-05-08T18:08:16.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7105999999999999e-05 2024-05-08T18:08:16.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109892+0000", 2024-05-08T18:08:16.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3577000000000001e-05 2024-05-08T18:08:16.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126161+0000", 2024-05-08T18:08:16.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016269458000000001 2024-05-08T18:08:16.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126299+0000", 2024-05-08T18:08:16.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138405 2024-05-08T18:08:16.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126534+0000", 2024-05-08T18:08:16.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000234875 2024-05-08T18:08:16.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127543+0000", 2024-05-08T18:08:16.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001008852 2024-05-08T18:08:16.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131128+0000", 2024-05-08T18:08:16.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035844359999999999 2024-05-08T18:08:16.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131222+0000", 2024-05-08T18:08:16.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3905000000000003e-05 2024-05-08T18:08:16.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131289+0000", 2024-05-08T18:08:16.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7500000000000001e-05 2024-05-08T18:08:16.663 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.663 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.663 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.664 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.664 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:08:16.664 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.249112066999999, 2024-05-08T18:08:16.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010652125, 2024-05-08T18:08:16.664 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.664 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.664 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.664 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.664 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.664 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.664 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 67 2024-05-08T18:08:16.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.664 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:08:16.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:08:16.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350135+0000", 2024-05-08T18:08:16.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.083e-06 2024-05-08T18:08:16.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350141+0000", 2024-05-08T18:08:16.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.178e-06 2024-05-08T18:08:16.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350152+0000", 2024-05-08T18:08:16.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0706999999999999e-05 2024-05-08T18:08:16.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350159+0000", 2024-05-08T18:08:16.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3640000000000001e-06 2024-05-08T18:08:16.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352606+0000", 2024-05-08T18:08:16.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024470379999999999 2024-05-08T18:08:16.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352718+0000", 2024-05-08T18:08:16.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000111366 2024-05-08T18:08:16.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352887+0000", 2024-05-08T18:08:16.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016887900000000001 2024-05-08T18:08:16.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358041+0000", 2024-05-08T18:08:16.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051542940000000002 2024-05-08T18:08:16.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360681+0000", 2024-05-08T18:08:16.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026404639999999999 2024-05-08T18:08:16.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360726+0000", 2024-05-08T18:08:16.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4666999999999998e-05 2024-05-08T18:08:16.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360786+0000", 2024-05-08T18:08:16.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0084999999999998e-05 2024-05-08T18:08:16.669 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.669 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.669 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.669 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.669 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:08:16.669 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.248856678999999, 2024-05-08T18:08:16.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010500438000000001, 2024-05-08T18:08:16.669 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.670 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.670 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.670 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.670 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.670 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.670 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 68 2024-05-08T18:08:16.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.670 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:08:16.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:08:16.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350391+0000", 2024-05-08T18:08:16.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:08:16.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350398+0000", 2024-05-08T18:08:16.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6599999999999995e-06 2024-05-08T18:08:16.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350414+0000", 2024-05-08T18:08:16.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6101000000000001e-05 2024-05-08T18:08:16.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350425+0000", 2024-05-08T18:08:16.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.099e-05 2024-05-08T18:08:16.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353737+0000", 2024-05-08T18:08:16.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033112739999999999 2024-05-08T18:08:16.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353810+0000", 2024-05-08T18:08:16.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3337999999999995e-05 2024-05-08T18:08:16.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353922+0000", 2024-05-08T18:08:16.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112409 2024-05-08T18:08:16.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358114+0000", 2024-05-08T18:08:16.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041912909999999998 2024-05-08T18:08:16.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360798+0000", 2024-05-08T18:08:16.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026845850000000002 2024-05-08T18:08:16.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360838+0000", 2024-05-08T18:08:16.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9619999999999997e-05 2024-05-08T18:08:16.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360890+0000", 2024-05-08T18:08:16.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.185e-05 2024-05-08T18:08:16.675 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.675 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.675 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.676 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.676 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:08:16.676 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.248480459000007, 2024-05-08T18:08:16.676 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010508969999999999, 2024-05-08T18:08:16.676 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.676 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.676 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.676 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.676 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.676 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.677 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 71 2024-05-08T18:08:16.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.677 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:08:16.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:08:16.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:08:16.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.61e-07 2024-05-08T18:08:16.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350771+0000", 2024-05-08T18:08:16.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6720000000000003e-06 2024-05-08T18:08:16.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350781+0000", 2024-05-08T18:08:16.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9450000000000005e-06 2024-05-08T18:08:16.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350786+0000", 2024-05-08T18:08:16.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2530000000000004e-06 2024-05-08T18:08:16.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356065+0000", 2024-05-08T18:08:16.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052789239999999999 2024-05-08T18:08:16.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356174+0000", 2024-05-08T18:08:16.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108564 2024-05-08T18:08:16.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356336+0000", 2024-05-08T18:08:16.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162566 2024-05-08T18:08:16.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358285+0000", 2024-05-08T18:08:16.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001948443 2024-05-08T18:08:16.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361124+0000", 2024-05-08T18:08:16.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028390120000000001 2024-05-08T18:08:16.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361217+0000", 2024-05-08T18:08:16.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3899000000000003e-05 2024-05-08T18:08:16.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361275+0000", 2024-05-08T18:08:16.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7031000000000003e-05 2024-05-08T18:08:16.683 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.683 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.683 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.684 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.684 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:08:16.684 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.248402987000006, 2024-05-08T18:08:16.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010535020000000001, 2024-05-08T18:08:16.684 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.684 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.684 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.684 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.684 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.684 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.684 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 72 2024-05-08T18:08:16.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.685 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:08:16.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:08:16.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350844+0000", 2024-05-08T18:08:16.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:08:16.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350957+0000", 2024-05-08T18:08:16.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112958 2024-05-08T18:08:16.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350966+0000", 2024-05-08T18:08:16.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3440000000000007e-06 2024-05-08T18:08:16.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350972+0000", 2024-05-08T18:08:16.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.37e-06 2024-05-08T18:08:16.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356777+0000", 2024-05-08T18:08:16.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058049199999999999 2024-05-08T18:08:16.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356852+0000", 2024-05-08T18:08:16.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5109000000000002e-05 2024-05-08T18:08:16.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356961+0000", 2024-05-08T18:08:16.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108818 2024-05-08T18:08:16.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359695+0000", 2024-05-08T18:08:16.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002733685 2024-05-08T18:08:16.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361284+0000", 2024-05-08T18:08:16.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015888740000000001 2024-05-08T18:08:16.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361323+0000", 2024-05-08T18:08:16.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9824999999999999e-05 2024-05-08T18:08:16.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361378+0000", 2024-05-08T18:08:16.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4593999999999999e-05 2024-05-08T18:08:16.690 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.690 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.690 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.690 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.690 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:08:16.690 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.248263184999999, 2024-05-08T18:08:16.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01225805, 2024-05-08T18:08:16.691 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.691 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.691 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.691 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.691 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.691 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.691 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 73 2024-05-08T18:08:16.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.691 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:08:16.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:08:16.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:08:16.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0999999999999999e-07 2024-05-08T18:08:16.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350987+0000", 2024-05-08T18:08:16.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3529999999999999e-06 2024-05-08T18:08:16.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350994+0000", 2024-05-08T18:08:16.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0840000000000003e-06 2024-05-08T18:08:16.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350998+0000", 2024-05-08T18:08:16.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.194e-06 2024-05-08T18:08:16.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358336+0000", 2024-05-08T18:08:16.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073376070000000003 2024-05-08T18:08:16.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358456+0000", 2024-05-08T18:08:16.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012042199999999999 2024-05-08T18:08:16.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358615+0000", 2024-05-08T18:08:16.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015928399999999999 2024-05-08T18:08:16.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.362117+0000", 2024-05-08T18:08:16.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035021039999999998 2024-05-08T18:08:16.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363139+0000", 2024-05-08T18:08:16.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010220349999999999 2024-05-08T18:08:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363181+0000", 2024-05-08T18:08:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1465999999999999e-05 2024-05-08T18:08:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363241+0000", 2024-05-08T18:08:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9991000000000002e-05 2024-05-08T18:08:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.697 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.697 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.697 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:08:16.697 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.248238368000003, 2024-05-08T18:08:16.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012698229, 2024-05-08T18:08:16.697 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.697 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.697 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.697 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.697 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.698 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.698 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 74 2024-05-08T18:08:16.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.698 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:08:16.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:08:16.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:08:16.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4000000000000002e-07 2024-05-08T18:08:16.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351013+0000", 2024-05-08T18:08:16.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8239999999999999e-06 2024-05-08T18:08:16.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351020+0000", 2024-05-08T18:08:16.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.52e-06 2024-05-08T18:08:16.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351025+0000", 2024-05-08T18:08:16.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3499999999999999e-06 2024-05-08T18:08:16.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359063+0000", 2024-05-08T18:08:16.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0080381800000000007 2024-05-08T18:08:16.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359140+0000", 2024-05-08T18:08:16.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7225999999999995e-05 2024-05-08T18:08:16.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359256+0000", 2024-05-08T18:08:16.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011537899999999999 2024-05-08T18:08:16.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363249+0000", 2024-05-08T18:08:16.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039937089999999998 2024-05-08T18:08:16.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363584+0000", 2024-05-08T18:08:16.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033516500000000001 2024-05-08T18:08:16.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363654+0000", 2024-05-08T18:08:16.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9093999999999999e-05 2024-05-08T18:08:16.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363706+0000", 2024-05-08T18:08:16.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2342000000000001e-05 2024-05-08T18:08:16.703 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.703 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.703 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.703 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.704 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:08:16.704 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.248200108000006, 2024-05-08T18:08:16.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015677229000000001, 2024-05-08T18:08:16.704 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.704 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.704 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.704 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.704 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.704 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.704 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 75 2024-05-08T18:08:16.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.704 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:08:16.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:08:16.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:08:16.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1699999999999999e-07 2024-05-08T18:08:16.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351141+0000", 2024-05-08T18:08:16.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4661999999999996e-05 2024-05-08T18:08:16.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351151+0000", 2024-05-08T18:08:16.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0084e-05 2024-05-08T18:08:16.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351160+0000", 2024-05-08T18:08:16.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2490000000000007e-06 2024-05-08T18:08:16.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359748+0000", 2024-05-08T18:08:16.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0085879849999999994 2024-05-08T18:08:16.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359820+0000", 2024-05-08T18:08:16.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2081000000000003e-05 2024-05-08T18:08:16.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359928+0000", 2024-05-08T18:08:16.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107157 2024-05-08T18:08:16.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363254+0000", 2024-05-08T18:08:16.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033268579999999998 2024-05-08T18:08:16.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366611+0000", 2024-05-08T18:08:16.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033564179999999999 2024-05-08T18:08:16.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366672+0000", 2024-05-08T18:08:16.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0714999999999997e-05 2024-05-08T18:08:16.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366723+0000", 2024-05-08T18:08:16.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1603e-05 2024-05-08T18:08:16.710 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.710 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.710 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.710 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.710 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:08:16.710 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.248075607999994, 2024-05-08T18:08:16.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015696418, 2024-05-08T18:08:16.710 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.711 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.711 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.711 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.711 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.711 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.711 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 76 2024-05-08T18:08:16.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.711 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:08:16.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:08:16.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351171+0000", 2024-05-08T18:08:16.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4600000000000004e-07 2024-05-08T18:08:16.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351174+0000", 2024-05-08T18:08:16.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2030000000000001e-06 2024-05-08T18:08:16.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351179+0000", 2024-05-08T18:08:16.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2079999999999999e-06 2024-05-08T18:08:16.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351184+0000", 2024-05-08T18:08:16.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3120000000000004e-06 2024-05-08T18:08:16.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361430+0000", 2024-05-08T18:08:16.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010246175 2024-05-08T18:08:16.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361545+0000", 2024-05-08T18:08:16.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115139 2024-05-08T18:08:16.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361712+0000", 2024-05-08T18:08:16.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000166491 2024-05-08T18:08:16.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363473+0000", 2024-05-08T18:08:16.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017610799999999999 2024-05-08T18:08:16.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366769+0000", 2024-05-08T18:08:16.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032964880000000002 2024-05-08T18:08:16.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366811+0000", 2024-05-08T18:08:16.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2296000000000003e-05 2024-05-08T18:08:16.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366867+0000", 2024-05-08T18:08:16.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5380000000000002e-05 2024-05-08T18:08:16.716 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.716 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.716 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.717 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:16.717 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:08:16.717 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 72.897147638999996, 2024-05-08T18:08:16.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010497067000000001, 2024-05-08T18:08:16.717 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:16.717 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:16.717 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:16.717 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:16.717 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:16.717 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:16.717 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 94 2024-05-08T18:08:16.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.717 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:16.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:16.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:08:16.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:16.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:08:16.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:16.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:16.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702099+0000", 2024-05-08T18:08:16.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4099999999999999e-07 2024-05-08T18:08:16.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:16.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702102+0000", 2024-05-08T18:08:16.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6650000000000001e-06 2024-05-08T18:08:16.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:16.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702108+0000", 2024-05-08T18:08:16.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.711e-06 2024-05-08T18:08:16.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:16.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702114+0000", 2024-05-08T18:08:16.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.241e-06 2024-05-08T18:08:16.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:16.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.708666+0000", 2024-05-08T18:08:16.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065511459999999999 2024-05-08T18:08:16.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:16.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.708833+0000", 2024-05-08T18:08:16.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000166966 2024-05-08T18:08:16.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:16.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.709171+0000", 2024-05-08T18:08:16.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033834000000000002 2024-05-08T18:08:16.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:16.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.710246+0000", 2024-05-08T18:08:16.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001074642 2024-05-08T18:08:16.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:16.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712422+0000", 2024-05-08T18:08:16.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021762370000000001 2024-05-08T18:08:16.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:16.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712521+0000", 2024-05-08T18:08:16.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9432999999999995e-05 2024-05-08T18:08:16.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:16.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:16.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:16.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712595+0000", 2024-05-08T18:08:16.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4245000000000005e-05 2024-05-08T18:08:16.723 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.723 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.723 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.723 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:16.723 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:16.723 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:16.724 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:16.725 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:16.725 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:16.726 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:16.726 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:08:16.727 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:16.727 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:16.727 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:16.727 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:16.728 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:16.725+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:16.730 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:16.730 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:16.750 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:16.750 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:16.771 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.1 to 1 (10000) 2024-05-08T18:08:16.776 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:16.776 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:16.778 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:08:16.793 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-08T18:08:16.798 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:16.798 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:16.849 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:16.849 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:16.850 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:16.849+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:16.865 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:08:16.950 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:16.953+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:17.018 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:17.018 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:17.026 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:17.026+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:17.031 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:08:17.128 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:17.129+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:17.194 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:17.194 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:17.207 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:08:17.251 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:17.253+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:17.329 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:17.329+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:17.368 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:17.368 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:17.382 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:08:17.431 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:17.430+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:17.531 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:17.533+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:17.540 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:17.540 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:17.554 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:08:17.632 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:17.630+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:17.700 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:17.701 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:17.714 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:08:17.733 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:17.734+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:17.776 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-05-08T18:08:17.777 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.2 to 1 (10000) 2024-05-08T18:08:17.800 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-08T18:08:17.836 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:17.836 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:17.836 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:17.837+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:17.849 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:08:17.935 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:17.930+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:18.011 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:18.011 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:18.024 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:08:18.071 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:18.073+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:18.137 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:18.137+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:18.149 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:18.149 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:18.162 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:08:18.250 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:18.253+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:18.323 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:18.324 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:18.337 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:08:18.378 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:18.381+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:18.440 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:18.441+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:18.500 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:18.500 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:18.513 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:08:18.542 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:18.542+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:18.643 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:18.645+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:18.676 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:18.676 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:18.690 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:08:18.743 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:18.745+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:18.777 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.3 to 1 (10000) 2024-05-08T18:08:18.804 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-08T18:08:18.820 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:08:18.823 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:18.823 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:18.838 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:08:18.884 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:18.882+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:18.946 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:18.945+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:18.961 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:18.961 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:18.975 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:08:18.990 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:18.990 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:19.007 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:19.007 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:19.023 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:19.023 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:19.039 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:19.040 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:19.046 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:19.045+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:19.058 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:19.059 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:19.078 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:19.096 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:19.096 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:19.116 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:19.116 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:19.143 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:36 5.e 5:71234df9:::zone_info.d0a95a6c-3c84-4d52-915c-e8ea581dfb9b:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:08:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.570248493000001, 2024-05-08T18:08:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028394430000000001, 2024-05-08T18:08:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:08:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:08:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 36 2024-05-08T18:08:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573456+0000", 2024-05-08T18:08:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573467+0000", 2024-05-08T18:08:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1243999999999999e-05 2024-05-08T18:08:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573499+0000", 2024-05-08T18:08:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1343000000000001e-05 2024-05-08T18:08:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573522+0000", 2024-05-08T18:08:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3540000000000002e-05 2024-05-08T18:08:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573634+0000", 2024-05-08T18:08:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112249 2024-05-08T18:08:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573841+0000", 2024-05-08T18:08:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000206407 2024-05-08T18:08:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.574122+0000", 2024-05-08T18:08:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000281475 2024-05-08T18:08:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.575489+0000", 2024-05-08T18:08:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001366391 2024-05-08T18:08:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576157+0000", 2024-05-08T18:08:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00066776200000000002 2024-05-08T18:08:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576234+0000", 2024-05-08T18:08:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7285000000000003e-05 2024-05-08T18:08:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576293+0000", 2024-05-08T18:08:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9556999999999999e-05 2024-05-08T18:08:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.613489299999998, 2024-05-08T18:08:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018560765, 2024-05-08T18:08:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:08:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 43 2024-05-08T18:08:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530217+0000", 2024-05-08T18:08:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:08:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530253+0000", 2024-05-08T18:08:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5621999999999999e-05 2024-05-08T18:08:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530288+0000", 2024-05-08T18:08:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5846999999999997e-05 2024-05-08T18:08:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530314+0000", 2024-05-08T18:08:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5732e-05 2024-05-08T18:08:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530952+0000", 2024-05-08T18:08:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00063739999999999999 2024-05-08T18:08:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530977+0000", 2024-05-08T18:08:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5375e-05 2024-05-08T18:08:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548506+0000", 2024-05-08T18:08:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017528781 2024-05-08T18:08:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548774+0000", 2024-05-08T18:08:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026821199999999999 2024-05-08T18:08:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.531175376, 2024-05-08T18:08:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003496893, 2024-05-08T18:08:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 211 2024-05-08T18:08:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612530+0000", 2024-05-08T18:08:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9490000000000001e-06 2024-05-08T18:08:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612544+0000", 2024-05-08T18:08:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3779e-05 2024-05-08T18:08:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612578+0000", 2024-05-08T18:08:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4421000000000001e-05 2024-05-08T18:08:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612596+0000", 2024-05-08T18:08:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7435000000000002e-05 2024-05-08T18:08:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612718+0000", 2024-05-08T18:08:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012218600000000001 2024-05-08T18:08:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612951+0000", 2024-05-08T18:08:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000232768 2024-05-08T18:08:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.613370+0000", 2024-05-08T18:08:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041921200000000002 2024-05-08T18:08:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.614840+0000", 2024-05-08T18:08:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014703679999999999 2024-05-08T18:08:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615860+0000", 2024-05-08T18:08:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010198220000000001 2024-05-08T18:08:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615954+0000", 2024-05-08T18:08:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4419000000000005e-05 2024-05-08T18:08:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.616024+0000", 2024-05-08T18:08:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9534000000000002e-05 2024-05-08T18:08:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.454485693999999, 2024-05-08T18:08:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035800939999999998, 2024-05-08T18:08:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 232 2024-05-08T18:08:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689219+0000", 2024-05-08T18:08:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4490000000000002e-06 2024-05-08T18:08:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689232+0000", 2024-05-08T18:08:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3183000000000001e-05 2024-05-08T18:08:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689263+0000", 2024-05-08T18:08:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400999999999999e-05 2024-05-08T18:08:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689279+0000", 2024-05-08T18:08:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6078000000000001e-05 2024-05-08T18:08:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689401+0000", 2024-05-08T18:08:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012243000000000001 2024-05-08T18:08:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689656+0000", 2024-05-08T18:08:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431899999999998 2024-05-08T18:08:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.690103+0000", 2024-05-08T18:08:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044706299999999999 2024-05-08T18:08:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.691780+0000", 2024-05-08T18:08:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016774209999999999 2024-05-08T18:08:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692634+0000", 2024-05-08T18:08:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085346 2024-05-08T18:08:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692728+0000", 2024-05-08T18:08:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4429e-05 2024-05-08T18:08:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692797+0000", 2024-05-08T18:08:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8861000000000004e-05 2024-05-08T18:08:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:267 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.429840716000001, 2024-05-08T18:08:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040291739999999999, 2024-05-08T18:08:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 267 2024-05-08T18:08:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713863+0000", 2024-05-08T18:08:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5200000000000001e-06 2024-05-08T18:08:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713873+0000", 2024-05-08T18:08:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9089999999999995e-06 2024-05-08T18:08:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713896+0000", 2024-05-08T18:08:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2595e-05 2024-05-08T18:08:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713914+0000", 2024-05-08T18:08:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7869000000000001e-05 2024-05-08T18:08:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714048+0000", 2024-05-08T18:08:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134802 2024-05-08T18:08:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714278+0000", 2024-05-08T18:08:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022994399999999999 2024-05-08T18:08:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714777+0000", 2024-05-08T18:08:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049880499999999995 2024-05-08T18:08:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.715976+0000", 2024-05-08T18:08:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011991110000000001 2024-05-08T18:08:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717646+0000", 2024-05-08T18:08:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016699989999999999 2024-05-08T18:08:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717790+0000", 2024-05-08T18:08:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014359799999999999 2024-05-08T18:08:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717891+0000", 2024-05-08T18:08:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101022 2024-05-08T18:08:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:308 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.422473476, 2024-05-08T18:08:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031672779999999999, 2024-05-08T18:08:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721230+0000", 2024-05-08T18:08:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:08:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721241+0000", 2024-05-08T18:08:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0942e-05 2024-05-08T18:08:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721265+0000", 2024-05-08T18:08:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3371e-05 2024-05-08T18:08:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721278+0000", 2024-05-08T18:08:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3586e-05 2024-05-08T18:08:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721399+0000", 2024-05-08T18:08:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012092 2024-05-08T18:08:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721507+0000", 2024-05-08T18:08:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107651 2024-05-08T18:08:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724292+0000", 2024-05-08T18:08:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027851870000000002 2024-05-08T18:08:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724396+0000", 2024-05-08T18:08:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000104114 2024-05-08T18:08:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:495 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.339855575000001, 2024-05-08T18:08:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005951001, 2024-05-08T18:08:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 495 2024-05-08T18:08:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803849+0000", 2024-05-08T18:08:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3580000000000001e-06 2024-05-08T18:08:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803864+0000", 2024-05-08T18:08:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4742999999999999e-05 2024-05-08T18:08:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803895+0000", 2024-05-08T18:08:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0970000000000003e-05 2024-05-08T18:08:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803908+0000", 2024-05-08T18:08:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2588999999999999e-05 2024-05-08T18:08:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804005+0000", 2024-05-08T18:08:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7107000000000004e-05 2024-05-08T18:08:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804291+0000", 2024-05-08T18:08:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028626900000000002 2024-05-08T18:08:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804648+0000", 2024-05-08T18:08:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000356955 2024-05-08T18:08:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805740+0000", 2024-05-08T18:08:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001091905 2024-05-08T18:08:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809636+0000", 2024-05-08T18:08:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389661 2024-05-08T18:08:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809722+0000", 2024-05-08T18:08:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:08:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809798+0000", 2024-05-08T18:08:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5462000000000004e-05 2024-05-08T18:08:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.333244256999997, 2024-05-08T18:08:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051396380000000002, 2024-05-08T18:08:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 504 2024-05-08T18:08:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810460+0000", 2024-05-08T18:08:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:08:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810470+0000", 2024-05-08T18:08:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0222e-05 2024-05-08T18:08:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810495+0000", 2024-05-08T18:08:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4508999999999999e-05 2024-05-08T18:08:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810515+0000", 2024-05-08T18:08:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9998999999999999e-05 2024-05-08T18:08:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810653+0000", 2024-05-08T18:08:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013851099999999999 2024-05-08T18:08:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810782+0000", 2024-05-08T18:08:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128152 2024-05-08T18:08:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811043+0000", 2024-05-08T18:08:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026172400000000002 2024-05-08T18:08:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812164+0000", 2024-05-08T18:08:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001121024 2024-05-08T18:08:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815415+0000", 2024-05-08T18:08:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032510270000000001 2024-05-08T18:08:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815538+0000", 2024-05-08T18:08:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012256999999999999 2024-05-08T18:08:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815598+0000", 2024-05-08T18:08:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9923000000000002e-05 2024-05-08T18:08:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:629 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.224939517000003, 2024-05-08T18:08:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611169999999998, 2024-05-08T18:08:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 629 2024-05-08T18:08:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918765+0000", 2024-05-08T18:08:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5670000000000002e-06 2024-05-08T18:08:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918777+0000", 2024-05-08T18:08:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1635e-05 2024-05-08T18:08:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918808+0000", 2024-05-08T18:08:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1024e-05 2024-05-08T18:08:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918823+0000", 2024-05-08T18:08:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4939e-05 2024-05-08T18:08:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918930+0000", 2024-05-08T18:08:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107144 2024-05-08T18:08:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919147+0000", 2024-05-08T18:08:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021682599999999999 2024-05-08T18:08:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919464+0000", 2024-05-08T18:08:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031716699999999998 2024-05-08T18:08:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.920561+0000", 2024-05-08T18:08:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010970229999999999 2024-05-08T18:08:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921468+0000", 2024-05-08T18:08:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00090726800000000003 2024-05-08T18:08:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921549+0000", 2024-05-08T18:08:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0430000000000001e-05 2024-05-08T18:08:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921624+0000", 2024-05-08T18:08:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5093999999999996e-05 2024-05-08T18:08:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:681 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.184618768999997, 2024-05-08T18:08:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044793259999999996, 2024-05-08T18:08:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 681 2024-05-08T18:08:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959085+0000", 2024-05-08T18:08:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.353e-06 2024-05-08T18:08:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959092+0000", 2024-05-08T18:08:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999999e-06 2024-05-08T18:08:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959113+0000", 2024-05-08T18:08:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0744e-05 2024-05-08T18:08:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959130+0000", 2024-05-08T18:08:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7679000000000001e-05 2024-05-08T18:08:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959217+0000", 2024-05-08T18:08:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6487000000000001e-05 2024-05-08T18:08:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959335+0000", 2024-05-08T18:08:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118476 2024-05-08T18:08:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959598+0000", 2024-05-08T18:08:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000263045 2024-05-08T18:08:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.960551+0000", 2024-05-08T18:08:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095251500000000002 2024-05-08T18:08:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963412+0000", 2024-05-08T18:08:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611800000000001 2024-05-08T18:08:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963498+0000", 2024-05-08T18:08:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6145999999999998e-05 2024-05-08T18:08:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963563+0000", 2024-05-08T18:08:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4701000000000003e-05 2024-05-08T18:08:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.149670333000003, 2024-05-08T18:08:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031621710000000001, 2024-05-08T18:08:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 709 2024-05-08T18:08:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994035+0000", 2024-05-08T18:08:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6460000000000002e-06 2024-05-08T18:08:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994047+0000", 2024-05-08T18:08:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999e-05 2024-05-08T18:08:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994076+0000", 2024-05-08T18:08:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9564e-05 2024-05-08T18:08:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994091+0000", 2024-05-08T18:08:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4696e-05 2024-05-08T18:08:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994239+0000", 2024-05-08T18:08:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014779699999999999 2024-05-08T18:08:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994585+0000", 2024-05-08T18:08:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034605900000000002 2024-05-08T18:08:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.995084+0000", 2024-05-08T18:08:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049904799999999998 2024-05-08T18:08:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.996558+0000", 2024-05-08T18:08:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001474532 2024-05-08T18:08:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997045+0000", 2024-05-08T18:08:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048685900000000002 2024-05-08T18:08:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997127+0000", 2024-05-08T18:08:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1280999999999996e-05 2024-05-08T18:08:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997194+0000", 2024-05-08T18:08:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7689999999999997e-05 2024-05-08T18:08:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.114280946999997, 2024-05-08T18:08:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003066236, 2024-05-08T18:08:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 724 2024-05-08T18:08:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029424+0000", 2024-05-08T18:08:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.503e-06 2024-05-08T18:08:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029437+0000", 2024-05-08T18:08:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3309000000000001e-05 2024-05-08T18:08:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029467+0000", 2024-05-08T18:08:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9677999999999999e-05 2024-05-08T18:08:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029489+0000", 2024-05-08T18:08:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2314999999999999e-05 2024-05-08T18:08:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029600+0000", 2024-05-08T18:08:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110561 2024-05-08T18:08:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029896+0000", 2024-05-08T18:08:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029632200000000001 2024-05-08T18:08:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.030468+0000", 2024-05-08T18:08:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00057224700000000001 2024-05-08T18:08:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.031728+0000", 2024-05-08T18:08:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012595429999999999 2024-05-08T18:08:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032338+0000", 2024-05-08T18:08:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00061006700000000005 2024-05-08T18:08:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032424+0000", 2024-05-08T18:08:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032488+0000", 2024-05-08T18:08:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4210999999999999e-05 2024-05-08T18:08:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.109630533000001, 2024-05-08T18:08:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029269769999999999, 2024-05-08T18:08:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 726 2024-05-08T18:08:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034074+0000", 2024-05-08T18:08:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5900000000000002e-06 2024-05-08T18:08:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034086+0000", 2024-05-08T18:08:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1265e-05 2024-05-08T18:08:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034118+0000", 2024-05-08T18:08:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2341000000000001e-05 2024-05-08T18:08:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034133+0000", 2024-05-08T18:08:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5166e-05 2024-05-08T18:08:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034254+0000", 2024-05-08T18:08:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121033 2024-05-08T18:08:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034492+0000", 2024-05-08T18:08:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023727700000000001 2024-05-08T18:08:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034967+0000", 2024-05-08T18:08:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047522100000000001 2024-05-08T18:08:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036353+0000", 2024-05-08T18:08:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013865800000000001 2024-05-08T18:08:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036841+0000", 2024-05-08T18:08:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048788999999999999 2024-05-08T18:08:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036929+0000", 2024-05-08T18:08:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:08:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036999+0000", 2024-05-08T18:08:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9448000000000003e-05 2024-05-08T18:08:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.106335702999999, 2024-05-08T18:08:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003040662, 2024-05-08T18:08:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 727 2024-05-08T18:08:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037369+0000", 2024-05-08T18:08:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:08:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037378+0000", 2024-05-08T18:08:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5359999999999998e-06 2024-05-08T18:08:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037405+0000", 2024-05-08T18:08:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6588e-05 2024-05-08T18:08:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037418+0000", 2024-05-08T18:08:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3642000000000001e-05 2024-05-08T18:08:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037531+0000", 2024-05-08T18:08:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112304 2024-05-08T18:08:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037785+0000", 2024-05-08T18:08:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025391299999999998 2024-05-08T18:08:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.038112+0000", 2024-05-08T18:08:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000326946 2024-05-08T18:08:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.039316+0000", 2024-05-08T18:08:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012043990000000001 2024-05-08T18:08:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040257+0000", 2024-05-08T18:08:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000941083 2024-05-08T18:08:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040345+0000", 2024-05-08T18:08:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8368999999999994e-05 2024-05-08T18:08:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040407+0000", 2024-05-08T18:08:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1941999999999997e-05 2024-05-08T18:08:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.991670313999997, 2024-05-08T18:08:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028797779999999999, 2024-05-08T18:08:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 777 2024-05-08T18:08:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152034+0000", 2024-05-08T18:08:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2299999999999998e-06 2024-05-08T18:08:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152045+0000", 2024-05-08T18:08:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0266e-05 2024-05-08T18:08:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152076+0000", 2024-05-08T18:08:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1007000000000003e-05 2024-05-08T18:08:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152094+0000", 2024-05-08T18:08:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8148999999999999e-05 2024-05-08T18:08:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152183+0000", 2024-05-08T18:08:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8845999999999996e-05 2024-05-08T18:08:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152308+0000", 2024-05-08T18:08:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012502999999999999 2024-05-08T18:08:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152578+0000", 2024-05-08T18:08:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027080099999999998 2024-05-08T18:08:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154238+0000", 2024-05-08T18:08:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016600180000000001 2024-05-08T18:08:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154714+0000", 2024-05-08T18:08:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000475341 2024-05-08T18:08:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154803+0000", 2024-05-08T18:08:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9566000000000003e-05 2024-05-08T18:08:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154912+0000", 2024-05-08T18:08:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010852400000000001 2024-05-08T18:08:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.748454420999998, 2024-05-08T18:08:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002844437, 2024-05-08T18:08:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 882 2024-05-08T18:08:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395250+0000", 2024-05-08T18:08:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-06 2024-05-08T18:08:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395261+0000", 2024-05-08T18:08:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1046000000000001e-05 2024-05-08T18:08:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395293+0000", 2024-05-08T18:08:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1473999999999997e-05 2024-05-08T18:08:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395307+0000", 2024-05-08T18:08:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4599e-05 2024-05-08T18:08:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395481+0000", 2024-05-08T18:08:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173499 2024-05-08T18:08:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395626+0000", 2024-05-08T18:08:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000145351 2024-05-08T18:08:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395902+0000", 2024-05-08T18:08:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027534499999999997 2024-05-08T18:08:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397118+0000", 2024-05-08T18:08:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012168929999999999 2024-05-08T18:08:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397951+0000", 2024-05-08T18:08:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000832272 2024-05-08T18:08:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398028+0000", 2024-05-08T18:08:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6921000000000004e-05 2024-05-08T18:08:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398092+0000", 2024-05-08T18:08:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4783999999999995e-05 2024-05-08T18:08:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.745393700999998, 2024-05-08T18:08:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002853894, 2024-05-08T18:08:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 883 2024-05-08T18:08:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398311+0000", 2024-05-08T18:08:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398321+0000", 2024-05-08T18:08:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9189999999999994e-06 2024-05-08T18:08:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398346+0000", 2024-05-08T18:08:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5065000000000001e-05 2024-05-08T18:08:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398360+0000", 2024-05-08T18:08:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4171999999999999e-05 2024-05-08T18:08:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398495+0000", 2024-05-08T18:08:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013503199999999999 2024-05-08T18:08:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398716+0000", 2024-05-08T18:08:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220459 2024-05-08T18:08:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.399054+0000", 2024-05-08T18:08:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033806199999999998 2024-05-08T18:08:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.400192+0000", 2024-05-08T18:08:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011389169999999999 2024-05-08T18:08:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401020+0000", 2024-05-08T18:08:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082746199999999995 2024-05-08T18:08:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401099+0000", 2024-05-08T18:08:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9157000000000001e-05 2024-05-08T18:08:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401163+0000", 2024-05-08T18:08:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3498999999999996e-05 2024-05-08T18:08:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.741604864000003, 2024-05-08T18:08:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031354040000000001, 2024-05-08T18:08:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 885 2024-05-08T18:08:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402100+0000", 2024-05-08T18:08:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.063e-06 2024-05-08T18:08:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402110+0000", 2024-05-08T18:08:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0453e-05 2024-05-08T18:08:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402141+0000", 2024-05-08T18:08:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0651000000000002e-05 2024-05-08T18:08:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402162+0000", 2024-05-08T18:08:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1373999999999999e-05 2024-05-08T18:08:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402306+0000", 2024-05-08T18:08:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143492 2024-05-08T18:08:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402562+0000", 2024-05-08T18:08:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025671899999999998 2024-05-08T18:08:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.403047+0000", 2024-05-08T18:08:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048419100000000003 2024-05-08T18:08:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404370+0000", 2024-05-08T18:08:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013231580000000001 2024-05-08T18:08:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404966+0000", 2024-05-08T18:08:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00059601100000000002 2024-05-08T18:08:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405115+0000", 2024-05-08T18:08:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149665 2024-05-08T18:08:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405233+0000", 2024-05-08T18:08:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117627 2024-05-08T18:08:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.644307329, 2024-05-08T18:08:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003251168, 2024-05-08T18:08:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 927 2024-05-08T18:08:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499396+0000", 2024-05-08T18:08:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:08:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499404+0000", 2024-05-08T18:08:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2629999999999997e-06 2024-05-08T18:08:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499423+0000", 2024-05-08T18:08:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9695e-05 2024-05-08T18:08:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499435+0000", 2024-05-08T18:08:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1542999999999999e-05 2024-05-08T18:08:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499545+0000", 2024-05-08T18:08:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110064 2024-05-08T18:08:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499764+0000", 2024-05-08T18:08:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021856499999999999 2024-05-08T18:08:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.500237+0000", 2024-05-08T18:08:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047359499999999999 2024-05-08T18:08:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.501627+0000", 2024-05-08T18:08:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013897860000000001 2024-05-08T18:08:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502484+0000", 2024-05-08T18:08:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085733300000000005 2024-05-08T18:08:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502574+0000", 2024-05-08T18:08:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9939999999999996e-05 2024-05-08T18:08:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502646+0000", 2024-05-08T18:08:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2064000000000007e-05 2024-05-08T18:08:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.640807788000004, 2024-05-08T18:08:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031881129999999998, 2024-05-08T18:08:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 928 2024-05-08T18:08:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502897+0000", 2024-05-08T18:08:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.916e-06 2024-05-08T18:08:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502906+0000", 2024-05-08T18:08:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2699999999999993e-06 2024-05-08T18:08:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502933+0000", 2024-05-08T18:08:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6823999999999999e-05 2024-05-08T18:08:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502946+0000", 2024-05-08T18:08:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3439e-05 2024-05-08T18:08:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503066+0000", 2024-05-08T18:08:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012013700000000001 2024-05-08T18:08:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503399+0000", 2024-05-08T18:08:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033298600000000001 2024-05-08T18:08:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503928+0000", 2024-05-08T18:08:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052877299999999996 2024-05-08T18:08:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505291+0000", 2024-05-08T18:08:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001363319 2024-05-08T18:08:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505933+0000", 2024-05-08T18:08:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064135799999999997 2024-05-08T18:08:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506019+0000", 2024-05-08T18:08:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6649000000000003e-05 2024-05-08T18:08:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506083+0000", 2024-05-08T18:08:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3441999999999993e-05 2024-05-08T18:08:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.256 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:19.257 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:08:19.257 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:19.254+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:19.358 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:19.357+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:19.428 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:19.428 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:19.428 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:19.428 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:19.442 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:08:19.488 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:19.486+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:19.559 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:19.561+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:19.567 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:19.567 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:19.567 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:19.567 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:19.567 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:19.582 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:08:19.659 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:19.661+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:19.752 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:19.752 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:19.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:19.752 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:19.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.752 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:3 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:08:19.753 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:19.753 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.216251415000002, 2024-05-08T18:08:19.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046964590000000001, 2024-05-08T18:08:19.753 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.753 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.753 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:08:19.753 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.753 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:08:19.753 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:08:19.753 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 3 2024-05-08T18:08:19.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.753 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:19.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:19.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534906+0000", 2024-05-08T18:08:19.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1030000000000002e-06 2024-05-08T18:08:19.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534918+0000", 2024-05-08T18:08:19.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1732999999999999e-05 2024-05-08T18:08:19.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534950+0000", 2024-05-08T18:08:19.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1420000000000001e-05 2024-05-08T18:08:19.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534974+0000", 2024-05-08T18:08:19.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4473000000000001e-05 2024-05-08T18:08:19.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.539338+0000", 2024-05-08T18:08:19.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043636719999999999 2024-05-08T18:08:19.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.539600+0000", 2024-05-08T18:08:19.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026205800000000002 2024-05-08T18:08:19.757 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.757 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.757 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.758 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:19.758 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:19.758 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.183177751000002, 2024-05-08T18:08:19.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054299370000000001, 2024-05-08T18:08:19.758 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.758 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.758 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.758 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.758 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.758 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.759 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 48 2024-05-08T18:08:19.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.759 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:19.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:19.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567980+0000", 2024-05-08T18:08:19.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.554e-06 2024-05-08T18:08:19.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567990+0000", 2024-05-08T18:08:19.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0961999999999999e-05 2024-05-08T18:08:19.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568023+0000", 2024-05-08T18:08:19.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441999999999999e-05 2024-05-08T18:08:19.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568042+0000", 2024-05-08T18:08:19.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8760999999999999e-05 2024-05-08T18:08:19.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568165+0000", 2024-05-08T18:08:19.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012333400000000001 2024-05-08T18:08:19.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568426+0000", 2024-05-08T18:08:19.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026132999999999999 2024-05-08T18:08:19.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:19.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568666+0000", 2024-05-08T18:08:19.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024009500000000001 2024-05-08T18:08:19.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.569886+0000", 2024-05-08T18:08:19.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012194790000000001 2024-05-08T18:08:19.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573254+0000", 2024-05-08T18:08:19.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033677109999999998 2024-05-08T18:08:19.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573339+0000", 2024-05-08T18:08:19.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5666000000000003e-05 2024-05-08T18:08:19.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573407+0000", 2024-05-08T18:08:19.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7602999999999996e-05 2024-05-08T18:08:19.764 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.764 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.764 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.765 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94206896343168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:19.765 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:19.765 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.177497588999998, 2024-05-08T18:08:19.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054113640000000001, 2024-05-08T18:08:19.765 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.765 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.765 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.765 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.765 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.765 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.765 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 49 2024-05-08T18:08:19.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.765 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:19.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:19.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573659+0000", 2024-05-08T18:08:19.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.762e-06 2024-05-08T18:08:19.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573667+0000", 2024-05-08T18:08:19.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8120000000000008e-06 2024-05-08T18:08:19.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573693+0000", 2024-05-08T18:08:19.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6057000000000001e-05 2024-05-08T18:08:19.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573710+0000", 2024-05-08T18:08:19.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7555999999999999e-05 2024-05-08T18:08:19.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573851+0000", 2024-05-08T18:08:19.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014109800000000001 2024-05-08T18:08:19.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.574072+0000", 2024-05-08T18:08:19.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022062899999999999 2024-05-08T18:08:19.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:19.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.574500+0000", 2024-05-08T18:08:19.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042798100000000002 2024-05-08T18:08:19.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.575719+0000", 2024-05-08T18:08:19.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001218717 2024-05-08T18:08:19.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578840+0000", 2024-05-08T18:08:19.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031215380000000001 2024-05-08T18:08:19.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578925+0000", 2024-05-08T18:08:19.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5191999999999993e-05 2024-05-08T18:08:19.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579069+0000", 2024-05-08T18:08:19.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143022 2024-05-08T18:08:19.770 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.770 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.770 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.771 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:08:19.771 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:19.771 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.174709610000001, 2024-05-08T18:08:19.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034814389999999998, 2024-05-08T18:08:19.771 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.771 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.771 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.771 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.771 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.771 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.771 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 205 2024-05-08T18:08:19.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.771 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:19.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:19.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576448+0000", 2024-05-08T18:08:19.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7839999999999999e-06 2024-05-08T18:08:19.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576462+0000", 2024-05-08T18:08:19.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4348999999999999e-05 2024-05-08T18:08:19.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576500+0000", 2024-05-08T18:08:19.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7252999999999997e-05 2024-05-08T18:08:19.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576528+0000", 2024-05-08T18:08:19.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8691e-05 2024-05-08T18:08:19.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576686+0000", 2024-05-08T18:08:19.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015810999999999999 2024-05-08T18:08:19.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576927+0000", 2024-05-08T18:08:19.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000240337 2024-05-08T18:08:19.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:19.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.577354+0000", 2024-05-08T18:08:19.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042767499999999997 2024-05-08T18:08:19.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.578866+0000", 2024-05-08T18:08:19.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001511271 2024-05-08T18:08:19.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579762+0000", 2024-05-08T18:08:19.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089618599999999999 2024-05-08T18:08:19.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579858+0000", 2024-05-08T18:08:19.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6686000000000002e-05 2024-05-08T18:08:19.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579927+0000", 2024-05-08T18:08:19.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8096999999999995e-05 2024-05-08T18:08:19.776 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.776 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.776 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.776 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.776 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:19.776 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.106713769999999, 2024-05-08T18:08:19.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035139590000000001, 2024-05-08T18:08:19.777 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.777 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.777 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.777 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.777 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.777 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.777 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 220 2024-05-08T18:08:19.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.777 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:19.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:19.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644444+0000", 2024-05-08T18:08:19.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6759999999999999e-06 2024-05-08T18:08:19.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644455+0000", 2024-05-08T18:08:19.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:08:19.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644487+0000", 2024-05-08T18:08:19.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2199999999999997e-05 2024-05-08T18:08:19.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644503+0000", 2024-05-08T18:08:19.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5452e-05 2024-05-08T18:08:19.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644689+0000", 2024-05-08T18:08:19.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000186541 2024-05-08T18:08:19.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644902+0000", 2024-05-08T18:08:19.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021321299999999999 2024-05-08T18:08:19.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:19.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.645299+0000", 2024-05-08T18:08:19.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039702699999999999 2024-05-08T18:08:19.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647459+0000", 2024-05-08T18:08:19.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021598279999999999 2024-05-08T18:08:19.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647803+0000", 2024-05-08T18:08:19.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034338199999999999 2024-05-08T18:08:19.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647888+0000", 2024-05-08T18:08:19.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5125999999999998e-05 2024-05-08T18:08:19.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647955+0000", 2024-05-08T18:08:19.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7280999999999995e-05 2024-05-08T18:08:19.782 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.782 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.782 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.782 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.782 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:19.782 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.086849250999997, 2024-05-08T18:08:19.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003220367, 2024-05-08T18:08:19.783 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.783 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.783 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.783 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.783 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.783 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.783 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 225 2024-05-08T18:08:19.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.783 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:19.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:19.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664308+0000", 2024-05-08T18:08:19.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:19.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664333+0000", 2024-05-08T18:08:19.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5361e-05 2024-05-08T18:08:19.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664362+0000", 2024-05-08T18:08:19.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8671999999999999e-05 2024-05-08T18:08:19.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664376+0000", 2024-05-08T18:08:19.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4741e-05 2024-05-08T18:08:19.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664541+0000", 2024-05-08T18:08:19.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016484400000000001 2024-05-08T18:08:19.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664767+0000", 2024-05-08T18:08:19.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000226061 2024-05-08T18:08:19.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:19.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.665199+0000", 2024-05-08T18:08:19.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000431674 2024-05-08T18:08:19.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.666428+0000", 2024-05-08T18:08:19.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001228605 2024-05-08T18:08:19.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667367+0000", 2024-05-08T18:08:19.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093924199999999996 2024-05-08T18:08:19.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667461+0000", 2024-05-08T18:08:19.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3762000000000001e-05 2024-05-08T18:08:19.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667526+0000", 2024-05-08T18:08:19.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5254999999999998e-05 2024-05-08T18:08:19.788 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.788 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.788 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.788 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.788 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:19.788 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.054621752999999, 2024-05-08T18:08:19.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037451559999999999, 2024-05-08T18:08:19.788 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.788 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.788 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.788 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.789 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.789 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.789 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 234 2024-05-08T18:08:19.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.789 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:19.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:19.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696535+0000", 2024-05-08T18:08:19.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0760000000000001e-06 2024-05-08T18:08:19.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696546+0000", 2024-05-08T18:08:19.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0556e-05 2024-05-08T18:08:19.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696577+0000", 2024-05-08T18:08:19.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0904000000000001e-05 2024-05-08T18:08:19.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696592+0000", 2024-05-08T18:08:19.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5316e-05 2024-05-08T18:08:19.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696731+0000", 2024-05-08T18:08:19.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138818 2024-05-08T18:08:19.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.697085+0000", 2024-05-08T18:08:19.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00035397800000000002 2024-05-08T18:08:19.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:19.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.697838+0000", 2024-05-08T18:08:19.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00075314800000000003 2024-05-08T18:08:19.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.699440+0000", 2024-05-08T18:08:19.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016023470000000001 2024-05-08T18:08:19.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700067+0000", 2024-05-08T18:08:19.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062698400000000003 2024-05-08T18:08:19.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700161+0000", 2024-05-08T18:08:19.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3762000000000001e-05 2024-05-08T18:08:19.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700278+0000", 2024-05-08T18:08:19.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117267 2024-05-08T18:08:19.794 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.794 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.794 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.794 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:431 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.794 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:19.794 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.989129740999999, 2024-05-08T18:08:19.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040957049999999998, 2024-05-08T18:08:19.794 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.794 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.794 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.794 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.794 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.795 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.795 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 431 2024-05-08T18:08:19.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.795 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:19.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:19.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762027+0000", 2024-05-08T18:08:19.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7889999999999999e-06 2024-05-08T18:08:19.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762036+0000", 2024-05-08T18:08:19.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6029999999999994e-06 2024-05-08T18:08:19.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762061+0000", 2024-05-08T18:08:19.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4831e-05 2024-05-08T18:08:19.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762076+0000", 2024-05-08T18:08:19.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4996e-05 2024-05-08T18:08:19.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.763559+0000", 2024-05-08T18:08:19.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001482501 2024-05-08T18:08:19.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.763747+0000", 2024-05-08T18:08:19.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018864399999999999 2024-05-08T18:08:19.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:19.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.764172+0000", 2024-05-08T18:08:19.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042445900000000002 2024-05-08T18:08:19.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.765292+0000", 2024-05-08T18:08:19.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001120196 2024-05-08T18:08:19.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.765812+0000", 2024-05-08T18:08:19.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052044000000000005 2024-05-08T18:08:19.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.766007+0000", 2024-05-08T18:08:19.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019423500000000001 2024-05-08T18:08:19.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.766121+0000", 2024-05-08T18:08:19.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114011 2024-05-08T18:08:19.799 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.800 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.800 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.800 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.800 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:19.800 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.982472270000002, 2024-05-08T18:08:19.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031982880000000001, 2024-05-08T18:08:19.800 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.800 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.800 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.800 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.800 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.800 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.801 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 438 2024-05-08T18:08:19.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.801 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:19.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:19.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768684+0000", 2024-05-08T18:08:19.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0049999999999999e-06 2024-05-08T18:08:19.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768697+0000", 2024-05-08T18:08:19.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2211e-05 2024-05-08T18:08:19.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768726+0000", 2024-05-08T18:08:19.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8949e-05 2024-05-08T18:08:19.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768743+0000", 2024-05-08T18:08:19.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7478000000000001e-05 2024-05-08T18:08:19.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768852+0000", 2024-05-08T18:08:19.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010889499999999999 2024-05-08T18:08:19.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.769168+0000", 2024-05-08T18:08:19.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031610900000000002 2024-05-08T18:08:19.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:19.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.769542+0000", 2024-05-08T18:08:19.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037368299999999998 2024-05-08T18:08:19.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.770721+0000", 2024-05-08T18:08:19.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001179591 2024-05-08T18:08:19.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771722+0000", 2024-05-08T18:08:19.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001000463 2024-05-08T18:08:19.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771819+0000", 2024-05-08T18:08:19.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6909000000000003e-05 2024-05-08T18:08:19.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771881+0000", 2024-05-08T18:08:19.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1995000000000005e-05 2024-05-08T18:08:19.805 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.805 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.805 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.805 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:477 6.4 e32/26 6:24c8e1ae:gc::gc.19:head v 32'12, mlcod=32'10)", 2024-05-08T18:08:19.805 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:19.805 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.960377242, 2024-05-08T18:08:19.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038511489999999999, 2024-05-08T18:08:19.806 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.806 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.806 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.806 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:19.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:19.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790779+0000", 2024-05-08T18:08:19.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4559999999999999e-06 2024-05-08T18:08:19.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790791+0000", 2024-05-08T18:08:19.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1780000000000001e-05 2024-05-08T18:08:19.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790817+0000", 2024-05-08T18:08:19.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5874999999999999e-05 2024-05-08T18:08:19.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790832+0000", 2024-05-08T18:08:19.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4909000000000001e-05 2024-05-08T18:08:19.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790959+0000", 2024-05-08T18:08:19.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012728199999999999 2024-05-08T18:08:19.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791007+0000", 2024-05-08T18:08:19.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7766000000000003e-05 2024-05-08T18:08:19.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794549+0000", 2024-05-08T18:08:19.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035422959999999999 2024-05-08T18:08:19.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794629+0000", 2024-05-08T18:08:19.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9784999999999996e-05 2024-05-08T18:08:19.809 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.810 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.810 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.810 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:487 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.810 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:19.810 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.955039994000003, 2024-05-08T18:08:19.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046865559999999997, 2024-05-08T18:08:19.810 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.810 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.810 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.810 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.810 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.811 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.811 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 487 2024-05-08T18:08:19.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.811 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:19.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:19.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796116+0000", 2024-05-08T18:08:19.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5650000000000001e-06 2024-05-08T18:08:19.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796124+0000", 2024-05-08T18:08:19.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6909999999999997e-06 2024-05-08T18:08:19.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796143+0000", 2024-05-08T18:08:19.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9483999999999998e-05 2024-05-08T18:08:19.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796154+0000", 2024-05-08T18:08:19.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0416e-05 2024-05-08T18:08:19.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796266+0000", 2024-05-08T18:08:19.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112011 2024-05-08T18:08:19.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796432+0000", 2024-05-08T18:08:19.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016641799999999999 2024-05-08T18:08:19.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:19.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796718+0000", 2024-05-08T18:08:19.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028548000000000001 2024-05-08T18:08:19.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798117+0000", 2024-05-08T18:08:19.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001399151 2024-05-08T18:08:19.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800656+0000", 2024-05-08T18:08:19.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025392689999999998 2024-05-08T18:08:19.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800733+0000", 2024-05-08T18:08:19.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6508000000000007e-05 2024-05-08T18:08:19.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800801+0000", 2024-05-08T18:08:19.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8563000000000001e-05 2024-05-08T18:08:19.815 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.815 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.815 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:489 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.953093496000001, 2024-05-08T18:08:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058220679999999997, 2024-05-08T18:08:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 489 2024-05-08T18:08:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:19.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:19.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798064+0000", 2024-05-08T18:08:19.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:08:19.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798074+0000", 2024-05-08T18:08:19.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0438999999999999e-05 2024-05-08T18:08:19.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798097+0000", 2024-05-08T18:08:19.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3019000000000001e-05 2024-05-08T18:08:19.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798115+0000", 2024-05-08T18:08:19.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7638e-05 2024-05-08T18:08:19.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798230+0000", 2024-05-08T18:08:19.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115375 2024-05-08T18:08:19.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798395+0000", 2024-05-08T18:08:19.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016542099999999999 2024-05-08T18:08:19.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:19.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798633+0000", 2024-05-08T18:08:19.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000237977 2024-05-08T18:08:19.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.799628+0000", 2024-05-08T18:08:19.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00099459099999999996 2024-05-08T18:08:19.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803706+0000", 2024-05-08T18:08:19.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040776199999999997 2024-05-08T18:08:19.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803796+0000", 2024-05-08T18:08:19.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0704000000000004e-05 2024-05-08T18:08:19.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803883+0000", 2024-05-08T18:08:19.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6923999999999996e-05 2024-05-08T18:08:19.821 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.821 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.821 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.821 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:491 6.10 e32/26 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:19.821 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:19.821 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.949870036999997, 2024-05-08T18:08:19.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052480360000000002, 2024-05-08T18:08:19.821 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.821 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.822 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.822 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:19.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:19.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801286+0000", 2024-05-08T18:08:19.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.085e-06 2024-05-08T18:08:19.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801293+0000", 2024-05-08T18:08:19.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.627e-06 2024-05-08T18:08:19.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801311+0000", 2024-05-08T18:08:19.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-05-08T18:08:19.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801320+0000", 2024-05-08T18:08:19.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5710000000000004e-06 2024-05-08T18:08:19.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801401+0000", 2024-05-08T18:08:19.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0798999999999997e-05 2024-05-08T18:08:19.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801439+0000", 2024-05-08T18:08:19.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7994000000000002e-05 2024-05-08T18:08:19.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806447+0000", 2024-05-08T18:08:19.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050077339999999998 2024-05-08T18:08:19.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806533+0000", 2024-05-08T18:08:19.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.577e-05 2024-05-08T18:08:19.825 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.825 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.825 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.825 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:495 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:19.826 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:19.826 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.946333146000001, 2024-05-08T18:08:19.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045481219999999999, 2024-05-08T18:08:19.826 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.826 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.826 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.826 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:19.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:19.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804823+0000", 2024-05-08T18:08:19.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.42e-06 2024-05-08T18:08:19.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804834+0000", 2024-05-08T18:08:19.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0584999999999999e-05 2024-05-08T18:08:19.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804848+0000", 2024-05-08T18:08:19.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:08:19.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804857+0000", 2024-05-08T18:08:19.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.302e-06 2024-05-08T18:08:19.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804967+0000", 2024-05-08T18:08:19.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109543 2024-05-08T18:08:19.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805018+0000", 2024-05-08T18:08:19.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0924000000000002e-05 2024-05-08T18:08:19.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809281+0000", 2024-05-08T18:08:19.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042631479999999996 2024-05-08T18:08:19.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809370+0000", 2024-05-08T18:08:19.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8787000000000002e-05 2024-05-08T18:08:19.829 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.830 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.830 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.830 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:500 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.830 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:19.830 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.944774731999999, 2024-05-08T18:08:19.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061595829999999997, 2024-05-08T18:08:19.830 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.830 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.830 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.830 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.830 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.830 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.831 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 500 2024-05-08T18:08:19.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.831 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:19.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:19.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806382+0000", 2024-05-08T18:08:19.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2709999999999999e-06 2024-05-08T18:08:19.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806395+0000", 2024-05-08T18:08:19.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2782000000000001e-05 2024-05-08T18:08:19.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806419+0000", 2024-05-08T18:08:19.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3841000000000001e-05 2024-05-08T18:08:19.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806437+0000", 2024-05-08T18:08:19.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8318999999999999e-05 2024-05-08T18:08:19.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806554+0000", 2024-05-08T18:08:19.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116507 2024-05-08T18:08:19.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806732+0000", 2024-05-08T18:08:19.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017828200000000001 2024-05-08T18:08:19.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:19.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806986+0000", 2024-05-08T18:08:19.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431100000000001 2024-05-08T18:08:19.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.808032+0000", 2024-05-08T18:08:19.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010455530000000001 2024-05-08T18:08:19.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812373+0000", 2024-05-08T18:08:19.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043410139999999998 2024-05-08T18:08:19.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812485+0000", 2024-05-08T18:08:19.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011234999999999999 2024-05-08T18:08:19.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812540+0000", 2024-05-08T18:08:19.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4353e-05 2024-05-08T18:08:19.835 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.835 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.835 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.835 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:502 6.10 e32/26 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:19.835 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:19.836 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.943601129000001, 2024-05-08T18:08:19.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049263659999999997, 2024-05-08T18:08:19.836 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.836 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.836 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.836 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:19.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:19.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807555+0000", 2024-05-08T18:08:19.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2079999999999999e-06 2024-05-08T18:08:19.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807563+0000", 2024-05-08T18:08:19.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3280000000000006e-06 2024-05-08T18:08:19.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807585+0000", 2024-05-08T18:08:19.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2361000000000002e-05 2024-05-08T18:08:19.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807596+0000", 2024-05-08T18:08:19.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0968000000000001e-05 2024-05-08T18:08:19.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807700+0000", 2024-05-08T18:08:19.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103232 2024-05-08T18:08:19.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807732+0000", 2024-05-08T18:08:19.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2373999999999999e-05 2024-05-08T18:08:19.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812391+0000", 2024-05-08T18:08:19.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046590140000000004 2024-05-08T18:08:19.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812480+0000", 2024-05-08T18:08:19.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8881000000000005e-05 2024-05-08T18:08:19.840 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.840 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.840 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.840 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:504 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'3, mlcod=32'1)", 2024-05-08T18:08:19.840 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:19.840 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.939928324, 2024-05-08T18:08:19.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389472, 2024-05-08T18:08:19.840 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.840 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.840 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.840 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:19.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:19.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811228+0000", 2024-05-08T18:08:19.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8819999999999999e-06 2024-05-08T18:08:19.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811240+0000", 2024-05-08T18:08:19.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1276e-05 2024-05-08T18:08:19.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811266+0000", 2024-05-08T18:08:19.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.601e-05 2024-05-08T18:08:19.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811283+0000", 2024-05-08T18:08:19.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7473e-05 2024-05-08T18:08:19.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811444+0000", 2024-05-08T18:08:19.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000161249 2024-05-08T18:08:19.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811501+0000", 2024-05-08T18:08:19.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6394999999999998e-05 2024-05-08T18:08:19.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815025+0000", 2024-05-08T18:08:19.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003524335 2024-05-08T18:08:19.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815121+0000", 2024-05-08T18:08:19.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6100000000000005e-05 2024-05-08T18:08:19.844 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.844 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.844 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.844 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:505 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.844 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:19.844 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.938299029, 2024-05-08T18:08:19.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007675075, 2024-05-08T18:08:19.844 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.844 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.845 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.845 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.845 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.845 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.845 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 505 2024-05-08T18:08:19.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.845 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:19.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:19.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812857+0000", 2024-05-08T18:08:19.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.621e-06 2024-05-08T18:08:19.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812865+0000", 2024-05-08T18:08:19.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0600000000000008e-06 2024-05-08T18:08:19.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812889+0000", 2024-05-08T18:08:19.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3569000000000001e-05 2024-05-08T18:08:19.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812901+0000", 2024-05-08T18:08:19.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1610000000000001e-05 2024-05-08T18:08:19.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813025+0000", 2024-05-08T18:08:19.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012430399999999999 2024-05-08T18:08:19.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813168+0000", 2024-05-08T18:08:19.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014329699999999999 2024-05-08T18:08:19.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:19.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813419+0000", 2024-05-08T18:08:19.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000250788 2024-05-08T18:08:19.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815462+0000", 2024-05-08T18:08:19.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002042865 2024-05-08T18:08:19.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820385+0000", 2024-05-08T18:08:19.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049229529999999999 2024-05-08T18:08:19.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820462+0000", 2024-05-08T18:08:19.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7101000000000006e-05 2024-05-08T18:08:19.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820531+0000", 2024-05-08T18:08:19.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8906999999999996e-05 2024-05-08T18:08:19.849 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.850 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.850 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.850 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:506 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:19.850 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:19.850 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.937076185999999, 2024-05-08T18:08:19.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006383143, 2024-05-08T18:08:19.850 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.850 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.850 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.850 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:19.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:19.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814081+0000", 2024-05-08T18:08:19.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0080000000000001e-06 2024-05-08T18:08:19.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814094+0000", 2024-05-08T18:08:19.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3407999999999999e-05 2024-05-08T18:08:19.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814125+0000", 2024-05-08T18:08:19.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0688999999999997e-05 2024-05-08T18:08:19.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814142+0000", 2024-05-08T18:08:19.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7192000000000001e-05 2024-05-08T18:08:19.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814245+0000", 2024-05-08T18:08:19.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103164 2024-05-08T18:08:19.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814302+0000", 2024-05-08T18:08:19.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6613999999999997e-05 2024-05-08T18:08:19.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820398+0000", 2024-05-08T18:08:19.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060967620000000004 2024-05-08T18:08:19.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820462+0000", 2024-05-08T18:08:19.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3305999999999993e-05 2024-05-08T18:08:19.854 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.854 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.854 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.854 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:750 6.19 6:9fecf831:::obj_delete_at_hint.0000000057:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:19.854 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:19.854 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.661837814999998, 2024-05-08T18:08:19.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035713440000000002, 2024-05-08T18:08:19.854 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:19.855 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:19.855 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:19.855 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:19.855 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:19.855 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:19.855 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 750 2024-05-08T18:08:19.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.855 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:19.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:19.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:19.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:19.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:19.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:19.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:19.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089318+0000", 2024-05-08T18:08:19.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.446e-06 2024-05-08T18:08:19.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:19.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089325+0000", 2024-05-08T18:08:19.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8560000000000001e-06 2024-05-08T18:08:19.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:19.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089345+0000", 2024-05-08T18:08:19.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9641999999999999e-05 2024-05-08T18:08:19.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:19.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089355+0000", 2024-05-08T18:08:19.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0586e-05 2024-05-08T18:08:19.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:19.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089469+0000", 2024-05-08T18:08:19.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113324 2024-05-08T18:08:19.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:19.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089692+0000", 2024-05-08T18:08:19.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022334500000000001 2024-05-08T18:08:19.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:19.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.090160+0000", 2024-05-08T18:08:19.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00046827799999999998 2024-05-08T18:08:19.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:19.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.091322+0000", 2024-05-08T18:08:19.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001161282 2024-05-08T18:08:19.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:19.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092750+0000", 2024-05-08T18:08:19.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014281299999999999 2024-05-08T18:08:19.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:19.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092829+0000", 2024-05-08T18:08:19.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9376999999999996e-05 2024-05-08T18:08:19.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:19.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:19.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:19.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092888+0000", 2024-05-08T18:08:19.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9077999999999999e-05 2024-05-08T18:08:19.859 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.859 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.860 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.860 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:19.860 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:19.860 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:19.860 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:08:19.862 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.4 to 1 (10000) 2024-05-08T18:08:19.863 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:08:19.863 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:19.858+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:19.863 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-08T18:08:19.961 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:19.958+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:20.035 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:20.036 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:20.036 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:20.036 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:20.050 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:08:20.062 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:20.065+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:20.163 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:20.165+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:20.211 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:20.211 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:20.212 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:20.212 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:20.212 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:20.225 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:08:20.272 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:20.270+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:20.349 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:20.349 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:20.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:20.349 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:08:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.813279864000002, 2024-05-08T18:08:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.032012946, 2024-05-08T18:08:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:08:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:08:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:08:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535484+0000", 2024-05-08T18:08:20.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7929999999999999e-06 2024-05-08T18:08:20.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535500+0000", 2024-05-08T18:08:20.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5226e-05 2024-05-08T18:08:20.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535535+0000", 2024-05-08T18:08:20.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5213000000000003e-05 2024-05-08T18:08:20.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535564+0000", 2024-05-08T18:08:20.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9360999999999999e-05 2024-05-08T18:08:20.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535757+0000", 2024-05-08T18:08:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000193229 2024-05-08T18:08:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:08:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535775+0000", 2024-05-08T18:08:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7098000000000001e-05 2024-05-08T18:08:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556004+0000", 2024-05-08T18:08:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020229068999999999 2024-05-08T18:08:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556036+0000", 2024-05-08T18:08:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1943000000000002e-05 2024-05-08T18:08:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.564721+0000", 2024-05-08T18:08:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086853320000000005 2024-05-08T18:08:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565032+0000", 2024-05-08T18:08:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031121799999999999 2024-05-08T18:08:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565365+0000", 2024-05-08T18:08:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000332744 2024-05-08T18:08:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567305+0000", 2024-05-08T18:08:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00194016 2024-05-08T18:08:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567368+0000", 2024-05-08T18:08:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3342000000000004e-05 2024-05-08T18:08:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567433+0000", 2024-05-08T18:08:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4726000000000003e-05 2024-05-08T18:08:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567494+0000", 2024-05-08T18:08:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0492000000000003e-05 2024-05-08T18:08:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206896342016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:08:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.780862771999999, 2024-05-08T18:08:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026490820000000001, 2024-05-08T18:08:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 47 2024-05-08T18:08:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:08:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:08:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567900+0000", 2024-05-08T18:08:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.03e-06 2024-05-08T18:08:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567909+0000", 2024-05-08T18:08:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0389999999999993e-06 2024-05-08T18:08:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567947+0000", 2024-05-08T18:08:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8013999999999999e-05 2024-05-08T18:08:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567961+0000", 2024-05-08T18:08:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3777999999999999e-05 2024-05-08T18:08:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568066+0000", 2024-05-08T18:08:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105208 2024-05-08T18:08:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568176+0000", 2024-05-08T18:08:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011041599999999999 2024-05-08T18:08:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568443+0000", 2024-05-08T18:08:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000266846 2024-05-08T18:08:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.569612+0000", 2024-05-08T18:08:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001169156 2024-05-08T18:08:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570378+0000", 2024-05-08T18:08:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00076617799999999995 2024-05-08T18:08:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570457+0000", 2024-05-08T18:08:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8750000000000003e-05 2024-05-08T18:08:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570547+0000", 2024-05-08T18:08:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9666999999999994e-05 2024-05-08T18:08:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:08:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.7698155, 2024-05-08T18:08:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051182119999999996, 2024-05-08T18:08:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 54 2024-05-08T18:08:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:08:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:08:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578947+0000", 2024-05-08T18:08:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578957+0000", 2024-05-08T18:08:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6020000000000006e-06 2024-05-08T18:08:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578997+0000", 2024-05-08T18:08:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0663e-05 2024-05-08T18:08:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579016+0000", 2024-05-08T18:08:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8185e-05 2024-05-08T18:08:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579117+0000", 2024-05-08T18:08:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010117599999999999 2024-05-08T18:08:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579252+0000", 2024-05-08T18:08:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013552 2024-05-08T18:08:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579393+0000", 2024-05-08T18:08:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140605 2024-05-08T18:08:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.580414+0000", 2024-05-08T18:08:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010214219999999999 2024-05-08T18:08:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.583866+0000", 2024-05-08T18:08:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034512840000000002 2024-05-08T18:08:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.583946+0000", 2024-05-08T18:08:20.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0406000000000002e-05 2024-05-08T18:08:20.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584063+0000", 2024-05-08T18:08:20.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117199 2024-05-08T18:08:20.370 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.370 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.371 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.371 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206896337408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:20.371 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:08:20.371 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.764528773000002, 2024-05-08T18:08:20.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027716910000000002, 2024-05-08T18:08:20.371 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.371 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 55 2024-05-08T18:08:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:08:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:08:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584234+0000", 2024-05-08T18:08:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9259999999999999e-06 2024-05-08T18:08:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584244+0000", 2024-05-08T18:08:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0369e-05 2024-05-08T18:08:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584270+0000", 2024-05-08T18:08:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5554999999999998e-05 2024-05-08T18:08:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584283+0000", 2024-05-08T18:08:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3039e-05 2024-05-08T18:08:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584384+0000", 2024-05-08T18:08:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000100881 2024-05-08T18:08:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584510+0000", 2024-05-08T18:08:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012627100000000001 2024-05-08T18:08:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584741+0000", 2024-05-08T18:08:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023162899999999999 2024-05-08T18:08:20.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:20.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.585714+0000", 2024-05-08T18:08:20.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00097270500000000003 2024-05-08T18:08:20.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.586818+0000", 2024-05-08T18:08:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00110403 2024-05-08T18:08:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.586908+0000", 2024-05-08T18:08:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9641000000000005e-05 2024-05-08T18:08:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.587003+0000", 2024-05-08T18:08:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5644999999999997e-05 2024-05-08T18:08:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:191 6.5 e29/26 6:a2ace8b3:::data_log.0:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:08:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.664701203999996, 2024-05-08T18:08:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001855095, 2024-05-08T18:08:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:08:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:08:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684061+0000", 2024-05-08T18:08:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:08:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684074+0000", 2024-05-08T18:08:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2479e-05 2024-05-08T18:08:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684104+0000", 2024-05-08T18:08:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0689999999999999e-05 2024-05-08T18:08:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684120+0000", 2024-05-08T18:08:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5996000000000001e-05 2024-05-08T18:08:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684221+0000", 2024-05-08T18:08:20.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000100647 2024-05-08T18:08:20.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684273+0000", 2024-05-08T18:08:20.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2074999999999999e-05 2024-05-08T18:08:20.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.685828+0000", 2024-05-08T18:08:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015553030000000001 2024-05-08T18:08:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.685914+0000", 2024-05-08T18:08:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5927999999999995e-05 2024-05-08T18:08:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.384 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:20.384 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:20.384 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.749662940999997, 2024-05-08T18:08:20.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003347367, 2024-05-08T18:08:20.384 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.384 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.384 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.385 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:20.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:20.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5300000000000003e-07 2024-05-08T18:08:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599110+0000", 2024-05-08T18:08:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1826e-05 2024-05-08T18:08:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599159+0000", 2024-05-08T18:08:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8322000000000003e-05 2024-05-08T18:08:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599180+0000", 2024-05-08T18:08:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1682e-05 2024-05-08T18:08:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599427+0000", 2024-05-08T18:08:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024721299999999998 2024-05-08T18:08:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599475+0000", 2024-05-08T18:08:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7299000000000002e-05 2024-05-08T18:08:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.602326+0000", 2024-05-08T18:08:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028516409999999998 2024-05-08T18:08:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.602445+0000", 2024-05-08T18:08:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011853099999999999 2024-05-08T18:08:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:231 6.1f e32/26 6:fde4dd55:gc::gc.26:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.662009843, 2024-05-08T18:08:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017909390000000001, 2024-05-08T18:08:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5000000000000002e-07 2024-05-08T18:08:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686785+0000", 2024-05-08T18:08:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3438000000000001e-05 2024-05-08T18:08:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686810+0000", 2024-05-08T18:08:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4858000000000002e-05 2024-05-08T18:08:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686823+0000", 2024-05-08T18:08:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3417999999999999e-05 2024-05-08T18:08:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686989+0000", 2024-05-08T18:08:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016624700000000001 2024-05-08T18:08:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.687023+0000", 2024-05-08T18:08:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3396999999999999e-05 2024-05-08T18:08:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.688453+0000", 2024-05-08T18:08:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001430675 2024-05-08T18:08:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.688542+0000", 2024-05-08T18:08:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8256000000000003e-05 2024-05-08T18:08:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:292 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:08:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.628623124000001, 2024-05-08T18:08:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020064839999999998, 2024-05-08T18:08:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:08:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:08:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720170+0000", 2024-05-08T18:08:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3090999999999999e-05 2024-05-08T18:08:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720189+0000", 2024-05-08T18:08:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8077999999999999e-05 2024-05-08T18:08:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720222+0000", 2024-05-08T18:08:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3111000000000002e-05 2024-05-08T18:08:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720241+0000", 2024-05-08T18:08:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9528e-05 2024-05-08T18:08:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720452+0000", 2024-05-08T18:08:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021077300000000001 2024-05-08T18:08:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720505+0000", 2024-05-08T18:08:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2605000000000002e-05 2024-05-08T18:08:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.722038+0000", 2024-05-08T18:08:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015334630000000001 2024-05-08T18:08:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.722144+0000", 2024-05-08T18:08:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010583500000000001 2024-05-08T18:08:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:328 6.1 e32/26 6:856b9b26:reshard::reshard.0000000002:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.623194832999999, 2024-05-08T18:08:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0018910070000000001, 2024-05-08T18:08:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3e-07 2024-05-08T18:08:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725576+0000", 2024-05-08T18:08:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5759999999999995e-06 2024-05-08T18:08:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725622+0000", 2024-05-08T18:08:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6196000000000003e-05 2024-05-08T18:08:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725642+0000", 2024-05-08T18:08:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9947999999999999e-05 2024-05-08T18:08:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.726011+0000", 2024-05-08T18:08:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036876699999999999 2024-05-08T18:08:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.726062+0000", 2024-05-08T18:08:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1062e-05 2024-05-08T18:08:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.727367+0000", 2024-05-08T18:08:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001304869 2024-05-08T18:08:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.727457+0000", 2024-05-08T18:08:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9858999999999995e-05 2024-05-08T18:08:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:382 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'6, mlcod=32'4)", 2024-05-08T18:08:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:08:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.610230229000003, 2024-05-08T18:08:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023570779999999999, 2024-05-08T18:08:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:08:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:08:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738532+0000", 2024-05-08T18:08:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.95e-06 2024-05-08T18:08:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738548+0000", 2024-05-08T18:08:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5911000000000001e-05 2024-05-08T18:08:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738583+0000", 2024-05-08T18:08:20.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4830999999999999e-05 2024-05-08T18:08:20.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738605+0000", 2024-05-08T18:08:20.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2005e-05 2024-05-08T18:08:20.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738747+0000", 2024-05-08T18:08:20.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014162800000000001 2024-05-08T18:08:20.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738800+0000", 2024-05-08T18:08:20.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2918999999999999e-05 2024-05-08T18:08:20.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.740802+0000", 2024-05-08T18:08:20.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020026150000000001 2024-05-08T18:08:20.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.740887+0000", 2024-05-08T18:08:20.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5218999999999998e-05 2024-05-08T18:08:20.407 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.407 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.407 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.407 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:394 6.c e32/26 6:3677c228:::obj_delete_at_hint.0000000006:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:20.407 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:08:20.407 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.605565018, 2024-05-08T18:08:20.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026335320000000001, 2024-05-08T18:08:20.407 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.407 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.407 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.407 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:08:20.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:08:20.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743197+0000", 2024-05-08T18:08:20.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.81e-06 2024-05-08T18:08:20.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743210+0000", 2024-05-08T18:08:20.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2354999999999999e-05 2024-05-08T18:08:20.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743237+0000", 2024-05-08T18:08:20.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7328e-05 2024-05-08T18:08:20.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743256+0000", 2024-05-08T18:08:20.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8712e-05 2024-05-08T18:08:20.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743394+0000", 2024-05-08T18:08:20.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138009 2024-05-08T18:08:20.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743449+0000", 2024-05-08T18:08:20.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5371000000000002e-05 2024-05-08T18:08:20.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745754+0000", 2024-05-08T18:08:20.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002304567 2024-05-08T18:08:20.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745829+0000", 2024-05-08T18:08:20.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.538e-05 2024-05-08T18:08:20.411 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.411 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.411 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.411 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:392 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'7, mlcod=32'5)", 2024-05-08T18:08:20.411 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:08:20.411 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.605112499000001, 2024-05-08T18:08:20.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022345389999999998, 2024-05-08T18:08:20.411 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.411 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.411 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.412 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:08:20.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:08:20.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743650+0000", 2024-05-08T18:08:20.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1260000000000001e-06 2024-05-08T18:08:20.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743666+0000", 2024-05-08T18:08:20.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5696e-05 2024-05-08T18:08:20.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743696+0000", 2024-05-08T18:08:20.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0037999999999999e-05 2024-05-08T18:08:20.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743716+0000", 2024-05-08T18:08:20.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0251e-05 2024-05-08T18:08:20.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743838+0000", 2024-05-08T18:08:20.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012187 2024-05-08T18:08:20.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743886+0000", 2024-05-08T18:08:20.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8053000000000002e-05 2024-05-08T18:08:20.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745805+0000", 2024-05-08T18:08:20.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019189509999999999 2024-05-08T18:08:20.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745883+0000", 2024-05-08T18:08:20.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7553999999999996e-05 2024-05-08T18:08:20.415 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.415 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.415 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.415 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:453 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:20.415 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:08:20.416 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.570947318999998, 2024-05-08T18:08:20.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017625729999999999, 2024-05-08T18:08:20.416 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.416 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.416 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.416 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:08:20.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:08:20.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777815+0000", 2024-05-08T18:08:20.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6130000000000001e-06 2024-05-08T18:08:20.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777826+0000", 2024-05-08T18:08:20.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:08:20.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777852+0000", 2024-05-08T18:08:20.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6787999999999998e-05 2024-05-08T18:08:20.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777865+0000", 2024-05-08T18:08:20.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2882e-05 2024-05-08T18:08:20.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777961+0000", 2024-05-08T18:08:20.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5280999999999998e-05 2024-05-08T18:08:20.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777993+0000", 2024-05-08T18:08:20.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1931999999999999e-05 2024-05-08T18:08:20.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779496+0000", 2024-05-08T18:08:20.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001503307 2024-05-08T18:08:20.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779576+0000", 2024-05-08T18:08:20.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9887000000000003e-05 2024-05-08T18:08:20.419 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.419 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.419 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.420 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:460 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'3, mlcod=32'1)", 2024-05-08T18:08:20.420 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:08:20.420 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.569611948999999, 2024-05-08T18:08:20.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032252579999999999, 2024-05-08T18:08:20.420 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.420 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.420 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.420 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:08:20.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:08:20.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779150+0000", 2024-05-08T18:08:20.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:20.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779161+0000", 2024-05-08T18:08:20.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0906e-05 2024-05-08T18:08:20.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779186+0000", 2024-05-08T18:08:20.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4861000000000001e-05 2024-05-08T18:08:20.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779198+0000", 2024-05-08T18:08:20.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1969e-05 2024-05-08T18:08:20.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779334+0000", 2024-05-08T18:08:20.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000135513 2024-05-08T18:08:20.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779396+0000", 2024-05-08T18:08:20.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2815000000000001e-05 2024-05-08T18:08:20.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.782247+0000", 2024-05-08T18:08:20.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028502200000000001 2024-05-08T18:08:20.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.782374+0000", 2024-05-08T18:08:20.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012726400000000001 2024-05-08T18:08:20.423 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.424 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.424 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.424 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:463 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-05-08T18:08:20.424 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:08:20.424 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.567265843999998, 2024-05-08T18:08:20.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0036423610000000002, 2024-05-08T18:08:20.424 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.424 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.424 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.424 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:08:20.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:08:20.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781497+0000", 2024-05-08T18:08:20.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.917e-06 2024-05-08T18:08:20.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781509+0000", 2024-05-08T18:08:20.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2227e-05 2024-05-08T18:08:20.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781539+0000", 2024-05-08T18:08:20.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0218000000000001e-05 2024-05-08T18:08:20.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781558+0000", 2024-05-08T18:08:20.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8918000000000001e-05 2024-05-08T18:08:20.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781660+0000", 2024-05-08T18:08:20.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101584 2024-05-08T18:08:20.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781697+0000", 2024-05-08T18:08:20.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7360000000000001e-05 2024-05-08T18:08:20.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785059+0000", 2024-05-08T18:08:20.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033618810000000002 2024-05-08T18:08:20.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785137+0000", 2024-05-08T18:08:20.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8256000000000004e-05 2024-05-08T18:08:20.428 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.428 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.428 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.428 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:466 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:20.428 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:08:20.428 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.565145592, 2024-05-08T18:08:20.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002137496, 2024-05-08T18:08:20.428 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.428 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.429 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.429 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:08:20.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:08:20.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783617+0000", 2024-05-08T18:08:20.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8330000000000001e-06 2024-05-08T18:08:20.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:08:20.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5872e-05 2024-05-08T18:08:20.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783668+0000", 2024-05-08T18:08:20.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5880999999999997e-05 2024-05-08T18:08:20.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783688+0000", 2024-05-08T18:08:20.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9485000000000001e-05 2024-05-08T18:08:20.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783819+0000", 2024-05-08T18:08:20.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013098600000000001 2024-05-08T18:08:20.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783865+0000", 2024-05-08T18:08:20.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5711000000000003e-05 2024-05-08T18:08:20.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785680+0000", 2024-05-08T18:08:20.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001815374 2024-05-08T18:08:20.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785752+0000", 2024-05-08T18:08:20.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2354000000000006e-05 2024-05-08T18:08:20.432 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.432 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.432 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.432 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:469 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'10, mlcod=32'8)", 2024-05-08T18:08:20.432 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:08:20.432 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.561854603, 2024-05-08T18:08:20.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002120242, 2024-05-08T18:08:20.433 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.433 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.433 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.433 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:08:20.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:08:20.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786907+0000", 2024-05-08T18:08:20.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.412e-06 2024-05-08T18:08:20.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786917+0000", 2024-05-08T18:08:20.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3489999999999998e-06 2024-05-08T18:08:20.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786940+0000", 2024-05-08T18:08:20.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3019000000000001e-05 2024-05-08T18:08:20.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786951+0000", 2024-05-08T18:08:20.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0956e-05 2024-05-08T18:08:20.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.787229+0000", 2024-05-08T18:08:20.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027875000000000003 2024-05-08T18:08:20.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.787263+0000", 2024-05-08T18:08:20.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3563999999999999e-05 2024-05-08T18:08:20.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.788886+0000", 2024-05-08T18:08:20.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016228320000000001 2024-05-08T18:08:20.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.789026+0000", 2024-05-08T18:08:20.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014035999999999999 2024-05-08T18:08:20.436 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.436 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.436 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.436 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:478 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'11, mlcod=32'9)", 2024-05-08T18:08:20.437 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:08:20.437 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.557742990000001, 2024-05-08T18:08:20.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037403340000000001, 2024-05-08T18:08:20.437 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.437 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.437 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.437 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:08:20.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:08:20.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791019+0000", 2024-05-08T18:08:20.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5999999999999999e-06 2024-05-08T18:08:20.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791032+0000", 2024-05-08T18:08:20.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3021e-05 2024-05-08T18:08:20.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791057+0000", 2024-05-08T18:08:20.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4600000000000002e-05 2024-05-08T18:08:20.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791071+0000", 2024-05-08T18:08:20.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4756000000000001e-05 2024-05-08T18:08:20.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791185+0000", 2024-05-08T18:08:20.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011333200000000001 2024-05-08T18:08:20.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791234+0000", 2024-05-08T18:08:20.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8695e-05 2024-05-08T18:08:20.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794662+0000", 2024-05-08T18:08:20.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034282520000000001 2024-05-08T18:08:20.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794758+0000", 2024-05-08T18:08:20.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6077999999999997e-05 2024-05-08T18:08:20.440 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.440 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.440 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.441 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:829 6.5 e32/26 6:a77c5545:::obj_delete_at_hint.0000000084:head v 32'12, mlcod=32'10)", 2024-05-08T18:08:20.441 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:08:20.441 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.076573975999999, 2024-05-08T18:08:20.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017254, 2024-05-08T18:08:20.441 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.441 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.441 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.441 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:08:20.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:08:20.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272188+0000", 2024-05-08T18:08:20.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7269999999999999e-06 2024-05-08T18:08:20.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272229+0000", 2024-05-08T18:08:20.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0256999999999998e-05 2024-05-08T18:08:20.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272261+0000", 2024-05-08T18:08:20.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2017000000000002e-05 2024-05-08T18:08:20.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272275+0000", 2024-05-08T18:08:20.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4532000000000001e-05 2024-05-08T18:08:20.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272437+0000", 2024-05-08T18:08:20.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016199699999999999 2024-05-08T18:08:20.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272501+0000", 2024-05-08T18:08:20.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3805000000000003e-05 2024-05-08T18:08:20.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.273824+0000", 2024-05-08T18:08:20.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001323039 2024-05-08T18:08:20.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.273912+0000", 2024-05-08T18:08:20.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8026000000000001e-05 2024-05-08T18:08:20.444 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.445 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.445 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.445 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:937 6.1f e32/26 6:fd6b5df8:::obj_delete_at_hint.0000000120:head v 32'10, mlcod=32'8)", 2024-05-08T18:08:20.445 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:08:20.445 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.825337861000001, 2024-05-08T18:08:20.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019919009999999999, 2024-05-08T18:08:20.445 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.445 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.445 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.445 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:08:20.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:08:20.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523425+0000", 2024-05-08T18:08:20.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8560000000000001e-06 2024-05-08T18:08:20.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523437+0000", 2024-05-08T18:08:20.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2833000000000001e-05 2024-05-08T18:08:20.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523464+0000", 2024-05-08T18:08:20.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6621000000000001e-05 2024-05-08T18:08:20.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523477+0000", 2024-05-08T18:08:20.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2758999999999999e-05 2024-05-08T18:08:20.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523612+0000", 2024-05-08T18:08:20.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013525899999999999 2024-05-08T18:08:20.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523679+0000", 2024-05-08T18:08:20.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6964000000000005e-05 2024-05-08T18:08:20.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.525312+0000", 2024-05-08T18:08:20.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016331 2024-05-08T18:08:20.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.525415+0000", 2024-05-08T18:08:20.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000102509 2024-05-08T18:08:20.449 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.449 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.449 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.449 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.449 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.449 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:20.450 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:08:20.451 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:20.453+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:20.551 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:20.546+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:20.620 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:20.620 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:20.621 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:20.621 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:20.634 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:08:20.652 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:20.653+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:20.752 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:20.750+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:20.801 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:20.801 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:20.801 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:20.801 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:20.801 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:20.802 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-05-08T18:08:20.808 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.5 to 1 (10000) 2024-05-08T18:08:20.817 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:08:20.839 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-08T18:08:20.886 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:20.889+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:20.955 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:20.950+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:20.981 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:20.981 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:20.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:20.981 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:20.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.981 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:20.981 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:08:20.981 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.164750056000003, 2024-05-08T18:08:20.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.16213206199999999, 2024-05-08T18:08:20.981 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.981 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.981 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.982 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:20.982 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:20.982 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:20.982 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1 2024-05-08T18:08:20.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.982 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:08:20.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:08:20.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814494+0000", 2024-05-08T18:08:20.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:08:20.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814520+0000", 2024-05-08T18:08:20.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-05 2024-05-08T18:08:20.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814543+0000", 2024-05-08T18:08:20.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2353000000000001e-05 2024-05-08T18:08:20.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814563+0000", 2024-05-08T18:08:20.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.048e-05 2024-05-08T18:08:20.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814677+0000", 2024-05-08T18:08:20.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113632 2024-05-08T18:08:20.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:20.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814705+0000", 2024-05-08T18:08:20.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8626999999999999e-05 2024-05-08T18:08:20.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971115+0000", 2024-05-08T18:08:20.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.156409825 2024-05-08T18:08:20.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971438+0000", 2024-05-08T18:08:20.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00032289200000000002 2024-05-08T18:08:20.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:20.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971849+0000", 2024-05-08T18:08:20.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041139300000000002 2024-05-08T18:08:20.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:20.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.975364+0000", 2024-05-08T18:08:20.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035148390000000001 2024-05-08T18:08:20.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:20.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976474+0000", 2024-05-08T18:08:20.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001110099 2024-05-08T18:08:20.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976564+0000", 2024-05-08T18:08:20.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9522000000000001e-05 2024-05-08T18:08:20.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976624+0000", 2024-05-08T18:08:20.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9616e-05 2024-05-08T18:08:20.989 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.989 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.989 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.989 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:20.990 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:08:20.990 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.966800610000007, 2024-05-08T18:08:20.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010762776999999999, 2024-05-08T18:08:20.990 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.990 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.990 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.990 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:20.990 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:20.990 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:20.990 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 24 2024-05-08T18:08:20.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.990 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:08:20.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:08:20.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012442+0000", 2024-05-08T18:08:20.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.4300000000000002e-07 2024-05-08T18:08:20.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012573+0000", 2024-05-08T18:08:20.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013108299999999999 2024-05-08T18:08:20.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012592+0000", 2024-05-08T18:08:20.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9009e-05 2024-05-08T18:08:20.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012610+0000", 2024-05-08T18:08:20.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.789e-05 2024-05-08T18:08:20.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019108+0000", 2024-05-08T18:08:20.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064981470000000001 2024-05-08T18:08:20.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019348+0000", 2024-05-08T18:08:20.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024006099999999999 2024-05-08T18:08:20.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:20.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019751+0000", 2024-05-08T18:08:20.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040324099999999998 2024-05-08T18:08:20.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:20.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.022727+0000", 2024-05-08T18:08:20.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002976107 2024-05-08T18:08:20.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:20.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.022826+0000", 2024-05-08T18:08:20.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8626000000000001e-05 2024-05-08T18:08:20.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:20.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023036+0000", 2024-05-08T18:08:20.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000209578 2024-05-08T18:08:20.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:20.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023204+0000", 2024-05-08T18:08:20.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016819200000000001 2024-05-08T18:08:20.995 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.995 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:20.995 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:20.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.996 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:20.996 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:08:20.996 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.966613515000006, 2024-05-08T18:08:20.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011074977999999999, 2024-05-08T18:08:20.996 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:20.996 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:20.996 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:20.996 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:20.996 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:20.996 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:20.996 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 25 2024-05-08T18:08:20.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.996 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:20.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:20.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:08:20.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:20.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:08:20.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:20.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:20.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012629+0000", 2024-05-08T18:08:20.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7700000000000004e-07 2024-05-08T18:08:20.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:20.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012636+0000", 2024-05-08T18:08:20.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-05-08T18:08:20.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:20.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012646+0000", 2024-05-08T18:08:20.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0147e-05 2024-05-08T18:08:20.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:20.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012657+0000", 2024-05-08T18:08:20.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0473e-05 2024-05-08T18:08:20.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:20.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021198+0000", 2024-05-08T18:08:20.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0085417510000000002 2024-05-08T18:08:20.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:20.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:20.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021445+0000", 2024-05-08T18:08:20.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024665100000000002 2024-05-08T18:08:20.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:20.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021820+0000", 2024-05-08T18:08:21.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037519400000000003 2024-05-08T18:08:21.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023231+0000", 2024-05-08T18:08:21.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001410412 2024-05-08T18:08:21.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023550+0000", 2024-05-08T18:08:21.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000319368 2024-05-08T18:08:21.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023632+0000", 2024-05-08T18:08:21.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2366000000000004e-05 2024-05-08T18:08:21.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023703+0000", 2024-05-08T18:08:21.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0568999999999995e-05 2024-05-08T18:08:21.001 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.001 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.001 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.002 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.002 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:08:21.002 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.870267728000002, 2024-05-08T18:08:21.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011460965, 2024-05-08T18:08:21.002 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.002 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.002 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.002 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.002 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.002 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.002 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 45 2024-05-08T18:08:21.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.002 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:08:21.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:08:21.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108975+0000", 2024-05-08T18:08:21.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:08:21.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108983+0000", 2024-05-08T18:08:21.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6669999999999996e-06 2024-05-08T18:08:21.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109005+0000", 2024-05-08T18:08:21.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2787000000000001e-05 2024-05-08T18:08:21.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109020+0000", 2024-05-08T18:08:21.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4192999999999999e-05 2024-05-08T18:08:21.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116378+0000", 2024-05-08T18:08:21.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073585600000000001 2024-05-08T18:08:21.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116516+0000", 2024-05-08T18:08:21.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000137739 2024-05-08T18:08:21.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116747+0000", 2024-05-08T18:08:21.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023132799999999999 2024-05-08T18:08:21.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120140+0000", 2024-05-08T18:08:21.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033931439999999998 2024-05-08T18:08:21.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120290+0000", 2024-05-08T18:08:21.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149765 2024-05-08T18:08:21.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120369+0000", 2024-05-08T18:08:21.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.907e-05 2024-05-08T18:08:21.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120435+0000", 2024-05-08T18:08:21.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5642999999999995e-05 2024-05-08T18:08:21.007 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.007 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.007 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.007 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.007 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:08:21.008 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.870203634999996, 2024-05-08T18:08:21.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013705973999999999, 2024-05-08T18:08:21.008 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.008 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.008 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.008 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.008 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.008 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.008 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:08:21.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.008 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:08:21.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:08:21.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109039+0000", 2024-05-08T18:08:21.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:08:21.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109044+0000", 2024-05-08T18:08:21.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6699999999999999e-06 2024-05-08T18:08:21.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109054+0000", 2024-05-08T18:08:21.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7100000000000002e-06 2024-05-08T18:08:21.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109064+0000", 2024-05-08T18:08:21.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5740000000000002e-06 2024-05-08T18:08:21.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.117676+0000", 2024-05-08T18:08:21.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086126060000000001 2024-05-08T18:08:21.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.117828+0000", 2024-05-08T18:08:21.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151552 2024-05-08T18:08:21.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118041+0000", 2024-05-08T18:08:21.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000212692 2024-05-08T18:08:21.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120269+0000", 2024-05-08T18:08:21.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022281860000000001 2024-05-08T18:08:21.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122593+0000", 2024-05-08T18:08:21.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023239419999999998 2024-05-08T18:08:21.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122672+0000", 2024-05-08T18:08:21.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9579999999999994e-05 2024-05-08T18:08:21.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122744+0000", 2024-05-08T18:08:21.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1695999999999999e-05 2024-05-08T18:08:21.013 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.013 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.013 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.013 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.013 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:08:21.013 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.870159791999995, 2024-05-08T18:08:21.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016228664, 2024-05-08T18:08:21.014 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.014 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.014 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.014 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.014 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.014 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.014 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 47 2024-05-08T18:08:21.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.014 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:08:21.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:08:21.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109083+0000", 2024-05-08T18:08:21.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4600000000000004e-07 2024-05-08T18:08:21.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109232+0000", 2024-05-08T18:08:21.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149782 2024-05-08T18:08:21.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109257+0000", 2024-05-08T18:08:21.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4856999999999999e-05 2024-05-08T18:08:21.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109272+0000", 2024-05-08T18:08:21.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.503e-05 2024-05-08T18:08:21.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118799+0000", 2024-05-08T18:08:21.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0095264400000000006 2024-05-08T18:08:21.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118947+0000", 2024-05-08T18:08:21.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014848199999999999 2024-05-08T18:08:21.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.119151+0000", 2024-05-08T18:08:21.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020350500000000001 2024-05-08T18:08:21.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121458+0000", 2024-05-08T18:08:21.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002307749 2024-05-08T18:08:21.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125170+0000", 2024-05-08T18:08:21.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037113409999999999 2024-05-08T18:08:21.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125246+0000", 2024-05-08T18:08:21.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6029e-05 2024-05-08T18:08:21.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125310+0000", 2024-05-08T18:08:21.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4702999999999994e-05 2024-05-08T18:08:21.019 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.019 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.019 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.019 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.019 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:08:21.019 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.869940274000001, 2024-05-08T18:08:21.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016305097000000001, 2024-05-08T18:08:21.020 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.020 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.020 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.020 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.020 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.020 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.020 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 48 2024-05-08T18:08:21.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.020 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:08:21.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:08:21.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109303+0000", 2024-05-08T18:08:21.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:21.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109332+0000", 2024-05-08T18:08:21.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9220000000000001e-05 2024-05-08T18:08:21.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109375+0000", 2024-05-08T18:08:21.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2765999999999997e-05 2024-05-08T18:08:21.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109394+0000", 2024-05-08T18:08:21.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8603000000000001e-05 2024-05-08T18:08:21.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120508+0000", 2024-05-08T18:08:21.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011114811 2024-05-08T18:08:21.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120663+0000", 2024-05-08T18:08:21.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000154332 2024-05-08T18:08:21.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120863+0000", 2024-05-08T18:08:21.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019995599999999999 2024-05-08T18:08:21.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125326+0000", 2024-05-08T18:08:21.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044631180000000003 2024-05-08T18:08:21.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125431+0000", 2024-05-08T18:08:21.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010522900000000001 2024-05-08T18:08:21.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125541+0000", 2024-05-08T18:08:21.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109802 2024-05-08T18:08:21.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125606+0000", 2024-05-08T18:08:21.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5549999999999994e-05 2024-05-08T18:08:21.025 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.025 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.025 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.025 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.025 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:08:21.025 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.869819954999997, 2024-05-08T18:08:21.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016563135, 2024-05-08T18:08:21.026 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.026 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.026 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.026 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.026 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.026 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.026 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 49 2024-05-08T18:08:21.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.026 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:08:21.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:08:21.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109423+0000", 2024-05-08T18:08:21.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5969999999999999e-06 2024-05-08T18:08:21.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109434+0000", 2024-05-08T18:08:21.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.113e-05 2024-05-08T18:08:21.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109455+0000", 2024-05-08T18:08:21.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0873000000000002e-05 2024-05-08T18:08:21.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109469+0000", 2024-05-08T18:08:21.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4039999999999999e-05 2024-05-08T18:08:21.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121566+0000", 2024-05-08T18:08:21.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012096325999999999 2024-05-08T18:08:21.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121725+0000", 2024-05-08T18:08:21.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015932899999999999 2024-05-08T18:08:21.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121981+0000", 2024-05-08T18:08:21.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025583799999999999 2024-05-08T18:08:21.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125680+0000", 2024-05-08T18:08:21.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0036995579999999999 2024-05-08T18:08:21.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125838+0000", 2024-05-08T18:08:21.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015731499999999999 2024-05-08T18:08:21.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125914+0000", 2024-05-08T18:08:21.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6686000000000004e-05 2024-05-08T18:08:21.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125985+0000", 2024-05-08T18:08:21.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0443000000000003e-05 2024-05-08T18:08:21.031 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.031 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.031 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.031 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.031 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:08:21.031 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.869747575999995, 2024-05-08T18:08:21.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016620291999999998, 2024-05-08T18:08:21.031 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.031 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.032 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.032 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.032 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.032 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.032 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 50 2024-05-08T18:08:21.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.032 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:08:21.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:08:21.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109495+0000", 2024-05-08T18:08:21.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.477e-06 2024-05-08T18:08:21.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109692+0000", 2024-05-08T18:08:21.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019638199999999999 2024-05-08T18:08:21.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109733+0000", 2024-05-08T18:08:21.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1093000000000001e-05 2024-05-08T18:08:21.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109745+0000", 2024-05-08T18:08:21.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1715999999999999e-05 2024-05-08T18:08:21.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122839+0000", 2024-05-08T18:08:21.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013094809000000001 2024-05-08T18:08:21.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122980+0000", 2024-05-08T18:08:21.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140829 2024-05-08T18:08:21.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.123239+0000", 2024-05-08T18:08:21.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025834799999999999 2024-05-08T18:08:21.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125810+0000", 2024-05-08T18:08:21.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025717729999999999 2024-05-08T18:08:21.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126001+0000", 2024-05-08T18:08:21.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019013600000000001 2024-05-08T18:08:21.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126064+0000", 2024-05-08T18:08:21.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3301999999999998e-05 2024-05-08T18:08:21.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126114+0000", 2024-05-08T18:08:21.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0426999999999997e-05 2024-05-08T18:08:21.037 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.037 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.037 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.037 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.037 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:08:21.037 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.869468428000005, 2024-05-08T18:08:21.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018305669, 2024-05-08T18:08:21.037 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.037 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.037 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.038 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.038 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.038 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.038 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 51 2024-05-08T18:08:21.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.038 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:08:21.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:08:21.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109775+0000", 2024-05-08T18:08:21.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5269999999999999e-06 2024-05-08T18:08:21.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109786+0000", 2024-05-08T18:08:21.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1296e-05 2024-05-08T18:08:21.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109806+0000", 2024-05-08T18:08:21.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0114000000000001e-05 2024-05-08T18:08:21.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109823+0000", 2024-05-08T18:08:21.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6665999999999999e-05 2024-05-08T18:08:21.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124193+0000", 2024-05-08T18:08:21.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014369916 2024-05-08T18:08:21.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124354+0000", 2024-05-08T18:08:21.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016167899999999999 2024-05-08T18:08:21.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124571+0000", 2024-05-08T18:08:21.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021652800000000001 2024-05-08T18:08:21.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126978+0000", 2024-05-08T18:08:21.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024071679999999999 2024-05-08T18:08:21.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127921+0000", 2024-05-08T18:08:21.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00094277599999999999 2024-05-08T18:08:21.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.128012+0000", 2024-05-08T18:08:21.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0818999999999999e-05 2024-05-08T18:08:21.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.128079+0000", 2024-05-08T18:08:21.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7180000000000004e-05 2024-05-08T18:08:21.043 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.043 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.043 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.043 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.043 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:08:21.043 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.869393321999993, 2024-05-08T18:08:21.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021440811000000001, 2024-05-08T18:08:21.043 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.043 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.043 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.043 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.044 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.044 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.044 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 52 2024-05-08T18:08:21.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.044 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:08:21.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:08:21.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109849+0000", 2024-05-08T18:08:21.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1370000000000001e-06 2024-05-08T18:08:21.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109861+0000", 2024-05-08T18:08:21.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1559999999999999e-05 2024-05-08T18:08:21.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109878+0000", 2024-05-08T18:08:21.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7105999999999999e-05 2024-05-08T18:08:21.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109892+0000", 2024-05-08T18:08:21.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3577000000000001e-05 2024-05-08T18:08:21.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126161+0000", 2024-05-08T18:08:21.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016269458000000001 2024-05-08T18:08:21.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126299+0000", 2024-05-08T18:08:21.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138405 2024-05-08T18:08:21.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126534+0000", 2024-05-08T18:08:21.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000234875 2024-05-08T18:08:21.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127543+0000", 2024-05-08T18:08:21.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001008852 2024-05-08T18:08:21.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131128+0000", 2024-05-08T18:08:21.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035844359999999999 2024-05-08T18:08:21.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131222+0000", 2024-05-08T18:08:21.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3905000000000003e-05 2024-05-08T18:08:21.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131289+0000", 2024-05-08T18:08:21.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7500000000000001e-05 2024-05-08T18:08:21.048 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.048 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.048 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.049 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.049 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:08:21.049 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.629107622999996, 2024-05-08T18:08:21.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010652125, 2024-05-08T18:08:21.049 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.049 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.049 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.049 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.049 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.049 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.049 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 67 2024-05-08T18:08:21.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.049 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:08:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:08:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350135+0000", 2024-05-08T18:08:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.083e-06 2024-05-08T18:08:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350141+0000", 2024-05-08T18:08:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.178e-06 2024-05-08T18:08:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350152+0000", 2024-05-08T18:08:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0706999999999999e-05 2024-05-08T18:08:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350159+0000", 2024-05-08T18:08:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3640000000000001e-06 2024-05-08T18:08:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352606+0000", 2024-05-08T18:08:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024470379999999999 2024-05-08T18:08:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352718+0000", 2024-05-08T18:08:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000111366 2024-05-08T18:08:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352887+0000", 2024-05-08T18:08:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016887900000000001 2024-05-08T18:08:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358041+0000", 2024-05-08T18:08:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051542940000000002 2024-05-08T18:08:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360681+0000", 2024-05-08T18:08:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026404639999999999 2024-05-08T18:08:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360726+0000", 2024-05-08T18:08:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4666999999999998e-05 2024-05-08T18:08:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360786+0000", 2024-05-08T18:08:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0084999999999998e-05 2024-05-08T18:08:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:08:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.628852234999997, 2024-05-08T18:08:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010500438000000001, 2024-05-08T18:08:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 68 2024-05-08T18:08:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:08:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:08:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350391+0000", 2024-05-08T18:08:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:08:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350398+0000", 2024-05-08T18:08:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6599999999999995e-06 2024-05-08T18:08:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350414+0000", 2024-05-08T18:08:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6101000000000001e-05 2024-05-08T18:08:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350425+0000", 2024-05-08T18:08:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.099e-05 2024-05-08T18:08:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353737+0000", 2024-05-08T18:08:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033112739999999999 2024-05-08T18:08:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353810+0000", 2024-05-08T18:08:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3337999999999995e-05 2024-05-08T18:08:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353922+0000", 2024-05-08T18:08:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112409 2024-05-08T18:08:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358114+0000", 2024-05-08T18:08:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041912909999999998 2024-05-08T18:08:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360798+0000", 2024-05-08T18:08:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026845850000000002 2024-05-08T18:08:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360838+0000", 2024-05-08T18:08:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9619999999999997e-05 2024-05-08T18:08:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360890+0000", 2024-05-08T18:08:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.185e-05 2024-05-08T18:08:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:08:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.628476015000004, 2024-05-08T18:08:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010508969999999999, 2024-05-08T18:08:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 71 2024-05-08T18:08:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:08:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:08:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:08:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.61e-07 2024-05-08T18:08:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350771+0000", 2024-05-08T18:08:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6720000000000003e-06 2024-05-08T18:08:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350781+0000", 2024-05-08T18:08:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9450000000000005e-06 2024-05-08T18:08:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350786+0000", 2024-05-08T18:08:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2530000000000004e-06 2024-05-08T18:08:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356065+0000", 2024-05-08T18:08:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052789239999999999 2024-05-08T18:08:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356174+0000", 2024-05-08T18:08:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108564 2024-05-08T18:08:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356336+0000", 2024-05-08T18:08:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162566 2024-05-08T18:08:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358285+0000", 2024-05-08T18:08:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001948443 2024-05-08T18:08:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361124+0000", 2024-05-08T18:08:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028390120000000001 2024-05-08T18:08:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361217+0000", 2024-05-08T18:08:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3899000000000003e-05 2024-05-08T18:08:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361275+0000", 2024-05-08T18:08:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7031000000000003e-05 2024-05-08T18:08:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:08:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.628398543000003, 2024-05-08T18:08:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010535020000000001, 2024-05-08T18:08:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 72 2024-05-08T18:08:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:08:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:08:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350844+0000", 2024-05-08T18:08:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:08:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350957+0000", 2024-05-08T18:08:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112958 2024-05-08T18:08:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350966+0000", 2024-05-08T18:08:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3440000000000007e-06 2024-05-08T18:08:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350972+0000", 2024-05-08T18:08:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.37e-06 2024-05-08T18:08:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356777+0000", 2024-05-08T18:08:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058049199999999999 2024-05-08T18:08:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356852+0000", 2024-05-08T18:08:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5109000000000002e-05 2024-05-08T18:08:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356961+0000", 2024-05-08T18:08:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108818 2024-05-08T18:08:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359695+0000", 2024-05-08T18:08:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002733685 2024-05-08T18:08:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361284+0000", 2024-05-08T18:08:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015888740000000001 2024-05-08T18:08:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361323+0000", 2024-05-08T18:08:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9824999999999999e-05 2024-05-08T18:08:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361378+0000", 2024-05-08T18:08:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4593999999999999e-05 2024-05-08T18:08:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:08:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.628258740999996, 2024-05-08T18:08:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01225805, 2024-05-08T18:08:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 73 2024-05-08T18:08:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:08:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:08:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:08:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0999999999999999e-07 2024-05-08T18:08:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350987+0000", 2024-05-08T18:08:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3529999999999999e-06 2024-05-08T18:08:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350994+0000", 2024-05-08T18:08:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0840000000000003e-06 2024-05-08T18:08:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350998+0000", 2024-05-08T18:08:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.194e-06 2024-05-08T18:08:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358336+0000", 2024-05-08T18:08:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073376070000000003 2024-05-08T18:08:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358456+0000", 2024-05-08T18:08:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012042199999999999 2024-05-08T18:08:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358615+0000", 2024-05-08T18:08:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015928399999999999 2024-05-08T18:08:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.362117+0000", 2024-05-08T18:08:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035021039999999998 2024-05-08T18:08:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363139+0000", 2024-05-08T18:08:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010220349999999999 2024-05-08T18:08:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363181+0000", 2024-05-08T18:08:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1465999999999999e-05 2024-05-08T18:08:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363241+0000", 2024-05-08T18:08:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9991000000000002e-05 2024-05-08T18:08:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:08:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.628233924, 2024-05-08T18:08:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012698229, 2024-05-08T18:08:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 74 2024-05-08T18:08:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:08:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:08:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:08:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4000000000000002e-07 2024-05-08T18:08:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351013+0000", 2024-05-08T18:08:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8239999999999999e-06 2024-05-08T18:08:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351020+0000", 2024-05-08T18:08:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.52e-06 2024-05-08T18:08:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351025+0000", 2024-05-08T18:08:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3499999999999999e-06 2024-05-08T18:08:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359063+0000", 2024-05-08T18:08:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0080381800000000007 2024-05-08T18:08:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359140+0000", 2024-05-08T18:08:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7225999999999995e-05 2024-05-08T18:08:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359256+0000", 2024-05-08T18:08:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011537899999999999 2024-05-08T18:08:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363249+0000", 2024-05-08T18:08:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039937089999999998 2024-05-08T18:08:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363584+0000", 2024-05-08T18:08:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033516500000000001 2024-05-08T18:08:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363654+0000", 2024-05-08T18:08:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9093999999999999e-05 2024-05-08T18:08:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363706+0000", 2024-05-08T18:08:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2342000000000001e-05 2024-05-08T18:08:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:08:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.628195664000003, 2024-05-08T18:08:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015677229000000001, 2024-05-08T18:08:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 75 2024-05-08T18:08:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:08:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:08:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:08:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1699999999999999e-07 2024-05-08T18:08:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351141+0000", 2024-05-08T18:08:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4661999999999996e-05 2024-05-08T18:08:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351151+0000", 2024-05-08T18:08:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0084e-05 2024-05-08T18:08:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351160+0000", 2024-05-08T18:08:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2490000000000007e-06 2024-05-08T18:08:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359748+0000", 2024-05-08T18:08:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0085879849999999994 2024-05-08T18:08:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359820+0000", 2024-05-08T18:08:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2081000000000003e-05 2024-05-08T18:08:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359928+0000", 2024-05-08T18:08:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107157 2024-05-08T18:08:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363254+0000", 2024-05-08T18:08:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033268579999999998 2024-05-08T18:08:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366611+0000", 2024-05-08T18:08:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033564179999999999 2024-05-08T18:08:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366672+0000", 2024-05-08T18:08:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0714999999999997e-05 2024-05-08T18:08:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366723+0000", 2024-05-08T18:08:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1603e-05 2024-05-08T18:08:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:08:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.628071164000005, 2024-05-08T18:08:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015696418, 2024-05-08T18:08:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 76 2024-05-08T18:08:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:08:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:08:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351171+0000", 2024-05-08T18:08:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4600000000000004e-07 2024-05-08T18:08:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351174+0000", 2024-05-08T18:08:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2030000000000001e-06 2024-05-08T18:08:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351179+0000", 2024-05-08T18:08:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2079999999999999e-06 2024-05-08T18:08:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351184+0000", 2024-05-08T18:08:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3120000000000004e-06 2024-05-08T18:08:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361430+0000", 2024-05-08T18:08:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010246175 2024-05-08T18:08:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361545+0000", 2024-05-08T18:08:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115139 2024-05-08T18:08:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361712+0000", 2024-05-08T18:08:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000166491 2024-05-08T18:08:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363473+0000", 2024-05-08T18:08:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017610799999999999 2024-05-08T18:08:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366769+0000", 2024-05-08T18:08:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032964880000000002 2024-05-08T18:08:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366811+0000", 2024-05-08T18:08:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2296000000000003e-05 2024-05-08T18:08:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366867+0000", 2024-05-08T18:08:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5380000000000002e-05 2024-05-08T18:08:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:08:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.277143194999994, 2024-05-08T18:08:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010497067000000001, 2024-05-08T18:08:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 94 2024-05-08T18:08:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:08:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:08:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702099+0000", 2024-05-08T18:08:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4099999999999999e-07 2024-05-08T18:08:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702102+0000", 2024-05-08T18:08:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6650000000000001e-06 2024-05-08T18:08:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702108+0000", 2024-05-08T18:08:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.711e-06 2024-05-08T18:08:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702114+0000", 2024-05-08T18:08:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.241e-06 2024-05-08T18:08:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.708666+0000", 2024-05-08T18:08:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065511459999999999 2024-05-08T18:08:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.708833+0000", 2024-05-08T18:08:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000166966 2024-05-08T18:08:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.709171+0000", 2024-05-08T18:08:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033834000000000002 2024-05-08T18:08:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.710246+0000", 2024-05-08T18:08:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001074642 2024-05-08T18:08:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712422+0000", 2024-05-08T18:08:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021762370000000001 2024-05-08T18:08:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712521+0000", 2024-05-08T18:08:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9432999999999995e-05 2024-05-08T18:08:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712595+0000", 2024-05-08T18:08:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4245000000000005e-05 2024-05-08T18:08:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:21.101 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:21.102 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:21.102+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:21.103 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:08:21.133 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:08:21.203 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:21.202+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:21.232 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:21.232 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:21.233 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:21.233 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:21.248 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:08:21.285 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:21.285 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:21.303 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:21.303 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:21.304 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:21.302+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:21.322 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:21.322 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:21.340 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:21.340 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:21.360 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:21.361 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:21.373 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:21.373 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:21.393 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:08:21.396 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:21.405 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:21.402+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:21.417 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:21.417 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:21.439 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:21.439 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:21.506 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:21.506+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:21.524 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:21.524 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:21.538 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:08:21.607 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:21.606+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:21.654 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:21.655 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:21.669 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:08:21.708 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:21.710+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:21.781 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:21.782 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:21.795 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:08:21.810 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.6 to 1 (10000) 2024-05-08T18:08:21.810 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:21.809+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:21.832 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-08T18:08:21.915 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:21.915 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:21.915 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:21.917+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:21.929 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:08:22.011 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:22.006+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:22.086 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:22.086 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:22.099 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:08:22.142 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:22.145+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:22.213 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:22.210+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:22.214 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:22.215 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:22.227 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:08:22.314 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:22.314+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:22.387 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:22.387 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:22.400 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:08:22.415 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:22.410+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:22.516 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:22.517+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:22.519 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:22.520 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:22.533 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:08:22.618 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:22.618+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:22.702 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:22.702 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:22.716 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:08:22.718 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:22.714+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:22.815 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.7 to 1 (10000) 2024-05-08T18:08:22.821 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:22.814+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:22.833 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:22.833 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:22.835 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:08:22.838 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-08T18:08:22.839 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:08:22.848 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:08:22.920 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:22.922+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:22.985 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:22.985 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:22.999 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:08:23.020 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:23.021+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:23.122 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:23.122+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:23.165 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:23.165 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:23.179 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:08:23.212 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:08:23.218 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:08:23.229 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-05-08T18:08:22.823548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":759,"num_read_kb":507,"num_write":530,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223172,"kb_used_data":6968,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751548,"statfs":{"total":773094113280,"available":772865585152,"internally_reserved":0,"allocated":7135232,"data_stored":4221530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039811"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.146751+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:08:21.146751+0000","last_peered":"2024-05-08T18:08:21.146751+0000","last_clean":"2024-05-08T18:08:21.146751+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:08:21.146751+0000","last_undegraded":"2024-05-08T18:08:21.146751+0000","last_fullsized":"2024-05-08T18:08:21.146751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.138073+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:08:21.138073+0000","last_peered":"2024-05-08T18:08:21.138073+0000","last_clean":"2024-05-08T18:08:21.138073+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:08:21.138073+0000","last_undegraded":"2024-05-08T18:08:21.138073+0000","last_fullsized":"2024-05-08T18:08:21.138073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140218+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:08:21.140218+0000","last_peered":"2024-05-08T18:08:21.140218+0000","last_clean":"2024-05-08T18:08:21.140218+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:08:21.140218+0000","last_undegraded":"2024-05-08T18:08:21.140218+0000","last_fullsized":"2024-05-08T18:08:21.140218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139579+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:08:21.139579+0000","last_peered":"2024-05-08T18:08:21.139579+0000","last_clean":"2024-05-08T18:08:21.139579+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:08:21.139579+0000","last_undegraded":"2024-05-08T18:08:21.139579+0000","last_fullsized":"2024-05-08T18:08:21.139579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817888+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:08:20.817888+0000","last_peered":"2024-05-08T18:08:20.817888+0000","last_clean":"2024-05-08T18:08:20.817888+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:08:20.817888+0000","last_undegraded":"2024-05-08T18:08:20.817888+0000","last_fullsized":"2024-05-08T18:08:20.817888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810531+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:08:20.810531+0000","last_peered":"2024-05-08T18:08:20.810531+0000","last_clean":"2024-05-08T18:08:20.810531+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:08:20.810531+0000","last_undegraded":"2024-05-08T18:08:20.810531+0000","last_fullsized":"2024-05-08T18:08:20.810531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142651+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:08:21.142651+0000","last_peered":"2024-05-08T18:08:21.142651+0000","last_clean":"2024-05-08T18:08:21.142651+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:08:21.142651+0000","last_undegraded":"2024-05-08T18:08:21.142651+0000","last_fullsized":"2024-05-08T18:08:21.142651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817493+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:08:20.817493+0000","last_peered":"2024-05-08T18:08:20.817493+0000","last_clean":"2024-05-08T18:08:20.817493+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:08:20.817493+0000","last_undegraded":"2024-05-08T18:08:20.817493+0000","last_fullsized":"2024-05-08T18:08:20.817493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142358+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:08:21.142358+0000","last_peered":"2024-05-08T18:08:21.142358+0000","last_clean":"2024-05-08T18:08:21.142358+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:08:21.142358+0000","last_undegraded":"2024-05-08T18:08:21.142358+0000","last_fullsized":"2024-05-08T18:08:21.142358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140162+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:08:21.140162+0000","last_peered":"2024-05-08T18:08:21.140162+0000","last_clean":"2024-05-08T18:08:21.140162+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:08:21.140162+0000","last_undegraded":"2024-05-08T18:08:21.140162+0000","last_fullsized":"2024-05-08T18:08:21.140162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":36,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139619+0000","last_change":"2024-05-08T18:07:55.439965+0000","last_active":"2024-05-08T18:08:21.139619+0000","last_peered":"2024-05-08T18:08:21.139619+0000","last_clean":"2024-05-08T18:08:21.139619+0000","last_became_active":"2024-05-08T18:07:55.439578+0000","last_became_peered":"2024-05-08T18:07:55.439578+0000","last_unstale":"2024-05-08T18:08:21.139619+0000","last_undegraded":"2024-05-08T18:08:21.139619+0000","last_fullsized":"2024-05-08T18:08:21.139619+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:30.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810263+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:08:20.810263+0000","last_peered":"2024-05-08T18:08:20.810263+0000","last_clean":"2024-05-08T18:08:20.810263+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:08:20.810263+0000","last_undegraded":"2024-05-08T18:08:20.810263+0000","last_fullsized":"2024-05-08T18:08:20.810263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140025+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:08:21.140025+0000","last_peered":"2024-05-08T18:08:21.140025+0000","last_clean":"2024-05-08T18:08:21.140025+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:08:21.140025+0000","last_undegraded":"2024-05-08T18:08:21.140025+0000","last_fullsized":"2024-05-08T18:08:21.140025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140727+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:08:21.140727+0000","last_peered":"2024-05-08T18:08:21.140727+0000","last_clean":"2024-05-08T18:08:21.140727+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:08:21.140727+0000","last_undegraded":"2024-05-08T18:08:21.140727+0000","last_fullsized":"2024-05-08T18:08:21.140727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812008+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:08:20.812008+0000","last_peered":"2024-05-08T18:08:20.812008+0000","last_clean":"2024-05-08T18:08:20.812008+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:08:20.812008+0000","last_undegraded":"2024-05-08T18:08:20.812008+0000","last_fullsized":"2024-05-08T18:08:20.812008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":48,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813469+0000","last_change":"2024-05-08T18:07:47.007132+0000","last_active":"2024-05-08T18:08:20.813469+0000","last_peered":"2024-05-08T18:08:20.813469+0000","last_clean":"2024-05-08T18:08:20.813469+0000","last_became_active":"2024-05-08T18:07:47.006744+0000","last_became_peered":"2024-05-08T18:07:47.006744+0000","last_unstale":"2024-05-08T18:08:20.813469+0000","last_undegraded":"2024-05-08T18:08:20.813469+0000","last_fullsized":"2024-05-08T18:08:20.813469+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:32.802677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809060+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:08:20.809060+0000","last_peered":"2024-05-08T18:08:20.809060+0000","last_clean":"2024-05-08T18:08:20.809060+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:08:20.809060+0000","last_undegraded":"2024-05-08T18:08:20.809060+0000","last_fullsized":"2024-05-08T18:08:20.809060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.146830+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:08:21.146830+0000","last_peered":"2024-05-08T18:08:21.146830+0000","last_clean":"2024-05-08T18:08:21.146830+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:08:21.146830+0000","last_undegraded":"2024-05-08T18:08:21.146830+0000","last_fullsized":"2024-05-08T18:08:21.146830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139798+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:08:21.139798+0000","last_peered":"2024-05-08T18:08:21.139798+0000","last_clean":"2024-05-08T18:08:21.139798+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:08:21.139798+0000","last_undegraded":"2024-05-08T18:08:21.139798+0000","last_fullsized":"2024-05-08T18:08:21.139798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142329+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:08:21.142329+0000","last_peered":"2024-05-08T18:08:21.142329+0000","last_clean":"2024-05-08T18:08:21.142329+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:08:21.142329+0000","last_undegraded":"2024-05-08T18:08:21.142329+0000","last_fullsized":"2024-05-08T18:08:21.142329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140361+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:08:21.140361+0000","last_peered":"2024-05-08T18:08:21.140361+0000","last_clean":"2024-05-08T18:08:21.140361+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:08:21.140361+0000","last_undegraded":"2024-05-08T18:08:21.140361+0000","last_fullsized":"2024-05-08T18:08:21.140361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139915+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:08:21.139915+0000","last_peered":"2024-05-08T18:08:21.139915+0000","last_clean":"2024-05-08T18:08:21.139915+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:08:21.139915+0000","last_undegraded":"2024-05-08T18:08:21.139915+0000","last_fullsized":"2024-05-08T18:08:21.139915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140218+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:08:21.140218+0000","last_peered":"2024-05-08T18:08:21.140218+0000","last_clean":"2024-05-08T18:08:21.140218+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:08:21.140218+0000","last_undegraded":"2024-05-08T18:08:21.140218+0000","last_fullsized":"2024-05-08T18:08:21.140218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809551+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:08:20.809551+0000","last_peered":"2024-05-08T18:08:20.809551+0000","last_clean":"2024-05-08T18:08:20.809551+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:08:20.809551+0000","last_undegraded":"2024-05-08T18:08:20.809551+0000","last_fullsized":"2024-05-08T18:08:20.809551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140946+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:08:21.140946+0000","last_peered":"2024-05-08T18:08:21.140946+0000","last_clean":"2024-05-08T18:08:21.140946+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:08:21.140946+0000","last_undegraded":"2024-05-08T18:08:21.140946+0000","last_fullsized":"2024-05-08T18:08:21.140946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813836+0000","last_change":"2024-05-08T18:07:15.480500+0000","last_active":"2024-05-08T18:08:20.813836+0000","last_peered":"2024-05-08T18:08:20.813836+0000","last_clean":"2024-05-08T18:08:20.813836+0000","last_became_active":"2024-05-08T18:07:15.480192+0000","last_became_peered":"2024-05-08T18:07:15.480192+0000","last_unstale":"2024-05-08T18:08:20.813836+0000","last_undegraded":"2024-05-08T18:08:20.813836+0000","last_fullsized":"2024-05-08T18:08:20.813836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810514+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:08:20.810514+0000","last_peered":"2024-05-08T18:08:20.810514+0000","last_clean":"2024-05-08T18:08:20.810514+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:08:20.810514+0000","last_undegraded":"2024-05-08T18:08:20.810514+0000","last_fullsized":"2024-05-08T18:08:20.810514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817682+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:08:20.817682+0000","last_peered":"2024-05-08T18:08:20.817682+0000","last_clean":"2024-05-08T18:08:20.817682+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:08:20.817682+0000","last_undegraded":"2024-05-08T18:08:20.817682+0000","last_fullsized":"2024-05-08T18:08:20.817682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.808510+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:08:20.808510+0000","last_peered":"2024-05-08T18:08:20.808510+0000","last_clean":"2024-05-08T18:08:20.808510+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:08:20.808510+0000","last_undegraded":"2024-05-08T18:08:20.808510+0000","last_fullsized":"2024-05-08T18:08:20.808510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812840+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:08:20.812840+0000","last_peered":"2024-05-08T18:08:20.812840+0000","last_clean":"2024-05-08T18:08:20.812840+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:08:20.812840+0000","last_undegraded":"2024-05-08T18:08:20.812840+0000","last_fullsized":"2024-05-08T18:08:20.812840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142766+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:08:21.142766+0000","last_peered":"2024-05-08T18:08:21.142766+0000","last_clean":"2024-05-08T18:08:21.142766+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:08:21.142766+0000","last_undegraded":"2024-05-08T18:08:21.142766+0000","last_fullsized":"2024-05-08T18:08:21.142766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144485+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:08:21.144485+0000","last_peered":"2024-05-08T18:08:21.144485+0000","last_clean":"2024-05-08T18:08:21.144485+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:08:21.144485+0000","last_undegraded":"2024-05-08T18:08:21.144485+0000","last_fullsized":"2024-05-08T18:08:21.144485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818322+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:08:20.818322+0000","last_peered":"2024-05-08T18:08:20.818322+0000","last_clean":"2024-05-08T18:08:20.818322+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:08:20.818322+0000","last_undegraded":"2024-05-08T18:08:20.818322+0000","last_fullsized":"2024-05-08T18:08:20.818322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.146555+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:08:21.146555+0000","last_peered":"2024-05-08T18:08:21.146555+0000","last_clean":"2024-05-08T18:08:21.146555+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:08:21.146555+0000","last_undegraded":"2024-05-08T18:08:21.146555+0000","last_fullsized":"2024-05-08T18:08:21.146555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.138834+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:08:21.138834+0000","last_peered":"2024-05-08T18:08:21.138834+0000","last_clean":"2024-05-08T18:08:21.138834+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:08:21.138834+0000","last_undegraded":"2024-05-08T18:08:21.138834+0000","last_fullsized":"2024-05-08T18:08:21.138834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144991+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:08:21.144991+0000","last_peered":"2024-05-08T18:08:21.144991+0000","last_clean":"2024-05-08T18:08:21.144991+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:08:21.144991+0000","last_undegraded":"2024-05-08T18:08:21.144991+0000","last_fullsized":"2024-05-08T18:08:21.144991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817723+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:08:20.817723+0000","last_peered":"2024-05-08T18:08:20.817723+0000","last_clean":"2024-05-08T18:08:20.817723+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:08:20.817723+0000","last_undegraded":"2024-05-08T18:08:20.817723+0000","last_fullsized":"2024-05-08T18:08:20.817723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812720+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:08:20.812720+0000","last_peered":"2024-05-08T18:08:20.812720+0000","last_clean":"2024-05-08T18:08:20.812720+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:08:20.812720+0000","last_undegraded":"2024-05-08T18:08:20.812720+0000","last_fullsized":"2024-05-08T18:08:20.812720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810820+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:08:20.810820+0000","last_peered":"2024-05-08T18:08:20.810820+0000","last_clean":"2024-05-08T18:08:20.810820+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:08:20.810820+0000","last_undegraded":"2024-05-08T18:08:20.810820+0000","last_fullsized":"2024-05-08T18:08:20.810820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810620+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:08:20.810620+0000","last_peered":"2024-05-08T18:08:20.810620+0000","last_clean":"2024-05-08T18:08:20.810620+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:08:20.810620+0000","last_undegraded":"2024-05-08T18:08:20.810620+0000","last_fullsized":"2024-05-08T18:08:20.810620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817288+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:08:20.817288+0000","last_peered":"2024-05-08T18:08:20.817288+0000","last_clean":"2024-05-08T18:08:20.817288+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:08:20.817288+0000","last_undegraded":"2024-05-08T18:08:20.817288+0000","last_fullsized":"2024-05-08T18:08:20.817288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818836+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:08:20.818836+0000","last_peered":"2024-05-08T18:08:20.818836+0000","last_clean":"2024-05-08T18:08:20.818836+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:08:20.818836+0000","last_undegraded":"2024-05-08T18:08:20.818836+0000","last_fullsized":"2024-05-08T18:08:20.818836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140247+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:08:21.140247+0000","last_peered":"2024-05-08T18:08:21.140247+0000","last_clean":"2024-05-08T18:08:21.140247+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:08:21.140247+0000","last_undegraded":"2024-05-08T18:08:21.140247+0000","last_fullsized":"2024-05-08T18:08:21.140247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813363+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:08:20.813363+0000","last_peered":"2024-05-08T18:08:20.813363+0000","last_clean":"2024-05-08T18:08:20.813363+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:08:20.813363+0000","last_undegraded":"2024-05-08T18:08:20.813363+0000","last_fullsized":"2024-05-08T18:08:20.813363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140756+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:08:21.140756+0000","last_peered":"2024-05-08T18:08:21.140756+0000","last_clean":"2024-05-08T18:08:21.140756+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:08:21.140756+0000","last_undegraded":"2024-05-08T18:08:21.140756+0000","last_fullsized":"2024-05-08T18:08:21.140756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143929+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:08:21.143929+0000","last_peered":"2024-05-08T18:08:21.143929+0000","last_clean":"2024-05-08T18:08:21.143929+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:08:21.143929+0000","last_undegraded":"2024-05-08T18:08:21.143929+0000","last_fullsized":"2024-05-08T18:08:21.143929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809159+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:08:20.809159+0000","last_peered":"2024-05-08T18:08:20.809159+0000","last_clean":"2024-05-08T18:08:20.809159+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:08:20.809159+0000","last_undegraded":"2024-05-08T18:08:20.809159+0000","last_fullsized":"2024-05-08T18:08:20.809159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813172+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:08:20.813172+0000","last_peered":"2024-05-08T18:08:20.813172+0000","last_clean":"2024-05-08T18:08:20.813172+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:08:20.813172+0000","last_undegraded":"2024-05-08T18:08:20.813172+0000","last_fullsized":"2024-05-08T18:08:20.813172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139643+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:08:21.139643+0000","last_peered":"2024-05-08T18:08:21.139643+0000","last_clean":"2024-05-08T18:08:21.139643+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:08:21.139643+0000","last_undegraded":"2024-05-08T18:08:21.139643+0000","last_fullsized":"2024-05-08T18:08:21.139643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140497+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:08:21.140497+0000","last_peered":"2024-05-08T18:08:21.140497+0000","last_clean":"2024-05-08T18:08:21.140497+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:08:21.140497+0000","last_undegraded":"2024-05-08T18:08:21.140497+0000","last_fullsized":"2024-05-08T18:08:21.140497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144380+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:08:21.144380+0000","last_peered":"2024-05-08T18:08:21.144380+0000","last_clean":"2024-05-08T18:08:21.144380+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:08:21.144380+0000","last_undegraded":"2024-05-08T18:08:21.144380+0000","last_fullsized":"2024-05-08T18:08:21.144380+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812531+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:08:20.812531+0000","last_peered":"2024-05-08T18:08:20.812531+0000","last_clean":"2024-05-08T18:08:20.812531+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:08:20.812531+0000","last_undegraded":"2024-05-08T18:08:20.812531+0000","last_fullsized":"2024-05-08T18:08:20.812531+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143149+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:08:21.143149+0000","last_peered":"2024-05-08T18:08:21.143149+0000","last_clean":"2024-05-08T18:08:21.143149+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:08:21.143149+0000","last_undegraded":"2024-05-08T18:08:21.143149+0000","last_fullsized":"2024-05-08T18:08:21.143149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":36,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142667+0000","last_change":"2024-05-08T18:07:55.357969+0000","last_active":"2024-05-08T18:08:21.142667+0000","last_peered":"2024-05-08T18:08:21.142667+0000","last_clean":"2024-05-08T18:08:21.142667+0000","last_became_active":"2024-05-08T18:07:55.357205+0000","last_became_peered":"2024-05-08T18:07:55.357205+0000","last_unstale":"2024-05-08T18:08:21.142667+0000","last_undegraded":"2024-05-08T18:08:21.142667+0000","last_fullsized":"2024-05-08T18:08:21.142667+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:04.667292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.138987+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:08:21.138987+0000","last_peered":"2024-05-08T18:08:21.138987+0000","last_clean":"2024-05-08T18:08:21.138987+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:08:21.138987+0000","last_undegraded":"2024-05-08T18:08:21.138987+0000","last_fullsized":"2024-05-08T18:08:21.138987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":108,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139929+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:08:21.139929+0000","last_peered":"2024-05-08T18:08:21.139929+0000","last_clean":"2024-05-08T18:08:21.139929+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:08:21.139929+0000","last_undegraded":"2024-05-08T18:08:21.139929+0000","last_fullsized":"2024-05-08T18:08:21.139929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141205+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:08:21.141205+0000","last_peered":"2024-05-08T18:08:21.141205+0000","last_clean":"2024-05-08T18:08:21.141205+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:08:21.141205+0000","last_undegraded":"2024-05-08T18:08:21.141205+0000","last_fullsized":"2024-05-08T18:08:21.141205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142021+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:08:21.142021+0000","last_peered":"2024-05-08T18:08:21.142021+0000","last_clean":"2024-05-08T18:08:21.142021+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:08:21.142021+0000","last_undegraded":"2024-05-08T18:08:21.142021+0000","last_fullsized":"2024-05-08T18:08:21.142021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.808837+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:08:20.808837+0000","last_peered":"2024-05-08T18:08:20.808837+0000","last_clean":"2024-05-08T18:08:20.808837+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:08:20.808837+0000","last_undegraded":"2024-05-08T18:08:20.808837+0000","last_fullsized":"2024-05-08T18:08:20.808837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.146998+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:08:21.146998+0000","last_peered":"2024-05-08T18:08:21.146998+0000","last_clean":"2024-05-08T18:08:21.146998+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:08:21.146998+0000","last_undegraded":"2024-05-08T18:08:21.146998+0000","last_fullsized":"2024-05-08T18:08:21.146998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139019+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:08:21.139019+0000","last_peered":"2024-05-08T18:08:21.139019+0000","last_clean":"2024-05-08T18:08:21.139019+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:08:21.139019+0000","last_undegraded":"2024-05-08T18:08:21.139019+0000","last_fullsized":"2024-05-08T18:08:21.139019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.814569+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:08:20.814569+0000","last_peered":"2024-05-08T18:08:20.814569+0000","last_clean":"2024-05-08T18:08:20.814569+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:08:20.814569+0000","last_undegraded":"2024-05-08T18:08:20.814569+0000","last_fullsized":"2024-05-08T18:08:20.814569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812509+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:08:20.812509+0000","last_peered":"2024-05-08T18:08:20.812509+0000","last_clean":"2024-05-08T18:08:20.812509+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:08:20.812509+0000","last_undegraded":"2024-05-08T18:08:20.812509+0000","last_fullsized":"2024-05-08T18:08:20.812509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":68,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.138508+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:08:21.138508+0000","last_peered":"2024-05-08T18:08:21.138508+0000","last_clean":"2024-05-08T18:08:21.138508+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:08:21.138508+0000","last_undegraded":"2024-05-08T18:08:21.138508+0000","last_fullsized":"2024-05-08T18:08:21.138508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142317+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:08:21.142317+0000","last_peered":"2024-05-08T18:08:21.142317+0000","last_clean":"2024-05-08T18:08:21.142317+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:08:21.142317+0000","last_undegraded":"2024-05-08T18:08:21.142317+0000","last_fullsized":"2024-05-08T18:08:21.142317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.145576+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:08:21.145576+0000","last_peered":"2024-05-08T18:08:21.145576+0000","last_clean":"2024-05-08T18:08:21.145576+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:08:21.145576+0000","last_undegraded":"2024-05-08T18:08:21.145576+0000","last_fullsized":"2024-05-08T18:08:21.145576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140484+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:08:21.140484+0000","last_peered":"2024-05-08T18:08:21.140484+0000","last_clean":"2024-05-08T18:08:21.140484+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:08:21.140484+0000","last_undegraded":"2024-05-08T18:08:21.140484+0000","last_fullsized":"2024-05-08T18:08:21.140484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143906+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:08:21.143906+0000","last_peered":"2024-05-08T18:08:21.143906+0000","last_clean":"2024-05-08T18:08:21.143906+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:08:21.143906+0000","last_undegraded":"2024-05-08T18:08:21.143906+0000","last_fullsized":"2024-05-08T18:08:21.143906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":87,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811739+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:08:20.811739+0000","last_peered":"2024-05-08T18:08:20.811739+0000","last_clean":"2024-05-08T18:08:20.811739+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:08:20.811739+0000","last_undegraded":"2024-05-08T18:08:20.811739+0000","last_fullsized":"2024-05-08T18:08:20.811739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818357+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:08:20.818357+0000","last_peered":"2024-05-08T18:08:20.818357+0000","last_clean":"2024-05-08T18:08:20.818357+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:08:20.818357+0000","last_undegraded":"2024-05-08T18:08:20.818357+0000","last_fullsized":"2024-05-08T18:08:20.818357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818126+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:08:20.818126+0000","last_peered":"2024-05-08T18:08:20.818126+0000","last_clean":"2024-05-08T18:08:20.818126+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:08:20.818126+0000","last_undegraded":"2024-05-08T18:08:20.818126+0000","last_fullsized":"2024-05-08T18:08:20.818126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143722+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:08:21.143722+0000","last_peered":"2024-05-08T18:08:21.143722+0000","last_clean":"2024-05-08T18:08:21.143722+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:08:21.143722+0000","last_undegraded":"2024-05-08T18:08:21.143722+0000","last_fullsized":"2024-05-08T18:08:21.143722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139959+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:08:21.139959+0000","last_peered":"2024-05-08T18:08:21.139959+0000","last_clean":"2024-05-08T18:08:21.139959+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:08:21.139959+0000","last_undegraded":"2024-05-08T18:08:21.139959+0000","last_fullsized":"2024-05-08T18:08:21.139959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":100,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817211+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:08:20.817211+0000","last_peered":"2024-05-08T18:08:20.817211+0000","last_clean":"2024-05-08T18:08:20.817211+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:08:20.817211+0000","last_undegraded":"2024-05-08T18:08:20.817211+0000","last_fullsized":"2024-05-08T18:08:20.817211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.138880+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:08:21.138880+0000","last_peered":"2024-05-08T18:08:21.138880+0000","last_clean":"2024-05-08T18:08:21.138880+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:08:21.138880+0000","last_undegraded":"2024-05-08T18:08:21.138880+0000","last_fullsized":"2024-05-08T18:08:21.138880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141190+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:08:21.141190+0000","last_peered":"2024-05-08T18:08:21.141190+0000","last_clean":"2024-05-08T18:08:21.141190+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:08:21.141190+0000","last_undegraded":"2024-05-08T18:08:21.141190+0000","last_fullsized":"2024-05-08T18:08:21.141190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809958+0000","last_change":"2024-05-08T18:07:55.356946+0000","last_active":"2024-05-08T18:08:20.809958+0000","last_peered":"2024-05-08T18:08:20.809958+0000","last_clean":"2024-05-08T18:08:20.809958+0000","last_became_active":"2024-05-08T18:07:55.355948+0000","last_became_peered":"2024-05-08T18:07:55.355948+0000","last_unstale":"2024-05-08T18:08:20.809958+0000","last_undegraded":"2024-05-08T18:08:20.809958+0000","last_fullsized":"2024-05-08T18:08:20.809958+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:04.163382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813399+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:08:20.813399+0000","last_peered":"2024-05-08T18:08:20.813399+0000","last_clean":"2024-05-08T18:08:20.813399+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:08:20.813399+0000","last_undegraded":"2024-05-08T18:08:20.813399+0000","last_fullsized":"2024-05-08T18:08:20.813399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141697+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:08:21.141697+0000","last_peered":"2024-05-08T18:08:21.141697+0000","last_clean":"2024-05-08T18:08:21.141697+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:08:21.141697+0000","last_undegraded":"2024-05-08T18:08:21.141697+0000","last_fullsized":"2024-05-08T18:08:21.141697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810643+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:08:20.810643+0000","last_peered":"2024-05-08T18:08:20.810643+0000","last_clean":"2024-05-08T18:08:20.810643+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:08:20.810643+0000","last_undegraded":"2024-05-08T18:08:20.810643+0000","last_fullsized":"2024-05-08T18:08:20.810643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.819089+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:08:20.819089+0000","last_peered":"2024-05-08T18:08:20.819089+0000","last_clean":"2024-05-08T18:08:20.819089+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:08:20.819089+0000","last_undegraded":"2024-05-08T18:08:20.819089+0000","last_fullsized":"2024-05-08T18:08:20.819089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811412+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:08:20.811412+0000","last_peered":"2024-05-08T18:08:20.811412+0000","last_clean":"2024-05-08T18:08:20.811412+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:08:20.811412+0000","last_undegraded":"2024-05-08T18:08:20.811412+0000","last_fullsized":"2024-05-08T18:08:20.811412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810886+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:08:20.810886+0000","last_peered":"2024-05-08T18:08:20.810886+0000","last_clean":"2024-05-08T18:08:20.810886+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:08:20.810886+0000","last_undegraded":"2024-05-08T18:08:20.810886+0000","last_fullsized":"2024-05-08T18:08:20.810886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142694+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:08:21.142694+0000","last_peered":"2024-05-08T18:08:21.142694+0000","last_clean":"2024-05-08T18:08:21.142694+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:08:21.142694+0000","last_undegraded":"2024-05-08T18:08:21.142694+0000","last_fullsized":"2024-05-08T18:08:21.142694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141449+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:08:21.141449+0000","last_peered":"2024-05-08T18:08:21.141449+0000","last_clean":"2024-05-08T18:08:21.141449+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:08:21.141449+0000","last_undegraded":"2024-05-08T18:08:21.141449+0000","last_fullsized":"2024-05-08T18:08:21.141449+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142827+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:08:21.142827+0000","last_peered":"2024-05-08T18:08:21.142827+0000","last_clean":"2024-05-08T18:08:21.142827+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:08:21.142827+0000","last_undegraded":"2024-05-08T18:08:21.142827+0000","last_fullsized":"2024-05-08T18:08:21.142827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142195+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:08:21.142195+0000","last_peered":"2024-05-08T18:08:21.142195+0000","last_clean":"2024-05-08T18:08:21.142195+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:08:21.142195+0000","last_undegraded":"2024-05-08T18:08:21.142195+0000","last_fullsized":"2024-05-08T18:08:21.142195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139987+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:08:21.139987+0000","last_peered":"2024-05-08T18:08:21.139987+0000","last_clean":"2024-05-08T18:08:21.139987+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:08:21.139987+0000","last_undegraded":"2024-05-08T18:08:21.139987+0000","last_fullsized":"2024-05-08T18:08:21.139987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811408+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:08:20.811408+0000","last_peered":"2024-05-08T18:08:20.811408+0000","last_clean":"2024-05-08T18:08:20.811408+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:08:20.811408+0000","last_undegraded":"2024-05-08T18:08:20.811408+0000","last_fullsized":"2024-05-08T18:08:20.811408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809303+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:08:20.809303+0000","last_peered":"2024-05-08T18:08:20.809303+0000","last_clean":"2024-05-08T18:08:20.809303+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:08:20.809303+0000","last_undegraded":"2024-05-08T18:08:20.809303+0000","last_fullsized":"2024-05-08T18:08:20.809303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142142+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:08:21.142142+0000","last_peered":"2024-05-08T18:08:21.142142+0000","last_clean":"2024-05-08T18:08:21.142142+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:08:21.142142+0000","last_undegraded":"2024-05-08T18:08:21.142142+0000","last_fullsized":"2024-05-08T18:08:21.142142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812562+0000","last_change":"2024-05-08T18:07:21.533056+0000","last_active":"2024-05-08T18:08:20.812562+0000","last_peered":"2024-05-08T18:08:20.812562+0000","last_clean":"2024-05-08T18:08:20.812562+0000","last_became_active":"2024-05-08T18:07:21.532184+0000","last_became_peered":"2024-05-08T18:07:21.532184+0000","last_unstale":"2024-05-08T18:08:20.812562+0000","last_undegraded":"2024-05-08T18:08:20.812562+0000","last_fullsized":"2024-05-08T18:08:20.812562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:50.629014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.138952+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:08:21.138952+0000","last_peered":"2024-05-08T18:08:21.138952+0000","last_clean":"2024-05-08T18:08:21.138952+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:08:21.138952+0000","last_undegraded":"2024-05-08T18:08:21.138952+0000","last_fullsized":"2024-05-08T18:08:21.138952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810316+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:08:20.810316+0000","last_peered":"2024-05-08T18:08:20.810316+0000","last_clean":"2024-05-08T18:08:20.810316+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:08:20.810316+0000","last_undegraded":"2024-05-08T18:08:20.810316+0000","last_fullsized":"2024-05-08T18:08:20.810316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141498+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:08:21.141498+0000","last_peered":"2024-05-08T18:08:21.141498+0000","last_clean":"2024-05-08T18:08:21.141498+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:08:21.141498+0000","last_undegraded":"2024-05-08T18:08:21.141498+0000","last_fullsized":"2024-05-08T18:08:21.141498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812188+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:08:20.812188+0000","last_peered":"2024-05-08T18:08:20.812188+0000","last_clean":"2024-05-08T18:08:20.812188+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:08:20.812188+0000","last_undegraded":"2024-05-08T18:08:20.812188+0000","last_fullsized":"2024-05-08T18:08:20.812188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":83,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811132+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:08:20.811132+0000","last_peered":"2024-05-08T18:08:20.811132+0000","last_clean":"2024-05-08T18:08:20.811132+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:08:20.811132+0000","last_undegraded":"2024-05-08T18:08:20.811132+0000","last_fullsized":"2024-05-08T18:08:20.811132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":105,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144414+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:08:21.144414+0000","last_peered":"2024-05-08T18:08:21.144414+0000","last_clean":"2024-05-08T18:08:21.144414+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:08:21.144414+0000","last_undegraded":"2024-05-08T18:08:21.144414+0000","last_fullsized":"2024-05-08T18:08:21.144414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":72,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139624+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:08:21.139624+0000","last_peered":"2024-05-08T18:08:21.139624+0000","last_clean":"2024-05-08T18:08:21.139624+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:08:21.139624+0000","last_undegraded":"2024-05-08T18:08:21.139624+0000","last_fullsized":"2024-05-08T18:08:21.139624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141108+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:08:21.141108+0000","last_peered":"2024-05-08T18:08:21.141108+0000","last_clean":"2024-05-08T18:08:21.141108+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:08:21.141108+0000","last_undegraded":"2024-05-08T18:08:21.141108+0000","last_fullsized":"2024-05-08T18:08:21.141108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139551+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:08:21.139551+0000","last_peered":"2024-05-08T18:08:21.139551+0000","last_clean":"2024-05-08T18:08:21.139551+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:08:21.139551+0000","last_undegraded":"2024-05-08T18:08:21.139551+0000","last_fullsized":"2024-05-08T18:08:21.139551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":192,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144149+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:08:21.144149+0000","last_peered":"2024-05-08T18:08:21.144149+0000","last_clean":"2024-05-08T18:08:21.144149+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:08:21.144149+0000","last_undegraded":"2024-05-08T18:08:21.144149+0000","last_fullsized":"2024-05-08T18:08:21.144149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141392+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:08:21.141392+0000","last_peered":"2024-05-08T18:08:21.141392+0000","last_clean":"2024-05-08T18:08:21.141392+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:08:21.141392+0000","last_undegraded":"2024-05-08T18:08:21.141392+0000","last_fullsized":"2024-05-08T18:08:21.141392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813199+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:08:20.813199+0000","last_peered":"2024-05-08T18:08:20.813199+0000","last_clean":"2024-05-08T18:08:20.813199+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:08:20.813199+0000","last_undegraded":"2024-05-08T18:08:20.813199+0000","last_fullsized":"2024-05-08T18:08:20.813199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143431+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:08:21.143431+0000","last_peered":"2024-05-08T18:08:21.143431+0000","last_clean":"2024-05-08T18:08:21.143431+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:08:21.143431+0000","last_undegraded":"2024-05-08T18:08:21.143431+0000","last_fullsized":"2024-05-08T18:08:21.143431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":104,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142684+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:08:21.142684+0000","last_peered":"2024-05-08T18:08:21.142684+0000","last_clean":"2024-05-08T18:08:21.142684+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:08:21.142684+0000","last_undegraded":"2024-05-08T18:08:21.142684+0000","last_fullsized":"2024-05-08T18:08:21.142684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818475+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:08:20.818475+0000","last_peered":"2024-05-08T18:08:20.818475+0000","last_clean":"2024-05-08T18:08:20.818475+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:08:20.818475+0000","last_undegraded":"2024-05-08T18:08:20.818475+0000","last_fullsized":"2024-05-08T18:08:20.818475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":68,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140717+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:08:21.140717+0000","last_peered":"2024-05-08T18:08:21.140717+0000","last_clean":"2024-05-08T18:08:21.140717+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:08:21.140717+0000","last_undegraded":"2024-05-08T18:08:21.140717+0000","last_fullsized":"2024-05-08T18:08:21.140717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818686+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:08:20.818686+0000","last_peered":"2024-05-08T18:08:20.818686+0000","last_clean":"2024-05-08T18:08:20.818686+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:08:20.818686+0000","last_undegraded":"2024-05-08T18:08:20.818686+0000","last_fullsized":"2024-05-08T18:08:20.818686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143672+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:08:21.143672+0000","last_peered":"2024-05-08T18:08:21.143672+0000","last_clean":"2024-05-08T18:08:21.143672+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:08:21.143672+0000","last_undegraded":"2024-05-08T18:08:21.143672+0000","last_fullsized":"2024-05-08T18:08:21.143672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817355+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:08:20.817355+0000","last_peered":"2024-05-08T18:08:20.817355+0000","last_clean":"2024-05-08T18:08:20.817355+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:08:20.817355+0000","last_undegraded":"2024-05-08T18:08:20.817355+0000","last_fullsized":"2024-05-08T18:08:20.817355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143331+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:08:21.143331+0000","last_peered":"2024-05-08T18:08:21.143331+0000","last_clean":"2024-05-08T18:08:21.143331+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:08:21.143331+0000","last_undegraded":"2024-05-08T18:08:21.143331+0000","last_fullsized":"2024-05-08T18:08:21.143331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":131,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141352+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:08:21.141352+0000","last_peered":"2024-05-08T18:08:21.141352+0000","last_clean":"2024-05-08T18:08:21.141352+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:08:21.141352+0000","last_undegraded":"2024-05-08T18:08:21.141352+0000","last_fullsized":"2024-05-08T18:08:21.141352+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144158+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:08:21.144158+0000","last_peered":"2024-05-08T18:08:21.144158+0000","last_clean":"2024-05-08T18:08:21.144158+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:08:21.144158+0000","last_undegraded":"2024-05-08T18:08:21.144158+0000","last_fullsized":"2024-05-08T18:08:21.144158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140436+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:08:21.140436+0000","last_peered":"2024-05-08T18:08:21.140436+0000","last_clean":"2024-05-08T18:08:21.140436+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:08:21.140436+0000","last_undegraded":"2024-05-08T18:08:21.140436+0000","last_fullsized":"2024-05-08T18:08:21.140436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141588+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:08:21.141588+0000","last_peered":"2024-05-08T18:08:21.141588+0000","last_clean":"2024-05-08T18:08:21.141588+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:08:21.141588+0000","last_undegraded":"2024-05-08T18:08:21.141588+0000","last_fullsized":"2024-05-08T18:08:21.141588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139509+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:08:21.139509+0000","last_peered":"2024-05-08T18:08:21.139509+0000","last_clean":"2024-05-08T18:08:21.139509+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:08:21.139509+0000","last_undegraded":"2024-05-08T18:08:21.139509+0000","last_fullsized":"2024-05-08T18:08:21.139509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139441+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:08:21.139441+0000","last_peered":"2024-05-08T18:08:21.139441+0000","last_clean":"2024-05-08T18:08:21.139441+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:08:21.139441+0000","last_undegraded":"2024-05-08T18:08:21.139441+0000","last_fullsized":"2024-05-08T18:08:21.139441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":83,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142352+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:08:21.142352+0000","last_peered":"2024-05-08T18:08:21.142352+0000","last_clean":"2024-05-08T18:08:21.142352+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:08:21.142352+0000","last_undegraded":"2024-05-08T18:08:21.142352+0000","last_fullsized":"2024-05-08T18:08:21.142352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":111,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144871+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:08:21.144871+0000","last_peered":"2024-05-08T18:08:21.144871+0000","last_clean":"2024-05-08T18:08:21.144871+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:08:21.144871+0000","last_undegraded":"2024-05-08T18:08:21.144871+0000","last_fullsized":"2024-05-08T18:08:21.144871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817648+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:08:20.817648+0000","last_peered":"2024-05-08T18:08:20.817648+0000","last_clean":"2024-05-08T18:08:20.817648+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:08:20.817648+0000","last_undegraded":"2024-05-08T18:08:20.817648+0000","last_fullsized":"2024-05-08T18:08:20.817648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.814144+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:08:20.814144+0000","last_peered":"2024-05-08T18:08:20.814144+0000","last_clean":"2024-05-08T18:08:20.814144+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:08:20.814144+0000","last_undegraded":"2024-05-08T18:08:20.814144+0000","last_fullsized":"2024-05-08T18:08:20.814144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141641+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:08:21.141641+0000","last_peered":"2024-05-08T18:08:21.141641+0000","last_clean":"2024-05-08T18:08:21.141641+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:08:21.141641+0000","last_undegraded":"2024-05-08T18:08:21.141641+0000","last_fullsized":"2024-05-08T18:08:21.141641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140596+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:08:21.140596+0000","last_peered":"2024-05-08T18:08:21.140596+0000","last_clean":"2024-05-08T18:08:21.140596+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:08:21.140596+0000","last_undegraded":"2024-05-08T18:08:21.140596+0000","last_fullsized":"2024-05-08T18:08:21.140596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810204+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:08:20.810204+0000","last_peered":"2024-05-08T18:08:20.810204+0000","last_clean":"2024-05-08T18:08:20.810204+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:08:20.810204+0000","last_undegraded":"2024-05-08T18:08:20.810204+0000","last_fullsized":"2024-05-08T18:08:20.810204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817657+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:08:20.817657+0000","last_peered":"2024-05-08T18:08:20.817657+0000","last_clean":"2024-05-08T18:08:20.817657+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:08:20.817657+0000","last_undegraded":"2024-05-08T18:08:20.817657+0000","last_fullsized":"2024-05-08T18:08:20.817657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.815375+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:08:20.815375+0000","last_peered":"2024-05-08T18:08:20.815375+0000","last_clean":"2024-05-08T18:08:20.815375+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:08:20.815375+0000","last_undegraded":"2024-05-08T18:08:20.815375+0000","last_fullsized":"2024-05-08T18:08:20.815375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":72,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141221+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:08:21.141221+0000","last_peered":"2024-05-08T18:08:21.141221+0000","last_clean":"2024-05-08T18:08:21.141221+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:08:21.141221+0000","last_undegraded":"2024-05-08T18:08:21.141221+0000","last_fullsized":"2024-05-08T18:08:21.141221+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.137749+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:08:21.137749+0000","last_peered":"2024-05-08T18:08:21.137749+0000","last_clean":"2024-05-08T18:08:21.137749+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:08:21.137749+0000","last_undegraded":"2024-05-08T18:08:21.137749+0000","last_fullsized":"2024-05-08T18:08:21.137749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140768+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:08:21.140768+0000","last_peered":"2024-05-08T18:08:21.140768+0000","last_clean":"2024-05-08T18:08:21.140768+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:08:21.140768+0000","last_undegraded":"2024-05-08T18:08:21.140768+0000","last_fullsized":"2024-05-08T18:08:21.140768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.145106+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:08:21.145106+0000","last_peered":"2024-05-08T18:08:21.145106+0000","last_clean":"2024-05-08T18:08:21.145106+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:08:21.145106+0000","last_undegraded":"2024-05-08T18:08:21.145106+0000","last_fullsized":"2024-05-08T18:08:21.145106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141886+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:08:21.141886+0000","last_peered":"2024-05-08T18:08:21.141886+0000","last_clean":"2024-05-08T18:08:21.141886+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:08:21.141886+0000","last_undegraded":"2024-05-08T18:08:21.141886+0000","last_fullsized":"2024-05-08T18:08:21.141886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817632+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:08:20.817632+0000","last_peered":"2024-05-08T18:08:20.817632+0000","last_clean":"2024-05-08T18:08:20.817632+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:08:20.817632+0000","last_undegraded":"2024-05-08T18:08:20.817632+0000","last_fullsized":"2024-05-08T18:08:20.817632+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":109,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811888+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:08:20.811888+0000","last_peered":"2024-05-08T18:08:20.811888+0000","last_clean":"2024-05-08T18:08:20.811888+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:08:20.811888+0000","last_undegraded":"2024-05-08T18:08:20.811888+0000","last_fullsized":"2024-05-08T18:08:20.811888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.808644+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:08:20.808644+0000","last_peered":"2024-05-08T18:08:20.808644+0000","last_clean":"2024-05-08T18:08:20.808644+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:08:20.808644+0000","last_undegraded":"2024-05-08T18:08:20.808644+0000","last_fullsized":"2024-05-08T18:08:20.808644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818109+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:08:20.818109+0000","last_peered":"2024-05-08T18:08:20.818109+0000","last_clean":"2024-05-08T18:08:20.818109+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:08:20.818109+0000","last_undegraded":"2024-05-08T18:08:20.818109+0000","last_fullsized":"2024-05-08T18:08:20.818109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818105+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:08:20.818105+0000","last_peered":"2024-05-08T18:08:20.818105+0000","last_clean":"2024-05-08T18:08:20.818105+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:08:20.818105+0000","last_undegraded":"2024-05-08T18:08:20.818105+0000","last_fullsized":"2024-05-08T18:08:20.818105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141724+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:08:21.141724+0000","last_peered":"2024-05-08T18:08:21.141724+0000","last_clean":"2024-05-08T18:08:21.141724+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:08:21.141724+0000","last_undegraded":"2024-05-08T18:08:21.141724+0000","last_fullsized":"2024-05-08T18:08:21.141724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.146168+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:08:21.146168+0000","last_peered":"2024-05-08T18:08:21.146168+0000","last_clean":"2024-05-08T18:08:21.146168+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:08:21.146168+0000","last_undegraded":"2024-05-08T18:08:21.146168+0000","last_fullsized":"2024-05-08T18:08:21.146168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":80,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141653+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:08:21.141653+0000","last_peered":"2024-05-08T18:08:21.141653+0000","last_clean":"2024-05-08T18:08:21.141653+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:08:21.141653+0000","last_undegraded":"2024-05-08T18:08:21.141653+0000","last_fullsized":"2024-05-08T18:08:21.141653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139678+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:08:21.139678+0000","last_peered":"2024-05-08T18:08:21.139678+0000","last_clean":"2024-05-08T18:08:21.139678+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:08:21.139678+0000","last_undegraded":"2024-05-08T18:08:21.139678+0000","last_fullsized":"2024-05-08T18:08:21.139678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":87,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.138168+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:08:21.138168+0000","last_peered":"2024-05-08T18:08:21.138168+0000","last_clean":"2024-05-08T18:08:21.138168+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:08:21.138168+0000","last_undegraded":"2024-05-08T18:08:21.138168+0000","last_fullsized":"2024-05-08T18:08:21.138168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813248+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:08:20.813248+0000","last_peered":"2024-05-08T18:08:20.813248+0000","last_clean":"2024-05-08T18:08:20.813248+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:08:20.813248+0000","last_undegraded":"2024-05-08T18:08:20.813248+0000","last_fullsized":"2024-05-08T18:08:20.813248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811825+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:08:20.811825+0000","last_peered":"2024-05-08T18:08:20.811825+0000","last_clean":"2024-05-08T18:08:20.811825+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:08:20.811825+0000","last_undegraded":"2024-05-08T18:08:20.811825+0000","last_fullsized":"2024-05-08T18:08:20.811825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812979+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:08:20.812979+0000","last_peered":"2024-05-08T18:08:20.812979+0000","last_clean":"2024-05-08T18:08:20.812979+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:08:20.812979+0000","last_undegraded":"2024-05-08T18:08:20.812979+0000","last_fullsized":"2024-05-08T18:08:20.812979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140472+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:08:21.140472+0000","last_peered":"2024-05-08T18:08:21.140472+0000","last_clean":"2024-05-08T18:08:21.140472+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:08:21.140472+0000","last_undegraded":"2024-05-08T18:08:21.140472+0000","last_fullsized":"2024-05-08T18:08:21.140472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.808817+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:08:20.808817+0000","last_peered":"2024-05-08T18:08:20.808817+0000","last_clean":"2024-05-08T18:08:20.808817+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:08:20.808817+0000","last_undegraded":"2024-05-08T18:08:20.808817+0000","last_fullsized":"2024-05-08T18:08:20.808817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810642+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:08:20.810642+0000","last_peered":"2024-05-08T18:08:20.810642+0000","last_clean":"2024-05-08T18:08:20.810642+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:08:20.810642+0000","last_undegraded":"2024-05-08T18:08:20.810642+0000","last_fullsized":"2024-05-08T18:08:20.810642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.815193+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:08:20.815193+0000","last_peered":"2024-05-08T18:08:20.815193+0000","last_clean":"2024-05-08T18:08:20.815193+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:08:20.815193+0000","last_undegraded":"2024-05-08T18:08:20.815193+0000","last_fullsized":"2024-05-08T18:08:20.815193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817858+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:08:20.817858+0000","last_peered":"2024-05-08T18:08:20.817858+0000","last_clean":"2024-05-08T18:08:20.817858+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:08:20.817858+0000","last_undegraded":"2024-05-08T18:08:20.817858+0000","last_fullsized":"2024-05-08T18:08:20.817858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.808940+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:08:20.808940+0000","last_peered":"2024-05-08T18:08:20.808940+0000","last_clean":"2024-05-08T18:08:20.808940+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:08:20.808940+0000","last_undegraded":"2024-05-08T18:08:20.808940+0000","last_fullsized":"2024-05-08T18:08:20.808940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818892+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:08:20.818892+0000","last_peered":"2024-05-08T18:08:20.818892+0000","last_clean":"2024-05-08T18:08:20.818892+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:08:20.818892+0000","last_undegraded":"2024-05-08T18:08:20.818892+0000","last_fullsized":"2024-05-08T18:08:20.818892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142189+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:08:21.142189+0000","last_peered":"2024-05-08T18:08:21.142189+0000","last_clean":"2024-05-08T18:08:21.142189+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:08:21.142189+0000","last_undegraded":"2024-05-08T18:08:21.142189+0000","last_fullsized":"2024-05-08T18:08:21.142189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811682+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:08:20.811682+0000","last_peered":"2024-05-08T18:08:20.811682+0000","last_clean":"2024-05-08T18:08:20.811682+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:08:20.811682+0000","last_undegraded":"2024-05-08T18:08:20.811682+0000","last_fullsized":"2024-05-08T18:08:20.811682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":114,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141447+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:08:21.141447+0000","last_peered":"2024-05-08T18:08:21.141447+0000","last_clean":"2024-05-08T18:08:21.141447+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:08:21.141447+0000","last_undegraded":"2024-05-08T18:08:21.141447+0000","last_fullsized":"2024-05-08T18:08:21.141447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812712+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:08:20.812712+0000","last_peered":"2024-05-08T18:08:20.812712+0000","last_clean":"2024-05-08T18:08:20.812712+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:08:20.812712+0000","last_undegraded":"2024-05-08T18:08:20.812712+0000","last_fullsized":"2024-05-08T18:08:20.812712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144109+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:08:21.144109+0000","last_peered":"2024-05-08T18:08:21.144109+0000","last_clean":"2024-05-08T18:08:21.144109+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:08:21.144109+0000","last_undegraded":"2024-05-08T18:08:21.144109+0000","last_fullsized":"2024-05-08T18:08:21.144109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.819010+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:08:20.819010+0000","last_peered":"2024-05-08T18:08:20.819010+0000","last_clean":"2024-05-08T18:08:20.819010+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:08:20.819010+0000","last_undegraded":"2024-05-08T18:08:20.819010+0000","last_fullsized":"2024-05-08T18:08:20.819010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809518+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:08:20.809518+0000","last_peered":"2024-05-08T18:08:20.809518+0000","last_clean":"2024-05-08T18:08:20.809518+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:08:20.809518+0000","last_undegraded":"2024-05-08T18:08:20.809518+0000","last_fullsized":"2024-05-08T18:08:20.809518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809563+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:08:20.809563+0000","last_peered":"2024-05-08T18:08:20.809563+0000","last_clean":"2024-05-08T18:08:20.809563+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:08:20.809563+0000","last_undegraded":"2024-05-08T18:08:20.809563+0000","last_fullsized":"2024-05-08T18:08:20.809563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140853+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:08:21.140853+0000","last_peered":"2024-05-08T18:08:21.140853+0000","last_clean":"2024-05-08T18:08:21.140853+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:08:21.140853+0000","last_undegraded":"2024-05-08T18:08:21.140853+0000","last_fullsized":"2024-05-08T18:08:21.140853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811952+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:08:20.811952+0000","last_peered":"2024-05-08T18:08:20.811952+0000","last_clean":"2024-05-08T18:08:20.811952+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:08:20.811952+0000","last_undegraded":"2024-05-08T18:08:20.811952+0000","last_fullsized":"2024-05-08T18:08:20.811952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811531+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:08:20.811531+0000","last_peered":"2024-05-08T18:08:20.811531+0000","last_clean":"2024-05-08T18:08:20.811531+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:08:20.811531+0000","last_undegraded":"2024-05-08T18:08:20.811531+0000","last_fullsized":"2024-05-08T18:08:20.811531+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812738+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:08:20.812738+0000","last_peered":"2024-05-08T18:08:20.812738+0000","last_clean":"2024-05-08T18:08:20.812738+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:08:20.812738+0000","last_undegraded":"2024-05-08T18:08:20.812738+0000","last_fullsized":"2024-05-08T18:08:20.812738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140683+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:08:21.140683+0000","last_peered":"2024-05-08T18:08:21.140683+0000","last_clean":"2024-05-08T18:08:21.140683+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:08:21.140683+0000","last_undegraded":"2024-05-08T18:08:21.140683+0000","last_fullsized":"2024-05-08T18:08:21.140683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.145363+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:08:21.145363+0000","last_peered":"2024-05-08T18:08:21.145363+0000","last_clean":"2024-05-08T18:08:21.145363+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:08:21.145363+0000","last_undegraded":"2024-05-08T18:08:21.145363+0000","last_fullsized":"2024-05-08T18:08:21.145363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813991+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:08:20.813991+0000","last_peered":"2024-05-08T18:08:20.813991+0000","last_clean":"2024-05-08T18:08:20.813991+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:08:20.813991+0000","last_undegraded":"2024-05-08T18:08:20.813991+0000","last_fullsized":"2024-05-08T18:08:20.813991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"48'5","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812035+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:08:20.812035+0000","last_peered":"2024-05-08T18:08:20.812035+0000","last_clean":"2024-05-08T18:08:20.812035+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:08:20.812035+0000","last_undegraded":"2024-05-08T18:08:20.812035+0000","last_fullsized":"2024-05-08T18:08:20.812035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139348+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:08:21.139348+0000","last_peered":"2024-05-08T18:08:21.139348+0000","last_clean":"2024-05-08T18:08:21.139348+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:08:21.139348+0000","last_undegraded":"2024-05-08T18:08:21.139348+0000","last_fullsized":"2024-05-08T18:08:21.139348+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817661+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:08:20.817661+0000","last_peered":"2024-05-08T18:08:20.817661+0000","last_clean":"2024-05-08T18:08:20.817661+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:08:20.817661+0000","last_undegraded":"2024-05-08T18:08:20.817661+0000","last_fullsized":"2024-05-08T18:08:20.817661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.815972+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:08:20.815972+0000","last_peered":"2024-05-08T18:08:20.815972+0000","last_clean":"2024-05-08T18:08:20.815972+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:08:20.815972+0000","last_undegraded":"2024-05-08T18:08:20.815972+0000","last_fullsized":"2024-05-08T18:08:20.815972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141489+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:08:21.141489+0000","last_peered":"2024-05-08T18:08:21.141489+0000","last_clean":"2024-05-08T18:08:21.141489+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:08:21.141489+0000","last_undegraded":"2024-05-08T18:08:21.141489+0000","last_fullsized":"2024-05-08T18:08:21.141489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142772+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:08:21.142772+0000","last_peered":"2024-05-08T18:08:21.142772+0000","last_clean":"2024-05-08T18:08:21.142772+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:08:21.142772+0000","last_undegraded":"2024-05-08T18:08:21.142772+0000","last_fullsized":"2024-05-08T18:08:21.142772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813662+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:08:20.813662+0000","last_peered":"2024-05-08T18:08:20.813662+0000","last_clean":"2024-05-08T18:08:20.813662+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:08:20.813662+0000","last_undegraded":"2024-05-08T18:08:20.813662+0000","last_fullsized":"2024-05-08T18:08:20.813662+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":72,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141420+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:08:21.141420+0000","last_peered":"2024-05-08T18:08:21.141420+0000","last_clean":"2024-05-08T18:08:21.141420+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:08:21.141420+0000","last_undegraded":"2024-05-08T18:08:21.141420+0000","last_fullsized":"2024-05-08T18:08:21.141420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141770+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:08:21.141770+0000","last_peered":"2024-05-08T18:08:21.141770+0000","last_clean":"2024-05-08T18:08:21.141770+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:08:21.141770+0000","last_undegraded":"2024-05-08T18:08:21.141770+0000","last_fullsized":"2024-05-08T18:08:21.141770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811963+0000","last_change":"2024-05-08T18:07:55.359230+0000","last_active":"2024-05-08T18:08:20.811963+0000","last_peered":"2024-05-08T18:08:20.811963+0000","last_clean":"2024-05-08T18:08:20.811963+0000","last_became_active":"2024-05-08T18:07:55.358047+0000","last_became_peered":"2024-05-08T18:07:55.358047+0000","last_unstale":"2024-05-08T18:08:20.811963+0000","last_undegraded":"2024-05-08T18:08:20.811963+0000","last_fullsized":"2024-05-08T18:08:20.811963+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:52.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.819237+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:08:20.819237+0000","last_peered":"2024-05-08T18:08:20.819237+0000","last_clean":"2024-05-08T18:08:20.819237+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:08:20.819237+0000","last_undegraded":"2024-05-08T18:08:20.819237+0000","last_fullsized":"2024-05-08T18:08:20.819237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":80,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141652+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:08:21.141652+0000","last_peered":"2024-05-08T18:08:21.141652+0000","last_clean":"2024-05-08T18:08:21.141652+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:08:21.141652+0000","last_undegraded":"2024-05-08T18:08:21.141652+0000","last_fullsized":"2024-05-08T18:08:21.141652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142649+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:08:21.142649+0000","last_peered":"2024-05-08T18:08:21.142649+0000","last_clean":"2024-05-08T18:08:21.142649+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:08:21.142649+0000","last_undegraded":"2024-05-08T18:08:21.142649+0000","last_fullsized":"2024-05-08T18:08:21.142649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817387+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:08:20.817387+0000","last_peered":"2024-05-08T18:08:20.817387+0000","last_clean":"2024-05-08T18:08:20.817387+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:08:20.817387+0000","last_undegraded":"2024-05-08T18:08:20.817387+0000","last_fullsized":"2024-05-08T18:08:20.817387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141829+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:08:21.141829+0000","last_peered":"2024-05-08T18:08:21.141829+0000","last_clean":"2024-05-08T18:08:21.141829+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:08:21.141829+0000","last_undegraded":"2024-05-08T18:08:21.141829+0000","last_fullsized":"2024-05-08T18:08:21.141829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812101+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:08:20.812101+0000","last_peered":"2024-05-08T18:08:20.812101+0000","last_clean":"2024-05-08T18:08:20.812101+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:08:20.812101+0000","last_undegraded":"2024-05-08T18:08:20.812101+0000","last_fullsized":"2024-05-08T18:08:20.812101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":83,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818510+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:08:20.818510+0000","last_peered":"2024-05-08T18:08:20.818510+0000","last_clean":"2024-05-08T18:08:20.818510+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:08:20.818510+0000","last_undegraded":"2024-05-08T18:08:20.818510+0000","last_fullsized":"2024-05-08T18:08:20.818510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":101,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142103+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:08:21.142103+0000","last_peered":"2024-05-08T18:08:21.142103+0000","last_clean":"2024-05-08T18:08:21.142103+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:08:21.142103+0000","last_undegraded":"2024-05-08T18:08:21.142103+0000","last_fullsized":"2024-05-08T18:08:21.142103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142245+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:08:21.142245+0000","last_peered":"2024-05-08T18:08:21.142245+0000","last_clean":"2024-05-08T18:08:21.142245+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:08:21.142245+0000","last_undegraded":"2024-05-08T18:08:21.142245+0000","last_fullsized":"2024-05-08T18:08:21.142245+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813207+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:08:20.813207+0000","last_peered":"2024-05-08T18:08:20.813207+0000","last_clean":"2024-05-08T18:08:20.813207+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:08:20.813207+0000","last_undegraded":"2024-05-08T18:08:20.813207+0000","last_fullsized":"2024-05-08T18:08:20.813207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818658+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:08:20.818658+0000","last_peered":"2024-05-08T18:08:20.818658+0000","last_clean":"2024-05-08T18:08:20.818658+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:08:20.818658+0000","last_undegraded":"2024-05-08T18:08:20.818658+0000","last_fullsized":"2024-05-08T18:08:20.818658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140331+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:08:21.140331+0000","last_peered":"2024-05-08T18:08:21.140331+0000","last_clean":"2024-05-08T18:08:21.140331+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:08:21.140331+0000","last_undegraded":"2024-05-08T18:08:21.140331+0000","last_fullsized":"2024-05-08T18:08:21.140331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":80,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141458+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:08:21.141458+0000","last_peered":"2024-05-08T18:08:21.141458+0000","last_clean":"2024-05-08T18:08:21.141458+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:08:21.141458+0000","last_undegraded":"2024-05-08T18:08:21.141458+0000","last_fullsized":"2024-05-08T18:08:21.141458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143055+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:08:21.143055+0000","last_peered":"2024-05-08T18:08:21.143055+0000","last_clean":"2024-05-08T18:08:21.143055+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:08:21.143055+0000","last_undegraded":"2024-05-08T18:08:21.143055+0000","last_fullsized":"2024-05-08T18:08:21.143055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142195+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:08:21.142195+0000","last_peered":"2024-05-08T18:08:21.142195+0000","last_clean":"2024-05-08T18:08:21.142195+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:08:21.142195+0000","last_undegraded":"2024-05-08T18:08:21.142195+0000","last_fullsized":"2024-05-08T18:08:21.142195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":68,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141033+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:08:21.141033+0000","last_peered":"2024-05-08T18:08:21.141033+0000","last_clean":"2024-05-08T18:08:21.141033+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:08:21.141033+0000","last_undegraded":"2024-05-08T18:08:21.141033+0000","last_fullsized":"2024-05-08T18:08:21.141033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812754+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:08:20.812754+0000","last_peered":"2024-05-08T18:08:20.812754+0000","last_clean":"2024-05-08T18:08:20.812754+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:08:20.812754+0000","last_undegraded":"2024-05-08T18:08:20.812754+0000","last_fullsized":"2024-05-08T18:08:20.812754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810989+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:08:20.810989+0000","last_peered":"2024-05-08T18:08:20.810989+0000","last_clean":"2024-05-08T18:08:20.810989+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:08:20.810989+0000","last_undegraded":"2024-05-08T18:08:20.810989+0000","last_fullsized":"2024-05-08T18:08:20.810989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810158+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:08:20.810158+0000","last_peered":"2024-05-08T18:08:20.810158+0000","last_clean":"2024-05-08T18:08:20.810158+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:08:20.810158+0000","last_undegraded":"2024-05-08T18:08:20.810158+0000","last_fullsized":"2024-05-08T18:08:20.810158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813359+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:08:20.813359+0000","last_peered":"2024-05-08T18:08:20.813359+0000","last_clean":"2024-05-08T18:08:20.813359+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:08:20.813359+0000","last_undegraded":"2024-05-08T18:08:20.813359+0000","last_fullsized":"2024-05-08T18:08:20.813359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139763+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:08:21.139763+0000","last_peered":"2024-05-08T18:08:21.139763+0000","last_clean":"2024-05-08T18:08:21.139763+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:08:21.139763+0000","last_undegraded":"2024-05-08T18:08:21.139763+0000","last_fullsized":"2024-05-08T18:08:21.139763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139071+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:08:21.139071+0000","last_peered":"2024-05-08T18:08:21.139071+0000","last_clean":"2024-05-08T18:08:21.139071+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:08:21.139071+0000","last_undegraded":"2024-05-08T18:08:21.139071+0000","last_fullsized":"2024-05-08T18:08:21.139071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141027+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:08:21.141027+0000","last_peered":"2024-05-08T18:08:21.141027+0000","last_clean":"2024-05-08T18:08:21.141027+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:08:21.141027+0000","last_undegraded":"2024-05-08T18:08:21.141027+0000","last_fullsized":"2024-05-08T18:08:21.141027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817504+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:08:20.817504+0000","last_peered":"2024-05-08T18:08:20.817504+0000","last_clean":"2024-05-08T18:08:20.817504+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:08:20.817504+0000","last_undegraded":"2024-05-08T18:08:20.817504+0000","last_fullsized":"2024-05-08T18:08:20.817504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142492+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:08:21.142492+0000","last_peered":"2024-05-08T18:08:21.142492+0000","last_clean":"2024-05-08T18:08:21.142492+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:08:21.142492+0000","last_undegraded":"2024-05-08T18:08:21.142492+0000","last_fullsized":"2024-05-08T18:08:21.142492+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810875+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:08:20.810875+0000","last_peered":"2024-05-08T18:08:20.810875+0000","last_clean":"2024-05-08T18:08:20.810875+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:08:20.810875+0000","last_undegraded":"2024-05-08T18:08:20.810875+0000","last_fullsized":"2024-05-08T18:08:20.810875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140789+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:08:21.140789+0000","last_peered":"2024-05-08T18:08:21.140789+0000","last_clean":"2024-05-08T18:08:21.140789+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:08:21.140789+0000","last_undegraded":"2024-05-08T18:08:21.140789+0000","last_fullsized":"2024-05-08T18:08:21.140789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142493+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:08:21.142493+0000","last_peered":"2024-05-08T18:08:21.142493+0000","last_clean":"2024-05-08T18:08:21.142493+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:08:21.142493+0000","last_undegraded":"2024-05-08T18:08:21.142493+0000","last_fullsized":"2024-05-08T18:08:21.142493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809413+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:08:20.809413+0000","last_peered":"2024-05-08T18:08:20.809413+0000","last_clean":"2024-05-08T18:08:20.809413+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:08:20.809413+0000","last_undegraded":"2024-05-08T18:08:20.809413+0000","last_fullsized":"2024-05-08T18:08:20.809413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142881+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:08:21.142881+0000","last_peered":"2024-05-08T18:08:21.142881+0000","last_clean":"2024-05-08T18:08:21.142881+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:08:21.142881+0000","last_undegraded":"2024-05-08T18:08:21.142881+0000","last_fullsized":"2024-05-08T18:08:21.142881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143198+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:08:21.143198+0000","last_peered":"2024-05-08T18:08:21.143198+0000","last_clean":"2024-05-08T18:08:21.143198+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:08:21.143198+0000","last_undegraded":"2024-05-08T18:08:21.143198+0000","last_fullsized":"2024-05-08T18:08:21.143198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":102,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139462+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:08:21.139462+0000","last_peered":"2024-05-08T18:08:21.139462+0000","last_clean":"2024-05-08T18:08:21.139462+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:08:21.139462+0000","last_undegraded":"2024-05-08T18:08:21.139462+0000","last_fullsized":"2024-05-08T18:08:21.139462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811579+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:08:20.811579+0000","last_peered":"2024-05-08T18:08:20.811579+0000","last_clean":"2024-05-08T18:08:20.811579+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:08:20.811579+0000","last_undegraded":"2024-05-08T18:08:20.811579+0000","last_fullsized":"2024-05-08T18:08:20.811579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.146895+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:08:21.146895+0000","last_peered":"2024-05-08T18:08:21.146895+0000","last_clean":"2024-05-08T18:08:21.146895+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:08:21.146895+0000","last_undegraded":"2024-05-08T18:08:21.146895+0000","last_fullsized":"2024-05-08T18:08:21.146895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810838+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:08:20.810838+0000","last_peered":"2024-05-08T18:08:20.810838+0000","last_clean":"2024-05-08T18:08:20.810838+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:08:20.810838+0000","last_undegraded":"2024-05-08T18:08:20.810838+0000","last_fullsized":"2024-05-08T18:08:20.810838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144982+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:08:21.144982+0000","last_peered":"2024-05-08T18:08:21.144982+0000","last_clean":"2024-05-08T18:08:21.144982+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:08:21.144982+0000","last_undegraded":"2024-05-08T18:08:21.144982+0000","last_fullsized":"2024-05-08T18:08:21.144982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140922+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:08:21.140922+0000","last_peered":"2024-05-08T18:08:21.140922+0000","last_clean":"2024-05-08T18:08:21.140922+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:08:21.140922+0000","last_undegraded":"2024-05-08T18:08:21.140922+0000","last_fullsized":"2024-05-08T18:08:21.140922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811684+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:08:20.811684+0000","last_peered":"2024-05-08T18:08:20.811684+0000","last_clean":"2024-05-08T18:08:20.811684+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:08:20.811684+0000","last_undegraded":"2024-05-08T18:08:20.811684+0000","last_fullsized":"2024-05-08T18:08:20.811684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":72,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141117+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:08:21.141117+0000","last_peered":"2024-05-08T18:08:21.141117+0000","last_clean":"2024-05-08T18:08:21.141117+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:08:21.141117+0000","last_undegraded":"2024-05-08T18:08:21.141117+0000","last_fullsized":"2024-05-08T18:08:21.141117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812838+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:08:20.812838+0000","last_peered":"2024-05-08T18:08:20.812838+0000","last_clean":"2024-05-08T18:08:20.812838+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:08:20.812838+0000","last_undegraded":"2024-05-08T18:08:20.812838+0000","last_fullsized":"2024-05-08T18:08:20.812838+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.816258+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:08:20.816258+0000","last_peered":"2024-05-08T18:08:20.816258+0000","last_clean":"2024-05-08T18:08:20.816258+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:08:20.816258+0000","last_undegraded":"2024-05-08T18:08:20.816258+0000","last_fullsized":"2024-05-08T18:08:20.816258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":36,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139652+0000","last_change":"2024-05-08T18:07:55.439856+0000","last_active":"2024-05-08T18:08:21.139652+0000","last_peered":"2024-05-08T18:08:21.139652+0000","last_clean":"2024-05-08T18:08:21.139652+0000","last_became_active":"2024-05-08T18:07:55.439188+0000","last_became_peered":"2024-05-08T18:07:55.439188+0000","last_unstale":"2024-05-08T18:08:21.139652+0000","last_undegraded":"2024-05-08T18:08:21.139652+0000","last_fullsized":"2024-05-08T18:08:21.139652+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:40.273251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.808506+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:08:20.808506+0000","last_peered":"2024-05-08T18:08:20.808506+0000","last_clean":"2024-05-08T18:08:20.808506+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:08:20.808506+0000","last_undegraded":"2024-05-08T18:08:20.808506+0000","last_fullsized":"2024-05-08T18:08:20.808506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.814927+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:08:20.814927+0000","last_peered":"2024-05-08T18:08:20.814927+0000","last_clean":"2024-05-08T18:08:20.814927+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:08:20.814927+0000","last_undegraded":"2024-05-08T18:08:20.814927+0000","last_fullsized":"2024-05-08T18:08:20.814927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.808892+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:08:20.808892+0000","last_peered":"2024-05-08T18:08:20.808892+0000","last_clean":"2024-05-08T18:08:20.808892+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:08:20.808892+0000","last_undegraded":"2024-05-08T18:08:20.808892+0000","last_fullsized":"2024-05-08T18:08:20.808892+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144628+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:08:21.144628+0000","last_peered":"2024-05-08T18:08:21.144628+0000","last_clean":"2024-05-08T18:08:21.144628+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:08:21.144628+0000","last_undegraded":"2024-05-08T18:08:21.144628+0000","last_fullsized":"2024-05-08T18:08:21.144628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809238+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:08:20.809238+0000","last_peered":"2024-05-08T18:08:20.809238+0000","last_clean":"2024-05-08T18:08:20.809238+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:08:20.809238+0000","last_undegraded":"2024-05-08T18:08:20.809238+0000","last_fullsized":"2024-05-08T18:08:20.809238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.819190+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:08:20.819190+0000","last_peered":"2024-05-08T18:08:20.819190+0000","last_clean":"2024-05-08T18:08:20.819190+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:08:20.819190+0000","last_undegraded":"2024-05-08T18:08:20.819190+0000","last_fullsized":"2024-05-08T18:08:20.819190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":83,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139779+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:08:21.139779+0000","last_peered":"2024-05-08T18:08:21.139779+0000","last_clean":"2024-05-08T18:08:21.139779+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:08:21.139779+0000","last_undegraded":"2024-05-08T18:08:21.139779+0000","last_fullsized":"2024-05-08T18:08:21.139779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809297+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:08:20.809297+0000","last_peered":"2024-05-08T18:08:20.809297+0000","last_clean":"2024-05-08T18:08:20.809297+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:08:20.809297+0000","last_undegraded":"2024-05-08T18:08:20.809297+0000","last_fullsized":"2024-05-08T18:08:20.809297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817301+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:08:20.817301+0000","last_peered":"2024-05-08T18:08:20.817301+0000","last_clean":"2024-05-08T18:08:20.817301+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:08:20.817301+0000","last_undegraded":"2024-05-08T18:08:20.817301+0000","last_fullsized":"2024-05-08T18:08:20.817301+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810239+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:08:20.810239+0000","last_peered":"2024-05-08T18:08:20.810239+0000","last_clean":"2024-05-08T18:08:20.810239+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:08:20.810239+0000","last_undegraded":"2024-05-08T18:08:20.810239+0000","last_fullsized":"2024-05-08T18:08:20.810239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141413+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:08:21.141413+0000","last_peered":"2024-05-08T18:08:21.141413+0000","last_clean":"2024-05-08T18:08:21.141413+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:08:21.141413+0000","last_undegraded":"2024-05-08T18:08:21.141413+0000","last_fullsized":"2024-05-08T18:08:21.141413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139418+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:08:21.139418+0000","last_peered":"2024-05-08T18:08:21.139418+0000","last_clean":"2024-05-08T18:08:21.139418+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:08:21.139418+0000","last_undegraded":"2024-05-08T18:08:21.139418+0000","last_fullsized":"2024-05-08T18:08:21.139418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140053+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:08:21.140053+0000","last_peered":"2024-05-08T18:08:21.140053+0000","last_clean":"2024-05-08T18:08:21.140053+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:08:21.140053+0000","last_undegraded":"2024-05-08T18:08:21.140053+0000","last_fullsized":"2024-05-08T18:08:21.140053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139356+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:08:21.139356+0000","last_peered":"2024-05-08T18:08:21.139356+0000","last_clean":"2024-05-08T18:08:21.139356+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:08:21.139356+0000","last_undegraded":"2024-05-08T18:08:21.139356+0000","last_fullsized":"2024-05-08T18:08:21.139356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144759+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:08:21.144759+0000","last_peered":"2024-05-08T18:08:21.144759+0000","last_clean":"2024-05-08T18:08:21.144759+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:08:21.144759+0000","last_undegraded":"2024-05-08T18:08:21.144759+0000","last_fullsized":"2024-05-08T18:08:21.144759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140439+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:08:21.140439+0000","last_peered":"2024-05-08T18:08:21.140439+0000","last_clean":"2024-05-08T18:08:21.140439+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:08:21.140439+0000","last_undegraded":"2024-05-08T18:08:21.140439+0000","last_fullsized":"2024-05-08T18:08:21.140439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141805+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:08:21.141805+0000","last_peered":"2024-05-08T18:08:21.141805+0000","last_clean":"2024-05-08T18:08:21.141805+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:08:21.141805+0000","last_undegraded":"2024-05-08T18:08:21.141805+0000","last_fullsized":"2024-05-08T18:08:21.141805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817607+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:08:20.817607+0000","last_peered":"2024-05-08T18:08:20.817607+0000","last_clean":"2024-05-08T18:08:20.817607+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:08:20.817607+0000","last_undegraded":"2024-05-08T18:08:20.817607+0000","last_fullsized":"2024-05-08T18:08:20.817607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.814401+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:08:20.814401+0000","last_peered":"2024-05-08T18:08:20.814401+0000","last_clean":"2024-05-08T18:08:20.814401+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:08:20.814401+0000","last_undegraded":"2024-05-08T18:08:20.814401+0000","last_fullsized":"2024-05-08T18:08:20.814401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813119+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:08:20.813119+0000","last_peered":"2024-05-08T18:08:20.813119+0000","last_clean":"2024-05-08T18:08:20.813119+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:08:20.813119+0000","last_undegraded":"2024-05-08T18:08:20.813119+0000","last_fullsized":"2024-05-08T18:08:20.813119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810887+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:08:20.810887+0000","last_peered":"2024-05-08T18:08:20.810887+0000","last_clean":"2024-05-08T18:08:20.810887+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:08:20.810887+0000","last_undegraded":"2024-05-08T18:08:20.810887+0000","last_fullsized":"2024-05-08T18:08:20.810887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142738+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:08:21.142738+0000","last_peered":"2024-05-08T18:08:21.142738+0000","last_clean":"2024-05-08T18:08:21.142738+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:08:21.142738+0000","last_undegraded":"2024-05-08T18:08:21.142738+0000","last_fullsized":"2024-05-08T18:08:21.142738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.815819+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:08:20.815819+0000","last_peered":"2024-05-08T18:08:20.815819+0000","last_clean":"2024-05-08T18:08:20.815819+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:08:20.815819+0000","last_undegraded":"2024-05-08T18:08:20.815819+0000","last_fullsized":"2024-05-08T18:08:20.815819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142737+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:08:21.142737+0000","last_peered":"2024-05-08T18:08:21.142737+0000","last_clean":"2024-05-08T18:08:21.142737+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:08:21.142737+0000","last_undegraded":"2024-05-08T18:08:21.142737+0000","last_fullsized":"2024-05-08T18:08:21.142737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139173+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:08:21.139173+0000","last_peered":"2024-05-08T18:08:21.139173+0000","last_clean":"2024-05-08T18:08:21.139173+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:08:21.139173+0000","last_undegraded":"2024-05-08T18:08:21.139173+0000","last_fullsized":"2024-05-08T18:08:21.139173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813161+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:08:20.813161+0000","last_peered":"2024-05-08T18:08:20.813161+0000","last_clean":"2024-05-08T18:08:20.813161+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:08:20.813161+0000","last_undegraded":"2024-05-08T18:08:20.813161+0000","last_fullsized":"2024-05-08T18:08:20.813161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.819207+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:08:20.819207+0000","last_peered":"2024-05-08T18:08:20.819207+0000","last_clean":"2024-05-08T18:08:20.819207+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:08:20.819207+0000","last_undegraded":"2024-05-08T18:08:20.819207+0000","last_fullsized":"2024-05-08T18:08:20.819207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143373+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:08:21.143373+0000","last_peered":"2024-05-08T18:08:21.143373+0000","last_clean":"2024-05-08T18:08:21.143373+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:08:21.143373+0000","last_undegraded":"2024-05-08T18:08:21.143373+0000","last_fullsized":"2024-05-08T18:08:21.143373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811173+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:08:20.811173+0000","last_peered":"2024-05-08T18:08:20.811173+0000","last_clean":"2024-05-08T18:08:20.811173+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:08:20.811173+0000","last_undegraded":"2024-05-08T18:08:20.811173+0000","last_fullsized":"2024-05-08T18:08:20.811173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.816458+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:08:20.816458+0000","last_peered":"2024-05-08T18:08:20.816458+0000","last_clean":"2024-05-08T18:08:20.816458+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:08:20.816458+0000","last_undegraded":"2024-05-08T18:08:20.816458+0000","last_fullsized":"2024-05-08T18:08:20.816458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141910+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:08:21.141910+0000","last_peered":"2024-05-08T18:08:21.141910+0000","last_clean":"2024-05-08T18:08:21.141910+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:08:21.141910+0000","last_undegraded":"2024-05-08T18:08:21.141910+0000","last_fullsized":"2024-05-08T18:08:21.141910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":36,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139816+0000","last_change":"2024-05-08T18:07:55.445745+0000","last_active":"2024-05-08T18:08:21.139816+0000","last_peered":"2024-05-08T18:08:21.139816+0000","last_clean":"2024-05-08T18:08:21.139816+0000","last_became_active":"2024-05-08T18:07:55.444935+0000","last_became_peered":"2024-05-08T18:07:55.444935+0000","last_unstale":"2024-05-08T18:08:21.139816+0000","last_undegraded":"2024-05-08T18:08:21.139816+0000","last_fullsized":"2024-05-08T18:08:21.139816+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:37.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809946+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:08:20.809946+0000","last_peered":"2024-05-08T18:08:20.809946+0000","last_clean":"2024-05-08T18:08:20.809946+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:08:20.809946+0000","last_undegraded":"2024-05-08T18:08:20.809946+0000","last_fullsized":"2024-05-08T18:08:20.809946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817718+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:08:20.817718+0000","last_peered":"2024-05-08T18:08:20.817718+0000","last_clean":"2024-05-08T18:08:20.817718+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:08:20.817718+0000","last_undegraded":"2024-05-08T18:08:20.817718+0000","last_fullsized":"2024-05-08T18:08:20.817718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142004+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:08:21.142004+0000","last_peered":"2024-05-08T18:08:21.142004+0000","last_clean":"2024-05-08T18:08:21.142004+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:08:21.142004+0000","last_undegraded":"2024-05-08T18:08:21.142004+0000","last_fullsized":"2024-05-08T18:08:21.142004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140535+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:08:21.140535+0000","last_peered":"2024-05-08T18:08:21.140535+0000","last_clean":"2024-05-08T18:08:21.140535+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:08:21.140535+0000","last_undegraded":"2024-05-08T18:08:21.140535+0000","last_fullsized":"2024-05-08T18:08:21.140535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817268+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:08:20.817268+0000","last_peered":"2024-05-08T18:08:20.817268+0000","last_clean":"2024-05-08T18:08:20.817268+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:08:20.817268+0000","last_undegraded":"2024-05-08T18:08:20.817268+0000","last_fullsized":"2024-05-08T18:08:20.817268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.145923+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:08:21.145923+0000","last_peered":"2024-05-08T18:08:21.145923+0000","last_clean":"2024-05-08T18:08:21.145923+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:08:21.145923+0000","last_undegraded":"2024-05-08T18:08:21.145923+0000","last_fullsized":"2024-05-08T18:08:21.145923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.815663+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:08:20.815663+0000","last_peered":"2024-05-08T18:08:20.815663+0000","last_clean":"2024-05-08T18:08:20.815663+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:08:20.815663+0000","last_undegraded":"2024-05-08T18:08:20.815663+0000","last_fullsized":"2024-05-08T18:08:20.815663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142569+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:08:21.142569+0000","last_peered":"2024-05-08T18:08:21.142569+0000","last_clean":"2024-05-08T18:08:21.142569+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:08:21.142569+0000","last_undegraded":"2024-05-08T18:08:21.142569+0000","last_fullsized":"2024-05-08T18:08:21.142569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143311+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:08:21.143311+0000","last_peered":"2024-05-08T18:08:21.143311+0000","last_clean":"2024-05-08T18:08:21.143311+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:08:21.143311+0000","last_undegraded":"2024-05-08T18:08:21.143311+0000","last_fullsized":"2024-05-08T18:08:21.143311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143678+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:08:21.143678+0000","last_peered":"2024-05-08T18:08:21.143678+0000","last_clean":"2024-05-08T18:08:21.143678+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:08:21.143678+0000","last_undegraded":"2024-05-08T18:08:21.143678+0000","last_fullsized":"2024-05-08T18:08:21.143678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143180+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:08:21.143180+0000","last_peered":"2024-05-08T18:08:21.143180+0000","last_clean":"2024-05-08T18:08:21.143180+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:08:21.143180+0000","last_undegraded":"2024-05-08T18:08:21.143180+0000","last_fullsized":"2024-05-08T18:08:21.143180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.819138+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:08:20.819138+0000","last_peered":"2024-05-08T18:08:20.819138+0000","last_clean":"2024-05-08T18:08:20.819138+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:08:20.819138+0000","last_undegraded":"2024-05-08T18:08:20.819138+0000","last_fullsized":"2024-05-08T18:08:20.819138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140185+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:08:21.140185+0000","last_peered":"2024-05-08T18:08:21.140185+0000","last_clean":"2024-05-08T18:08:21.140185+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:08:21.140185+0000","last_undegraded":"2024-05-08T18:08:21.140185+0000","last_fullsized":"2024-05-08T18:08:21.140185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141122+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:08:21.141122+0000","last_peered":"2024-05-08T18:08:21.141122+0000","last_clean":"2024-05-08T18:08:21.141122+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:08:21.141122+0000","last_undegraded":"2024-05-08T18:08:21.141122+0000","last_fullsized":"2024-05-08T18:08:21.141122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28340,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343500,"statfs":{"total":96636764160,"available":96607744000,"internally_reserved":0,"allocated":1347584,"data_stored":967126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":724992,"data_stored":375662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":786432,"data_stored":385328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":383998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":376058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":712704,"data_stored":375224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":383757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1339392,"data_stored":974377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:08:23.239 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:08:23.239 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:23.229+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:23.323 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:23.322+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:23.347 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:23.348 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:23.362 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:08:23.423 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:23.425+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:23.458 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:08:23.523 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:23.525+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:23.528 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:23.529 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:23.543 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:08:23.603 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:08:23.609 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:08:23.610 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:23.610 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:23.618 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-05-08T18:08:22.823548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":759,"num_read_kb":507,"num_write":530,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223172,"kb_used_data":6968,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751548,"statfs":{"total":773094113280,"available":772865585152,"internally_reserved":0,"allocated":7135232,"data_stored":4221530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039811"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.146751+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:08:21.146751+0000","last_peered":"2024-05-08T18:08:21.146751+0000","last_clean":"2024-05-08T18:08:21.146751+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:08:21.146751+0000","last_undegraded":"2024-05-08T18:08:21.146751+0000","last_fullsized":"2024-05-08T18:08:21.146751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.138073+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:08:21.138073+0000","last_peered":"2024-05-08T18:08:21.138073+0000","last_clean":"2024-05-08T18:08:21.138073+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:08:21.138073+0000","last_undegraded":"2024-05-08T18:08:21.138073+0000","last_fullsized":"2024-05-08T18:08:21.138073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140218+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:08:21.140218+0000","last_peered":"2024-05-08T18:08:21.140218+0000","last_clean":"2024-05-08T18:08:21.140218+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:08:21.140218+0000","last_undegraded":"2024-05-08T18:08:21.140218+0000","last_fullsized":"2024-05-08T18:08:21.140218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139579+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:08:21.139579+0000","last_peered":"2024-05-08T18:08:21.139579+0000","last_clean":"2024-05-08T18:08:21.139579+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:08:21.139579+0000","last_undegraded":"2024-05-08T18:08:21.139579+0000","last_fullsized":"2024-05-08T18:08:21.139579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817888+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:08:20.817888+0000","last_peered":"2024-05-08T18:08:20.817888+0000","last_clean":"2024-05-08T18:08:20.817888+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:08:20.817888+0000","last_undegraded":"2024-05-08T18:08:20.817888+0000","last_fullsized":"2024-05-08T18:08:20.817888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810531+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:08:20.810531+0000","last_peered":"2024-05-08T18:08:20.810531+0000","last_clean":"2024-05-08T18:08:20.810531+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:08:20.810531+0000","last_undegraded":"2024-05-08T18:08:20.810531+0000","last_fullsized":"2024-05-08T18:08:20.810531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142651+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:08:21.142651+0000","last_peered":"2024-05-08T18:08:21.142651+0000","last_clean":"2024-05-08T18:08:21.142651+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:08:21.142651+0000","last_undegraded":"2024-05-08T18:08:21.142651+0000","last_fullsized":"2024-05-08T18:08:21.142651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817493+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:08:20.817493+0000","last_peered":"2024-05-08T18:08:20.817493+0000","last_clean":"2024-05-08T18:08:20.817493+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:08:20.817493+0000","last_undegraded":"2024-05-08T18:08:20.817493+0000","last_fullsized":"2024-05-08T18:08:20.817493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142358+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:08:21.142358+0000","last_peered":"2024-05-08T18:08:21.142358+0000","last_clean":"2024-05-08T18:08:21.142358+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:08:21.142358+0000","last_undegraded":"2024-05-08T18:08:21.142358+0000","last_fullsized":"2024-05-08T18:08:21.142358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140162+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:08:21.140162+0000","last_peered":"2024-05-08T18:08:21.140162+0000","last_clean":"2024-05-08T18:08:21.140162+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:08:21.140162+0000","last_undegraded":"2024-05-08T18:08:21.140162+0000","last_fullsized":"2024-05-08T18:08:21.140162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":36,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139619+0000","last_change":"2024-05-08T18:07:55.439965+0000","last_active":"2024-05-08T18:08:21.139619+0000","last_peered":"2024-05-08T18:08:21.139619+0000","last_clean":"2024-05-08T18:08:21.139619+0000","last_became_active":"2024-05-08T18:07:55.439578+0000","last_became_peered":"2024-05-08T18:07:55.439578+0000","last_unstale":"2024-05-08T18:08:21.139619+0000","last_undegraded":"2024-05-08T18:08:21.139619+0000","last_fullsized":"2024-05-08T18:08:21.139619+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:30.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810263+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:08:20.810263+0000","last_peered":"2024-05-08T18:08:20.810263+0000","last_clean":"2024-05-08T18:08:20.810263+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:08:20.810263+0000","last_undegraded":"2024-05-08T18:08:20.810263+0000","last_fullsized":"2024-05-08T18:08:20.810263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140025+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:08:21.140025+0000","last_peered":"2024-05-08T18:08:21.140025+0000","last_clean":"2024-05-08T18:08:21.140025+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:08:21.140025+0000","last_undegraded":"2024-05-08T18:08:21.140025+0000","last_fullsized":"2024-05-08T18:08:21.140025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140727+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:08:21.140727+0000","last_peered":"2024-05-08T18:08:21.140727+0000","last_clean":"2024-05-08T18:08:21.140727+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:08:21.140727+0000","last_undegraded":"2024-05-08T18:08:21.140727+0000","last_fullsized":"2024-05-08T18:08:21.140727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812008+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:08:20.812008+0000","last_peered":"2024-05-08T18:08:20.812008+0000","last_clean":"2024-05-08T18:08:20.812008+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:08:20.812008+0000","last_undegraded":"2024-05-08T18:08:20.812008+0000","last_fullsized":"2024-05-08T18:08:20.812008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":48,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813469+0000","last_change":"2024-05-08T18:07:47.007132+0000","last_active":"2024-05-08T18:08:20.813469+0000","last_peered":"2024-05-08T18:08:20.813469+0000","last_clean":"2024-05-08T18:08:20.813469+0000","last_became_active":"2024-05-08T18:07:47.006744+0000","last_became_peered":"2024-05-08T18:07:47.006744+0000","last_unstale":"2024-05-08T18:08:20.813469+0000","last_undegraded":"2024-05-08T18:08:20.813469+0000","last_fullsized":"2024-05-08T18:08:20.813469+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:32.802677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809060+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:08:20.809060+0000","last_peered":"2024-05-08T18:08:20.809060+0000","last_clean":"2024-05-08T18:08:20.809060+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:08:20.809060+0000","last_undegraded":"2024-05-08T18:08:20.809060+0000","last_fullsized":"2024-05-08T18:08:20.809060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.146830+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:08:21.146830+0000","last_peered":"2024-05-08T18:08:21.146830+0000","last_clean":"2024-05-08T18:08:21.146830+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:08:21.146830+0000","last_undegraded":"2024-05-08T18:08:21.146830+0000","last_fullsized":"2024-05-08T18:08:21.146830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139798+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:08:21.139798+0000","last_peered":"2024-05-08T18:08:21.139798+0000","last_clean":"2024-05-08T18:08:21.139798+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:08:21.139798+0000","last_undegraded":"2024-05-08T18:08:21.139798+0000","last_fullsized":"2024-05-08T18:08:21.139798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142329+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:08:21.142329+0000","last_peered":"2024-05-08T18:08:21.142329+0000","last_clean":"2024-05-08T18:08:21.142329+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:08:21.142329+0000","last_undegraded":"2024-05-08T18:08:21.142329+0000","last_fullsized":"2024-05-08T18:08:21.142329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140361+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:08:21.140361+0000","last_peered":"2024-05-08T18:08:21.140361+0000","last_clean":"2024-05-08T18:08:21.140361+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:08:21.140361+0000","last_undegraded":"2024-05-08T18:08:21.140361+0000","last_fullsized":"2024-05-08T18:08:21.140361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139915+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:08:21.139915+0000","last_peered":"2024-05-08T18:08:21.139915+0000","last_clean":"2024-05-08T18:08:21.139915+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:08:21.139915+0000","last_undegraded":"2024-05-08T18:08:21.139915+0000","last_fullsized":"2024-05-08T18:08:21.139915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140218+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:08:21.140218+0000","last_peered":"2024-05-08T18:08:21.140218+0000","last_clean":"2024-05-08T18:08:21.140218+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:08:21.140218+0000","last_undegraded":"2024-05-08T18:08:21.140218+0000","last_fullsized":"2024-05-08T18:08:21.140218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809551+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:08:20.809551+0000","last_peered":"2024-05-08T18:08:20.809551+0000","last_clean":"2024-05-08T18:08:20.809551+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:08:20.809551+0000","last_undegraded":"2024-05-08T18:08:20.809551+0000","last_fullsized":"2024-05-08T18:08:20.809551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140946+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:08:21.140946+0000","last_peered":"2024-05-08T18:08:21.140946+0000","last_clean":"2024-05-08T18:08:21.140946+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:08:21.140946+0000","last_undegraded":"2024-05-08T18:08:21.140946+0000","last_fullsized":"2024-05-08T18:08:21.140946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813836+0000","last_change":"2024-05-08T18:07:15.480500+0000","last_active":"2024-05-08T18:08:20.813836+0000","last_peered":"2024-05-08T18:08:20.813836+0000","last_clean":"2024-05-08T18:08:20.813836+0000","last_became_active":"2024-05-08T18:07:15.480192+0000","last_became_peered":"2024-05-08T18:07:15.480192+0000","last_unstale":"2024-05-08T18:08:20.813836+0000","last_undegraded":"2024-05-08T18:08:20.813836+0000","last_fullsized":"2024-05-08T18:08:20.813836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810514+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:08:20.810514+0000","last_peered":"2024-05-08T18:08:20.810514+0000","last_clean":"2024-05-08T18:08:20.810514+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:08:20.810514+0000","last_undegraded":"2024-05-08T18:08:20.810514+0000","last_fullsized":"2024-05-08T18:08:20.810514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817682+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:08:20.817682+0000","last_peered":"2024-05-08T18:08:20.817682+0000","last_clean":"2024-05-08T18:08:20.817682+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:08:20.817682+0000","last_undegraded":"2024-05-08T18:08:20.817682+0000","last_fullsized":"2024-05-08T18:08:20.817682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.808510+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:08:20.808510+0000","last_peered":"2024-05-08T18:08:20.808510+0000","last_clean":"2024-05-08T18:08:20.808510+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:08:20.808510+0000","last_undegraded":"2024-05-08T18:08:20.808510+0000","last_fullsized":"2024-05-08T18:08:20.808510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812840+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:08:20.812840+0000","last_peered":"2024-05-08T18:08:20.812840+0000","last_clean":"2024-05-08T18:08:20.812840+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:08:20.812840+0000","last_undegraded":"2024-05-08T18:08:20.812840+0000","last_fullsized":"2024-05-08T18:08:20.812840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142766+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:08:21.142766+0000","last_peered":"2024-05-08T18:08:21.142766+0000","last_clean":"2024-05-08T18:08:21.142766+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:08:21.142766+0000","last_undegraded":"2024-05-08T18:08:21.142766+0000","last_fullsized":"2024-05-08T18:08:21.142766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144485+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:08:21.144485+0000","last_peered":"2024-05-08T18:08:21.144485+0000","last_clean":"2024-05-08T18:08:21.144485+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:08:21.144485+0000","last_undegraded":"2024-05-08T18:08:21.144485+0000","last_fullsized":"2024-05-08T18:08:21.144485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818322+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:08:20.818322+0000","last_peered":"2024-05-08T18:08:20.818322+0000","last_clean":"2024-05-08T18:08:20.818322+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:08:20.818322+0000","last_undegraded":"2024-05-08T18:08:20.818322+0000","last_fullsized":"2024-05-08T18:08:20.818322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.146555+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:08:21.146555+0000","last_peered":"2024-05-08T18:08:21.146555+0000","last_clean":"2024-05-08T18:08:21.146555+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:08:21.146555+0000","last_undegraded":"2024-05-08T18:08:21.146555+0000","last_fullsized":"2024-05-08T18:08:21.146555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.138834+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:08:21.138834+0000","last_peered":"2024-05-08T18:08:21.138834+0000","last_clean":"2024-05-08T18:08:21.138834+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:08:21.138834+0000","last_undegraded":"2024-05-08T18:08:21.138834+0000","last_fullsized":"2024-05-08T18:08:21.138834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144991+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:08:21.144991+0000","last_peered":"2024-05-08T18:08:21.144991+0000","last_clean":"2024-05-08T18:08:21.144991+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:08:21.144991+0000","last_undegraded":"2024-05-08T18:08:21.144991+0000","last_fullsized":"2024-05-08T18:08:21.144991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817723+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:08:20.817723+0000","last_peered":"2024-05-08T18:08:20.817723+0000","last_clean":"2024-05-08T18:08:20.817723+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:08:20.817723+0000","last_undegraded":"2024-05-08T18:08:20.817723+0000","last_fullsized":"2024-05-08T18:08:20.817723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812720+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:08:20.812720+0000","last_peered":"2024-05-08T18:08:20.812720+0000","last_clean":"2024-05-08T18:08:20.812720+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:08:20.812720+0000","last_undegraded":"2024-05-08T18:08:20.812720+0000","last_fullsized":"2024-05-08T18:08:20.812720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810820+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:08:20.810820+0000","last_peered":"2024-05-08T18:08:20.810820+0000","last_clean":"2024-05-08T18:08:20.810820+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:08:20.810820+0000","last_undegraded":"2024-05-08T18:08:20.810820+0000","last_fullsized":"2024-05-08T18:08:20.810820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810620+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:08:20.810620+0000","last_peered":"2024-05-08T18:08:20.810620+0000","last_clean":"2024-05-08T18:08:20.810620+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:08:20.810620+0000","last_undegraded":"2024-05-08T18:08:20.810620+0000","last_fullsized":"2024-05-08T18:08:20.810620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817288+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:08:20.817288+0000","last_peered":"2024-05-08T18:08:20.817288+0000","last_clean":"2024-05-08T18:08:20.817288+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:08:20.817288+0000","last_undegraded":"2024-05-08T18:08:20.817288+0000","last_fullsized":"2024-05-08T18:08:20.817288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818836+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:08:20.818836+0000","last_peered":"2024-05-08T18:08:20.818836+0000","last_clean":"2024-05-08T18:08:20.818836+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:08:20.818836+0000","last_undegraded":"2024-05-08T18:08:20.818836+0000","last_fullsized":"2024-05-08T18:08:20.818836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140247+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:08:21.140247+0000","last_peered":"2024-05-08T18:08:21.140247+0000","last_clean":"2024-05-08T18:08:21.140247+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:08:21.140247+0000","last_undegraded":"2024-05-08T18:08:21.140247+0000","last_fullsized":"2024-05-08T18:08:21.140247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813363+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:08:20.813363+0000","last_peered":"2024-05-08T18:08:20.813363+0000","last_clean":"2024-05-08T18:08:20.813363+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:08:20.813363+0000","last_undegraded":"2024-05-08T18:08:20.813363+0000","last_fullsized":"2024-05-08T18:08:20.813363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140756+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:08:21.140756+0000","last_peered":"2024-05-08T18:08:21.140756+0000","last_clean":"2024-05-08T18:08:21.140756+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:08:21.140756+0000","last_undegraded":"2024-05-08T18:08:21.140756+0000","last_fullsized":"2024-05-08T18:08:21.140756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143929+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:08:21.143929+0000","last_peered":"2024-05-08T18:08:21.143929+0000","last_clean":"2024-05-08T18:08:21.143929+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:08:21.143929+0000","last_undegraded":"2024-05-08T18:08:21.143929+0000","last_fullsized":"2024-05-08T18:08:21.143929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809159+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:08:20.809159+0000","last_peered":"2024-05-08T18:08:20.809159+0000","last_clean":"2024-05-08T18:08:20.809159+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:08:20.809159+0000","last_undegraded":"2024-05-08T18:08:20.809159+0000","last_fullsized":"2024-05-08T18:08:20.809159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813172+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:08:20.813172+0000","last_peered":"2024-05-08T18:08:20.813172+0000","last_clean":"2024-05-08T18:08:20.813172+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:08:20.813172+0000","last_undegraded":"2024-05-08T18:08:20.813172+0000","last_fullsized":"2024-05-08T18:08:20.813172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139643+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:08:21.139643+0000","last_peered":"2024-05-08T18:08:21.139643+0000","last_clean":"2024-05-08T18:08:21.139643+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:08:21.139643+0000","last_undegraded":"2024-05-08T18:08:21.139643+0000","last_fullsized":"2024-05-08T18:08:21.139643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140497+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:08:21.140497+0000","last_peered":"2024-05-08T18:08:21.140497+0000","last_clean":"2024-05-08T18:08:21.140497+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:08:21.140497+0000","last_undegraded":"2024-05-08T18:08:21.140497+0000","last_fullsized":"2024-05-08T18:08:21.140497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144380+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:08:21.144380+0000","last_peered":"2024-05-08T18:08:21.144380+0000","last_clean":"2024-05-08T18:08:21.144380+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:08:21.144380+0000","last_undegraded":"2024-05-08T18:08:21.144380+0000","last_fullsized":"2024-05-08T18:08:21.144380+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812531+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:08:20.812531+0000","last_peered":"2024-05-08T18:08:20.812531+0000","last_clean":"2024-05-08T18:08:20.812531+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:08:20.812531+0000","last_undegraded":"2024-05-08T18:08:20.812531+0000","last_fullsized":"2024-05-08T18:08:20.812531+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143149+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:08:21.143149+0000","last_peered":"2024-05-08T18:08:21.143149+0000","last_clean":"2024-05-08T18:08:21.143149+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:08:21.143149+0000","last_undegraded":"2024-05-08T18:08:21.143149+0000","last_fullsized":"2024-05-08T18:08:21.143149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":36,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142667+0000","last_change":"2024-05-08T18:07:55.357969+0000","last_active":"2024-05-08T18:08:21.142667+0000","last_peered":"2024-05-08T18:08:21.142667+0000","last_clean":"2024-05-08T18:08:21.142667+0000","last_became_active":"2024-05-08T18:07:55.357205+0000","last_became_peered":"2024-05-08T18:07:55.357205+0000","last_unstale":"2024-05-08T18:08:21.142667+0000","last_undegraded":"2024-05-08T18:08:21.142667+0000","last_fullsized":"2024-05-08T18:08:21.142667+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:04.667292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.138987+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:08:21.138987+0000","last_peered":"2024-05-08T18:08:21.138987+0000","last_clean":"2024-05-08T18:08:21.138987+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:08:21.138987+0000","last_undegraded":"2024-05-08T18:08:21.138987+0000","last_fullsized":"2024-05-08T18:08:21.138987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":108,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139929+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:08:21.139929+0000","last_peered":"2024-05-08T18:08:21.139929+0000","last_clean":"2024-05-08T18:08:21.139929+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:08:21.139929+0000","last_undegraded":"2024-05-08T18:08:21.139929+0000","last_fullsized":"2024-05-08T18:08:21.139929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141205+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:08:21.141205+0000","last_peered":"2024-05-08T18:08:21.141205+0000","last_clean":"2024-05-08T18:08:21.141205+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:08:21.141205+0000","last_undegraded":"2024-05-08T18:08:21.141205+0000","last_fullsized":"2024-05-08T18:08:21.141205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142021+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:08:21.142021+0000","last_peered":"2024-05-08T18:08:21.142021+0000","last_clean":"2024-05-08T18:08:21.142021+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:08:21.142021+0000","last_undegraded":"2024-05-08T18:08:21.142021+0000","last_fullsized":"2024-05-08T18:08:21.142021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.808837+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:08:20.808837+0000","last_peered":"2024-05-08T18:08:20.808837+0000","last_clean":"2024-05-08T18:08:20.808837+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:08:20.808837+0000","last_undegraded":"2024-05-08T18:08:20.808837+0000","last_fullsized":"2024-05-08T18:08:20.808837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.146998+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:08:21.146998+0000","last_peered":"2024-05-08T18:08:21.146998+0000","last_clean":"2024-05-08T18:08:21.146998+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:08:21.146998+0000","last_undegraded":"2024-05-08T18:08:21.146998+0000","last_fullsized":"2024-05-08T18:08:21.146998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139019+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:08:21.139019+0000","last_peered":"2024-05-08T18:08:21.139019+0000","last_clean":"2024-05-08T18:08:21.139019+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:08:21.139019+0000","last_undegraded":"2024-05-08T18:08:21.139019+0000","last_fullsized":"2024-05-08T18:08:21.139019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.814569+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:08:20.814569+0000","last_peered":"2024-05-08T18:08:20.814569+0000","last_clean":"2024-05-08T18:08:20.814569+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:08:20.814569+0000","last_undegraded":"2024-05-08T18:08:20.814569+0000","last_fullsized":"2024-05-08T18:08:20.814569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812509+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:08:20.812509+0000","last_peered":"2024-05-08T18:08:20.812509+0000","last_clean":"2024-05-08T18:08:20.812509+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:08:20.812509+0000","last_undegraded":"2024-05-08T18:08:20.812509+0000","last_fullsized":"2024-05-08T18:08:20.812509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":68,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.138508+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:08:21.138508+0000","last_peered":"2024-05-08T18:08:21.138508+0000","last_clean":"2024-05-08T18:08:21.138508+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:08:21.138508+0000","last_undegraded":"2024-05-08T18:08:21.138508+0000","last_fullsized":"2024-05-08T18:08:21.138508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142317+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:08:21.142317+0000","last_peered":"2024-05-08T18:08:21.142317+0000","last_clean":"2024-05-08T18:08:21.142317+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:08:21.142317+0000","last_undegraded":"2024-05-08T18:08:21.142317+0000","last_fullsized":"2024-05-08T18:08:21.142317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.145576+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:08:21.145576+0000","last_peered":"2024-05-08T18:08:21.145576+0000","last_clean":"2024-05-08T18:08:21.145576+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:08:21.145576+0000","last_undegraded":"2024-05-08T18:08:21.145576+0000","last_fullsized":"2024-05-08T18:08:21.145576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140484+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:08:21.140484+0000","last_peered":"2024-05-08T18:08:21.140484+0000","last_clean":"2024-05-08T18:08:21.140484+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:08:21.140484+0000","last_undegraded":"2024-05-08T18:08:21.140484+0000","last_fullsized":"2024-05-08T18:08:21.140484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143906+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:08:21.143906+0000","last_peered":"2024-05-08T18:08:21.143906+0000","last_clean":"2024-05-08T18:08:21.143906+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:08:21.143906+0000","last_undegraded":"2024-05-08T18:08:21.143906+0000","last_fullsized":"2024-05-08T18:08:21.143906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":87,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811739+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:08:20.811739+0000","last_peered":"2024-05-08T18:08:20.811739+0000","last_clean":"2024-05-08T18:08:20.811739+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:08:20.811739+0000","last_undegraded":"2024-05-08T18:08:20.811739+0000","last_fullsized":"2024-05-08T18:08:20.811739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818357+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:08:20.818357+0000","last_peered":"2024-05-08T18:08:20.818357+0000","last_clean":"2024-05-08T18:08:20.818357+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:08:20.818357+0000","last_undegraded":"2024-05-08T18:08:20.818357+0000","last_fullsized":"2024-05-08T18:08:20.818357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818126+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:08:20.818126+0000","last_peered":"2024-05-08T18:08:20.818126+0000","last_clean":"2024-05-08T18:08:20.818126+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:08:20.818126+0000","last_undegraded":"2024-05-08T18:08:20.818126+0000","last_fullsized":"2024-05-08T18:08:20.818126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143722+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:08:21.143722+0000","last_peered":"2024-05-08T18:08:21.143722+0000","last_clean":"2024-05-08T18:08:21.143722+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:08:21.143722+0000","last_undegraded":"2024-05-08T18:08:21.143722+0000","last_fullsized":"2024-05-08T18:08:21.143722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139959+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:08:21.139959+0000","last_peered":"2024-05-08T18:08:21.139959+0000","last_clean":"2024-05-08T18:08:21.139959+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:08:21.139959+0000","last_undegraded":"2024-05-08T18:08:21.139959+0000","last_fullsized":"2024-05-08T18:08:21.139959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":100,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817211+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:08:20.817211+0000","last_peered":"2024-05-08T18:08:20.817211+0000","last_clean":"2024-05-08T18:08:20.817211+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:08:20.817211+0000","last_undegraded":"2024-05-08T18:08:20.817211+0000","last_fullsized":"2024-05-08T18:08:20.817211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.138880+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:08:21.138880+0000","last_peered":"2024-05-08T18:08:21.138880+0000","last_clean":"2024-05-08T18:08:21.138880+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:08:21.138880+0000","last_undegraded":"2024-05-08T18:08:21.138880+0000","last_fullsized":"2024-05-08T18:08:21.138880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141190+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:08:21.141190+0000","last_peered":"2024-05-08T18:08:21.141190+0000","last_clean":"2024-05-08T18:08:21.141190+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:08:21.141190+0000","last_undegraded":"2024-05-08T18:08:21.141190+0000","last_fullsized":"2024-05-08T18:08:21.141190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809958+0000","last_change":"2024-05-08T18:07:55.356946+0000","last_active":"2024-05-08T18:08:20.809958+0000","last_peered":"2024-05-08T18:08:20.809958+0000","last_clean":"2024-05-08T18:08:20.809958+0000","last_became_active":"2024-05-08T18:07:55.355948+0000","last_became_peered":"2024-05-08T18:07:55.355948+0000","last_unstale":"2024-05-08T18:08:20.809958+0000","last_undegraded":"2024-05-08T18:08:20.809958+0000","last_fullsized":"2024-05-08T18:08:20.809958+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:04.163382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813399+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:08:20.813399+0000","last_peered":"2024-05-08T18:08:20.813399+0000","last_clean":"2024-05-08T18:08:20.813399+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:08:20.813399+0000","last_undegraded":"2024-05-08T18:08:20.813399+0000","last_fullsized":"2024-05-08T18:08:20.813399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141697+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:08:21.141697+0000","last_peered":"2024-05-08T18:08:21.141697+0000","last_clean":"2024-05-08T18:08:21.141697+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:08:21.141697+0000","last_undegraded":"2024-05-08T18:08:21.141697+0000","last_fullsized":"2024-05-08T18:08:21.141697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810643+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:08:20.810643+0000","last_peered":"2024-05-08T18:08:20.810643+0000","last_clean":"2024-05-08T18:08:20.810643+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:08:20.810643+0000","last_undegraded":"2024-05-08T18:08:20.810643+0000","last_fullsized":"2024-05-08T18:08:20.810643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.819089+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:08:20.819089+0000","last_peered":"2024-05-08T18:08:20.819089+0000","last_clean":"2024-05-08T18:08:20.819089+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:08:20.819089+0000","last_undegraded":"2024-05-08T18:08:20.819089+0000","last_fullsized":"2024-05-08T18:08:20.819089+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811412+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:08:20.811412+0000","last_peered":"2024-05-08T18:08:20.811412+0000","last_clean":"2024-05-08T18:08:20.811412+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:08:20.811412+0000","last_undegraded":"2024-05-08T18:08:20.811412+0000","last_fullsized":"2024-05-08T18:08:20.811412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810886+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:08:20.810886+0000","last_peered":"2024-05-08T18:08:20.810886+0000","last_clean":"2024-05-08T18:08:20.810886+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:08:20.810886+0000","last_undegraded":"2024-05-08T18:08:20.810886+0000","last_fullsized":"2024-05-08T18:08:20.810886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142694+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:08:21.142694+0000","last_peered":"2024-05-08T18:08:21.142694+0000","last_clean":"2024-05-08T18:08:21.142694+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:08:21.142694+0000","last_undegraded":"2024-05-08T18:08:21.142694+0000","last_fullsized":"2024-05-08T18:08:21.142694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141449+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:08:21.141449+0000","last_peered":"2024-05-08T18:08:21.141449+0000","last_clean":"2024-05-08T18:08:21.141449+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:08:21.141449+0000","last_undegraded":"2024-05-08T18:08:21.141449+0000","last_fullsized":"2024-05-08T18:08:21.141449+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142827+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:08:21.142827+0000","last_peered":"2024-05-08T18:08:21.142827+0000","last_clean":"2024-05-08T18:08:21.142827+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:08:21.142827+0000","last_undegraded":"2024-05-08T18:08:21.142827+0000","last_fullsized":"2024-05-08T18:08:21.142827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142195+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:08:21.142195+0000","last_peered":"2024-05-08T18:08:21.142195+0000","last_clean":"2024-05-08T18:08:21.142195+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:08:21.142195+0000","last_undegraded":"2024-05-08T18:08:21.142195+0000","last_fullsized":"2024-05-08T18:08:21.142195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139987+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:08:21.139987+0000","last_peered":"2024-05-08T18:08:21.139987+0000","last_clean":"2024-05-08T18:08:21.139987+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:08:21.139987+0000","last_undegraded":"2024-05-08T18:08:21.139987+0000","last_fullsized":"2024-05-08T18:08:21.139987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811408+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:08:20.811408+0000","last_peered":"2024-05-08T18:08:20.811408+0000","last_clean":"2024-05-08T18:08:20.811408+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:08:20.811408+0000","last_undegraded":"2024-05-08T18:08:20.811408+0000","last_fullsized":"2024-05-08T18:08:20.811408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809303+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:08:20.809303+0000","last_peered":"2024-05-08T18:08:20.809303+0000","last_clean":"2024-05-08T18:08:20.809303+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:08:20.809303+0000","last_undegraded":"2024-05-08T18:08:20.809303+0000","last_fullsized":"2024-05-08T18:08:20.809303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142142+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:08:21.142142+0000","last_peered":"2024-05-08T18:08:21.142142+0000","last_clean":"2024-05-08T18:08:21.142142+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:08:21.142142+0000","last_undegraded":"2024-05-08T18:08:21.142142+0000","last_fullsized":"2024-05-08T18:08:21.142142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812562+0000","last_change":"2024-05-08T18:07:21.533056+0000","last_active":"2024-05-08T18:08:20.812562+0000","last_peered":"2024-05-08T18:08:20.812562+0000","last_clean":"2024-05-08T18:08:20.812562+0000","last_became_active":"2024-05-08T18:07:21.532184+0000","last_became_peered":"2024-05-08T18:07:21.532184+0000","last_unstale":"2024-05-08T18:08:20.812562+0000","last_undegraded":"2024-05-08T18:08:20.812562+0000","last_fullsized":"2024-05-08T18:08:20.812562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:50.629014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.138952+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:08:21.138952+0000","last_peered":"2024-05-08T18:08:21.138952+0000","last_clean":"2024-05-08T18:08:21.138952+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:08:21.138952+0000","last_undegraded":"2024-05-08T18:08:21.138952+0000","last_fullsized":"2024-05-08T18:08:21.138952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810316+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:08:20.810316+0000","last_peered":"2024-05-08T18:08:20.810316+0000","last_clean":"2024-05-08T18:08:20.810316+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:08:20.810316+0000","last_undegraded":"2024-05-08T18:08:20.810316+0000","last_fullsized":"2024-05-08T18:08:20.810316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141498+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:08:21.141498+0000","last_peered":"2024-05-08T18:08:21.141498+0000","last_clean":"2024-05-08T18:08:21.141498+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:08:21.141498+0000","last_undegraded":"2024-05-08T18:08:21.141498+0000","last_fullsized":"2024-05-08T18:08:21.141498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812188+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:08:20.812188+0000","last_peered":"2024-05-08T18:08:20.812188+0000","last_clean":"2024-05-08T18:08:20.812188+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:08:20.812188+0000","last_undegraded":"2024-05-08T18:08:20.812188+0000","last_fullsized":"2024-05-08T18:08:20.812188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":83,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811132+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:08:20.811132+0000","last_peered":"2024-05-08T18:08:20.811132+0000","last_clean":"2024-05-08T18:08:20.811132+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:08:20.811132+0000","last_undegraded":"2024-05-08T18:08:20.811132+0000","last_fullsized":"2024-05-08T18:08:20.811132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":105,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144414+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:08:21.144414+0000","last_peered":"2024-05-08T18:08:21.144414+0000","last_clean":"2024-05-08T18:08:21.144414+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:08:21.144414+0000","last_undegraded":"2024-05-08T18:08:21.144414+0000","last_fullsized":"2024-05-08T18:08:21.144414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":72,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139624+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:08:21.139624+0000","last_peered":"2024-05-08T18:08:21.139624+0000","last_clean":"2024-05-08T18:08:21.139624+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:08:21.139624+0000","last_undegraded":"2024-05-08T18:08:21.139624+0000","last_fullsized":"2024-05-08T18:08:21.139624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141108+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:08:21.141108+0000","last_peered":"2024-05-08T18:08:21.141108+0000","last_clean":"2024-05-08T18:08:21.141108+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:08:21.141108+0000","last_undegraded":"2024-05-08T18:08:21.141108+0000","last_fullsized":"2024-05-08T18:08:21.141108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139551+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:08:21.139551+0000","last_peered":"2024-05-08T18:08:21.139551+0000","last_clean":"2024-05-08T18:08:21.139551+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:08:21.139551+0000","last_undegraded":"2024-05-08T18:08:21.139551+0000","last_fullsized":"2024-05-08T18:08:21.139551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":192,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144149+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:08:21.144149+0000","last_peered":"2024-05-08T18:08:21.144149+0000","last_clean":"2024-05-08T18:08:21.144149+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:08:21.144149+0000","last_undegraded":"2024-05-08T18:08:21.144149+0000","last_fullsized":"2024-05-08T18:08:21.144149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141392+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:08:21.141392+0000","last_peered":"2024-05-08T18:08:21.141392+0000","last_clean":"2024-05-08T18:08:21.141392+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:08:21.141392+0000","last_undegraded":"2024-05-08T18:08:21.141392+0000","last_fullsized":"2024-05-08T18:08:21.141392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813199+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:08:20.813199+0000","last_peered":"2024-05-08T18:08:20.813199+0000","last_clean":"2024-05-08T18:08:20.813199+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:08:20.813199+0000","last_undegraded":"2024-05-08T18:08:20.813199+0000","last_fullsized":"2024-05-08T18:08:20.813199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143431+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:08:21.143431+0000","last_peered":"2024-05-08T18:08:21.143431+0000","last_clean":"2024-05-08T18:08:21.143431+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:08:21.143431+0000","last_undegraded":"2024-05-08T18:08:21.143431+0000","last_fullsized":"2024-05-08T18:08:21.143431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":104,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142684+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:08:21.142684+0000","last_peered":"2024-05-08T18:08:21.142684+0000","last_clean":"2024-05-08T18:08:21.142684+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:08:21.142684+0000","last_undegraded":"2024-05-08T18:08:21.142684+0000","last_fullsized":"2024-05-08T18:08:21.142684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818475+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:08:20.818475+0000","last_peered":"2024-05-08T18:08:20.818475+0000","last_clean":"2024-05-08T18:08:20.818475+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:08:20.818475+0000","last_undegraded":"2024-05-08T18:08:20.818475+0000","last_fullsized":"2024-05-08T18:08:20.818475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":68,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140717+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:08:21.140717+0000","last_peered":"2024-05-08T18:08:21.140717+0000","last_clean":"2024-05-08T18:08:21.140717+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:08:21.140717+0000","last_undegraded":"2024-05-08T18:08:21.140717+0000","last_fullsized":"2024-05-08T18:08:21.140717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818686+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:08:20.818686+0000","last_peered":"2024-05-08T18:08:20.818686+0000","last_clean":"2024-05-08T18:08:20.818686+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:08:20.818686+0000","last_undegraded":"2024-05-08T18:08:20.818686+0000","last_fullsized":"2024-05-08T18:08:20.818686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143672+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:08:21.143672+0000","last_peered":"2024-05-08T18:08:21.143672+0000","last_clean":"2024-05-08T18:08:21.143672+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:08:21.143672+0000","last_undegraded":"2024-05-08T18:08:21.143672+0000","last_fullsized":"2024-05-08T18:08:21.143672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817355+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:08:20.817355+0000","last_peered":"2024-05-08T18:08:20.817355+0000","last_clean":"2024-05-08T18:08:20.817355+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:08:20.817355+0000","last_undegraded":"2024-05-08T18:08:20.817355+0000","last_fullsized":"2024-05-08T18:08:20.817355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143331+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:08:21.143331+0000","last_peered":"2024-05-08T18:08:21.143331+0000","last_clean":"2024-05-08T18:08:21.143331+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:08:21.143331+0000","last_undegraded":"2024-05-08T18:08:21.143331+0000","last_fullsized":"2024-05-08T18:08:21.143331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":131,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141352+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:08:21.141352+0000","last_peered":"2024-05-08T18:08:21.141352+0000","last_clean":"2024-05-08T18:08:21.141352+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:08:21.141352+0000","last_undegraded":"2024-05-08T18:08:21.141352+0000","last_fullsized":"2024-05-08T18:08:21.141352+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144158+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:08:21.144158+0000","last_peered":"2024-05-08T18:08:21.144158+0000","last_clean":"2024-05-08T18:08:21.144158+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:08:21.144158+0000","last_undegraded":"2024-05-08T18:08:21.144158+0000","last_fullsized":"2024-05-08T18:08:21.144158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140436+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:08:21.140436+0000","last_peered":"2024-05-08T18:08:21.140436+0000","last_clean":"2024-05-08T18:08:21.140436+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:08:21.140436+0000","last_undegraded":"2024-05-08T18:08:21.140436+0000","last_fullsized":"2024-05-08T18:08:21.140436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141588+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:08:21.141588+0000","last_peered":"2024-05-08T18:08:21.141588+0000","last_clean":"2024-05-08T18:08:21.141588+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:08:21.141588+0000","last_undegraded":"2024-05-08T18:08:21.141588+0000","last_fullsized":"2024-05-08T18:08:21.141588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139509+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:08:21.139509+0000","last_peered":"2024-05-08T18:08:21.139509+0000","last_clean":"2024-05-08T18:08:21.139509+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:08:21.139509+0000","last_undegraded":"2024-05-08T18:08:21.139509+0000","last_fullsized":"2024-05-08T18:08:21.139509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139441+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:08:21.139441+0000","last_peered":"2024-05-08T18:08:21.139441+0000","last_clean":"2024-05-08T18:08:21.139441+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:08:21.139441+0000","last_undegraded":"2024-05-08T18:08:21.139441+0000","last_fullsized":"2024-05-08T18:08:21.139441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":83,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142352+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:08:21.142352+0000","last_peered":"2024-05-08T18:08:21.142352+0000","last_clean":"2024-05-08T18:08:21.142352+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:08:21.142352+0000","last_undegraded":"2024-05-08T18:08:21.142352+0000","last_fullsized":"2024-05-08T18:08:21.142352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":111,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144871+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:08:21.144871+0000","last_peered":"2024-05-08T18:08:21.144871+0000","last_clean":"2024-05-08T18:08:21.144871+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:08:21.144871+0000","last_undegraded":"2024-05-08T18:08:21.144871+0000","last_fullsized":"2024-05-08T18:08:21.144871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817648+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:08:20.817648+0000","last_peered":"2024-05-08T18:08:20.817648+0000","last_clean":"2024-05-08T18:08:20.817648+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:08:20.817648+0000","last_undegraded":"2024-05-08T18:08:20.817648+0000","last_fullsized":"2024-05-08T18:08:20.817648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.814144+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:08:20.814144+0000","last_peered":"2024-05-08T18:08:20.814144+0000","last_clean":"2024-05-08T18:08:20.814144+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:08:20.814144+0000","last_undegraded":"2024-05-08T18:08:20.814144+0000","last_fullsized":"2024-05-08T18:08:20.814144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141641+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:08:21.141641+0000","last_peered":"2024-05-08T18:08:21.141641+0000","last_clean":"2024-05-08T18:08:21.141641+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:08:21.141641+0000","last_undegraded":"2024-05-08T18:08:21.141641+0000","last_fullsized":"2024-05-08T18:08:21.141641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140596+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:08:21.140596+0000","last_peered":"2024-05-08T18:08:21.140596+0000","last_clean":"2024-05-08T18:08:21.140596+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:08:21.140596+0000","last_undegraded":"2024-05-08T18:08:21.140596+0000","last_fullsized":"2024-05-08T18:08:21.140596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810204+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:08:20.810204+0000","last_peered":"2024-05-08T18:08:20.810204+0000","last_clean":"2024-05-08T18:08:20.810204+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:08:20.810204+0000","last_undegraded":"2024-05-08T18:08:20.810204+0000","last_fullsized":"2024-05-08T18:08:20.810204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817657+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:08:20.817657+0000","last_peered":"2024-05-08T18:08:20.817657+0000","last_clean":"2024-05-08T18:08:20.817657+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:08:20.817657+0000","last_undegraded":"2024-05-08T18:08:20.817657+0000","last_fullsized":"2024-05-08T18:08:20.817657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.815375+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:08:20.815375+0000","last_peered":"2024-05-08T18:08:20.815375+0000","last_clean":"2024-05-08T18:08:20.815375+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:08:20.815375+0000","last_undegraded":"2024-05-08T18:08:20.815375+0000","last_fullsized":"2024-05-08T18:08:20.815375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":72,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141221+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:08:21.141221+0000","last_peered":"2024-05-08T18:08:21.141221+0000","last_clean":"2024-05-08T18:08:21.141221+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:08:21.141221+0000","last_undegraded":"2024-05-08T18:08:21.141221+0000","last_fullsized":"2024-05-08T18:08:21.141221+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.137749+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:08:21.137749+0000","last_peered":"2024-05-08T18:08:21.137749+0000","last_clean":"2024-05-08T18:08:21.137749+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:08:21.137749+0000","last_undegraded":"2024-05-08T18:08:21.137749+0000","last_fullsized":"2024-05-08T18:08:21.137749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140768+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:08:21.140768+0000","last_peered":"2024-05-08T18:08:21.140768+0000","last_clean":"2024-05-08T18:08:21.140768+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:08:21.140768+0000","last_undegraded":"2024-05-08T18:08:21.140768+0000","last_fullsized":"2024-05-08T18:08:21.140768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.145106+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:08:21.145106+0000","last_peered":"2024-05-08T18:08:21.145106+0000","last_clean":"2024-05-08T18:08:21.145106+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:08:21.145106+0000","last_undegraded":"2024-05-08T18:08:21.145106+0000","last_fullsized":"2024-05-08T18:08:21.145106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141886+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:08:21.141886+0000","last_peered":"2024-05-08T18:08:21.141886+0000","last_clean":"2024-05-08T18:08:21.141886+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:08:21.141886+0000","last_undegraded":"2024-05-08T18:08:21.141886+0000","last_fullsized":"2024-05-08T18:08:21.141886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817632+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:08:20.817632+0000","last_peered":"2024-05-08T18:08:20.817632+0000","last_clean":"2024-05-08T18:08:20.817632+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:08:20.817632+0000","last_undegraded":"2024-05-08T18:08:20.817632+0000","last_fullsized":"2024-05-08T18:08:20.817632+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":109,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811888+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:08:20.811888+0000","last_peered":"2024-05-08T18:08:20.811888+0000","last_clean":"2024-05-08T18:08:20.811888+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:08:20.811888+0000","last_undegraded":"2024-05-08T18:08:20.811888+0000","last_fullsized":"2024-05-08T18:08:20.811888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.808644+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:08:20.808644+0000","last_peered":"2024-05-08T18:08:20.808644+0000","last_clean":"2024-05-08T18:08:20.808644+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:08:20.808644+0000","last_undegraded":"2024-05-08T18:08:20.808644+0000","last_fullsized":"2024-05-08T18:08:20.808644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818109+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:08:20.818109+0000","last_peered":"2024-05-08T18:08:20.818109+0000","last_clean":"2024-05-08T18:08:20.818109+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:08:20.818109+0000","last_undegraded":"2024-05-08T18:08:20.818109+0000","last_fullsized":"2024-05-08T18:08:20.818109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818105+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:08:20.818105+0000","last_peered":"2024-05-08T18:08:20.818105+0000","last_clean":"2024-05-08T18:08:20.818105+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:08:20.818105+0000","last_undegraded":"2024-05-08T18:08:20.818105+0000","last_fullsized":"2024-05-08T18:08:20.818105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141724+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:08:21.141724+0000","last_peered":"2024-05-08T18:08:21.141724+0000","last_clean":"2024-05-08T18:08:21.141724+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:08:21.141724+0000","last_undegraded":"2024-05-08T18:08:21.141724+0000","last_fullsized":"2024-05-08T18:08:21.141724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.146168+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:08:21.146168+0000","last_peered":"2024-05-08T18:08:21.146168+0000","last_clean":"2024-05-08T18:08:21.146168+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:08:21.146168+0000","last_undegraded":"2024-05-08T18:08:21.146168+0000","last_fullsized":"2024-05-08T18:08:21.146168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":80,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141653+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:08:21.141653+0000","last_peered":"2024-05-08T18:08:21.141653+0000","last_clean":"2024-05-08T18:08:21.141653+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:08:21.141653+0000","last_undegraded":"2024-05-08T18:08:21.141653+0000","last_fullsized":"2024-05-08T18:08:21.141653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139678+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:08:21.139678+0000","last_peered":"2024-05-08T18:08:21.139678+0000","last_clean":"2024-05-08T18:08:21.139678+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:08:21.139678+0000","last_undegraded":"2024-05-08T18:08:21.139678+0000","last_fullsized":"2024-05-08T18:08:21.139678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":87,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.138168+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:08:21.138168+0000","last_peered":"2024-05-08T18:08:21.138168+0000","last_clean":"2024-05-08T18:08:21.138168+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:08:21.138168+0000","last_undegraded":"2024-05-08T18:08:21.138168+0000","last_fullsized":"2024-05-08T18:08:21.138168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813248+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:08:20.813248+0000","last_peered":"2024-05-08T18:08:20.813248+0000","last_clean":"2024-05-08T18:08:20.813248+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:08:20.813248+0000","last_undegraded":"2024-05-08T18:08:20.813248+0000","last_fullsized":"2024-05-08T18:08:20.813248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811825+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:08:20.811825+0000","last_peered":"2024-05-08T18:08:20.811825+0000","last_clean":"2024-05-08T18:08:20.811825+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:08:20.811825+0000","last_undegraded":"2024-05-08T18:08:20.811825+0000","last_fullsized":"2024-05-08T18:08:20.811825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812979+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:08:20.812979+0000","last_peered":"2024-05-08T18:08:20.812979+0000","last_clean":"2024-05-08T18:08:20.812979+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:08:20.812979+0000","last_undegraded":"2024-05-08T18:08:20.812979+0000","last_fullsized":"2024-05-08T18:08:20.812979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140472+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:08:21.140472+0000","last_peered":"2024-05-08T18:08:21.140472+0000","last_clean":"2024-05-08T18:08:21.140472+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:08:21.140472+0000","last_undegraded":"2024-05-08T18:08:21.140472+0000","last_fullsized":"2024-05-08T18:08:21.140472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.808817+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:08:20.808817+0000","last_peered":"2024-05-08T18:08:20.808817+0000","last_clean":"2024-05-08T18:08:20.808817+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:08:20.808817+0000","last_undegraded":"2024-05-08T18:08:20.808817+0000","last_fullsized":"2024-05-08T18:08:20.808817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810642+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:08:20.810642+0000","last_peered":"2024-05-08T18:08:20.810642+0000","last_clean":"2024-05-08T18:08:20.810642+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:08:20.810642+0000","last_undegraded":"2024-05-08T18:08:20.810642+0000","last_fullsized":"2024-05-08T18:08:20.810642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.815193+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:08:20.815193+0000","last_peered":"2024-05-08T18:08:20.815193+0000","last_clean":"2024-05-08T18:08:20.815193+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:08:20.815193+0000","last_undegraded":"2024-05-08T18:08:20.815193+0000","last_fullsized":"2024-05-08T18:08:20.815193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817858+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:08:20.817858+0000","last_peered":"2024-05-08T18:08:20.817858+0000","last_clean":"2024-05-08T18:08:20.817858+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:08:20.817858+0000","last_undegraded":"2024-05-08T18:08:20.817858+0000","last_fullsized":"2024-05-08T18:08:20.817858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.808940+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:08:20.808940+0000","last_peered":"2024-05-08T18:08:20.808940+0000","last_clean":"2024-05-08T18:08:20.808940+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:08:20.808940+0000","last_undegraded":"2024-05-08T18:08:20.808940+0000","last_fullsized":"2024-05-08T18:08:20.808940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818892+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:08:20.818892+0000","last_peered":"2024-05-08T18:08:20.818892+0000","last_clean":"2024-05-08T18:08:20.818892+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:08:20.818892+0000","last_undegraded":"2024-05-08T18:08:20.818892+0000","last_fullsized":"2024-05-08T18:08:20.818892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142189+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:08:21.142189+0000","last_peered":"2024-05-08T18:08:21.142189+0000","last_clean":"2024-05-08T18:08:21.142189+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:08:21.142189+0000","last_undegraded":"2024-05-08T18:08:21.142189+0000","last_fullsized":"2024-05-08T18:08:21.142189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811682+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:08:20.811682+0000","last_peered":"2024-05-08T18:08:20.811682+0000","last_clean":"2024-05-08T18:08:20.811682+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:08:20.811682+0000","last_undegraded":"2024-05-08T18:08:20.811682+0000","last_fullsized":"2024-05-08T18:08:20.811682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":114,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141447+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:08:21.141447+0000","last_peered":"2024-05-08T18:08:21.141447+0000","last_clean":"2024-05-08T18:08:21.141447+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:08:21.141447+0000","last_undegraded":"2024-05-08T18:08:21.141447+0000","last_fullsized":"2024-05-08T18:08:21.141447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812712+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:08:20.812712+0000","last_peered":"2024-05-08T18:08:20.812712+0000","last_clean":"2024-05-08T18:08:20.812712+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:08:20.812712+0000","last_undegraded":"2024-05-08T18:08:20.812712+0000","last_fullsized":"2024-05-08T18:08:20.812712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144109+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:08:21.144109+0000","last_peered":"2024-05-08T18:08:21.144109+0000","last_clean":"2024-05-08T18:08:21.144109+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:08:21.144109+0000","last_undegraded":"2024-05-08T18:08:21.144109+0000","last_fullsized":"2024-05-08T18:08:21.144109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.819010+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:08:20.819010+0000","last_peered":"2024-05-08T18:08:20.819010+0000","last_clean":"2024-05-08T18:08:20.819010+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:08:20.819010+0000","last_undegraded":"2024-05-08T18:08:20.819010+0000","last_fullsized":"2024-05-08T18:08:20.819010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809518+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:08:20.809518+0000","last_peered":"2024-05-08T18:08:20.809518+0000","last_clean":"2024-05-08T18:08:20.809518+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:08:20.809518+0000","last_undegraded":"2024-05-08T18:08:20.809518+0000","last_fullsized":"2024-05-08T18:08:20.809518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809563+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:08:20.809563+0000","last_peered":"2024-05-08T18:08:20.809563+0000","last_clean":"2024-05-08T18:08:20.809563+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:08:20.809563+0000","last_undegraded":"2024-05-08T18:08:20.809563+0000","last_fullsized":"2024-05-08T18:08:20.809563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140853+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:08:21.140853+0000","last_peered":"2024-05-08T18:08:21.140853+0000","last_clean":"2024-05-08T18:08:21.140853+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:08:21.140853+0000","last_undegraded":"2024-05-08T18:08:21.140853+0000","last_fullsized":"2024-05-08T18:08:21.140853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811952+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:08:20.811952+0000","last_peered":"2024-05-08T18:08:20.811952+0000","last_clean":"2024-05-08T18:08:20.811952+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:08:20.811952+0000","last_undegraded":"2024-05-08T18:08:20.811952+0000","last_fullsized":"2024-05-08T18:08:20.811952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811531+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:08:20.811531+0000","last_peered":"2024-05-08T18:08:20.811531+0000","last_clean":"2024-05-08T18:08:20.811531+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:08:20.811531+0000","last_undegraded":"2024-05-08T18:08:20.811531+0000","last_fullsized":"2024-05-08T18:08:20.811531+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812738+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:08:20.812738+0000","last_peered":"2024-05-08T18:08:20.812738+0000","last_clean":"2024-05-08T18:08:20.812738+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:08:20.812738+0000","last_undegraded":"2024-05-08T18:08:20.812738+0000","last_fullsized":"2024-05-08T18:08:20.812738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140683+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:08:21.140683+0000","last_peered":"2024-05-08T18:08:21.140683+0000","last_clean":"2024-05-08T18:08:21.140683+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:08:21.140683+0000","last_undegraded":"2024-05-08T18:08:21.140683+0000","last_fullsized":"2024-05-08T18:08:21.140683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.145363+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:08:21.145363+0000","last_peered":"2024-05-08T18:08:21.145363+0000","last_clean":"2024-05-08T18:08:21.145363+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:08:21.145363+0000","last_undegraded":"2024-05-08T18:08:21.145363+0000","last_fullsized":"2024-05-08T18:08:21.145363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813991+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:08:20.813991+0000","last_peered":"2024-05-08T18:08:20.813991+0000","last_clean":"2024-05-08T18:08:20.813991+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:08:20.813991+0000","last_undegraded":"2024-05-08T18:08:20.813991+0000","last_fullsized":"2024-05-08T18:08:20.813991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"48'5","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812035+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:08:20.812035+0000","last_peered":"2024-05-08T18:08:20.812035+0000","last_clean":"2024-05-08T18:08:20.812035+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:08:20.812035+0000","last_undegraded":"2024-05-08T18:08:20.812035+0000","last_fullsized":"2024-05-08T18:08:20.812035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139348+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:08:21.139348+0000","last_peered":"2024-05-08T18:08:21.139348+0000","last_clean":"2024-05-08T18:08:21.139348+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:08:21.139348+0000","last_undegraded":"2024-05-08T18:08:21.139348+0000","last_fullsized":"2024-05-08T18:08:21.139348+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817661+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:08:20.817661+0000","last_peered":"2024-05-08T18:08:20.817661+0000","last_clean":"2024-05-08T18:08:20.817661+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:08:20.817661+0000","last_undegraded":"2024-05-08T18:08:20.817661+0000","last_fullsized":"2024-05-08T18:08:20.817661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.815972+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:08:20.815972+0000","last_peered":"2024-05-08T18:08:20.815972+0000","last_clean":"2024-05-08T18:08:20.815972+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:08:20.815972+0000","last_undegraded":"2024-05-08T18:08:20.815972+0000","last_fullsized":"2024-05-08T18:08:20.815972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141489+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:08:21.141489+0000","last_peered":"2024-05-08T18:08:21.141489+0000","last_clean":"2024-05-08T18:08:21.141489+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:08:21.141489+0000","last_undegraded":"2024-05-08T18:08:21.141489+0000","last_fullsized":"2024-05-08T18:08:21.141489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142772+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:08:21.142772+0000","last_peered":"2024-05-08T18:08:21.142772+0000","last_clean":"2024-05-08T18:08:21.142772+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:08:21.142772+0000","last_undegraded":"2024-05-08T18:08:21.142772+0000","last_fullsized":"2024-05-08T18:08:21.142772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813662+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:08:20.813662+0000","last_peered":"2024-05-08T18:08:20.813662+0000","last_clean":"2024-05-08T18:08:20.813662+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:08:20.813662+0000","last_undegraded":"2024-05-08T18:08:20.813662+0000","last_fullsized":"2024-05-08T18:08:20.813662+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":72,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141420+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:08:21.141420+0000","last_peered":"2024-05-08T18:08:21.141420+0000","last_clean":"2024-05-08T18:08:21.141420+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:08:21.141420+0000","last_undegraded":"2024-05-08T18:08:21.141420+0000","last_fullsized":"2024-05-08T18:08:21.141420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141770+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:08:21.141770+0000","last_peered":"2024-05-08T18:08:21.141770+0000","last_clean":"2024-05-08T18:08:21.141770+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:08:21.141770+0000","last_undegraded":"2024-05-08T18:08:21.141770+0000","last_fullsized":"2024-05-08T18:08:21.141770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811963+0000","last_change":"2024-05-08T18:07:55.359230+0000","last_active":"2024-05-08T18:08:20.811963+0000","last_peered":"2024-05-08T18:08:20.811963+0000","last_clean":"2024-05-08T18:08:20.811963+0000","last_became_active":"2024-05-08T18:07:55.358047+0000","last_became_peered":"2024-05-08T18:07:55.358047+0000","last_unstale":"2024-05-08T18:08:20.811963+0000","last_undegraded":"2024-05-08T18:08:20.811963+0000","last_fullsized":"2024-05-08T18:08:20.811963+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:52.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.819237+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:08:20.819237+0000","last_peered":"2024-05-08T18:08:20.819237+0000","last_clean":"2024-05-08T18:08:20.819237+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:08:20.819237+0000","last_undegraded":"2024-05-08T18:08:20.819237+0000","last_fullsized":"2024-05-08T18:08:20.819237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":80,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141652+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:08:21.141652+0000","last_peered":"2024-05-08T18:08:21.141652+0000","last_clean":"2024-05-08T18:08:21.141652+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:08:21.141652+0000","last_undegraded":"2024-05-08T18:08:21.141652+0000","last_fullsized":"2024-05-08T18:08:21.141652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142649+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:08:21.142649+0000","last_peered":"2024-05-08T18:08:21.142649+0000","last_clean":"2024-05-08T18:08:21.142649+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:08:21.142649+0000","last_undegraded":"2024-05-08T18:08:21.142649+0000","last_fullsized":"2024-05-08T18:08:21.142649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817387+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:08:20.817387+0000","last_peered":"2024-05-08T18:08:20.817387+0000","last_clean":"2024-05-08T18:08:20.817387+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:08:20.817387+0000","last_undegraded":"2024-05-08T18:08:20.817387+0000","last_fullsized":"2024-05-08T18:08:20.817387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141829+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:08:21.141829+0000","last_peered":"2024-05-08T18:08:21.141829+0000","last_clean":"2024-05-08T18:08:21.141829+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:08:21.141829+0000","last_undegraded":"2024-05-08T18:08:21.141829+0000","last_fullsized":"2024-05-08T18:08:21.141829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812101+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:08:20.812101+0000","last_peered":"2024-05-08T18:08:20.812101+0000","last_clean":"2024-05-08T18:08:20.812101+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:08:20.812101+0000","last_undegraded":"2024-05-08T18:08:20.812101+0000","last_fullsized":"2024-05-08T18:08:20.812101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":83,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818510+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:08:20.818510+0000","last_peered":"2024-05-08T18:08:20.818510+0000","last_clean":"2024-05-08T18:08:20.818510+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:08:20.818510+0000","last_undegraded":"2024-05-08T18:08:20.818510+0000","last_fullsized":"2024-05-08T18:08:20.818510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":101,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142103+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:08:21.142103+0000","last_peered":"2024-05-08T18:08:21.142103+0000","last_clean":"2024-05-08T18:08:21.142103+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:08:21.142103+0000","last_undegraded":"2024-05-08T18:08:21.142103+0000","last_fullsized":"2024-05-08T18:08:21.142103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142245+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:08:21.142245+0000","last_peered":"2024-05-08T18:08:21.142245+0000","last_clean":"2024-05-08T18:08:21.142245+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:08:21.142245+0000","last_undegraded":"2024-05-08T18:08:21.142245+0000","last_fullsized":"2024-05-08T18:08:21.142245+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813207+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:08:20.813207+0000","last_peered":"2024-05-08T18:08:20.813207+0000","last_clean":"2024-05-08T18:08:20.813207+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:08:20.813207+0000","last_undegraded":"2024-05-08T18:08:20.813207+0000","last_fullsized":"2024-05-08T18:08:20.813207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.818658+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:08:20.818658+0000","last_peered":"2024-05-08T18:08:20.818658+0000","last_clean":"2024-05-08T18:08:20.818658+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:08:20.818658+0000","last_undegraded":"2024-05-08T18:08:20.818658+0000","last_fullsized":"2024-05-08T18:08:20.818658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140331+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:08:21.140331+0000","last_peered":"2024-05-08T18:08:21.140331+0000","last_clean":"2024-05-08T18:08:21.140331+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:08:21.140331+0000","last_undegraded":"2024-05-08T18:08:21.140331+0000","last_fullsized":"2024-05-08T18:08:21.140331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":80,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141458+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:08:21.141458+0000","last_peered":"2024-05-08T18:08:21.141458+0000","last_clean":"2024-05-08T18:08:21.141458+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:08:21.141458+0000","last_undegraded":"2024-05-08T18:08:21.141458+0000","last_fullsized":"2024-05-08T18:08:21.141458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":103,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143055+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:08:21.143055+0000","last_peered":"2024-05-08T18:08:21.143055+0000","last_clean":"2024-05-08T18:08:21.143055+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:08:21.143055+0000","last_undegraded":"2024-05-08T18:08:21.143055+0000","last_fullsized":"2024-05-08T18:08:21.143055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142195+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:08:21.142195+0000","last_peered":"2024-05-08T18:08:21.142195+0000","last_clean":"2024-05-08T18:08:21.142195+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:08:21.142195+0000","last_undegraded":"2024-05-08T18:08:21.142195+0000","last_fullsized":"2024-05-08T18:08:21.142195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":68,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141033+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:08:21.141033+0000","last_peered":"2024-05-08T18:08:21.141033+0000","last_clean":"2024-05-08T18:08:21.141033+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:08:21.141033+0000","last_undegraded":"2024-05-08T18:08:21.141033+0000","last_fullsized":"2024-05-08T18:08:21.141033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812754+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:08:20.812754+0000","last_peered":"2024-05-08T18:08:20.812754+0000","last_clean":"2024-05-08T18:08:20.812754+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:08:20.812754+0000","last_undegraded":"2024-05-08T18:08:20.812754+0000","last_fullsized":"2024-05-08T18:08:20.812754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810989+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:08:20.810989+0000","last_peered":"2024-05-08T18:08:20.810989+0000","last_clean":"2024-05-08T18:08:20.810989+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:08:20.810989+0000","last_undegraded":"2024-05-08T18:08:20.810989+0000","last_fullsized":"2024-05-08T18:08:20.810989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810158+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:08:20.810158+0000","last_peered":"2024-05-08T18:08:20.810158+0000","last_clean":"2024-05-08T18:08:20.810158+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:08:20.810158+0000","last_undegraded":"2024-05-08T18:08:20.810158+0000","last_fullsized":"2024-05-08T18:08:20.810158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813359+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:08:20.813359+0000","last_peered":"2024-05-08T18:08:20.813359+0000","last_clean":"2024-05-08T18:08:20.813359+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:08:20.813359+0000","last_undegraded":"2024-05-08T18:08:20.813359+0000","last_fullsized":"2024-05-08T18:08:20.813359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":74,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139763+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:08:21.139763+0000","last_peered":"2024-05-08T18:08:21.139763+0000","last_clean":"2024-05-08T18:08:21.139763+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:08:21.139763+0000","last_undegraded":"2024-05-08T18:08:21.139763+0000","last_fullsized":"2024-05-08T18:08:21.139763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139071+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:08:21.139071+0000","last_peered":"2024-05-08T18:08:21.139071+0000","last_clean":"2024-05-08T18:08:21.139071+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:08:21.139071+0000","last_undegraded":"2024-05-08T18:08:21.139071+0000","last_fullsized":"2024-05-08T18:08:21.139071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141027+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:08:21.141027+0000","last_peered":"2024-05-08T18:08:21.141027+0000","last_clean":"2024-05-08T18:08:21.141027+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:08:21.141027+0000","last_undegraded":"2024-05-08T18:08:21.141027+0000","last_fullsized":"2024-05-08T18:08:21.141027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817504+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:08:20.817504+0000","last_peered":"2024-05-08T18:08:20.817504+0000","last_clean":"2024-05-08T18:08:20.817504+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:08:20.817504+0000","last_undegraded":"2024-05-08T18:08:20.817504+0000","last_fullsized":"2024-05-08T18:08:20.817504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142492+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:08:21.142492+0000","last_peered":"2024-05-08T18:08:21.142492+0000","last_clean":"2024-05-08T18:08:21.142492+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:08:21.142492+0000","last_undegraded":"2024-05-08T18:08:21.142492+0000","last_fullsized":"2024-05-08T18:08:21.142492+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810875+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:08:20.810875+0000","last_peered":"2024-05-08T18:08:20.810875+0000","last_clean":"2024-05-08T18:08:20.810875+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:08:20.810875+0000","last_undegraded":"2024-05-08T18:08:20.810875+0000","last_fullsized":"2024-05-08T18:08:20.810875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140789+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:08:21.140789+0000","last_peered":"2024-05-08T18:08:21.140789+0000","last_clean":"2024-05-08T18:08:21.140789+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:08:21.140789+0000","last_undegraded":"2024-05-08T18:08:21.140789+0000","last_fullsized":"2024-05-08T18:08:21.140789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142493+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:08:21.142493+0000","last_peered":"2024-05-08T18:08:21.142493+0000","last_clean":"2024-05-08T18:08:21.142493+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:08:21.142493+0000","last_undegraded":"2024-05-08T18:08:21.142493+0000","last_fullsized":"2024-05-08T18:08:21.142493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809413+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:08:20.809413+0000","last_peered":"2024-05-08T18:08:20.809413+0000","last_clean":"2024-05-08T18:08:20.809413+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:08:20.809413+0000","last_undegraded":"2024-05-08T18:08:20.809413+0000","last_fullsized":"2024-05-08T18:08:20.809413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142881+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:08:21.142881+0000","last_peered":"2024-05-08T18:08:21.142881+0000","last_clean":"2024-05-08T18:08:21.142881+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:08:21.142881+0000","last_undegraded":"2024-05-08T18:08:21.142881+0000","last_fullsized":"2024-05-08T18:08:21.142881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143198+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:08:21.143198+0000","last_peered":"2024-05-08T18:08:21.143198+0000","last_clean":"2024-05-08T18:08:21.143198+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:08:21.143198+0000","last_undegraded":"2024-05-08T18:08:21.143198+0000","last_fullsized":"2024-05-08T18:08:21.143198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":102,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139462+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:08:21.139462+0000","last_peered":"2024-05-08T18:08:21.139462+0000","last_clean":"2024-05-08T18:08:21.139462+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:08:21.139462+0000","last_undegraded":"2024-05-08T18:08:21.139462+0000","last_fullsized":"2024-05-08T18:08:21.139462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811579+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:08:20.811579+0000","last_peered":"2024-05-08T18:08:20.811579+0000","last_clean":"2024-05-08T18:08:20.811579+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:08:20.811579+0000","last_undegraded":"2024-05-08T18:08:20.811579+0000","last_fullsized":"2024-05-08T18:08:20.811579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.146895+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:08:21.146895+0000","last_peered":"2024-05-08T18:08:21.146895+0000","last_clean":"2024-05-08T18:08:21.146895+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:08:21.146895+0000","last_undegraded":"2024-05-08T18:08:21.146895+0000","last_fullsized":"2024-05-08T18:08:21.146895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810838+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:08:20.810838+0000","last_peered":"2024-05-08T18:08:20.810838+0000","last_clean":"2024-05-08T18:08:20.810838+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:08:20.810838+0000","last_undegraded":"2024-05-08T18:08:20.810838+0000","last_fullsized":"2024-05-08T18:08:20.810838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144982+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:08:21.144982+0000","last_peered":"2024-05-08T18:08:21.144982+0000","last_clean":"2024-05-08T18:08:21.144982+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:08:21.144982+0000","last_undegraded":"2024-05-08T18:08:21.144982+0000","last_fullsized":"2024-05-08T18:08:21.144982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140922+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:08:21.140922+0000","last_peered":"2024-05-08T18:08:21.140922+0000","last_clean":"2024-05-08T18:08:21.140922+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:08:21.140922+0000","last_undegraded":"2024-05-08T18:08:21.140922+0000","last_fullsized":"2024-05-08T18:08:21.140922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811684+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:08:20.811684+0000","last_peered":"2024-05-08T18:08:20.811684+0000","last_clean":"2024-05-08T18:08:20.811684+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:08:20.811684+0000","last_undegraded":"2024-05-08T18:08:20.811684+0000","last_fullsized":"2024-05-08T18:08:20.811684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":72,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141117+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:08:21.141117+0000","last_peered":"2024-05-08T18:08:21.141117+0000","last_clean":"2024-05-08T18:08:21.141117+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:08:21.141117+0000","last_undegraded":"2024-05-08T18:08:21.141117+0000","last_fullsized":"2024-05-08T18:08:21.141117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.812838+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:08:20.812838+0000","last_peered":"2024-05-08T18:08:20.812838+0000","last_clean":"2024-05-08T18:08:20.812838+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:08:20.812838+0000","last_undegraded":"2024-05-08T18:08:20.812838+0000","last_fullsized":"2024-05-08T18:08:20.812838+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.816258+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:08:20.816258+0000","last_peered":"2024-05-08T18:08:20.816258+0000","last_clean":"2024-05-08T18:08:20.816258+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:08:20.816258+0000","last_undegraded":"2024-05-08T18:08:20.816258+0000","last_fullsized":"2024-05-08T18:08:20.816258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":36,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139652+0000","last_change":"2024-05-08T18:07:55.439856+0000","last_active":"2024-05-08T18:08:21.139652+0000","last_peered":"2024-05-08T18:08:21.139652+0000","last_clean":"2024-05-08T18:08:21.139652+0000","last_became_active":"2024-05-08T18:07:55.439188+0000","last_became_peered":"2024-05-08T18:07:55.439188+0000","last_unstale":"2024-05-08T18:08:21.139652+0000","last_undegraded":"2024-05-08T18:08:21.139652+0000","last_fullsized":"2024-05-08T18:08:21.139652+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:40.273251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":81,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.808506+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:08:20.808506+0000","last_peered":"2024-05-08T18:08:20.808506+0000","last_clean":"2024-05-08T18:08:20.808506+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:08:20.808506+0000","last_undegraded":"2024-05-08T18:08:20.808506+0000","last_fullsized":"2024-05-08T18:08:20.808506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.814927+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:08:20.814927+0000","last_peered":"2024-05-08T18:08:20.814927+0000","last_clean":"2024-05-08T18:08:20.814927+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:08:20.814927+0000","last_undegraded":"2024-05-08T18:08:20.814927+0000","last_fullsized":"2024-05-08T18:08:20.814927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.808892+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:08:20.808892+0000","last_peered":"2024-05-08T18:08:20.808892+0000","last_clean":"2024-05-08T18:08:20.808892+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:08:20.808892+0000","last_undegraded":"2024-05-08T18:08:20.808892+0000","last_fullsized":"2024-05-08T18:08:20.808892+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":70,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144628+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:08:21.144628+0000","last_peered":"2024-05-08T18:08:21.144628+0000","last_clean":"2024-05-08T18:08:21.144628+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:08:21.144628+0000","last_undegraded":"2024-05-08T18:08:21.144628+0000","last_fullsized":"2024-05-08T18:08:21.144628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809238+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:08:20.809238+0000","last_peered":"2024-05-08T18:08:20.809238+0000","last_clean":"2024-05-08T18:08:20.809238+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:08:20.809238+0000","last_undegraded":"2024-05-08T18:08:20.809238+0000","last_fullsized":"2024-05-08T18:08:20.809238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.819190+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:08:20.819190+0000","last_peered":"2024-05-08T18:08:20.819190+0000","last_clean":"2024-05-08T18:08:20.819190+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:08:20.819190+0000","last_undegraded":"2024-05-08T18:08:20.819190+0000","last_fullsized":"2024-05-08T18:08:20.819190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":83,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139779+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:08:21.139779+0000","last_peered":"2024-05-08T18:08:21.139779+0000","last_clean":"2024-05-08T18:08:21.139779+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:08:21.139779+0000","last_undegraded":"2024-05-08T18:08:21.139779+0000","last_fullsized":"2024-05-08T18:08:21.139779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809297+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:08:20.809297+0000","last_peered":"2024-05-08T18:08:20.809297+0000","last_clean":"2024-05-08T18:08:20.809297+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:08:20.809297+0000","last_undegraded":"2024-05-08T18:08:20.809297+0000","last_fullsized":"2024-05-08T18:08:20.809297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":73,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817301+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:08:20.817301+0000","last_peered":"2024-05-08T18:08:20.817301+0000","last_clean":"2024-05-08T18:08:20.817301+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:08:20.817301+0000","last_undegraded":"2024-05-08T18:08:20.817301+0000","last_fullsized":"2024-05-08T18:08:20.817301+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":69,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810239+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:08:20.810239+0000","last_peered":"2024-05-08T18:08:20.810239+0000","last_clean":"2024-05-08T18:08:20.810239+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:08:20.810239+0000","last_undegraded":"2024-05-08T18:08:20.810239+0000","last_fullsized":"2024-05-08T18:08:20.810239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141413+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:08:21.141413+0000","last_peered":"2024-05-08T18:08:21.141413+0000","last_clean":"2024-05-08T18:08:21.141413+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:08:21.141413+0000","last_undegraded":"2024-05-08T18:08:21.141413+0000","last_fullsized":"2024-05-08T18:08:21.141413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139418+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:08:21.139418+0000","last_peered":"2024-05-08T18:08:21.139418+0000","last_clean":"2024-05-08T18:08:21.139418+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:08:21.139418+0000","last_undegraded":"2024-05-08T18:08:21.139418+0000","last_fullsized":"2024-05-08T18:08:21.139418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140053+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:08:21.140053+0000","last_peered":"2024-05-08T18:08:21.140053+0000","last_clean":"2024-05-08T18:08:21.140053+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:08:21.140053+0000","last_undegraded":"2024-05-08T18:08:21.140053+0000","last_fullsized":"2024-05-08T18:08:21.140053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139356+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:08:21.139356+0000","last_peered":"2024-05-08T18:08:21.139356+0000","last_clean":"2024-05-08T18:08:21.139356+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:08:21.139356+0000","last_undegraded":"2024-05-08T18:08:21.139356+0000","last_fullsized":"2024-05-08T18:08:21.139356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.144759+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:08:21.144759+0000","last_peered":"2024-05-08T18:08:21.144759+0000","last_clean":"2024-05-08T18:08:21.144759+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:08:21.144759+0000","last_undegraded":"2024-05-08T18:08:21.144759+0000","last_fullsized":"2024-05-08T18:08:21.144759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140439+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:08:21.140439+0000","last_peered":"2024-05-08T18:08:21.140439+0000","last_clean":"2024-05-08T18:08:21.140439+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:08:21.140439+0000","last_undegraded":"2024-05-08T18:08:21.140439+0000","last_fullsized":"2024-05-08T18:08:21.140439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141805+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:08:21.141805+0000","last_peered":"2024-05-08T18:08:21.141805+0000","last_clean":"2024-05-08T18:08:21.141805+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:08:21.141805+0000","last_undegraded":"2024-05-08T18:08:21.141805+0000","last_fullsized":"2024-05-08T18:08:21.141805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817607+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:08:20.817607+0000","last_peered":"2024-05-08T18:08:20.817607+0000","last_clean":"2024-05-08T18:08:20.817607+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:08:20.817607+0000","last_undegraded":"2024-05-08T18:08:20.817607+0000","last_fullsized":"2024-05-08T18:08:20.817607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.814401+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:08:20.814401+0000","last_peered":"2024-05-08T18:08:20.814401+0000","last_clean":"2024-05-08T18:08:20.814401+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:08:20.814401+0000","last_undegraded":"2024-05-08T18:08:20.814401+0000","last_fullsized":"2024-05-08T18:08:20.814401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813119+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:08:20.813119+0000","last_peered":"2024-05-08T18:08:20.813119+0000","last_clean":"2024-05-08T18:08:20.813119+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:08:20.813119+0000","last_undegraded":"2024-05-08T18:08:20.813119+0000","last_fullsized":"2024-05-08T18:08:20.813119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.810887+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:08:20.810887+0000","last_peered":"2024-05-08T18:08:20.810887+0000","last_clean":"2024-05-08T18:08:20.810887+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:08:20.810887+0000","last_undegraded":"2024-05-08T18:08:20.810887+0000","last_fullsized":"2024-05-08T18:08:20.810887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142738+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:08:21.142738+0000","last_peered":"2024-05-08T18:08:21.142738+0000","last_clean":"2024-05-08T18:08:21.142738+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:08:21.142738+0000","last_undegraded":"2024-05-08T18:08:21.142738+0000","last_fullsized":"2024-05-08T18:08:21.142738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.815819+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:08:20.815819+0000","last_peered":"2024-05-08T18:08:20.815819+0000","last_clean":"2024-05-08T18:08:20.815819+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:08:20.815819+0000","last_undegraded":"2024-05-08T18:08:20.815819+0000","last_fullsized":"2024-05-08T18:08:20.815819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142737+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:08:21.142737+0000","last_peered":"2024-05-08T18:08:21.142737+0000","last_clean":"2024-05-08T18:08:21.142737+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:08:21.142737+0000","last_undegraded":"2024-05-08T18:08:21.142737+0000","last_fullsized":"2024-05-08T18:08:21.142737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139173+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:08:21.139173+0000","last_peered":"2024-05-08T18:08:21.139173+0000","last_clean":"2024-05-08T18:08:21.139173+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:08:21.139173+0000","last_undegraded":"2024-05-08T18:08:21.139173+0000","last_fullsized":"2024-05-08T18:08:21.139173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.813161+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:08:20.813161+0000","last_peered":"2024-05-08T18:08:20.813161+0000","last_clean":"2024-05-08T18:08:20.813161+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:08:20.813161+0000","last_undegraded":"2024-05-08T18:08:20.813161+0000","last_fullsized":"2024-05-08T18:08:20.813161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.819207+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:08:20.819207+0000","last_peered":"2024-05-08T18:08:20.819207+0000","last_clean":"2024-05-08T18:08:20.819207+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:08:20.819207+0000","last_undegraded":"2024-05-08T18:08:20.819207+0000","last_fullsized":"2024-05-08T18:08:20.819207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143373+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:08:21.143373+0000","last_peered":"2024-05-08T18:08:21.143373+0000","last_clean":"2024-05-08T18:08:21.143373+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:08:21.143373+0000","last_undegraded":"2024-05-08T18:08:21.143373+0000","last_fullsized":"2024-05-08T18:08:21.143373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.811173+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:08:20.811173+0000","last_peered":"2024-05-08T18:08:20.811173+0000","last_clean":"2024-05-08T18:08:20.811173+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:08:20.811173+0000","last_undegraded":"2024-05-08T18:08:20.811173+0000","last_fullsized":"2024-05-08T18:08:20.811173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.816458+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:08:20.816458+0000","last_peered":"2024-05-08T18:08:20.816458+0000","last_clean":"2024-05-08T18:08:20.816458+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:08:20.816458+0000","last_undegraded":"2024-05-08T18:08:20.816458+0000","last_fullsized":"2024-05-08T18:08:20.816458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141910+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:08:21.141910+0000","last_peered":"2024-05-08T18:08:21.141910+0000","last_clean":"2024-05-08T18:08:21.141910+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:08:21.141910+0000","last_undegraded":"2024-05-08T18:08:21.141910+0000","last_fullsized":"2024-05-08T18:08:21.141910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":36,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.139816+0000","last_change":"2024-05-08T18:07:55.445745+0000","last_active":"2024-05-08T18:08:21.139816+0000","last_peered":"2024-05-08T18:08:21.139816+0000","last_clean":"2024-05-08T18:08:21.139816+0000","last_became_active":"2024-05-08T18:07:55.444935+0000","last_became_peered":"2024-05-08T18:07:55.444935+0000","last_unstale":"2024-05-08T18:08:21.139816+0000","last_undegraded":"2024-05-08T18:08:21.139816+0000","last_fullsized":"2024-05-08T18:08:21.139816+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:37.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.809946+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:08:20.809946+0000","last_peered":"2024-05-08T18:08:20.809946+0000","last_clean":"2024-05-08T18:08:20.809946+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:08:20.809946+0000","last_undegraded":"2024-05-08T18:08:20.809946+0000","last_fullsized":"2024-05-08T18:08:20.809946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817718+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:08:20.817718+0000","last_peered":"2024-05-08T18:08:20.817718+0000","last_clean":"2024-05-08T18:08:20.817718+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:08:20.817718+0000","last_undegraded":"2024-05-08T18:08:20.817718+0000","last_fullsized":"2024-05-08T18:08:20.817718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142004+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:08:21.142004+0000","last_peered":"2024-05-08T18:08:21.142004+0000","last_clean":"2024-05-08T18:08:21.142004+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:08:21.142004+0000","last_undegraded":"2024-05-08T18:08:21.142004+0000","last_fullsized":"2024-05-08T18:08:21.142004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140535+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:08:21.140535+0000","last_peered":"2024-05-08T18:08:21.140535+0000","last_clean":"2024-05-08T18:08:21.140535+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:08:21.140535+0000","last_undegraded":"2024-05-08T18:08:21.140535+0000","last_fullsized":"2024-05-08T18:08:21.140535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.817268+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:08:20.817268+0000","last_peered":"2024-05-08T18:08:20.817268+0000","last_clean":"2024-05-08T18:08:20.817268+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:08:20.817268+0000","last_undegraded":"2024-05-08T18:08:20.817268+0000","last_fullsized":"2024-05-08T18:08:20.817268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.145923+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:08:21.145923+0000","last_peered":"2024-05-08T18:08:21.145923+0000","last_clean":"2024-05-08T18:08:21.145923+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:08:21.145923+0000","last_undegraded":"2024-05-08T18:08:21.145923+0000","last_fullsized":"2024-05-08T18:08:21.145923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.815663+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:08:20.815663+0000","last_peered":"2024-05-08T18:08:20.815663+0000","last_clean":"2024-05-08T18:08:20.815663+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:08:20.815663+0000","last_undegraded":"2024-05-08T18:08:20.815663+0000","last_fullsized":"2024-05-08T18:08:20.815663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.142569+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:08:21.142569+0000","last_peered":"2024-05-08T18:08:21.142569+0000","last_clean":"2024-05-08T18:08:21.142569+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:08:21.142569+0000","last_undegraded":"2024-05-08T18:08:21.142569+0000","last_fullsized":"2024-05-08T18:08:21.142569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":86,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143311+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:08:21.143311+0000","last_peered":"2024-05-08T18:08:21.143311+0000","last_clean":"2024-05-08T18:08:21.143311+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:08:21.143311+0000","last_undegraded":"2024-05-08T18:08:21.143311+0000","last_fullsized":"2024-05-08T18:08:21.143311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143678+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:08:21.143678+0000","last_peered":"2024-05-08T18:08:21.143678+0000","last_clean":"2024-05-08T18:08:21.143678+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:08:21.143678+0000","last_undegraded":"2024-05-08T18:08:21.143678+0000","last_fullsized":"2024-05-08T18:08:21.143678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":89,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.143180+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:08:21.143180+0000","last_peered":"2024-05-08T18:08:21.143180+0000","last_clean":"2024-05-08T18:08:21.143180+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:08:21.143180+0000","last_undegraded":"2024-05-08T18:08:21.143180+0000","last_fullsized":"2024-05-08T18:08:21.143180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:20.819138+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:08:20.819138+0000","last_peered":"2024-05-08T18:08:20.819138+0000","last_clean":"2024-05-08T18:08:20.819138+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:08:20.819138+0000","last_undegraded":"2024-05-08T18:08:20.819138+0000","last_fullsized":"2024-05-08T18:08:20.819138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.140185+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:08:21.140185+0000","last_peered":"2024-05-08T18:08:21.140185+0000","last_clean":"2024-05-08T18:08:21.140185+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:08:21.140185+0000","last_undegraded":"2024-05-08T18:08:21.140185+0000","last_fullsized":"2024-05-08T18:08:21.140185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":85,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-08T18:08:21.141122+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:08:21.141122+0000","last_peered":"2024-05-08T18:08:21.141122+0000","last_clean":"2024-05-08T18:08:21.141122+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:08:21.141122+0000","last_undegraded":"2024-05-08T18:08:21.141122+0000","last_fullsized":"2024-05-08T18:08:21.141122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28340,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343500,"statfs":{"total":96636764160,"available":96607744000,"internally_reserved":0,"allocated":1347584,"data_stored":967126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":724992,"data_stored":375662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":786432,"data_stored":385328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":383998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":376058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":712704,"data_stored":375224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":383757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1339392,"data_stored":974377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:08:23.627 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-08T18:08:23.627 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-08T18:08:23.627 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-05-08T18:08:23.627 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-05-08T18:08:23.627 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-05-08T18:08:23.628 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2024-05-08T18:08:23.629 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:23.630+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:23.641 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:23.641 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:23.656 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:23.656 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:23.663 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:23.663 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:23.672 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:23.672 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:23.679 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:08:23.689 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:23.690 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:23.706 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:23.706 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:23.724 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:23.724 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:23.729 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:23.730+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:23.741 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:23.741 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:23.746 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:23.746 INFO:teuthology.orchestra.run.smithi115.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-05-08T18:08:23.746 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:23.821 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-05-08T18:08:23.830 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:23.830+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:23.851 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:23.851 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:23.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:23.851 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:23.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.851 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:3 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:08:23.851 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:23.852 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.314918946000006, 2024-05-08T18:08:23.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046964590000000001, 2024-05-08T18:08:23.852 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.852 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.852 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:08:23.852 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:23.852 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:08:23.852 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:08:23.852 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 3 2024-05-08T18:08:23.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.852 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:23.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:23.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534906+0000", 2024-05-08T18:08:23.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1030000000000002e-06 2024-05-08T18:08:23.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534918+0000", 2024-05-08T18:08:23.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1732999999999999e-05 2024-05-08T18:08:23.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534950+0000", 2024-05-08T18:08:23.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1420000000000001e-05 2024-05-08T18:08:23.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534974+0000", 2024-05-08T18:08:23.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4473000000000001e-05 2024-05-08T18:08:23.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.539338+0000", 2024-05-08T18:08:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043636719999999999 2024-05-08T18:08:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.539600+0000", 2024-05-08T18:08:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026205800000000002 2024-05-08T18:08:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.855 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.281845281999999, 2024-05-08T18:08:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054299370000000001, 2024-05-08T18:08:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 48 2024-05-08T18:08:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:23.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:23.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567980+0000", 2024-05-08T18:08:23.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.554e-06 2024-05-08T18:08:23.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567990+0000", 2024-05-08T18:08:23.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0961999999999999e-05 2024-05-08T18:08:23.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568023+0000", 2024-05-08T18:08:23.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441999999999999e-05 2024-05-08T18:08:23.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568042+0000", 2024-05-08T18:08:23.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8760999999999999e-05 2024-05-08T18:08:23.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568165+0000", 2024-05-08T18:08:23.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012333400000000001 2024-05-08T18:08:23.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568426+0000", 2024-05-08T18:08:23.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026132999999999999 2024-05-08T18:08:23.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:23.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568666+0000", 2024-05-08T18:08:23.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024009500000000001 2024-05-08T18:08:23.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:23.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.569886+0000", 2024-05-08T18:08:23.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012194790000000001 2024-05-08T18:08:23.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:23.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573254+0000", 2024-05-08T18:08:23.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033677109999999998 2024-05-08T18:08:23.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573339+0000", 2024-05-08T18:08:23.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5666000000000003e-05 2024-05-08T18:08:23.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573407+0000", 2024-05-08T18:08:23.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7602999999999996e-05 2024-05-08T18:08:23.861 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.861 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.861 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.861 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94206896343168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:23.861 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:23.861 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.276165120000002, 2024-05-08T18:08:23.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054113640000000001, 2024-05-08T18:08:23.862 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.862 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.862 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.862 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:23.862 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:23.862 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:23.862 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 49 2024-05-08T18:08:23.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.862 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:23.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:23.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573659+0000", 2024-05-08T18:08:23.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.762e-06 2024-05-08T18:08:23.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573667+0000", 2024-05-08T18:08:23.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8120000000000008e-06 2024-05-08T18:08:23.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573693+0000", 2024-05-08T18:08:23.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6057000000000001e-05 2024-05-08T18:08:23.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573710+0000", 2024-05-08T18:08:23.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7555999999999999e-05 2024-05-08T18:08:23.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573851+0000", 2024-05-08T18:08:23.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014109800000000001 2024-05-08T18:08:23.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.574072+0000", 2024-05-08T18:08:23.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022062899999999999 2024-05-08T18:08:23.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:23.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.574500+0000", 2024-05-08T18:08:23.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042798100000000002 2024-05-08T18:08:23.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:23.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.575719+0000", 2024-05-08T18:08:23.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001218717 2024-05-08T18:08:23.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:23.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578840+0000", 2024-05-08T18:08:23.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031215380000000001 2024-05-08T18:08:23.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578925+0000", 2024-05-08T18:08:23.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5191999999999993e-05 2024-05-08T18:08:23.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579069+0000", 2024-05-08T18:08:23.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143022 2024-05-08T18:08:23.867 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.867 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.867 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.867 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:08:23.867 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:23.867 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.273377140999997, 2024-05-08T18:08:23.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034814389999999998, 2024-05-08T18:08:23.868 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.868 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.868 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.868 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:23.868 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:23.868 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:23.868 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 205 2024-05-08T18:08:23.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.868 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:23.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:23.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576448+0000", 2024-05-08T18:08:23.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7839999999999999e-06 2024-05-08T18:08:23.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576462+0000", 2024-05-08T18:08:23.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4348999999999999e-05 2024-05-08T18:08:23.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576500+0000", 2024-05-08T18:08:23.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7252999999999997e-05 2024-05-08T18:08:23.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576528+0000", 2024-05-08T18:08:23.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8691e-05 2024-05-08T18:08:23.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576686+0000", 2024-05-08T18:08:23.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015810999999999999 2024-05-08T18:08:23.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576927+0000", 2024-05-08T18:08:23.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000240337 2024-05-08T18:08:23.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:23.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.577354+0000", 2024-05-08T18:08:23.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042767499999999997 2024-05-08T18:08:23.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:23.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.578866+0000", 2024-05-08T18:08:23.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001511271 2024-05-08T18:08:23.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:23.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579762+0000", 2024-05-08T18:08:23.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089618599999999999 2024-05-08T18:08:23.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579858+0000", 2024-05-08T18:08:23.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6686000000000002e-05 2024-05-08T18:08:23.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579927+0000", 2024-05-08T18:08:23.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8096999999999995e-05 2024-05-08T18:08:23.873 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.873 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.873 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.873 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:23.873 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:23.873 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.205381301000003, 2024-05-08T18:08:23.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035139590000000001, 2024-05-08T18:08:23.873 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.874 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.874 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.874 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:23.874 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:23.874 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:23.874 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 220 2024-05-08T18:08:23.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.874 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:23.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:23.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644444+0000", 2024-05-08T18:08:23.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6759999999999999e-06 2024-05-08T18:08:23.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644455+0000", 2024-05-08T18:08:23.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:08:23.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644487+0000", 2024-05-08T18:08:23.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2199999999999997e-05 2024-05-08T18:08:23.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644503+0000", 2024-05-08T18:08:23.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5452e-05 2024-05-08T18:08:23.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644689+0000", 2024-05-08T18:08:23.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000186541 2024-05-08T18:08:23.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644902+0000", 2024-05-08T18:08:23.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021321299999999999 2024-05-08T18:08:23.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:23.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.645299+0000", 2024-05-08T18:08:23.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039702699999999999 2024-05-08T18:08:23.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:23.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647459+0000", 2024-05-08T18:08:23.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021598279999999999 2024-05-08T18:08:23.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:23.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647803+0000", 2024-05-08T18:08:23.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034338199999999999 2024-05-08T18:08:23.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647888+0000", 2024-05-08T18:08:23.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5125999999999998e-05 2024-05-08T18:08:23.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647955+0000", 2024-05-08T18:08:23.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7280999999999995e-05 2024-05-08T18:08:23.879 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.879 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.879 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.879 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:23.879 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:23.879 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.185516782000001, 2024-05-08T18:08:23.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003220367, 2024-05-08T18:08:23.879 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.879 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.880 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.880 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:23.880 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:23.880 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:23.880 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 225 2024-05-08T18:08:23.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.880 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:23.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:23.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664308+0000", 2024-05-08T18:08:23.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:23.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664333+0000", 2024-05-08T18:08:23.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5361e-05 2024-05-08T18:08:23.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664362+0000", 2024-05-08T18:08:23.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8671999999999999e-05 2024-05-08T18:08:23.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664376+0000", 2024-05-08T18:08:23.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4741e-05 2024-05-08T18:08:23.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664541+0000", 2024-05-08T18:08:23.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016484400000000001 2024-05-08T18:08:23.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664767+0000", 2024-05-08T18:08:23.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000226061 2024-05-08T18:08:23.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:23.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.665199+0000", 2024-05-08T18:08:23.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000431674 2024-05-08T18:08:23.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:23.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.666428+0000", 2024-05-08T18:08:23.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001228605 2024-05-08T18:08:23.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:23.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667367+0000", 2024-05-08T18:08:23.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093924199999999996 2024-05-08T18:08:23.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667461+0000", 2024-05-08T18:08:23.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3762000000000001e-05 2024-05-08T18:08:23.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667526+0000", 2024-05-08T18:08:23.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5254999999999998e-05 2024-05-08T18:08:23.884 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.885 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.885 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.885 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:23.885 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:23.885 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.153289284000003, 2024-05-08T18:08:23.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037451559999999999, 2024-05-08T18:08:23.885 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.885 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.885 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.885 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:23.885 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:23.886 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:23.886 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 234 2024-05-08T18:08:23.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.886 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:23.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:23.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696535+0000", 2024-05-08T18:08:23.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0760000000000001e-06 2024-05-08T18:08:23.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696546+0000", 2024-05-08T18:08:23.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0556e-05 2024-05-08T18:08:23.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696577+0000", 2024-05-08T18:08:23.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0904000000000001e-05 2024-05-08T18:08:23.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696592+0000", 2024-05-08T18:08:23.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5316e-05 2024-05-08T18:08:23.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696731+0000", 2024-05-08T18:08:23.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138818 2024-05-08T18:08:23.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.697085+0000", 2024-05-08T18:08:23.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00035397800000000002 2024-05-08T18:08:23.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:23.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.697838+0000", 2024-05-08T18:08:23.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00075314800000000003 2024-05-08T18:08:23.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:23.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.699440+0000", 2024-05-08T18:08:23.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016023470000000001 2024-05-08T18:08:23.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:23.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700067+0000", 2024-05-08T18:08:23.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062698400000000003 2024-05-08T18:08:23.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700161+0000", 2024-05-08T18:08:23.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3762000000000001e-05 2024-05-08T18:08:23.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700278+0000", 2024-05-08T18:08:23.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117267 2024-05-08T18:08:23.890 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.890 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.890 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.891 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:431 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:23.891 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:23.891 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.087797272000003, 2024-05-08T18:08:23.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040957049999999998, 2024-05-08T18:08:23.891 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.891 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.891 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.891 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:23.891 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:23.891 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:23.891 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 431 2024-05-08T18:08:23.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.891 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:23.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:23.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762027+0000", 2024-05-08T18:08:23.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7889999999999999e-06 2024-05-08T18:08:23.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762036+0000", 2024-05-08T18:08:23.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6029999999999994e-06 2024-05-08T18:08:23.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762061+0000", 2024-05-08T18:08:23.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4831e-05 2024-05-08T18:08:23.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762076+0000", 2024-05-08T18:08:23.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4996e-05 2024-05-08T18:08:23.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.763559+0000", 2024-05-08T18:08:23.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001482501 2024-05-08T18:08:23.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.763747+0000", 2024-05-08T18:08:23.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018864399999999999 2024-05-08T18:08:23.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:23.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.764172+0000", 2024-05-08T18:08:23.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042445900000000002 2024-05-08T18:08:23.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:23.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.765292+0000", 2024-05-08T18:08:23.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001120196 2024-05-08T18:08:23.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:23.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.765812+0000", 2024-05-08T18:08:23.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052044000000000005 2024-05-08T18:08:23.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.766007+0000", 2024-05-08T18:08:23.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019423500000000001 2024-05-08T18:08:23.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.766121+0000", 2024-05-08T18:08:23.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114011 2024-05-08T18:08:23.896 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.896 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.896 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.897 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:23.897 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:23.897 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.081139800999999, 2024-05-08T18:08:23.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031982880000000001, 2024-05-08T18:08:23.897 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.897 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.897 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.897 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:23.897 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:23.897 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:23.897 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 438 2024-05-08T18:08:23.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.897 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:23.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:23.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768684+0000", 2024-05-08T18:08:23.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0049999999999999e-06 2024-05-08T18:08:23.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768697+0000", 2024-05-08T18:08:23.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2211e-05 2024-05-08T18:08:23.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768726+0000", 2024-05-08T18:08:23.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8949e-05 2024-05-08T18:08:23.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768743+0000", 2024-05-08T18:08:23.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7478000000000001e-05 2024-05-08T18:08:23.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768852+0000", 2024-05-08T18:08:23.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010889499999999999 2024-05-08T18:08:23.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.769168+0000", 2024-05-08T18:08:23.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031610900000000002 2024-05-08T18:08:23.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:23.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.769542+0000", 2024-05-08T18:08:23.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037368299999999998 2024-05-08T18:08:23.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:23.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.770721+0000", 2024-05-08T18:08:23.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001179591 2024-05-08T18:08:23.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:23.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771722+0000", 2024-05-08T18:08:23.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001000463 2024-05-08T18:08:23.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771819+0000", 2024-05-08T18:08:23.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6909000000000003e-05 2024-05-08T18:08:23.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771881+0000", 2024-05-08T18:08:23.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1995000000000005e-05 2024-05-08T18:08:23.902 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.902 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.902 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.902 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:477 6.4 e32/26 6:24c8e1ae:gc::gc.19:head v 32'12, mlcod=32'10)", 2024-05-08T18:08:23.902 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:23.902 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.059044772999997, 2024-05-08T18:08:23.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038511489999999999, 2024-05-08T18:08:23.903 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.903 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.903 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.903 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:23.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:23.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790779+0000", 2024-05-08T18:08:23.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4559999999999999e-06 2024-05-08T18:08:23.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790791+0000", 2024-05-08T18:08:23.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1780000000000001e-05 2024-05-08T18:08:23.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790817+0000", 2024-05-08T18:08:23.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5874999999999999e-05 2024-05-08T18:08:23.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790832+0000", 2024-05-08T18:08:23.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4909000000000001e-05 2024-05-08T18:08:23.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790959+0000", 2024-05-08T18:08:23.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012728199999999999 2024-05-08T18:08:23.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791007+0000", 2024-05-08T18:08:23.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7766000000000003e-05 2024-05-08T18:08:23.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794549+0000", 2024-05-08T18:08:23.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035422959999999999 2024-05-08T18:08:23.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794629+0000", 2024-05-08T18:08:23.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9784999999999996e-05 2024-05-08T18:08:23.906 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.906 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.906 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.907 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:487 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:23.907 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:23.907 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.053707525, 2024-05-08T18:08:23.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046865559999999997, 2024-05-08T18:08:23.907 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.907 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.907 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.907 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:23.907 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:23.907 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:23.907 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 487 2024-05-08T18:08:23.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.907 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:23.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:23.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796116+0000", 2024-05-08T18:08:23.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5650000000000001e-06 2024-05-08T18:08:23.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796124+0000", 2024-05-08T18:08:23.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6909999999999997e-06 2024-05-08T18:08:23.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796143+0000", 2024-05-08T18:08:23.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9483999999999998e-05 2024-05-08T18:08:23.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796154+0000", 2024-05-08T18:08:23.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0416e-05 2024-05-08T18:08:23.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796266+0000", 2024-05-08T18:08:23.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112011 2024-05-08T18:08:23.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796432+0000", 2024-05-08T18:08:23.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016641799999999999 2024-05-08T18:08:23.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:23.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796718+0000", 2024-05-08T18:08:23.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028548000000000001 2024-05-08T18:08:23.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:23.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798117+0000", 2024-05-08T18:08:23.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001399151 2024-05-08T18:08:23.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:23.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800656+0000", 2024-05-08T18:08:23.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025392689999999998 2024-05-08T18:08:23.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800733+0000", 2024-05-08T18:08:23.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6508000000000007e-05 2024-05-08T18:08:23.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800801+0000", 2024-05-08T18:08:23.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8563000000000001e-05 2024-05-08T18:08:23.912 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.912 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.912 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.912 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:489 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:23.912 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:23.912 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.051761026999998, 2024-05-08T18:08:23.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058220679999999997, 2024-05-08T18:08:23.912 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.913 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.913 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.913 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:23.913 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:23.913 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:23.913 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 489 2024-05-08T18:08:23.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.913 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:23.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:23.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798064+0000", 2024-05-08T18:08:23.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:08:23.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798074+0000", 2024-05-08T18:08:23.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0438999999999999e-05 2024-05-08T18:08:23.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798097+0000", 2024-05-08T18:08:23.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3019000000000001e-05 2024-05-08T18:08:23.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798115+0000", 2024-05-08T18:08:23.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7638e-05 2024-05-08T18:08:23.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798230+0000", 2024-05-08T18:08:23.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115375 2024-05-08T18:08:23.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798395+0000", 2024-05-08T18:08:23.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016542099999999999 2024-05-08T18:08:23.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:23.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798633+0000", 2024-05-08T18:08:23.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000237977 2024-05-08T18:08:23.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:23.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.799628+0000", 2024-05-08T18:08:23.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00099459099999999996 2024-05-08T18:08:23.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:23.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803706+0000", 2024-05-08T18:08:23.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040776199999999997 2024-05-08T18:08:23.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803796+0000", 2024-05-08T18:08:23.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0704000000000004e-05 2024-05-08T18:08:23.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803883+0000", 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6923999999999996e-05 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:491 6.10 e32/26 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.048537568, 2024-05-08T18:08:23.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052480360000000002, 2024-05-08T18:08:23.919 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.919 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.919 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.919 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:23.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:23.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801286+0000", 2024-05-08T18:08:23.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.085e-06 2024-05-08T18:08:23.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801293+0000", 2024-05-08T18:08:23.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.627e-06 2024-05-08T18:08:23.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801311+0000", 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801320+0000", 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5710000000000004e-06 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801401+0000", 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0798999999999997e-05 2024-05-08T18:08:23.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801439+0000", 2024-05-08T18:08:23.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7994000000000002e-05 2024-05-08T18:08:23.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806447+0000", 2024-05-08T18:08:23.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050077339999999998 2024-05-08T18:08:23.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806533+0000", 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.577e-05 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:495 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.045000676999997, 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045481219999999999, 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804823+0000", 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.42e-06 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804834+0000", 2024-05-08T18:08:23.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0584999999999999e-05 2024-05-08T18:08:23.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804848+0000", 2024-05-08T18:08:23.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:08:23.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804857+0000", 2024-05-08T18:08:23.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.302e-06 2024-05-08T18:08:23.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804967+0000", 2024-05-08T18:08:23.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109543 2024-05-08T18:08:23.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805018+0000", 2024-05-08T18:08:23.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0924000000000002e-05 2024-05-08T18:08:23.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809281+0000", 2024-05-08T18:08:23.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042631479999999996 2024-05-08T18:08:23.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809370+0000", 2024-05-08T18:08:23.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8787000000000002e-05 2024-05-08T18:08:23.927 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.927 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.927 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.927 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:500 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:23.927 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:23.927 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.043442263000003, 2024-05-08T18:08:23.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061595829999999997, 2024-05-08T18:08:23.928 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.928 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.928 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.928 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:23.928 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:23.928 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:23.928 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 500 2024-05-08T18:08:23.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.928 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:23.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:23.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806382+0000", 2024-05-08T18:08:23.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2709999999999999e-06 2024-05-08T18:08:23.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806395+0000", 2024-05-08T18:08:23.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2782000000000001e-05 2024-05-08T18:08:23.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806419+0000", 2024-05-08T18:08:23.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3841000000000001e-05 2024-05-08T18:08:23.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806437+0000", 2024-05-08T18:08:23.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8318999999999999e-05 2024-05-08T18:08:23.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806554+0000", 2024-05-08T18:08:23.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116507 2024-05-08T18:08:23.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806732+0000", 2024-05-08T18:08:23.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017828200000000001 2024-05-08T18:08:23.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:23.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806986+0000", 2024-05-08T18:08:23.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431100000000001 2024-05-08T18:08:23.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:23.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.808032+0000", 2024-05-08T18:08:23.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010455530000000001 2024-05-08T18:08:23.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:23.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812373+0000", 2024-05-08T18:08:23.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043410139999999998 2024-05-08T18:08:23.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812485+0000", 2024-05-08T18:08:23.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011234999999999999 2024-05-08T18:08:23.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812540+0000", 2024-05-08T18:08:23.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4353e-05 2024-05-08T18:08:23.932 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.933 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.933 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.933 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:502 6.10 e32/26 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:23.933 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:23.933 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.042268659999998, 2024-05-08T18:08:23.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049263659999999997, 2024-05-08T18:08:23.933 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.933 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.933 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.933 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:23.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:23.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807555+0000", 2024-05-08T18:08:23.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2079999999999999e-06 2024-05-08T18:08:23.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807563+0000", 2024-05-08T18:08:23.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3280000000000006e-06 2024-05-08T18:08:23.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807585+0000", 2024-05-08T18:08:23.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2361000000000002e-05 2024-05-08T18:08:23.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807596+0000", 2024-05-08T18:08:23.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0968000000000001e-05 2024-05-08T18:08:23.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807700+0000", 2024-05-08T18:08:23.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103232 2024-05-08T18:08:23.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807732+0000", 2024-05-08T18:08:23.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2373999999999999e-05 2024-05-08T18:08:23.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812391+0000", 2024-05-08T18:08:23.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046590140000000004 2024-05-08T18:08:23.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812480+0000", 2024-05-08T18:08:23.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8881000000000005e-05 2024-05-08T18:08:23.937 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.937 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.937 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.937 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:504 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'3, mlcod=32'1)", 2024-05-08T18:08:23.937 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:23.937 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.038595854999997, 2024-05-08T18:08:23.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389472, 2024-05-08T18:08:23.937 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.937 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.937 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.937 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:23.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:23.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811228+0000", 2024-05-08T18:08:23.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8819999999999999e-06 2024-05-08T18:08:23.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811240+0000", 2024-05-08T18:08:23.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1276e-05 2024-05-08T18:08:23.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811266+0000", 2024-05-08T18:08:23.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.601e-05 2024-05-08T18:08:23.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811283+0000", 2024-05-08T18:08:23.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7473e-05 2024-05-08T18:08:23.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811444+0000", 2024-05-08T18:08:23.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000161249 2024-05-08T18:08:23.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811501+0000", 2024-05-08T18:08:23.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6394999999999998e-05 2024-05-08T18:08:23.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815025+0000", 2024-05-08T18:08:23.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003524335 2024-05-08T18:08:23.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815121+0000", 2024-05-08T18:08:23.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6100000000000005e-05 2024-05-08T18:08:23.941 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.941 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.941 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.941 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:505 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:23.941 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:23.941 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.036966560000003, 2024-05-08T18:08:23.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007675075, 2024-05-08T18:08:23.941 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.941 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.941 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.941 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:23.941 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:23.942 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:23.942 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 505 2024-05-08T18:08:23.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.942 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:23.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:23.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812857+0000", 2024-05-08T18:08:23.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.621e-06 2024-05-08T18:08:23.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812865+0000", 2024-05-08T18:08:23.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0600000000000008e-06 2024-05-08T18:08:23.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812889+0000", 2024-05-08T18:08:23.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3569000000000001e-05 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812901+0000", 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1610000000000001e-05 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813025+0000", 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012430399999999999 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813168+0000", 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014329699999999999 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:23.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813419+0000", 2024-05-08T18:08:23.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000250788 2024-05-08T18:08:23.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:23.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815462+0000", 2024-05-08T18:08:23.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002042865 2024-05-08T18:08:23.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:23.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820385+0000", 2024-05-08T18:08:23.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049229529999999999 2024-05-08T18:08:23.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820462+0000", 2024-05-08T18:08:23.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7101000000000006e-05 2024-05-08T18:08:23.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820531+0000", 2024-05-08T18:08:23.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8906999999999996e-05 2024-05-08T18:08:23.946 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.946 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.946 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.946 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:506 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:23.947 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:23.947 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.035743717000003, 2024-05-08T18:08:23.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006383143, 2024-05-08T18:08:23.947 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.947 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.947 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.947 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:23.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:23.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814081+0000", 2024-05-08T18:08:23.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0080000000000001e-06 2024-05-08T18:08:23.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814094+0000", 2024-05-08T18:08:23.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3407999999999999e-05 2024-05-08T18:08:23.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814125+0000", 2024-05-08T18:08:23.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0688999999999997e-05 2024-05-08T18:08:23.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814142+0000", 2024-05-08T18:08:23.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7192000000000001e-05 2024-05-08T18:08:23.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814245+0000", 2024-05-08T18:08:23.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103164 2024-05-08T18:08:23.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814302+0000", 2024-05-08T18:08:23.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6613999999999997e-05 2024-05-08T18:08:23.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820398+0000", 2024-05-08T18:08:23.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060967620000000004 2024-05-08T18:08:23.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820462+0000", 2024-05-08T18:08:23.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3305999999999993e-05 2024-05-08T18:08:23.950 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.950 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.951 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.951 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:750 6.19 6:9fecf831:::obj_delete_at_hint.0000000057:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:23.951 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:23.951 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.760505346000002, 2024-05-08T18:08:23.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035713440000000002, 2024-05-08T18:08:23.951 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:23.951 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:23.951 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:23.951 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:23.951 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:23.951 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:23.951 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 750 2024-05-08T18:08:23.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.951 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:23.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:23.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:23.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:23.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:23.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:23.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:23.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089318+0000", 2024-05-08T18:08:23.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.446e-06 2024-05-08T18:08:23.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:23.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089325+0000", 2024-05-08T18:08:23.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8560000000000001e-06 2024-05-08T18:08:23.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:23.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089345+0000", 2024-05-08T18:08:23.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9641999999999999e-05 2024-05-08T18:08:23.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:23.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089355+0000", 2024-05-08T18:08:23.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0586e-05 2024-05-08T18:08:23.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:23.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089469+0000", 2024-05-08T18:08:23.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113324 2024-05-08T18:08:23.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:23.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089692+0000", 2024-05-08T18:08:23.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022334500000000001 2024-05-08T18:08:23.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:23.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.090160+0000", 2024-05-08T18:08:23.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00046827799999999998 2024-05-08T18:08:23.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:23.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.091322+0000", 2024-05-08T18:08:23.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001161282 2024-05-08T18:08:23.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:23.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092750+0000", 2024-05-08T18:08:23.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014281299999999999 2024-05-08T18:08:23.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:23.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092829+0000", 2024-05-08T18:08:23.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9376999999999996e-05 2024-05-08T18:08:23.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:23.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:23.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:23.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092888+0000", 2024-05-08T18:08:23.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9077999999999999e-05 2024-05-08T18:08:23.956 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.956 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.956 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.956 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:23.956 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:23.956 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:23.958 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:08:23.958 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:23.958+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:24.058 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:24.058+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:24.126 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:24.126 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:24.126 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:24.126 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:24.140 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:08:24.184 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:24.186+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:24.261 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:24.261+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:24.307 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:24.307 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:24.308 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:24.308 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:24.308 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:24.321 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:08:24.368 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:24.370+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:24.448 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:24.448 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:24.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:24.448 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:24.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.448 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:24.448 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:08:24.448 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.911362658999998, 2024-05-08T18:08:24.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.032012946, 2024-05-08T18:08:24.448 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.448 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.448 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.449 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:24.449 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:24.449 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:24.449 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:08:24.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.449 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:08:24.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:08:24.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535484+0000", 2024-05-08T18:08:24.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7929999999999999e-06 2024-05-08T18:08:24.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535500+0000", 2024-05-08T18:08:24.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5226e-05 2024-05-08T18:08:24.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535535+0000", 2024-05-08T18:08:24.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5213000000000003e-05 2024-05-08T18:08:24.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535564+0000", 2024-05-08T18:08:24.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9360999999999999e-05 2024-05-08T18:08:24.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535757+0000", 2024-05-08T18:08:24.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000193229 2024-05-08T18:08:24.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:08:24.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535775+0000", 2024-05-08T18:08:24.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7098000000000001e-05 2024-05-08T18:08:24.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556004+0000", 2024-05-08T18:08:24.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020229068999999999 2024-05-08T18:08:24.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:24.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556036+0000", 2024-05-08T18:08:24.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1943000000000002e-05 2024-05-08T18:08:24.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.564721+0000", 2024-05-08T18:08:24.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086853320000000005 2024-05-08T18:08:24.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565032+0000", 2024-05-08T18:08:24.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031121799999999999 2024-05-08T18:08:24.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:24.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565365+0000", 2024-05-08T18:08:24.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000332744 2024-05-08T18:08:24.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:24.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567305+0000", 2024-05-08T18:08:24.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00194016 2024-05-08T18:08:24.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:24.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567368+0000", 2024-05-08T18:08:24.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3342000000000004e-05 2024-05-08T18:08:24.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567433+0000", 2024-05-08T18:08:24.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4726000000000003e-05 2024-05-08T18:08:24.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567494+0000", 2024-05-08T18:08:24.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0492000000000003e-05 2024-05-08T18:08:24.455 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.455 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.455 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.455 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206896342016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:24.455 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:08:24.455 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.878945567000002, 2024-05-08T18:08:24.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026490820000000001, 2024-05-08T18:08:24.455 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.456 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.456 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.456 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:24.456 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:24.456 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:24.456 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 47 2024-05-08T18:08:24.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.456 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:08:24.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:08:24.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567900+0000", 2024-05-08T18:08:24.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.03e-06 2024-05-08T18:08:24.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567909+0000", 2024-05-08T18:08:24.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0389999999999993e-06 2024-05-08T18:08:24.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567947+0000", 2024-05-08T18:08:24.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8013999999999999e-05 2024-05-08T18:08:24.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567961+0000", 2024-05-08T18:08:24.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3777999999999999e-05 2024-05-08T18:08:24.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568066+0000", 2024-05-08T18:08:24.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105208 2024-05-08T18:08:24.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568176+0000", 2024-05-08T18:08:24.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011041599999999999 2024-05-08T18:08:24.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:24.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568443+0000", 2024-05-08T18:08:24.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000266846 2024-05-08T18:08:24.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:24.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.569612+0000", 2024-05-08T18:08:24.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001169156 2024-05-08T18:08:24.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:24.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570378+0000", 2024-05-08T18:08:24.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00076617799999999995 2024-05-08T18:08:24.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570457+0000", 2024-05-08T18:08:24.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8750000000000003e-05 2024-05-08T18:08:24.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570547+0000", 2024-05-08T18:08:24.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9666999999999994e-05 2024-05-08T18:08:24.460 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.461 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.461 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.461 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:24.461 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:08:24.461 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.867898295000003, 2024-05-08T18:08:24.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051182119999999996, 2024-05-08T18:08:24.461 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.461 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.461 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.461 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:24.461 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:24.461 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:24.461 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 54 2024-05-08T18:08:24.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.462 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:08:24.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:08:24.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578947+0000", 2024-05-08T18:08:24.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:24.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578957+0000", 2024-05-08T18:08:24.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6020000000000006e-06 2024-05-08T18:08:24.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578997+0000", 2024-05-08T18:08:24.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0663e-05 2024-05-08T18:08:24.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579016+0000", 2024-05-08T18:08:24.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8185e-05 2024-05-08T18:08:24.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579117+0000", 2024-05-08T18:08:24.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010117599999999999 2024-05-08T18:08:24.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579252+0000", 2024-05-08T18:08:24.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013552 2024-05-08T18:08:24.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:24.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579393+0000", 2024-05-08T18:08:24.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140605 2024-05-08T18:08:24.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:24.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.580414+0000", 2024-05-08T18:08:24.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010214219999999999 2024-05-08T18:08:24.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:24.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.583866+0000", 2024-05-08T18:08:24.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034512840000000002 2024-05-08T18:08:24.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.583946+0000", 2024-05-08T18:08:24.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0406000000000002e-05 2024-05-08T18:08:24.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584063+0000", 2024-05-08T18:08:24.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117199 2024-05-08T18:08:24.466 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.466 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.466 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.466 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206896337408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:24.466 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:08:24.466 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.862611567999998, 2024-05-08T18:08:24.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027716910000000002, 2024-05-08T18:08:24.467 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.467 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.467 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.467 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:24.467 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:24.467 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:24.467 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 55 2024-05-08T18:08:24.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.467 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:08:24.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:08:24.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584234+0000", 2024-05-08T18:08:24.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9259999999999999e-06 2024-05-08T18:08:24.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584244+0000", 2024-05-08T18:08:24.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0369e-05 2024-05-08T18:08:24.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584270+0000", 2024-05-08T18:08:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5554999999999998e-05 2024-05-08T18:08:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584283+0000", 2024-05-08T18:08:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3039e-05 2024-05-08T18:08:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584384+0000", 2024-05-08T18:08:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000100881 2024-05-08T18:08:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584510+0000", 2024-05-08T18:08:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012627100000000001 2024-05-08T18:08:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584741+0000", 2024-05-08T18:08:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023162899999999999 2024-05-08T18:08:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.585714+0000", 2024-05-08T18:08:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00097270500000000003 2024-05-08T18:08:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.586818+0000", 2024-05-08T18:08:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00110403 2024-05-08T18:08:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.586908+0000", 2024-05-08T18:08:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9641000000000005e-05 2024-05-08T18:08:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.587003+0000", 2024-05-08T18:08:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5644999999999997e-05 2024-05-08T18:08:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.472 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.472 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:191 6.5 e29/26 6:a2ace8b3:::data_log.0:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:24.472 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:08:24.472 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.762783999, 2024-05-08T18:08:24.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001855095, 2024-05-08T18:08:24.472 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.472 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.472 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.472 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:08:24.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:08:24.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684061+0000", 2024-05-08T18:08:24.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:08:24.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684074+0000", 2024-05-08T18:08:24.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2479e-05 2024-05-08T18:08:24.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684104+0000", 2024-05-08T18:08:24.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0689999999999999e-05 2024-05-08T18:08:24.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684120+0000", 2024-05-08T18:08:24.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5996000000000001e-05 2024-05-08T18:08:24.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684221+0000", 2024-05-08T18:08:24.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000100647 2024-05-08T18:08:24.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684273+0000", 2024-05-08T18:08:24.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2074999999999999e-05 2024-05-08T18:08:24.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.685828+0000", 2024-05-08T18:08:24.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015553030000000001 2024-05-08T18:08:24.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.685914+0000", 2024-05-08T18:08:24.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5927999999999995e-05 2024-05-08T18:08:24.476 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.476 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.476 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.476 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:24.476 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:24.476 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.847745736, 2024-05-08T18:08:24.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003347367, 2024-05-08T18:08:24.476 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.476 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.476 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.476 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:24.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:24.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:24.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5300000000000003e-07 2024-05-08T18:08:24.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599110+0000", 2024-05-08T18:08:24.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1826e-05 2024-05-08T18:08:24.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599159+0000", 2024-05-08T18:08:24.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8322000000000003e-05 2024-05-08T18:08:24.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599180+0000", 2024-05-08T18:08:24.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1682e-05 2024-05-08T18:08:24.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599427+0000", 2024-05-08T18:08:24.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024721299999999998 2024-05-08T18:08:24.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599475+0000", 2024-05-08T18:08:24.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7299000000000002e-05 2024-05-08T18:08:24.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.602326+0000", 2024-05-08T18:08:24.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028516409999999998 2024-05-08T18:08:24.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.602445+0000", 2024-05-08T18:08:24.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011853099999999999 2024-05-08T18:08:24.480 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.480 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.480 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.480 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:231 6.1f e32/26 6:fde4dd55:gc::gc.26:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:24.480 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:24.480 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.760092638000003, 2024-05-08T18:08:24.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017909390000000001, 2024-05-08T18:08:24.481 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.481 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.481 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.481 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:24.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:24.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:24.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5000000000000002e-07 2024-05-08T18:08:24.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686785+0000", 2024-05-08T18:08:24.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3438000000000001e-05 2024-05-08T18:08:24.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686810+0000", 2024-05-08T18:08:24.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4858000000000002e-05 2024-05-08T18:08:24.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686823+0000", 2024-05-08T18:08:24.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3417999999999999e-05 2024-05-08T18:08:24.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686989+0000", 2024-05-08T18:08:24.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016624700000000001 2024-05-08T18:08:24.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.687023+0000", 2024-05-08T18:08:24.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3396999999999999e-05 2024-05-08T18:08:24.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.688453+0000", 2024-05-08T18:08:24.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001430675 2024-05-08T18:08:24.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.688542+0000", 2024-05-08T18:08:24.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8256000000000003e-05 2024-05-08T18:08:24.484 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.484 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.484 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.485 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.485 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:292 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:24.485 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:08:24.485 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.726705918999997, 2024-05-08T18:08:24.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020064839999999998, 2024-05-08T18:08:24.485 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.485 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.485 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.485 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.485 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.485 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:08:24.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.485 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:08:24.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720170+0000", 2024-05-08T18:08:24.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3090999999999999e-05 2024-05-08T18:08:24.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720189+0000", 2024-05-08T18:08:24.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8077999999999999e-05 2024-05-08T18:08:24.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720222+0000", 2024-05-08T18:08:24.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3111000000000002e-05 2024-05-08T18:08:24.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720241+0000", 2024-05-08T18:08:24.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9528e-05 2024-05-08T18:08:24.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720452+0000", 2024-05-08T18:08:24.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021077300000000001 2024-05-08T18:08:24.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720505+0000", 2024-05-08T18:08:24.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2605000000000002e-05 2024-05-08T18:08:24.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.722038+0000", 2024-05-08T18:08:24.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015334630000000001 2024-05-08T18:08:24.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.722144+0000", 2024-05-08T18:08:24.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010583500000000001 2024-05-08T18:08:24.489 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.489 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.489 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.489 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:328 6.1 e32/26 6:856b9b26:reshard::reshard.0000000002:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:24.489 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:24.489 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.721277628000003, 2024-05-08T18:08:24.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0018910070000000001, 2024-05-08T18:08:24.489 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.489 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.489 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.489 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:24.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.490 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:24.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.490 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:24.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3e-07 2024-05-08T18:08:24.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725576+0000", 2024-05-08T18:08:24.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5759999999999995e-06 2024-05-08T18:08:24.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725622+0000", 2024-05-08T18:08:24.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6196000000000003e-05 2024-05-08T18:08:24.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725642+0000", 2024-05-08T18:08:24.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9947999999999999e-05 2024-05-08T18:08:24.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.726011+0000", 2024-05-08T18:08:24.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036876699999999999 2024-05-08T18:08:24.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.726062+0000", 2024-05-08T18:08:24.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1062e-05 2024-05-08T18:08:24.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.727367+0000", 2024-05-08T18:08:24.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001304869 2024-05-08T18:08:24.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.727457+0000", 2024-05-08T18:08:24.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9858999999999995e-05 2024-05-08T18:08:24.493 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.493 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.493 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.493 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:382 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'6, mlcod=32'4)", 2024-05-08T18:08:24.493 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:08:24.493 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.708313023999999, 2024-05-08T18:08:24.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023570779999999999, 2024-05-08T18:08:24.494 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.494 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.494 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.494 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.494 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:08:24.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.494 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.494 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:08:24.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738532+0000", 2024-05-08T18:08:24.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.95e-06 2024-05-08T18:08:24.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738548+0000", 2024-05-08T18:08:24.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5911000000000001e-05 2024-05-08T18:08:24.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738583+0000", 2024-05-08T18:08:24.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4830999999999999e-05 2024-05-08T18:08:24.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738605+0000", 2024-05-08T18:08:24.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2005e-05 2024-05-08T18:08:24.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738747+0000", 2024-05-08T18:08:24.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014162800000000001 2024-05-08T18:08:24.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738800+0000", 2024-05-08T18:08:24.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2918999999999999e-05 2024-05-08T18:08:24.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.740802+0000", 2024-05-08T18:08:24.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020026150000000001 2024-05-08T18:08:24.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.740887+0000", 2024-05-08T18:08:24.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5218999999999998e-05 2024-05-08T18:08:24.497 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.497 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.497 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.497 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:394 6.c e32/26 6:3677c228:::obj_delete_at_hint.0000000006:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:24.498 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:08:24.498 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.703647813000003, 2024-05-08T18:08:24.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026335320000000001, 2024-05-08T18:08:24.498 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.498 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.498 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.498 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:08:24.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:08:24.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743197+0000", 2024-05-08T18:08:24.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.81e-06 2024-05-08T18:08:24.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743210+0000", 2024-05-08T18:08:24.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2354999999999999e-05 2024-05-08T18:08:24.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743237+0000", 2024-05-08T18:08:24.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7328e-05 2024-05-08T18:08:24.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743256+0000", 2024-05-08T18:08:24.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8712e-05 2024-05-08T18:08:24.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743394+0000", 2024-05-08T18:08:24.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138009 2024-05-08T18:08:24.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743449+0000", 2024-05-08T18:08:24.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5371000000000002e-05 2024-05-08T18:08:24.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745754+0000", 2024-05-08T18:08:24.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002304567 2024-05-08T18:08:24.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745829+0000", 2024-05-08T18:08:24.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.538e-05 2024-05-08T18:08:24.501 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.501 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.501 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.502 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:392 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'7, mlcod=32'5)", 2024-05-08T18:08:24.502 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:08:24.502 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.703195293999997, 2024-05-08T18:08:24.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022345389999999998, 2024-05-08T18:08:24.502 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.502 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.502 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.502 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:08:24.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:08:24.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743650+0000", 2024-05-08T18:08:24.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1260000000000001e-06 2024-05-08T18:08:24.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743666+0000", 2024-05-08T18:08:24.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5696e-05 2024-05-08T18:08:24.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743696+0000", 2024-05-08T18:08:24.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0037999999999999e-05 2024-05-08T18:08:24.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743716+0000", 2024-05-08T18:08:24.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0251e-05 2024-05-08T18:08:24.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743838+0000", 2024-05-08T18:08:24.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012187 2024-05-08T18:08:24.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743886+0000", 2024-05-08T18:08:24.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8053000000000002e-05 2024-05-08T18:08:24.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745805+0000", 2024-05-08T18:08:24.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019189509999999999 2024-05-08T18:08:24.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745883+0000", 2024-05-08T18:08:24.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7553999999999996e-05 2024-05-08T18:08:24.505 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.505 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.505 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.506 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:453 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:24.506 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:08:24.506 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.669030114000002, 2024-05-08T18:08:24.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017625729999999999, 2024-05-08T18:08:24.506 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.506 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.506 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.506 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:08:24.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:08:24.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777815+0000", 2024-05-08T18:08:24.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6130000000000001e-06 2024-05-08T18:08:24.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777826+0000", 2024-05-08T18:08:24.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:08:24.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777852+0000", 2024-05-08T18:08:24.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6787999999999998e-05 2024-05-08T18:08:24.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777865+0000", 2024-05-08T18:08:24.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2882e-05 2024-05-08T18:08:24.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777961+0000", 2024-05-08T18:08:24.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5280999999999998e-05 2024-05-08T18:08:24.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777993+0000", 2024-05-08T18:08:24.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1931999999999999e-05 2024-05-08T18:08:24.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779496+0000", 2024-05-08T18:08:24.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001503307 2024-05-08T18:08:24.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779576+0000", 2024-05-08T18:08:24.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9887000000000003e-05 2024-05-08T18:08:24.510 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.510 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.510 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.510 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:460 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'3, mlcod=32'1)", 2024-05-08T18:08:24.510 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:08:24.510 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.667694744000002, 2024-05-08T18:08:24.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032252579999999999, 2024-05-08T18:08:24.510 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.510 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.510 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.510 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:08:24.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:08:24.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779150+0000", 2024-05-08T18:08:24.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:24.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779161+0000", 2024-05-08T18:08:24.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0906e-05 2024-05-08T18:08:24.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779186+0000", 2024-05-08T18:08:24.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4861000000000001e-05 2024-05-08T18:08:24.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779198+0000", 2024-05-08T18:08:24.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1969e-05 2024-05-08T18:08:24.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779334+0000", 2024-05-08T18:08:24.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000135513 2024-05-08T18:08:24.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779396+0000", 2024-05-08T18:08:24.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2815000000000001e-05 2024-05-08T18:08:24.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.782247+0000", 2024-05-08T18:08:24.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028502200000000001 2024-05-08T18:08:24.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.782374+0000", 2024-05-08T18:08:24.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012726400000000001 2024-05-08T18:08:24.514 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.514 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.514 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.514 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:463 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-05-08T18:08:24.514 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:08:24.515 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.665348639000001, 2024-05-08T18:08:24.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0036423610000000002, 2024-05-08T18:08:24.515 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.515 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.515 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.515 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:08:24.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:08:24.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781497+0000", 2024-05-08T18:08:24.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.917e-06 2024-05-08T18:08:24.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781509+0000", 2024-05-08T18:08:24.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2227e-05 2024-05-08T18:08:24.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781539+0000", 2024-05-08T18:08:24.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0218000000000001e-05 2024-05-08T18:08:24.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781558+0000", 2024-05-08T18:08:24.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8918000000000001e-05 2024-05-08T18:08:24.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781660+0000", 2024-05-08T18:08:24.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101584 2024-05-08T18:08:24.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781697+0000", 2024-05-08T18:08:24.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7360000000000001e-05 2024-05-08T18:08:24.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785059+0000", 2024-05-08T18:08:24.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033618810000000002 2024-05-08T18:08:24.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785137+0000", 2024-05-08T18:08:24.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8256000000000004e-05 2024-05-08T18:08:24.518 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.518 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.518 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.519 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:466 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:24.519 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:08:24.519 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.663228386999997, 2024-05-08T18:08:24.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002137496, 2024-05-08T18:08:24.519 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.519 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.519 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.519 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:08:24.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:08:24.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783617+0000", 2024-05-08T18:08:24.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8330000000000001e-06 2024-05-08T18:08:24.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:08:24.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5872e-05 2024-05-08T18:08:24.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783668+0000", 2024-05-08T18:08:24.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5880999999999997e-05 2024-05-08T18:08:24.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783688+0000", 2024-05-08T18:08:24.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9485000000000001e-05 2024-05-08T18:08:24.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783819+0000", 2024-05-08T18:08:24.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013098600000000001 2024-05-08T18:08:24.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783865+0000", 2024-05-08T18:08:24.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5711000000000003e-05 2024-05-08T18:08:24.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785680+0000", 2024-05-08T18:08:24.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001815374 2024-05-08T18:08:24.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785752+0000", 2024-05-08T18:08:24.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2354000000000006e-05 2024-05-08T18:08:24.523 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.523 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.523 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.523 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:469 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'10, mlcod=32'8)", 2024-05-08T18:08:24.523 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:08:24.523 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.659937397999997, 2024-05-08T18:08:24.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002120242, 2024-05-08T18:08:24.523 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.523 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.523 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.524 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:08:24.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:08:24.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786907+0000", 2024-05-08T18:08:24.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.412e-06 2024-05-08T18:08:24.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786917+0000", 2024-05-08T18:08:24.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3489999999999998e-06 2024-05-08T18:08:24.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786940+0000", 2024-05-08T18:08:24.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3019000000000001e-05 2024-05-08T18:08:24.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786951+0000", 2024-05-08T18:08:24.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0956e-05 2024-05-08T18:08:24.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.787229+0000", 2024-05-08T18:08:24.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027875000000000003 2024-05-08T18:08:24.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.787263+0000", 2024-05-08T18:08:24.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3563999999999999e-05 2024-05-08T18:08:24.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.788886+0000", 2024-05-08T18:08:24.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016228320000000001 2024-05-08T18:08:24.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.789026+0000", 2024-05-08T18:08:24.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014035999999999999 2024-05-08T18:08:24.527 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.527 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.527 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.527 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:478 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'11, mlcod=32'9)", 2024-05-08T18:08:24.527 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:08:24.527 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.655825784999998, 2024-05-08T18:08:24.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037403340000000001, 2024-05-08T18:08:24.527 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.528 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.528 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.528 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:08:24.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:08:24.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791019+0000", 2024-05-08T18:08:24.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5999999999999999e-06 2024-05-08T18:08:24.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791032+0000", 2024-05-08T18:08:24.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3021e-05 2024-05-08T18:08:24.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791057+0000", 2024-05-08T18:08:24.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4600000000000002e-05 2024-05-08T18:08:24.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791071+0000", 2024-05-08T18:08:24.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4756000000000001e-05 2024-05-08T18:08:24.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791185+0000", 2024-05-08T18:08:24.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011333200000000001 2024-05-08T18:08:24.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791234+0000", 2024-05-08T18:08:24.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8695e-05 2024-05-08T18:08:24.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794662+0000", 2024-05-08T18:08:24.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034282520000000001 2024-05-08T18:08:24.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794758+0000", 2024-05-08T18:08:24.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6077999999999997e-05 2024-05-08T18:08:24.531 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.531 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.531 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.531 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:829 6.5 e32/26 6:a77c5545:::obj_delete_at_hint.0000000084:head v 32'12, mlcod=32'10)", 2024-05-08T18:08:24.532 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:08:24.532 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.174656771000002, 2024-05-08T18:08:24.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017254, 2024-05-08T18:08:24.532 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.532 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.532 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.532 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:08:24.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:08:24.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272188+0000", 2024-05-08T18:08:24.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7269999999999999e-06 2024-05-08T18:08:24.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272229+0000", 2024-05-08T18:08:24.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0256999999999998e-05 2024-05-08T18:08:24.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272261+0000", 2024-05-08T18:08:24.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2017000000000002e-05 2024-05-08T18:08:24.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272275+0000", 2024-05-08T18:08:24.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4532000000000001e-05 2024-05-08T18:08:24.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272437+0000", 2024-05-08T18:08:24.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016199699999999999 2024-05-08T18:08:24.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272501+0000", 2024-05-08T18:08:24.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3805000000000003e-05 2024-05-08T18:08:24.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.273824+0000", 2024-05-08T18:08:24.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001323039 2024-05-08T18:08:24.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.273912+0000", 2024-05-08T18:08:24.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8026000000000001e-05 2024-05-08T18:08:24.535 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.535 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.536 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.536 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:937 6.1f e32/26 6:fd6b5df8:::obj_delete_at_hint.0000000120:head v 32'10, mlcod=32'8)", 2024-05-08T18:08:24.536 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:08:24.536 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.923420655999998, 2024-05-08T18:08:24.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019919009999999999, 2024-05-08T18:08:24.536 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:24.536 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:24.536 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:24.536 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:24.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:24.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:08:24.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:24.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:08:24.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:24.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:24.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523425+0000", 2024-05-08T18:08:24.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8560000000000001e-06 2024-05-08T18:08:24.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:24.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523437+0000", 2024-05-08T18:08:24.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2833000000000001e-05 2024-05-08T18:08:24.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:24.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523464+0000", 2024-05-08T18:08:24.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6621000000000001e-05 2024-05-08T18:08:24.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:24.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523477+0000", 2024-05-08T18:08:24.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2758999999999999e-05 2024-05-08T18:08:24.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:24.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523612+0000", 2024-05-08T18:08:24.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013525899999999999 2024-05-08T18:08:24.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:24.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523679+0000", 2024-05-08T18:08:24.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6964000000000005e-05 2024-05-08T18:08:24.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:24.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.525312+0000", 2024-05-08T18:08:24.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016331 2024-05-08T18:08:24.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:24.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:24.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:24.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.525415+0000", 2024-05-08T18:08:24.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000102509 2024-05-08T18:08:24.540 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.540 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.540 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.540 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:24.540 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:24.540 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:24.541 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:08:24.542 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:24.541+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:24.642 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:24.641+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:24.712 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:24.712 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:24.712 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:24.712 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:24.726 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:08:24.772 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:24.774+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:24.843 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:24.845+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:24.848 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:24.848 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:24.848 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:24.848 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:24.849 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:24.863 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:08:24.944 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:24.945+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:25.030 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:25.030 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:25.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:25.030 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:25.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.031 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.031 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:08:25.031 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.214305163999995, 2024-05-08T18:08:25.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.16213206199999999, 2024-05-08T18:08:25.031 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.031 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.031 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.031 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.031 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.031 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.031 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1 2024-05-08T18:08:25.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.031 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:08:25.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:08:25.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814494+0000", 2024-05-08T18:08:25.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:08:25.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814520+0000", 2024-05-08T18:08:25.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-05 2024-05-08T18:08:25.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814543+0000", 2024-05-08T18:08:25.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2353000000000001e-05 2024-05-08T18:08:25.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814563+0000", 2024-05-08T18:08:25.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.048e-05 2024-05-08T18:08:25.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814677+0000", 2024-05-08T18:08:25.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113632 2024-05-08T18:08:25.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:25.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814705+0000", 2024-05-08T18:08:25.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8626999999999999e-05 2024-05-08T18:08:25.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971115+0000", 2024-05-08T18:08:25.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.156409825 2024-05-08T18:08:25.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971438+0000", 2024-05-08T18:08:25.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00032289200000000002 2024-05-08T18:08:25.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971849+0000", 2024-05-08T18:08:25.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041139300000000002 2024-05-08T18:08:25.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.975364+0000", 2024-05-08T18:08:25.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035148390000000001 2024-05-08T18:08:25.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976474+0000", 2024-05-08T18:08:25.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001110099 2024-05-08T18:08:25.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976564+0000", 2024-05-08T18:08:25.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9522000000000001e-05 2024-05-08T18:08:25.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976624+0000", 2024-05-08T18:08:25.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9616e-05 2024-05-08T18:08:25.036 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.036 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.036 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.036 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.037 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:08:25.037 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.016355718, 2024-05-08T18:08:25.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010762776999999999, 2024-05-08T18:08:25.037 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.037 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.037 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.037 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.037 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.037 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.037 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 24 2024-05-08T18:08:25.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.037 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:08:25.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:08:25.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012442+0000", 2024-05-08T18:08:25.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.4300000000000002e-07 2024-05-08T18:08:25.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012573+0000", 2024-05-08T18:08:25.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013108299999999999 2024-05-08T18:08:25.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012592+0000", 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9009e-05 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012610+0000", 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.789e-05 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019108+0000", 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064981470000000001 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019348+0000", 2024-05-08T18:08:25.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024006099999999999 2024-05-08T18:08:25.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019751+0000", 2024-05-08T18:08:25.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040324099999999998 2024-05-08T18:08:25.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.022727+0000", 2024-05-08T18:08:25.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002976107 2024-05-08T18:08:25.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.022826+0000", 2024-05-08T18:08:25.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8626000000000001e-05 2024-05-08T18:08:25.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023036+0000", 2024-05-08T18:08:25.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000209578 2024-05-08T18:08:25.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023204+0000", 2024-05-08T18:08:25.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016819200000000001 2024-05-08T18:08:25.041 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.042 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.042 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.042 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.042 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:08:25.042 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.016168622999999, 2024-05-08T18:08:25.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011074977999999999, 2024-05-08T18:08:25.042 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.042 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.042 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.042 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.042 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.042 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.042 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 25 2024-05-08T18:08:25.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.043 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:08:25.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:08:25.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012629+0000", 2024-05-08T18:08:25.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7700000000000004e-07 2024-05-08T18:08:25.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012636+0000", 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012646+0000", 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0147e-05 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012657+0000", 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0473e-05 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021198+0000", 2024-05-08T18:08:25.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0085417510000000002 2024-05-08T18:08:25.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021445+0000", 2024-05-08T18:08:25.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024665100000000002 2024-05-08T18:08:25.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021820+0000", 2024-05-08T18:08:25.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037519400000000003 2024-05-08T18:08:25.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023231+0000", 2024-05-08T18:08:25.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001410412 2024-05-08T18:08:25.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023550+0000", 2024-05-08T18:08:25.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000319368 2024-05-08T18:08:25.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023632+0000", 2024-05-08T18:08:25.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2366000000000004e-05 2024-05-08T18:08:25.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023703+0000", 2024-05-08T18:08:25.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0568999999999995e-05 2024-05-08T18:08:25.047 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.047 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.047 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.047 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.047 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:08:25.047 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.919822835999994, 2024-05-08T18:08:25.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011460965, 2024-05-08T18:08:25.047 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.047 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.047 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.047 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.048 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.048 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.048 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 45 2024-05-08T18:08:25.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.048 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:08:25.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:08:25.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108975+0000", 2024-05-08T18:08:25.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:08:25.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108983+0000", 2024-05-08T18:08:25.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6669999999999996e-06 2024-05-08T18:08:25.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109005+0000", 2024-05-08T18:08:25.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2787000000000001e-05 2024-05-08T18:08:25.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109020+0000", 2024-05-08T18:08:25.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4192999999999999e-05 2024-05-08T18:08:25.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116378+0000", 2024-05-08T18:08:25.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073585600000000001 2024-05-08T18:08:25.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116516+0000", 2024-05-08T18:08:25.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000137739 2024-05-08T18:08:25.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116747+0000", 2024-05-08T18:08:25.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023132799999999999 2024-05-08T18:08:25.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120140+0000", 2024-05-08T18:08:25.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033931439999999998 2024-05-08T18:08:25.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120290+0000", 2024-05-08T18:08:25.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149765 2024-05-08T18:08:25.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120369+0000", 2024-05-08T18:08:25.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.907e-05 2024-05-08T18:08:25.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120435+0000", 2024-05-08T18:08:25.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5642999999999995e-05 2024-05-08T18:08:25.052 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.052 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.052 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.053 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.053 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:08:25.053 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.919758743000003, 2024-05-08T18:08:25.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013705973999999999, 2024-05-08T18:08:25.053 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.053 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.053 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.053 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.053 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.053 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.053 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:08:25.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.053 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:08:25.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:08:25.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109039+0000", 2024-05-08T18:08:25.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:08:25.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109044+0000", 2024-05-08T18:08:25.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6699999999999999e-06 2024-05-08T18:08:25.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109054+0000", 2024-05-08T18:08:25.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7100000000000002e-06 2024-05-08T18:08:25.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109064+0000", 2024-05-08T18:08:25.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5740000000000002e-06 2024-05-08T18:08:25.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.117676+0000", 2024-05-08T18:08:25.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086126060000000001 2024-05-08T18:08:25.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.117828+0000", 2024-05-08T18:08:25.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151552 2024-05-08T18:08:25.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118041+0000", 2024-05-08T18:08:25.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000212692 2024-05-08T18:08:25.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120269+0000", 2024-05-08T18:08:25.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022281860000000001 2024-05-08T18:08:25.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122593+0000", 2024-05-08T18:08:25.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023239419999999998 2024-05-08T18:08:25.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122672+0000", 2024-05-08T18:08:25.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9579999999999994e-05 2024-05-08T18:08:25.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122744+0000", 2024-05-08T18:08:25.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1695999999999999e-05 2024-05-08T18:08:25.058 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.058 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.058 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.058 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.058 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:08:25.058 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.919714900000002, 2024-05-08T18:08:25.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016228664, 2024-05-08T18:08:25.058 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.058 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.058 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.059 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.059 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.059 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.059 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 47 2024-05-08T18:08:25.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.059 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:08:25.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:08:25.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109083+0000", 2024-05-08T18:08:25.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4600000000000004e-07 2024-05-08T18:08:25.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109232+0000", 2024-05-08T18:08:25.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149782 2024-05-08T18:08:25.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109257+0000", 2024-05-08T18:08:25.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4856999999999999e-05 2024-05-08T18:08:25.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109272+0000", 2024-05-08T18:08:25.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.503e-05 2024-05-08T18:08:25.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118799+0000", 2024-05-08T18:08:25.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0095264400000000006 2024-05-08T18:08:25.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118947+0000", 2024-05-08T18:08:25.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014848199999999999 2024-05-08T18:08:25.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.119151+0000", 2024-05-08T18:08:25.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020350500000000001 2024-05-08T18:08:25.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121458+0000", 2024-05-08T18:08:25.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002307749 2024-05-08T18:08:25.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125170+0000", 2024-05-08T18:08:25.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037113409999999999 2024-05-08T18:08:25.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125246+0000", 2024-05-08T18:08:25.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6029e-05 2024-05-08T18:08:25.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125310+0000", 2024-05-08T18:08:25.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4702999999999994e-05 2024-05-08T18:08:25.063 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.063 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.063 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.063 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.063 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.919495381999994, 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016305097000000001, 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 48 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:08:25.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109303+0000", 2024-05-08T18:08:25.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:25.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109332+0000", 2024-05-08T18:08:25.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9220000000000001e-05 2024-05-08T18:08:25.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109375+0000", 2024-05-08T18:08:25.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2765999999999997e-05 2024-05-08T18:08:25.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109394+0000", 2024-05-08T18:08:25.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8603000000000001e-05 2024-05-08T18:08:25.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120508+0000", 2024-05-08T18:08:25.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011114811 2024-05-08T18:08:25.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120663+0000", 2024-05-08T18:08:25.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000154332 2024-05-08T18:08:25.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120863+0000", 2024-05-08T18:08:25.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019995599999999999 2024-05-08T18:08:25.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125326+0000", 2024-05-08T18:08:25.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044631180000000003 2024-05-08T18:08:25.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125431+0000", 2024-05-08T18:08:25.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010522900000000001 2024-05-08T18:08:25.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125541+0000", 2024-05-08T18:08:25.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109802 2024-05-08T18:08:25.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125606+0000", 2024-05-08T18:08:25.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5549999999999994e-05 2024-05-08T18:08:25.068 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.069 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.069 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.069 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.069 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:08:25.069 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.919375063000004, 2024-05-08T18:08:25.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016563135, 2024-05-08T18:08:25.069 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.069 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.069 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.069 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.069 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.069 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.070 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 49 2024-05-08T18:08:25.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.070 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:08:25.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:08:25.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109423+0000", 2024-05-08T18:08:25.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5969999999999999e-06 2024-05-08T18:08:25.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109434+0000", 2024-05-08T18:08:25.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.113e-05 2024-05-08T18:08:25.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109455+0000", 2024-05-08T18:08:25.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0873000000000002e-05 2024-05-08T18:08:25.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109469+0000", 2024-05-08T18:08:25.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4039999999999999e-05 2024-05-08T18:08:25.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121566+0000", 2024-05-08T18:08:25.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012096325999999999 2024-05-08T18:08:25.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121725+0000", 2024-05-08T18:08:25.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015932899999999999 2024-05-08T18:08:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121981+0000", 2024-05-08T18:08:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025583799999999999 2024-05-08T18:08:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125680+0000", 2024-05-08T18:08:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0036995579999999999 2024-05-08T18:08:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125838+0000", 2024-05-08T18:08:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015731499999999999 2024-05-08T18:08:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125914+0000", 2024-05-08T18:08:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6686000000000004e-05 2024-05-08T18:08:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125985+0000", 2024-05-08T18:08:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0443000000000003e-05 2024-05-08T18:08:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:08:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.919302684000002, 2024-05-08T18:08:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016620291999999998, 2024-05-08T18:08:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 50 2024-05-08T18:08:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:08:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:08:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109495+0000", 2024-05-08T18:08:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.477e-06 2024-05-08T18:08:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109692+0000", 2024-05-08T18:08:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019638199999999999 2024-05-08T18:08:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109733+0000", 2024-05-08T18:08:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1093000000000001e-05 2024-05-08T18:08:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109745+0000", 2024-05-08T18:08:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1715999999999999e-05 2024-05-08T18:08:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122839+0000", 2024-05-08T18:08:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013094809000000001 2024-05-08T18:08:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122980+0000", 2024-05-08T18:08:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140829 2024-05-08T18:08:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.123239+0000", 2024-05-08T18:08:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025834799999999999 2024-05-08T18:08:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125810+0000", 2024-05-08T18:08:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025717729999999999 2024-05-08T18:08:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126001+0000", 2024-05-08T18:08:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019013600000000001 2024-05-08T18:08:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126064+0000", 2024-05-08T18:08:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3301999999999998e-05 2024-05-08T18:08:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126114+0000", 2024-05-08T18:08:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0426999999999997e-05 2024-05-08T18:08:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:08:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.919023535999997, 2024-05-08T18:08:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018305669, 2024-05-08T18:08:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 51 2024-05-08T18:08:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:08:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:08:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109775+0000", 2024-05-08T18:08:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5269999999999999e-06 2024-05-08T18:08:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109786+0000", 2024-05-08T18:08:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1296e-05 2024-05-08T18:08:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109806+0000", 2024-05-08T18:08:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0114000000000001e-05 2024-05-08T18:08:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109823+0000", 2024-05-08T18:08:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6665999999999999e-05 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124193+0000", 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014369916 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124354+0000", 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016167899999999999 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124571+0000", 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021652800000000001 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126978+0000", 2024-05-08T18:08:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024071679999999999 2024-05-08T18:08:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127921+0000", 2024-05-08T18:08:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00094277599999999999 2024-05-08T18:08:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.128012+0000", 2024-05-08T18:08:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0818999999999999e-05 2024-05-08T18:08:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.128079+0000", 2024-05-08T18:08:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7180000000000004e-05 2024-05-08T18:08:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:08:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.91894843, 2024-05-08T18:08:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021440811000000001, 2024-05-08T18:08:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 52 2024-05-08T18:08:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:08:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:08:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109849+0000", 2024-05-08T18:08:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1370000000000001e-06 2024-05-08T18:08:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109861+0000", 2024-05-08T18:08:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1559999999999999e-05 2024-05-08T18:08:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109878+0000", 2024-05-08T18:08:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7105999999999999e-05 2024-05-08T18:08:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109892+0000", 2024-05-08T18:08:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3577000000000001e-05 2024-05-08T18:08:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126161+0000", 2024-05-08T18:08:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016269458000000001 2024-05-08T18:08:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126299+0000", 2024-05-08T18:08:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138405 2024-05-08T18:08:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126534+0000", 2024-05-08T18:08:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000234875 2024-05-08T18:08:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127543+0000", 2024-05-08T18:08:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001008852 2024-05-08T18:08:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131128+0000", 2024-05-08T18:08:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035844359999999999 2024-05-08T18:08:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131222+0000", 2024-05-08T18:08:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3905000000000003e-05 2024-05-08T18:08:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131289+0000", 2024-05-08T18:08:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7500000000000001e-05 2024-05-08T18:08:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:08:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.678662731000003, 2024-05-08T18:08:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010652125, 2024-05-08T18:08:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 67 2024-05-08T18:08:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:08:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:08:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350135+0000", 2024-05-08T18:08:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.083e-06 2024-05-08T18:08:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350141+0000", 2024-05-08T18:08:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.178e-06 2024-05-08T18:08:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350152+0000", 2024-05-08T18:08:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0706999999999999e-05 2024-05-08T18:08:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350159+0000", 2024-05-08T18:08:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3640000000000001e-06 2024-05-08T18:08:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352606+0000", 2024-05-08T18:08:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024470379999999999 2024-05-08T18:08:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352718+0000", 2024-05-08T18:08:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000111366 2024-05-08T18:08:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352887+0000", 2024-05-08T18:08:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016887900000000001 2024-05-08T18:08:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358041+0000", 2024-05-08T18:08:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051542940000000002 2024-05-08T18:08:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360681+0000", 2024-05-08T18:08:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026404639999999999 2024-05-08T18:08:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360726+0000", 2024-05-08T18:08:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4666999999999998e-05 2024-05-08T18:08:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360786+0000", 2024-05-08T18:08:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0084999999999998e-05 2024-05-08T18:08:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:08:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.678407343000003, 2024-05-08T18:08:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010500438000000001, 2024-05-08T18:08:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 68 2024-05-08T18:08:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:08:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:08:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350391+0000", 2024-05-08T18:08:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:08:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350398+0000", 2024-05-08T18:08:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6599999999999995e-06 2024-05-08T18:08:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350414+0000", 2024-05-08T18:08:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6101000000000001e-05 2024-05-08T18:08:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350425+0000", 2024-05-08T18:08:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.099e-05 2024-05-08T18:08:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353737+0000", 2024-05-08T18:08:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033112739999999999 2024-05-08T18:08:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353810+0000", 2024-05-08T18:08:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3337999999999995e-05 2024-05-08T18:08:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353922+0000", 2024-05-08T18:08:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112409 2024-05-08T18:08:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358114+0000", 2024-05-08T18:08:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041912909999999998 2024-05-08T18:08:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360798+0000", 2024-05-08T18:08:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026845850000000002 2024-05-08T18:08:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360838+0000", 2024-05-08T18:08:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9619999999999997e-05 2024-05-08T18:08:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360890+0000", 2024-05-08T18:08:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.185e-05 2024-05-08T18:08:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:08:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.678031122999997, 2024-05-08T18:08:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010508969999999999, 2024-05-08T18:08:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 71 2024-05-08T18:08:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:08:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:08:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:08:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.61e-07 2024-05-08T18:08:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350771+0000", 2024-05-08T18:08:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6720000000000003e-06 2024-05-08T18:08:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350781+0000", 2024-05-08T18:08:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9450000000000005e-06 2024-05-08T18:08:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350786+0000", 2024-05-08T18:08:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2530000000000004e-06 2024-05-08T18:08:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356065+0000", 2024-05-08T18:08:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052789239999999999 2024-05-08T18:08:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356174+0000", 2024-05-08T18:08:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108564 2024-05-08T18:08:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356336+0000", 2024-05-08T18:08:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162566 2024-05-08T18:08:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358285+0000", 2024-05-08T18:08:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001948443 2024-05-08T18:08:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361124+0000", 2024-05-08T18:08:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028390120000000001 2024-05-08T18:08:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361217+0000", 2024-05-08T18:08:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3899000000000003e-05 2024-05-08T18:08:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361275+0000", 2024-05-08T18:08:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7031000000000003e-05 2024-05-08T18:08:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:08:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.677953650999996, 2024-05-08T18:08:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010535020000000001, 2024-05-08T18:08:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 72 2024-05-08T18:08:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:08:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:08:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350844+0000", 2024-05-08T18:08:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:08:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350957+0000", 2024-05-08T18:08:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112958 2024-05-08T18:08:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350966+0000", 2024-05-08T18:08:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3440000000000007e-06 2024-05-08T18:08:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350972+0000", 2024-05-08T18:08:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.37e-06 2024-05-08T18:08:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356777+0000", 2024-05-08T18:08:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058049199999999999 2024-05-08T18:08:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356852+0000", 2024-05-08T18:08:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5109000000000002e-05 2024-05-08T18:08:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356961+0000", 2024-05-08T18:08:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108818 2024-05-08T18:08:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359695+0000", 2024-05-08T18:08:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002733685 2024-05-08T18:08:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361284+0000", 2024-05-08T18:08:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015888740000000001 2024-05-08T18:08:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361323+0000", 2024-05-08T18:08:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9824999999999999e-05 2024-05-08T18:08:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361378+0000", 2024-05-08T18:08:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4593999999999999e-05 2024-05-08T18:08:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:08:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.677813849000003, 2024-05-08T18:08:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01225805, 2024-05-08T18:08:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 73 2024-05-08T18:08:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:08:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:08:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:08:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0999999999999999e-07 2024-05-08T18:08:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350987+0000", 2024-05-08T18:08:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3529999999999999e-06 2024-05-08T18:08:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350994+0000", 2024-05-08T18:08:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0840000000000003e-06 2024-05-08T18:08:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350998+0000", 2024-05-08T18:08:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.194e-06 2024-05-08T18:08:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358336+0000", 2024-05-08T18:08:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073376070000000003 2024-05-08T18:08:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358456+0000", 2024-05-08T18:08:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012042199999999999 2024-05-08T18:08:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358615+0000", 2024-05-08T18:08:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015928399999999999 2024-05-08T18:08:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.362117+0000", 2024-05-08T18:08:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035021039999999998 2024-05-08T18:08:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363139+0000", 2024-05-08T18:08:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010220349999999999 2024-05-08T18:08:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363181+0000", 2024-05-08T18:08:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1465999999999999e-05 2024-05-08T18:08:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363241+0000", 2024-05-08T18:08:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9991000000000002e-05 2024-05-08T18:08:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:08:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.677789032000007, 2024-05-08T18:08:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012698229, 2024-05-08T18:08:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 74 2024-05-08T18:08:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:08:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:08:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:08:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4000000000000002e-07 2024-05-08T18:08:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351013+0000", 2024-05-08T18:08:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8239999999999999e-06 2024-05-08T18:08:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351020+0000", 2024-05-08T18:08:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.52e-06 2024-05-08T18:08:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351025+0000", 2024-05-08T18:08:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3499999999999999e-06 2024-05-08T18:08:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359063+0000", 2024-05-08T18:08:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0080381800000000007 2024-05-08T18:08:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359140+0000", 2024-05-08T18:08:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7225999999999995e-05 2024-05-08T18:08:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359256+0000", 2024-05-08T18:08:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011537899999999999 2024-05-08T18:08:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363249+0000", 2024-05-08T18:08:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039937089999999998 2024-05-08T18:08:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363584+0000", 2024-05-08T18:08:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033516500000000001 2024-05-08T18:08:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363654+0000", 2024-05-08T18:08:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9093999999999999e-05 2024-05-08T18:08:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363706+0000", 2024-05-08T18:08:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2342000000000001e-05 2024-05-08T18:08:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:08:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.677750771999996, 2024-05-08T18:08:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015677229000000001, 2024-05-08T18:08:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 75 2024-05-08T18:08:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:08:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:08:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:08:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1699999999999999e-07 2024-05-08T18:08:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351141+0000", 2024-05-08T18:08:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4661999999999996e-05 2024-05-08T18:08:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351151+0000", 2024-05-08T18:08:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0084e-05 2024-05-08T18:08:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351160+0000", 2024-05-08T18:08:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2490000000000007e-06 2024-05-08T18:08:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359748+0000", 2024-05-08T18:08:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0085879849999999994 2024-05-08T18:08:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359820+0000", 2024-05-08T18:08:25.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2081000000000003e-05 2024-05-08T18:08:25.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359928+0000", 2024-05-08T18:08:25.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107157 2024-05-08T18:08:25.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363254+0000", 2024-05-08T18:08:25.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033268579999999998 2024-05-08T18:08:25.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366611+0000", 2024-05-08T18:08:25.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033564179999999999 2024-05-08T18:08:25.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366672+0000", 2024-05-08T18:08:25.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0714999999999997e-05 2024-05-08T18:08:25.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366723+0000", 2024-05-08T18:08:25.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1603e-05 2024-05-08T18:08:25.128 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.128 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.128 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:08:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.677626271999998, 2024-05-08T18:08:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015696418, 2024-05-08T18:08:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 76 2024-05-08T18:08:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:08:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:08:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351171+0000", 2024-05-08T18:08:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4600000000000004e-07 2024-05-08T18:08:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351174+0000", 2024-05-08T18:08:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2030000000000001e-06 2024-05-08T18:08:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351179+0000", 2024-05-08T18:08:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2079999999999999e-06 2024-05-08T18:08:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351184+0000", 2024-05-08T18:08:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3120000000000004e-06 2024-05-08T18:08:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361430+0000", 2024-05-08T18:08:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010246175 2024-05-08T18:08:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361545+0000", 2024-05-08T18:08:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115139 2024-05-08T18:08:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361712+0000", 2024-05-08T18:08:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000166491 2024-05-08T18:08:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363473+0000", 2024-05-08T18:08:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017610799999999999 2024-05-08T18:08:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366769+0000", 2024-05-08T18:08:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032964880000000002 2024-05-08T18:08:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366811+0000", 2024-05-08T18:08:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2296000000000003e-05 2024-05-08T18:08:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366867+0000", 2024-05-08T18:08:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5380000000000002e-05 2024-05-08T18:08:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:08:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.326698303000001, 2024-05-08T18:08:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010497067000000001, 2024-05-08T18:08:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 94 2024-05-08T18:08:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:08:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:08:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702099+0000", 2024-05-08T18:08:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4099999999999999e-07 2024-05-08T18:08:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702102+0000", 2024-05-08T18:08:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6650000000000001e-06 2024-05-08T18:08:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702108+0000", 2024-05-08T18:08:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.711e-06 2024-05-08T18:08:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702114+0000", 2024-05-08T18:08:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.241e-06 2024-05-08T18:08:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.708666+0000", 2024-05-08T18:08:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065511459999999999 2024-05-08T18:08:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.708833+0000", 2024-05-08T18:08:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000166966 2024-05-08T18:08:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.709171+0000", 2024-05-08T18:08:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033834000000000002 2024-05-08T18:08:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.710246+0000", 2024-05-08T18:08:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001074642 2024-05-08T18:08:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712422+0000", 2024-05-08T18:08:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021762370000000001 2024-05-08T18:08:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712521+0000", 2024-05-08T18:08:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9432999999999995e-05 2024-05-08T18:08:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712595+0000", 2024-05-08T18:08:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4245000000000005e-05 2024-05-08T18:08:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:25.140 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:25.141 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:25.142+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:25.141 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:08:25.243 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:25.242+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:25.268 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:25.268 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:25.268 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:25.268 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:25.281 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:08:25.344 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:25.342+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:25.406 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:25.407 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:25.407 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:25.407 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:25.407 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:25.420 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:08:25.444 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:25.446+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:25.541 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:25.542 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:25.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:25.542 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:25.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.542 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:52 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'31)", 2024-05-08T18:08:25.542 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:08:25.542 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.417815231000006, 2024-05-08T18:08:25.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00409947, 2024-05-08T18:08:25.542 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.542 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.542 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.542 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:08:25.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:08:25.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127167+0000", 2024-05-08T18:08:25.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7800000000000001e-07 2024-05-08T18:08:25.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127172+0000", 2024-05-08T18:08:25.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1120000000000004e-06 2024-05-08T18:08:25.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127183+0000", 2024-05-08T18:08:25.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1107000000000001e-05 2024-05-08T18:08:25.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127189+0000", 2024-05-08T18:08:25.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0310000000000004e-06 2024-05-08T18:08:25.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127237+0000", 2024-05-08T18:08:25.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7907000000000001e-05 2024-05-08T18:08:25.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127252+0000", 2024-05-08T18:08:25.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5373e-05 2024-05-08T18:08:25.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131206+0000", 2024-05-08T18:08:25.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039540199999999999 2024-05-08T18:08:25.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131265+0000", 2024-05-08T18:08:25.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9141999999999997e-05 2024-05-08T18:08:25.546 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.546 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.546 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.546 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-05-08T18:08:25.546 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:08:25.546 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.409056827000001, 2024-05-08T18:08:25.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049265589999999996, 2024-05-08T18:08:25.546 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.546 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.546 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.546 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135925+0000", 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8100000000000002e-07 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136007+0000", 2024-05-08T18:08:25.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1864000000000001e-05 2024-05-08T18:08:25.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136019+0000", 2024-05-08T18:08:25.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2438e-05 2024-05-08T18:08:25.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136026+0000", 2024-05-08T18:08:25.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0809999999999996e-06 2024-05-08T18:08:25.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136093+0000", 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6769999999999999e-05 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136108+0000", 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.465e-05 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140800+0000", 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046919450000000003 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140851+0000", 2024-05-08T18:08:25.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.113e-05 2024-05-08T18:08:25.550 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.550 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.550 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.550 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-05-08T18:08:25.550 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:08:25.550 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.192571616999999, 2024-05-08T18:08:25.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042257299999999996, 2024-05-08T18:08:25.550 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.550 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.550 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.550 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:08:25.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:08:25.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352410+0000", 2024-05-08T18:08:25.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7599999999999997e-07 2024-05-08T18:08:25.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352489+0000", 2024-05-08T18:08:25.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8564000000000002e-05 2024-05-08T18:08:25.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352500+0000", 2024-05-08T18:08:25.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1411e-05 2024-05-08T18:08:25.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352506+0000", 2024-05-08T18:08:25.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7309999999999998e-06 2024-05-08T18:08:25.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352569+0000", 2024-05-08T18:08:25.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3173e-05 2024-05-08T18:08:25.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352598+0000", 2024-05-08T18:08:25.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8855000000000001e-05 2024-05-08T18:08:25.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356592+0000", 2024-05-08T18:08:25.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039941539999999998 2024-05-08T18:08:25.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356635+0000", 2024-05-08T18:08:25.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3166e-05 2024-05-08T18:08:25.554 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.554 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.554 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.554 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:75 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'53, mlcod=15'43)", 2024-05-08T18:08:25.554 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:08:25.554 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.184400199999999, 2024-05-08T18:08:25.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063708030000000004, 2024-05-08T18:08:25.554 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.554 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.555 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.555 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:08:25.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:08:25.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:08:25.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:08:25.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360641+0000", 2024-05-08T18:08:25.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9273e-05 2024-05-08T18:08:25.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360651+0000", 2024-05-08T18:08:25.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0353000000000001e-05 2024-05-08T18:08:25.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360659+0000", 2024-05-08T18:08:25.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4789999999999999e-06 2024-05-08T18:08:25.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360720+0000", 2024-05-08T18:08:25.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699000000000007e-05 2024-05-08T18:08:25.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360739+0000", 2024-05-08T18:08:25.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8913999999999999e-05 2024-05-08T18:08:25.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366883+0000", 2024-05-08T18:08:25.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061438229999999996 2024-05-08T18:08:25.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366952+0000", 2024-05-08T18:08:25.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8677000000000007e-05 2024-05-08T18:08:25.558 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.558 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.558 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.559 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:76 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'54, mlcod=15'49)", 2024-05-08T18:08:25.559 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:08:25.559 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.182663695000002, 2024-05-08T18:08:25.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046550610000000003, 2024-05-08T18:08:25.559 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.559 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.559 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.559 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:08:25.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:08:25.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362318+0000", 2024-05-08T18:08:25.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.99e-07 2024-05-08T18:08:25.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362323+0000", 2024-05-08T18:08:25.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.566e-06 2024-05-08T18:08:25.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362334+0000", 2024-05-08T18:08:25.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1403000000000001e-05 2024-05-08T18:08:25.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362342+0000", 2024-05-08T18:08:25.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3420000000000008e-06 2024-05-08T18:08:25.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362396+0000", 2024-05-08T18:08:25.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3476000000000001e-05 2024-05-08T18:08:25.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362415+0000", 2024-05-08T18:08:25.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8787000000000002e-05 2024-05-08T18:08:25.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366954+0000", 2024-05-08T18:08:25.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045388609999999999 2024-05-08T18:08:25.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366972+0000", 2024-05-08T18:08:25.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8927e-05 2024-05-08T18:08:25.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.562 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.563 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:79 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'57, mlcod=15'53)", 2024-05-08T18:08:25.563 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:08:25.563 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.175267766999994, 2024-05-08T18:08:25.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045322499999999998, 2024-05-08T18:08:25.563 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.563 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.563 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.563 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:08:25.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:08:25.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369714+0000", 2024-05-08T18:08:25.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:08:25.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369787+0000", 2024-05-08T18:08:25.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3317000000000003e-05 2024-05-08T18:08:25.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369797+0000", 2024-05-08T18:08:25.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9510000000000001e-06 2024-05-08T18:08:25.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369802+0000", 2024-05-08T18:08:25.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8210000000000001e-06 2024-05-08T18:08:25.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369854+0000", 2024-05-08T18:08:25.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1751e-05 2024-05-08T18:08:25.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369880+0000", 2024-05-08T18:08:25.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6577999999999999e-05 2024-05-08T18:08:25.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374202+0000", 2024-05-08T18:08:25.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217029999999997 2024-05-08T18:08:25.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374246+0000", 2024-05-08T18:08:25.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3544000000000002e-05 2024-05-08T18:08:25.566 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.566 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.566 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.567 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:89 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'63, mlcod=15'60)", 2024-05-08T18:08:25.567 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:08:25.567 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.841725601999997, 2024-05-08T18:08:25.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057729900000000004, 2024-05-08T18:08:25.567 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.567 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.567 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.567 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:08:25.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:08:25.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:08:25.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:08:25.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703261+0000", 2024-05-08T18:08:25.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2569999999999998e-06 2024-05-08T18:08:25.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703272+0000", 2024-05-08T18:08:25.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0739e-05 2024-05-08T18:08:25.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703282+0000", 2024-05-08T18:08:25.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6250000000000002e-06 2024-05-08T18:08:25.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703333+0000", 2024-05-08T18:08:25.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1588000000000001e-05 2024-05-08T18:08:25.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703358+0000", 2024-05-08T18:08:25.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4913999999999999e-05 2024-05-08T18:08:25.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708907+0000", 2024-05-08T18:08:25.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055484829999999999 2024-05-08T18:08:25.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.709028+0000", 2024-05-08T18:08:25.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121667 2024-05-08T18:08:25.570 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.570 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.570 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.571 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-05-08T18:08:25.571 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:08:25.571 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.840660084999996, 2024-05-08T18:08:25.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0074185579999999996, 2024-05-08T18:08:25.571 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.571 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.571 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.571 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:08:25.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:08:25.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704322+0000", 2024-05-08T18:08:25.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8299999999999997e-07 2024-05-08T18:08:25.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704410+0000", 2024-05-08T18:08:25.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8552000000000002e-05 2024-05-08T18:08:25.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704421+0000", 2024-05-08T18:08:25.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0794e-05 2024-05-08T18:08:25.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704427+0000", 2024-05-08T18:08:25.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8699999999999997e-06 2024-05-08T18:08:25.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704481+0000", 2024-05-08T18:08:25.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4410999999999998e-05 2024-05-08T18:08:25.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704511+0000", 2024-05-08T18:08:25.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9906000000000001e-05 2024-05-08T18:08:25.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711682+0000", 2024-05-08T18:08:25.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071710209999999996 2024-05-08T18:08:25.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711740+0000", 2024-05-08T18:08:25.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7521e-05 2024-05-08T18:08:25.575 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.575 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.575 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.575 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:91 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'65, mlcod=15'60)", 2024-05-08T18:08:25.575 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:08:25.575 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.839115891999995, 2024-05-08T18:08:25.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059345600000000002, 2024-05-08T18:08:25.575 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.575 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.576 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.576 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:08:25.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:08:25.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705866+0000", 2024-05-08T18:08:25.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0900000000000001e-07 2024-05-08T18:08:25.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705872+0000", 2024-05-08T18:08:25.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0580000000000003e-06 2024-05-08T18:08:25.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705883+0000", 2024-05-08T18:08:25.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0986e-05 2024-05-08T18:08:25.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705889+0000", 2024-05-08T18:08:25.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6400000000000002e-06 2024-05-08T18:08:25.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705942+0000", 2024-05-08T18:08:25.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3726e-05 2024-05-08T18:08:25.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705963+0000", 2024-05-08T18:08:25.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0713e-05 2024-05-08T18:08:25.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711744+0000", 2024-05-08T18:08:25.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057812669999999997 2024-05-08T18:08:25.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711800+0000", 2024-05-08T18:08:25.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5461000000000003e-05 2024-05-08T18:08:25.580 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.580 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.580 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.580 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:92 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'66, mlcod=15'61)", 2024-05-08T18:08:25.580 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:08:25.580 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.837791543999998, 2024-05-08T18:08:25.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046553640000000004, 2024-05-08T18:08:25.580 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.580 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.580 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.580 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:08:25.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:08:25.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707191+0000", 2024-05-08T18:08:25.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9300000000000006e-07 2024-05-08T18:08:25.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707198+0000", 2024-05-08T18:08:25.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4669999999999998e-06 2024-05-08T18:08:25.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707214+0000", 2024-05-08T18:08:25.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5911000000000001e-05 2024-05-08T18:08:25.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707221+0000", 2024-05-08T18:08:25.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.43e-06 2024-05-08T18:08:25.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707283+0000", 2024-05-08T18:08:25.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1974e-05 2024-05-08T18:08:25.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707308+0000", 2024-05-08T18:08:25.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4589000000000001e-05 2024-05-08T18:08:25.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711802+0000", 2024-05-08T18:08:25.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044944939999999999 2024-05-08T18:08:25.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711845+0000", 2024-05-08T18:08:25.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2506000000000003e-05 2024-05-08T18:08:25.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.584 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.584 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:93 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'67, mlcod=15'61)", 2024-05-08T18:08:25.584 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:08:25.584 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.836961286999994, 2024-05-08T18:08:25.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217760000000003, 2024-05-08T18:08:25.584 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.584 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.585 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.585 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:08:25.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:08:25.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708021+0000", 2024-05-08T18:08:25.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.92e-07 2024-05-08T18:08:25.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708106+0000", 2024-05-08T18:08:25.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5400000000000002e-05 2024-05-08T18:08:25.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708116+0000", 2024-05-08T18:08:25.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0482000000000001e-05 2024-05-08T18:08:25.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708124+0000", 2024-05-08T18:08:25.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5349999999999999e-06 2024-05-08T18:08:25.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708182+0000", 2024-05-08T18:08:25.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8130000000000001e-05 2024-05-08T18:08:25.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708203+0000", 2024-05-08T18:08:25.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1118e-05 2024-05-08T18:08:25.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712298+0000", 2024-05-08T18:08:25.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004094688 2024-05-08T18:08:25.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712342+0000", 2024-05-08T18:08:25.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3730999999999999e-05 2024-05-08T18:08:25.588 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.588 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.588 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.588 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:25.588 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:08:25.589 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 58.940535220999998, 2024-05-08T18:08:25.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087837890000000002, 2024-05-08T18:08:25.589 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.589 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.589 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.589 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:25.589 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:25.589 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:25.589 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210 2024-05-08T18:08:25.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.589 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:08:25.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:08:25.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604448+0000", 2024-05-08T18:08:25.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4229999999999999e-06 2024-05-08T18:08:25.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604460+0000", 2024-05-08T18:08:25.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:08:25.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604491+0000", 2024-05-08T18:08:25.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1004000000000003e-05 2024-05-08T18:08:25.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604513+0000", 2024-05-08T18:08:25.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1886e-05 2024-05-08T18:08:25.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604670+0000", 2024-05-08T18:08:25.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000156735 2024-05-08T18:08:25.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:08:25.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604680+0000", 2024-05-08T18:08:25.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0113e-05 2024-05-08T18:08:25.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609236+0000", 2024-05-08T18:08:25.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045557269999999999 2024-05-08T18:08:25.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609544+0000", 2024-05-08T18:08:25.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030863800000000002 2024-05-08T18:08:25.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:25.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.610952+0000", 2024-05-08T18:08:25.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014077269999999999 2024-05-08T18:08:25.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:25.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.612639+0000", 2024-05-08T18:08:25.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001686398 2024-05-08T18:08:25.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613101+0000", 2024-05-08T18:08:25.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00046249600000000001 2024-05-08T18:08:25.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613176+0000", 2024-05-08T18:08:25.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5032999999999998e-05 2024-05-08T18:08:25.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613230+0000", 2024-05-08T18:08:25.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3638999999999999e-05 2024-05-08T18:08:25.594 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.595 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.595 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.595 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:25.595 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:08:25.595 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 58.891947010999999, 2024-05-08T18:08:25.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046602199999999996, 2024-05-08T18:08:25.595 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.595 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.595 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:25.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:25.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:25.595 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 222 2024-05-08T18:08:25.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.596 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:08:25.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:08:25.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653037+0000", 2024-05-08T18:08:25.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:08:25.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653048+0000", 2024-05-08T18:08:25.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:08:25.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653077+0000", 2024-05-08T18:08:25.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9326e-05 2024-05-08T18:08:25.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653098+0000", 2024-05-08T18:08:25.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1327000000000001e-05 2024-05-08T18:08:25.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653230+0000", 2024-05-08T18:08:25.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013206599999999999 2024-05-08T18:08:25.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653444+0000", 2024-05-08T18:08:25.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000213401 2024-05-08T18:08:25.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:25.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653852+0000", 2024-05-08T18:08:25.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040808700000000001 2024-05-08T18:08:25.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.656108+0000", 2024-05-08T18:08:25.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022565739999999999 2024-05-08T18:08:25.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:25.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657533+0000", 2024-05-08T18:08:25.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014241799999999999 2024-05-08T18:08:25.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657629+0000", 2024-05-08T18:08:25.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6435999999999996e-05 2024-05-08T18:08:25.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657694+0000", 2024-05-08T18:08:25.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5349000000000001e-05 2024-05-08T18:08:25.600 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.600 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.600 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.601 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:461 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:25.601 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:08:25.601 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 58.765325205000003, 2024-05-08T18:08:25.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040933549999999999, 2024-05-08T18:08:25.601 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.601 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.601 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.601 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:25.601 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:25.601 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:25.601 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 461 2024-05-08T18:08:25.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.601 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:08:25.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:08:25.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779657+0000", 2024-05-08T18:08:25.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.252e-06 2024-05-08T18:08:25.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779663+0000", 2024-05-08T18:08:25.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0170000000000002e-06 2024-05-08T18:08:25.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779676+0000", 2024-05-08T18:08:25.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.296e-05 2024-05-08T18:08:25.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779684+0000", 2024-05-08T18:08:25.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4209999999999998e-06 2024-05-08T18:08:25.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779736+0000", 2024-05-08T18:08:25.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2296999999999998e-05 2024-05-08T18:08:25.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779787+0000", 2024-05-08T18:08:25.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0954e-05 2024-05-08T18:08:25.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:25.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779897+0000", 2024-05-08T18:08:25.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011001999999999999 2024-05-08T18:08:25.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:25.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780506+0000", 2024-05-08T18:08:25.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060872599999999997 2024-05-08T18:08:25.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783690+0000", 2024-05-08T18:08:25.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031847210000000002 2024-05-08T18:08:25.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783722+0000", 2024-05-08T18:08:25.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1608e-05 2024-05-08T18:08:25.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783749+0000", 2024-05-08T18:08:25.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7379e-05 2024-05-08T18:08:25.606 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.606 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.606 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.606 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:491 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:25.606 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:08:25.606 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 58.743061597000001, 2024-05-08T18:08:25.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059507570000000001, 2024-05-08T18:08:25.606 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.606 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.607 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.607 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:25.607 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:25.607 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:25.607 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 491 2024-05-08T18:08:25.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.607 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:08:25.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:08:25.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801921+0000", 2024-05-08T18:08:25.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6959999999999999e-06 2024-05-08T18:08:25.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801928+0000", 2024-05-08T18:08:25.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0299999999999996e-06 2024-05-08T18:08:25.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801944+0000", 2024-05-08T18:08:25.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285e-05 2024-05-08T18:08:25.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801953+0000", 2024-05-08T18:08:25.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1849999999999993e-06 2024-05-08T18:08:25.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802008+0000", 2024-05-08T18:08:25.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5379e-05 2024-05-08T18:08:25.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802093+0000", 2024-05-08T18:08:25.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4907000000000005e-05 2024-05-08T18:08:25.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:25.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802217+0000", 2024-05-08T18:08:25.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000124253 2024-05-08T18:08:25.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:25.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802725+0000", 2024-05-08T18:08:25.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050758699999999999 2024-05-08T18:08:25.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807807+0000", 2024-05-08T18:08:25.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005082133 2024-05-08T18:08:25.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807840+0000", 2024-05-08T18:08:25.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3399000000000003e-05 2024-05-08T18:08:25.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807870+0000", 2024-05-08T18:08:25.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9903000000000002e-05 2024-05-08T18:08:25.612 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.612 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.612 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.612 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:25.612 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:08:25.612 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 58.736719393000001, 2024-05-08T18:08:25.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056057140000000004, 2024-05-08T18:08:25.612 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.612 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.612 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.612 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:25.612 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:25.612 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:25.613 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 502 2024-05-08T18:08:25.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.613 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:08:25.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:08:25.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808263+0000", 2024-05-08T18:08:25.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.054e-06 2024-05-08T18:08:25.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808268+0000", 2024-05-08T18:08:25.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4829999999999999e-06 2024-05-08T18:08:25.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808279+0000", 2024-05-08T18:08:25.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0710000000000001e-05 2024-05-08T18:08:25.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808285+0000", 2024-05-08T18:08:25.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0610000000000001e-06 2024-05-08T18:08:25.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808331+0000", 2024-05-08T18:08:25.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5939000000000002e-05 2024-05-08T18:08:25.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808380+0000", 2024-05-08T18:08:25.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9382999999999998e-05 2024-05-08T18:08:25.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:25.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808484+0000", 2024-05-08T18:08:25.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010410499999999999 2024-05-08T18:08:25.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:25.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.809035+0000", 2024-05-08T18:08:25.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000550969 2024-05-08T18:08:25.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813811+0000", 2024-05-08T18:08:25.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047759830000000001 2024-05-08T18:08:25.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813842+0000", 2024-05-08T18:08:25.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0778000000000002e-05 2024-05-08T18:08:25.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813867+0000", 2024-05-08T18:08:25.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5249000000000002e-05 2024-05-08T18:08:25.617 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.617 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.617 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.617 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:25.617 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:08:25.618 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 58.710189106999998, 2024-05-08T18:08:25.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041392019999999998, 2024-05-08T18:08:25.618 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.618 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.618 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.618 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:25.618 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:25.618 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:25.618 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 527 2024-05-08T18:08:25.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.618 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:08:25.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:08:25.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834793+0000", 2024-05-08T18:08:25.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.212e-06 2024-05-08T18:08:25.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834799+0000", 2024-05-08T18:08:25.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.468e-06 2024-05-08T18:08:25.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834811+0000", 2024-05-08T18:08:25.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2602000000000001e-05 2024-05-08T18:08:25.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834819+0000", 2024-05-08T18:08:25.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6660000000000008e-06 2024-05-08T18:08:25.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834871+0000", 2024-05-08T18:08:25.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2450000000000001e-05 2024-05-08T18:08:25.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834973+0000", 2024-05-08T18:08:25.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101778 2024-05-08T18:08:25.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:25.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835114+0000", 2024-05-08T18:08:25.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014053399999999999 2024-05-08T18:08:25.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:25.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835758+0000", 2024-05-08T18:08:25.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064386100000000002 2024-05-08T18:08:25.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838876+0000", 2024-05-08T18:08:25.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031188890000000001 2024-05-08T18:08:25.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838907+0000", 2024-05-08T18:08:25.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-08T18:08:25.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838931+0000", 2024-05-08T18:08:25.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3822999999999999e-05 2024-05-08T18:08:25.623 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.623 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.623 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.623 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:25.623 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:08:25.623 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 58.705684126999998, 2024-05-08T18:08:25.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048358089999999999, 2024-05-08T18:08:25.623 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.623 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.624 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.624 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:25.624 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:25.624 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:25.624 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 534 2024-05-08T18:08:25.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.624 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:08:25.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:08:25.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839298+0000", 2024-05-08T18:08:25.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1429999999999999e-06 2024-05-08T18:08:25.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839304+0000", 2024-05-08T18:08:25.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4380000000000003e-06 2024-05-08T18:08:25.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839313+0000", 2024-05-08T18:08:25.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5210000000000008e-06 2024-05-08T18:08:25.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839318+0000", 2024-05-08T18:08:25.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0540000000000002e-06 2024-05-08T18:08:25.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839355+0000", 2024-05-08T18:08:25.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6541999999999997e-05 2024-05-08T18:08:25.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839400+0000", 2024-05-08T18:08:25.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4861999999999998e-05 2024-05-08T18:08:25.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:25.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839504+0000", 2024-05-08T18:08:25.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104169 2024-05-08T18:08:25.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:25.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.840046+0000", 2024-05-08T18:08:25.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054245400000000005 2024-05-08T18:08:25.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844075+0000", 2024-05-08T18:08:25.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040287559999999997 2024-05-08T18:08:25.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844108+0000", 2024-05-08T18:08:25.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2872e-05 2024-05-08T18:08:25.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844133+0000", 2024-05-08T18:08:25.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4998e-05 2024-05-08T18:08:25.629 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.629 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.629 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.629 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:544 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:25.629 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:08:25.629 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 58.692541116999998, 2024-05-08T18:08:25.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052743060000000003, 2024-05-08T18:08:25.629 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.629 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.629 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.629 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:25.630 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:25.630 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:25.630 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 544 2024-05-08T18:08:25.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.630 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:08:25.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:08:25.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852442+0000", 2024-05-08T18:08:25.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.88e-06 2024-05-08T18:08:25.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852450+0000", 2024-05-08T18:08:25.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1999999999999994e-06 2024-05-08T18:08:25.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852472+0000", 2024-05-08T18:08:25.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2160000000000001e-05 2024-05-08T18:08:25.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852487+0000", 2024-05-08T18:08:25.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5044e-05 2024-05-08T18:08:25.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852550+0000", 2024-05-08T18:08:25.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3152999999999997e-05 2024-05-08T18:08:25.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852608+0000", 2024-05-08T18:08:25.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8026000000000003e-05 2024-05-08T18:08:25.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:25.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852727+0000", 2024-05-08T18:08:25.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118919 2024-05-08T18:08:25.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:25.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.853180+0000", 2024-05-08T18:08:25.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045216599999999999 2024-05-08T18:08:25.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857638+0000", 2024-05-08T18:08:25.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044584510000000004 2024-05-08T18:08:25.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857672+0000", 2024-05-08T18:08:25.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3571000000000001e-05 2024-05-08T18:08:25.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857714+0000", 2024-05-08T18:08:25.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2735999999999999e-05 2024-05-08T18:08:25.634 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.634 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.634 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.635 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:25.635 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:08:25.635 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 58.364712337999997, 2024-05-08T18:08:25.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004733213, 2024-05-08T18:08:25.635 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:25.635 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:25.635 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:25.635 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:25.635 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:25.635 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:25.635 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 789 2024-05-08T18:08:25.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.636 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:25.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:25.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:08:25.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:25.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:08:25.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:25.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:25.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180271+0000", 2024-05-08T18:08:25.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8700000000000001e-06 2024-05-08T18:08:25.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:25.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180281+0000", 2024-05-08T18:08:25.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0067e-05 2024-05-08T18:08:25.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:25.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180311+0000", 2024-05-08T18:08:25.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0783e-05 2024-05-08T18:08:25.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:25.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180333+0000", 2024-05-08T18:08:25.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1509999999999999e-05 2024-05-08T18:08:25.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:25.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180450+0000", 2024-05-08T18:08:25.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116686 2024-05-08T18:08:25.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:25.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180581+0000", 2024-05-08T18:08:25.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013103499999999999 2024-05-08T18:08:25.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:25.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180848+0000", 2024-05-08T18:08:25.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026750199999999997 2024-05-08T18:08:25.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:25.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184268+0000", 2024-05-08T18:08:25.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034198319999999998 2024-05-08T18:08:25.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:25.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184844+0000", 2024-05-08T18:08:25.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057643899999999999 2024-05-08T18:08:25.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:25.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184933+0000", 2024-05-08T18:08:25.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8692999999999999e-05 2024-05-08T18:08:25.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:25.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:25.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:25.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.185002+0000", 2024-05-08T18:08:25.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8795999999999997e-05 2024-05-08T18:08:25.640 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.640 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.640 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.640 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:25.640 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:25.640 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:25.642 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:08:25.642 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:25.641+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:25.743 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:25.742+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:25.758 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:08:25.806 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:25.806 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:25.806 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:25.806 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:25.820 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:08:25.843 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:25.842+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:25.851 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:08:25.898 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:25.898 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:25.917 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:25.917 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:25.933 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:25.933 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:25.944 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:25.946+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:25.950 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:25.950 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:25.973 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:25.973 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:25.997 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:25.997 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:26.007 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:26.007 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:26.024 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:08:26.031 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:26.032 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:26.055 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:26.056 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:26.056 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:26.057+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:26.145 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:26.146+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:26.146 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:26.147 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:26.161 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:08:26.246 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:26.246+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:26.274 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:26.274 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:26.288 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:08:26.346 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:26.349+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:26.409 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:26.409 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:26.422 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:08:26.448 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:26.450+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:26.549 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:26.550+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:26.590 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:26.590 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:26.605 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:08:26.650 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:26.650+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:26.735 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:26.736 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:26.750 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:08:26.751 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:26.750+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:26.833 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-05-08T18:08:26.851 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:26.853+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:26.870 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:26.871 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:26.884 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:08:26.970 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:26.973+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:27.047 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:27.047 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:27.053 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:27.054+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:27.061 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:08:27.154 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:27.154+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:27.193 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:27.193 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:27.208 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:08:27.255 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:27.257+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:27.357 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:27.357+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:27.369 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:27.369 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:27.383 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:08:27.460 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:27.462+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:27.504 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:27.505 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:27.519 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:08:27.560 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:27.562+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:27.660 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:27.661+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:27.680 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:27.680 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:27.694 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:08:27.762 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:27.762+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:27.817 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:27.817 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:27.831 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:08:27.876 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:27.878+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:27.964 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:27.965+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:27.999 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:27.999 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:28.013 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:08:28.064 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:28.066+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:28.080 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:08:28.138 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:28.138 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:28.152 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:08:28.164 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:28.165+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:28.226 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:28.226 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:28.245 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:28.245 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:28.262 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:28.262 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:28.264 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:28.265+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:28.280 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:28.280 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:28.299 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:28.299 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:28.319 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:28.319 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:28.320 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:28.320 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:28.334 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:08:28.340 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:28.340 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:28.357 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:28.357 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:28.365 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:28.365+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:28.457 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:28.457 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:28.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:28.458 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:28.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.458 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:28.458 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:08:28.458 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.922443485000002, 2024-05-08T18:08:28.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.032012946, 2024-05-08T18:08:28.458 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.458 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.458 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.458 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:28.459 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:28.459 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:28.459 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:08:28.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.459 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:08:28.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:08:28.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535484+0000", 2024-05-08T18:08:28.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7929999999999999e-06 2024-05-08T18:08:28.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535500+0000", 2024-05-08T18:08:28.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5226e-05 2024-05-08T18:08:28.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535535+0000", 2024-05-08T18:08:28.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5213000000000003e-05 2024-05-08T18:08:28.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535564+0000", 2024-05-08T18:08:28.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9360999999999999e-05 2024-05-08T18:08:28.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535757+0000", 2024-05-08T18:08:28.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000193229 2024-05-08T18:08:28.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:08:28.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535775+0000", 2024-05-08T18:08:28.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7098000000000001e-05 2024-05-08T18:08:28.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556004+0000", 2024-05-08T18:08:28.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020229068999999999 2024-05-08T18:08:28.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:28.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556036+0000", 2024-05-08T18:08:28.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1943000000000002e-05 2024-05-08T18:08:28.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.564721+0000", 2024-05-08T18:08:28.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086853320000000005 2024-05-08T18:08:28.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565032+0000", 2024-05-08T18:08:28.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031121799999999999 2024-05-08T18:08:28.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:28.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565365+0000", 2024-05-08T18:08:28.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000332744 2024-05-08T18:08:28.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:28.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567305+0000", 2024-05-08T18:08:28.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00194016 2024-05-08T18:08:28.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:28.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567368+0000", 2024-05-08T18:08:28.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3342000000000004e-05 2024-05-08T18:08:28.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567433+0000", 2024-05-08T18:08:28.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4726000000000003e-05 2024-05-08T18:08:28.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567494+0000", 2024-05-08T18:08:28.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0492000000000003e-05 2024-05-08T18:08:28.465 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.465 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.465 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.465 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206896342016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:28.465 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:08:28.465 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.890026392999999, 2024-05-08T18:08:28.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026490820000000001, 2024-05-08T18:08:28.465 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.465 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.465 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.465 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:28.465 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:28.465 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:28.466 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 47 2024-05-08T18:08:28.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.466 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:08:28.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567898+0000", 2024-05-08T18:08:28.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567900+0000", 2024-05-08T18:08:28.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.03e-06 2024-05-08T18:08:28.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567909+0000", 2024-05-08T18:08:28.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0389999999999993e-06 2024-05-08T18:08:28.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567947+0000", 2024-05-08T18:08:28.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8013999999999999e-05 2024-05-08T18:08:28.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567961+0000", 2024-05-08T18:08:28.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3777999999999999e-05 2024-05-08T18:08:28.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568066+0000", 2024-05-08T18:08:28.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105208 2024-05-08T18:08:28.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568176+0000", 2024-05-08T18:08:28.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011041599999999999 2024-05-08T18:08:28.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:28.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568443+0000", 2024-05-08T18:08:28.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000266846 2024-05-08T18:08:28.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:28.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.569612+0000", 2024-05-08T18:08:28.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001169156 2024-05-08T18:08:28.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:28.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570378+0000", 2024-05-08T18:08:28.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00076617799999999995 2024-05-08T18:08:28.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570457+0000", 2024-05-08T18:08:28.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8750000000000003e-05 2024-05-08T18:08:28.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.570547+0000", 2024-05-08T18:08:28.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9666999999999994e-05 2024-05-08T18:08:28.470 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.470 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.470 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.471 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:28.471 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:08:28.471 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.878979121, 2024-05-08T18:08:28.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051182119999999996, 2024-05-08T18:08:28.471 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.471 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.471 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.471 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:28.471 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:28.471 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:28.471 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 54 2024-05-08T18:08:28.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.471 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:08:28.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578945+0000", 2024-05-08T18:08:28.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578947+0000", 2024-05-08T18:08:28.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:28.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578957+0000", 2024-05-08T18:08:28.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6020000000000006e-06 2024-05-08T18:08:28.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578997+0000", 2024-05-08T18:08:28.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0663e-05 2024-05-08T18:08:28.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579016+0000", 2024-05-08T18:08:28.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8185e-05 2024-05-08T18:08:28.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579117+0000", 2024-05-08T18:08:28.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010117599999999999 2024-05-08T18:08:28.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579252+0000", 2024-05-08T18:08:28.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013552 2024-05-08T18:08:28.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:28.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579393+0000", 2024-05-08T18:08:28.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140605 2024-05-08T18:08:28.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:28.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.580414+0000", 2024-05-08T18:08:28.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010214219999999999 2024-05-08T18:08:28.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:28.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.583866+0000", 2024-05-08T18:08:28.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034512840000000002 2024-05-08T18:08:28.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.583946+0000", 2024-05-08T18:08:28.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0406000000000002e-05 2024-05-08T18:08:28.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584063+0000", 2024-05-08T18:08:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117199 2024-05-08T18:08:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206896337408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:08:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.873692394000003, 2024-05-08T18:08:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027716910000000002, 2024-05-08T18:08:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:28.476 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:28.477 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:28.477 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 55 2024-05-08T18:08:28.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.477 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:08:28.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584232+0000", 2024-05-08T18:08:28.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584234+0000", 2024-05-08T18:08:28.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9259999999999999e-06 2024-05-08T18:08:28.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584244+0000", 2024-05-08T18:08:28.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0369e-05 2024-05-08T18:08:28.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584270+0000", 2024-05-08T18:08:28.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5554999999999998e-05 2024-05-08T18:08:28.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584283+0000", 2024-05-08T18:08:28.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3039e-05 2024-05-08T18:08:28.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584384+0000", 2024-05-08T18:08:28.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000100881 2024-05-08T18:08:28.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584510+0000", 2024-05-08T18:08:28.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012627100000000001 2024-05-08T18:08:28.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:28.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.584741+0000", 2024-05-08T18:08:28.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023162899999999999 2024-05-08T18:08:28.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:28.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.585714+0000", 2024-05-08T18:08:28.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00097270500000000003 2024-05-08T18:08:28.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:28.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.586818+0000", 2024-05-08T18:08:28.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00110403 2024-05-08T18:08:28.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.586908+0000", 2024-05-08T18:08:28.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9641000000000005e-05 2024-05-08T18:08:28.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.587003+0000", 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5644999999999997e-05 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:191 6.5 e29/26 6:a2ace8b3:::data_log.0:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.773864825000004, 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001855095, 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.481 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:08:28.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684059+0000", 2024-05-08T18:08:28.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684061+0000", 2024-05-08T18:08:28.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:08:28.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684074+0000", 2024-05-08T18:08:28.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2479e-05 2024-05-08T18:08:28.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684104+0000", 2024-05-08T18:08:28.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0689999999999999e-05 2024-05-08T18:08:28.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684120+0000", 2024-05-08T18:08:28.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5996000000000001e-05 2024-05-08T18:08:28.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684221+0000", 2024-05-08T18:08:28.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000100647 2024-05-08T18:08:28.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.485 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.485 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.684273+0000", 2024-05-08T18:08:28.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2074999999999999e-05 2024-05-08T18:08:28.485 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.485 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.485 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.685828+0000", 2024-05-08T18:08:28.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015553030000000001 2024-05-08T18:08:28.485 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.485 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.485 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.685914+0000", 2024-05-08T18:08:28.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5927999999999995e-05 2024-05-08T18:08:28.485 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.485 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.486 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.486 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:28.486 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:28.486 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.858826561999997, 2024-05-08T18:08:28.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003347367, 2024-05-08T18:08:28.486 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.486 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.486 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.486 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:28.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:28.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599098+0000", 2024-05-08T18:08:28.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5300000000000003e-07 2024-05-08T18:08:28.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599110+0000", 2024-05-08T18:08:28.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1826e-05 2024-05-08T18:08:28.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599159+0000", 2024-05-08T18:08:28.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8322000000000003e-05 2024-05-08T18:08:28.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599180+0000", 2024-05-08T18:08:28.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1682e-05 2024-05-08T18:08:28.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599427+0000", 2024-05-08T18:08:28.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024721299999999998 2024-05-08T18:08:28.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.599475+0000", 2024-05-08T18:08:28.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7299000000000002e-05 2024-05-08T18:08:28.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.602326+0000", 2024-05-08T18:08:28.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028516409999999998 2024-05-08T18:08:28.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.602445+0000", 2024-05-08T18:08:28.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011853099999999999 2024-05-08T18:08:28.490 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.490 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.490 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.490 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:231 6.1f e32/26 6:fde4dd55:gc::gc.26:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:28.490 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:28.490 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.771173464, 2024-05-08T18:08:28.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017909390000000001, 2024-05-08T18:08:28.490 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.490 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.490 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.490 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:28.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:28.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686751+0000", 2024-05-08T18:08:28.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5000000000000002e-07 2024-05-08T18:08:28.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686785+0000", 2024-05-08T18:08:28.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3438000000000001e-05 2024-05-08T18:08:28.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686810+0000", 2024-05-08T18:08:28.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4858000000000002e-05 2024-05-08T18:08:28.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686823+0000", 2024-05-08T18:08:28.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3417999999999999e-05 2024-05-08T18:08:28.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.686989+0000", 2024-05-08T18:08:28.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016624700000000001 2024-05-08T18:08:28.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.687023+0000", 2024-05-08T18:08:28.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3396999999999999e-05 2024-05-08T18:08:28.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.688453+0000", 2024-05-08T18:08:28.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001430675 2024-05-08T18:08:28.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.688542+0000", 2024-05-08T18:08:28.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8256000000000003e-05 2024-05-08T18:08:28.494 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.494 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.494 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.494 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.494 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:292 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:28.494 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:08:28.494 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.737786745000001, 2024-05-08T18:08:28.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020064839999999998, 2024-05-08T18:08:28.494 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.494 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.494 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.494 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:08:28.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720137+0000", 2024-05-08T18:08:28.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720170+0000", 2024-05-08T18:08:28.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3090999999999999e-05 2024-05-08T18:08:28.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720189+0000", 2024-05-08T18:08:28.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8077999999999999e-05 2024-05-08T18:08:28.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720222+0000", 2024-05-08T18:08:28.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3111000000000002e-05 2024-05-08T18:08:28.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720241+0000", 2024-05-08T18:08:28.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9528e-05 2024-05-08T18:08:28.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720452+0000", 2024-05-08T18:08:28.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021077300000000001 2024-05-08T18:08:28.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.720505+0000", 2024-05-08T18:08:28.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2605000000000002e-05 2024-05-08T18:08:28.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.722038+0000", 2024-05-08T18:08:28.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015334630000000001 2024-05-08T18:08:28.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.722144+0000", 2024-05-08T18:08:28.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010583500000000001 2024-05-08T18:08:28.498 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.498 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.498 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.498 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:328 6.1 e32/26 6:856b9b26:reshard::reshard.0000000002:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:28.498 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:28.498 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.732358454, 2024-05-08T18:08:28.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0018910070000000001, 2024-05-08T18:08:28.498 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.498 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.498 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.499 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:28.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:28.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725566+0000", 2024-05-08T18:08:28.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3e-07 2024-05-08T18:08:28.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725576+0000", 2024-05-08T18:08:28.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5759999999999995e-06 2024-05-08T18:08:28.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725622+0000", 2024-05-08T18:08:28.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6196000000000003e-05 2024-05-08T18:08:28.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.725642+0000", 2024-05-08T18:08:28.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9947999999999999e-05 2024-05-08T18:08:28.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.726011+0000", 2024-05-08T18:08:28.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036876699999999999 2024-05-08T18:08:28.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.726062+0000", 2024-05-08T18:08:28.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1062e-05 2024-05-08T18:08:28.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.727367+0000", 2024-05-08T18:08:28.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001304869 2024-05-08T18:08:28.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.727457+0000", 2024-05-08T18:08:28.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9858999999999995e-05 2024-05-08T18:08:28.502 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.502 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.502 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.502 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:382 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'6, mlcod=32'4)", 2024-05-08T18:08:28.502 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:08:28.502 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.719393850000003, 2024-05-08T18:08:28.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023570779999999999, 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738530+0000", 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738532+0000", 2024-05-08T18:08:28.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.95e-06 2024-05-08T18:08:28.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738548+0000", 2024-05-08T18:08:28.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5911000000000001e-05 2024-05-08T18:08:28.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738583+0000", 2024-05-08T18:08:28.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4830999999999999e-05 2024-05-08T18:08:28.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738605+0000", 2024-05-08T18:08:28.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2005e-05 2024-05-08T18:08:28.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738747+0000", 2024-05-08T18:08:28.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014162800000000001 2024-05-08T18:08:28.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.738800+0000", 2024-05-08T18:08:28.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2918999999999999e-05 2024-05-08T18:08:28.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.740802+0000", 2024-05-08T18:08:28.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020026150000000001 2024-05-08T18:08:28.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.740887+0000", 2024-05-08T18:08:28.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5218999999999998e-05 2024-05-08T18:08:28.506 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.506 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.506 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.506 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:394 6.c e32/26 6:3677c228:::obj_delete_at_hint.0000000006:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:28.506 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:08:28.506 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.714728639, 2024-05-08T18:08:28.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026335320000000001, 2024-05-08T18:08:28.506 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.507 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.507 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.507 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:08:28.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743195+0000", 2024-05-08T18:08:28.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743197+0000", 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.81e-06 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743210+0000", 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2354999999999999e-05 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743237+0000", 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7328e-05 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743256+0000", 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8712e-05 2024-05-08T18:08:28.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743394+0000", 2024-05-08T18:08:28.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138009 2024-05-08T18:08:28.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743449+0000", 2024-05-08T18:08:28.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5371000000000002e-05 2024-05-08T18:08:28.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745754+0000", 2024-05-08T18:08:28.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002304567 2024-05-08T18:08:28.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745829+0000", 2024-05-08T18:08:28.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.538e-05 2024-05-08T18:08:28.510 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.510 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.510 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.510 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:392 6.3 e32/26 6:c3a682d4:reshard::reshard.0000000004:head v 32'7, mlcod=32'5)", 2024-05-08T18:08:28.510 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:08:28.510 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.714276120000001, 2024-05-08T18:08:28.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022345389999999998, 2024-05-08T18:08:28.511 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.511 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.511 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.511 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:08:28.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743648+0000", 2024-05-08T18:08:28.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743650+0000", 2024-05-08T18:08:28.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1260000000000001e-06 2024-05-08T18:08:28.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743666+0000", 2024-05-08T18:08:28.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5696e-05 2024-05-08T18:08:28.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743696+0000", 2024-05-08T18:08:28.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0037999999999999e-05 2024-05-08T18:08:28.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743716+0000", 2024-05-08T18:08:28.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0251e-05 2024-05-08T18:08:28.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743838+0000", 2024-05-08T18:08:28.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012187 2024-05-08T18:08:28.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.743886+0000", 2024-05-08T18:08:28.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8053000000000002e-05 2024-05-08T18:08:28.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745805+0000", 2024-05-08T18:08:28.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019189509999999999 2024-05-08T18:08:28.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.745883+0000", 2024-05-08T18:08:28.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7553999999999996e-05 2024-05-08T18:08:28.514 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.514 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.515 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.515 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:453 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:28.515 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:08:28.515 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.680110939999999, 2024-05-08T18:08:28.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017625729999999999, 2024-05-08T18:08:28.516 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.516 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.516 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.516 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:08:28.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777813+0000", 2024-05-08T18:08:28.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777815+0000", 2024-05-08T18:08:28.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6130000000000001e-06 2024-05-08T18:08:28.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777826+0000", 2024-05-08T18:08:28.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:08:28.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777852+0000", 2024-05-08T18:08:28.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6787999999999998e-05 2024-05-08T18:08:28.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777865+0000", 2024-05-08T18:08:28.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2882e-05 2024-05-08T18:08:28.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777961+0000", 2024-05-08T18:08:28.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5280999999999998e-05 2024-05-08T18:08:28.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.777993+0000", 2024-05-08T18:08:28.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1931999999999999e-05 2024-05-08T18:08:28.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779496+0000", 2024-05-08T18:08:28.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001503307 2024-05-08T18:08:28.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779576+0000", 2024-05-08T18:08:28.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9887000000000003e-05 2024-05-08T18:08:28.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.519 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.519 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:460 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'3, mlcod=32'1)", 2024-05-08T18:08:28.519 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:08:28.519 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.678775569999999, 2024-05-08T18:08:28.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032252579999999999, 2024-05-08T18:08:28.520 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.520 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.520 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.520 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:08:28.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779149+0000", 2024-05-08T18:08:28.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779150+0000", 2024-05-08T18:08:28.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:28.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779161+0000", 2024-05-08T18:08:28.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0906e-05 2024-05-08T18:08:28.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779186+0000", 2024-05-08T18:08:28.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4861000000000001e-05 2024-05-08T18:08:28.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779198+0000", 2024-05-08T18:08:28.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1969e-05 2024-05-08T18:08:28.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779334+0000", 2024-05-08T18:08:28.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000135513 2024-05-08T18:08:28.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.779396+0000", 2024-05-08T18:08:28.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2815000000000001e-05 2024-05-08T18:08:28.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.782247+0000", 2024-05-08T18:08:28.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028502200000000001 2024-05-08T18:08:28.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.782374+0000", 2024-05-08T18:08:28.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012726400000000001 2024-05-08T18:08:28.527 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.527 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.527 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.528 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:463 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-05-08T18:08:28.528 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:08:28.528 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.676429464999998, 2024-05-08T18:08:28.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0036423610000000002, 2024-05-08T18:08:28.528 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.528 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.528 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.529 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:08:28.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781495+0000", 2024-05-08T18:08:28.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781497+0000", 2024-05-08T18:08:28.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.917e-06 2024-05-08T18:08:28.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781509+0000", 2024-05-08T18:08:28.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2227e-05 2024-05-08T18:08:28.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781539+0000", 2024-05-08T18:08:28.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0218000000000001e-05 2024-05-08T18:08:28.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781558+0000", 2024-05-08T18:08:28.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8918000000000001e-05 2024-05-08T18:08:28.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781660+0000", 2024-05-08T18:08:28.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101584 2024-05-08T18:08:28.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.781697+0000", 2024-05-08T18:08:28.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7360000000000001e-05 2024-05-08T18:08:28.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785059+0000", 2024-05-08T18:08:28.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033618810000000002 2024-05-08T18:08:28.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785137+0000", 2024-05-08T18:08:28.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8256000000000004e-05 2024-05-08T18:08:28.532 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.533 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.533 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.533 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:466 6.1 e32/26 6:80b6fe23:reshard::reshard.0000000011:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:28.533 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:08:28.533 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.674309213000001, 2024-05-08T18:08:28.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002137496, 2024-05-08T18:08:28.533 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.533 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.533 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.533 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:08:28.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783615+0000", 2024-05-08T18:08:28.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783617+0000", 2024-05-08T18:08:28.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8330000000000001e-06 2024-05-08T18:08:28.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:08:28.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5872e-05 2024-05-08T18:08:28.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783668+0000", 2024-05-08T18:08:28.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5880999999999997e-05 2024-05-08T18:08:28.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783688+0000", 2024-05-08T18:08:28.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9485000000000001e-05 2024-05-08T18:08:28.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783819+0000", 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013098600000000001 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.783865+0000", 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5711000000000003e-05 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785680+0000", 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001815374 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.785752+0000", 2024-05-08T18:08:28.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2354000000000006e-05 2024-05-08T18:08:28.537 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.537 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.537 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.537 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:469 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'10, mlcod=32'8)", 2024-05-08T18:08:28.537 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:08:28.537 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.671018224000001, 2024-05-08T18:08:28.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002120242, 2024-05-08T18:08:28.537 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.537 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.537 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.538 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:08:28.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786906+0000", 2024-05-08T18:08:28.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786907+0000", 2024-05-08T18:08:28.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.412e-06 2024-05-08T18:08:28.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786917+0000", 2024-05-08T18:08:28.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3489999999999998e-06 2024-05-08T18:08:28.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786940+0000", 2024-05-08T18:08:28.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3019000000000001e-05 2024-05-08T18:08:28.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.786951+0000", 2024-05-08T18:08:28.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0956e-05 2024-05-08T18:08:28.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.787229+0000", 2024-05-08T18:08:28.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027875000000000003 2024-05-08T18:08:28.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.787263+0000", 2024-05-08T18:08:28.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3563999999999999e-05 2024-05-08T18:08:28.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.788886+0000", 2024-05-08T18:08:28.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016228320000000001 2024-05-08T18:08:28.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.789026+0000", 2024-05-08T18:08:28.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014035999999999999 2024-05-08T18:08:28.542 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.542 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.542 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.542 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:478 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'11, mlcod=32'9)", 2024-05-08T18:08:28.542 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:08:28.542 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.666906611000002, 2024-05-08T18:08:28.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037403340000000001, 2024-05-08T18:08:28.542 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.542 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:08:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791018+0000", 2024-05-08T18:08:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791019+0000", 2024-05-08T18:08:28.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5999999999999999e-06 2024-05-08T18:08:28.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791032+0000", 2024-05-08T18:08:28.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3021e-05 2024-05-08T18:08:28.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791057+0000", 2024-05-08T18:08:28.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4600000000000002e-05 2024-05-08T18:08:28.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791071+0000", 2024-05-08T18:08:28.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4756000000000001e-05 2024-05-08T18:08:28.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791185+0000", 2024-05-08T18:08:28.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011333200000000001 2024-05-08T18:08:28.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791234+0000", 2024-05-08T18:08:28.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8695e-05 2024-05-08T18:08:28.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794662+0000", 2024-05-08T18:08:28.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034282520000000001 2024-05-08T18:08:28.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794758+0000", 2024-05-08T18:08:28.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6077999999999997e-05 2024-05-08T18:08:28.546 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.546 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.546 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.546 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:829 6.5 e32/26 6:a77c5545:::obj_delete_at_hint.0000000084:head v 32'12, mlcod=32'10)", 2024-05-08T18:08:28.546 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:08:28.546 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.185737596999999, 2024-05-08T18:08:28.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017254, 2024-05-08T18:08:28.547 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.547 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.547 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.547 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:08:28.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272187+0000", 2024-05-08T18:08:28.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272188+0000", 2024-05-08T18:08:28.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7269999999999999e-06 2024-05-08T18:08:28.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272229+0000", 2024-05-08T18:08:28.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0256999999999998e-05 2024-05-08T18:08:28.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272261+0000", 2024-05-08T18:08:28.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2017000000000002e-05 2024-05-08T18:08:28.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272275+0000", 2024-05-08T18:08:28.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4532000000000001e-05 2024-05-08T18:08:28.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272437+0000", 2024-05-08T18:08:28.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016199699999999999 2024-05-08T18:08:28.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.272501+0000", 2024-05-08T18:08:28.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3805000000000003e-05 2024-05-08T18:08:28.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.273824+0000", 2024-05-08T18:08:28.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001323039 2024-05-08T18:08:28.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.273912+0000", 2024-05-08T18:08:28.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8026000000000001e-05 2024-05-08T18:08:28.550 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.550 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.550 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.551 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:937 6.1f e32/26 6:fd6b5df8:::obj_delete_at_hint.0000000120:head v 32'10, mlcod=32'8)", 2024-05-08T18:08:28.551 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:08:28.551 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.934501482000002, 2024-05-08T18:08:28.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019919009999999999, 2024-05-08T18:08:28.551 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.551 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.551 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.551 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:08:28.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523423+0000", 2024-05-08T18:08:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523425+0000", 2024-05-08T18:08:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8560000000000001e-06 2024-05-08T18:08:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523437+0000", 2024-05-08T18:08:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2833000000000001e-05 2024-05-08T18:08:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:28.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523464+0000", 2024-05-08T18:08:28.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6621000000000001e-05 2024-05-08T18:08:28.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:28.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523477+0000", 2024-05-08T18:08:28.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2758999999999999e-05 2024-05-08T18:08:28.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:28.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523612+0000", 2024-05-08T18:08:28.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013525899999999999 2024-05-08T18:08:28.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:28.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.523679+0000", 2024-05-08T18:08:28.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6964000000000005e-05 2024-05-08T18:08:28.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:28.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.525312+0000", 2024-05-08T18:08:28.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016331 2024-05-08T18:08:28.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:28.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.525415+0000", 2024-05-08T18:08:28.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000102509 2024-05-08T18:08:28.554 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.554 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.554 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.554 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:28.555 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:28.555 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:28.556 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:08:28.556 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:28.561+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:28.657 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:28.658+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:28.682 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:28.682 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:28.682 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:28.682 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:28.696 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:08:28.757 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:28.757+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:28.858 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:28.861+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:28.862 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:08:28.862 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:28.862 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:28.862 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:28.862 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:28.863 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:28.876 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:08:28.959 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:28.961+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:28.998 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:28.998 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:28.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:28.998 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:28.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.998 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:28.998 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:08:28.998 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.182101818000007, 2024-05-08T18:08:28.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.16213206199999999, 2024-05-08T18:08:28.998 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:28.999 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:28.999 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:28.999 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:28.999 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:28.999 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:28.999 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1 2024-05-08T18:08:28.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.999 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:28.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:28.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:08:28.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:28.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:28.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:28.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:08:29.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814494+0000", 2024-05-08T18:08:29.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:08:29.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814520+0000", 2024-05-08T18:08:29.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-05 2024-05-08T18:08:29.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814543+0000", 2024-05-08T18:08:29.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2353000000000001e-05 2024-05-08T18:08:29.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814563+0000", 2024-05-08T18:08:29.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.048e-05 2024-05-08T18:08:29.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814677+0000", 2024-05-08T18:08:29.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113632 2024-05-08T18:08:29.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:29.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814705+0000", 2024-05-08T18:08:29.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8626999999999999e-05 2024-05-08T18:08:29.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971115+0000", 2024-05-08T18:08:29.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.156409825 2024-05-08T18:08:29.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971438+0000", 2024-05-08T18:08:29.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00032289200000000002 2024-05-08T18:08:29.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971849+0000", 2024-05-08T18:08:29.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041139300000000002 2024-05-08T18:08:29.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.975364+0000", 2024-05-08T18:08:29.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035148390000000001 2024-05-08T18:08:29.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976474+0000", 2024-05-08T18:08:29.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001110099 2024-05-08T18:08:29.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976564+0000", 2024-05-08T18:08:29.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9522000000000001e-05 2024-05-08T18:08:29.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976624+0000", 2024-05-08T18:08:29.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9616e-05 2024-05-08T18:08:29.004 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.005 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.005 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.005 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.005 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:08:29.005 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.984152371999997, 2024-05-08T18:08:29.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010762776999999999, 2024-05-08T18:08:29.005 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.005 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.005 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.005 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.005 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.006 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.006 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 24 2024-05-08T18:08:29.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.006 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:08:29.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012441+0000", 2024-05-08T18:08:29.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012442+0000", 2024-05-08T18:08:29.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.4300000000000002e-07 2024-05-08T18:08:29.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012573+0000", 2024-05-08T18:08:29.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013108299999999999 2024-05-08T18:08:29.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012592+0000", 2024-05-08T18:08:29.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9009e-05 2024-05-08T18:08:29.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012610+0000", 2024-05-08T18:08:29.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.789e-05 2024-05-08T18:08:29.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019108+0000", 2024-05-08T18:08:29.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064981470000000001 2024-05-08T18:08:29.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019348+0000", 2024-05-08T18:08:29.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024006099999999999 2024-05-08T18:08:29.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.019751+0000", 2024-05-08T18:08:29.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040324099999999998 2024-05-08T18:08:29.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.022727+0000", 2024-05-08T18:08:29.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002976107 2024-05-08T18:08:29.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.022826+0000", 2024-05-08T18:08:29.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8626000000000001e-05 2024-05-08T18:08:29.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023036+0000", 2024-05-08T18:08:29.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000209578 2024-05-08T18:08:29.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023204+0000", 2024-05-08T18:08:29.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016819200000000001 2024-05-08T18:08:29.010 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.010 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.010 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.010 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.010 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:08:29.010 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.983965276999996, 2024-05-08T18:08:29.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011074977999999999, 2024-05-08T18:08:29.010 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.011 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.011 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.011 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.011 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.011 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.011 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 25 2024-05-08T18:08:29.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.011 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:08:29.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012628+0000", 2024-05-08T18:08:29.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012629+0000", 2024-05-08T18:08:29.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7700000000000004e-07 2024-05-08T18:08:29.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012636+0000", 2024-05-08T18:08:29.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-05-08T18:08:29.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012646+0000", 2024-05-08T18:08:29.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0147e-05 2024-05-08T18:08:29.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.012657+0000", 2024-05-08T18:08:29.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0473e-05 2024-05-08T18:08:29.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021198+0000", 2024-05-08T18:08:29.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0085417510000000002 2024-05-08T18:08:29.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021445+0000", 2024-05-08T18:08:29.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024665100000000002 2024-05-08T18:08:29.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.021820+0000", 2024-05-08T18:08:29.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037519400000000003 2024-05-08T18:08:29.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023231+0000", 2024-05-08T18:08:29.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001410412 2024-05-08T18:08:29.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023550+0000", 2024-05-08T18:08:29.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000319368 2024-05-08T18:08:29.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023632+0000", 2024-05-08T18:08:29.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2366000000000004e-05 2024-05-08T18:08:29.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.023703+0000", 2024-05-08T18:08:29.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0568999999999995e-05 2024-05-08T18:08:29.015 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.015 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.015 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.016 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.016 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:08:29.016 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.887619490000006, 2024-05-08T18:08:29.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011460965, 2024-05-08T18:08:29.016 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.016 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.016 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.016 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.016 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.016 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.016 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 45 2024-05-08T18:08:29.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.016 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:08:29.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108974+0000", 2024-05-08T18:08:29.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108975+0000", 2024-05-08T18:08:29.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:08:29.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.108983+0000", 2024-05-08T18:08:29.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6669999999999996e-06 2024-05-08T18:08:29.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109005+0000", 2024-05-08T18:08:29.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2787000000000001e-05 2024-05-08T18:08:29.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109020+0000", 2024-05-08T18:08:29.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4192999999999999e-05 2024-05-08T18:08:29.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116378+0000", 2024-05-08T18:08:29.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073585600000000001 2024-05-08T18:08:29.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116516+0000", 2024-05-08T18:08:29.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000137739 2024-05-08T18:08:29.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.116747+0000", 2024-05-08T18:08:29.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023132799999999999 2024-05-08T18:08:29.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120140+0000", 2024-05-08T18:08:29.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033931439999999998 2024-05-08T18:08:29.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120290+0000", 2024-05-08T18:08:29.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149765 2024-05-08T18:08:29.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120369+0000", 2024-05-08T18:08:29.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.907e-05 2024-05-08T18:08:29.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120435+0000", 2024-05-08T18:08:29.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5642999999999995e-05 2024-05-08T18:08:29.021 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.021 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.021 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.021 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.022 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:08:29.022 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.887555397, 2024-05-08T18:08:29.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013705973999999999, 2024-05-08T18:08:29.022 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.022 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.022 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.022 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.022 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.022 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.022 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:08:29.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.023 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:08:29.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109038+0000", 2024-05-08T18:08:29.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109039+0000", 2024-05-08T18:08:29.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:08:29.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109044+0000", 2024-05-08T18:08:29.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6699999999999999e-06 2024-05-08T18:08:29.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109054+0000", 2024-05-08T18:08:29.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7100000000000002e-06 2024-05-08T18:08:29.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109064+0000", 2024-05-08T18:08:29.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5740000000000002e-06 2024-05-08T18:08:29.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.117676+0000", 2024-05-08T18:08:29.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086126060000000001 2024-05-08T18:08:29.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.117828+0000", 2024-05-08T18:08:29.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151552 2024-05-08T18:08:29.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118041+0000", 2024-05-08T18:08:29.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000212692 2024-05-08T18:08:29.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120269+0000", 2024-05-08T18:08:29.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022281860000000001 2024-05-08T18:08:29.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122593+0000", 2024-05-08T18:08:29.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023239419999999998 2024-05-08T18:08:29.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122672+0000", 2024-05-08T18:08:29.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9579999999999994e-05 2024-05-08T18:08:29.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122744+0000", 2024-05-08T18:08:29.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1695999999999999e-05 2024-05-08T18:08:29.027 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.027 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.028 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.028 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.028 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:08:29.028 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.887511554, 2024-05-08T18:08:29.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016228664, 2024-05-08T18:08:29.028 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.028 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.028 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.028 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.028 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.028 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.028 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 47 2024-05-08T18:08:29.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.029 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:08:29.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109082+0000", 2024-05-08T18:08:29.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109083+0000", 2024-05-08T18:08:29.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4600000000000004e-07 2024-05-08T18:08:29.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109232+0000", 2024-05-08T18:08:29.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149782 2024-05-08T18:08:29.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109257+0000", 2024-05-08T18:08:29.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4856999999999999e-05 2024-05-08T18:08:29.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109272+0000", 2024-05-08T18:08:29.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.503e-05 2024-05-08T18:08:29.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118799+0000", 2024-05-08T18:08:29.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0095264400000000006 2024-05-08T18:08:29.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.118947+0000", 2024-05-08T18:08:29.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014848199999999999 2024-05-08T18:08:29.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.119151+0000", 2024-05-08T18:08:29.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020350500000000001 2024-05-08T18:08:29.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121458+0000", 2024-05-08T18:08:29.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002307749 2024-05-08T18:08:29.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125170+0000", 2024-05-08T18:08:29.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037113409999999999 2024-05-08T18:08:29.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125246+0000", 2024-05-08T18:08:29.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6029e-05 2024-05-08T18:08:29.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125310+0000", 2024-05-08T18:08:29.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4702999999999994e-05 2024-05-08T18:08:29.033 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.033 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.033 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.033 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.034 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:08:29.034 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.887292036000005, 2024-05-08T18:08:29.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016305097000000001, 2024-05-08T18:08:29.034 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.034 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.034 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.034 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.034 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.034 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.034 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 48 2024-05-08T18:08:29.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.034 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:08:29.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109301+0000", 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109303+0000", 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109332+0000", 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9220000000000001e-05 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109375+0000", 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2765999999999997e-05 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109394+0000", 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8603000000000001e-05 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120508+0000", 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011114811 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120663+0000", 2024-05-08T18:08:29.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000154332 2024-05-08T18:08:29.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.120863+0000", 2024-05-08T18:08:29.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019995599999999999 2024-05-08T18:08:29.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125326+0000", 2024-05-08T18:08:29.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044631180000000003 2024-05-08T18:08:29.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125431+0000", 2024-05-08T18:08:29.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010522900000000001 2024-05-08T18:08:29.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125541+0000", 2024-05-08T18:08:29.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109802 2024-05-08T18:08:29.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125606+0000", 2024-05-08T18:08:29.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5549999999999994e-05 2024-05-08T18:08:29.038 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.038 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.038 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.039 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.039 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:08:29.039 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.887171717000001, 2024-05-08T18:08:29.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016563135, 2024-05-08T18:08:29.039 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.039 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.039 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.039 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.039 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.039 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.039 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 49 2024-05-08T18:08:29.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.039 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109422+0000", 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109423+0000", 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5969999999999999e-06 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109434+0000", 2024-05-08T18:08:29.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.113e-05 2024-05-08T18:08:29.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109455+0000", 2024-05-08T18:08:29.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0873000000000002e-05 2024-05-08T18:08:29.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109469+0000", 2024-05-08T18:08:29.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4039999999999999e-05 2024-05-08T18:08:29.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121566+0000", 2024-05-08T18:08:29.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012096325999999999 2024-05-08T18:08:29.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121725+0000", 2024-05-08T18:08:29.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015932899999999999 2024-05-08T18:08:29.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.121981+0000", 2024-05-08T18:08:29.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025583799999999999 2024-05-08T18:08:29.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125680+0000", 2024-05-08T18:08:29.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0036995579999999999 2024-05-08T18:08:29.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125838+0000", 2024-05-08T18:08:29.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015731499999999999 2024-05-08T18:08:29.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125914+0000", 2024-05-08T18:08:29.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6686000000000004e-05 2024-05-08T18:08:29.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125985+0000", 2024-05-08T18:08:29.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0443000000000003e-05 2024-05-08T18:08:29.044 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.044 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.044 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.044 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.044 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:08:29.044 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.887099337999999, 2024-05-08T18:08:29.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016620291999999998, 2024-05-08T18:08:29.044 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.044 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.044 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.045 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.045 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.045 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.045 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 50 2024-05-08T18:08:29.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.045 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:08:29.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109494+0000", 2024-05-08T18:08:29.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109495+0000", 2024-05-08T18:08:29.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.477e-06 2024-05-08T18:08:29.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109692+0000", 2024-05-08T18:08:29.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019638199999999999 2024-05-08T18:08:29.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109733+0000", 2024-05-08T18:08:29.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1093000000000001e-05 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109745+0000", 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1715999999999999e-05 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122839+0000", 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013094809000000001 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.122980+0000", 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140829 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.123239+0000", 2024-05-08T18:08:29.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025834799999999999 2024-05-08T18:08:29.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.125810+0000", 2024-05-08T18:08:29.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025717729999999999 2024-05-08T18:08:29.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126001+0000", 2024-05-08T18:08:29.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019013600000000001 2024-05-08T18:08:29.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126064+0000", 2024-05-08T18:08:29.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3301999999999998e-05 2024-05-08T18:08:29.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126114+0000", 2024-05-08T18:08:29.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0426999999999997e-05 2024-05-08T18:08:29.049 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.049 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.049 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.049 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.049 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:08:29.049 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.886820189999995, 2024-05-08T18:08:29.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018305669, 2024-05-08T18:08:29.050 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.050 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.050 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.050 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.050 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.050 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.050 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 51 2024-05-08T18:08:29.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.050 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:08:29.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109773+0000", 2024-05-08T18:08:29.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109775+0000", 2024-05-08T18:08:29.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5269999999999999e-06 2024-05-08T18:08:29.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109786+0000", 2024-05-08T18:08:29.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1296e-05 2024-05-08T18:08:29.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109806+0000", 2024-05-08T18:08:29.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0114000000000001e-05 2024-05-08T18:08:29.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109823+0000", 2024-05-08T18:08:29.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6665999999999999e-05 2024-05-08T18:08:29.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124193+0000", 2024-05-08T18:08:29.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014369916 2024-05-08T18:08:29.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124354+0000", 2024-05-08T18:08:29.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016167899999999999 2024-05-08T18:08:29.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.124571+0000", 2024-05-08T18:08:29.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021652800000000001 2024-05-08T18:08:29.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126978+0000", 2024-05-08T18:08:29.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024071679999999999 2024-05-08T18:08:29.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127921+0000", 2024-05-08T18:08:29.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00094277599999999999 2024-05-08T18:08:29.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.128012+0000", 2024-05-08T18:08:29.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0818999999999999e-05 2024-05-08T18:08:29.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.128079+0000", 2024-05-08T18:08:29.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7180000000000004e-05 2024-05-08T18:08:29.054 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.054 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.054 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.886745083999998, 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021440811000000001, 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 52 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:08:29.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:08:29.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109849+0000", 2024-05-08T18:08:29.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1370000000000001e-06 2024-05-08T18:08:29.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109861+0000", 2024-05-08T18:08:29.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1559999999999999e-05 2024-05-08T18:08:29.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109878+0000", 2024-05-08T18:08:29.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7105999999999999e-05 2024-05-08T18:08:29.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109892+0000", 2024-05-08T18:08:29.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3577000000000001e-05 2024-05-08T18:08:29.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126161+0000", 2024-05-08T18:08:29.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016269458000000001 2024-05-08T18:08:29.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126299+0000", 2024-05-08T18:08:29.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138405 2024-05-08T18:08:29.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126534+0000", 2024-05-08T18:08:29.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000234875 2024-05-08T18:08:29.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127543+0000", 2024-05-08T18:08:29.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001008852 2024-05-08T18:08:29.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131128+0000", 2024-05-08T18:08:29.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035844359999999999 2024-05-08T18:08:29.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131222+0000", 2024-05-08T18:08:29.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3905000000000003e-05 2024-05-08T18:08:29.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131289+0000", 2024-05-08T18:08:29.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7500000000000001e-05 2024-05-08T18:08:29.059 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.059 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.059 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.060 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.060 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:08:29.060 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.646459385, 2024-05-08T18:08:29.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010652125, 2024-05-08T18:08:29.060 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.060 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.060 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.060 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.060 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.060 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.061 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 67 2024-05-08T18:08:29.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.061 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:08:29.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350134+0000", 2024-05-08T18:08:29.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350135+0000", 2024-05-08T18:08:29.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.083e-06 2024-05-08T18:08:29.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350141+0000", 2024-05-08T18:08:29.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.178e-06 2024-05-08T18:08:29.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350152+0000", 2024-05-08T18:08:29.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0706999999999999e-05 2024-05-08T18:08:29.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350159+0000", 2024-05-08T18:08:29.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3640000000000001e-06 2024-05-08T18:08:29.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352606+0000", 2024-05-08T18:08:29.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024470379999999999 2024-05-08T18:08:29.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352718+0000", 2024-05-08T18:08:29.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000111366 2024-05-08T18:08:29.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.352887+0000", 2024-05-08T18:08:29.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016887900000000001 2024-05-08T18:08:29.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358041+0000", 2024-05-08T18:08:29.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051542940000000002 2024-05-08T18:08:29.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360681+0000", 2024-05-08T18:08:29.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026404639999999999 2024-05-08T18:08:29.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360726+0000", 2024-05-08T18:08:29.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4666999999999998e-05 2024-05-08T18:08:29.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360786+0000", 2024-05-08T18:08:29.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0084999999999998e-05 2024-05-08T18:08:29.065 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.065 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.065 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.065 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.066 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:08:29.066 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.646203997000001, 2024-05-08T18:08:29.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010500438000000001, 2024-05-08T18:08:29.066 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.066 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.066 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.066 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.066 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.066 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.066 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 68 2024-05-08T18:08:29.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.066 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:08:29.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350389+0000", 2024-05-08T18:08:29.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350391+0000", 2024-05-08T18:08:29.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:08:29.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350398+0000", 2024-05-08T18:08:29.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6599999999999995e-06 2024-05-08T18:08:29.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350414+0000", 2024-05-08T18:08:29.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6101000000000001e-05 2024-05-08T18:08:29.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350425+0000", 2024-05-08T18:08:29.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.099e-05 2024-05-08T18:08:29.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353737+0000", 2024-05-08T18:08:29.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033112739999999999 2024-05-08T18:08:29.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353810+0000", 2024-05-08T18:08:29.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3337999999999995e-05 2024-05-08T18:08:29.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.353922+0000", 2024-05-08T18:08:29.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112409 2024-05-08T18:08:29.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358114+0000", 2024-05-08T18:08:29.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041912909999999998 2024-05-08T18:08:29.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360798+0000", 2024-05-08T18:08:29.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026845850000000002 2024-05-08T18:08:29.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360838+0000", 2024-05-08T18:08:29.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9619999999999997e-05 2024-05-08T18:08:29.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.360890+0000", 2024-05-08T18:08:29.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.185e-05 2024-05-08T18:08:29.070 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.071 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.071 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.071 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.071 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:08:29.071 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.645827776999994, 2024-05-08T18:08:29.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010508969999999999, 2024-05-08T18:08:29.071 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.071 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.071 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.071 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.071 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.071 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.071 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 71 2024-05-08T18:08:29.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.072 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:08:29.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:08:29.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350766+0000", 2024-05-08T18:08:29.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.61e-07 2024-05-08T18:08:29.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350771+0000", 2024-05-08T18:08:29.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6720000000000003e-06 2024-05-08T18:08:29.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350781+0000", 2024-05-08T18:08:29.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9450000000000005e-06 2024-05-08T18:08:29.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350786+0000", 2024-05-08T18:08:29.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2530000000000004e-06 2024-05-08T18:08:29.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356065+0000", 2024-05-08T18:08:29.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052789239999999999 2024-05-08T18:08:29.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356174+0000", 2024-05-08T18:08:29.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108564 2024-05-08T18:08:29.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356336+0000", 2024-05-08T18:08:29.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162566 2024-05-08T18:08:29.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358285+0000", 2024-05-08T18:08:29.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001948443 2024-05-08T18:08:29.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361124+0000", 2024-05-08T18:08:29.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028390120000000001 2024-05-08T18:08:29.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361217+0000", 2024-05-08T18:08:29.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3899000000000003e-05 2024-05-08T18:08:29.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361275+0000", 2024-05-08T18:08:29.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7031000000000003e-05 2024-05-08T18:08:29.076 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.076 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.076 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.076 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.076 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:08:29.076 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.645750305000007, 2024-05-08T18:08:29.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010535020000000001, 2024-05-08T18:08:29.076 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.076 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.077 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.077 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.077 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.077 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.077 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 72 2024-05-08T18:08:29.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.077 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:08:29.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350843+0000", 2024-05-08T18:08:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350844+0000", 2024-05-08T18:08:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:08:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350957+0000", 2024-05-08T18:08:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112958 2024-05-08T18:08:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350966+0000", 2024-05-08T18:08:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3440000000000007e-06 2024-05-08T18:08:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350972+0000", 2024-05-08T18:08:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.37e-06 2024-05-08T18:08:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356777+0000", 2024-05-08T18:08:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058049199999999999 2024-05-08T18:08:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356852+0000", 2024-05-08T18:08:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5109000000000002e-05 2024-05-08T18:08:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.356961+0000", 2024-05-08T18:08:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108818 2024-05-08T18:08:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359695+0000", 2024-05-08T18:08:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002733685 2024-05-08T18:08:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361284+0000", 2024-05-08T18:08:29.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015888740000000001 2024-05-08T18:08:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361323+0000", 2024-05-08T18:08:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9824999999999999e-05 2024-05-08T18:08:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361378+0000", 2024-05-08T18:08:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4593999999999999e-05 2024-05-08T18:08:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:08:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.645610503, 2024-05-08T18:08:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01225805, 2024-05-08T18:08:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 73 2024-05-08T18:08:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.082 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:08:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:08:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350983+0000", 2024-05-08T18:08:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0999999999999999e-07 2024-05-08T18:08:29.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350987+0000", 2024-05-08T18:08:29.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3529999999999999e-06 2024-05-08T18:08:29.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350994+0000", 2024-05-08T18:08:29.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0840000000000003e-06 2024-05-08T18:08:29.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.350998+0000", 2024-05-08T18:08:29.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.194e-06 2024-05-08T18:08:29.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358336+0000", 2024-05-08T18:08:29.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073376070000000003 2024-05-08T18:08:29.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358456+0000", 2024-05-08T18:08:29.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012042199999999999 2024-05-08T18:08:29.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.358615+0000", 2024-05-08T18:08:29.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015928399999999999 2024-05-08T18:08:29.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.362117+0000", 2024-05-08T18:08:29.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035021039999999998 2024-05-08T18:08:29.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363139+0000", 2024-05-08T18:08:29.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010220349999999999 2024-05-08T18:08:29.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363181+0000", 2024-05-08T18:08:29.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1465999999999999e-05 2024-05-08T18:08:29.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363241+0000", 2024-05-08T18:08:29.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9991000000000002e-05 2024-05-08T18:08:29.087 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.087 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.087 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.087 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.087 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:08:29.087 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.645585686000004, 2024-05-08T18:08:29.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012698229, 2024-05-08T18:08:29.087 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.087 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.088 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.088 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.088 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.088 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.088 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 74 2024-05-08T18:08:29.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.088 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:08:29.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:08:29.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351008+0000", 2024-05-08T18:08:29.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4000000000000002e-07 2024-05-08T18:08:29.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351013+0000", 2024-05-08T18:08:29.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8239999999999999e-06 2024-05-08T18:08:29.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351020+0000", 2024-05-08T18:08:29.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.52e-06 2024-05-08T18:08:29.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351025+0000", 2024-05-08T18:08:29.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3499999999999999e-06 2024-05-08T18:08:29.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359063+0000", 2024-05-08T18:08:29.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0080381800000000007 2024-05-08T18:08:29.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359140+0000", 2024-05-08T18:08:29.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7225999999999995e-05 2024-05-08T18:08:29.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359256+0000", 2024-05-08T18:08:29.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011537899999999999 2024-05-08T18:08:29.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363249+0000", 2024-05-08T18:08:29.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039937089999999998 2024-05-08T18:08:29.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363584+0000", 2024-05-08T18:08:29.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033516500000000001 2024-05-08T18:08:29.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363654+0000", 2024-05-08T18:08:29.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9093999999999999e-05 2024-05-08T18:08:29.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363706+0000", 2024-05-08T18:08:29.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2342000000000001e-05 2024-05-08T18:08:29.092 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.092 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.092 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.092 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.092 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:08:29.093 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.645547425999993, 2024-05-08T18:08:29.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015677229000000001, 2024-05-08T18:08:29.093 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.093 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.093 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.093 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.093 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.093 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.093 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 75 2024-05-08T18:08:29.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.093 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:08:29.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:08:29.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351046+0000", 2024-05-08T18:08:29.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1699999999999999e-07 2024-05-08T18:08:29.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351141+0000", 2024-05-08T18:08:29.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4661999999999996e-05 2024-05-08T18:08:29.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351151+0000", 2024-05-08T18:08:29.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0084e-05 2024-05-08T18:08:29.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351160+0000", 2024-05-08T18:08:29.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2490000000000007e-06 2024-05-08T18:08:29.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359748+0000", 2024-05-08T18:08:29.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0085879849999999994 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359820+0000", 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2081000000000003e-05 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.359928+0000", 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107157 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363254+0000", 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033268579999999998 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366611+0000", 2024-05-08T18:08:29.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033564179999999999 2024-05-08T18:08:29.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366672+0000", 2024-05-08T18:08:29.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0714999999999997e-05 2024-05-08T18:08:29.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366723+0000", 2024-05-08T18:08:29.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1603e-05 2024-05-08T18:08:29.097 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.097 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.098 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.098 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.098 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:08:29.098 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.645422925999995, 2024-05-08T18:08:29.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015696418, 2024-05-08T18:08:29.098 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.098 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.098 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.098 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.098 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.098 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.099 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 76 2024-05-08T18:08:29.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.099 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:08:29.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351170+0000", 2024-05-08T18:08:29.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351171+0000", 2024-05-08T18:08:29.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4600000000000004e-07 2024-05-08T18:08:29.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351174+0000", 2024-05-08T18:08:29.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2030000000000001e-06 2024-05-08T18:08:29.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351179+0000", 2024-05-08T18:08:29.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2079999999999999e-06 2024-05-08T18:08:29.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.351184+0000", 2024-05-08T18:08:29.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3120000000000004e-06 2024-05-08T18:08:29.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361430+0000", 2024-05-08T18:08:29.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010246175 2024-05-08T18:08:29.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361545+0000", 2024-05-08T18:08:29.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115139 2024-05-08T18:08:29.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.361712+0000", 2024-05-08T18:08:29.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000166491 2024-05-08T18:08:29.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.363473+0000", 2024-05-08T18:08:29.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017610799999999999 2024-05-08T18:08:29.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366769+0000", 2024-05-08T18:08:29.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032964880000000002 2024-05-08T18:08:29.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366811+0000", 2024-05-08T18:08:29.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2296000000000003e-05 2024-05-08T18:08:29.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.366867+0000", 2024-05-08T18:08:29.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5380000000000002e-05 2024-05-08T18:08:29.103 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.103 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.103 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.294494956999998, 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010497067000000001, 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 94 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:29.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702098+0000", 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702099+0000", 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4099999999999999e-07 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702102+0000", 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6650000000000001e-06 2024-05-08T18:08:29.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:29.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702108+0000", 2024-05-08T18:08:29.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.711e-06 2024-05-08T18:08:29.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.702114+0000", 2024-05-08T18:08:29.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.241e-06 2024-05-08T18:08:29.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:29.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.708666+0000", 2024-05-08T18:08:29.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065511459999999999 2024-05-08T18:08:29.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:29.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.708833+0000", 2024-05-08T18:08:29.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000166966 2024-05-08T18:08:29.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:29.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.709171+0000", 2024-05-08T18:08:29.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033834000000000002 2024-05-08T18:08:29.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:29.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.710246+0000", 2024-05-08T18:08:29.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001074642 2024-05-08T18:08:29.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712422+0000", 2024-05-08T18:08:29.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021762370000000001 2024-05-08T18:08:29.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:29.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712521+0000", 2024-05-08T18:08:29.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9432999999999995e-05 2024-05-08T18:08:29.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:29.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:29.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:29.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.712595+0000", 2024-05-08T18:08:29.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4245000000000005e-05 2024-05-08T18:08:29.108 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.109 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.109 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.109 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:29.109 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:29.109 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:29.110 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:08:29.111 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:29.113+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:29.211 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:29.210+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:29.239 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:29.239 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:29.253 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:08:29.312 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:29.314+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:29.366 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:29.366 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:29.366 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:29.366 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:29.366 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:29.379 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:08:29.422 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:29.425+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:29.510 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:29.510 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:29.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:29.510 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:29.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.510 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:52 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'31)", 2024-05-08T18:08:29.510 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:08:29.510 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.386331154000004, 2024-05-08T18:08:29.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00409947, 2024-05-08T18:08:29.510 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.511 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.511 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.511 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:08:29.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:08:29.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127167+0000", 2024-05-08T18:08:29.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7800000000000001e-07 2024-05-08T18:08:29.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127172+0000", 2024-05-08T18:08:29.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1120000000000004e-06 2024-05-08T18:08:29.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127183+0000", 2024-05-08T18:08:29.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1107000000000001e-05 2024-05-08T18:08:29.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127189+0000", 2024-05-08T18:08:29.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0310000000000004e-06 2024-05-08T18:08:29.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127237+0000", 2024-05-08T18:08:29.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7907000000000001e-05 2024-05-08T18:08:29.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127252+0000", 2024-05-08T18:08:29.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5373e-05 2024-05-08T18:08:29.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131206+0000", 2024-05-08T18:08:29.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039540199999999999 2024-05-08T18:08:29.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131265+0000", 2024-05-08T18:08:29.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9141999999999997e-05 2024-05-08T18:08:29.514 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.514 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.514 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.515 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-05-08T18:08:29.515 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:08:29.515 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.377572749999999, 2024-05-08T18:08:29.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049265589999999996, 2024-05-08T18:08:29.515 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.515 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.515 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.515 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:08:29.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:08:29.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135925+0000", 2024-05-08T18:08:29.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8100000000000002e-07 2024-05-08T18:08:29.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136007+0000", 2024-05-08T18:08:29.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1864000000000001e-05 2024-05-08T18:08:29.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136019+0000", 2024-05-08T18:08:29.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2438e-05 2024-05-08T18:08:29.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136026+0000", 2024-05-08T18:08:29.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0809999999999996e-06 2024-05-08T18:08:29.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136093+0000", 2024-05-08T18:08:29.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6769999999999999e-05 2024-05-08T18:08:29.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136108+0000", 2024-05-08T18:08:29.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.465e-05 2024-05-08T18:08:29.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140800+0000", 2024-05-08T18:08:29.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046919450000000003 2024-05-08T18:08:29.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140851+0000", 2024-05-08T18:08:29.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.113e-05 2024-05-08T18:08:29.519 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.519 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.519 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.519 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-05-08T18:08:29.519 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:08:29.519 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.161087539999997, 2024-05-08T18:08:29.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042257299999999996, 2024-05-08T18:08:29.519 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.519 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.519 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.519 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:08:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:08:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352410+0000", 2024-05-08T18:08:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7599999999999997e-07 2024-05-08T18:08:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352489+0000", 2024-05-08T18:08:29.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8564000000000002e-05 2024-05-08T18:08:29.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352500+0000", 2024-05-08T18:08:29.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1411e-05 2024-05-08T18:08:29.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352506+0000", 2024-05-08T18:08:29.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7309999999999998e-06 2024-05-08T18:08:29.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352569+0000", 2024-05-08T18:08:29.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3173e-05 2024-05-08T18:08:29.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352598+0000", 2024-05-08T18:08:29.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8855000000000001e-05 2024-05-08T18:08:29.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356592+0000", 2024-05-08T18:08:29.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039941539999999998 2024-05-08T18:08:29.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356635+0000", 2024-05-08T18:08:29.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3166e-05 2024-05-08T18:08:29.523 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.523 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.523 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.523 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:75 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'53, mlcod=15'43)", 2024-05-08T18:08:29.523 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:08:29.524 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.152916122999997, 2024-05-08T18:08:29.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063708030000000004, 2024-05-08T18:08:29.524 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.524 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.524 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.524 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:08:29.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:08:29.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:08:29.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:08:29.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360641+0000", 2024-05-08T18:08:29.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9273e-05 2024-05-08T18:08:29.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360651+0000", 2024-05-08T18:08:29.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0353000000000001e-05 2024-05-08T18:08:29.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360659+0000", 2024-05-08T18:08:29.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4789999999999999e-06 2024-05-08T18:08:29.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360720+0000", 2024-05-08T18:08:29.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699000000000007e-05 2024-05-08T18:08:29.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360739+0000", 2024-05-08T18:08:29.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8913999999999999e-05 2024-05-08T18:08:29.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366883+0000", 2024-05-08T18:08:29.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061438229999999996 2024-05-08T18:08:29.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366952+0000", 2024-05-08T18:08:29.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8677000000000007e-05 2024-05-08T18:08:29.527 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.527 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.527 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.528 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:76 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'54, mlcod=15'49)", 2024-05-08T18:08:29.528 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:08:29.528 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.151179618, 2024-05-08T18:08:29.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046550610000000003, 2024-05-08T18:08:29.528 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.528 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.528 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.528 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:08:29.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:08:29.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362318+0000", 2024-05-08T18:08:29.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.99e-07 2024-05-08T18:08:29.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362323+0000", 2024-05-08T18:08:29.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.566e-06 2024-05-08T18:08:29.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362334+0000", 2024-05-08T18:08:29.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1403000000000001e-05 2024-05-08T18:08:29.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362342+0000", 2024-05-08T18:08:29.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3420000000000008e-06 2024-05-08T18:08:29.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362396+0000", 2024-05-08T18:08:29.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3476000000000001e-05 2024-05-08T18:08:29.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362415+0000", 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8787000000000002e-05 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366954+0000", 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045388609999999999 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366972+0000", 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8927e-05 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.531 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.532 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:79 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'57, mlcod=15'53)", 2024-05-08T18:08:29.532 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:08:29.532 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.143783690000006, 2024-05-08T18:08:29.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045322499999999998, 2024-05-08T18:08:29.532 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.532 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.532 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.532 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369714+0000", 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369787+0000", 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3317000000000003e-05 2024-05-08T18:08:29.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369797+0000", 2024-05-08T18:08:29.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9510000000000001e-06 2024-05-08T18:08:29.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369802+0000", 2024-05-08T18:08:29.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8210000000000001e-06 2024-05-08T18:08:29.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369854+0000", 2024-05-08T18:08:29.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1751e-05 2024-05-08T18:08:29.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369880+0000", 2024-05-08T18:08:29.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6577999999999999e-05 2024-05-08T18:08:29.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374202+0000", 2024-05-08T18:08:29.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217029999999997 2024-05-08T18:08:29.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374246+0000", 2024-05-08T18:08:29.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3544000000000002e-05 2024-05-08T18:08:29.536 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.536 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.536 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.536 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:89 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'63, mlcod=15'60)", 2024-05-08T18:08:29.536 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:08:29.536 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.810241524999995, 2024-05-08T18:08:29.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057729900000000004, 2024-05-08T18:08:29.536 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.536 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.536 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.536 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:08:29.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:08:29.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:08:29.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:08:29.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703261+0000", 2024-05-08T18:08:29.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2569999999999998e-06 2024-05-08T18:08:29.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703272+0000", 2024-05-08T18:08:29.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0739e-05 2024-05-08T18:08:29.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703282+0000", 2024-05-08T18:08:29.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6250000000000002e-06 2024-05-08T18:08:29.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703333+0000", 2024-05-08T18:08:29.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1588000000000001e-05 2024-05-08T18:08:29.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703358+0000", 2024-05-08T18:08:29.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4913999999999999e-05 2024-05-08T18:08:29.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708907+0000", 2024-05-08T18:08:29.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055484829999999999 2024-05-08T18:08:29.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.709028+0000", 2024-05-08T18:08:29.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121667 2024-05-08T18:08:29.540 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.540 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.540 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.541 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-05-08T18:08:29.541 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:08:29.541 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.809176007999994, 2024-05-08T18:08:29.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0074185579999999996, 2024-05-08T18:08:29.541 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.541 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.541 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.541 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:08:29.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:08:29.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704322+0000", 2024-05-08T18:08:29.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8299999999999997e-07 2024-05-08T18:08:29.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704410+0000", 2024-05-08T18:08:29.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8552000000000002e-05 2024-05-08T18:08:29.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704421+0000", 2024-05-08T18:08:29.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0794e-05 2024-05-08T18:08:29.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704427+0000", 2024-05-08T18:08:29.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8699999999999997e-06 2024-05-08T18:08:29.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704481+0000", 2024-05-08T18:08:29.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4410999999999998e-05 2024-05-08T18:08:29.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704511+0000", 2024-05-08T18:08:29.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9906000000000001e-05 2024-05-08T18:08:29.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711682+0000", 2024-05-08T18:08:29.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071710209999999996 2024-05-08T18:08:29.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711740+0000", 2024-05-08T18:08:29.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7521e-05 2024-05-08T18:08:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:91 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'65, mlcod=15'60)", 2024-05-08T18:08:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:08:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.807631814999993, 2024-05-08T18:08:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059345600000000002, 2024-05-08T18:08:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:08:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:08:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705866+0000", 2024-05-08T18:08:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0900000000000001e-07 2024-05-08T18:08:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705872+0000", 2024-05-08T18:08:29.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0580000000000003e-06 2024-05-08T18:08:29.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705883+0000", 2024-05-08T18:08:29.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0986e-05 2024-05-08T18:08:29.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705889+0000", 2024-05-08T18:08:29.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6400000000000002e-06 2024-05-08T18:08:29.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705942+0000", 2024-05-08T18:08:29.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3726e-05 2024-05-08T18:08:29.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705963+0000", 2024-05-08T18:08:29.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0713e-05 2024-05-08T18:08:29.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711744+0000", 2024-05-08T18:08:29.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057812669999999997 2024-05-08T18:08:29.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711800+0000", 2024-05-08T18:08:29.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5461000000000003e-05 2024-05-08T18:08:29.549 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.549 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.549 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.549 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:92 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'66, mlcod=15'61)", 2024-05-08T18:08:29.549 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:08:29.549 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.806307466999996, 2024-05-08T18:08:29.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046553640000000004, 2024-05-08T18:08:29.549 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.549 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.549 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.549 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:08:29.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:08:29.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707191+0000", 2024-05-08T18:08:29.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9300000000000006e-07 2024-05-08T18:08:29.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707198+0000", 2024-05-08T18:08:29.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4669999999999998e-06 2024-05-08T18:08:29.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707214+0000", 2024-05-08T18:08:29.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5911000000000001e-05 2024-05-08T18:08:29.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707221+0000", 2024-05-08T18:08:29.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.43e-06 2024-05-08T18:08:29.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707283+0000", 2024-05-08T18:08:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1974e-05 2024-05-08T18:08:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707308+0000", 2024-05-08T18:08:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4589000000000001e-05 2024-05-08T18:08:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711802+0000", 2024-05-08T18:08:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044944939999999999 2024-05-08T18:08:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711845+0000", 2024-05-08T18:08:29.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2506000000000003e-05 2024-05-08T18:08:29.553 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.553 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.553 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.553 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:93 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'67, mlcod=15'61)", 2024-05-08T18:08:29.553 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:08:29.553 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.805477210000006, 2024-05-08T18:08:29.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217760000000003, 2024-05-08T18:08:29.553 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.553 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.553 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.553 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708021+0000", 2024-05-08T18:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.92e-07 2024-05-08T18:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708106+0000", 2024-05-08T18:08:29.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5400000000000002e-05 2024-05-08T18:08:29.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708116+0000", 2024-05-08T18:08:29.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0482000000000001e-05 2024-05-08T18:08:29.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708124+0000", 2024-05-08T18:08:29.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5349999999999999e-06 2024-05-08T18:08:29.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708182+0000", 2024-05-08T18:08:29.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8130000000000001e-05 2024-05-08T18:08:29.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708203+0000", 2024-05-08T18:08:29.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1118e-05 2024-05-08T18:08:29.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712298+0000", 2024-05-08T18:08:29.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004094688 2024-05-08T18:08:29.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712342+0000", 2024-05-08T18:08:29.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3730999999999999e-05 2024-05-08T18:08:29.557 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.557 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.557 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.557 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:29.557 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:08:29.557 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 62.909051144000003, 2024-05-08T18:08:29.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087837890000000002, 2024-05-08T18:08:29.557 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.557 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.557 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.558 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:29.558 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:29.558 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:29.558 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210 2024-05-08T18:08:29.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.558 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:08:29.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:08:29.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604448+0000", 2024-05-08T18:08:29.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4229999999999999e-06 2024-05-08T18:08:29.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604460+0000", 2024-05-08T18:08:29.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:08:29.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604491+0000", 2024-05-08T18:08:29.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1004000000000003e-05 2024-05-08T18:08:29.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604513+0000", 2024-05-08T18:08:29.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1886e-05 2024-05-08T18:08:29.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604670+0000", 2024-05-08T18:08:29.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000156735 2024-05-08T18:08:29.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:08:29.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604680+0000", 2024-05-08T18:08:29.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0113e-05 2024-05-08T18:08:29.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609236+0000", 2024-05-08T18:08:29.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045557269999999999 2024-05-08T18:08:29.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609544+0000", 2024-05-08T18:08:29.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030863800000000002 2024-05-08T18:08:29.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:29.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.610952+0000", 2024-05-08T18:08:29.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014077269999999999 2024-05-08T18:08:29.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:29.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.612639+0000", 2024-05-08T18:08:29.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001686398 2024-05-08T18:08:29.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613101+0000", 2024-05-08T18:08:29.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00046249600000000001 2024-05-08T18:08:29.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613176+0000", 2024-05-08T18:08:29.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5032999999999998e-05 2024-05-08T18:08:29.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613230+0000", 2024-05-08T18:08:29.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3638999999999999e-05 2024-05-08T18:08:29.564 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.565 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.565 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.565 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:29.565 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:08:29.565 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 62.860462933999997, 2024-05-08T18:08:29.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046602199999999996, 2024-05-08T18:08:29.565 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.565 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.565 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.565 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:29.565 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:29.565 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:29.565 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 222 2024-05-08T18:08:29.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.566 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:08:29.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:08:29.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653037+0000", 2024-05-08T18:08:29.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:08:29.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653048+0000", 2024-05-08T18:08:29.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:08:29.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653077+0000", 2024-05-08T18:08:29.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9326e-05 2024-05-08T18:08:29.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653098+0000", 2024-05-08T18:08:29.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1327000000000001e-05 2024-05-08T18:08:29.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653230+0000", 2024-05-08T18:08:29.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013206599999999999 2024-05-08T18:08:29.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653444+0000", 2024-05-08T18:08:29.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000213401 2024-05-08T18:08:29.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:29.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653852+0000", 2024-05-08T18:08:29.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040808700000000001 2024-05-08T18:08:29.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.656108+0000", 2024-05-08T18:08:29.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022565739999999999 2024-05-08T18:08:29.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:29.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657533+0000", 2024-05-08T18:08:29.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014241799999999999 2024-05-08T18:08:29.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657629+0000", 2024-05-08T18:08:29.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6435999999999996e-05 2024-05-08T18:08:29.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657694+0000", 2024-05-08T18:08:29.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5349000000000001e-05 2024-05-08T18:08:29.570 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.570 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.570 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.570 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:461 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:29.570 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:08:29.570 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 62.733841128000002, 2024-05-08T18:08:29.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040933549999999999, 2024-05-08T18:08:29.570 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.571 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.571 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.571 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:29.571 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:29.571 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:29.571 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 461 2024-05-08T18:08:29.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.571 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:08:29.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:08:29.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779657+0000", 2024-05-08T18:08:29.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.252e-06 2024-05-08T18:08:29.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779663+0000", 2024-05-08T18:08:29.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0170000000000002e-06 2024-05-08T18:08:29.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779676+0000", 2024-05-08T18:08:29.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.296e-05 2024-05-08T18:08:29.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779684+0000", 2024-05-08T18:08:29.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4209999999999998e-06 2024-05-08T18:08:29.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779736+0000", 2024-05-08T18:08:29.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2296999999999998e-05 2024-05-08T18:08:29.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779787+0000", 2024-05-08T18:08:29.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0954e-05 2024-05-08T18:08:29.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:29.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779897+0000", 2024-05-08T18:08:29.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011001999999999999 2024-05-08T18:08:29.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:29.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780506+0000", 2024-05-08T18:08:29.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060872599999999997 2024-05-08T18:08:29.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783690+0000", 2024-05-08T18:08:29.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031847210000000002 2024-05-08T18:08:29.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783722+0000", 2024-05-08T18:08:29.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1608e-05 2024-05-08T18:08:29.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783749+0000", 2024-05-08T18:08:29.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7379e-05 2024-05-08T18:08:29.576 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.576 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.576 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.576 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:491 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:29.576 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:08:29.576 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 62.711577519999999, 2024-05-08T18:08:29.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059507570000000001, 2024-05-08T18:08:29.576 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.576 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.576 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.576 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:29.576 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:29.577 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:29.577 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 491 2024-05-08T18:08:29.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.577 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:08:29.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:08:29.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801921+0000", 2024-05-08T18:08:29.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6959999999999999e-06 2024-05-08T18:08:29.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801928+0000", 2024-05-08T18:08:29.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0299999999999996e-06 2024-05-08T18:08:29.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801944+0000", 2024-05-08T18:08:29.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285e-05 2024-05-08T18:08:29.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801953+0000", 2024-05-08T18:08:29.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1849999999999993e-06 2024-05-08T18:08:29.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802008+0000", 2024-05-08T18:08:29.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5379e-05 2024-05-08T18:08:29.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802093+0000", 2024-05-08T18:08:29.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4907000000000005e-05 2024-05-08T18:08:29.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:29.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802217+0000", 2024-05-08T18:08:29.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000124253 2024-05-08T18:08:29.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:29.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802725+0000", 2024-05-08T18:08:29.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050758699999999999 2024-05-08T18:08:29.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807807+0000", 2024-05-08T18:08:29.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005082133 2024-05-08T18:08:29.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807840+0000", 2024-05-08T18:08:29.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3399000000000003e-05 2024-05-08T18:08:29.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807870+0000", 2024-05-08T18:08:29.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9903000000000002e-05 2024-05-08T18:08:29.581 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.581 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.581 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.581 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:29.581 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:08:29.582 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 62.705235316, 2024-05-08T18:08:29.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056057140000000004, 2024-05-08T18:08:29.582 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.582 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.582 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.582 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:29.582 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:29.582 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:29.582 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 502 2024-05-08T18:08:29.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.582 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:08:29.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:08:29.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808263+0000", 2024-05-08T18:08:29.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.054e-06 2024-05-08T18:08:29.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808268+0000", 2024-05-08T18:08:29.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4829999999999999e-06 2024-05-08T18:08:29.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808279+0000", 2024-05-08T18:08:29.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0710000000000001e-05 2024-05-08T18:08:29.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808285+0000", 2024-05-08T18:08:29.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0610000000000001e-06 2024-05-08T18:08:29.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808331+0000", 2024-05-08T18:08:29.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5939000000000002e-05 2024-05-08T18:08:29.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808380+0000", 2024-05-08T18:08:29.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9382999999999998e-05 2024-05-08T18:08:29.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:29.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808484+0000", 2024-05-08T18:08:29.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010410499999999999 2024-05-08T18:08:29.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:29.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.809035+0000", 2024-05-08T18:08:29.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000550969 2024-05-08T18:08:29.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813811+0000", 2024-05-08T18:08:29.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047759830000000001 2024-05-08T18:08:29.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813842+0000", 2024-05-08T18:08:29.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0778000000000002e-05 2024-05-08T18:08:29.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813867+0000", 2024-05-08T18:08:29.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5249000000000002e-05 2024-05-08T18:08:29.587 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.587 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.587 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.587 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:29.587 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:08:29.587 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 62.678705030000003, 2024-05-08T18:08:29.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041392019999999998, 2024-05-08T18:08:29.587 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.587 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.587 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.587 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:29.587 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:29.588 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:29.588 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 527 2024-05-08T18:08:29.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.588 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:08:29.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:08:29.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834793+0000", 2024-05-08T18:08:29.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.212e-06 2024-05-08T18:08:29.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834799+0000", 2024-05-08T18:08:29.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.468e-06 2024-05-08T18:08:29.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834811+0000", 2024-05-08T18:08:29.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2602000000000001e-05 2024-05-08T18:08:29.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834819+0000", 2024-05-08T18:08:29.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6660000000000008e-06 2024-05-08T18:08:29.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834871+0000", 2024-05-08T18:08:29.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2450000000000001e-05 2024-05-08T18:08:29.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834973+0000", 2024-05-08T18:08:29.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101778 2024-05-08T18:08:29.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:29.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835114+0000", 2024-05-08T18:08:29.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014053399999999999 2024-05-08T18:08:29.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:29.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835758+0000", 2024-05-08T18:08:29.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064386100000000002 2024-05-08T18:08:29.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838876+0000", 2024-05-08T18:08:29.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031188890000000001 2024-05-08T18:08:29.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838907+0000", 2024-05-08T18:08:29.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-08T18:08:29.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838931+0000", 2024-05-08T18:08:29.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3822999999999999e-05 2024-05-08T18:08:29.592 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.592 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.592 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.593 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:29.593 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:08:29.593 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 62.674200050000003, 2024-05-08T18:08:29.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048358089999999999, 2024-05-08T18:08:29.593 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.593 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.593 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.593 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:29.593 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:29.593 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:29.593 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 534 2024-05-08T18:08:29.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.594 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:08:29.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:08:29.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839298+0000", 2024-05-08T18:08:29.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1429999999999999e-06 2024-05-08T18:08:29.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839304+0000", 2024-05-08T18:08:29.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4380000000000003e-06 2024-05-08T18:08:29.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839313+0000", 2024-05-08T18:08:29.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5210000000000008e-06 2024-05-08T18:08:29.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839318+0000", 2024-05-08T18:08:29.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0540000000000002e-06 2024-05-08T18:08:29.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839355+0000", 2024-05-08T18:08:29.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6541999999999997e-05 2024-05-08T18:08:29.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839400+0000", 2024-05-08T18:08:29.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4861999999999998e-05 2024-05-08T18:08:29.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:29.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839504+0000", 2024-05-08T18:08:29.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104169 2024-05-08T18:08:29.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:29.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.840046+0000", 2024-05-08T18:08:29.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054245400000000005 2024-05-08T18:08:29.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844075+0000", 2024-05-08T18:08:29.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040287559999999997 2024-05-08T18:08:29.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844108+0000", 2024-05-08T18:08:29.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2872e-05 2024-05-08T18:08:29.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844133+0000", 2024-05-08T18:08:29.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4998e-05 2024-05-08T18:08:29.598 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:544 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 62.661057040000003, 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052743060000000003, 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 544 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.599 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:08:29.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:08:29.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852442+0000", 2024-05-08T18:08:29.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.88e-06 2024-05-08T18:08:29.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852450+0000", 2024-05-08T18:08:29.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1999999999999994e-06 2024-05-08T18:08:29.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852472+0000", 2024-05-08T18:08:29.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2160000000000001e-05 2024-05-08T18:08:29.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852487+0000", 2024-05-08T18:08:29.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5044e-05 2024-05-08T18:08:29.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852550+0000", 2024-05-08T18:08:29.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3152999999999997e-05 2024-05-08T18:08:29.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852608+0000", 2024-05-08T18:08:29.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8026000000000003e-05 2024-05-08T18:08:29.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:29.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852727+0000", 2024-05-08T18:08:29.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118919 2024-05-08T18:08:29.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:29.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.853180+0000", 2024-05-08T18:08:29.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045216599999999999 2024-05-08T18:08:29.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857638+0000", 2024-05-08T18:08:29.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044584510000000004 2024-05-08T18:08:29.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857672+0000", 2024-05-08T18:08:29.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3571000000000001e-05 2024-05-08T18:08:29.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857714+0000", 2024-05-08T18:08:29.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2735999999999999e-05 2024-05-08T18:08:29.604 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.604 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.604 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.604 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:29.604 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:08:29.604 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 62.333228261000002, 2024-05-08T18:08:29.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004733213, 2024-05-08T18:08:29.604 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:29.605 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:29.605 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:29.605 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:29.605 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:29.605 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:29.605 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 789 2024-05-08T18:08:29.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.605 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:29.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:29.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:08:29.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:29.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:08:29.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:29.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:29.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180271+0000", 2024-05-08T18:08:29.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8700000000000001e-06 2024-05-08T18:08:29.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:29.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180281+0000", 2024-05-08T18:08:29.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0067e-05 2024-05-08T18:08:29.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:29.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180311+0000", 2024-05-08T18:08:29.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0783e-05 2024-05-08T18:08:29.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:29.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180333+0000", 2024-05-08T18:08:29.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1509999999999999e-05 2024-05-08T18:08:29.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:29.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180450+0000", 2024-05-08T18:08:29.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116686 2024-05-08T18:08:29.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180581+0000", 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013103499999999999 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180848+0000", 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026750199999999997 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184268+0000", 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034198319999999998 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184844+0000", 2024-05-08T18:08:29.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057643899999999999 2024-05-08T18:08:29.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:29.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184933+0000", 2024-05-08T18:08:29.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8692999999999999e-05 2024-05-08T18:08:29.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:29.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:29.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:29.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.185002+0000", 2024-05-08T18:08:29.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8795999999999997e-05 2024-05-08T18:08:29.609 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.609 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.609 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.609 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:29.609 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:29.609 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:29.611 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:08:29.611 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:29.613+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:29.712 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:29.714+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:29.780 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:29.780 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:29.780 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:29.780 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:29.793 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:08:29.812 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:29.814+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:29.861 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-05-08T18:08:29.913 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:29.913+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:29.926 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:29.926 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:29.926 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:29.926 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:29.926 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:29.939 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:08:30.014 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:30.014+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:30.105 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:30.105 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:30.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:30.105 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:30.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.105 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:30.106 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:30.106 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 66.538072600999996, 2024-05-08T18:08:30.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035750999999999999, 2024-05-08T18:08:30.106 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.106 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.106 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.106 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:30.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:30.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570203+0000", 2024-05-08T18:08:30.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6749999999999996e-06 2024-05-08T18:08:30.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570213+0000", 2024-05-08T18:08:30.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0139999999999999e-05 2024-05-08T18:08:30.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570231+0000", 2024-05-08T18:08:30.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8402000000000001e-05 2024-05-08T18:08:30.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570245+0000", 2024-05-08T18:08:30.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3135e-05 2024-05-08T18:08:30.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570338+0000", 2024-05-08T18:08:30.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3498000000000005e-05 2024-05-08T18:08:30.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570373+0000", 2024-05-08T18:08:30.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5179999999999999e-05 2024-05-08T18:08:30.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573694+0000", 2024-05-08T18:08:30.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003320524 2024-05-08T18:08:30.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573771+0000", 2024-05-08T18:08:30.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7546000000000006e-05 2024-05-08T18:08:30.110 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.110 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.110 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.110 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-05-08T18:08:30.110 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:30.110 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 66.532759639000005, 2024-05-08T18:08:30.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038280229999999998, 2024-05-08T18:08:30.110 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.110 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.110 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.110 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:30.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:30.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575510+0000", 2024-05-08T18:08:30.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0979999999999999e-06 2024-05-08T18:08:30.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575527+0000", 2024-05-08T18:08:30.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6393999999999999e-05 2024-05-08T18:08:30.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575549+0000", 2024-05-08T18:08:30.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1843000000000001e-05 2024-05-08T18:08:30.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575560+0000", 2024-05-08T18:08:30.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.186e-05 2024-05-08T18:08:30.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575651+0000", 2024-05-08T18:08:30.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1068000000000003e-05 2024-05-08T18:08:30.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575685+0000", 2024-05-08T18:08:30.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3614e-05 2024-05-08T18:08:30.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579231+0000", 2024-05-08T18:08:30.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003546249 2024-05-08T18:08:30.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579337+0000", 2024-05-08T18:08:30.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010589700000000001 2024-05-08T18:08:30.114 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.114 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.114 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.114 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-05-08T18:08:30.114 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:30.114 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 66.530722347999998, 2024-05-08T18:08:30.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004223157, 2024-05-08T18:08:30.114 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.115 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.115 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.115 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:30.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:30.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577548+0000", 2024-05-08T18:08:30.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.66e-06 2024-05-08T18:08:30.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577561+0000", 2024-05-08T18:08:30.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2533e-05 2024-05-08T18:08:30.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577585+0000", 2024-05-08T18:08:30.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3873e-05 2024-05-08T18:08:30.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577605+0000", 2024-05-08T18:08:30.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0477000000000001e-05 2024-05-08T18:08:30.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577717+0000", 2024-05-08T18:08:30.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011229499999999999 2024-05-08T18:08:30.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577777+0000", 2024-05-08T18:08:30.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.944e-05 2024-05-08T18:08:30.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581704+0000", 2024-05-08T18:08:30.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039267800000000004 2024-05-08T18:08:30.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581770+0000", 2024-05-08T18:08:30.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6099000000000005e-05 2024-05-08T18:08:30.118 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.118 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.118 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.119 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:54 7.d e29/28 7:b4812045:::notify.4:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:30.119 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:30.119 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 66.527909624000003, 2024-05-08T18:08:30.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003988503, 2024-05-08T18:08:30.119 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.119 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.119 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.119 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:30.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:30.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580368+0000", 2024-05-08T18:08:30.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3089999999999996e-06 2024-05-08T18:08:30.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580400+0000", 2024-05-08T18:08:30.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2580000000000003e-05 2024-05-08T18:08:30.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580427+0000", 2024-05-08T18:08:30.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6976999999999999e-05 2024-05-08T18:08:30.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580443+0000", 2024-05-08T18:08:30.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5585000000000001e-05 2024-05-08T18:08:30.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580555+0000", 2024-05-08T18:08:30.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112639 2024-05-08T18:08:30.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580601+0000", 2024-05-08T18:08:30.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6e-05 2024-05-08T18:08:30.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584229+0000", 2024-05-08T18:08:30.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036273659999999999 2024-05-08T18:08:30.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584348+0000", 2024-05-08T18:08:30.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119047 2024-05-08T18:08:30.123 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.123 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.123 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.123 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:30.123 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:30.123 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 66.418496353999998, 2024-05-08T18:08:30.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032136159999999999, 2024-05-08T18:08:30.123 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.123 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.124 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.124 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:30.124 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:30.124 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:30.124 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 193 2024-05-08T18:08:30.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.124 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:30.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:30.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689775+0000", 2024-05-08T18:08:30.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.357e-06 2024-05-08T18:08:30.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689788+0000", 2024-05-08T18:08:30.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3029e-05 2024-05-08T18:08:30.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689819+0000", 2024-05-08T18:08:30.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.065e-05 2024-05-08T18:08:30.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689833+0000", 2024-05-08T18:08:30.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4790000000000001e-05 2024-05-08T18:08:30.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689948+0000", 2024-05-08T18:08:30.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115089 2024-05-08T18:08:30.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690155+0000", 2024-05-08T18:08:30.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206932 2024-05-08T18:08:30.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:30.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690420+0000", 2024-05-08T18:08:30.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026450200000000001 2024-05-08T18:08:30.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:30.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692229+0000", 2024-05-08T18:08:30.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001808823 2024-05-08T18:08:30.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:30.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692816+0000", 2024-05-08T18:08:30.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058773199999999999 2024-05-08T18:08:30.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692915+0000", 2024-05-08T18:08:30.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8646000000000004e-05 2024-05-08T18:08:30.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692986+0000", 2024-05-08T18:08:30.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1066e-05 2024-05-08T18:08:30.128 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.128 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.128 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.129 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:30.129 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:30.129 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 63.519530134999997, 2024-05-08T18:08:30.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089431319999999995, 2024-05-08T18:08:30.129 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.129 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.129 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.129 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:30.129 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:30.129 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:30.129 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 208 2024-05-08T18:08:30.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.130 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:30.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:30.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588741+0000", 2024-05-08T18:08:30.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:08:30.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588752+0000", 2024-05-08T18:08:30.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0813e-05 2024-05-08T18:08:30.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588782+0000", 2024-05-08T18:08:30.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0020000000000001e-05 2024-05-08T18:08:30.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588803+0000", 2024-05-08T18:08:30.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1115999999999999e-05 2024-05-08T18:08:30.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588943+0000", 2024-05-08T18:08:30.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013971599999999999 2024-05-08T18:08:30.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:08:30.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588954+0000", 2024-05-08T18:08:30.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1365999999999999e-05 2024-05-08T18:08:30.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594340+0000", 2024-05-08T18:08:30.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053854910000000001 2024-05-08T18:08:30.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594670+0000", 2024-05-08T18:08:30.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000330055 2024-05-08T18:08:30.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:30.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.595179+0000", 2024-05-08T18:08:30.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050879199999999999 2024-05-08T18:08:30.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:30.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.596408+0000", 2024-05-08T18:08:30.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012295209999999999 2024-05-08T18:08:30.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:30.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597532+0000", 2024-05-08T18:08:30.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011233860000000001 2024-05-08T18:08:30.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597619+0000", 2024-05-08T18:08:30.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7775999999999994e-05 2024-05-08T18:08:30.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597682+0000", 2024-05-08T18:08:30.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2522999999999998e-05 2024-05-08T18:08:30.135 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.135 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.135 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.135 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:30.135 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:30.135 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 63.490901156, 2024-05-08T18:08:30.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031262669999999998, 2024-05-08T18:08:30.135 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.135 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.136 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.136 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:30.136 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:30.136 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:30.136 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 212 2024-05-08T18:08:30.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.136 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:30.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:30.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617370+0000", 2024-05-08T18:08:30.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:08:30.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617379+0000", 2024-05-08T18:08:30.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2359999999999993e-06 2024-05-08T18:08:30.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617405+0000", 2024-05-08T18:08:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5639999999999998e-05 2024-05-08T18:08:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617425+0000", 2024-05-08T18:08:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0457000000000001e-05 2024-05-08T18:08:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617573+0000", 2024-05-08T18:08:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014776200000000001 2024-05-08T18:08:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617786+0000", 2024-05-08T18:08:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212418 2024-05-08T18:08:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.618177+0000", 2024-05-08T18:08:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039161699999999997 2024-05-08T18:08:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.619563+0000", 2024-05-08T18:08:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013852999999999999 2024-05-08T18:08:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620334+0000", 2024-05-08T18:08:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00077182200000000002 2024-05-08T18:08:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620426+0000", 2024-05-08T18:08:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1526000000000004e-05 2024-05-08T18:08:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620494+0000", 2024-05-08T18:08:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8078999999999997e-05 2024-05-08T18:08:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.140 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 63.466582602999999, 2024-05-08T18:08:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035230880000000002, 2024-05-08T18:08:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 219 2024-05-08T18:08:30.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641689+0000", 2024-05-08T18:08:30.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:08:30.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641700+0000", 2024-05-08T18:08:30.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1507e-05 2024-05-08T18:08:30.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641732+0000", 2024-05-08T18:08:30.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1585999999999999e-05 2024-05-08T18:08:30.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641754+0000", 2024-05-08T18:08:30.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1480000000000001e-05 2024-05-08T18:08:30.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641942+0000", 2024-05-08T18:08:30.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018826300000000001 2024-05-08T18:08:30.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642165+0000", 2024-05-08T18:08:30.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022301100000000001 2024-05-08T18:08:30.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:30.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642587+0000", 2024-05-08T18:08:30.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042182400000000001 2024-05-08T18:08:30.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:30.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.643767+0000", 2024-05-08T18:08:30.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001180675 2024-05-08T18:08:30.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:30.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645010+0000", 2024-05-08T18:08:30.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012427110000000001 2024-05-08T18:08:30.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645101+0000", 2024-05-08T18:08:30.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0871999999999993e-05 2024-05-08T18:08:30.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645209+0000", 2024-05-08T18:08:30.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108496 2024-05-08T18:08:30.146 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.146 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.146 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.146 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:30.146 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:30.147 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 63.446785616, 2024-05-08T18:08:30.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035793639999999998, 2024-05-08T18:08:30.147 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.147 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.147 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.147 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:30.147 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:30.147 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:30.147 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 224 2024-05-08T18:08:30.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.147 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:30.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:30.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661485+0000", 2024-05-08T18:08:30.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9759999999999998e-06 2024-05-08T18:08:30.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661494+0000", 2024-05-08T18:08:30.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3469999999999999e-06 2024-05-08T18:08:30.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661517+0000", 2024-05-08T18:08:30.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.389e-05 2024-05-08T18:08:30.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661537+0000", 2024-05-08T18:08:30.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9803e-05 2024-05-08T18:08:30.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661696+0000", 2024-05-08T18:08:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015865899999999999 2024-05-08T18:08:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661910+0000", 2024-05-08T18:08:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021434199999999999 2024-05-08T18:08:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.662336+0000", 2024-05-08T18:08:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042575300000000001 2024-05-08T18:08:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.663720+0000", 2024-05-08T18:08:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013843799999999999 2024-05-08T18:08:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.664909+0000", 2024-05-08T18:08:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011889019999999999 2024-05-08T18:08:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665001+0000", 2024-05-08T18:08:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1649000000000003e-05 2024-05-08T18:08:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665063+0000", 2024-05-08T18:08:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1662999999999996e-05 2024-05-08T18:08:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 63.414192342, 2024-05-08T18:08:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031551930000000001, 2024-05-08T18:08:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.152 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.153 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:30.153 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:30.153 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:30.153 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 233 2024-05-08T18:08:30.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.153 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:30.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694079+0000", 2024-05-08T18:08:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694090+0000", 2024-05-08T18:08:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1182999999999999e-05 2024-05-08T18:08:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694119+0000", 2024-05-08T18:08:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9076000000000001e-05 2024-05-08T18:08:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694143+0000", 2024-05-08T18:08:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4363e-05 2024-05-08T18:08:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694291+0000", 2024-05-08T18:08:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147849 2024-05-08T18:08:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694534+0000", 2024-05-08T18:08:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000242382 2024-05-08T18:08:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694957+0000", 2024-05-08T18:08:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042316700000000001 2024-05-08T18:08:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.696306+0000", 2024-05-08T18:08:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013489940000000001 2024-05-08T18:08:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:30.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697071+0000", 2024-05-08T18:08:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076482999999999998 2024-05-08T18:08:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697167+0000", 2024-05-08T18:08:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6773000000000003e-05 2024-05-08T18:08:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697232+0000", 2024-05-08T18:08:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4386000000000003e-05 2024-05-08T18:08:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:328 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 63.382473754999999, 2024-05-08T18:08:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029659439999999999, 2024-05-08T18:08:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 328 2024-05-08T18:08:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.158 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725796+0000", 2024-05-08T18:08:30.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-06 2024-05-08T18:08:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725802+0000", 2024-05-08T18:08:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7219999999999996e-06 2024-05-08T18:08:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725816+0000", 2024-05-08T18:08:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3886999999999999e-05 2024-05-08T18:08:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725824+0000", 2024-05-08T18:08:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5920000000000003e-06 2024-05-08T18:08:30.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725885+0000", 2024-05-08T18:08:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1526999999999996e-05 2024-05-08T18:08:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725972+0000", 2024-05-08T18:08:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7099000000000001e-05 2024-05-08T18:08:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726093+0000", 2024-05-08T18:08:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120383 2024-05-08T18:08:30.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726717+0000", 2024-05-08T18:08:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062435099999999999 2024-05-08T18:08:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728693+0000", 2024-05-08T18:08:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019758309999999999 2024-05-08T18:08:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728731+0000", 2024-05-08T18:08:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8591999999999999e-05 2024-05-08T18:08:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728761+0000", 2024-05-08T18:08:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9770000000000001e-05 2024-05-08T18:08:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:460 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:30.163 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 63.328656531, 2024-05-08T18:08:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040209540000000002, 2024-05-08T18:08:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 460 2024-05-08T18:08:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:30.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779613+0000", 2024-05-08T18:08:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:08:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779619+0000", 2024-05-08T18:08:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3630000000000002e-06 2024-05-08T18:08:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779631+0000", 2024-05-08T18:08:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2211e-05 2024-05-08T18:08:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779637+0000", 2024-05-08T18:08:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0430000000000004e-06 2024-05-08T18:08:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779702+0000", 2024-05-08T18:08:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4481999999999997e-05 2024-05-08T18:08:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779848+0000", 2024-05-08T18:08:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014608500000000001 2024-05-08T18:08:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780056+0000", 2024-05-08T18:08:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020889699999999999 2024-05-08T18:08:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780700+0000", 2024-05-08T18:08:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064379300000000003 2024-05-08T18:08:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783576+0000", 2024-05-08T18:08:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028754919999999999 2024-05-08T18:08:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783608+0000", 2024-05-08T18:08:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2223e-05 2024-05-08T18:08:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:08:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5296e-05 2024-05-08T18:08:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:466 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 63.324118292999998, 2024-05-08T18:08:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028979520000000001, 2024-05-08T18:08:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.169 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 466 2024-05-08T18:08:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.61e-07 2024-05-08T18:08:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784155+0000", 2024-05-08T18:08:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9299999999999996e-06 2024-05-08T18:08:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784165+0000", 2024-05-08T18:08:30.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5680000000000005e-06 2024-05-08T18:08:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784170+0000", 2024-05-08T18:08:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1379999999999998e-06 2024-05-08T18:08:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784219+0000", 2024-05-08T18:08:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9231999999999999e-05 2024-05-08T18:08:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784310+0000", 2024-05-08T18:08:30.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0797000000000005e-05 2024-05-08T18:08:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784490+0000", 2024-05-08T18:08:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179705 2024-05-08T18:08:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.785090+0000", 2024-05-08T18:08:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060073899999999998 2024-05-08T18:08:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.786973+0000", 2024-05-08T18:08:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018824460000000001 2024-05-08T18:08:30.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787007+0000", 2024-05-08T18:08:30.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3779999999999998e-05 2024-05-08T18:08:30.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787049+0000", 2024-05-08T18:08:30.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1856e-05 2024-05-08T18:08:30.174 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.174 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.174 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.174 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:477 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:30.174 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 63.316976298999997, 2024-05-08T18:08:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046076989999999998, 2024-05-08T18:08:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 477 2024-05-08T18:08:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791294+0000", 2024-05-08T18:08:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-06 2024-05-08T18:08:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791300+0000", 2024-05-08T18:08:30.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5320000000000003e-06 2024-05-08T18:08:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791313+0000", 2024-05-08T18:08:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2576e-05 2024-05-08T18:08:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791319+0000", 2024-05-08T18:08:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1720000000000004e-06 2024-05-08T18:08:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791379+0000", 2024-05-08T18:08:30.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0343000000000001e-05 2024-05-08T18:08:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791477+0000", 2024-05-08T18:08:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7662000000000001e-05 2024-05-08T18:08:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791678+0000", 2024-05-08T18:08:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000200788 2024-05-08T18:08:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.792263+0000", 2024-05-08T18:08:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058525700000000005 2024-05-08T18:08:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795842+0000", 2024-05-08T18:08:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035787079999999999 2024-05-08T18:08:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795874+0000", 2024-05-08T18:08:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2205000000000001e-05 2024-05-08T18:08:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795900+0000", 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6222000000000001e-05 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:642 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 63.178216595999999, 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030444059999999999, 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:30.180 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 642 2024-05-08T18:08:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930055+0000", 2024-05-08T18:08:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7999999999999999e-06 2024-05-08T18:08:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930065+0000", 2024-05-08T18:08:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0176999999999999e-05 2024-05-08T18:08:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930092+0000", 2024-05-08T18:08:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6460000000000001e-05 2024-05-08T18:08:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930112+0000", 2024-05-08T18:08:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0043000000000001e-05 2024-05-08T18:08:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930219+0000", 2024-05-08T18:08:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010698500000000001 2024-05-08T18:08:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930345+0000", 2024-05-08T18:08:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012620400000000001 2024-05-08T18:08:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930579+0000", 2024-05-08T18:08:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234145 2024-05-08T18:08:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.931471+0000", 2024-05-08T18:08:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00089161500000000001 2024-05-08T18:08:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.932978+0000", 2024-05-08T18:08:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001507296 2024-05-08T18:08:30.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933044+0000", 2024-05-08T18:08:30.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6402000000000006e-05 2024-05-08T18:08:30.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933097+0000", 2024-05-08T18:08:30.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2278999999999999e-05 2024-05-08T18:08:30.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.185 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.186 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:681 6.e e32/26 6:748722ff:gc::gc.6:head v 32'7, mlcod=32'5)", 2024-05-08T18:08:30.186 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:30.186 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 63.147421018999999, 2024-05-08T18:08:30.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003318185, 2024-05-08T18:08:30.186 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.186 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.186 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.186 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:30.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:30.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960849+0000", 2024-05-08T18:08:30.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.423e-06 2024-05-08T18:08:30.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960859+0000", 2024-05-08T18:08:30.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3170000000000008e-06 2024-05-08T18:08:30.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960874+0000", 2024-05-08T18:08:30.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5125e-05 2024-05-08T18:08:30.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960884+0000", 2024-05-08T18:08:30.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8120000000000002e-06 2024-05-08T18:08:30.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960972+0000", 2024-05-08T18:08:30.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8540000000000003e-05 2024-05-08T18:08:30.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960996+0000", 2024-05-08T18:08:30.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3479999999999999e-05 2024-05-08T18:08:30.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964110+0000", 2024-05-08T18:08:30.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031142729999999999 2024-05-08T18:08:30.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964166+0000", 2024-05-08T18:08:30.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6215000000000003e-05 2024-05-08T18:08:30.189 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.189 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.190 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:30.190 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:30.190 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 63.056384924, 2024-05-08T18:08:30.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030648379999999999, 2024-05-08T18:08:30.190 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.190 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.190 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.190 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:30.190 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:30.190 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:30.190 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 733 2024-05-08T18:08:30.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.191 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:30.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:30.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051887+0000", 2024-05-08T18:08:30.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.74e-06 2024-05-08T18:08:30.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051900+0000", 2024-05-08T18:08:30.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3113e-05 2024-05-08T18:08:30.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051931+0000", 2024-05-08T18:08:30.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1665999999999998e-05 2024-05-08T18:08:30.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051946+0000", 2024-05-08T18:08:30.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4780000000000001e-05 2024-05-08T18:08:30.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052078+0000", 2024-05-08T18:08:30.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013133200000000001 2024-05-08T18:08:30.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052338+0000", 2024-05-08T18:08:30.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026056899999999999 2024-05-08T18:08:30.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:30.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052652+0000", 2024-05-08T18:08:30.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031396700000000001 2024-05-08T18:08:30.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:30.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.053668+0000", 2024-05-08T18:08:30.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00101574 2024-05-08T18:08:30.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:30.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054800+0000", 2024-05-08T18:08:30.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011319819999999999 2024-05-08T18:08:30.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054884+0000", 2024-05-08T18:08:30.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4005999999999995e-05 2024-05-08T18:08:30.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054949+0000", 2024-05-08T18:08:30.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4943000000000005e-05 2024-05-08T18:08:30.195 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.195 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.195 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.195 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:30.196 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:30.196 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 63.052530289000003, 2024-05-08T18:08:30.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029745919999999999, 2024-05-08T18:08:30.196 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.196 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.196 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.196 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:30.196 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:30.196 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:30.196 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 735 2024-05-08T18:08:30.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.196 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:30.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:30.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055741+0000", 2024-05-08T18:08:30.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.984e-06 2024-05-08T18:08:30.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055766+0000", 2024-05-08T18:08:30.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5253e-05 2024-05-08T18:08:30.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055785+0000", 2024-05-08T18:08:30.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9559999999999999e-05 2024-05-08T18:08:30.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055798+0000", 2024-05-08T18:08:30.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-05 2024-05-08T18:08:30.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055932+0000", 2024-05-08T18:08:30.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134609 2024-05-08T18:08:30.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056184+0000", 2024-05-08T18:08:30.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025167800000000003 2024-05-08T18:08:30.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:30.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056680+0000", 2024-05-08T18:08:30.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049576299999999998 2024-05-08T18:08:30.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:30.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058060+0000", 2024-05-08T18:08:30.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013801 2024-05-08T18:08:30.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:30.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058447+0000", 2024-05-08T18:08:30.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038695299999999999 2024-05-08T18:08:30.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058601+0000", 2024-05-08T18:08:30.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015396299999999999 2024-05-08T18:08:30.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058713+0000", 2024-05-08T18:08:30.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112389 2024-05-08T18:08:30.201 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.201 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.201 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.201 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:30.201 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:30.201 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 62.945514938999999, 2024-05-08T18:08:30.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029913650000000002, 2024-05-08T18:08:30.202 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.202 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.202 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.202 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:30.202 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:30.202 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:30.202 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 781 2024-05-08T18:08:30.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.202 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:30.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:30.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162757+0000", 2024-05-08T18:08:30.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:08:30.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162770+0000", 2024-05-08T18:08:30.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3406e-05 2024-05-08T18:08:30.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162799+0000", 2024-05-08T18:08:30.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-05 2024-05-08T18:08:30.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162813+0000", 2024-05-08T18:08:30.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:08:30.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162942+0000", 2024-05-08T18:08:30.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012902200000000001 2024-05-08T18:08:30.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163159+0000", 2024-05-08T18:08:30.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021738500000000001 2024-05-08T18:08:30.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:30.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163476+0000", 2024-05-08T18:08:30.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031666499999999999 2024-05-08T18:08:30.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:30.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.164533+0000", 2024-05-08T18:08:30.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010574219999999999 2024-05-08T18:08:30.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:30.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165587+0000", 2024-05-08T18:08:30.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001053476 2024-05-08T18:08:30.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165674+0000", 2024-05-08T18:08:30.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6725999999999996e-05 2024-05-08T18:08:30.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165745+0000", 2024-05-08T18:08:30.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1779000000000005e-05 2024-05-08T18:08:30.207 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.207 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.207 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.207 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:30.207 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:30.207 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 62.562925090999997, 2024-05-08T18:08:30.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029834750000000002, 2024-05-08T18:08:30.207 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:30.207 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:30.207 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:30.207 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:30.207 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:30.208 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:30.208 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 946 2024-05-08T18:08:30.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.208 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:30.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:30.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:30.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:30.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:30.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:30.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:30.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545346+0000", 2024-05-08T18:08:30.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6570000000000001e-06 2024-05-08T18:08:30.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:30.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545357+0000", 2024-05-08T18:08:30.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0740000000000001e-05 2024-05-08T18:08:30.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:30.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545384+0000", 2024-05-08T18:08:30.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6780000000000001e-05 2024-05-08T18:08:30.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:30.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545398+0000", 2024-05-08T18:08:30.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3936e-05 2024-05-08T18:08:30.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:30.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545515+0000", 2024-05-08T18:08:30.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117413 2024-05-08T18:08:30.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:30.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545751+0000", 2024-05-08T18:08:30.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023559500000000001 2024-05-08T18:08:30.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:30.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.546075+0000", 2024-05-08T18:08:30.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000324357 2024-05-08T18:08:30.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:30.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.547104+0000", 2024-05-08T18:08:30.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010285959999999999 2024-05-08T18:08:30.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:30.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548141+0000", 2024-05-08T18:08:30.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001036922 2024-05-08T18:08:30.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:30.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548223+0000", 2024-05-08T18:08:30.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2260000000000002e-05 2024-05-08T18:08:30.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:30.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:30.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:30.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548327+0000", 2024-05-08T18:08:30.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104219 2024-05-08T18:08:30.212 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.212 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.212 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.213 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:30.213 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:30.213 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:30.214 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:08:30.215 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:30.214+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:30.315 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:30.314+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:30.333 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:30.333 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:30.333 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:30.333 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:30.346 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:08:30.373 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:08:30.434 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:30.437+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:30.465 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:30.465 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:30.479 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:08:30.516 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:30.518+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:30.529 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:30.530 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:30.547 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:30.547 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:30.563 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:30.563 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:30.581 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:30.581 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:30.601 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:30.602 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:30.617 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:30.618+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:30.623 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:30.624 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:30.638 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:30.638 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:30.644 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:30.644 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:30.652 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:08:30.665 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:30.665 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:30.722 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:30.725+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:30.777 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:30.777 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:30.790 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:08:30.818 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:30.818+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:30.919 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:30.921+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:30.966 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:30.967 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:30.980 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:08:31.022 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:31.025+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:31.121 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:31.122+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:31.145 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:31.145 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:31.158 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:08:31.221 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:31.222+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:31.292 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:31.292 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:31.306 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:08:31.323 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:31.325+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:31.423 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:31.425+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:31.469 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:31.469 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:31.484 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:08:31.524 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:31.525+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:31.608 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:31.608 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:31.622 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:08:31.625 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:31.626+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:31.726 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:31.725+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:31.746 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:31.746 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:31.760 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:08:31.827 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:31.826+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:31.882 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:31.883 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:31.884 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:08:31.897 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:08:31.940 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:31.942+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:32.029 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:32.029+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:32.061 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:32.061 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:32.077 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:08:32.130 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:32.133+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:32.200 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:32.200 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:32.214 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:08:32.232 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:32.233+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:32.330 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:32.330 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:32.333 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:32.334+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:32.345 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:08:32.433 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:32.433+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:32.503 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:32.503 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:32.517 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:08:32.534 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:32.537+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:32.635 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:32.635 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:32.636 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:32.637+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:32.650 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:08:32.682 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:08:32.737 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:32.738+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:32.781 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:32.781 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:32.795 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:08:32.838 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:32.841+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:32.866 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-05-08T18:08:32.896 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:32.896 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:32.926 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:32.926 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:32.937 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:32.938+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:32.956 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:32.956 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:32.958 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:32.958 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:32.974 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:08:32.987 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:33.017 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:33.018 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:33.038 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:33.037+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:33.051 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:33.051 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:33.071 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:33.071 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:33.106 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:33.106 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:33.116 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:33.116 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:33.117 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:33.117 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:33.132 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:08:33.174 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:33.177+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:33.239 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:33.241+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:33.322 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:33.323 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:33.323 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:33.336 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:08:33.341 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:33.342+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:33.440 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:33.441+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:33.516 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:52 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'31)", 2024-05-08T18:08:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:08:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.391821458999999, 2024-05-08T18:08:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00409947, 2024-05-08T18:08:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:08:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:08:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127167+0000", 2024-05-08T18:08:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7800000000000001e-07 2024-05-08T18:08:33.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127172+0000", 2024-05-08T18:08:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1120000000000004e-06 2024-05-08T18:08:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127183+0000", 2024-05-08T18:08:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1107000000000001e-05 2024-05-08T18:08:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127189+0000", 2024-05-08T18:08:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0310000000000004e-06 2024-05-08T18:08:33.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127237+0000", 2024-05-08T18:08:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7907000000000001e-05 2024-05-08T18:08:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127252+0000", 2024-05-08T18:08:33.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5373e-05 2024-05-08T18:08:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131206+0000", 2024-05-08T18:08:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039540199999999999 2024-05-08T18:08:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131265+0000", 2024-05-08T18:08:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9141999999999997e-05 2024-05-08T18:08:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.521 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-05-08T18:08:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:08:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.383063054999994, 2024-05-08T18:08:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049265589999999996, 2024-05-08T18:08:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:08:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:08:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135925+0000", 2024-05-08T18:08:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8100000000000002e-07 2024-05-08T18:08:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136007+0000", 2024-05-08T18:08:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1864000000000001e-05 2024-05-08T18:08:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136019+0000", 2024-05-08T18:08:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2438e-05 2024-05-08T18:08:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136026+0000", 2024-05-08T18:08:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0809999999999996e-06 2024-05-08T18:08:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136093+0000", 2024-05-08T18:08:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6769999999999999e-05 2024-05-08T18:08:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136108+0000", 2024-05-08T18:08:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.465e-05 2024-05-08T18:08:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140800+0000", 2024-05-08T18:08:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046919450000000003 2024-05-08T18:08:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140851+0000", 2024-05-08T18:08:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.113e-05 2024-05-08T18:08:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-05-08T18:08:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:08:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.166577845000006, 2024-05-08T18:08:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042257299999999996, 2024-05-08T18:08:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.526 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:08:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:08:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352410+0000", 2024-05-08T18:08:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7599999999999997e-07 2024-05-08T18:08:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352489+0000", 2024-05-08T18:08:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8564000000000002e-05 2024-05-08T18:08:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352500+0000", 2024-05-08T18:08:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1411e-05 2024-05-08T18:08:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352506+0000", 2024-05-08T18:08:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7309999999999998e-06 2024-05-08T18:08:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352569+0000", 2024-05-08T18:08:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3173e-05 2024-05-08T18:08:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352598+0000", 2024-05-08T18:08:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8855000000000001e-05 2024-05-08T18:08:33.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356592+0000", 2024-05-08T18:08:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039941539999999998 2024-05-08T18:08:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356635+0000", 2024-05-08T18:08:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3166e-05 2024-05-08T18:08:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:75 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'53, mlcod=15'43)", 2024-05-08T18:08:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:08:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.158406428000006, 2024-05-08T18:08:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063708030000000004, 2024-05-08T18:08:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:08:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:08:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:08:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:08:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360641+0000", 2024-05-08T18:08:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9273e-05 2024-05-08T18:08:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360651+0000", 2024-05-08T18:08:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0353000000000001e-05 2024-05-08T18:08:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360659+0000", 2024-05-08T18:08:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4789999999999999e-06 2024-05-08T18:08:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360720+0000", 2024-05-08T18:08:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699000000000007e-05 2024-05-08T18:08:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360739+0000", 2024-05-08T18:08:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8913999999999999e-05 2024-05-08T18:08:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366883+0000", 2024-05-08T18:08:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061438229999999996 2024-05-08T18:08:33.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366952+0000", 2024-05-08T18:08:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8677000000000007e-05 2024-05-08T18:08:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:76 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'54, mlcod=15'49)", 2024-05-08T18:08:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:08:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.156669922999995, 2024-05-08T18:08:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046550610000000003, 2024-05-08T18:08:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.536 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:08:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:08:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362318+0000", 2024-05-08T18:08:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.99e-07 2024-05-08T18:08:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362323+0000", 2024-05-08T18:08:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.566e-06 2024-05-08T18:08:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362334+0000", 2024-05-08T18:08:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1403000000000001e-05 2024-05-08T18:08:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362342+0000", 2024-05-08T18:08:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3420000000000008e-06 2024-05-08T18:08:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362396+0000", 2024-05-08T18:08:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3476000000000001e-05 2024-05-08T18:08:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362415+0000", 2024-05-08T18:08:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8787000000000002e-05 2024-05-08T18:08:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366954+0000", 2024-05-08T18:08:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045388609999999999 2024-05-08T18:08:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366972+0000", 2024-05-08T18:08:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8927e-05 2024-05-08T18:08:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:79 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'57, mlcod=15'53)", 2024-05-08T18:08:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:08:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.149273995000001, 2024-05-08T18:08:33.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045322499999999998, 2024-05-08T18:08:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:08:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:08:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369714+0000", 2024-05-08T18:08:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:08:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369787+0000", 2024-05-08T18:08:33.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3317000000000003e-05 2024-05-08T18:08:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369797+0000", 2024-05-08T18:08:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9510000000000001e-06 2024-05-08T18:08:33.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369802+0000", 2024-05-08T18:08:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8210000000000001e-06 2024-05-08T18:08:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369854+0000", 2024-05-08T18:08:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1751e-05 2024-05-08T18:08:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369880+0000", 2024-05-08T18:08:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6577999999999999e-05 2024-05-08T18:08:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374202+0000", 2024-05-08T18:08:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217029999999997 2024-05-08T18:08:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374246+0000", 2024-05-08T18:08:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3544000000000002e-05 2024-05-08T18:08:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:89 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'63, mlcod=15'60)", 2024-05-08T18:08:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:08:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 89.815731830000004, 2024-05-08T18:08:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057729900000000004, 2024-05-08T18:08:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.549 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:08:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:08:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:08:33.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:08:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703261+0000", 2024-05-08T18:08:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2569999999999998e-06 2024-05-08T18:08:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703272+0000", 2024-05-08T18:08:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0739e-05 2024-05-08T18:08:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703282+0000", 2024-05-08T18:08:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6250000000000002e-06 2024-05-08T18:08:33.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703333+0000", 2024-05-08T18:08:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1588000000000001e-05 2024-05-08T18:08:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703358+0000", 2024-05-08T18:08:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4913999999999999e-05 2024-05-08T18:08:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708907+0000", 2024-05-08T18:08:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055484829999999999 2024-05-08T18:08:33.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.709028+0000", 2024-05-08T18:08:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121667 2024-05-08T18:08:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-05-08T18:08:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:08:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 89.814666313000004, 2024-05-08T18:08:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0074185579999999996, 2024-05-08T18:08:33.553 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:08:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:08:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704322+0000", 2024-05-08T18:08:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8299999999999997e-07 2024-05-08T18:08:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704410+0000", 2024-05-08T18:08:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8552000000000002e-05 2024-05-08T18:08:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704421+0000", 2024-05-08T18:08:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0794e-05 2024-05-08T18:08:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704427+0000", 2024-05-08T18:08:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8699999999999997e-06 2024-05-08T18:08:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704481+0000", 2024-05-08T18:08:33.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4410999999999998e-05 2024-05-08T18:08:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704511+0000", 2024-05-08T18:08:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9906000000000001e-05 2024-05-08T18:08:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711682+0000", 2024-05-08T18:08:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071710209999999996 2024-05-08T18:08:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711740+0000", 2024-05-08T18:08:33.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7521e-05 2024-05-08T18:08:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:91 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'65, mlcod=15'60)", 2024-05-08T18:08:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:08:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 89.813122120000003, 2024-05-08T18:08:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059345600000000002, 2024-05-08T18:08:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:08:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:08:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705866+0000", 2024-05-08T18:08:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0900000000000001e-07 2024-05-08T18:08:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705872+0000", 2024-05-08T18:08:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0580000000000003e-06 2024-05-08T18:08:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705883+0000", 2024-05-08T18:08:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0986e-05 2024-05-08T18:08:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705889+0000", 2024-05-08T18:08:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6400000000000002e-06 2024-05-08T18:08:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705942+0000", 2024-05-08T18:08:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3726e-05 2024-05-08T18:08:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705963+0000", 2024-05-08T18:08:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0713e-05 2024-05-08T18:08:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711744+0000", 2024-05-08T18:08:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057812669999999997 2024-05-08T18:08:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711800+0000", 2024-05-08T18:08:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5461000000000003e-05 2024-05-08T18:08:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:92 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'66, mlcod=15'61)", 2024-05-08T18:08:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:08:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 89.811797772000006, 2024-05-08T18:08:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046553640000000004, 2024-05-08T18:08:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.562 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:08:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:08:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707191+0000", 2024-05-08T18:08:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9300000000000006e-07 2024-05-08T18:08:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707198+0000", 2024-05-08T18:08:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4669999999999998e-06 2024-05-08T18:08:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707214+0000", 2024-05-08T18:08:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5911000000000001e-05 2024-05-08T18:08:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707221+0000", 2024-05-08T18:08:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.43e-06 2024-05-08T18:08:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707283+0000", 2024-05-08T18:08:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1974e-05 2024-05-08T18:08:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707308+0000", 2024-05-08T18:08:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4589000000000001e-05 2024-05-08T18:08:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711802+0000", 2024-05-08T18:08:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044944939999999999 2024-05-08T18:08:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711845+0000", 2024-05-08T18:08:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2506000000000003e-05 2024-05-08T18:08:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:93 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'67, mlcod=15'61)", 2024-05-08T18:08:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:08:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 89.810967515000002, 2024-05-08T18:08:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217760000000003, 2024-05-08T18:08:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.566 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:08:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:08:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708021+0000", 2024-05-08T18:08:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.92e-07 2024-05-08T18:08:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708106+0000", 2024-05-08T18:08:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5400000000000002e-05 2024-05-08T18:08:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708116+0000", 2024-05-08T18:08:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0482000000000001e-05 2024-05-08T18:08:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708124+0000", 2024-05-08T18:08:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5349999999999999e-06 2024-05-08T18:08:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708182+0000", 2024-05-08T18:08:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8130000000000001e-05 2024-05-08T18:08:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708203+0000", 2024-05-08T18:08:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1118e-05 2024-05-08T18:08:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712298+0000", 2024-05-08T18:08:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004094688 2024-05-08T18:08:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712342+0000", 2024-05-08T18:08:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3730999999999999e-05 2024-05-08T18:08:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.570 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:08:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 66.914541448999998, 2024-05-08T18:08:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087837890000000002, 2024-05-08T18:08:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:33.571 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210 2024-05-08T18:08:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:08:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:08:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604448+0000", 2024-05-08T18:08:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4229999999999999e-06 2024-05-08T18:08:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604460+0000", 2024-05-08T18:08:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:08:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604491+0000", 2024-05-08T18:08:33.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1004000000000003e-05 2024-05-08T18:08:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604513+0000", 2024-05-08T18:08:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1886e-05 2024-05-08T18:08:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604670+0000", 2024-05-08T18:08:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000156735 2024-05-08T18:08:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:08:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604680+0000", 2024-05-08T18:08:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0113e-05 2024-05-08T18:08:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609236+0000", 2024-05-08T18:08:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045557269999999999 2024-05-08T18:08:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609544+0000", 2024-05-08T18:08:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030863800000000002 2024-05-08T18:08:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.610952+0000", 2024-05-08T18:08:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014077269999999999 2024-05-08T18:08:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.612639+0000", 2024-05-08T18:08:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001686398 2024-05-08T18:08:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613101+0000", 2024-05-08T18:08:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00046249600000000001 2024-05-08T18:08:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613176+0000", 2024-05-08T18:08:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5032999999999998e-05 2024-05-08T18:08:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613230+0000", 2024-05-08T18:08:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3638999999999999e-05 2024-05-08T18:08:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:33.577 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:08:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 66.865953239000007, 2024-05-08T18:08:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046602199999999996, 2024-05-08T18:08:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 222 2024-05-08T18:08:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.578 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:08:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:08:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653037+0000", 2024-05-08T18:08:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:08:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653048+0000", 2024-05-08T18:08:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:08:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653077+0000", 2024-05-08T18:08:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9326e-05 2024-05-08T18:08:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653098+0000", 2024-05-08T18:08:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1327000000000001e-05 2024-05-08T18:08:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653230+0000", 2024-05-08T18:08:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013206599999999999 2024-05-08T18:08:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653444+0000", 2024-05-08T18:08:33.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000213401 2024-05-08T18:08:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653852+0000", 2024-05-08T18:08:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040808700000000001 2024-05-08T18:08:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.656108+0000", 2024-05-08T18:08:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022565739999999999 2024-05-08T18:08:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657533+0000", 2024-05-08T18:08:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014241799999999999 2024-05-08T18:08:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657629+0000", 2024-05-08T18:08:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6435999999999996e-05 2024-05-08T18:08:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657694+0000", 2024-05-08T18:08:33.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5349000000000001e-05 2024-05-08T18:08:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:461 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:08:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 66.739331433000004, 2024-05-08T18:08:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040933549999999999, 2024-05-08T18:08:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:33.584 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 461 2024-05-08T18:08:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:08:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:08:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779657+0000", 2024-05-08T18:08:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.252e-06 2024-05-08T18:08:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779663+0000", 2024-05-08T18:08:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0170000000000002e-06 2024-05-08T18:08:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779676+0000", 2024-05-08T18:08:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.296e-05 2024-05-08T18:08:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779684+0000", 2024-05-08T18:08:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4209999999999998e-06 2024-05-08T18:08:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779736+0000", 2024-05-08T18:08:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2296999999999998e-05 2024-05-08T18:08:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779787+0000", 2024-05-08T18:08:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0954e-05 2024-05-08T18:08:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779897+0000", 2024-05-08T18:08:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011001999999999999 2024-05-08T18:08:33.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780506+0000", 2024-05-08T18:08:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060872599999999997 2024-05-08T18:08:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783690+0000", 2024-05-08T18:08:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031847210000000002 2024-05-08T18:08:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783722+0000", 2024-05-08T18:08:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1608e-05 2024-05-08T18:08:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783749+0000", 2024-05-08T18:08:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7379e-05 2024-05-08T18:08:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.590 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:491 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:08:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 66.717067825000001, 2024-05-08T18:08:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059507570000000001, 2024-05-08T18:08:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 491 2024-05-08T18:08:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:08:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:08:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801921+0000", 2024-05-08T18:08:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6959999999999999e-06 2024-05-08T18:08:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801928+0000", 2024-05-08T18:08:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0299999999999996e-06 2024-05-08T18:08:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801944+0000", 2024-05-08T18:08:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285e-05 2024-05-08T18:08:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801953+0000", 2024-05-08T18:08:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1849999999999993e-06 2024-05-08T18:08:33.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802008+0000", 2024-05-08T18:08:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5379e-05 2024-05-08T18:08:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802093+0000", 2024-05-08T18:08:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4907000000000005e-05 2024-05-08T18:08:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802217+0000", 2024-05-08T18:08:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000124253 2024-05-08T18:08:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802725+0000", 2024-05-08T18:08:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050758699999999999 2024-05-08T18:08:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807807+0000", 2024-05-08T18:08:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005082133 2024-05-08T18:08:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807840+0000", 2024-05-08T18:08:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3399000000000003e-05 2024-05-08T18:08:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807870+0000", 2024-05-08T18:08:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9903000000000002e-05 2024-05-08T18:08:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:33.596 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:08:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 66.710725620999995, 2024-05-08T18:08:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056057140000000004, 2024-05-08T18:08:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 502 2024-05-08T18:08:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:08:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:08:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808263+0000", 2024-05-08T18:08:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.054e-06 2024-05-08T18:08:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808268+0000", 2024-05-08T18:08:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4829999999999999e-06 2024-05-08T18:08:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808279+0000", 2024-05-08T18:08:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0710000000000001e-05 2024-05-08T18:08:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808285+0000", 2024-05-08T18:08:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0610000000000001e-06 2024-05-08T18:08:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808331+0000", 2024-05-08T18:08:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5939000000000002e-05 2024-05-08T18:08:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808380+0000", 2024-05-08T18:08:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9382999999999998e-05 2024-05-08T18:08:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808484+0000", 2024-05-08T18:08:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010410499999999999 2024-05-08T18:08:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.809035+0000", 2024-05-08T18:08:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000550969 2024-05-08T18:08:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813811+0000", 2024-05-08T18:08:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047759830000000001 2024-05-08T18:08:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813842+0000", 2024-05-08T18:08:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0778000000000002e-05 2024-05-08T18:08:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813867+0000", 2024-05-08T18:08:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5249000000000002e-05 2024-05-08T18:08:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:33.602 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:08:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 66.684195334999998, 2024-05-08T18:08:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041392019999999998, 2024-05-08T18:08:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 527 2024-05-08T18:08:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:08:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:08:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834793+0000", 2024-05-08T18:08:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.212e-06 2024-05-08T18:08:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834799+0000", 2024-05-08T18:08:33.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.468e-06 2024-05-08T18:08:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834811+0000", 2024-05-08T18:08:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2602000000000001e-05 2024-05-08T18:08:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834819+0000", 2024-05-08T18:08:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6660000000000008e-06 2024-05-08T18:08:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834871+0000", 2024-05-08T18:08:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2450000000000001e-05 2024-05-08T18:08:33.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834973+0000", 2024-05-08T18:08:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101778 2024-05-08T18:08:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835114+0000", 2024-05-08T18:08:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014053399999999999 2024-05-08T18:08:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:33.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835758+0000", 2024-05-08T18:08:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064386100000000002 2024-05-08T18:08:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838876+0000", 2024-05-08T18:08:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031188890000000001 2024-05-08T18:08:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838907+0000", 2024-05-08T18:08:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-08T18:08:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838931+0000", 2024-05-08T18:08:33.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3822999999999999e-05 2024-05-08T18:08:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:08:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 66.679690355000005, 2024-05-08T18:08:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048358089999999999, 2024-05-08T18:08:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:33.608 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 534 2024-05-08T18:08:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:08:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:08:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839298+0000", 2024-05-08T18:08:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1429999999999999e-06 2024-05-08T18:08:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839304+0000", 2024-05-08T18:08:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4380000000000003e-06 2024-05-08T18:08:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839313+0000", 2024-05-08T18:08:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5210000000000008e-06 2024-05-08T18:08:33.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839318+0000", 2024-05-08T18:08:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0540000000000002e-06 2024-05-08T18:08:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839355+0000", 2024-05-08T18:08:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6541999999999997e-05 2024-05-08T18:08:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839400+0000", 2024-05-08T18:08:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4861999999999998e-05 2024-05-08T18:08:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839504+0000", 2024-05-08T18:08:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104169 2024-05-08T18:08:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.840046+0000", 2024-05-08T18:08:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054245400000000005 2024-05-08T18:08:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844075+0000", 2024-05-08T18:08:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040287559999999997 2024-05-08T18:08:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844108+0000", 2024-05-08T18:08:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2872e-05 2024-05-08T18:08:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844133+0000", 2024-05-08T18:08:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4998e-05 2024-05-08T18:08:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.613 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:544 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:08:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 66.666547344999998, 2024-05-08T18:08:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052743060000000003, 2024-05-08T18:08:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:33.614 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 544 2024-05-08T18:08:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:08:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:08:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852442+0000", 2024-05-08T18:08:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.88e-06 2024-05-08T18:08:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852450+0000", 2024-05-08T18:08:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1999999999999994e-06 2024-05-08T18:08:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852472+0000", 2024-05-08T18:08:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2160000000000001e-05 2024-05-08T18:08:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852487+0000", 2024-05-08T18:08:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5044e-05 2024-05-08T18:08:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852550+0000", 2024-05-08T18:08:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3152999999999997e-05 2024-05-08T18:08:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852608+0000", 2024-05-08T18:08:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8026000000000003e-05 2024-05-08T18:08:33.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852727+0000", 2024-05-08T18:08:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118919 2024-05-08T18:08:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.853180+0000", 2024-05-08T18:08:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045216599999999999 2024-05-08T18:08:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857638+0000", 2024-05-08T18:08:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044584510000000004 2024-05-08T18:08:33.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857672+0000", 2024-05-08T18:08:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3571000000000001e-05 2024-05-08T18:08:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857714+0000", 2024-05-08T18:08:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2735999999999999e-05 2024-05-08T18:08:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:08:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 66.338718565999997, 2024-05-08T18:08:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004733213, 2024-05-08T18:08:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 789 2024-05-08T18:08:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.620 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:08:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:08:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:33.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180271+0000", 2024-05-08T18:08:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8700000000000001e-06 2024-05-08T18:08:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180281+0000", 2024-05-08T18:08:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0067e-05 2024-05-08T18:08:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180311+0000", 2024-05-08T18:08:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0783e-05 2024-05-08T18:08:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180333+0000", 2024-05-08T18:08:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1509999999999999e-05 2024-05-08T18:08:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180450+0000", 2024-05-08T18:08:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116686 2024-05-08T18:08:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180581+0000", 2024-05-08T18:08:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013103499999999999 2024-05-08T18:08:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:33.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180848+0000", 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026750199999999997 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184268+0000", 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034198319999999998 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184844+0000", 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057643899999999999 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184933+0000", 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8692999999999999e-05 2024-05-08T18:08:33.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.185002+0000", 2024-05-08T18:08:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8795999999999997e-05 2024-05-08T18:08:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:33.625 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:33.625 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:33.627 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:08:33.627 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:33.629+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:33.728 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:33.730+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:33.828 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:33.828 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:33.828 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:33.829 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:33.829+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:33.844 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:08:33.930 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:33.933+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:34.015 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:34.015 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:34.027 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:08:34.030 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:34.030+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:34.131 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:34.130+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:34.179 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:34.179 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:34.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 70.612475348999993, 2024-05-08T18:08:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035750999999999999, 2024-05-08T18:08:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:34.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570203+0000", 2024-05-08T18:08:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6749999999999996e-06 2024-05-08T18:08:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570213+0000", 2024-05-08T18:08:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0139999999999999e-05 2024-05-08T18:08:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570231+0000", 2024-05-08T18:08:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8402000000000001e-05 2024-05-08T18:08:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570245+0000", 2024-05-08T18:08:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3135e-05 2024-05-08T18:08:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570338+0000", 2024-05-08T18:08:34.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3498000000000005e-05 2024-05-08T18:08:34.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570373+0000", 2024-05-08T18:08:34.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5179999999999999e-05 2024-05-08T18:08:34.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573694+0000", 2024-05-08T18:08:34.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003320524 2024-05-08T18:08:34.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573771+0000", 2024-05-08T18:08:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7546000000000006e-05 2024-05-08T18:08:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-05-08T18:08:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 70.607162387000002, 2024-05-08T18:08:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038280229999999998, 2024-05-08T18:08:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.184 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.185 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:34.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:34.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575510+0000", 2024-05-08T18:08:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0979999999999999e-06 2024-05-08T18:08:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575527+0000", 2024-05-08T18:08:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6393999999999999e-05 2024-05-08T18:08:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575549+0000", 2024-05-08T18:08:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1843000000000001e-05 2024-05-08T18:08:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575560+0000", 2024-05-08T18:08:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.186e-05 2024-05-08T18:08:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575651+0000", 2024-05-08T18:08:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1068000000000003e-05 2024-05-08T18:08:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575685+0000", 2024-05-08T18:08:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3614e-05 2024-05-08T18:08:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579231+0000", 2024-05-08T18:08:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003546249 2024-05-08T18:08:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579337+0000", 2024-05-08T18:08:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010589700000000001 2024-05-08T18:08:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-05-08T18:08:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 70.605125095999995, 2024-05-08T18:08:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004223157, 2024-05-08T18:08:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577548+0000", 2024-05-08T18:08:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.66e-06 2024-05-08T18:08:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577561+0000", 2024-05-08T18:08:34.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2533e-05 2024-05-08T18:08:34.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577585+0000", 2024-05-08T18:08:34.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3873e-05 2024-05-08T18:08:34.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577605+0000", 2024-05-08T18:08:34.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0477000000000001e-05 2024-05-08T18:08:34.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577717+0000", 2024-05-08T18:08:34.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011229499999999999 2024-05-08T18:08:34.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577777+0000", 2024-05-08T18:08:34.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.944e-05 2024-05-08T18:08:34.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581704+0000", 2024-05-08T18:08:34.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039267800000000004 2024-05-08T18:08:34.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581770+0000", 2024-05-08T18:08:34.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6099000000000005e-05 2024-05-08T18:08:34.193 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.193 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.193 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.193 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:54 7.d e29/28 7:b4812045:::notify.4:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:34.193 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:34.193 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 70.602312372, 2024-05-08T18:08:34.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003988503, 2024-05-08T18:08:34.193 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.194 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.194 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.194 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:34.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:34.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580368+0000", 2024-05-08T18:08:34.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3089999999999996e-06 2024-05-08T18:08:34.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580400+0000", 2024-05-08T18:08:34.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2580000000000003e-05 2024-05-08T18:08:34.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580427+0000", 2024-05-08T18:08:34.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6976999999999999e-05 2024-05-08T18:08:34.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580443+0000", 2024-05-08T18:08:34.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5585000000000001e-05 2024-05-08T18:08:34.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580555+0000", 2024-05-08T18:08:34.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112639 2024-05-08T18:08:34.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580601+0000", 2024-05-08T18:08:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6e-05 2024-05-08T18:08:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584229+0000", 2024-05-08T18:08:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036273659999999999 2024-05-08T18:08:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584348+0000", 2024-05-08T18:08:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119047 2024-05-08T18:08:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.198 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:34.198 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:34.198 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 70.492899101999996, 2024-05-08T18:08:34.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032136159999999999, 2024-05-08T18:08:34.198 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.198 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.198 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.198 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.198 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.198 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.198 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 193 2024-05-08T18:08:34.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.198 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:34.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:34.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689775+0000", 2024-05-08T18:08:34.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.357e-06 2024-05-08T18:08:34.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689788+0000", 2024-05-08T18:08:34.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3029e-05 2024-05-08T18:08:34.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689819+0000", 2024-05-08T18:08:34.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.065e-05 2024-05-08T18:08:34.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689833+0000", 2024-05-08T18:08:34.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4790000000000001e-05 2024-05-08T18:08:34.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689948+0000", 2024-05-08T18:08:34.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115089 2024-05-08T18:08:34.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690155+0000", 2024-05-08T18:08:34.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206932 2024-05-08T18:08:34.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:34.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690420+0000", 2024-05-08T18:08:34.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026450200000000001 2024-05-08T18:08:34.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692229+0000", 2024-05-08T18:08:34.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001808823 2024-05-08T18:08:34.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692816+0000", 2024-05-08T18:08:34.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058773199999999999 2024-05-08T18:08:34.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692915+0000", 2024-05-08T18:08:34.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8646000000000004e-05 2024-05-08T18:08:34.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692986+0000", 2024-05-08T18:08:34.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1066e-05 2024-05-08T18:08:34.203 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.203 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.203 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.204 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.204 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:34.204 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.593932882999994, 2024-05-08T18:08:34.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089431319999999995, 2024-05-08T18:08:34.204 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.204 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.204 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.204 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.204 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.204 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.204 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 208 2024-05-08T18:08:34.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.204 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:34.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:34.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588741+0000", 2024-05-08T18:08:34.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:08:34.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588752+0000", 2024-05-08T18:08:34.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0813e-05 2024-05-08T18:08:34.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588782+0000", 2024-05-08T18:08:34.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0020000000000001e-05 2024-05-08T18:08:34.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588803+0000", 2024-05-08T18:08:34.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1115999999999999e-05 2024-05-08T18:08:34.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588943+0000", 2024-05-08T18:08:34.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013971599999999999 2024-05-08T18:08:34.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:08:34.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588954+0000", 2024-05-08T18:08:34.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1365999999999999e-05 2024-05-08T18:08:34.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594340+0000", 2024-05-08T18:08:34.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053854910000000001 2024-05-08T18:08:34.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594670+0000", 2024-05-08T18:08:34.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000330055 2024-05-08T18:08:34.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:34.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.595179+0000", 2024-05-08T18:08:34.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050879199999999999 2024-05-08T18:08:34.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.596408+0000", 2024-05-08T18:08:34.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012295209999999999 2024-05-08T18:08:34.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597532+0000", 2024-05-08T18:08:34.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011233860000000001 2024-05-08T18:08:34.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597619+0000", 2024-05-08T18:08:34.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7775999999999994e-05 2024-05-08T18:08:34.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597682+0000", 2024-05-08T18:08:34.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2522999999999998e-05 2024-05-08T18:08:34.210 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.210 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.210 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.210 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.210 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:34.210 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.565303904000004, 2024-05-08T18:08:34.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031262669999999998, 2024-05-08T18:08:34.211 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.211 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.211 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.211 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.211 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.211 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.211 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 212 2024-05-08T18:08:34.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.211 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:34.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:34.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617370+0000", 2024-05-08T18:08:34.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:08:34.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617379+0000", 2024-05-08T18:08:34.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2359999999999993e-06 2024-05-08T18:08:34.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617405+0000", 2024-05-08T18:08:34.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5639999999999998e-05 2024-05-08T18:08:34.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617425+0000", 2024-05-08T18:08:34.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0457000000000001e-05 2024-05-08T18:08:34.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617573+0000", 2024-05-08T18:08:34.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014776200000000001 2024-05-08T18:08:34.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617786+0000", 2024-05-08T18:08:34.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212418 2024-05-08T18:08:34.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:34.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.618177+0000", 2024-05-08T18:08:34.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039161699999999997 2024-05-08T18:08:34.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.619563+0000", 2024-05-08T18:08:34.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013852999999999999 2024-05-08T18:08:34.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620334+0000", 2024-05-08T18:08:34.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00077182200000000002 2024-05-08T18:08:34.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620426+0000", 2024-05-08T18:08:34.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1526000000000004e-05 2024-05-08T18:08:34.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620494+0000", 2024-05-08T18:08:34.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8078999999999997e-05 2024-05-08T18:08:34.216 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.216 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.216 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.216 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.216 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:34.216 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.540985351000003, 2024-05-08T18:08:34.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035230880000000002, 2024-05-08T18:08:34.216 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.216 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.216 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.216 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.216 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.216 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.216 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 219 2024-05-08T18:08:34.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.217 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:34.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:34.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641689+0000", 2024-05-08T18:08:34.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:08:34.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641700+0000", 2024-05-08T18:08:34.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1507e-05 2024-05-08T18:08:34.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641732+0000", 2024-05-08T18:08:34.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1585999999999999e-05 2024-05-08T18:08:34.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641754+0000", 2024-05-08T18:08:34.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1480000000000001e-05 2024-05-08T18:08:34.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641942+0000", 2024-05-08T18:08:34.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018826300000000001 2024-05-08T18:08:34.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642165+0000", 2024-05-08T18:08:34.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022301100000000001 2024-05-08T18:08:34.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:34.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642587+0000", 2024-05-08T18:08:34.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042182400000000001 2024-05-08T18:08:34.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.643767+0000", 2024-05-08T18:08:34.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001180675 2024-05-08T18:08:34.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645010+0000", 2024-05-08T18:08:34.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012427110000000001 2024-05-08T18:08:34.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645101+0000", 2024-05-08T18:08:34.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0871999999999993e-05 2024-05-08T18:08:34.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645209+0000", 2024-05-08T18:08:34.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108496 2024-05-08T18:08:34.221 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.221 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.221 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.221 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.221 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:34.221 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.521188363999997, 2024-05-08T18:08:34.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035793639999999998, 2024-05-08T18:08:34.222 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.222 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.222 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.222 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.222 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.222 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.222 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 224 2024-05-08T18:08:34.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.222 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:34.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:34.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661485+0000", 2024-05-08T18:08:34.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9759999999999998e-06 2024-05-08T18:08:34.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661494+0000", 2024-05-08T18:08:34.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3469999999999999e-06 2024-05-08T18:08:34.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661517+0000", 2024-05-08T18:08:34.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.389e-05 2024-05-08T18:08:34.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661537+0000", 2024-05-08T18:08:34.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9803e-05 2024-05-08T18:08:34.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661696+0000", 2024-05-08T18:08:34.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015865899999999999 2024-05-08T18:08:34.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661910+0000", 2024-05-08T18:08:34.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021434199999999999 2024-05-08T18:08:34.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:34.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.662336+0000", 2024-05-08T18:08:34.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042575300000000001 2024-05-08T18:08:34.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.663720+0000", 2024-05-08T18:08:34.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013843799999999999 2024-05-08T18:08:34.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.664909+0000", 2024-05-08T18:08:34.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011889019999999999 2024-05-08T18:08:34.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665001+0000", 2024-05-08T18:08:34.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1649000000000003e-05 2024-05-08T18:08:34.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665063+0000", 2024-05-08T18:08:34.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1662999999999996e-05 2024-05-08T18:08:34.227 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.227 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.227 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.227 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.228 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:34.228 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.488595090000004, 2024-05-08T18:08:34.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031551930000000001, 2024-05-08T18:08:34.228 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.228 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.228 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.228 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.228 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.228 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.228 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 233 2024-05-08T18:08:34.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.228 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:34.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:34.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694079+0000", 2024-05-08T18:08:34.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:34.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694090+0000", 2024-05-08T18:08:34.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1182999999999999e-05 2024-05-08T18:08:34.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694119+0000", 2024-05-08T18:08:34.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9076000000000001e-05 2024-05-08T18:08:34.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694143+0000", 2024-05-08T18:08:34.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4363e-05 2024-05-08T18:08:34.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694291+0000", 2024-05-08T18:08:34.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147849 2024-05-08T18:08:34.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694534+0000", 2024-05-08T18:08:34.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000242382 2024-05-08T18:08:34.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:34.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694957+0000", 2024-05-08T18:08:34.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042316700000000001 2024-05-08T18:08:34.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.696306+0000", 2024-05-08T18:08:34.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013489940000000001 2024-05-08T18:08:34.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697071+0000", 2024-05-08T18:08:34.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076482999999999998 2024-05-08T18:08:34.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697167+0000", 2024-05-08T18:08:34.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6773000000000003e-05 2024-05-08T18:08:34.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697232+0000", 2024-05-08T18:08:34.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4386000000000003e-05 2024-05-08T18:08:34.233 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.233 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.233 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.234 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:328 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.234 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:34.234 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.456876503000004, 2024-05-08T18:08:34.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029659439999999999, 2024-05-08T18:08:34.234 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.234 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.234 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.234 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.234 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.234 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.234 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 328 2024-05-08T18:08:34.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.234 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:34.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:34.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725796+0000", 2024-05-08T18:08:34.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-06 2024-05-08T18:08:34.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725802+0000", 2024-05-08T18:08:34.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7219999999999996e-06 2024-05-08T18:08:34.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725816+0000", 2024-05-08T18:08:34.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3886999999999999e-05 2024-05-08T18:08:34.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725824+0000", 2024-05-08T18:08:34.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5920000000000003e-06 2024-05-08T18:08:34.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725885+0000", 2024-05-08T18:08:34.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1526999999999996e-05 2024-05-08T18:08:34.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725972+0000", 2024-05-08T18:08:34.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7099000000000001e-05 2024-05-08T18:08:34.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:34.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726093+0000", 2024-05-08T18:08:34.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120383 2024-05-08T18:08:34.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726717+0000", 2024-05-08T18:08:34.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062435099999999999 2024-05-08T18:08:34.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728693+0000", 2024-05-08T18:08:34.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019758309999999999 2024-05-08T18:08:34.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728731+0000", 2024-05-08T18:08:34.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8591999999999999e-05 2024-05-08T18:08:34.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728761+0000", 2024-05-08T18:08:34.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9770000000000001e-05 2024-05-08T18:08:34.239 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.239 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.239 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.240 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:460 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.240 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:34.240 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.403059279000004, 2024-05-08T18:08:34.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040209540000000002, 2024-05-08T18:08:34.240 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.240 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.240 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.240 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.240 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.240 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.240 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 460 2024-05-08T18:08:34.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.241 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:34.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:34.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779613+0000", 2024-05-08T18:08:34.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:08:34.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779619+0000", 2024-05-08T18:08:34.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3630000000000002e-06 2024-05-08T18:08:34.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779631+0000", 2024-05-08T18:08:34.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2211e-05 2024-05-08T18:08:34.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779637+0000", 2024-05-08T18:08:34.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0430000000000004e-06 2024-05-08T18:08:34.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779702+0000", 2024-05-08T18:08:34.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4481999999999997e-05 2024-05-08T18:08:34.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779848+0000", 2024-05-08T18:08:34.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014608500000000001 2024-05-08T18:08:34.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:34.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780056+0000", 2024-05-08T18:08:34.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020889699999999999 2024-05-08T18:08:34.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780700+0000", 2024-05-08T18:08:34.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064379300000000003 2024-05-08T18:08:34.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783576+0000", 2024-05-08T18:08:34.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028754919999999999 2024-05-08T18:08:34.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783608+0000", 2024-05-08T18:08:34.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2223e-05 2024-05-08T18:08:34.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:08:34.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5296e-05 2024-05-08T18:08:34.245 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.245 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.246 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.246 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:466 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.246 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:34.246 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.398521040999995, 2024-05-08T18:08:34.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028979520000000001, 2024-05-08T18:08:34.246 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.246 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.246 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.246 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.246 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.246 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.247 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 466 2024-05-08T18:08:34.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.247 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:34.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:34.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:34.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.61e-07 2024-05-08T18:08:34.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784155+0000", 2024-05-08T18:08:34.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9299999999999996e-06 2024-05-08T18:08:34.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784165+0000", 2024-05-08T18:08:34.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5680000000000005e-06 2024-05-08T18:08:34.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784170+0000", 2024-05-08T18:08:34.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1379999999999998e-06 2024-05-08T18:08:34.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784219+0000", 2024-05-08T18:08:34.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9231999999999999e-05 2024-05-08T18:08:34.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784310+0000", 2024-05-08T18:08:34.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0797000000000005e-05 2024-05-08T18:08:34.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:34.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784490+0000", 2024-05-08T18:08:34.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179705 2024-05-08T18:08:34.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.785090+0000", 2024-05-08T18:08:34.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060073899999999998 2024-05-08T18:08:34.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.786973+0000", 2024-05-08T18:08:34.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018824460000000001 2024-05-08T18:08:34.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787007+0000", 2024-05-08T18:08:34.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3779999999999998e-05 2024-05-08T18:08:34.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787049+0000", 2024-05-08T18:08:34.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1856e-05 2024-05-08T18:08:34.251 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.251 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.251 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.252 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:477 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.252 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:34.252 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.391379047000001, 2024-05-08T18:08:34.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046076989999999998, 2024-05-08T18:08:34.252 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.252 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.252 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.252 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.252 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.252 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.252 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 477 2024-05-08T18:08:34.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.253 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:34.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:34.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.254 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791294+0000", 2024-05-08T18:08:34.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-06 2024-05-08T18:08:34.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.254 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791300+0000", 2024-05-08T18:08:34.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5320000000000003e-06 2024-05-08T18:08:34.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.254 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791313+0000", 2024-05-08T18:08:34.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2576e-05 2024-05-08T18:08:34.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791319+0000", 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1720000000000004e-06 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791379+0000", 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0343000000000001e-05 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791477+0000", 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7662000000000001e-05 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:34.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791678+0000", 2024-05-08T18:08:34.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000200788 2024-05-08T18:08:34.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.792263+0000", 2024-05-08T18:08:34.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058525700000000005 2024-05-08T18:08:34.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795842+0000", 2024-05-08T18:08:34.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035787079999999999 2024-05-08T18:08:34.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795874+0000", 2024-05-08T18:08:34.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2205000000000001e-05 2024-05-08T18:08:34.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795900+0000", 2024-05-08T18:08:34.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6222000000000001e-05 2024-05-08T18:08:34.257 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.257 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.257 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.257 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:642 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.257 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:34.258 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.252619343999996, 2024-05-08T18:08:34.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030444059999999999, 2024-05-08T18:08:34.258 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.258 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.258 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.258 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.258 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.258 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.258 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 642 2024-05-08T18:08:34.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.258 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:34.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:34.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930055+0000", 2024-05-08T18:08:34.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7999999999999999e-06 2024-05-08T18:08:34.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930065+0000", 2024-05-08T18:08:34.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0176999999999999e-05 2024-05-08T18:08:34.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930092+0000", 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6460000000000001e-05 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930112+0000", 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0043000000000001e-05 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930219+0000", 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010698500000000001 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.260 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930345+0000", 2024-05-08T18:08:34.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012620400000000001 2024-05-08T18:08:34.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:34.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930579+0000", 2024-05-08T18:08:34.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234145 2024-05-08T18:08:34.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.931471+0000", 2024-05-08T18:08:34.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00089161500000000001 2024-05-08T18:08:34.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.932978+0000", 2024-05-08T18:08:34.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001507296 2024-05-08T18:08:34.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933044+0000", 2024-05-08T18:08:34.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6402000000000006e-05 2024-05-08T18:08:34.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933097+0000", 2024-05-08T18:08:34.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2278999999999999e-05 2024-05-08T18:08:34.262 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.262 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.262 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.263 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:681 6.e e32/26 6:748722ff:gc::gc.6:head v 32'7, mlcod=32'5)", 2024-05-08T18:08:34.263 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:34.263 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.221823767000004, 2024-05-08T18:08:34.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003318185, 2024-05-08T18:08:34.263 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.263 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.263 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.263 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:34.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:34.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960849+0000", 2024-05-08T18:08:34.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.423e-06 2024-05-08T18:08:34.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960859+0000", 2024-05-08T18:08:34.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3170000000000008e-06 2024-05-08T18:08:34.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960874+0000", 2024-05-08T18:08:34.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5125e-05 2024-05-08T18:08:34.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960884+0000", 2024-05-08T18:08:34.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8120000000000002e-06 2024-05-08T18:08:34.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960972+0000", 2024-05-08T18:08:34.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8540000000000003e-05 2024-05-08T18:08:34.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.266 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.266 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960996+0000", 2024-05-08T18:08:34.266 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3479999999999999e-05 2024-05-08T18:08:34.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.266 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.266 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964110+0000", 2024-05-08T18:08:34.266 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031142729999999999 2024-05-08T18:08:34.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.266 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.266 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964166+0000", 2024-05-08T18:08:34.266 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6215000000000003e-05 2024-05-08T18:08:34.266 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.266 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.267 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.267 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.267 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:34.267 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.130787671999997, 2024-05-08T18:08:34.267 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030648379999999999, 2024-05-08T18:08:34.267 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.267 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.267 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.267 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.267 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.267 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.267 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 733 2024-05-08T18:08:34.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.268 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:34.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:34.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051887+0000", 2024-05-08T18:08:34.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.74e-06 2024-05-08T18:08:34.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051900+0000", 2024-05-08T18:08:34.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3113e-05 2024-05-08T18:08:34.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051931+0000", 2024-05-08T18:08:34.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1665999999999998e-05 2024-05-08T18:08:34.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051946+0000", 2024-05-08T18:08:34.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4780000000000001e-05 2024-05-08T18:08:34.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052078+0000", 2024-05-08T18:08:34.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013133200000000001 2024-05-08T18:08:34.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052338+0000", 2024-05-08T18:08:34.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026056899999999999 2024-05-08T18:08:34.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:34.271 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052652+0000", 2024-05-08T18:08:34.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031396700000000001 2024-05-08T18:08:34.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.271 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.271 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.053668+0000", 2024-05-08T18:08:34.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00101574 2024-05-08T18:08:34.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.271 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.271 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054800+0000", 2024-05-08T18:08:34.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011319819999999999 2024-05-08T18:08:34.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.271 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054884+0000", 2024-05-08T18:08:34.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4005999999999995e-05 2024-05-08T18:08:34.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.272 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054949+0000", 2024-05-08T18:08:34.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4943000000000005e-05 2024-05-08T18:08:34.272 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.272 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.272 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.272 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.272 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:34.273 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.126933037000001, 2024-05-08T18:08:34.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029745919999999999, 2024-05-08T18:08:34.273 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.273 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.273 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.273 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.273 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.273 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.273 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 735 2024-05-08T18:08:34.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.273 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:34.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:34.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055741+0000", 2024-05-08T18:08:34.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.984e-06 2024-05-08T18:08:34.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055766+0000", 2024-05-08T18:08:34.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5253e-05 2024-05-08T18:08:34.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055785+0000", 2024-05-08T18:08:34.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9559999999999999e-05 2024-05-08T18:08:34.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055798+0000", 2024-05-08T18:08:34.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-05 2024-05-08T18:08:34.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.276 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055932+0000", 2024-05-08T18:08:34.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134609 2024-05-08T18:08:34.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.276 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056184+0000", 2024-05-08T18:08:34.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025167800000000003 2024-05-08T18:08:34.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:34.276 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056680+0000", 2024-05-08T18:08:34.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049576299999999998 2024-05-08T18:08:34.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058060+0000", 2024-05-08T18:08:34.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013801 2024-05-08T18:08:34.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.277 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058447+0000", 2024-05-08T18:08:34.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038695299999999999 2024-05-08T18:08:34.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.277 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058601+0000", 2024-05-08T18:08:34.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015396299999999999 2024-05-08T18:08:34.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.278 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.278 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058713+0000", 2024-05-08T18:08:34.278 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112389 2024-05-08T18:08:34.278 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.278 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.278 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.278 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.278 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:34.278 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.019917687000003, 2024-05-08T18:08:34.278 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029913650000000002, 2024-05-08T18:08:34.278 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.278 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.279 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.279 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.279 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.279 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.279 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 781 2024-05-08T18:08:34.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.279 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:34.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:34.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162757+0000", 2024-05-08T18:08:34.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:08:34.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162770+0000", 2024-05-08T18:08:34.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3406e-05 2024-05-08T18:08:34.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.281 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162799+0000", 2024-05-08T18:08:34.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-05 2024-05-08T18:08:34.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.281 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162813+0000", 2024-05-08T18:08:34.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:08:34.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.281 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162942+0000", 2024-05-08T18:08:34.282 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012902200000000001 2024-05-08T18:08:34.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.282 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.282 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163159+0000", 2024-05-08T18:08:34.282 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021738500000000001 2024-05-08T18:08:34.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.282 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:34.282 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163476+0000", 2024-05-08T18:08:34.282 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031666499999999999 2024-05-08T18:08:34.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.282 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.164533+0000", 2024-05-08T18:08:34.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010574219999999999 2024-05-08T18:08:34.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165587+0000", 2024-05-08T18:08:34.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001053476 2024-05-08T18:08:34.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165674+0000", 2024-05-08T18:08:34.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6725999999999996e-05 2024-05-08T18:08:34.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165745+0000", 2024-05-08T18:08:34.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1779000000000005e-05 2024-05-08T18:08:34.284 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.284 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.284 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.284 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.284 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:34.284 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 66.637327838999994, 2024-05-08T18:08:34.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029834750000000002, 2024-05-08T18:08:34.284 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.284 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.284 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.284 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.284 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.284 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.285 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 946 2024-05-08T18:08:34.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.285 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:34.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:34.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545346+0000", 2024-05-08T18:08:34.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6570000000000001e-06 2024-05-08T18:08:34.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.286 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545357+0000", 2024-05-08T18:08:34.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0740000000000001e-05 2024-05-08T18:08:34.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.286 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545384+0000", 2024-05-08T18:08:34.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6780000000000001e-05 2024-05-08T18:08:34.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.286 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545398+0000", 2024-05-08T18:08:34.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3936e-05 2024-05-08T18:08:34.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.287 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.287 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545515+0000", 2024-05-08T18:08:34.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117413 2024-05-08T18:08:34.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.287 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.287 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545751+0000", 2024-05-08T18:08:34.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023559500000000001 2024-05-08T18:08:34.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.287 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:34.287 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.546075+0000", 2024-05-08T18:08:34.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000324357 2024-05-08T18:08:34.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.547104+0000", 2024-05-08T18:08:34.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010285959999999999 2024-05-08T18:08:34.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548141+0000", 2024-05-08T18:08:34.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001036922 2024-05-08T18:08:34.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548223+0000", 2024-05-08T18:08:34.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2260000000000002e-05 2024-05-08T18:08:34.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548327+0000", 2024-05-08T18:08:34.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104219 2024-05-08T18:08:34.289 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.289 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.289 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.289 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.289 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.289 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:34.291 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:08:34.291 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:34.290+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:34.391 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:34.393+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:34.424 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:34.424 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:34.424 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:34.437 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:08:34.493 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:34.494+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:34.593 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:34.594+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:34.638 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:34.638 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:34.638 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:34.638 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:34.638 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:34.654 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:08:34.698 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:34.701+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:34.795 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:34.797+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:34.803 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.228899669, 2024-05-08T18:08:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002466088, 2024-05-08T18:08:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 52 2024-05-08T18:08:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:34.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577062+0000", 2024-05-08T18:08:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.994e-06 2024-05-08T18:08:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577075+0000", 2024-05-08T18:08:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2480000000000001e-05 2024-05-08T18:08:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577108+0000", 2024-05-08T18:08:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3096000000000003e-05 2024-05-08T18:08:34.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577131+0000", 2024-05-08T18:08:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2993000000000002e-05 2024-05-08T18:08:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577260+0000", 2024-05-08T18:08:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012912899999999999 2024-05-08T18:08:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577453+0000", 2024-05-08T18:08:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000193668 2024-05-08T18:08:34.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577634+0000", 2024-05-08T18:08:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180576 2024-05-08T18:08:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579082+0000", 2024-05-08T18:08:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001448083 2024-05-08T18:08:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579290+0000", 2024-05-08T18:08:34.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000208333 2024-05-08T18:08:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579403+0000", 2024-05-08T18:08:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011296800000000001 2024-05-08T18:08:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579525+0000", 2024-05-08T18:08:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121768 2024-05-08T18:08:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.809 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:34.809 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:34.809 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.217039904000004, 2024-05-08T18:08:34.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038858310000000002, 2024-05-08T18:08:34.809 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.809 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.809 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.809 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:34.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:34.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588920+0000", 2024-05-08T18:08:34.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.23e-07 2024-05-08T18:08:34.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588929+0000", 2024-05-08T18:08:34.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3659999999999998e-06 2024-05-08T18:08:34.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588948+0000", 2024-05-08T18:08:34.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8768000000000001e-05 2024-05-08T18:08:34.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588962+0000", 2024-05-08T18:08:34.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4e-05 2024-05-08T18:08:34.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589110+0000", 2024-05-08T18:08:34.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148047 2024-05-08T18:08:34.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589173+0000", 2024-05-08T18:08:34.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2766000000000002e-05 2024-05-08T18:08:34.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592728+0000", 2024-05-08T18:08:34.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035553300000000002 2024-05-08T18:08:34.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592805+0000", 2024-05-08T18:08:34.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6730999999999994e-05 2024-05-08T18:08:34.812 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.812 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.812 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.813 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.813 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:34.813 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 68.100971005999995, 2024-05-08T18:08:34.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034354310000000001, 2024-05-08T18:08:34.813 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.813 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.813 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.813 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.813 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.813 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.813 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 236 2024-05-08T18:08:34.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.813 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:34.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:34.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704991+0000", 2024-05-08T18:08:34.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1240000000000001e-06 2024-05-08T18:08:34.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705009+0000", 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7819e-05 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705048+0000", 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9632999999999998e-05 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705073+0000", 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4686999999999999e-05 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705241+0000", 2024-05-08T18:08:34.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759899999999999 2024-05-08T18:08:34.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705511+0000", 2024-05-08T18:08:34.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027018799999999998 2024-05-08T18:08:34.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:34.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705965+0000", 2024-05-08T18:08:34.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045433000000000002 2024-05-08T18:08:34.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.707487+0000", 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015214810000000001 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708125+0000", 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063870300000000001 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708298+0000", 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172592 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708423+0000", 2024-05-08T18:08:34.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125275 2024-05-08T18:08:34.818 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.818 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.818 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.818 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:308 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.818 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:34.818 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 68.084133104000003, 2024-05-08T18:08:34.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038707400000000001, 2024-05-08T18:08:34.818 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.818 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.818 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.818 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.818 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.819 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.819 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 308 2024-05-08T18:08:34.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.819 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:34.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:34.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721827+0000", 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1519999999999999e-06 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721840+0000", 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.362e-05 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721857+0000", 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6901e-05 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721867+0000", 2024-05-08T18:08:34.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0034000000000001e-05 2024-05-08T18:08:34.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721922+0000", 2024-05-08T18:08:34.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4450999999999998e-05 2024-05-08T18:08:34.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721981+0000", 2024-05-08T18:08:34.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9267e-05 2024-05-08T18:08:34.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:34.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722103+0000", 2024-05-08T18:08:34.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121502 2024-05-08T18:08:34.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722757+0000", 2024-05-08T18:08:34.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065419700000000003 2024-05-08T18:08:34.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725619+0000", 2024-05-08T18:08:34.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002862107 2024-05-08T18:08:34.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725654+0000", 2024-05-08T18:08:34.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:08:34.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725696+0000", 2024-05-08T18:08:34.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:08:34.823 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.823 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.823 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.823 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:604 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.823 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:34.823 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.906850398000003, 2024-05-08T18:08:34.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002741884, 2024-05-08T18:08:34.823 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.824 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.824 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.824 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.824 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.824 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.824 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 604 2024-05-08T18:08:34.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.824 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:34.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:34.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899111+0000", 2024-05-08T18:08:34.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0910000000000001e-06 2024-05-08T18:08:34.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899126+0000", 2024-05-08T18:08:34.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:08:34.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899159+0000", 2024-05-08T18:08:34.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3241999999999998e-05 2024-05-08T18:08:34.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899174+0000", 2024-05-08T18:08:34.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5235000000000001e-05 2024-05-08T18:08:34.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899316+0000", 2024-05-08T18:08:34.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014175599999999999 2024-05-08T18:08:34.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899525+0000", 2024-05-08T18:08:34.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020915300000000001 2024-05-08T18:08:34.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:34.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899872+0000", 2024-05-08T18:08:34.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034668299999999997 2024-05-08T18:08:34.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901064+0000", 2024-05-08T18:08:34.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001191473 2024-05-08T18:08:34.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901664+0000", 2024-05-08T18:08:34.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060054599999999998 2024-05-08T18:08:34.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901779+0000", 2024-05-08T18:08:34.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011452500000000001 2024-05-08T18:08:34.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901850+0000", 2024-05-08T18:08:34.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1580000000000002e-05 2024-05-08T18:08:34.828 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.829 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.829 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.829 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:612 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.829 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:34.829 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.901341834999997, 2024-05-08T18:08:34.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025904750000000001, 2024-05-08T18:08:34.829 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.829 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.829 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.829 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.829 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.829 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.830 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 612 2024-05-08T18:08:34.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.830 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:34.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:34.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904619+0000", 2024-05-08T18:08:34.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8479999999999999e-06 2024-05-08T18:08:34.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904628+0000", 2024-05-08T18:08:34.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8829999999999995e-06 2024-05-08T18:08:34.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904650+0000", 2024-05-08T18:08:34.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2467999999999999e-05 2024-05-08T18:08:34.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904669+0000", 2024-05-08T18:08:34.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9303000000000001e-05 2024-05-08T18:08:34.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904766+0000", 2024-05-08T18:08:34.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6917999999999996e-05 2024-05-08T18:08:34.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904935+0000", 2024-05-08T18:08:34.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000168441 2024-05-08T18:08:34.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:34.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.905288+0000", 2024-05-08T18:08:34.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035312199999999998 2024-05-08T18:08:34.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.906520+0000", 2024-05-08T18:08:34.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001232005 2024-05-08T18:08:34.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907086+0000", 2024-05-08T18:08:34.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056658900000000005 2024-05-08T18:08:34.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907154+0000", 2024-05-08T18:08:34.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7197000000000001e-05 2024-05-08T18:08:34.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907207+0000", 2024-05-08T18:08:34.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3701e-05 2024-05-08T18:08:34.834 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.834 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.834 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.835 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.835 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:34.835 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.733324241999995, 2024-05-08T18:08:34.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032464490000000002, 2024-05-08T18:08:34.835 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.835 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.835 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.835 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.835 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.835 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.835 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 742 2024-05-08T18:08:34.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.836 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:34.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:34.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072637+0000", 2024-05-08T18:08:34.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9059999999999998e-06 2024-05-08T18:08:34.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072651+0000", 2024-05-08T18:08:34.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3477e-05 2024-05-08T18:08:34.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072683+0000", 2024-05-08T18:08:34.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2116000000000002e-05 2024-05-08T18:08:34.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072698+0000", 2024-05-08T18:08:34.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5454000000000001e-05 2024-05-08T18:08:34.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072845+0000", 2024-05-08T18:08:34.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146532 2024-05-08T18:08:34.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073241+0000", 2024-05-08T18:08:34.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039580699999999997 2024-05-08T18:08:34.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.839 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:34.839 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073812+0000", 2024-05-08T18:08:34.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057164900000000003 2024-05-08T18:08:34.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.839 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.839 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075063+0000", 2024-05-08T18:08:34.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001250131 2024-05-08T18:08:34.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.839 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.839 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075723+0000", 2024-05-08T18:08:34.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00066039199999999999 2024-05-08T18:08:34.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075808+0000", 2024-05-08T18:08:34.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5458999999999996e-05 2024-05-08T18:08:34.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075881+0000", 2024-05-08T18:08:34.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2526000000000003e-05 2024-05-08T18:08:34.840 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.840 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.840 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.841 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.841 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:34.841 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.690915876999995, 2024-05-08T18:08:34.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029270590000000001, 2024-05-08T18:08:34.841 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.841 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.841 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.841 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.841 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.841 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.841 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 760 2024-05-08T18:08:34.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.841 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:34.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:34.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115045+0000", 2024-05-08T18:08:34.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0729999999999999e-06 2024-05-08T18:08:34.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115057+0000", 2024-05-08T18:08:34.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1617000000000001e-05 2024-05-08T18:08:34.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115088+0000", 2024-05-08T18:08:34.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1155999999999998e-05 2024-05-08T18:08:34.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115103+0000", 2024-05-08T18:08:34.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5067e-05 2024-05-08T18:08:34.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115289+0000", 2024-05-08T18:08:34.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186582 2024-05-08T18:08:34.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115506+0000", 2024-05-08T18:08:34.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021690500000000001 2024-05-08T18:08:34.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:34.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115832+0000", 2024-05-08T18:08:34.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032556799999999998 2024-05-08T18:08:34.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.116892+0000", 2024-05-08T18:08:34.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010597989999999999 2024-05-08T18:08:34.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117807+0000", 2024-05-08T18:08:34.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091502599999999999 2024-05-08T18:08:34.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117895+0000", 2024-05-08T18:08:34.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7977000000000001e-05 2024-05-08T18:08:34.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117970+0000", 2024-05-08T18:08:34.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5289000000000004e-05 2024-05-08T18:08:34.846 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.846 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.846 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.846 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.846 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:34.847 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.559918390999997, 2024-05-08T18:08:34.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028290730000000001, 2024-05-08T18:08:34.847 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.847 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.847 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.847 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.847 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.847 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.847 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 817 2024-05-08T18:08:34.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.847 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:34.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:34.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246043+0000", 2024-05-08T18:08:34.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.807e-06 2024-05-08T18:08:34.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246056+0000", 2024-05-08T18:08:34.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2383e-05 2024-05-08T18:08:34.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246087+0000", 2024-05-08T18:08:34.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1937000000000003e-05 2024-05-08T18:08:34.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246104+0000", 2024-05-08T18:08:34.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6643e-05 2024-05-08T18:08:34.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246225+0000", 2024-05-08T18:08:34.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012061900000000001 2024-05-08T18:08:34.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246510+0000", 2024-05-08T18:08:34.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028507100000000002 2024-05-08T18:08:34.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:34.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246881+0000", 2024-05-08T18:08:34.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037163799999999998 2024-05-08T18:08:34.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248078+0000", 2024-05-08T18:08:34.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011968969999999999 2024-05-08T18:08:34.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248715+0000", 2024-05-08T18:08:34.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063698599999999998 2024-05-08T18:08:34.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248801+0000", 2024-05-08T18:08:34.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5772999999999993e-05 2024-05-08T18:08:34.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248869+0000", 2024-05-08T18:08:34.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8318999999999994e-05 2024-05-08T18:08:34.852 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.852 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.852 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.853 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.853 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:34.853 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.506174907000002, 2024-05-08T18:08:34.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003281693, 2024-05-08T18:08:34.853 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.853 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.853 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.853 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.853 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.853 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.853 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 841 2024-05-08T18:08:34.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.853 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:34.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:34.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299786+0000", 2024-05-08T18:08:34.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4770000000000002e-06 2024-05-08T18:08:34.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299798+0000", 2024-05-08T18:08:34.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1493e-05 2024-05-08T18:08:34.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299827+0000", 2024-05-08T18:08:34.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9363e-05 2024-05-08T18:08:34.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299842+0000", 2024-05-08T18:08:34.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.448e-05 2024-05-08T18:08:34.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300001+0000", 2024-05-08T18:08:34.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015909600000000001 2024-05-08T18:08:34.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300384+0000", 2024-05-08T18:08:34.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038306000000000001 2024-05-08T18:08:34.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:34.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300929+0000", 2024-05-08T18:08:34.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054551299999999997 2024-05-08T18:08:34.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302151+0000", 2024-05-08T18:08:34.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012218540000000001 2024-05-08T18:08:34.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302918+0000", 2024-05-08T18:08:34.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076719099999999997 2024-05-08T18:08:34.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303000+0000", 2024-05-08T18:08:34.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1662999999999994e-05 2024-05-08T18:08:34.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303065+0000", 2024-05-08T18:08:34.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5502999999999999e-05 2024-05-08T18:08:34.858 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.858 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.858 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.858 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.858 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:34.858 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.501979450999997, 2024-05-08T18:08:34.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026179150000000002, 2024-05-08T18:08:34.858 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.859 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.859 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.859 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.859 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.859 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.859 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 843 2024-05-08T18:08:34.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.859 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:34.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303981+0000", 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9740000000000001e-06 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303990+0000", 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9889999999999998e-06 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304012+0000", 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1537000000000001e-05 2024-05-08T18:08:34.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304023+0000", 2024-05-08T18:08:34.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:08:34.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304101+0000", 2024-05-08T18:08:34.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7732999999999996e-05 2024-05-08T18:08:34.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304210+0000", 2024-05-08T18:08:34.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010985299999999999 2024-05-08T18:08:34.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:34.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304490+0000", 2024-05-08T18:08:34.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000279564 2024-05-08T18:08:34.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.305542+0000", 2024-05-08T18:08:34.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051976 2024-05-08T18:08:34.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306451+0000", 2024-05-08T18:08:34.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00090901999999999997 2024-05-08T18:08:34.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306533+0000", 2024-05-08T18:08:34.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1790000000000001e-05 2024-05-08T18:08:34.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306597+0000", 2024-05-08T18:08:34.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4332999999999995e-05 2024-05-08T18:08:34.863 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.863 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.863 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.864 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.864 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:34.864 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.492283240999996, 2024-05-08T18:08:34.864 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00275537, 2024-05-08T18:08:34.864 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.864 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.864 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.864 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.864 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.864 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.864 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 847 2024-05-08T18:08:34.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.864 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.864 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.864 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.864 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313678+0000", 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313689+0000", 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1273e-05 2024-05-08T18:08:34.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.866 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.866 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313719+0000", 2024-05-08T18:08:34.866 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9726e-05 2024-05-08T18:08:34.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.866 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.866 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313733+0000", 2024-05-08T18:08:34.866 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4487e-05 2024-05-08T18:08:34.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.866 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.866 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313858+0000", 2024-05-08T18:08:34.866 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125172 2024-05-08T18:08:34.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314072+0000", 2024-05-08T18:08:34.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021314200000000001 2024-05-08T18:08:34.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:34.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314378+0000", 2024-05-08T18:08:34.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030653100000000002 2024-05-08T18:08:34.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.315524+0000", 2024-05-08T18:08:34.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011458950000000001 2024-05-08T18:08:34.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.868 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316213+0000", 2024-05-08T18:08:34.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068942199999999997 2024-05-08T18:08:34.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.868 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316314+0000", 2024-05-08T18:08:34.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100723 2024-05-08T18:08:34.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.868 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316431+0000", 2024-05-08T18:08:34.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116759 2024-05-08T18:08:34.868 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.869 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.869 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.869 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.869 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:34.869 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.488631303999995, 2024-05-08T18:08:34.869 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025522510000000002, 2024-05-08T18:08:34.869 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.869 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.869 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.869 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.869 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.869 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.869 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 849 2024-05-08T18:08:34.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.870 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.870 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.870 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:34.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.870 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.870 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:34.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.870 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.870 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317329+0000", 2024-05-08T18:08:34.871 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9530000000000002e-06 2024-05-08T18:08:34.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.871 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.871 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317340+0000", 2024-05-08T18:08:34.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.08e-05 2024-05-08T18:08:34.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317364+0000", 2024-05-08T18:08:34.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4142999999999999e-05 2024-05-08T18:08:34.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.874 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317377+0000", 2024-05-08T18:08:34.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2764e-05 2024-05-08T18:08:34.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.874 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.874 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317471+0000", 2024-05-08T18:08:34.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4289000000000005e-05 2024-05-08T18:08:34.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.874 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.874 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317600+0000", 2024-05-08T18:08:34.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012910499999999999 2024-05-08T18:08:34.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.874 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:34.875 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317868+0000", 2024-05-08T18:08:34.875 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000267562 2024-05-08T18:08:34.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.875 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.875 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319081+0000", 2024-05-08T18:08:34.875 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001213387 2024-05-08T18:08:34.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.875 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.875 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319723+0000", 2024-05-08T18:08:34.875 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064134200000000004 2024-05-08T18:08:34.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.875 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.875 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319808+0000", 2024-05-08T18:08:34.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:34.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.876 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.876 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319880+0000", 2024-05-08T18:08:34.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1426000000000004e-05 2024-05-08T18:08:34.876 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.876 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.876 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.876 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.876 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:34.876 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.445198822999998, 2024-05-08T18:08:34.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002815157, 2024-05-08T18:08:34.876 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.877 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.877 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.877 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.877 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.877 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.877 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 868 2024-05-08T18:08:34.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.877 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.877 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.877 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:34.877 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:34.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360762+0000", 2024-05-08T18:08:34.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:08:34.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360775+0000", 2024-05-08T18:08:34.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2840000000000001e-05 2024-05-08T18:08:34.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360805+0000", 2024-05-08T18:08:34.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9686e-05 2024-05-08T18:08:34.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360819+0000", 2024-05-08T18:08:34.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.434e-05 2024-05-08T18:08:34.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360948+0000", 2024-05-08T18:08:34.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000129033 2024-05-08T18:08:34.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361166+0000", 2024-05-08T18:08:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021747800000000001 2024-05-08T18:08:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361481+0000", 2024-05-08T18:08:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031515800000000001 2024-05-08T18:08:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.362546+0000", 2024-05-08T18:08:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010653889999999999 2024-05-08T18:08:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.881 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.881 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363365+0000", 2024-05-08T18:08:34.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081906100000000005 2024-05-08T18:08:34.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.881 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.881 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363450+0000", 2024-05-08T18:08:34.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5202000000000002e-05 2024-05-08T18:08:34.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.881 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.881 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363575+0000", 2024-05-08T18:08:34.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012460999999999999 2024-05-08T18:08:34.881 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.882 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.882 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.882 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.882 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.882 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.882 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:34.882 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.441506649999994, 2024-05-08T18:08:34.882 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024676260000000001, 2024-05-08T18:08:34.882 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.882 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.882 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.882 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.882 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.883 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.883 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 870 2024-05-08T18:08:34.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.883 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:34.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:34.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364454+0000", 2024-05-08T18:08:34.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7770000000000001e-06 2024-05-08T18:08:34.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364463+0000", 2024-05-08T18:08:34.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4800000000000007e-06 2024-05-08T18:08:34.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364487+0000", 2024-05-08T18:08:34.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3589999999999999e-05 2024-05-08T18:08:34.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364499+0000", 2024-05-08T18:08:34.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.241e-05 2024-05-08T18:08:34.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364607+0000", 2024-05-08T18:08:34.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010760900000000001 2024-05-08T18:08:34.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.886 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.886 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364750+0000", 2024-05-08T18:08:34.886 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014265600000000001 2024-05-08T18:08:34.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.886 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:34.886 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.365021+0000", 2024-05-08T18:08:34.886 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027115100000000002 2024-05-08T18:08:34.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.886 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.887 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366163+0000", 2024-05-08T18:08:34.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011419189999999999 2024-05-08T18:08:34.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.887 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.887 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366727+0000", 2024-05-08T18:08:34.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056400199999999997 2024-05-08T18:08:34.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.887 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.887 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366810+0000", 2024-05-08T18:08:34.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3133000000000005e-05 2024-05-08T18:08:34.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.888 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.888 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366920+0000", 2024-05-08T18:08:34.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109899 2024-05-08T18:08:34.888 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.888 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.888 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.888 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.888 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:34.888 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.351592471999993, 2024-05-08T18:08:34.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027893459999999998, 2024-05-08T18:08:34.889 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.889 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.889 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.889 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.889 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.889 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.889 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 907 2024-05-08T18:08:34.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.889 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.889 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:34.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:34.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454369+0000", 2024-05-08T18:08:34.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5730000000000002e-06 2024-05-08T18:08:34.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454381+0000", 2024-05-08T18:08:34.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.208e-05 2024-05-08T18:08:34.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454413+0000", 2024-05-08T18:08:34.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2493000000000002e-05 2024-05-08T18:08:34.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454432+0000", 2024-05-08T18:08:34.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8862999999999999e-05 2024-05-08T18:08:34.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454577+0000", 2024-05-08T18:08:34.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014477899999999999 2024-05-08T18:08:34.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454800+0000", 2024-05-08T18:08:34.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223425 2024-05-08T18:08:34.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:34.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.455168+0000", 2024-05-08T18:08:34.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036712799999999999 2024-05-08T18:08:34.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456282+0000", 2024-05-08T18:08:34.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011141580000000001 2024-05-08T18:08:34.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456953+0000", 2024-05-08T18:08:34.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000670956 2024-05-08T18:08:34.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457038+0000", 2024-05-08T18:08:34.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4828999999999997e-05 2024-05-08T18:08:34.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457156+0000", 2024-05-08T18:08:34.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118062 2024-05-08T18:08:34.893 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.894 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.894 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.894 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.894 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:34.894 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.347900108999994, 2024-05-08T18:08:34.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026891609999999998, 2024-05-08T18:08:34.894 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.894 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.894 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.894 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.894 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.894 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.894 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 909 2024-05-08T18:08:34.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.895 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:34.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:34.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458060+0000", 2024-05-08T18:08:34.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:34.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458069+0000", 2024-05-08T18:08:34.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6440000000000006e-06 2024-05-08T18:08:34.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458090+0000", 2024-05-08T18:08:34.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1089000000000001e-05 2024-05-08T18:08:34.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458102+0000", 2024-05-08T18:08:34.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2306999999999999e-05 2024-05-08T18:08:34.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458191+0000", 2024-05-08T18:08:34.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8213000000000004e-05 2024-05-08T18:08:34.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458313+0000", 2024-05-08T18:08:34.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012231500000000001 2024-05-08T18:08:34.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:34.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458581+0000", 2024-05-08T18:08:34.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026762500000000001 2024-05-08T18:08:34.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.459773+0000", 2024-05-08T18:08:34.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001192991 2024-05-08T18:08:34.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460590+0000", 2024-05-08T18:08:34.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081618100000000002 2024-05-08T18:08:34.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460681+0000", 2024-05-08T18:08:34.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0946000000000006e-05 2024-05-08T18:08:34.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460748+0000", 2024-05-08T18:08:34.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7139999999999998e-05 2024-05-08T18:08:34.899 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.899 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.899 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.900 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.900 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:34.900 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.254257090999999, 2024-05-08T18:08:34.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030359179999999999, 2024-05-08T18:08:34.900 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.900 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.900 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.900 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.900 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.900 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.900 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 949 2024-05-08T18:08:34.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.900 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:34.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:34.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551705+0000", 2024-05-08T18:08:34.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2770000000000001e-06 2024-05-08T18:08:34.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551717+0000", 2024-05-08T18:08:34.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.206e-05 2024-05-08T18:08:34.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551747+0000", 2024-05-08T18:08:34.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0168999999999999e-05 2024-05-08T18:08:34.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551763+0000", 2024-05-08T18:08:34.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:08:34.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551880+0000", 2024-05-08T18:08:34.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116976 2024-05-08T18:08:34.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552099+0000", 2024-05-08T18:08:34.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021910199999999999 2024-05-08T18:08:34.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:34.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552476+0000", 2024-05-08T18:08:34.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000376697 2024-05-08T18:08:34.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.553551+0000", 2024-05-08T18:08:34.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001074925 2024-05-08T18:08:34.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554588+0000", 2024-05-08T18:08:34.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010374099999999999 2024-05-08T18:08:34.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554671+0000", 2024-05-08T18:08:34.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3368999999999994e-05 2024-05-08T18:08:34.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554738+0000", 2024-05-08T18:08:34.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6043000000000004e-05 2024-05-08T18:08:34.905 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.905 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.905 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.905 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.905 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:34.905 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.240643653000006, 2024-05-08T18:08:34.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028304160000000001, 2024-05-08T18:08:34.906 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.906 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.906 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.906 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.906 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.906 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.906 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 955 2024-05-08T18:08:34.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.906 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:34.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:34.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565318+0000", 2024-05-08T18:08:34.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7030000000000002e-06 2024-05-08T18:08:34.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565330+0000", 2024-05-08T18:08:34.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.204e-05 2024-05-08T18:08:34.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565363+0000", 2024-05-08T18:08:34.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2722999999999998e-05 2024-05-08T18:08:34.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565389+0000", 2024-05-08T18:08:34.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6412999999999999e-05 2024-05-08T18:08:34.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565510+0000", 2024-05-08T18:08:34.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120932 2024-05-08T18:08:34.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565722+0000", 2024-05-08T18:08:34.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212139 2024-05-08T18:08:34.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:34.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.566034+0000", 2024-05-08T18:08:34.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000312038 2024-05-08T18:08:34.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567340+0000", 2024-05-08T18:08:34.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00130547 2024-05-08T18:08:34.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567998+0000", 2024-05-08T18:08:34.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000658382 2024-05-08T18:08:34.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568081+0000", 2024-05-08T18:08:34.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3269999999999994e-05 2024-05-08T18:08:34.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568145+0000", 2024-05-08T18:08:34.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4306000000000004e-05 2024-05-08T18:08:34.911 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.911 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.911 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.911 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:34.911 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:34.911 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 67.236924130000006, 2024-05-08T18:08:34.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027506660000000001, 2024-05-08T18:08:34.912 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:34.912 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:34.912 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:34.912 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:34.912 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:34.912 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:34.912 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 957 2024-05-08T18:08:34.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.912 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:34.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:34.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:34.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:34.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:34.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:34.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:34.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569036+0000", 2024-05-08T18:08:34.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.776e-06 2024-05-08T18:08:34.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:34.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569061+0000", 2024-05-08T18:08:34.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5097e-05 2024-05-08T18:08:34.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:34.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569084+0000", 2024-05-08T18:08:34.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.23e-05 2024-05-08T18:08:34.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:34.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569096+0000", 2024-05-08T18:08:34.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.22e-05 2024-05-08T18:08:34.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:34.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569180+0000", 2024-05-08T18:08:34.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4369000000000005e-05 2024-05-08T18:08:34.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:34.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569296+0000", 2024-05-08T18:08:34.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115999 2024-05-08T18:08:34.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:34.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569550+0000", 2024-05-08T18:08:34.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025397499999999998 2024-05-08T18:08:34.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:34.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.570963+0000", 2024-05-08T18:08:34.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001413023 2024-05-08T18:08:34.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571614+0000", 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065041199999999995 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571701+0000", 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7569000000000001e-05 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571785+0000", 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3945999999999999e-05 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.916 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:34.917 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:34.917 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:34.917 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:08:34.919 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:08:34.919 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:34.918+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:35.019 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:35.018+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:35.086 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:35.086 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:35.086 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:35.086 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:35.105 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:08:35.120 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:35.122+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:35.123 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:08:35.220 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:35.221+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:35.260 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:35.260 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:35.261 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:35.261 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:35.261 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:35.278 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:08:35.322 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:35.325+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:35.351 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:35.351 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:35.382 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:35.382 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:35.413 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:35.413 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:35.422 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:35.425+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:35.442 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:35.442 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:35.464 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:35.464 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:35.475 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:35.475 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:35.481 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:08:35.505 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:35.505 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:35.523 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:35.525+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:35.533 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:35.534 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:35.559 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:35.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:35.615 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:35.615 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:35.625 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:35.626+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:35.629 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:08:35.725 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:35.725+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:35.796 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:35.796 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:35.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:08:35.826 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:35.829+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:35.887 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-05-08T18:08:35.927 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:35.926+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:35.934 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:35.934 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:35.948 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:08:36.040 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:36.042+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:36.115 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:36.115 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:36.129 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:36.130+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:36.130 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:08:36.229 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:36.229+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:36.295 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:36.295 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:36.309 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:08:36.352 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:36.354+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:36.425 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:36.425 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:36.431 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:36.433+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:36.439 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:08:36.532 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:36.534+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:36.604 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:36.604 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:36.618 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:08:36.633 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:36.633+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:36.734 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:36.737+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:36.781 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:36.781 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:36.795 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:08:36.835 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:36.837+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:36.912 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:36.913 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:36.927 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:08:36.976 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:36.978+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:37.036 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:37.037+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:37.049 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:37.049 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:37.063 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:08:37.137 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:37.137+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:37.226 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:37.226 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:37.237 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:37.237+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:37.240 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:08:37.338 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:37.341+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:37.357 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:37.357 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:37.371 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:08:37.439 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:37.437+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:37.521 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:37.521 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:37.534 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:08:37.580 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:08:37.582 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:37.585+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:37.641 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:37.641+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:37.685 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:37.920 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:37.921 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:08:37.922 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:08:37.923 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:37.923 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:37.923 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:37.923 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:37.924 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:37.924 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:37.924 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:37.925 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:37.925 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:37.925 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:37.925 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:37.926 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:37.926 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:37.926 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:37.927 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:37.927 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:37.928 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:37.921+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:38.022 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:38.021+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:38.065 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:52 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'31)", 2024-05-08T18:08:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:08:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.942019463999998, 2024-05-08T18:08:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00409947, 2024-05-08T18:08:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.065 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:08:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127166+0000", 2024-05-08T18:08:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127167+0000", 2024-05-08T18:08:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7800000000000001e-07 2024-05-08T18:08:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127172+0000", 2024-05-08T18:08:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1120000000000004e-06 2024-05-08T18:08:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127183+0000", 2024-05-08T18:08:38.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1107000000000001e-05 2024-05-08T18:08:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127189+0000", 2024-05-08T18:08:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0310000000000004e-06 2024-05-08T18:08:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127237+0000", 2024-05-08T18:08:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7907000000000001e-05 2024-05-08T18:08:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.127252+0000", 2024-05-08T18:08:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5373e-05 2024-05-08T18:08:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131206+0000", 2024-05-08T18:08:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039540199999999999 2024-05-08T18:08:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.131265+0000", 2024-05-08T18:08:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9141999999999997e-05 2024-05-08T18:08:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.069 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-05-08T18:08:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:08:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.933261060000007, 2024-05-08T18:08:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049265589999999996, 2024-05-08T18:08:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:08:38.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135924+0000", 2024-05-08T18:08:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.135925+0000", 2024-05-08T18:08:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8100000000000002e-07 2024-05-08T18:08:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136007+0000", 2024-05-08T18:08:38.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1864000000000001e-05 2024-05-08T18:08:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136019+0000", 2024-05-08T18:08:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2438e-05 2024-05-08T18:08:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136026+0000", 2024-05-08T18:08:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0809999999999996e-06 2024-05-08T18:08:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136093+0000", 2024-05-08T18:08:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6769999999999999e-05 2024-05-08T18:08:38.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.136108+0000", 2024-05-08T18:08:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.465e-05 2024-05-08T18:08:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140800+0000", 2024-05-08T18:08:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046919450000000003 2024-05-08T18:08:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.140851+0000", 2024-05-08T18:08:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.113e-05 2024-05-08T18:08:38.073 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-05-08T18:08:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:08:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.716775850000005, 2024-05-08T18:08:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042257299999999996, 2024-05-08T18:08:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:08:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352409+0000", 2024-05-08T18:08:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352410+0000", 2024-05-08T18:08:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7599999999999997e-07 2024-05-08T18:08:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352489+0000", 2024-05-08T18:08:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8564000000000002e-05 2024-05-08T18:08:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352500+0000", 2024-05-08T18:08:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1411e-05 2024-05-08T18:08:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352506+0000", 2024-05-08T18:08:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7309999999999998e-06 2024-05-08T18:08:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352569+0000", 2024-05-08T18:08:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3173e-05 2024-05-08T18:08:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.352598+0000", 2024-05-08T18:08:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8855000000000001e-05 2024-05-08T18:08:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356592+0000", 2024-05-08T18:08:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039941539999999998 2024-05-08T18:08:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.356635+0000", 2024-05-08T18:08:38.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3166e-05 2024-05-08T18:08:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:75 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'53, mlcod=15'43)", 2024-05-08T18:08:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:08:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.708604433000005, 2024-05-08T18:08:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063708030000000004, 2024-05-08T18:08:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:08:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:08:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360581+0000", 2024-05-08T18:08:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:08:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360641+0000", 2024-05-08T18:08:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9273e-05 2024-05-08T18:08:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360651+0000", 2024-05-08T18:08:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0353000000000001e-05 2024-05-08T18:08:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360659+0000", 2024-05-08T18:08:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4789999999999999e-06 2024-05-08T18:08:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360720+0000", 2024-05-08T18:08:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699000000000007e-05 2024-05-08T18:08:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.360739+0000", 2024-05-08T18:08:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8913999999999999e-05 2024-05-08T18:08:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366883+0000", 2024-05-08T18:08:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061438229999999996 2024-05-08T18:08:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366952+0000", 2024-05-08T18:08:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8677000000000007e-05 2024-05-08T18:08:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:76 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'54, mlcod=15'49)", 2024-05-08T18:08:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:08:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.706867927999994, 2024-05-08T18:08:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046550610000000003, 2024-05-08T18:08:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:08:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362317+0000", 2024-05-08T18:08:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362318+0000", 2024-05-08T18:08:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.99e-07 2024-05-08T18:08:38.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362323+0000", 2024-05-08T18:08:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.566e-06 2024-05-08T18:08:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362334+0000", 2024-05-08T18:08:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1403000000000001e-05 2024-05-08T18:08:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362342+0000", 2024-05-08T18:08:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3420000000000008e-06 2024-05-08T18:08:38.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362396+0000", 2024-05-08T18:08:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3476000000000001e-05 2024-05-08T18:08:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.362415+0000", 2024-05-08T18:08:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8787000000000002e-05 2024-05-08T18:08:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366954+0000", 2024-05-08T18:08:38.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045388609999999999 2024-05-08T18:08:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.366972+0000", 2024-05-08T18:08:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8927e-05 2024-05-08T18:08:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:79 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'57, mlcod=15'53)", 2024-05-08T18:08:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:08:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.699472, 2024-05-08T18:08:38.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045322499999999998, 2024-05-08T18:08:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:08:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369713+0000", 2024-05-08T18:08:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369714+0000", 2024-05-08T18:08:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8500000000000001e-07 2024-05-08T18:08:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369787+0000", 2024-05-08T18:08:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3317000000000003e-05 2024-05-08T18:08:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369797+0000", 2024-05-08T18:08:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9510000000000001e-06 2024-05-08T18:08:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369802+0000", 2024-05-08T18:08:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8210000000000001e-06 2024-05-08T18:08:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369854+0000", 2024-05-08T18:08:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1751e-05 2024-05-08T18:08:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.369880+0000", 2024-05-08T18:08:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6577999999999999e-05 2024-05-08T18:08:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374202+0000", 2024-05-08T18:08:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217029999999997 2024-05-08T18:08:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.374246+0000", 2024-05-08T18:08:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3544000000000002e-05 2024-05-08T18:08:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:89 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'63, mlcod=15'60)", 2024-05-08T18:08:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:08:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.365929835000003, 2024-05-08T18:08:38.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057729900000000004, 2024-05-08T18:08:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:08:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:08:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703256+0000", 2024-05-08T18:08:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:08:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703261+0000", 2024-05-08T18:08:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2569999999999998e-06 2024-05-08T18:08:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703272+0000", 2024-05-08T18:08:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0739e-05 2024-05-08T18:08:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703282+0000", 2024-05-08T18:08:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6250000000000002e-06 2024-05-08T18:08:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703333+0000", 2024-05-08T18:08:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1588000000000001e-05 2024-05-08T18:08:38.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.703358+0000", 2024-05-08T18:08:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4913999999999999e-05 2024-05-08T18:08:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708907+0000", 2024-05-08T18:08:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055484829999999999 2024-05-08T18:08:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.709028+0000", 2024-05-08T18:08:38.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121667 2024-05-08T18:08:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-05-08T18:08:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:08:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.364864318000002, 2024-05-08T18:08:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0074185579999999996, 2024-05-08T18:08:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:08:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704321+0000", 2024-05-08T18:08:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704322+0000", 2024-05-08T18:08:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8299999999999997e-07 2024-05-08T18:08:38.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704410+0000", 2024-05-08T18:08:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8552000000000002e-05 2024-05-08T18:08:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704421+0000", 2024-05-08T18:08:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0794e-05 2024-05-08T18:08:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704427+0000", 2024-05-08T18:08:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8699999999999997e-06 2024-05-08T18:08:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704481+0000", 2024-05-08T18:08:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4410999999999998e-05 2024-05-08T18:08:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.704511+0000", 2024-05-08T18:08:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9906000000000001e-05 2024-05-08T18:08:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711682+0000", 2024-05-08T18:08:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071710209999999996 2024-05-08T18:08:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711740+0000", 2024-05-08T18:08:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7521e-05 2024-05-08T18:08:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:91 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'65, mlcod=15'60)", 2024-05-08T18:08:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:08:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.363320125000001, 2024-05-08T18:08:38.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059345600000000002, 2024-05-08T18:08:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:08:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705865+0000", 2024-05-08T18:08:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705866+0000", 2024-05-08T18:08:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0900000000000001e-07 2024-05-08T18:08:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705872+0000", 2024-05-08T18:08:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0580000000000003e-06 2024-05-08T18:08:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705883+0000", 2024-05-08T18:08:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0986e-05 2024-05-08T18:08:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705889+0000", 2024-05-08T18:08:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6400000000000002e-06 2024-05-08T18:08:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705942+0000", 2024-05-08T18:08:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3726e-05 2024-05-08T18:08:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.705963+0000", 2024-05-08T18:08:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0713e-05 2024-05-08T18:08:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711744+0000", 2024-05-08T18:08:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057812669999999997 2024-05-08T18:08:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711800+0000", 2024-05-08T18:08:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5461000000000003e-05 2024-05-08T18:08:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:92 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'66, mlcod=15'61)", 2024-05-08T18:08:38.103 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:08:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.361995777000004, 2024-05-08T18:08:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046553640000000004, 2024-05-08T18:08:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:08:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707190+0000", 2024-05-08T18:08:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707191+0000", 2024-05-08T18:08:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9300000000000006e-07 2024-05-08T18:08:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707198+0000", 2024-05-08T18:08:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4669999999999998e-06 2024-05-08T18:08:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707214+0000", 2024-05-08T18:08:38.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5911000000000001e-05 2024-05-08T18:08:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707221+0000", 2024-05-08T18:08:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.43e-06 2024-05-08T18:08:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707283+0000", 2024-05-08T18:08:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1974e-05 2024-05-08T18:08:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.707308+0000", 2024-05-08T18:08:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4589000000000001e-05 2024-05-08T18:08:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711802+0000", 2024-05-08T18:08:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044944939999999999 2024-05-08T18:08:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.711845+0000", 2024-05-08T18:08:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2506000000000003e-05 2024-05-08T18:08:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4203.0:93 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'67, mlcod=15'61)", 2024-05-08T18:08:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:08:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.36116552, 2024-05-08T18:08:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043217760000000003, 2024-05-08T18:08:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:08:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708020+0000", 2024-05-08T18:08:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708021+0000", 2024-05-08T18:08:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.92e-07 2024-05-08T18:08:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708106+0000", 2024-05-08T18:08:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5400000000000002e-05 2024-05-08T18:08:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708116+0000", 2024-05-08T18:08:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0482000000000001e-05 2024-05-08T18:08:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708124+0000", 2024-05-08T18:08:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5349999999999999e-06 2024-05-08T18:08:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708182+0000", 2024-05-08T18:08:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8130000000000001e-05 2024-05-08T18:08:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.708203+0000", 2024-05-08T18:08:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1118e-05 2024-05-08T18:08:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712298+0000", 2024-05-08T18:08:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004094688 2024-05-08T18:08:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:03.712342+0000", 2024-05-08T18:08:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3730999999999999e-05 2024-05-08T18:08:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.111 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:08:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.464739453999996, 2024-05-08T18:08:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087837890000000002, 2024-05-08T18:08:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 210 2024-05-08T18:08:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.112 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:08:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604446+0000", 2024-05-08T18:08:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604448+0000", 2024-05-08T18:08:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4229999999999999e-06 2024-05-08T18:08:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604460+0000", 2024-05-08T18:08:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:08:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604491+0000", 2024-05-08T18:08:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1004000000000003e-05 2024-05-08T18:08:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604513+0000", 2024-05-08T18:08:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1886e-05 2024-05-08T18:08:38.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604670+0000", 2024-05-08T18:08:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000156735 2024-05-08T18:08:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:08:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.604680+0000", 2024-05-08T18:08:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0113e-05 2024-05-08T18:08:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609236+0000", 2024-05-08T18:08:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045557269999999999 2024-05-08T18:08:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.609544+0000", 2024-05-08T18:08:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030863800000000002 2024-05-08T18:08:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.610952+0000", 2024-05-08T18:08:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014077269999999999 2024-05-08T18:08:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.612639+0000", 2024-05-08T18:08:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001686398 2024-05-08T18:08:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613101+0000", 2024-05-08T18:08:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00046249600000000001 2024-05-08T18:08:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613176+0000", 2024-05-08T18:08:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5032999999999998e-05 2024-05-08T18:08:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.613230+0000", 2024-05-08T18:08:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3638999999999999e-05 2024-05-08T18:08:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.117 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:08:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.416151244000005, 2024-05-08T18:08:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046602199999999996, 2024-05-08T18:08:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.118 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 222 2024-05-08T18:08:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:08:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653034+0000", 2024-05-08T18:08:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653037+0000", 2024-05-08T18:08:38.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:08:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653048+0000", 2024-05-08T18:08:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:08:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653077+0000", 2024-05-08T18:08:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9326e-05 2024-05-08T18:08:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653098+0000", 2024-05-08T18:08:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1327000000000001e-05 2024-05-08T18:08:38.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653230+0000", 2024-05-08T18:08:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013206599999999999 2024-05-08T18:08:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653444+0000", 2024-05-08T18:08:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000213401 2024-05-08T18:08:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.653852+0000", 2024-05-08T18:08:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040808700000000001 2024-05-08T18:08:38.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.656108+0000", 2024-05-08T18:08:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022565739999999999 2024-05-08T18:08:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657533+0000", 2024-05-08T18:08:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014241799999999999 2024-05-08T18:08:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657629+0000", 2024-05-08T18:08:38.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6435999999999996e-05 2024-05-08T18:08:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.657694+0000", 2024-05-08T18:08:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5349000000000001e-05 2024-05-08T18:08:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:461 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:08:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.289529438000002, 2024-05-08T18:08:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040933549999999999, 2024-05-08T18:08:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.123 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 461 2024-05-08T18:08:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:08:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779656+0000", 2024-05-08T18:08:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779657+0000", 2024-05-08T18:08:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.252e-06 2024-05-08T18:08:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779663+0000", 2024-05-08T18:08:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0170000000000002e-06 2024-05-08T18:08:38.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779676+0000", 2024-05-08T18:08:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.296e-05 2024-05-08T18:08:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779684+0000", 2024-05-08T18:08:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4209999999999998e-06 2024-05-08T18:08:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779736+0000", 2024-05-08T18:08:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2296999999999998e-05 2024-05-08T18:08:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779787+0000", 2024-05-08T18:08:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0954e-05 2024-05-08T18:08:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779897+0000", 2024-05-08T18:08:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011001999999999999 2024-05-08T18:08:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780506+0000", 2024-05-08T18:08:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060872599999999997 2024-05-08T18:08:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783690+0000", 2024-05-08T18:08:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031847210000000002 2024-05-08T18:08:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783722+0000", 2024-05-08T18:08:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1608e-05 2024-05-08T18:08:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783749+0000", 2024-05-08T18:08:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7379e-05 2024-05-08T18:08:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:491 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:08:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.267265829999999, 2024-05-08T18:08:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059507570000000001, 2024-05-08T18:08:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.129 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 491 2024-05-08T18:08:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:08:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801920+0000", 2024-05-08T18:08:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801921+0000", 2024-05-08T18:08:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6959999999999999e-06 2024-05-08T18:08:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801928+0000", 2024-05-08T18:08:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0299999999999996e-06 2024-05-08T18:08:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801944+0000", 2024-05-08T18:08:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285e-05 2024-05-08T18:08:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.801953+0000", 2024-05-08T18:08:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1849999999999993e-06 2024-05-08T18:08:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802008+0000", 2024-05-08T18:08:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5379e-05 2024-05-08T18:08:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802093+0000", 2024-05-08T18:08:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4907000000000005e-05 2024-05-08T18:08:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802217+0000", 2024-05-08T18:08:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000124253 2024-05-08T18:08:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.802725+0000", 2024-05-08T18:08:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050758699999999999 2024-05-08T18:08:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807807+0000", 2024-05-08T18:08:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005082133 2024-05-08T18:08:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807840+0000", 2024-05-08T18:08:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3399000000000003e-05 2024-05-08T18:08:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.807870+0000", 2024-05-08T18:08:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9903000000000002e-05 2024-05-08T18:08:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.134 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:08:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.260923625999993, 2024-05-08T18:08:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056057140000000004, 2024-05-08T18:08:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 502 2024-05-08T18:08:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:08:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808262+0000", 2024-05-08T18:08:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808263+0000", 2024-05-08T18:08:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.054e-06 2024-05-08T18:08:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808268+0000", 2024-05-08T18:08:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4829999999999999e-06 2024-05-08T18:08:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808279+0000", 2024-05-08T18:08:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0710000000000001e-05 2024-05-08T18:08:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808285+0000", 2024-05-08T18:08:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0610000000000001e-06 2024-05-08T18:08:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808331+0000", 2024-05-08T18:08:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5939000000000002e-05 2024-05-08T18:08:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808380+0000", 2024-05-08T18:08:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9382999999999998e-05 2024-05-08T18:08:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:38.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.808484+0000", 2024-05-08T18:08:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010410499999999999 2024-05-08T18:08:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.809035+0000", 2024-05-08T18:08:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000550969 2024-05-08T18:08:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813811+0000", 2024-05-08T18:08:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047759830000000001 2024-05-08T18:08:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813842+0000", 2024-05-08T18:08:38.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0778000000000002e-05 2024-05-08T18:08:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.813867+0000", 2024-05-08T18:08:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5249000000000002e-05 2024-05-08T18:08:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:08:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.234393339999997, 2024-05-08T18:08:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041392019999999998, 2024-05-08T18:08:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.141 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 527 2024-05-08T18:08:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:08:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834792+0000", 2024-05-08T18:08:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834793+0000", 2024-05-08T18:08:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.212e-06 2024-05-08T18:08:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834799+0000", 2024-05-08T18:08:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.468e-06 2024-05-08T18:08:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834811+0000", 2024-05-08T18:08:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2602000000000001e-05 2024-05-08T18:08:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834819+0000", 2024-05-08T18:08:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6660000000000008e-06 2024-05-08T18:08:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834871+0000", 2024-05-08T18:08:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2450000000000001e-05 2024-05-08T18:08:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.834973+0000", 2024-05-08T18:08:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101778 2024-05-08T18:08:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835114+0000", 2024-05-08T18:08:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014053399999999999 2024-05-08T18:08:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.835758+0000", 2024-05-08T18:08:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064386100000000002 2024-05-08T18:08:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838876+0000", 2024-05-08T18:08:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031188890000000001 2024-05-08T18:08:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838907+0000", 2024-05-08T18:08:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-08T18:08:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.838931+0000", 2024-05-08T18:08:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3822999999999999e-05 2024-05-08T18:08:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.146 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:08:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.229888360000004, 2024-05-08T18:08:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048358089999999999, 2024-05-08T18:08:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 534 2024-05-08T18:08:38.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:08:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839297+0000", 2024-05-08T18:08:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839298+0000", 2024-05-08T18:08:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1429999999999999e-06 2024-05-08T18:08:38.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839304+0000", 2024-05-08T18:08:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4380000000000003e-06 2024-05-08T18:08:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839313+0000", 2024-05-08T18:08:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5210000000000008e-06 2024-05-08T18:08:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839318+0000", 2024-05-08T18:08:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0540000000000002e-06 2024-05-08T18:08:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839355+0000", 2024-05-08T18:08:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6541999999999997e-05 2024-05-08T18:08:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839400+0000", 2024-05-08T18:08:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4861999999999998e-05 2024-05-08T18:08:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.839504+0000", 2024-05-08T18:08:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104169 2024-05-08T18:08:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.840046+0000", 2024-05-08T18:08:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054245400000000005 2024-05-08T18:08:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844075+0000", 2024-05-08T18:08:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040287559999999997 2024-05-08T18:08:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844108+0000", 2024-05-08T18:08:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2872e-05 2024-05-08T18:08:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.844133+0000", 2024-05-08T18:08:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4998e-05 2024-05-08T18:08:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:544 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:08:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.216745349999997, 2024-05-08T18:08:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052743060000000003, 2024-05-08T18:08:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.152 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 544 2024-05-08T18:08:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:08:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852440+0000", 2024-05-08T18:08:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852442+0000", 2024-05-08T18:08:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.88e-06 2024-05-08T18:08:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852450+0000", 2024-05-08T18:08:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1999999999999994e-06 2024-05-08T18:08:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852472+0000", 2024-05-08T18:08:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2160000000000001e-05 2024-05-08T18:08:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852487+0000", 2024-05-08T18:08:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5044e-05 2024-05-08T18:08:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852550+0000", 2024-05-08T18:08:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3152999999999997e-05 2024-05-08T18:08:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852608+0000", 2024-05-08T18:08:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8026000000000003e-05 2024-05-08T18:08:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852727+0000", 2024-05-08T18:08:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118919 2024-05-08T18:08:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.853180+0000", 2024-05-08T18:08:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045216599999999999 2024-05-08T18:08:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857638+0000", 2024-05-08T18:08:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044584510000000004 2024-05-08T18:08:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857672+0000", 2024-05-08T18:08:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3571000000000001e-05 2024-05-08T18:08:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.857714+0000", 2024-05-08T18:08:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2735999999999999e-05 2024-05-08T18:08:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:08:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 70.888916570999996, 2024-05-08T18:08:38.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004733213, 2024-05-08T18:08:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 789 2024-05-08T18:08:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:08:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180269+0000", 2024-05-08T18:08:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180271+0000", 2024-05-08T18:08:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8700000000000001e-06 2024-05-08T18:08:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180281+0000", 2024-05-08T18:08:38.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0067e-05 2024-05-08T18:08:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180311+0000", 2024-05-08T18:08:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0783e-05 2024-05-08T18:08:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180333+0000", 2024-05-08T18:08:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1509999999999999e-05 2024-05-08T18:08:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180450+0000", 2024-05-08T18:08:38.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116686 2024-05-08T18:08:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180581+0000", 2024-05-08T18:08:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013103499999999999 2024-05-08T18:08:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.180848+0000", 2024-05-08T18:08:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026750199999999997 2024-05-08T18:08:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184268+0000", 2024-05-08T18:08:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034198319999999998 2024-05-08T18:08:38.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184844+0000", 2024-05-08T18:08:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057643899999999999 2024-05-08T18:08:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184933+0000", 2024-05-08T18:08:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8692999999999999e-05 2024-05-08T18:08:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.185002+0000", 2024-05-08T18:08:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8795999999999997e-05 2024-05-08T18:08:38.162 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.163 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.163 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:38.164 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:08:38.165 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:38.165+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:38.265 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:38.265+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:38.273 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:38.273 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:38.273 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:38.273 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:38.285 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:08:38.365 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:38.365+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:38.423 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:38.424 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:38.424 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:38.436 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:08:38.467 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:38.465+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:38.568 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:38.569+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:38.609 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 75.043643185999997, 2024-05-08T18:08:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035750999999999999, 2024-05-08T18:08:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570203+0000", 2024-05-08T18:08:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6749999999999996e-06 2024-05-08T18:08:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570213+0000", 2024-05-08T18:08:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0139999999999999e-05 2024-05-08T18:08:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570231+0000", 2024-05-08T18:08:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8402000000000001e-05 2024-05-08T18:08:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570245+0000", 2024-05-08T18:08:38.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3135e-05 2024-05-08T18:08:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570338+0000", 2024-05-08T18:08:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3498000000000005e-05 2024-05-08T18:08:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570373+0000", 2024-05-08T18:08:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5179999999999999e-05 2024-05-08T18:08:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573694+0000", 2024-05-08T18:08:38.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003320524 2024-05-08T18:08:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573771+0000", 2024-05-08T18:08:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7546000000000006e-05 2024-05-08T18:08:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-05-08T18:08:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 75.038330224000006, 2024-05-08T18:08:38.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038280229999999998, 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575510+0000", 2024-05-08T18:08:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0979999999999999e-06 2024-05-08T18:08:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575527+0000", 2024-05-08T18:08:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6393999999999999e-05 2024-05-08T18:08:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575549+0000", 2024-05-08T18:08:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1843000000000001e-05 2024-05-08T18:08:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575560+0000", 2024-05-08T18:08:38.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.186e-05 2024-05-08T18:08:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575651+0000", 2024-05-08T18:08:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1068000000000003e-05 2024-05-08T18:08:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575685+0000", 2024-05-08T18:08:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3614e-05 2024-05-08T18:08:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579231+0000", 2024-05-08T18:08:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003546249 2024-05-08T18:08:38.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579337+0000", 2024-05-08T18:08:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010589700000000001 2024-05-08T18:08:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-05-08T18:08:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 75.036292932999999, 2024-05-08T18:08:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004223157, 2024-05-08T18:08:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.618 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577548+0000", 2024-05-08T18:08:38.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.66e-06 2024-05-08T18:08:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577561+0000", 2024-05-08T18:08:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2533e-05 2024-05-08T18:08:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577585+0000", 2024-05-08T18:08:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3873e-05 2024-05-08T18:08:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577605+0000", 2024-05-08T18:08:38.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0477000000000001e-05 2024-05-08T18:08:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577717+0000", 2024-05-08T18:08:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011229499999999999 2024-05-08T18:08:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577777+0000", 2024-05-08T18:08:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.944e-05 2024-05-08T18:08:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581704+0000", 2024-05-08T18:08:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039267800000000004 2024-05-08T18:08:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581770+0000", 2024-05-08T18:08:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6099000000000005e-05 2024-05-08T18:08:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:54 7.d e29/28 7:b4812045:::notify.4:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:38.622 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 75.033480209000004, 2024-05-08T18:08:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003988503, 2024-05-08T18:08:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580368+0000", 2024-05-08T18:08:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3089999999999996e-06 2024-05-08T18:08:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580400+0000", 2024-05-08T18:08:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2580000000000003e-05 2024-05-08T18:08:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580427+0000", 2024-05-08T18:08:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6976999999999999e-05 2024-05-08T18:08:38.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580443+0000", 2024-05-08T18:08:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5585000000000001e-05 2024-05-08T18:08:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580555+0000", 2024-05-08T18:08:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112639 2024-05-08T18:08:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580601+0000", 2024-05-08T18:08:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6e-05 2024-05-08T18:08:38.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584229+0000", 2024-05-08T18:08:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036273659999999999 2024-05-08T18:08:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584348+0000", 2024-05-08T18:08:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119047 2024-05-08T18:08:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 74.924066938999999, 2024-05-08T18:08:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032136159999999999, 2024-05-08T18:08:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 193 2024-05-08T18:08:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689775+0000", 2024-05-08T18:08:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.357e-06 2024-05-08T18:08:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689788+0000", 2024-05-08T18:08:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3029e-05 2024-05-08T18:08:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689819+0000", 2024-05-08T18:08:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.065e-05 2024-05-08T18:08:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689833+0000", 2024-05-08T18:08:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4790000000000001e-05 2024-05-08T18:08:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689948+0000", 2024-05-08T18:08:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115089 2024-05-08T18:08:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690155+0000", 2024-05-08T18:08:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206932 2024-05-08T18:08:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690420+0000", 2024-05-08T18:08:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026450200000000001 2024-05-08T18:08:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692229+0000", 2024-05-08T18:08:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001808823 2024-05-08T18:08:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692816+0000", 2024-05-08T18:08:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058773199999999999 2024-05-08T18:08:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692915+0000", 2024-05-08T18:08:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8646000000000004e-05 2024-05-08T18:08:38.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692986+0000", 2024-05-08T18:08:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1066e-05 2024-05-08T18:08:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.025100719999998, 2024-05-08T18:08:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089431319999999995, 2024-05-08T18:08:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 208 2024-05-08T18:08:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588741+0000", 2024-05-08T18:08:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:08:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588752+0000", 2024-05-08T18:08:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0813e-05 2024-05-08T18:08:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588782+0000", 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0020000000000001e-05 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588803+0000", 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1115999999999999e-05 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588943+0000", 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013971599999999999 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588954+0000", 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1365999999999999e-05 2024-05-08T18:08:38.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594340+0000", 2024-05-08T18:08:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053854910000000001 2024-05-08T18:08:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594670+0000", 2024-05-08T18:08:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000330055 2024-05-08T18:08:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.595179+0000", 2024-05-08T18:08:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050879199999999999 2024-05-08T18:08:38.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.596408+0000", 2024-05-08T18:08:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012295209999999999 2024-05-08T18:08:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597532+0000", 2024-05-08T18:08:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011233860000000001 2024-05-08T18:08:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597619+0000", 2024-05-08T18:08:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7775999999999994e-05 2024-05-08T18:08:38.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597682+0000", 2024-05-08T18:08:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2522999999999998e-05 2024-05-08T18:08:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.996471740999993, 2024-05-08T18:08:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031262669999999998, 2024-05-08T18:08:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.638 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 212 2024-05-08T18:08:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617370+0000", 2024-05-08T18:08:38.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:08:38.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617379+0000", 2024-05-08T18:08:38.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2359999999999993e-06 2024-05-08T18:08:38.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617405+0000", 2024-05-08T18:08:38.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5639999999999998e-05 2024-05-08T18:08:38.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617425+0000", 2024-05-08T18:08:38.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0457000000000001e-05 2024-05-08T18:08:38.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617573+0000", 2024-05-08T18:08:38.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014776200000000001 2024-05-08T18:08:38.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617786+0000", 2024-05-08T18:08:38.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212418 2024-05-08T18:08:38.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.618177+0000", 2024-05-08T18:08:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039161699999999997 2024-05-08T18:08:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.619563+0000", 2024-05-08T18:08:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013852999999999999 2024-05-08T18:08:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620334+0000", 2024-05-08T18:08:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00077182200000000002 2024-05-08T18:08:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620426+0000", 2024-05-08T18:08:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1526000000000004e-05 2024-05-08T18:08:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620494+0000", 2024-05-08T18:08:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8078999999999997e-05 2024-05-08T18:08:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.643 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.972153187999993, 2024-05-08T18:08:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035230880000000002, 2024-05-08T18:08:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 219 2024-05-08T18:08:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641689+0000", 2024-05-08T18:08:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:08:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641700+0000", 2024-05-08T18:08:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1507e-05 2024-05-08T18:08:38.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641732+0000", 2024-05-08T18:08:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1585999999999999e-05 2024-05-08T18:08:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641754+0000", 2024-05-08T18:08:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1480000000000001e-05 2024-05-08T18:08:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641942+0000", 2024-05-08T18:08:38.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018826300000000001 2024-05-08T18:08:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642165+0000", 2024-05-08T18:08:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022301100000000001 2024-05-08T18:08:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642587+0000", 2024-05-08T18:08:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042182400000000001 2024-05-08T18:08:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.643767+0000", 2024-05-08T18:08:38.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001180675 2024-05-08T18:08:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645010+0000", 2024-05-08T18:08:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012427110000000001 2024-05-08T18:08:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645101+0000", 2024-05-08T18:08:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0871999999999993e-05 2024-05-08T18:08:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645209+0000", 2024-05-08T18:08:38.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108496 2024-05-08T18:08:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.952356201000001, 2024-05-08T18:08:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035793639999999998, 2024-05-08T18:08:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.649 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 224 2024-05-08T18:08:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:38.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661485+0000", 2024-05-08T18:08:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9759999999999998e-06 2024-05-08T18:08:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661494+0000", 2024-05-08T18:08:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3469999999999999e-06 2024-05-08T18:08:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661517+0000", 2024-05-08T18:08:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.389e-05 2024-05-08T18:08:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661537+0000", 2024-05-08T18:08:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9803e-05 2024-05-08T18:08:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661696+0000", 2024-05-08T18:08:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015865899999999999 2024-05-08T18:08:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661910+0000", 2024-05-08T18:08:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021434199999999999 2024-05-08T18:08:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.662336+0000", 2024-05-08T18:08:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042575300000000001 2024-05-08T18:08:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.663720+0000", 2024-05-08T18:08:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013843799999999999 2024-05-08T18:08:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.664909+0000", 2024-05-08T18:08:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011889019999999999 2024-05-08T18:08:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665001+0000", 2024-05-08T18:08:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1649000000000003e-05 2024-05-08T18:08:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665063+0000", 2024-05-08T18:08:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1662999999999996e-05 2024-05-08T18:08:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.919762926999994, 2024-05-08T18:08:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031551930000000001, 2024-05-08T18:08:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 233 2024-05-08T18:08:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.655 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694079+0000", 2024-05-08T18:08:38.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694090+0000", 2024-05-08T18:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1182999999999999e-05 2024-05-08T18:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694119+0000", 2024-05-08T18:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9076000000000001e-05 2024-05-08T18:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694143+0000", 2024-05-08T18:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4363e-05 2024-05-08T18:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694291+0000", 2024-05-08T18:08:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147849 2024-05-08T18:08:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694534+0000", 2024-05-08T18:08:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000242382 2024-05-08T18:08:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694957+0000", 2024-05-08T18:08:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042316700000000001 2024-05-08T18:08:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.696306+0000", 2024-05-08T18:08:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013489940000000001 2024-05-08T18:08:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697071+0000", 2024-05-08T18:08:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076482999999999998 2024-05-08T18:08:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697167+0000", 2024-05-08T18:08:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6773000000000003e-05 2024-05-08T18:08:38.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697232+0000", 2024-05-08T18:08:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4386000000000003e-05 2024-05-08T18:08:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:328 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.888044339999993, 2024-05-08T18:08:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029659439999999999, 2024-05-08T18:08:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.660 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 328 2024-05-08T18:08:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:38.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725796+0000", 2024-05-08T18:08:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-06 2024-05-08T18:08:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725802+0000", 2024-05-08T18:08:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7219999999999996e-06 2024-05-08T18:08:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725816+0000", 2024-05-08T18:08:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3886999999999999e-05 2024-05-08T18:08:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725824+0000", 2024-05-08T18:08:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5920000000000003e-06 2024-05-08T18:08:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725885+0000", 2024-05-08T18:08:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1526999999999996e-05 2024-05-08T18:08:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725972+0000", 2024-05-08T18:08:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7099000000000001e-05 2024-05-08T18:08:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726093+0000", 2024-05-08T18:08:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120383 2024-05-08T18:08:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726717+0000", 2024-05-08T18:08:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062435099999999999 2024-05-08T18:08:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728693+0000", 2024-05-08T18:08:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019758309999999999 2024-05-08T18:08:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728731+0000", 2024-05-08T18:08:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8591999999999999e-05 2024-05-08T18:08:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728761+0000", 2024-05-08T18:08:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9770000000000001e-05 2024-05-08T18:08:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:460 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.834227115999994, 2024-05-08T18:08:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040209540000000002, 2024-05-08T18:08:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 460 2024-05-08T18:08:38.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779613+0000", 2024-05-08T18:08:38.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:08:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779619+0000", 2024-05-08T18:08:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3630000000000002e-06 2024-05-08T18:08:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779631+0000", 2024-05-08T18:08:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2211e-05 2024-05-08T18:08:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779637+0000", 2024-05-08T18:08:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0430000000000004e-06 2024-05-08T18:08:38.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779702+0000", 2024-05-08T18:08:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4481999999999997e-05 2024-05-08T18:08:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779848+0000", 2024-05-08T18:08:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014608500000000001 2024-05-08T18:08:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780056+0000", 2024-05-08T18:08:38.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020889699999999999 2024-05-08T18:08:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780700+0000", 2024-05-08T18:08:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064379300000000003 2024-05-08T18:08:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783576+0000", 2024-05-08T18:08:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028754919999999999 2024-05-08T18:08:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783608+0000", 2024-05-08T18:08:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2223e-05 2024-05-08T18:08:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:08:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5296e-05 2024-05-08T18:08:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:466 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.671 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.829688877999999, 2024-05-08T18:08:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028979520000000001, 2024-05-08T18:08:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 466 2024-05-08T18:08:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.61e-07 2024-05-08T18:08:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784155+0000", 2024-05-08T18:08:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9299999999999996e-06 2024-05-08T18:08:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784165+0000", 2024-05-08T18:08:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5680000000000005e-06 2024-05-08T18:08:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784170+0000", 2024-05-08T18:08:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1379999999999998e-06 2024-05-08T18:08:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784219+0000", 2024-05-08T18:08:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9231999999999999e-05 2024-05-08T18:08:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784310+0000", 2024-05-08T18:08:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0797000000000005e-05 2024-05-08T18:08:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784490+0000", 2024-05-08T18:08:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179705 2024-05-08T18:08:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.785090+0000", 2024-05-08T18:08:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060073899999999998 2024-05-08T18:08:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.786973+0000", 2024-05-08T18:08:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018824460000000001 2024-05-08T18:08:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787007+0000", 2024-05-08T18:08:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3779999999999998e-05 2024-05-08T18:08:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787049+0000", 2024-05-08T18:08:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1856e-05 2024-05-08T18:08:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:477 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.822546884000005, 2024-05-08T18:08:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046076989999999998, 2024-05-08T18:08:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.677 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 477 2024-05-08T18:08:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791294+0000", 2024-05-08T18:08:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-06 2024-05-08T18:08:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791300+0000", 2024-05-08T18:08:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5320000000000003e-06 2024-05-08T18:08:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791313+0000", 2024-05-08T18:08:38.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2576e-05 2024-05-08T18:08:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791319+0000", 2024-05-08T18:08:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1720000000000004e-06 2024-05-08T18:08:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791379+0000", 2024-05-08T18:08:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0343000000000001e-05 2024-05-08T18:08:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791477+0000", 2024-05-08T18:08:38.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7662000000000001e-05 2024-05-08T18:08:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791678+0000", 2024-05-08T18:08:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000200788 2024-05-08T18:08:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.792263+0000", 2024-05-08T18:08:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058525700000000005 2024-05-08T18:08:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795842+0000", 2024-05-08T18:08:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035787079999999999 2024-05-08T18:08:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795874+0000", 2024-05-08T18:08:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2205000000000001e-05 2024-05-08T18:08:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795900+0000", 2024-05-08T18:08:38.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6222000000000001e-05 2024-05-08T18:08:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:642 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.683787181, 2024-05-08T18:08:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030444059999999999, 2024-05-08T18:08:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.683 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 642 2024-05-08T18:08:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:38.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930055+0000", 2024-05-08T18:08:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7999999999999999e-06 2024-05-08T18:08:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930065+0000", 2024-05-08T18:08:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0176999999999999e-05 2024-05-08T18:08:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930092+0000", 2024-05-08T18:08:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6460000000000001e-05 2024-05-08T18:08:38.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930112+0000", 2024-05-08T18:08:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0043000000000001e-05 2024-05-08T18:08:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930219+0000", 2024-05-08T18:08:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010698500000000001 2024-05-08T18:08:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930345+0000", 2024-05-08T18:08:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012620400000000001 2024-05-08T18:08:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930579+0000", 2024-05-08T18:08:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234145 2024-05-08T18:08:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.931471+0000", 2024-05-08T18:08:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00089161500000000001 2024-05-08T18:08:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.932978+0000", 2024-05-08T18:08:38.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001507296 2024-05-08T18:08:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933044+0000", 2024-05-08T18:08:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6402000000000006e-05 2024-05-08T18:08:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933097+0000", 2024-05-08T18:08:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2278999999999999e-05 2024-05-08T18:08:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.688 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:681 6.e e32/26 6:748722ff:gc::gc.6:head v 32'7, mlcod=32'5)", 2024-05-08T18:08:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.652991603999993, 2024-05-08T18:08:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003318185, 2024-05-08T18:08:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960849+0000", 2024-05-08T18:08:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.423e-06 2024-05-08T18:08:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960859+0000", 2024-05-08T18:08:38.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3170000000000008e-06 2024-05-08T18:08:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960874+0000", 2024-05-08T18:08:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5125e-05 2024-05-08T18:08:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960884+0000", 2024-05-08T18:08:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8120000000000002e-06 2024-05-08T18:08:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960972+0000", 2024-05-08T18:08:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8540000000000003e-05 2024-05-08T18:08:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960996+0000", 2024-05-08T18:08:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3479999999999999e-05 2024-05-08T18:08:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964110+0000", 2024-05-08T18:08:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031142729999999999 2024-05-08T18:08:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964166+0000", 2024-05-08T18:08:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6215000000000003e-05 2024-05-08T18:08:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.561955509000001, 2024-05-08T18:08:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030648379999999999, 2024-05-08T18:08:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.693 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 733 2024-05-08T18:08:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051887+0000", 2024-05-08T18:08:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.74e-06 2024-05-08T18:08:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051900+0000", 2024-05-08T18:08:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3113e-05 2024-05-08T18:08:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051931+0000", 2024-05-08T18:08:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1665999999999998e-05 2024-05-08T18:08:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051946+0000", 2024-05-08T18:08:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4780000000000001e-05 2024-05-08T18:08:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052078+0000", 2024-05-08T18:08:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013133200000000001 2024-05-08T18:08:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052338+0000", 2024-05-08T18:08:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026056899999999999 2024-05-08T18:08:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052652+0000", 2024-05-08T18:08:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031396700000000001 2024-05-08T18:08:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.053668+0000", 2024-05-08T18:08:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00101574 2024-05-08T18:08:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054800+0000", 2024-05-08T18:08:38.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011319819999999999 2024-05-08T18:08:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054884+0000", 2024-05-08T18:08:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4005999999999995e-05 2024-05-08T18:08:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054949+0000", 2024-05-08T18:08:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4943000000000005e-05 2024-05-08T18:08:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.558100874000004, 2024-05-08T18:08:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029745919999999999, 2024-05-08T18:08:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 735 2024-05-08T18:08:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055741+0000", 2024-05-08T18:08:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.984e-06 2024-05-08T18:08:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055766+0000", 2024-05-08T18:08:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5253e-05 2024-05-08T18:08:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055785+0000", 2024-05-08T18:08:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9559999999999999e-05 2024-05-08T18:08:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055798+0000", 2024-05-08T18:08:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-05 2024-05-08T18:08:38.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055932+0000", 2024-05-08T18:08:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134609 2024-05-08T18:08:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056184+0000", 2024-05-08T18:08:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025167800000000003 2024-05-08T18:08:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056680+0000", 2024-05-08T18:08:38.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049576299999999998 2024-05-08T18:08:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058060+0000", 2024-05-08T18:08:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013801 2024-05-08T18:08:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058447+0000", 2024-05-08T18:08:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038695299999999999 2024-05-08T18:08:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058601+0000", 2024-05-08T18:08:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015396299999999999 2024-05-08T18:08:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058713+0000", 2024-05-08T18:08:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112389 2024-05-08T18:08:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:38.704 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.451085524000007, 2024-05-08T18:08:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029913650000000002, 2024-05-08T18:08:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 781 2024-05-08T18:08:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162757+0000", 2024-05-08T18:08:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:08:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162770+0000", 2024-05-08T18:08:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3406e-05 2024-05-08T18:08:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162799+0000", 2024-05-08T18:08:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-05 2024-05-08T18:08:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162813+0000", 2024-05-08T18:08:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:08:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162942+0000", 2024-05-08T18:08:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012902200000000001 2024-05-08T18:08:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163159+0000", 2024-05-08T18:08:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021738500000000001 2024-05-08T18:08:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163476+0000", 2024-05-08T18:08:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031666499999999999 2024-05-08T18:08:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.164533+0000", 2024-05-08T18:08:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010574219999999999 2024-05-08T18:08:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165587+0000", 2024-05-08T18:08:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001053476 2024-05-08T18:08:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165674+0000", 2024-05-08T18:08:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6725999999999996e-05 2024-05-08T18:08:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165745+0000", 2024-05-08T18:08:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1779000000000005e-05 2024-05-08T18:08:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.068495675999998, 2024-05-08T18:08:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029834750000000002, 2024-05-08T18:08:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:38.710 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 946 2024-05-08T18:08:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:38.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545346+0000", 2024-05-08T18:08:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6570000000000001e-06 2024-05-08T18:08:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545357+0000", 2024-05-08T18:08:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0740000000000001e-05 2024-05-08T18:08:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545384+0000", 2024-05-08T18:08:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6780000000000001e-05 2024-05-08T18:08:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545398+0000", 2024-05-08T18:08:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3936e-05 2024-05-08T18:08:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545515+0000", 2024-05-08T18:08:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117413 2024-05-08T18:08:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545751+0000", 2024-05-08T18:08:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023559500000000001 2024-05-08T18:08:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.546075+0000", 2024-05-08T18:08:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000324357 2024-05-08T18:08:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.547104+0000", 2024-05-08T18:08:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010285959999999999 2024-05-08T18:08:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548141+0000", 2024-05-08T18:08:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001036922 2024-05-08T18:08:38.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548223+0000", 2024-05-08T18:08:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2260000000000002e-05 2024-05-08T18:08:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548327+0000", 2024-05-08T18:08:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104219 2024-05-08T18:08:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:38.715 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:38.716 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:38.717 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:08:38.717 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:38.717+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:38.818 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:38.817+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:38.869 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:38.870 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:38.870 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:38.882 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:08:38.901 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-05-08T18:08:38.918 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:38.921+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:39.020 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:39.021+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:39.020 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:39.021 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:39.033 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:08:39.120 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:39.121+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:39.148 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:39.148 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 75.574224619000006, 2024-05-08T18:08:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002466088, 2024-05-08T18:08:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 52 2024-05-08T18:08:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577062+0000", 2024-05-08T18:08:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.994e-06 2024-05-08T18:08:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577075+0000", 2024-05-08T18:08:39.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2480000000000001e-05 2024-05-08T18:08:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577108+0000", 2024-05-08T18:08:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3096000000000003e-05 2024-05-08T18:08:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577131+0000", 2024-05-08T18:08:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2993000000000002e-05 2024-05-08T18:08:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577260+0000", 2024-05-08T18:08:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012912899999999999 2024-05-08T18:08:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577453+0000", 2024-05-08T18:08:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000193668 2024-05-08T18:08:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577634+0000", 2024-05-08T18:08:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180576 2024-05-08T18:08:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579082+0000", 2024-05-08T18:08:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001448083 2024-05-08T18:08:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579290+0000", 2024-05-08T18:08:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000208333 2024-05-08T18:08:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579403+0000", 2024-05-08T18:08:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011296800000000001 2024-05-08T18:08:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579525+0000", 2024-05-08T18:08:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121768 2024-05-08T18:08:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 75.562364853999995, 2024-05-08T18:08:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038858310000000002, 2024-05-08T18:08:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.154 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588920+0000", 2024-05-08T18:08:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.23e-07 2024-05-08T18:08:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588929+0000", 2024-05-08T18:08:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3659999999999998e-06 2024-05-08T18:08:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588948+0000", 2024-05-08T18:08:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8768000000000001e-05 2024-05-08T18:08:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588962+0000", 2024-05-08T18:08:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4e-05 2024-05-08T18:08:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589110+0000", 2024-05-08T18:08:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148047 2024-05-08T18:08:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589173+0000", 2024-05-08T18:08:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2766000000000002e-05 2024-05-08T18:08:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592728+0000", 2024-05-08T18:08:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035553300000000002 2024-05-08T18:08:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592805+0000", 2024-05-08T18:08:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6730999999999994e-05 2024-05-08T18:08:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.446295956, 2024-05-08T18:08:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034354310000000001, 2024-05-08T18:08:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.158 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 236 2024-05-08T18:08:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:39.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704991+0000", 2024-05-08T18:08:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1240000000000001e-06 2024-05-08T18:08:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705009+0000", 2024-05-08T18:08:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7819e-05 2024-05-08T18:08:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705048+0000", 2024-05-08T18:08:39.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9632999999999998e-05 2024-05-08T18:08:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705073+0000", 2024-05-08T18:08:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4686999999999999e-05 2024-05-08T18:08:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705241+0000", 2024-05-08T18:08:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759899999999999 2024-05-08T18:08:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705511+0000", 2024-05-08T18:08:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027018799999999998 2024-05-08T18:08:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705965+0000", 2024-05-08T18:08:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045433000000000002 2024-05-08T18:08:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.707487+0000", 2024-05-08T18:08:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015214810000000001 2024-05-08T18:08:39.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708125+0000", 2024-05-08T18:08:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063870300000000001 2024-05-08T18:08:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708298+0000", 2024-05-08T18:08:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172592 2024-05-08T18:08:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708423+0000", 2024-05-08T18:08:39.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125275 2024-05-08T18:08:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:308 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.429458053999994, 2024-05-08T18:08:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038707400000000001, 2024-05-08T18:08:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.164 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 308 2024-05-08T18:08:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721827+0000", 2024-05-08T18:08:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1519999999999999e-06 2024-05-08T18:08:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721840+0000", 2024-05-08T18:08:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.362e-05 2024-05-08T18:08:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721857+0000", 2024-05-08T18:08:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6901e-05 2024-05-08T18:08:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721867+0000", 2024-05-08T18:08:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0034000000000001e-05 2024-05-08T18:08:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721922+0000", 2024-05-08T18:08:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4450999999999998e-05 2024-05-08T18:08:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721981+0000", 2024-05-08T18:08:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9267e-05 2024-05-08T18:08:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722103+0000", 2024-05-08T18:08:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121502 2024-05-08T18:08:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722757+0000", 2024-05-08T18:08:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065419700000000003 2024-05-08T18:08:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725619+0000", 2024-05-08T18:08:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002862107 2024-05-08T18:08:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725654+0000", 2024-05-08T18:08:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:08:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725696+0000", 2024-05-08T18:08:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:08:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:604 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.252175347999994, 2024-05-08T18:08:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002741884, 2024-05-08T18:08:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 604 2024-05-08T18:08:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899111+0000", 2024-05-08T18:08:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0910000000000001e-06 2024-05-08T18:08:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899126+0000", 2024-05-08T18:08:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:08:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899159+0000", 2024-05-08T18:08:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3241999999999998e-05 2024-05-08T18:08:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899174+0000", 2024-05-08T18:08:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5235000000000001e-05 2024-05-08T18:08:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899316+0000", 2024-05-08T18:08:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014175599999999999 2024-05-08T18:08:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899525+0000", 2024-05-08T18:08:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020915300000000001 2024-05-08T18:08:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899872+0000", 2024-05-08T18:08:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034668299999999997 2024-05-08T18:08:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901064+0000", 2024-05-08T18:08:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001191473 2024-05-08T18:08:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901664+0000", 2024-05-08T18:08:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060054599999999998 2024-05-08T18:08:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901779+0000", 2024-05-08T18:08:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011452500000000001 2024-05-08T18:08:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901850+0000", 2024-05-08T18:08:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1580000000000002e-05 2024-05-08T18:08:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:612 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.246666785000002, 2024-05-08T18:08:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025904750000000001, 2024-05-08T18:08:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 612 2024-05-08T18:08:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904619+0000", 2024-05-08T18:08:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8479999999999999e-06 2024-05-08T18:08:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904628+0000", 2024-05-08T18:08:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8829999999999995e-06 2024-05-08T18:08:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904650+0000", 2024-05-08T18:08:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2467999999999999e-05 2024-05-08T18:08:39.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904669+0000", 2024-05-08T18:08:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9303000000000001e-05 2024-05-08T18:08:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904766+0000", 2024-05-08T18:08:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6917999999999996e-05 2024-05-08T18:08:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904935+0000", 2024-05-08T18:08:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000168441 2024-05-08T18:08:39.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.905288+0000", 2024-05-08T18:08:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035312199999999998 2024-05-08T18:08:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.906520+0000", 2024-05-08T18:08:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001232005 2024-05-08T18:08:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907086+0000", 2024-05-08T18:08:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056658900000000005 2024-05-08T18:08:39.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907154+0000", 2024-05-08T18:08:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7197000000000001e-05 2024-05-08T18:08:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907207+0000", 2024-05-08T18:08:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3701e-05 2024-05-08T18:08:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.180 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.078649192, 2024-05-08T18:08:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032464490000000002, 2024-05-08T18:08:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 742 2024-05-08T18:08:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072637+0000", 2024-05-08T18:08:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9059999999999998e-06 2024-05-08T18:08:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072651+0000", 2024-05-08T18:08:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3477e-05 2024-05-08T18:08:39.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072683+0000", 2024-05-08T18:08:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2116000000000002e-05 2024-05-08T18:08:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072698+0000", 2024-05-08T18:08:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5454000000000001e-05 2024-05-08T18:08:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072845+0000", 2024-05-08T18:08:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146532 2024-05-08T18:08:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073241+0000", 2024-05-08T18:08:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039580699999999997 2024-05-08T18:08:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073812+0000", 2024-05-08T18:08:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057164900000000003 2024-05-08T18:08:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075063+0000", 2024-05-08T18:08:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001250131 2024-05-08T18:08:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075723+0000", 2024-05-08T18:08:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00066039199999999999 2024-05-08T18:08:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075808+0000", 2024-05-08T18:08:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5458999999999996e-05 2024-05-08T18:08:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075881+0000", 2024-05-08T18:08:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2526000000000003e-05 2024-05-08T18:08:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.036240827, 2024-05-08T18:08:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029270590000000001, 2024-05-08T18:08:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 760 2024-05-08T18:08:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.186 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115045+0000", 2024-05-08T18:08:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0729999999999999e-06 2024-05-08T18:08:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115057+0000", 2024-05-08T18:08:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1617000000000001e-05 2024-05-08T18:08:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115088+0000", 2024-05-08T18:08:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1155999999999998e-05 2024-05-08T18:08:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115103+0000", 2024-05-08T18:08:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5067e-05 2024-05-08T18:08:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115289+0000", 2024-05-08T18:08:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186582 2024-05-08T18:08:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115506+0000", 2024-05-08T18:08:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021690500000000001 2024-05-08T18:08:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115832+0000", 2024-05-08T18:08:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032556799999999998 2024-05-08T18:08:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.116892+0000", 2024-05-08T18:08:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010597989999999999 2024-05-08T18:08:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117807+0000", 2024-05-08T18:08:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091502599999999999 2024-05-08T18:08:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117895+0000", 2024-05-08T18:08:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7977000000000001e-05 2024-05-08T18:08:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117970+0000", 2024-05-08T18:08:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5289000000000004e-05 2024-05-08T18:08:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.905243341000002, 2024-05-08T18:08:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028290730000000001, 2024-05-08T18:08:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.191 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 817 2024-05-08T18:08:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246043+0000", 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.807e-06 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246056+0000", 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2383e-05 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246087+0000", 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1937000000000003e-05 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246104+0000", 2024-05-08T18:08:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6643e-05 2024-05-08T18:08:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246225+0000", 2024-05-08T18:08:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012061900000000001 2024-05-08T18:08:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246510+0000", 2024-05-08T18:08:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028507100000000002 2024-05-08T18:08:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246881+0000", 2024-05-08T18:08:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037163799999999998 2024-05-08T18:08:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248078+0000", 2024-05-08T18:08:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011968969999999999 2024-05-08T18:08:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248715+0000", 2024-05-08T18:08:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063698599999999998 2024-05-08T18:08:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248801+0000", 2024-05-08T18:08:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5772999999999993e-05 2024-05-08T18:08:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248869+0000", 2024-05-08T18:08:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8318999999999994e-05 2024-05-08T18:08:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.851499856999993, 2024-05-08T18:08:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003281693, 2024-05-08T18:08:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 841 2024-05-08T18:08:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299786+0000", 2024-05-08T18:08:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4770000000000002e-06 2024-05-08T18:08:39.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299798+0000", 2024-05-08T18:08:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1493e-05 2024-05-08T18:08:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299827+0000", 2024-05-08T18:08:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9363e-05 2024-05-08T18:08:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299842+0000", 2024-05-08T18:08:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.448e-05 2024-05-08T18:08:39.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300001+0000", 2024-05-08T18:08:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015909600000000001 2024-05-08T18:08:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300384+0000", 2024-05-08T18:08:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038306000000000001 2024-05-08T18:08:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300929+0000", 2024-05-08T18:08:39.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054551299999999997 2024-05-08T18:08:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302151+0000", 2024-05-08T18:08:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012218540000000001 2024-05-08T18:08:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302918+0000", 2024-05-08T18:08:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076719099999999997 2024-05-08T18:08:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303000+0000", 2024-05-08T18:08:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1662999999999994e-05 2024-05-08T18:08:39.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303065+0000", 2024-05-08T18:08:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5502999999999999e-05 2024-05-08T18:08:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.847304401000002, 2024-05-08T18:08:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026179150000000002, 2024-05-08T18:08:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.202 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 843 2024-05-08T18:08:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:39.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303981+0000", 2024-05-08T18:08:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9740000000000001e-06 2024-05-08T18:08:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303990+0000", 2024-05-08T18:08:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9889999999999998e-06 2024-05-08T18:08:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304012+0000", 2024-05-08T18:08:39.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1537000000000001e-05 2024-05-08T18:08:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304023+0000", 2024-05-08T18:08:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:08:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304101+0000", 2024-05-08T18:08:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7732999999999996e-05 2024-05-08T18:08:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304210+0000", 2024-05-08T18:08:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010985299999999999 2024-05-08T18:08:39.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304490+0000", 2024-05-08T18:08:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000279564 2024-05-08T18:08:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.305542+0000", 2024-05-08T18:08:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051976 2024-05-08T18:08:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306451+0000", 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00090901999999999997 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306533+0000", 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1790000000000001e-05 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306597+0000", 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4332999999999995e-05 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.207 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.837608191000001, 2024-05-08T18:08:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00275537, 2024-05-08T18:08:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 847 2024-05-08T18:08:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:39.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313678+0000", 2024-05-08T18:08:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:08:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313689+0000", 2024-05-08T18:08:39.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1273e-05 2024-05-08T18:08:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313719+0000", 2024-05-08T18:08:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9726e-05 2024-05-08T18:08:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313733+0000", 2024-05-08T18:08:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4487e-05 2024-05-08T18:08:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313858+0000", 2024-05-08T18:08:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125172 2024-05-08T18:08:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314072+0000", 2024-05-08T18:08:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021314200000000001 2024-05-08T18:08:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314378+0000", 2024-05-08T18:08:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030653100000000002 2024-05-08T18:08:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.315524+0000", 2024-05-08T18:08:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011458950000000001 2024-05-08T18:08:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316213+0000", 2024-05-08T18:08:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068942199999999997 2024-05-08T18:08:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316314+0000", 2024-05-08T18:08:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100723 2024-05-08T18:08:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316431+0000", 2024-05-08T18:08:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116759 2024-05-08T18:08:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.833956254, 2024-05-08T18:08:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025522510000000002, 2024-05-08T18:08:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.213 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 849 2024-05-08T18:08:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317329+0000", 2024-05-08T18:08:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9530000000000002e-06 2024-05-08T18:08:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317340+0000", 2024-05-08T18:08:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.08e-05 2024-05-08T18:08:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317364+0000", 2024-05-08T18:08:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4142999999999999e-05 2024-05-08T18:08:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317377+0000", 2024-05-08T18:08:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2764e-05 2024-05-08T18:08:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317471+0000", 2024-05-08T18:08:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4289000000000005e-05 2024-05-08T18:08:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317600+0000", 2024-05-08T18:08:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012910499999999999 2024-05-08T18:08:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:39.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317868+0000", 2024-05-08T18:08:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000267562 2024-05-08T18:08:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319081+0000", 2024-05-08T18:08:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001213387 2024-05-08T18:08:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319723+0000", 2024-05-08T18:08:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064134200000000004 2024-05-08T18:08:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319808+0000", 2024-05-08T18:08:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319880+0000", 2024-05-08T18:08:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1426000000000004e-05 2024-05-08T18:08:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.790523773000004, 2024-05-08T18:08:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002815157, 2024-05-08T18:08:39.218 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 868 2024-05-08T18:08:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360762+0000", 2024-05-08T18:08:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:08:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360775+0000", 2024-05-08T18:08:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2840000000000001e-05 2024-05-08T18:08:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360805+0000", 2024-05-08T18:08:39.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9686e-05 2024-05-08T18:08:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360819+0000", 2024-05-08T18:08:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.434e-05 2024-05-08T18:08:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360948+0000", 2024-05-08T18:08:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000129033 2024-05-08T18:08:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361166+0000", 2024-05-08T18:08:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021747800000000001 2024-05-08T18:08:39.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361481+0000", 2024-05-08T18:08:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031515800000000001 2024-05-08T18:08:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.362546+0000", 2024-05-08T18:08:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010653889999999999 2024-05-08T18:08:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363365+0000", 2024-05-08T18:08:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081906100000000005 2024-05-08T18:08:39.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363450+0000", 2024-05-08T18:08:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5202000000000002e-05 2024-05-08T18:08:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363575+0000", 2024-05-08T18:08:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012460999999999999 2024-05-08T18:08:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.223 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.786831599999999, 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024676260000000001, 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 870 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364454+0000", 2024-05-08T18:08:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7770000000000001e-06 2024-05-08T18:08:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364463+0000", 2024-05-08T18:08:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4800000000000007e-06 2024-05-08T18:08:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364487+0000", 2024-05-08T18:08:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3589999999999999e-05 2024-05-08T18:08:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364499+0000", 2024-05-08T18:08:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.241e-05 2024-05-08T18:08:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364607+0000", 2024-05-08T18:08:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010760900000000001 2024-05-08T18:08:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364750+0000", 2024-05-08T18:08:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014265600000000001 2024-05-08T18:08:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.365021+0000", 2024-05-08T18:08:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027115100000000002 2024-05-08T18:08:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366163+0000", 2024-05-08T18:08:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011419189999999999 2024-05-08T18:08:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366727+0000", 2024-05-08T18:08:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056400199999999997 2024-05-08T18:08:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366810+0000", 2024-05-08T18:08:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3133000000000005e-05 2024-05-08T18:08:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366920+0000", 2024-05-08T18:08:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109899 2024-05-08T18:08:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.228 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.696917421999999, 2024-05-08T18:08:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027893459999999998, 2024-05-08T18:08:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 907 2024-05-08T18:08:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.229 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454369+0000", 2024-05-08T18:08:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5730000000000002e-06 2024-05-08T18:08:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454381+0000", 2024-05-08T18:08:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.208e-05 2024-05-08T18:08:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454413+0000", 2024-05-08T18:08:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2493000000000002e-05 2024-05-08T18:08:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454432+0000", 2024-05-08T18:08:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8862999999999999e-05 2024-05-08T18:08:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454577+0000", 2024-05-08T18:08:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014477899999999999 2024-05-08T18:08:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454800+0000", 2024-05-08T18:08:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223425 2024-05-08T18:08:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:39.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.455168+0000", 2024-05-08T18:08:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036712799999999999 2024-05-08T18:08:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456282+0000", 2024-05-08T18:08:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011141580000000001 2024-05-08T18:08:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456953+0000", 2024-05-08T18:08:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000670956 2024-05-08T18:08:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457038+0000", 2024-05-08T18:08:39.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4828999999999997e-05 2024-05-08T18:08:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457156+0000", 2024-05-08T18:08:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118062 2024-05-08T18:08:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.693225059, 2024-05-08T18:08:39.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026891609999999998, 2024-05-08T18:08:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 909 2024-05-08T18:08:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458060+0000", 2024-05-08T18:08:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458069+0000", 2024-05-08T18:08:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6440000000000006e-06 2024-05-08T18:08:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458090+0000", 2024-05-08T18:08:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1089000000000001e-05 2024-05-08T18:08:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458102+0000", 2024-05-08T18:08:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2306999999999999e-05 2024-05-08T18:08:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458191+0000", 2024-05-08T18:08:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8213000000000004e-05 2024-05-08T18:08:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458313+0000", 2024-05-08T18:08:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012231500000000001 2024-05-08T18:08:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458581+0000", 2024-05-08T18:08:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026762500000000001 2024-05-08T18:08:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.459773+0000", 2024-05-08T18:08:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001192991 2024-05-08T18:08:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460590+0000", 2024-05-08T18:08:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081618100000000002 2024-05-08T18:08:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460681+0000", 2024-05-08T18:08:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0946000000000006e-05 2024-05-08T18:08:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460748+0000", 2024-05-08T18:08:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7139999999999998e-05 2024-05-08T18:08:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.239 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.599582041000005, 2024-05-08T18:08:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030359179999999999, 2024-05-08T18:08:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 949 2024-05-08T18:08:39.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551705+0000", 2024-05-08T18:08:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2770000000000001e-06 2024-05-08T18:08:39.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551717+0000", 2024-05-08T18:08:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.206e-05 2024-05-08T18:08:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551747+0000", 2024-05-08T18:08:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0168999999999999e-05 2024-05-08T18:08:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551763+0000", 2024-05-08T18:08:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:08:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551880+0000", 2024-05-08T18:08:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116976 2024-05-08T18:08:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552099+0000", 2024-05-08T18:08:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021910199999999999 2024-05-08T18:08:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552476+0000", 2024-05-08T18:08:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000376697 2024-05-08T18:08:39.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.553551+0000", 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001074925 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554588+0000", 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010374099999999999 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554671+0000", 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3368999999999994e-05 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554738+0000", 2024-05-08T18:08:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6043000000000004e-05 2024-05-08T18:08:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.585968602999998, 2024-05-08T18:08:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028304160000000001, 2024-05-08T18:08:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 955 2024-05-08T18:08:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565318+0000", 2024-05-08T18:08:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7030000000000002e-06 2024-05-08T18:08:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565330+0000", 2024-05-08T18:08:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.204e-05 2024-05-08T18:08:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565363+0000", 2024-05-08T18:08:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2722999999999998e-05 2024-05-08T18:08:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565389+0000", 2024-05-08T18:08:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6412999999999999e-05 2024-05-08T18:08:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565510+0000", 2024-05-08T18:08:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120932 2024-05-08T18:08:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565722+0000", 2024-05-08T18:08:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212139 2024-05-08T18:08:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.566034+0000", 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000312038 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567340+0000", 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00130547 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567998+0000", 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000658382 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568081+0000", 2024-05-08T18:08:39.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3269999999999994e-05 2024-05-08T18:08:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568145+0000", 2024-05-08T18:08:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4306000000000004e-05 2024-05-08T18:08:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 71.582249079999997, 2024-05-08T18:08:39.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027506660000000001, 2024-05-08T18:08:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 957 2024-05-08T18:08:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569036+0000", 2024-05-08T18:08:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.776e-06 2024-05-08T18:08:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569061+0000", 2024-05-08T18:08:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5097e-05 2024-05-08T18:08:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569084+0000", 2024-05-08T18:08:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.23e-05 2024-05-08T18:08:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569096+0000", 2024-05-08T18:08:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.22e-05 2024-05-08T18:08:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569180+0000", 2024-05-08T18:08:39.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4369000000000005e-05 2024-05-08T18:08:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569296+0000", 2024-05-08T18:08:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115999 2024-05-08T18:08:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569550+0000", 2024-05-08T18:08:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025397499999999998 2024-05-08T18:08:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.570963+0000", 2024-05-08T18:08:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001413023 2024-05-08T18:08:39.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571614+0000", 2024-05-08T18:08:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065041199999999995 2024-05-08T18:08:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571701+0000", 2024-05-08T18:08:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7569000000000001e-05 2024-05-08T18:08:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571785+0000", 2024-05-08T18:08:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3945999999999999e-05 2024-05-08T18:08:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.255 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.256 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.256 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:39.257 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:08:39.257 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:39.257+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:39.358 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:39.357+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:39.410 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:39.410 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:39.411 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:39.411 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:39.423 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:08:39.459 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:39.457+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:39.530 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:39.530 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:39.530 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:39.531 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:39.531 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:39.544 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:08:39.590 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:39.592+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:39.656 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:39.656 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:39.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:39.656 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:39.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.657 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:39.657 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:39.657 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 78.107698088000006, 2024-05-08T18:08:39.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049710090000000002, 2024-05-08T18:08:39.657 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.657 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.657 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-08T18:08:39.657 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.657 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.657 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.657 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 44 2024-05-08T18:08:39.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.657 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:39.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:39.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552775+0000", 2024-05-08T18:08:39.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4450000000000001e-06 2024-05-08T18:08:39.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552790+0000", 2024-05-08T18:08:39.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4363e-05 2024-05-08T18:08:39.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552820+0000", 2024-05-08T18:08:39.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0485999999999999e-05 2024-05-08T18:08:39.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552843+0000", 2024-05-08T18:08:39.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2985000000000001e-05 2024-05-08T18:08:39.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554350+0000", 2024-05-08T18:08:39.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015065149999999999 2024-05-08T18:08:39.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-08T18:08:39.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554374+0000", 2024-05-08T18:08:39.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4097e-05 2024-05-08T18:08:39.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557531+0000", 2024-05-08T18:08:39.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031567169999999999 2024-05-08T18:08:39.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557743+0000", 2024-05-08T18:08:39.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212401 2024-05-08T18:08:39.661 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.661 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.661 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.661 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:39.661 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:39.661 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.072346210999996, 2024-05-08T18:08:39.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050241879999999997, 2024-05-08T18:08:39.661 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.661 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.661 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.662 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.662 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.662 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.662 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 58 2024-05-08T18:08:39.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.662 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:39.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:39.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588125+0000", 2024-05-08T18:08:39.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1399999999999995e-07 2024-05-08T18:08:39.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588129+0000", 2024-05-08T18:08:39.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6779999999999999e-06 2024-05-08T18:08:39.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588142+0000", 2024-05-08T18:08:39.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3047999999999999e-05 2024-05-08T18:08:39.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588174+0000", 2024-05-08T18:08:39.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1270999999999999e-05 2024-05-08T18:08:39.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588307+0000", 2024-05-08T18:08:39.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013307600000000001 2024-05-08T18:08:39.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588477+0000", 2024-05-08T18:08:39.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000170213 2024-05-08T18:08:39.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:39.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588669+0000", 2024-05-08T18:08:39.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019211599999999999 2024-05-08T18:08:39.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.590228+0000", 2024-05-08T18:08:39.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015590059999999999 2024-05-08T18:08:39.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593029+0000", 2024-05-08T18:08:39.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028006400000000001 2024-05-08T18:08:39.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593099+0000", 2024-05-08T18:08:39.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0300000000000001e-05 2024-05-08T18:08:39.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593148+0000", 2024-05-08T18:08:39.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8925999999999999e-05 2024-05-08T18:08:39.666 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.666 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.666 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.667 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:08:39.667 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:39.667 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.075808050999996, 2024-05-08T18:08:39.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00385587, 2024-05-08T18:08:39.667 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.667 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.667 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.667 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.667 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.667 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.667 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207 2024-05-08T18:08:39.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.667 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:39.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:39.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584665+0000", 2024-05-08T18:08:39.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0570000000000001e-06 2024-05-08T18:08:39.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584679+0000", 2024-05-08T18:08:39.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3713000000000001e-05 2024-05-08T18:08:39.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584712+0000", 2024-05-08T18:08:39.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3213999999999997e-05 2024-05-08T18:08:39.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584728+0000", 2024-05-08T18:08:39.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5936000000000001e-05 2024-05-08T18:08:39.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584951+0000", 2024-05-08T18:08:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000222955 2024-05-08T18:08:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585196+0000", 2024-05-08T18:08:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024550800000000002 2024-05-08T18:08:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585643+0000", 2024-05-08T18:08:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00044644699999999999 2024-05-08T18:08:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.587110+0000", 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001467323 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588371+0000", 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012607180000000001 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588452+0000", 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1216000000000003e-05 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588518+0000", 2024-05-08T18:08:39.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5783000000000004e-05 2024-05-08T18:08:39.672 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.672 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.672 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.672 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.672 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:39.672 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.029632649000007, 2024-05-08T18:08:39.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003249994, 2024-05-08T18:08:39.672 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.672 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.672 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.672 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.672 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.673 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.673 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216 2024-05-08T18:08:39.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.673 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:39.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:39.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630840+0000", 2024-05-08T18:08:39.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0730000000000001e-06 2024-05-08T18:08:39.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630854+0000", 2024-05-08T18:08:39.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3360000000000001e-05 2024-05-08T18:08:39.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630889+0000", 2024-05-08T18:08:39.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5176999999999999e-05 2024-05-08T18:08:39.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630911+0000", 2024-05-08T18:08:39.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.247e-05 2024-05-08T18:08:39.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631046+0000", 2024-05-08T18:08:39.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013484599999999999 2024-05-08T18:08:39.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631272+0000", 2024-05-08T18:08:39.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000225694 2024-05-08T18:08:39.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:39.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631703+0000", 2024-05-08T18:08:39.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000431144 2024-05-08T18:08:39.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633244+0000", 2024-05-08T18:08:39.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001540622 2024-05-08T18:08:39.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633926+0000", 2024-05-08T18:08:39.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068244200000000001 2024-05-08T18:08:39.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634019+0000", 2024-05-08T18:08:39.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3148999999999999e-05 2024-05-08T18:08:39.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634087+0000", 2024-05-08T18:08:39.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8016999999999996e-05 2024-05-08T18:08:39.677 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.677 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.677 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.677 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.678 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:39.678 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.988088599999998, 2024-05-08T18:08:39.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003119854, 2024-05-08T18:08:39.678 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.678 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.678 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.678 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.678 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.678 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.678 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 227 2024-05-08T18:08:39.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.678 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:39.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:39.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672384+0000", 2024-05-08T18:08:39.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7470000000000001e-06 2024-05-08T18:08:39.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672396+0000", 2024-05-08T18:08:39.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.154e-05 2024-05-08T18:08:39.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672427+0000", 2024-05-08T18:08:39.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1676e-05 2024-05-08T18:08:39.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672443+0000", 2024-05-08T18:08:39.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5214e-05 2024-05-08T18:08:39.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672563+0000", 2024-05-08T18:08:39.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120535 2024-05-08T18:08:39.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672778+0000", 2024-05-08T18:08:39.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021446200000000001 2024-05-08T18:08:39.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:39.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.673205+0000", 2024-05-08T18:08:39.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042750699999999998 2024-05-08T18:08:39.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.674848+0000", 2024-05-08T18:08:39.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016432980000000001 2024-05-08T18:08:39.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675346+0000", 2024-05-08T18:08:39.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049711999999999998 2024-05-08T18:08:39.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675432+0000", 2024-05-08T18:08:39.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6798999999999993e-05 2024-05-08T18:08:39.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675501+0000", 2024-05-08T18:08:39.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8955999999999995e-05 2024-05-08T18:08:39.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.683 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.683 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.683 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:39.683 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.981147813000007, 2024-05-08T18:08:39.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034322110000000001, 2024-05-08T18:08:39.683 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.683 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.683 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.683 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.683 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.684 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.684 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 229 2024-05-08T18:08:39.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.684 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:39.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:39.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679325+0000", 2024-05-08T18:08:39.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:08:39.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679339+0000", 2024-05-08T18:08:39.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:08:39.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679370+0000", 2024-05-08T18:08:39.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0280000000000001e-05 2024-05-08T18:08:39.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679385+0000", 2024-05-08T18:08:39.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5026e-05 2024-05-08T18:08:39.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679504+0000", 2024-05-08T18:08:39.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119023 2024-05-08T18:08:39.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679711+0000", 2024-05-08T18:08:39.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020705499999999999 2024-05-08T18:08:39.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:39.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.680115+0000", 2024-05-08T18:08:39.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040396699999999998 2024-05-08T18:08:39.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.681424+0000", 2024-05-08T18:08:39.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001309387 2024-05-08T18:08:39.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682488+0000", 2024-05-08T18:08:39.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010642519999999999 2024-05-08T18:08:39.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682640+0000", 2024-05-08T18:08:39.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015123599999999999 2024-05-08T18:08:39.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682754+0000", 2024-05-08T18:08:39.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011482200000000001 2024-05-08T18:08:39.688 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.688 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.688 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.688 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.688 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:39.689 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.973763603999998, 2024-05-08T18:08:39.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033353329999999998, 2024-05-08T18:08:39.689 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.689 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.689 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.689 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.689 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.689 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.689 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 231 2024-05-08T18:08:39.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.689 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:39.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:39.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686709+0000", 2024-05-08T18:08:39.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4729999999999999e-06 2024-05-08T18:08:39.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686720+0000", 2024-05-08T18:08:39.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1157e-05 2024-05-08T18:08:39.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686750+0000", 2024-05-08T18:08:39.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0417e-05 2024-05-08T18:08:39.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686765+0000", 2024-05-08T18:08:39.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.487e-05 2024-05-08T18:08:39.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686872+0000", 2024-05-08T18:08:39.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010703499999999999 2024-05-08T18:08:39.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687085+0000", 2024-05-08T18:08:39.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021279599999999999 2024-05-08T18:08:39.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:39.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687501+0000", 2024-05-08T18:08:39.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041554 2024-05-08T18:08:39.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.688886+0000", 2024-05-08T18:08:39.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00138565 2024-05-08T18:08:39.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689899+0000", 2024-05-08T18:08:39.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010128190000000001 2024-05-08T18:08:39.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689978+0000", 2024-05-08T18:08:39.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8490000000000002e-05 2024-05-08T18:08:39.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.690042+0000", 2024-05-08T18:08:39.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4085999999999996e-05 2024-05-08T18:08:39.694 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.694 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.694 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.694 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:394 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.694 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:39.694 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.916690527, 2024-05-08T18:08:39.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034384960000000001, 2024-05-08T18:08:39.694 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.694 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.695 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.695 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.695 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.695 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.695 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 394 2024-05-08T18:08:39.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.695 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:39.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:39.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743781+0000", 2024-05-08T18:08:39.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3e-06 2024-05-08T18:08:39.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743788+0000", 2024-05-08T18:08:39.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7399999999999998e-06 2024-05-08T18:08:39.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743801+0000", 2024-05-08T18:08:39.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3757000000000001e-05 2024-05-08T18:08:39.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743808+0000", 2024-05-08T18:08:39.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6579999999999996e-06 2024-05-08T18:08:39.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743875+0000", 2024-05-08T18:08:39.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6740000000000001e-05 2024-05-08T18:08:39.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743971+0000", 2024-05-08T18:08:39.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6175000000000007e-05 2024-05-08T18:08:39.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:39.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744100+0000", 2024-05-08T18:08:39.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012954899999999999 2024-05-08T18:08:39.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744863+0000", 2024-05-08T18:08:39.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076300100000000002 2024-05-08T18:08:39.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747089+0000", 2024-05-08T18:08:39.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022258540000000002 2024-05-08T18:08:39.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747162+0000", 2024-05-08T18:08:39.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2632000000000005e-05 2024-05-08T18:08:39.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747218+0000", 2024-05-08T18:08:39.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.609e-05 2024-05-08T18:08:39.700 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.700 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.700 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.700 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:535 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.700 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:39.700 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.818977450000006, 2024-05-08T18:08:39.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055640899999999998, 2024-05-08T18:08:39.700 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.700 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.700 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.700 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.700 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.700 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.701 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 535 2024-05-08T18:08:39.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.701 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:39.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:39.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841494+0000", 2024-05-08T18:08:39.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0899999999999999e-06 2024-05-08T18:08:39.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841500+0000", 2024-05-08T18:08:39.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0249999999999999e-06 2024-05-08T18:08:39.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841513+0000", 2024-05-08T18:08:39.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3658e-05 2024-05-08T18:08:39.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841522+0000", 2024-05-08T18:08:39.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3410000000000003e-06 2024-05-08T18:08:39.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841574+0000", 2024-05-08T18:08:39.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2794000000000003e-05 2024-05-08T18:08:39.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841633+0000", 2024-05-08T18:08:39.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8595999999999999e-05 2024-05-08T18:08:39.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841755+0000", 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012227399999999999 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.842349+0000", 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00059377699999999998 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.846949+0000", 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004599723 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847008+0000", 2024-05-08T18:08:39.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8854999999999998e-05 2024-05-08T18:08:39.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847057+0000", 2024-05-08T18:08:39.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8956999999999999e-05 2024-05-08T18:08:39.705 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.705 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.705 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.705 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:541 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.705 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:39.705 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.811947919999994, 2024-05-08T18:08:39.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037829790000000001, 2024-05-08T18:08:39.706 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.706 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.706 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.706 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.706 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.706 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.706 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 541 2024-05-08T18:08:39.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.706 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:39.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:39.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848523+0000", 2024-05-08T18:08:39.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8599999999999997e-07 2024-05-08T18:08:39.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848526+0000", 2024-05-08T18:08:39.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4690000000000002e-06 2024-05-08T18:08:39.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848536+0000", 2024-05-08T18:08:39.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2029999999999998e-06 2024-05-08T18:08:39.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848540+0000", 2024-05-08T18:08:39.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9169999999999997e-06 2024-05-08T18:08:39.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848591+0000", 2024-05-08T18:08:39.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0328000000000003e-05 2024-05-08T18:08:39.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848646+0000", 2024-05-08T18:08:39.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5281999999999997e-05 2024-05-08T18:08:39.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:39.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848759+0000", 2024-05-08T18:08:39.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011278899999999999 2024-05-08T18:08:39.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.849323+0000", 2024-05-08T18:08:39.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056433999999999998 2024-05-08T18:08:39.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852225+0000", 2024-05-08T18:08:39.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029017320000000002 2024-05-08T18:08:39.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852277+0000", 2024-05-08T18:08:39.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2460999999999998e-05 2024-05-08T18:08:39.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852305+0000", 2024-05-08T18:08:39.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7671999999999999e-05 2024-05-08T18:08:39.711 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.711 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.711 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.711 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.711 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:39.711 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.678800843000005, 2024-05-08T18:08:39.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002973084, 2024-05-08T18:08:39.711 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.711 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.711 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.712 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.712 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.712 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.712 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 703 2024-05-08T18:08:39.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.712 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:39.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:39.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981672+0000", 2024-05-08T18:08:39.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5799999999999999e-06 2024-05-08T18:08:39.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981683+0000", 2024-05-08T18:08:39.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1270000000000001e-05 2024-05-08T18:08:39.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981715+0000", 2024-05-08T18:08:39.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1470000000000002e-05 2024-05-08T18:08:39.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981730+0000", 2024-05-08T18:08:39.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5262999999999999e-05 2024-05-08T18:08:39.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981864+0000", 2024-05-08T18:08:39.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134043 2024-05-08T18:08:39.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982168+0000", 2024-05-08T18:08:39.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030453799999999998 2024-05-08T18:08:39.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:39.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982620+0000", 2024-05-08T18:08:39.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045170900000000001 2024-05-08T18:08:39.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.983648+0000", 2024-05-08T18:08:39.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010276009999999999 2024-05-08T18:08:39.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984486+0000", 2024-05-08T18:08:39.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083874600000000002 2024-05-08T18:08:39.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984571+0000", 2024-05-08T18:08:39.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4370999999999996e-05 2024-05-08T18:08:39.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984642+0000", 2024-05-08T18:08:39.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1493000000000001e-05 2024-05-08T18:08:39.716 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.717 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.717 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.717 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:789 6.0 e32/26 6:0216b5b6:::obj_delete_at_hint.0000000070:head v 32'14, mlcod=32'12)", 2024-05-08T18:08:39.717 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:39.717 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.479374070000006, 2024-05-08T18:08:39.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034621420000000001, 2024-05-08T18:08:39.717 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.717 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.717 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.717 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:39.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:39.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181098+0000", 2024-05-08T18:08:39.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8029999999999999e-06 2024-05-08T18:08:39.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181109+0000", 2024-05-08T18:08:39.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1219999999999999e-05 2024-05-08T18:08:39.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181138+0000", 2024-05-08T18:08:39.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.898e-05 2024-05-08T18:08:39.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181151+0000", 2024-05-08T18:08:39.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.308e-05 2024-05-08T18:08:39.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181268+0000", 2024-05-08T18:08:39.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116629 2024-05-08T18:08:39.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181321+0000", 2024-05-08T18:08:39.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3325999999999997e-05 2024-05-08T18:08:39.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184477+0000", 2024-05-08T18:08:39.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003156458 2024-05-08T18:08:39.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184558+0000", 2024-05-08T18:08:39.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0646e-05 2024-05-08T18:08:39.721 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.721 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.721 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.721 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.721 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:39.721 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.448200565999997, 2024-05-08T18:08:39.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031146310000000001, 2024-05-08T18:08:39.722 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.722 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.722 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.722 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.722 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.722 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.722 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 802 2024-05-08T18:08:39.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.722 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:39.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212272+0000", 2024-05-08T18:08:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.943e-06 2024-05-08T18:08:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212284+0000", 2024-05-08T18:08:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1747e-05 2024-05-08T18:08:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212315+0000", 2024-05-08T18:08:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0579e-05 2024-05-08T18:08:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212336+0000", 2024-05-08T18:08:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1639999999999999e-05 2024-05-08T18:08:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212488+0000", 2024-05-08T18:08:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151192 2024-05-08T18:08:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212703+0000", 2024-05-08T18:08:39.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000215439 2024-05-08T18:08:39.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:39.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.213033+0000", 2024-05-08T18:08:39.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032992699999999999 2024-05-08T18:08:39.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.214306+0000", 2024-05-08T18:08:39.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012726949999999999 2024-05-08T18:08:39.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215232+0000", 2024-05-08T18:08:39.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092652999999999995 2024-05-08T18:08:39.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215321+0000", 2024-05-08T18:08:39.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9272999999999997e-05 2024-05-08T18:08:39.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215384+0000", 2024-05-08T18:08:39.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2665999999999999e-05 2024-05-08T18:08:39.726 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.726 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.726 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.727 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.727 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:39.727 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.367656159999996, 2024-05-08T18:08:39.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030150250000000002, 2024-05-08T18:08:39.727 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.727 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.727 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.727 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.727 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.727 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.727 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 838 2024-05-08T18:08:39.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.728 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:39.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:39.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292816+0000", 2024-05-08T18:08:39.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:08:39.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292828+0000", 2024-05-08T18:08:39.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.184e-05 2024-05-08T18:08:39.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292857+0000", 2024-05-08T18:08:39.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8960000000000001e-05 2024-05-08T18:08:39.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292871+0000", 2024-05-08T18:08:39.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.45e-05 2024-05-08T18:08:39.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293000+0000", 2024-05-08T18:08:39.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128875 2024-05-08T18:08:39.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293231+0000", 2024-05-08T18:08:39.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023030500000000001 2024-05-08T18:08:39.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:39.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293563+0000", 2024-05-08T18:08:39.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000332648 2024-05-08T18:08:39.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.294882+0000", 2024-05-08T18:08:39.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001319183 2024-05-08T18:08:39.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295664+0000", 2024-05-08T18:08:39.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000781991 2024-05-08T18:08:39.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295754+0000", 2024-05-08T18:08:39.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9176000000000001e-05 2024-05-08T18:08:39.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295829+0000", 2024-05-08T18:08:39.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.525e-05 2024-05-08T18:08:39.732 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.732 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.732 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.732 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.732 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:39.732 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.306522490999996, 2024-05-08T18:08:39.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029338929999999999, 2024-05-08T18:08:39.732 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.733 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.733 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.733 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.733 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.733 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.733 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 865 2024-05-08T18:08:39.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.733 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:39.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:39.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353950+0000", 2024-05-08T18:08:39.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2469999999999998e-06 2024-05-08T18:08:39.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353961+0000", 2024-05-08T18:08:39.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1523e-05 2024-05-08T18:08:39.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353991+0000", 2024-05-08T18:08:39.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9920000000000002e-05 2024-05-08T18:08:39.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354013+0000", 2024-05-08T18:08:39.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1590000000000002e-05 2024-05-08T18:08:39.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354206+0000", 2024-05-08T18:08:39.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019273900000000001 2024-05-08T18:08:39.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354418+0000", 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212518 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354720+0000", 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030151800000000002 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.355983+0000", 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012636780000000001 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356733+0000", 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074988400000000003 2024-05-08T18:08:39.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356819+0000", 2024-05-08T18:08:39.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5690000000000001e-05 2024-05-08T18:08:39.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356881+0000", 2024-05-08T18:08:39.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2586e-05 2024-05-08T18:08:39.737 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.737 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.737 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.737 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.738 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:39.738 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.293399125999997, 2024-05-08T18:08:39.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004954511, 2024-05-08T18:08:39.738 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.738 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.738 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.738 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.738 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.738 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.738 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 871 2024-05-08T18:08:39.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.738 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:39.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:39.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367073+0000", 2024-05-08T18:08:39.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2340000000000001e-06 2024-05-08T18:08:39.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367085+0000", 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1483e-05 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367111+0000", 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5890000000000001e-05 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367130+0000", 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9700000000000001e-05 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367284+0000", 2024-05-08T18:08:39.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015411799999999999 2024-05-08T18:08:39.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367516+0000", 2024-05-08T18:08:39.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000231272 2024-05-08T18:08:39.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:39.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367837+0000", 2024-05-08T18:08:39.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032173400000000001 2024-05-08T18:08:39.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371395+0000", 2024-05-08T18:08:39.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035574719999999999 2024-05-08T18:08:39.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371882+0000", 2024-05-08T18:08:39.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048693899999999998 2024-05-08T18:08:39.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371962+0000", 2024-05-08T18:08:39.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.975e-05 2024-05-08T18:08:39.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372025+0000", 2024-05-08T18:08:39.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3918999999999996e-05 2024-05-08T18:08:39.743 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.743 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.743 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.743 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.743 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:39.743 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.287511421999994, 2024-05-08T18:08:39.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045233640000000002, 2024-05-08T18:08:39.743 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.743 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.743 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.743 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.743 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.743 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.744 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 873 2024-05-08T18:08:39.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.744 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:39.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:39.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372961+0000", 2024-05-08T18:08:39.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:08:39.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372969+0000", 2024-05-08T18:08:39.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2940000000000006e-06 2024-05-08T18:08:39.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372991+0000", 2024-05-08T18:08:39.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1829000000000001e-05 2024-05-08T18:08:39.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373009+0000", 2024-05-08T18:08:39.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8607e-05 2024-05-08T18:08:39.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373127+0000", 2024-05-08T18:08:39.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011728899999999999 2024-05-08T18:08:39.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373260+0000", 2024-05-08T18:08:39.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013301200000000001 2024-05-08T18:08:39.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:39.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373526+0000", 2024-05-08T18:08:39.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026613500000000003 2024-05-08T18:08:39.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.374558+0000", 2024-05-08T18:08:39.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001032156 2024-05-08T18:08:39.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377333+0000", 2024-05-08T18:08:39.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027749329999999998 2024-05-08T18:08:39.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377421+0000", 2024-05-08T18:08:39.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8679999999999998e-05 2024-05-08T18:08:39.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377482+0000", 2024-05-08T18:08:39.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0538999999999998e-05 2024-05-08T18:08:39.748 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.748 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.748 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.748 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.748 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:39.748 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.227902267999994, 2024-05-08T18:08:39.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035261009999999998, 2024-05-08T18:08:39.749 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.749 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.749 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.749 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.749 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.749 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.749 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 898 2024-05-08T18:08:39.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.749 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:39.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:39.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432570+0000", 2024-05-08T18:08:39.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.26e-06 2024-05-08T18:08:39.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432580+0000", 2024-05-08T18:08:39.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8570000000000007e-06 2024-05-08T18:08:39.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432605+0000", 2024-05-08T18:08:39.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5273e-05 2024-05-08T18:08:39.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432618+0000", 2024-05-08T18:08:39.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2999999999999999e-05 2024-05-08T18:08:39.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432742+0000", 2024-05-08T18:08:39.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012369200000000001 2024-05-08T18:08:39.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433109+0000", 2024-05-08T18:08:39.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036760500000000002 2024-05-08T18:08:39.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:39.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433645+0000", 2024-05-08T18:08:39.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053599599999999996 2024-05-08T18:08:39.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435050+0000", 2024-05-08T18:08:39.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001404696 2024-05-08T18:08:39.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435834+0000", 2024-05-08T18:08:39.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078381100000000003 2024-05-08T18:08:39.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435984+0000", 2024-05-08T18:08:39.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015006899999999999 2024-05-08T18:08:39.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.436094+0000", 2024-05-08T18:08:39.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109842 2024-05-08T18:08:39.753 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.753 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.754 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.754 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.754 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:39.754 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.223149418999995, 2024-05-08T18:08:39.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031481899999999999, 2024-05-08T18:08:39.754 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.754 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.754 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.754 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 900 2024-05-08T18:08:39.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.754 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:39.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:39.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437323+0000", 2024-05-08T18:08:39.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.447e-06 2024-05-08T18:08:39.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437334+0000", 2024-05-08T18:08:39.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0835999999999999e-05 2024-05-08T18:08:39.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437364+0000", 2024-05-08T18:08:39.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0463999999999998e-05 2024-05-08T18:08:39.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437379+0000", 2024-05-08T18:08:39.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4806e-05 2024-05-08T18:08:39.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437500+0000", 2024-05-08T18:08:39.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121309 2024-05-08T18:08:39.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437729+0000", 2024-05-08T18:08:39.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022818200000000001 2024-05-08T18:08:39.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:39.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.438199+0000", 2024-05-08T18:08:39.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047025300000000001 2024-05-08T18:08:39.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.439418+0000", 2024-05-08T18:08:39.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012193849999999999 2024-05-08T18:08:39.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440217+0000", 2024-05-08T18:08:39.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00079905999999999998 2024-05-08T18:08:39.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440352+0000", 2024-05-08T18:08:39.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013485299999999999 2024-05-08T18:08:39.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440469+0000", 2024-05-08T18:08:39.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116595 2024-05-08T18:08:39.759 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.759 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.759 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.759 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:39.759 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:39.759 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.136913414000006, 2024-05-08T18:08:39.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003477894, 2024-05-08T18:08:39.759 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:39.759 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:39.760 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:39.760 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:39.760 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:39.760 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:39.760 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 937 2024-05-08T18:08:39.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.760 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:39.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:39.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:39.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:39.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:39.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:39.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:39.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523559+0000", 2024-05-08T18:08:39.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.95e-06 2024-05-08T18:08:39.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:39.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523567+0000", 2024-05-08T18:08:39.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6799999999999999e-06 2024-05-08T18:08:39.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:39.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523591+0000", 2024-05-08T18:08:39.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3269e-05 2024-05-08T18:08:39.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:39.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523611+0000", 2024-05-08T18:08:39.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0100000000000001e-05 2024-05-08T18:08:39.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:39.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523767+0000", 2024-05-08T18:08:39.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015604900000000001 2024-05-08T18:08:39.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:39.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523994+0000", 2024-05-08T18:08:39.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022764199999999999 2024-05-08T18:08:39.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:39.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.524338+0000", 2024-05-08T18:08:39.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034388700000000002 2024-05-08T18:08:39.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:39.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.525707+0000", 2024-05-08T18:08:39.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001368544 2024-05-08T18:08:39.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:39.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526843+0000", 2024-05-08T18:08:39.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001136501 2024-05-08T18:08:39.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:39.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526957+0000", 2024-05-08T18:08:39.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011359 2024-05-08T18:08:39.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:39.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:39.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:39.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.527035+0000", 2024-05-08T18:08:39.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7682000000000006e-05 2024-05-08T18:08:39.764 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.764 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.764 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.764 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:39.765 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:39.765 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:39.766 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:08:39.766 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:39.764+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:39.866 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:39.868+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:39.901 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:39.901 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:39.916 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:08:39.945 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:08:39.990 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:39.992+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:40.035 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:40.035 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:40.035 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:40.035 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:40.035 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:40.049 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:08:40.068 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:40.068+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:40.140 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:40.168 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:40.168+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:40.170 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:40.170 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:40.173 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:40.173 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:40.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:40.173 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:40.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.174 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:36 5.e 5:71234df9:::zone_info.d0a95a6c-3c84-4d52-915c-e8ea581dfb9b:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:08:40.174 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:40.174 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 80.598395027999999, 2024-05-08T18:08:40.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028394430000000001, 2024-05-08T18:08:40.174 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.174 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.174 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.174 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.174 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:08:40.174 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:08:40.174 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 36 2024-05-08T18:08:40.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.178 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:40.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:40.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573456+0000", 2024-05-08T18:08:40.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:40.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573467+0000", 2024-05-08T18:08:40.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1243999999999999e-05 2024-05-08T18:08:40.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573499+0000", 2024-05-08T18:08:40.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1343000000000001e-05 2024-05-08T18:08:40.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573522+0000", 2024-05-08T18:08:40.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3540000000000002e-05 2024-05-08T18:08:40.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573634+0000", 2024-05-08T18:08:40.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112249 2024-05-08T18:08:40.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573841+0000", 2024-05-08T18:08:40.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000206407 2024-05-08T18:08:40.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:40.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.574122+0000", 2024-05-08T18:08:40.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000281475 2024-05-08T18:08:40.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.575489+0000", 2024-05-08T18:08:40.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001366391 2024-05-08T18:08:40.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576157+0000", 2024-05-08T18:08:40.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00066776200000000002 2024-05-08T18:08:40.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576234+0000", 2024-05-08T18:08:40.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7285000000000003e-05 2024-05-08T18:08:40.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576293+0000", 2024-05-08T18:08:40.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9556999999999999e-05 2024-05-08T18:08:40.183 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.183 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.183 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.183 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:40.183 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:40.183 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.641635835000002, 2024-05-08T18:08:40.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018560765, 2024-05-08T18:08:40.183 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.183 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.183 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:08:40.184 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.184 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.184 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.184 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 43 2024-05-08T18:08:40.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.184 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:40.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:40.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530217+0000", 2024-05-08T18:08:40.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:08:40.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530253+0000", 2024-05-08T18:08:40.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5621999999999999e-05 2024-05-08T18:08:40.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530288+0000", 2024-05-08T18:08:40.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5846999999999997e-05 2024-05-08T18:08:40.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530314+0000", 2024-05-08T18:08:40.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5732e-05 2024-05-08T18:08:40.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530952+0000", 2024-05-08T18:08:40.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00063739999999999999 2024-05-08T18:08:40.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:40.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530977+0000", 2024-05-08T18:08:40.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5375e-05 2024-05-08T18:08:40.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548506+0000", 2024-05-08T18:08:40.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017528781 2024-05-08T18:08:40.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548774+0000", 2024-05-08T18:08:40.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026821199999999999 2024-05-08T18:08:40.187 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.187 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.187 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.188 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.188 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:40.188 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.559321910999998, 2024-05-08T18:08:40.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003496893, 2024-05-08T18:08:40.188 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.188 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.188 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.188 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.188 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.188 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.188 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 211 2024-05-08T18:08:40.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.188 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:40.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:40.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612530+0000", 2024-05-08T18:08:40.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9490000000000001e-06 2024-05-08T18:08:40.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612544+0000", 2024-05-08T18:08:40.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3779e-05 2024-05-08T18:08:40.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612578+0000", 2024-05-08T18:08:40.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4421000000000001e-05 2024-05-08T18:08:40.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612596+0000", 2024-05-08T18:08:40.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7435000000000002e-05 2024-05-08T18:08:40.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612718+0000", 2024-05-08T18:08:40.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012218600000000001 2024-05-08T18:08:40.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612951+0000", 2024-05-08T18:08:40.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000232768 2024-05-08T18:08:40.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:40.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.613370+0000", 2024-05-08T18:08:40.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041921200000000002 2024-05-08T18:08:40.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.614840+0000", 2024-05-08T18:08:40.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014703679999999999 2024-05-08T18:08:40.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615860+0000", 2024-05-08T18:08:40.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010198220000000001 2024-05-08T18:08:40.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615954+0000", 2024-05-08T18:08:40.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4419000000000005e-05 2024-05-08T18:08:40.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.616024+0000", 2024-05-08T18:08:40.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9534000000000002e-05 2024-05-08T18:08:40.193 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.193 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.193 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.193 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.193 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:40.193 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.482632229000004, 2024-05-08T18:08:40.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035800939999999998, 2024-05-08T18:08:40.193 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.194 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.194 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.194 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.194 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.194 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.194 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 232 2024-05-08T18:08:40.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.194 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:40.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:40.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689219+0000", 2024-05-08T18:08:40.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4490000000000002e-06 2024-05-08T18:08:40.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689232+0000", 2024-05-08T18:08:40.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3183000000000001e-05 2024-05-08T18:08:40.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689263+0000", 2024-05-08T18:08:40.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400999999999999e-05 2024-05-08T18:08:40.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689279+0000", 2024-05-08T18:08:40.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6078000000000001e-05 2024-05-08T18:08:40.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689401+0000", 2024-05-08T18:08:40.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012243000000000001 2024-05-08T18:08:40.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689656+0000", 2024-05-08T18:08:40.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431899999999998 2024-05-08T18:08:40.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:40.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.690103+0000", 2024-05-08T18:08:40.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044706299999999999 2024-05-08T18:08:40.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.691780+0000", 2024-05-08T18:08:40.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016774209999999999 2024-05-08T18:08:40.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692634+0000", 2024-05-08T18:08:40.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085346 2024-05-08T18:08:40.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692728+0000", 2024-05-08T18:08:40.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4429e-05 2024-05-08T18:08:40.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692797+0000", 2024-05-08T18:08:40.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8861000000000004e-05 2024-05-08T18:08:40.199 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.199 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.199 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.199 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:267 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.199 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:40.199 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.457987251000006, 2024-05-08T18:08:40.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040291739999999999, 2024-05-08T18:08:40.199 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.199 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.199 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.199 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.200 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.200 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.200 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 267 2024-05-08T18:08:40.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.200 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:40.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:40.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713863+0000", 2024-05-08T18:08:40.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5200000000000001e-06 2024-05-08T18:08:40.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713873+0000", 2024-05-08T18:08:40.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9089999999999995e-06 2024-05-08T18:08:40.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713896+0000", 2024-05-08T18:08:40.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2595e-05 2024-05-08T18:08:40.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713914+0000", 2024-05-08T18:08:40.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7869000000000001e-05 2024-05-08T18:08:40.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714048+0000", 2024-05-08T18:08:40.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134802 2024-05-08T18:08:40.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714278+0000", 2024-05-08T18:08:40.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022994399999999999 2024-05-08T18:08:40.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:40.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714777+0000", 2024-05-08T18:08:40.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049880499999999995 2024-05-08T18:08:40.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.715976+0000", 2024-05-08T18:08:40.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011991110000000001 2024-05-08T18:08:40.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717646+0000", 2024-05-08T18:08:40.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016699989999999999 2024-05-08T18:08:40.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717790+0000", 2024-05-08T18:08:40.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014359799999999999 2024-05-08T18:08:40.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717891+0000", 2024-05-08T18:08:40.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101022 2024-05-08T18:08:40.204 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.204 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.204 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.205 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:308 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:40.205 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:40.205 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.450620010999998, 2024-05-08T18:08:40.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031672779999999999, 2024-05-08T18:08:40.205 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.205 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.205 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.205 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:40.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:40.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721230+0000", 2024-05-08T18:08:40.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:08:40.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721241+0000", 2024-05-08T18:08:40.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0942e-05 2024-05-08T18:08:40.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721265+0000", 2024-05-08T18:08:40.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3371e-05 2024-05-08T18:08:40.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721278+0000", 2024-05-08T18:08:40.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3586e-05 2024-05-08T18:08:40.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721399+0000", 2024-05-08T18:08:40.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012092 2024-05-08T18:08:40.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721507+0000", 2024-05-08T18:08:40.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107651 2024-05-08T18:08:40.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724292+0000", 2024-05-08T18:08:40.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027851870000000002 2024-05-08T18:08:40.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724396+0000", 2024-05-08T18:08:40.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000104114 2024-05-08T18:08:40.208 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.209 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.209 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.209 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:495 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.209 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:40.209 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.368002110000006, 2024-05-08T18:08:40.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005951001, 2024-05-08T18:08:40.209 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.209 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.209 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.209 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.209 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.209 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.209 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 495 2024-05-08T18:08:40.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.210 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:40.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:40.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803849+0000", 2024-05-08T18:08:40.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3580000000000001e-06 2024-05-08T18:08:40.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803864+0000", 2024-05-08T18:08:40.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4742999999999999e-05 2024-05-08T18:08:40.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803895+0000", 2024-05-08T18:08:40.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0970000000000003e-05 2024-05-08T18:08:40.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803908+0000", 2024-05-08T18:08:40.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2588999999999999e-05 2024-05-08T18:08:40.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804005+0000", 2024-05-08T18:08:40.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7107000000000004e-05 2024-05-08T18:08:40.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804291+0000", 2024-05-08T18:08:40.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028626900000000002 2024-05-08T18:08:40.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:40.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804648+0000", 2024-05-08T18:08:40.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000356955 2024-05-08T18:08:40.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805740+0000", 2024-05-08T18:08:40.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001091905 2024-05-08T18:08:40.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809636+0000", 2024-05-08T18:08:40.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389661 2024-05-08T18:08:40.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809722+0000", 2024-05-08T18:08:40.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:08:40.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809798+0000", 2024-05-08T18:08:40.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5462000000000004e-05 2024-05-08T18:08:40.214 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.214 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.214 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.214 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.214 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:40.214 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.361390791999995, 2024-05-08T18:08:40.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051396380000000002, 2024-05-08T18:08:40.214 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.215 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.215 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.215 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.215 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.215 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.215 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 504 2024-05-08T18:08:40.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.215 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:40.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810460+0000", 2024-05-08T18:08:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:08:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810470+0000", 2024-05-08T18:08:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0222e-05 2024-05-08T18:08:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810495+0000", 2024-05-08T18:08:40.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4508999999999999e-05 2024-05-08T18:08:40.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810515+0000", 2024-05-08T18:08:40.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9998999999999999e-05 2024-05-08T18:08:40.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810653+0000", 2024-05-08T18:08:40.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013851099999999999 2024-05-08T18:08:40.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810782+0000", 2024-05-08T18:08:40.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128152 2024-05-08T18:08:40.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:40.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811043+0000", 2024-05-08T18:08:40.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026172400000000002 2024-05-08T18:08:40.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812164+0000", 2024-05-08T18:08:40.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001121024 2024-05-08T18:08:40.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815415+0000", 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032510270000000001 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815538+0000", 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012256999999999999 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815598+0000", 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9923000000000002e-05 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.220 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:629 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.220 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:40.220 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.253086052, 2024-05-08T18:08:40.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611169999999998, 2024-05-08T18:08:40.220 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.220 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.220 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.220 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.220 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.220 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.220 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 629 2024-05-08T18:08:40.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.220 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:40.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:40.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918765+0000", 2024-05-08T18:08:40.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5670000000000002e-06 2024-05-08T18:08:40.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918777+0000", 2024-05-08T18:08:40.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1635e-05 2024-05-08T18:08:40.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918808+0000", 2024-05-08T18:08:40.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1024e-05 2024-05-08T18:08:40.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918823+0000", 2024-05-08T18:08:40.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4939e-05 2024-05-08T18:08:40.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918930+0000", 2024-05-08T18:08:40.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107144 2024-05-08T18:08:40.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919147+0000", 2024-05-08T18:08:40.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021682599999999999 2024-05-08T18:08:40.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:40.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919464+0000", 2024-05-08T18:08:40.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031716699999999998 2024-05-08T18:08:40.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.920561+0000", 2024-05-08T18:08:40.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010970229999999999 2024-05-08T18:08:40.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921468+0000", 2024-05-08T18:08:40.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00090726800000000003 2024-05-08T18:08:40.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921549+0000", 2024-05-08T18:08:40.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0430000000000001e-05 2024-05-08T18:08:40.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921624+0000", 2024-05-08T18:08:40.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5093999999999996e-05 2024-05-08T18:08:40.225 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.225 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.225 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.225 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:681 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.225 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:40.225 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.212765304000001, 2024-05-08T18:08:40.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044793259999999996, 2024-05-08T18:08:40.225 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.226 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.226 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.226 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.226 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.226 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.226 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 681 2024-05-08T18:08:40.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.226 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:40.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:40.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959085+0000", 2024-05-08T18:08:40.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.353e-06 2024-05-08T18:08:40.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959092+0000", 2024-05-08T18:08:40.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999999e-06 2024-05-08T18:08:40.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959113+0000", 2024-05-08T18:08:40.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0744e-05 2024-05-08T18:08:40.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959130+0000", 2024-05-08T18:08:40.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7679000000000001e-05 2024-05-08T18:08:40.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959217+0000", 2024-05-08T18:08:40.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6487000000000001e-05 2024-05-08T18:08:40.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959335+0000", 2024-05-08T18:08:40.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118476 2024-05-08T18:08:40.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:40.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959598+0000", 2024-05-08T18:08:40.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000263045 2024-05-08T18:08:40.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.960551+0000", 2024-05-08T18:08:40.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095251500000000002 2024-05-08T18:08:40.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963412+0000", 2024-05-08T18:08:40.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611800000000001 2024-05-08T18:08:40.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963498+0000", 2024-05-08T18:08:40.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6145999999999998e-05 2024-05-08T18:08:40.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963563+0000", 2024-05-08T18:08:40.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4701000000000003e-05 2024-05-08T18:08:40.230 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.231 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.231 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.231 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.231 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:40.231 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.177816867999994, 2024-05-08T18:08:40.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031621710000000001, 2024-05-08T18:08:40.231 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.231 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.231 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.231 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.231 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.231 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.231 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 709 2024-05-08T18:08:40.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.232 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:40.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:40.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994035+0000", 2024-05-08T18:08:40.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6460000000000002e-06 2024-05-08T18:08:40.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994047+0000", 2024-05-08T18:08:40.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999e-05 2024-05-08T18:08:40.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994076+0000", 2024-05-08T18:08:40.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9564e-05 2024-05-08T18:08:40.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994091+0000", 2024-05-08T18:08:40.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4696e-05 2024-05-08T18:08:40.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994239+0000", 2024-05-08T18:08:40.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014779699999999999 2024-05-08T18:08:40.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994585+0000", 2024-05-08T18:08:40.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034605900000000002 2024-05-08T18:08:40.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:40.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.995084+0000", 2024-05-08T18:08:40.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049904799999999998 2024-05-08T18:08:40.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.996558+0000", 2024-05-08T18:08:40.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001474532 2024-05-08T18:08:40.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997045+0000", 2024-05-08T18:08:40.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048685900000000002 2024-05-08T18:08:40.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997127+0000", 2024-05-08T18:08:40.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1280999999999996e-05 2024-05-08T18:08:40.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997194+0000", 2024-05-08T18:08:40.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7689999999999997e-05 2024-05-08T18:08:40.236 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.236 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.236 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.236 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.236 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:40.237 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.142427482000002, 2024-05-08T18:08:40.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003066236, 2024-05-08T18:08:40.237 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.237 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.237 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.237 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.237 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.237 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.237 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 724 2024-05-08T18:08:40.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.237 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:40.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:40.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029424+0000", 2024-05-08T18:08:40.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.503e-06 2024-05-08T18:08:40.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029437+0000", 2024-05-08T18:08:40.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3309000000000001e-05 2024-05-08T18:08:40.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029467+0000", 2024-05-08T18:08:40.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9677999999999999e-05 2024-05-08T18:08:40.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029489+0000", 2024-05-08T18:08:40.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2314999999999999e-05 2024-05-08T18:08:40.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029600+0000", 2024-05-08T18:08:40.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110561 2024-05-08T18:08:40.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029896+0000", 2024-05-08T18:08:40.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029632200000000001 2024-05-08T18:08:40.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:40.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.030468+0000", 2024-05-08T18:08:40.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00057224700000000001 2024-05-08T18:08:40.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.031728+0000", 2024-05-08T18:08:40.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012595429999999999 2024-05-08T18:08:40.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032338+0000", 2024-05-08T18:08:40.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00061006700000000005 2024-05-08T18:08:40.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032424+0000", 2024-05-08T18:08:40.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:40.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032488+0000", 2024-05-08T18:08:40.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4210999999999999e-05 2024-05-08T18:08:40.242 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.242 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.242 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.242 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.242 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:40.242 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.137777068000005, 2024-05-08T18:08:40.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029269769999999999, 2024-05-08T18:08:40.242 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.243 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.243 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.243 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.243 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.243 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.243 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 726 2024-05-08T18:08:40.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.243 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:40.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:40.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034074+0000", 2024-05-08T18:08:40.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5900000000000002e-06 2024-05-08T18:08:40.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034086+0000", 2024-05-08T18:08:40.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1265e-05 2024-05-08T18:08:40.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034118+0000", 2024-05-08T18:08:40.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2341000000000001e-05 2024-05-08T18:08:40.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034133+0000", 2024-05-08T18:08:40.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5166e-05 2024-05-08T18:08:40.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034254+0000", 2024-05-08T18:08:40.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121033 2024-05-08T18:08:40.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034492+0000", 2024-05-08T18:08:40.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023727700000000001 2024-05-08T18:08:40.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:40.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034967+0000", 2024-05-08T18:08:40.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047522100000000001 2024-05-08T18:08:40.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036353+0000", 2024-05-08T18:08:40.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013865800000000001 2024-05-08T18:08:40.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036841+0000", 2024-05-08T18:08:40.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048788999999999999 2024-05-08T18:08:40.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036929+0000", 2024-05-08T18:08:40.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:08:40.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036999+0000", 2024-05-08T18:08:40.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9448000000000003e-05 2024-05-08T18:08:40.247 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.134482238000004, 2024-05-08T18:08:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003040662, 2024-05-08T18:08:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 727 2024-05-08T18:08:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037369+0000", 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037378+0000", 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5359999999999998e-06 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037405+0000", 2024-05-08T18:08:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6588e-05 2024-05-08T18:08:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037418+0000", 2024-05-08T18:08:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3642000000000001e-05 2024-05-08T18:08:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037531+0000", 2024-05-08T18:08:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112304 2024-05-08T18:08:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037785+0000", 2024-05-08T18:08:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025391299999999998 2024-05-08T18:08:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.038112+0000", 2024-05-08T18:08:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000326946 2024-05-08T18:08:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.039316+0000", 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012043990000000001 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040257+0000", 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000941083 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040345+0000", 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8368999999999994e-05 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040407+0000", 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1941999999999997e-05 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.019816848999994, 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028797779999999999, 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 777 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152034+0000", 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2299999999999998e-06 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152045+0000", 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0266e-05 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152076+0000", 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1007000000000003e-05 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152094+0000", 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8148999999999999e-05 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152183+0000", 2024-05-08T18:08:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8845999999999996e-05 2024-05-08T18:08:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152308+0000", 2024-05-08T18:08:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012502999999999999 2024-05-08T18:08:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152578+0000", 2024-05-08T18:08:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027080099999999998 2024-05-08T18:08:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154238+0000", 2024-05-08T18:08:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016600180000000001 2024-05-08T18:08:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154714+0000", 2024-05-08T18:08:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000475341 2024-05-08T18:08:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154803+0000", 2024-05-08T18:08:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9566000000000003e-05 2024-05-08T18:08:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154912+0000", 2024-05-08T18:08:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010852400000000001 2024-05-08T18:08:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 72.776600955999996, 2024-05-08T18:08:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002844437, 2024-05-08T18:08:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 882 2024-05-08T18:08:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395250+0000", 2024-05-08T18:08:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-06 2024-05-08T18:08:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395261+0000", 2024-05-08T18:08:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1046000000000001e-05 2024-05-08T18:08:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395293+0000", 2024-05-08T18:08:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1473999999999997e-05 2024-05-08T18:08:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395307+0000", 2024-05-08T18:08:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4599e-05 2024-05-08T18:08:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395481+0000", 2024-05-08T18:08:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173499 2024-05-08T18:08:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395626+0000", 2024-05-08T18:08:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000145351 2024-05-08T18:08:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395902+0000", 2024-05-08T18:08:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027534499999999997 2024-05-08T18:08:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397118+0000", 2024-05-08T18:08:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012168929999999999 2024-05-08T18:08:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397951+0000", 2024-05-08T18:08:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000832272 2024-05-08T18:08:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398028+0000", 2024-05-08T18:08:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6921000000000004e-05 2024-05-08T18:08:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398092+0000", 2024-05-08T18:08:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4783999999999995e-05 2024-05-08T18:08:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 72.773540236000002, 2024-05-08T18:08:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002853894, 2024-05-08T18:08:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 883 2024-05-08T18:08:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398311+0000", 2024-05-08T18:08:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398321+0000", 2024-05-08T18:08:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9189999999999994e-06 2024-05-08T18:08:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398346+0000", 2024-05-08T18:08:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5065000000000001e-05 2024-05-08T18:08:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398360+0000", 2024-05-08T18:08:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4171999999999999e-05 2024-05-08T18:08:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398495+0000", 2024-05-08T18:08:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013503199999999999 2024-05-08T18:08:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398716+0000", 2024-05-08T18:08:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220459 2024-05-08T18:08:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.399054+0000", 2024-05-08T18:08:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033806199999999998 2024-05-08T18:08:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.400192+0000", 2024-05-08T18:08:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011389169999999999 2024-05-08T18:08:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401020+0000", 2024-05-08T18:08:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082746199999999995 2024-05-08T18:08:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401099+0000", 2024-05-08T18:08:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9157000000000001e-05 2024-05-08T18:08:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401163+0000", 2024-05-08T18:08:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3498999999999996e-05 2024-05-08T18:08:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 72.769751399, 2024-05-08T18:08:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031354040000000001, 2024-05-08T18:08:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 885 2024-05-08T18:08:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402100+0000", 2024-05-08T18:08:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.063e-06 2024-05-08T18:08:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402110+0000", 2024-05-08T18:08:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0453e-05 2024-05-08T18:08:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402141+0000", 2024-05-08T18:08:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0651000000000002e-05 2024-05-08T18:08:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402162+0000", 2024-05-08T18:08:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1373999999999999e-05 2024-05-08T18:08:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402306+0000", 2024-05-08T18:08:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143492 2024-05-08T18:08:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402562+0000", 2024-05-08T18:08:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025671899999999998 2024-05-08T18:08:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.403047+0000", 2024-05-08T18:08:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048419100000000003 2024-05-08T18:08:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404370+0000", 2024-05-08T18:08:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013231580000000001 2024-05-08T18:08:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404966+0000", 2024-05-08T18:08:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00059601100000000002 2024-05-08T18:08:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405115+0000", 2024-05-08T18:08:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149665 2024-05-08T18:08:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405233+0000", 2024-05-08T18:08:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117627 2024-05-08T18:08:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 72.672453864000005, 2024-05-08T18:08:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003251168, 2024-05-08T18:08:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 927 2024-05-08T18:08:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499396+0000", 2024-05-08T18:08:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:08:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499404+0000", 2024-05-08T18:08:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2629999999999997e-06 2024-05-08T18:08:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499423+0000", 2024-05-08T18:08:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9695e-05 2024-05-08T18:08:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499435+0000", 2024-05-08T18:08:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1542999999999999e-05 2024-05-08T18:08:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499545+0000", 2024-05-08T18:08:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110064 2024-05-08T18:08:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499764+0000", 2024-05-08T18:08:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021856499999999999 2024-05-08T18:08:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.500237+0000", 2024-05-08T18:08:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047359499999999999 2024-05-08T18:08:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.501627+0000", 2024-05-08T18:08:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013897860000000001 2024-05-08T18:08:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502484+0000", 2024-05-08T18:08:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085733300000000005 2024-05-08T18:08:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502574+0000", 2024-05-08T18:08:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9939999999999996e-05 2024-05-08T18:08:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502646+0000", 2024-05-08T18:08:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2064000000000007e-05 2024-05-08T18:08:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 72.668954322999994, 2024-05-08T18:08:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031881129999999998, 2024-05-08T18:08:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 928 2024-05-08T18:08:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502897+0000", 2024-05-08T18:08:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.916e-06 2024-05-08T18:08:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502906+0000", 2024-05-08T18:08:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2699999999999993e-06 2024-05-08T18:08:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502933+0000", 2024-05-08T18:08:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6823999999999999e-05 2024-05-08T18:08:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502946+0000", 2024-05-08T18:08:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3439e-05 2024-05-08T18:08:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503066+0000", 2024-05-08T18:08:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012013700000000001 2024-05-08T18:08:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503399+0000", 2024-05-08T18:08:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033298600000000001 2024-05-08T18:08:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503928+0000", 2024-05-08T18:08:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052877299999999996 2024-05-08T18:08:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505291+0000", 2024-05-08T18:08:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001363319 2024-05-08T18:08:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505933+0000", 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064135799999999997 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506019+0000", 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6649000000000003e-05 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506083+0000", 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3441999999999993e-05 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:40.289 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:40.289 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:40.289 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:40.290 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:40.291 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:40.291 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:40.291 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:08:40.292 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:40.292 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:40.292 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:40.288+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:40.293 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:40.293 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:40.325 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:40.325 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:40.354 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:40.355 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:40.418 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:40.420+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:40.420 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:40.420 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:40.434 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:08:40.491 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:40.489+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:40.551 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:40.551 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:40.567 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:08:40.591 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:40.592+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:40.692 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:40.693+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:40.732 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:40.732 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:40.746 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:08:40.793 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:40.792+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:40.894 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:40.892+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:40.911 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:40.911 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:40.925 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:08:40.930 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:08:40.994 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:40.993+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:41.048 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:41.048 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:41.063 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:08:41.095 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:41.096+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:41.196 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:41.197+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:41.227 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:41.227 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:41.241 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:08:41.297 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:41.296+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:41.397 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:41.397+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:41.402 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:41.403 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:41.418 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:08:41.498 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:41.500+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:41.582 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:41.582 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:41.597 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:08:41.600 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:41.601+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:41.699 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:41.697+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:41.714 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:41.714 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:41.729 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:08:41.800 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:41.801+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:41.896 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:41.896 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:41.901 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:41.901+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:41.916 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:08:41.916 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-05-08T18:08:42.002 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:42.004+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:42.086 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:42.086 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:42.103 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:42.104+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:42.104 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:08:42.204 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:42.205+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:42.305 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:42.305+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:42.313 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:42.313 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:42.331 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:08:42.376 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:08:42.405 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:42.405+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:42.502 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:42.502 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:42.505 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:42.504+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:42.521 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:08:42.574 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:42.575 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:42.605 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:42.605 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:42.607 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:42.608+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:42.635 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:42.666 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:42.666 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:42.698 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:42.698 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:42.708 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:42.708+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:42.730 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:42.730 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:42.730 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:42.731 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:42.731 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:42.731 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:42.731 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:42.749 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:08:42.764 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:42.765 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:42.797 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:42.797 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:42.809 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:42.809+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:42.910 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:42.912+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:42.936 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:42.936 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:42.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:42.936 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:42.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.937 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:42.937 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:42.937 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 79.369383095000003, 2024-05-08T18:08:42.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035750999999999999, 2024-05-08T18:08:42.937 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:42.937 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:42.937 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:42.937 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:42.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:42.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:42.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:42.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:42.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:42.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570203+0000", 2024-05-08T18:08:42.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6749999999999996e-06 2024-05-08T18:08:42.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:42.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570213+0000", 2024-05-08T18:08:42.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0139999999999999e-05 2024-05-08T18:08:42.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:42.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570231+0000", 2024-05-08T18:08:42.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8402000000000001e-05 2024-05-08T18:08:42.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:42.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570245+0000", 2024-05-08T18:08:42.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3135e-05 2024-05-08T18:08:42.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:42.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570338+0000", 2024-05-08T18:08:42.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3498000000000005e-05 2024-05-08T18:08:42.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:42.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570373+0000", 2024-05-08T18:08:42.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5179999999999999e-05 2024-05-08T18:08:42.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:42.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573694+0000", 2024-05-08T18:08:42.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003320524 2024-05-08T18:08:42.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:42.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573771+0000", 2024-05-08T18:08:42.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7546000000000006e-05 2024-05-08T18:08:42.941 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.941 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:42.942 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.942 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-05-08T18:08:42.942 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:42.942 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 79.364070132999998, 2024-05-08T18:08:42.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038280229999999998, 2024-05-08T18:08:42.942 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:42.942 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:42.942 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:42.942 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:42.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:42.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:42.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:42.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:42.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:42.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575510+0000", 2024-05-08T18:08:42.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0979999999999999e-06 2024-05-08T18:08:42.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:42.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575527+0000", 2024-05-08T18:08:42.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6393999999999999e-05 2024-05-08T18:08:42.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:42.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575549+0000", 2024-05-08T18:08:42.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1843000000000001e-05 2024-05-08T18:08:42.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:42.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575560+0000", 2024-05-08T18:08:42.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.186e-05 2024-05-08T18:08:42.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:42.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575651+0000", 2024-05-08T18:08:42.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1068000000000003e-05 2024-05-08T18:08:42.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:42.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575685+0000", 2024-05-08T18:08:42.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3614e-05 2024-05-08T18:08:42.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:42.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579231+0000", 2024-05-08T18:08:42.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003546249 2024-05-08T18:08:42.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:42.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579337+0000", 2024-05-08T18:08:42.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010589700000000001 2024-05-08T18:08:42.947 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.947 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:42.947 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.947 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-05-08T18:08:42.947 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:42.947 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 79.362032842000005, 2024-05-08T18:08:42.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004223157, 2024-05-08T18:08:42.947 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:42.947 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:42.948 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:42.948 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:42.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:42.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:42.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:42.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:42.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:42.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577548+0000", 2024-05-08T18:08:42.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.66e-06 2024-05-08T18:08:42.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:42.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577561+0000", 2024-05-08T18:08:42.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2533e-05 2024-05-08T18:08:42.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:42.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577585+0000", 2024-05-08T18:08:42.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3873e-05 2024-05-08T18:08:42.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:42.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577605+0000", 2024-05-08T18:08:42.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0477000000000001e-05 2024-05-08T18:08:42.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:42.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577717+0000", 2024-05-08T18:08:42.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011229499999999999 2024-05-08T18:08:42.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:42.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577777+0000", 2024-05-08T18:08:42.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.944e-05 2024-05-08T18:08:42.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:42.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581704+0000", 2024-05-08T18:08:42.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039267800000000004 2024-05-08T18:08:42.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:42.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581770+0000", 2024-05-08T18:08:42.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6099000000000005e-05 2024-05-08T18:08:42.952 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.952 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:42.952 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.952 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:54 7.d e29/28 7:b4812045:::notify.4:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:42.952 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:42.952 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 79.359220117999996, 2024-05-08T18:08:42.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003988503, 2024-05-08T18:08:42.953 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:42.953 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:42.953 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:42.953 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:42.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:42.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:42.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:42.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:42.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:42.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580368+0000", 2024-05-08T18:08:42.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3089999999999996e-06 2024-05-08T18:08:42.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:42.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580400+0000", 2024-05-08T18:08:42.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2580000000000003e-05 2024-05-08T18:08:42.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:42.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580427+0000", 2024-05-08T18:08:42.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6976999999999999e-05 2024-05-08T18:08:42.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:42.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580443+0000", 2024-05-08T18:08:42.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5585000000000001e-05 2024-05-08T18:08:42.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:42.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580555+0000", 2024-05-08T18:08:42.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112639 2024-05-08T18:08:42.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:42.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580601+0000", 2024-05-08T18:08:42.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6e-05 2024-05-08T18:08:42.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:42.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584229+0000", 2024-05-08T18:08:42.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036273659999999999 2024-05-08T18:08:42.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:42.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584348+0000", 2024-05-08T18:08:42.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119047 2024-05-08T18:08:42.958 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.958 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:42.958 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.959 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:42.959 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:42.959 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 79.249806848000006, 2024-05-08T18:08:42.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032136159999999999, 2024-05-08T18:08:42.959 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:42.959 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:42.959 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:42.959 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:42.959 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:42.959 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:42.959 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 193 2024-05-08T18:08:42.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.960 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:42.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:42.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:42.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:42.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:42.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:42.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689775+0000", 2024-05-08T18:08:42.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.357e-06 2024-05-08T18:08:42.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:42.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689788+0000", 2024-05-08T18:08:42.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3029e-05 2024-05-08T18:08:42.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:42.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689819+0000", 2024-05-08T18:08:42.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.065e-05 2024-05-08T18:08:42.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:42.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689833+0000", 2024-05-08T18:08:42.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4790000000000001e-05 2024-05-08T18:08:42.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:42.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689948+0000", 2024-05-08T18:08:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115089 2024-05-08T18:08:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690155+0000", 2024-05-08T18:08:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206932 2024-05-08T18:08:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690420+0000", 2024-05-08T18:08:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026450200000000001 2024-05-08T18:08:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692229+0000", 2024-05-08T18:08:42.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001808823 2024-05-08T18:08:42.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:42.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692816+0000", 2024-05-08T18:08:42.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058773199999999999 2024-05-08T18:08:42.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:42.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692915+0000", 2024-05-08T18:08:42.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8646000000000004e-05 2024-05-08T18:08:42.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:42.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692986+0000", 2024-05-08T18:08:42.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1066e-05 2024-05-08T18:08:42.965 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.965 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:42.965 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.965 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:42.965 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:42.965 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.350840629000004, 2024-05-08T18:08:42.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089431319999999995, 2024-05-08T18:08:42.965 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:42.965 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:42.965 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:42.965 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:42.966 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:42.966 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:42.966 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 208 2024-05-08T18:08:42.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.966 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:42.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:42.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:42.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:42.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:42.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:42.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588741+0000", 2024-05-08T18:08:42.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:08:42.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:42.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588752+0000", 2024-05-08T18:08:42.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0813e-05 2024-05-08T18:08:42.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:42.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588782+0000", 2024-05-08T18:08:42.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0020000000000001e-05 2024-05-08T18:08:42.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:42.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588803+0000", 2024-05-08T18:08:42.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1115999999999999e-05 2024-05-08T18:08:42.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:42.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588943+0000", 2024-05-08T18:08:42.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013971599999999999 2024-05-08T18:08:42.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:08:42.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588954+0000", 2024-05-08T18:08:42.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1365999999999999e-05 2024-05-08T18:08:42.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:42.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594340+0000", 2024-05-08T18:08:42.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053854910000000001 2024-05-08T18:08:42.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:42.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594670+0000", 2024-05-08T18:08:42.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000330055 2024-05-08T18:08:42.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:42.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.595179+0000", 2024-05-08T18:08:42.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050879199999999999 2024-05-08T18:08:42.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:42.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.596408+0000", 2024-05-08T18:08:42.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012295209999999999 2024-05-08T18:08:42.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:42.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597532+0000", 2024-05-08T18:08:42.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011233860000000001 2024-05-08T18:08:42.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:42.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597619+0000", 2024-05-08T18:08:42.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7775999999999994e-05 2024-05-08T18:08:42.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:42.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597682+0000", 2024-05-08T18:08:42.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2522999999999998e-05 2024-05-08T18:08:42.972 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.972 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:42.972 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.972 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:42.972 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:42.972 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.32221165, 2024-05-08T18:08:42.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031262669999999998, 2024-05-08T18:08:42.972 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:42.972 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:42.972 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:42.972 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:42.972 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:42.973 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:42.973 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 212 2024-05-08T18:08:42.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.973 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:42.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:42.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:42.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:42.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:42.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:42.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617370+0000", 2024-05-08T18:08:42.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:08:42.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:42.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617379+0000", 2024-05-08T18:08:42.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2359999999999993e-06 2024-05-08T18:08:42.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:42.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617405+0000", 2024-05-08T18:08:42.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5639999999999998e-05 2024-05-08T18:08:42.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:42.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617425+0000", 2024-05-08T18:08:42.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0457000000000001e-05 2024-05-08T18:08:42.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:42.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617573+0000", 2024-05-08T18:08:42.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014776200000000001 2024-05-08T18:08:42.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:42.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617786+0000", 2024-05-08T18:08:42.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212418 2024-05-08T18:08:42.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:42.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.618177+0000", 2024-05-08T18:08:42.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039161699999999997 2024-05-08T18:08:42.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:42.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.619563+0000", 2024-05-08T18:08:42.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013852999999999999 2024-05-08T18:08:42.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:42.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620334+0000", 2024-05-08T18:08:42.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00077182200000000002 2024-05-08T18:08:42.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:42.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620426+0000", 2024-05-08T18:08:42.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1526000000000004e-05 2024-05-08T18:08:42.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:42.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620494+0000", 2024-05-08T18:08:42.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8078999999999997e-05 2024-05-08T18:08:42.977 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.978 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:42.978 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.978 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:42.978 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:42.978 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.297893096999999, 2024-05-08T18:08:42.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035230880000000002, 2024-05-08T18:08:42.978 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:42.978 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:42.978 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:42.978 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:42.978 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:42.979 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:42.979 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 219 2024-05-08T18:08:42.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.979 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:42.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:42.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:42.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:42.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:42.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:42.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641689+0000", 2024-05-08T18:08:42.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:08:42.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:42.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641700+0000", 2024-05-08T18:08:42.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1507e-05 2024-05-08T18:08:42.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:42.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641732+0000", 2024-05-08T18:08:42.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1585999999999999e-05 2024-05-08T18:08:42.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:42.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641754+0000", 2024-05-08T18:08:42.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1480000000000001e-05 2024-05-08T18:08:42.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:42.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641942+0000", 2024-05-08T18:08:42.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018826300000000001 2024-05-08T18:08:42.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:42.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642165+0000", 2024-05-08T18:08:42.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022301100000000001 2024-05-08T18:08:42.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:42.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642587+0000", 2024-05-08T18:08:42.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042182400000000001 2024-05-08T18:08:42.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:42.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.643767+0000", 2024-05-08T18:08:42.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001180675 2024-05-08T18:08:42.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:42.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645010+0000", 2024-05-08T18:08:42.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012427110000000001 2024-05-08T18:08:42.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:42.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645101+0000", 2024-05-08T18:08:42.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0871999999999993e-05 2024-05-08T18:08:42.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:42.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645209+0000", 2024-05-08T18:08:42.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108496 2024-05-08T18:08:42.983 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.984 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:42.984 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.984 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:42.984 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:42.984 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.278096110000007, 2024-05-08T18:08:42.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035793639999999998, 2024-05-08T18:08:42.984 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:42.984 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:42.984 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:42.984 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:42.984 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:42.984 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:42.985 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 224 2024-05-08T18:08:42.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.985 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:42.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:42.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:42.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:42.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:42.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:42.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661485+0000", 2024-05-08T18:08:42.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9759999999999998e-06 2024-05-08T18:08:42.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:42.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661494+0000", 2024-05-08T18:08:42.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3469999999999999e-06 2024-05-08T18:08:42.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:42.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661517+0000", 2024-05-08T18:08:42.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.389e-05 2024-05-08T18:08:42.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:42.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661537+0000", 2024-05-08T18:08:42.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9803e-05 2024-05-08T18:08:42.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:42.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661696+0000", 2024-05-08T18:08:42.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015865899999999999 2024-05-08T18:08:42.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:42.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661910+0000", 2024-05-08T18:08:42.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021434199999999999 2024-05-08T18:08:42.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:42.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.662336+0000", 2024-05-08T18:08:42.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042575300000000001 2024-05-08T18:08:42.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:42.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.663720+0000", 2024-05-08T18:08:42.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013843799999999999 2024-05-08T18:08:42.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:42.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.664909+0000", 2024-05-08T18:08:42.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011889019999999999 2024-05-08T18:08:42.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:42.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665001+0000", 2024-05-08T18:08:42.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1649000000000003e-05 2024-05-08T18:08:42.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:42.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665063+0000", 2024-05-08T18:08:42.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1662999999999996e-05 2024-05-08T18:08:42.989 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.989 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:42.989 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.990 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:42.990 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:42.990 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.245502836, 2024-05-08T18:08:42.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031551930000000001, 2024-05-08T18:08:42.990 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:42.990 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:42.990 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:42.990 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:42.990 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:42.990 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:42.990 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 233 2024-05-08T18:08:42.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.990 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:42.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:42.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:42.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:42.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:42.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:42.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694079+0000", 2024-05-08T18:08:42.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:42.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:42.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694090+0000", 2024-05-08T18:08:42.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1182999999999999e-05 2024-05-08T18:08:42.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:42.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694119+0000", 2024-05-08T18:08:42.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9076000000000001e-05 2024-05-08T18:08:42.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:42.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694143+0000", 2024-05-08T18:08:42.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4363e-05 2024-05-08T18:08:42.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:42.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694291+0000", 2024-05-08T18:08:42.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147849 2024-05-08T18:08:42.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:42.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694534+0000", 2024-05-08T18:08:42.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000242382 2024-05-08T18:08:42.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:42.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694957+0000", 2024-05-08T18:08:42.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042316700000000001 2024-05-08T18:08:42.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:42.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.696306+0000", 2024-05-08T18:08:42.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013489940000000001 2024-05-08T18:08:42.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:42.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697071+0000", 2024-05-08T18:08:42.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076482999999999998 2024-05-08T18:08:42.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:42.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697167+0000", 2024-05-08T18:08:42.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6773000000000003e-05 2024-05-08T18:08:42.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:42.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697232+0000", 2024-05-08T18:08:42.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4386000000000003e-05 2024-05-08T18:08:42.995 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.995 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:42.995 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:42.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.995 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:328 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:42.995 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:42.996 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.213784249, 2024-05-08T18:08:42.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029659439999999999, 2024-05-08T18:08:42.996 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:42.996 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:42.996 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:42.996 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:42.996 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:42.996 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:42.996 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 328 2024-05-08T18:08:42.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.996 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:42.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:42.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:42.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:42.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:42.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:42.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:42.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725796+0000", 2024-05-08T18:08:42.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-06 2024-05-08T18:08:42.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:42.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725802+0000", 2024-05-08T18:08:42.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7219999999999996e-06 2024-05-08T18:08:42.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:42.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725816+0000", 2024-05-08T18:08:42.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3886999999999999e-05 2024-05-08T18:08:42.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:42.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:42.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725824+0000", 2024-05-08T18:08:43.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5920000000000003e-06 2024-05-08T18:08:43.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725885+0000", 2024-05-08T18:08:43.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1526999999999996e-05 2024-05-08T18:08:43.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725972+0000", 2024-05-08T18:08:43.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7099000000000001e-05 2024-05-08T18:08:43.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:43.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726093+0000", 2024-05-08T18:08:43.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120383 2024-05-08T18:08:43.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726717+0000", 2024-05-08T18:08:43.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062435099999999999 2024-05-08T18:08:43.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728693+0000", 2024-05-08T18:08:43.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019758309999999999 2024-05-08T18:08:43.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728731+0000", 2024-05-08T18:08:43.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8591999999999999e-05 2024-05-08T18:08:43.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728761+0000", 2024-05-08T18:08:43.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9770000000000001e-05 2024-05-08T18:08:43.002 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.002 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.002 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.002 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:460 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.003 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:43.003 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.159967025, 2024-05-08T18:08:43.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040209540000000002, 2024-05-08T18:08:43.003 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.003 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.003 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.003 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.003 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.003 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.003 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 460 2024-05-08T18:08:43.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.003 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779613+0000", 2024-05-08T18:08:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:08:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779619+0000", 2024-05-08T18:08:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3630000000000002e-06 2024-05-08T18:08:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779631+0000", 2024-05-08T18:08:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2211e-05 2024-05-08T18:08:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779637+0000", 2024-05-08T18:08:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0430000000000004e-06 2024-05-08T18:08:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779702+0000", 2024-05-08T18:08:43.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4481999999999997e-05 2024-05-08T18:08:43.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779848+0000", 2024-05-08T18:08:43.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014608500000000001 2024-05-08T18:08:43.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:43.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780056+0000", 2024-05-08T18:08:43.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020889699999999999 2024-05-08T18:08:43.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780700+0000", 2024-05-08T18:08:43.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064379300000000003 2024-05-08T18:08:43.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783576+0000", 2024-05-08T18:08:43.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028754919999999999 2024-05-08T18:08:43.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783608+0000", 2024-05-08T18:08:43.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2223e-05 2024-05-08T18:08:43.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:08:43.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5296e-05 2024-05-08T18:08:43.008 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.008 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.008 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.008 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:466 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.008 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:43.008 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.155428787000005, 2024-05-08T18:08:43.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028979520000000001, 2024-05-08T18:08:43.008 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.008 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.008 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.009 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.009 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.009 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.009 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 466 2024-05-08T18:08:43.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.009 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:43.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:43.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:43.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.61e-07 2024-05-08T18:08:43.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784155+0000", 2024-05-08T18:08:43.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9299999999999996e-06 2024-05-08T18:08:43.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784165+0000", 2024-05-08T18:08:43.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5680000000000005e-06 2024-05-08T18:08:43.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784170+0000", 2024-05-08T18:08:43.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1379999999999998e-06 2024-05-08T18:08:43.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784219+0000", 2024-05-08T18:08:43.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9231999999999999e-05 2024-05-08T18:08:43.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784310+0000", 2024-05-08T18:08:43.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0797000000000005e-05 2024-05-08T18:08:43.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:43.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784490+0000", 2024-05-08T18:08:43.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179705 2024-05-08T18:08:43.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.785090+0000", 2024-05-08T18:08:43.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060073899999999998 2024-05-08T18:08:43.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.786973+0000", 2024-05-08T18:08:43.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018824460000000001 2024-05-08T18:08:43.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787007+0000", 2024-05-08T18:08:43.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3779999999999998e-05 2024-05-08T18:08:43.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787049+0000", 2024-05-08T18:08:43.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1856e-05 2024-05-08T18:08:43.013 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.013 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.013 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.014 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:477 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.014 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:43.014 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.148286792999997, 2024-05-08T18:08:43.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046076989999999998, 2024-05-08T18:08:43.014 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.014 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.014 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.014 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.014 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.014 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.014 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 477 2024-05-08T18:08:43.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.014 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:43.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:43.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791294+0000", 2024-05-08T18:08:43.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-06 2024-05-08T18:08:43.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791300+0000", 2024-05-08T18:08:43.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5320000000000003e-06 2024-05-08T18:08:43.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791313+0000", 2024-05-08T18:08:43.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2576e-05 2024-05-08T18:08:43.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791319+0000", 2024-05-08T18:08:43.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1720000000000004e-06 2024-05-08T18:08:43.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791379+0000", 2024-05-08T18:08:43.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0343000000000001e-05 2024-05-08T18:08:43.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791477+0000", 2024-05-08T18:08:43.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7662000000000001e-05 2024-05-08T18:08:43.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:43.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791678+0000", 2024-05-08T18:08:43.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000200788 2024-05-08T18:08:43.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.792263+0000", 2024-05-08T18:08:43.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058525700000000005 2024-05-08T18:08:43.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795842+0000", 2024-05-08T18:08:43.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035787079999999999 2024-05-08T18:08:43.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795874+0000", 2024-05-08T18:08:43.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2205000000000001e-05 2024-05-08T18:08:43.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795900+0000", 2024-05-08T18:08:43.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6222000000000001e-05 2024-05-08T18:08:43.019 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.019 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.019 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.019 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:642 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.019 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:43.019 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.009527090000006, 2024-05-08T18:08:43.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030444059999999999, 2024-05-08T18:08:43.019 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.020 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.020 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.020 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.020 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.020 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.020 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 642 2024-05-08T18:08:43.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.020 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:43.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:43.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930055+0000", 2024-05-08T18:08:43.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7999999999999999e-06 2024-05-08T18:08:43.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930065+0000", 2024-05-08T18:08:43.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0176999999999999e-05 2024-05-08T18:08:43.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930092+0000", 2024-05-08T18:08:43.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6460000000000001e-05 2024-05-08T18:08:43.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930112+0000", 2024-05-08T18:08:43.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0043000000000001e-05 2024-05-08T18:08:43.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930219+0000", 2024-05-08T18:08:43.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010698500000000001 2024-05-08T18:08:43.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930345+0000", 2024-05-08T18:08:43.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012620400000000001 2024-05-08T18:08:43.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:43.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930579+0000", 2024-05-08T18:08:43.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234145 2024-05-08T18:08:43.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.931471+0000", 2024-05-08T18:08:43.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00089161500000000001 2024-05-08T18:08:43.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.932978+0000", 2024-05-08T18:08:43.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001507296 2024-05-08T18:08:43.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933044+0000", 2024-05-08T18:08:43.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6402000000000006e-05 2024-05-08T18:08:43.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933097+0000", 2024-05-08T18:08:43.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2278999999999999e-05 2024-05-08T18:08:43.024 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.024 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.025 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.025 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:681 6.e e32/26 6:748722ff:gc::gc.6:head v 32'7, mlcod=32'5)", 2024-05-08T18:08:43.025 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:43.025 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 75.978731513, 2024-05-08T18:08:43.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003318185, 2024-05-08T18:08:43.025 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.025 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.025 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.025 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:43.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:43.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960849+0000", 2024-05-08T18:08:43.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.423e-06 2024-05-08T18:08:43.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960859+0000", 2024-05-08T18:08:43.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3170000000000008e-06 2024-05-08T18:08:43.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960874+0000", 2024-05-08T18:08:43.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5125e-05 2024-05-08T18:08:43.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960884+0000", 2024-05-08T18:08:43.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8120000000000002e-06 2024-05-08T18:08:43.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960972+0000", 2024-05-08T18:08:43.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8540000000000003e-05 2024-05-08T18:08:43.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960996+0000", 2024-05-08T18:08:43.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3479999999999999e-05 2024-05-08T18:08:43.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964110+0000", 2024-05-08T18:08:43.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031142729999999999 2024-05-08T18:08:43.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964166+0000", 2024-05-08T18:08:43.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6215000000000003e-05 2024-05-08T18:08:43.029 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.029 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.029 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.029 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.029 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:43.029 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 75.887695418000007, 2024-05-08T18:08:43.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030648379999999999, 2024-05-08T18:08:43.029 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.029 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.029 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.030 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.030 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.030 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.030 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 733 2024-05-08T18:08:43.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.030 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:43.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:43.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051887+0000", 2024-05-08T18:08:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.74e-06 2024-05-08T18:08:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051900+0000", 2024-05-08T18:08:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3113e-05 2024-05-08T18:08:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051931+0000", 2024-05-08T18:08:43.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1665999999999998e-05 2024-05-08T18:08:43.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051946+0000", 2024-05-08T18:08:43.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4780000000000001e-05 2024-05-08T18:08:43.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052078+0000", 2024-05-08T18:08:43.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013133200000000001 2024-05-08T18:08:43.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052338+0000", 2024-05-08T18:08:43.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026056899999999999 2024-05-08T18:08:43.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:43.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052652+0000", 2024-05-08T18:08:43.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031396700000000001 2024-05-08T18:08:43.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.053668+0000", 2024-05-08T18:08:43.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00101574 2024-05-08T18:08:43.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054800+0000", 2024-05-08T18:08:43.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011319819999999999 2024-05-08T18:08:43.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054884+0000", 2024-05-08T18:08:43.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4005999999999995e-05 2024-05-08T18:08:43.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054949+0000", 2024-05-08T18:08:43.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4943000000000005e-05 2024-05-08T18:08:43.034 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.034 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.034 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.035 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.035 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:43.035 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 75.883840782999997, 2024-05-08T18:08:43.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029745919999999999, 2024-05-08T18:08:43.037 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.038 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.038 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.038 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.038 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.038 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.038 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 735 2024-05-08T18:08:43.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.038 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:43.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:43.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055741+0000", 2024-05-08T18:08:43.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.984e-06 2024-05-08T18:08:43.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055766+0000", 2024-05-08T18:08:43.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5253e-05 2024-05-08T18:08:43.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055785+0000", 2024-05-08T18:08:43.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9559999999999999e-05 2024-05-08T18:08:43.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055798+0000", 2024-05-08T18:08:43.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-05 2024-05-08T18:08:43.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055932+0000", 2024-05-08T18:08:43.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134609 2024-05-08T18:08:43.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056184+0000", 2024-05-08T18:08:43.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025167800000000003 2024-05-08T18:08:43.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:43.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056680+0000", 2024-05-08T18:08:43.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049576299999999998 2024-05-08T18:08:43.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058060+0000", 2024-05-08T18:08:43.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013801 2024-05-08T18:08:43.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058447+0000", 2024-05-08T18:08:43.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038695299999999999 2024-05-08T18:08:43.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058601+0000", 2024-05-08T18:08:43.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015396299999999999 2024-05-08T18:08:43.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058713+0000", 2024-05-08T18:08:43.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112389 2024-05-08T18:08:43.043 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.043 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.043 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.043 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.043 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:43.043 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 75.776825432999999, 2024-05-08T18:08:43.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029913650000000002, 2024-05-08T18:08:43.043 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.043 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.043 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.043 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.043 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.043 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.044 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 781 2024-05-08T18:08:43.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.044 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:43.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:43.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162757+0000", 2024-05-08T18:08:43.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:08:43.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162770+0000", 2024-05-08T18:08:43.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3406e-05 2024-05-08T18:08:43.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162799+0000", 2024-05-08T18:08:43.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-05 2024-05-08T18:08:43.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162813+0000", 2024-05-08T18:08:43.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:08:43.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162942+0000", 2024-05-08T18:08:43.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012902200000000001 2024-05-08T18:08:43.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163159+0000", 2024-05-08T18:08:43.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021738500000000001 2024-05-08T18:08:43.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:43.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163476+0000", 2024-05-08T18:08:43.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031666499999999999 2024-05-08T18:08:43.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.164533+0000", 2024-05-08T18:08:43.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010574219999999999 2024-05-08T18:08:43.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165587+0000", 2024-05-08T18:08:43.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001053476 2024-05-08T18:08:43.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165674+0000", 2024-05-08T18:08:43.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6725999999999996e-05 2024-05-08T18:08:43.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165745+0000", 2024-05-08T18:08:43.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1779000000000005e-05 2024-05-08T18:08:43.048 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.048 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.048 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.048 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.049 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:43.049 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 75.394235585000004, 2024-05-08T18:08:43.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029834750000000002, 2024-05-08T18:08:43.049 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.049 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.049 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.049 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.049 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.049 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.049 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 946 2024-05-08T18:08:43.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.049 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:43.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:43.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545346+0000", 2024-05-08T18:08:43.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6570000000000001e-06 2024-05-08T18:08:43.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545357+0000", 2024-05-08T18:08:43.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0740000000000001e-05 2024-05-08T18:08:43.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545384+0000", 2024-05-08T18:08:43.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6780000000000001e-05 2024-05-08T18:08:43.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545398+0000", 2024-05-08T18:08:43.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3936e-05 2024-05-08T18:08:43.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545515+0000", 2024-05-08T18:08:43.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117413 2024-05-08T18:08:43.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545751+0000", 2024-05-08T18:08:43.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023559500000000001 2024-05-08T18:08:43.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:43.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.546075+0000", 2024-05-08T18:08:43.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000324357 2024-05-08T18:08:43.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.547104+0000", 2024-05-08T18:08:43.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010285959999999999 2024-05-08T18:08:43.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548141+0000", 2024-05-08T18:08:43.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001036922 2024-05-08T18:08:43.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548223+0000", 2024-05-08T18:08:43.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2260000000000002e-05 2024-05-08T18:08:43.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548327+0000", 2024-05-08T18:08:43.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104219 2024-05-08T18:08:43.054 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.054 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.054 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.054 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.054 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.054 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:43.054 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:08:43.056 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:43.056+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:43.157 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:43.156+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:43.224 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:43.224 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:43.224 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:43.224 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:43.243 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:08:43.287 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:43.288+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:43.359 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:43.360+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:43.455 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:43.455 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:43.455 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:43.460 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:43.461+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:43.474 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:08:43.561 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:43.561+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:43.662 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:43.661+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:43.690 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:43.690 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.11630495, 2024-05-08T18:08:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002466088, 2024-05-08T18:08:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 52 2024-05-08T18:08:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577062+0000", 2024-05-08T18:08:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.994e-06 2024-05-08T18:08:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577075+0000", 2024-05-08T18:08:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2480000000000001e-05 2024-05-08T18:08:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577108+0000", 2024-05-08T18:08:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3096000000000003e-05 2024-05-08T18:08:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577131+0000", 2024-05-08T18:08:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2993000000000002e-05 2024-05-08T18:08:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577260+0000", 2024-05-08T18:08:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012912899999999999 2024-05-08T18:08:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577453+0000", 2024-05-08T18:08:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000193668 2024-05-08T18:08:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577634+0000", 2024-05-08T18:08:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180576 2024-05-08T18:08:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579082+0000", 2024-05-08T18:08:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001448083 2024-05-08T18:08:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579290+0000", 2024-05-08T18:08:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000208333 2024-05-08T18:08:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579403+0000", 2024-05-08T18:08:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011296800000000001 2024-05-08T18:08:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579525+0000", 2024-05-08T18:08:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121768 2024-05-08T18:08:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.104445185000003, 2024-05-08T18:08:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038858310000000002, 2024-05-08T18:08:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588920+0000", 2024-05-08T18:08:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.23e-07 2024-05-08T18:08:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588929+0000", 2024-05-08T18:08:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3659999999999998e-06 2024-05-08T18:08:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588948+0000", 2024-05-08T18:08:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8768000000000001e-05 2024-05-08T18:08:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588962+0000", 2024-05-08T18:08:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4e-05 2024-05-08T18:08:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589110+0000", 2024-05-08T18:08:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148047 2024-05-08T18:08:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589173+0000", 2024-05-08T18:08:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2766000000000002e-05 2024-05-08T18:08:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592728+0000", 2024-05-08T18:08:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035553300000000002 2024-05-08T18:08:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592805+0000", 2024-05-08T18:08:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6730999999999994e-05 2024-05-08T18:08:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.988376286999994, 2024-05-08T18:08:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034354310000000001, 2024-05-08T18:08:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 236 2024-05-08T18:08:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704991+0000", 2024-05-08T18:08:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1240000000000001e-06 2024-05-08T18:08:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705009+0000", 2024-05-08T18:08:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7819e-05 2024-05-08T18:08:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705048+0000", 2024-05-08T18:08:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9632999999999998e-05 2024-05-08T18:08:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705073+0000", 2024-05-08T18:08:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4686999999999999e-05 2024-05-08T18:08:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705241+0000", 2024-05-08T18:08:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759899999999999 2024-05-08T18:08:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705511+0000", 2024-05-08T18:08:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027018799999999998 2024-05-08T18:08:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705965+0000", 2024-05-08T18:08:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045433000000000002 2024-05-08T18:08:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.707487+0000", 2024-05-08T18:08:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015214810000000001 2024-05-08T18:08:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708125+0000", 2024-05-08T18:08:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063870300000000001 2024-05-08T18:08:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708298+0000", 2024-05-08T18:08:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172592 2024-05-08T18:08:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708423+0000", 2024-05-08T18:08:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125275 2024-05-08T18:08:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:308 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.971538385000002, 2024-05-08T18:08:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038707400000000001, 2024-05-08T18:08:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 308 2024-05-08T18:08:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721827+0000", 2024-05-08T18:08:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1519999999999999e-06 2024-05-08T18:08:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721840+0000", 2024-05-08T18:08:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.362e-05 2024-05-08T18:08:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721857+0000", 2024-05-08T18:08:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6901e-05 2024-05-08T18:08:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721867+0000", 2024-05-08T18:08:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0034000000000001e-05 2024-05-08T18:08:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721922+0000", 2024-05-08T18:08:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4450999999999998e-05 2024-05-08T18:08:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721981+0000", 2024-05-08T18:08:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9267e-05 2024-05-08T18:08:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722103+0000", 2024-05-08T18:08:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121502 2024-05-08T18:08:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722757+0000", 2024-05-08T18:08:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065419700000000003 2024-05-08T18:08:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725619+0000", 2024-05-08T18:08:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002862107 2024-05-08T18:08:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725654+0000", 2024-05-08T18:08:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:08:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725696+0000", 2024-05-08T18:08:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:08:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:604 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.794255679000003, 2024-05-08T18:08:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002741884, 2024-05-08T18:08:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 604 2024-05-08T18:08:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899111+0000", 2024-05-08T18:08:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0910000000000001e-06 2024-05-08T18:08:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899126+0000", 2024-05-08T18:08:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:08:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899159+0000", 2024-05-08T18:08:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3241999999999998e-05 2024-05-08T18:08:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899174+0000", 2024-05-08T18:08:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5235000000000001e-05 2024-05-08T18:08:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899316+0000", 2024-05-08T18:08:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014175599999999999 2024-05-08T18:08:43.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899525+0000", 2024-05-08T18:08:43.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020915300000000001 2024-05-08T18:08:43.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:43.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899872+0000", 2024-05-08T18:08:43.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034668299999999997 2024-05-08T18:08:43.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901064+0000", 2024-05-08T18:08:43.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001191473 2024-05-08T18:08:43.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901664+0000", 2024-05-08T18:08:43.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060054599999999998 2024-05-08T18:08:43.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901779+0000", 2024-05-08T18:08:43.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011452500000000001 2024-05-08T18:08:43.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901850+0000", 2024-05-08T18:08:43.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1580000000000002e-05 2024-05-08T18:08:43.725 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.725 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.725 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.726 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:612 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.726 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:43.726 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.788747115999996, 2024-05-08T18:08:43.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025904750000000001, 2024-05-08T18:08:43.726 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.726 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.726 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.726 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.726 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.726 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.726 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 612 2024-05-08T18:08:43.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.727 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:43.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:43.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904619+0000", 2024-05-08T18:08:43.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8479999999999999e-06 2024-05-08T18:08:43.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904628+0000", 2024-05-08T18:08:43.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8829999999999995e-06 2024-05-08T18:08:43.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904650+0000", 2024-05-08T18:08:43.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2467999999999999e-05 2024-05-08T18:08:43.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904669+0000", 2024-05-08T18:08:43.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9303000000000001e-05 2024-05-08T18:08:43.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904766+0000", 2024-05-08T18:08:43.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6917999999999996e-05 2024-05-08T18:08:43.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904935+0000", 2024-05-08T18:08:43.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000168441 2024-05-08T18:08:43.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:43.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.905288+0000", 2024-05-08T18:08:43.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035312199999999998 2024-05-08T18:08:43.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.906520+0000", 2024-05-08T18:08:43.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001232005 2024-05-08T18:08:43.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907086+0000", 2024-05-08T18:08:43.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056658900000000005 2024-05-08T18:08:43.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907154+0000", 2024-05-08T18:08:43.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7197000000000001e-05 2024-05-08T18:08:43.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907207+0000", 2024-05-08T18:08:43.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3701e-05 2024-05-08T18:08:43.732 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.732 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.732 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.732 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.732 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:43.732 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.620729522999994, 2024-05-08T18:08:43.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032464490000000002, 2024-05-08T18:08:43.732 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.732 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.733 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.733 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.733 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.733 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.733 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 742 2024-05-08T18:08:43.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.733 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:43.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:43.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072637+0000", 2024-05-08T18:08:43.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9059999999999998e-06 2024-05-08T18:08:43.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072651+0000", 2024-05-08T18:08:43.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3477e-05 2024-05-08T18:08:43.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072683+0000", 2024-05-08T18:08:43.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2116000000000002e-05 2024-05-08T18:08:43.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072698+0000", 2024-05-08T18:08:43.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5454000000000001e-05 2024-05-08T18:08:43.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072845+0000", 2024-05-08T18:08:43.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146532 2024-05-08T18:08:43.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073241+0000", 2024-05-08T18:08:43.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039580699999999997 2024-05-08T18:08:43.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:43.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073812+0000", 2024-05-08T18:08:43.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057164900000000003 2024-05-08T18:08:43.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075063+0000", 2024-05-08T18:08:43.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001250131 2024-05-08T18:08:43.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075723+0000", 2024-05-08T18:08:43.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00066039199999999999 2024-05-08T18:08:43.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075808+0000", 2024-05-08T18:08:43.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5458999999999996e-05 2024-05-08T18:08:43.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075881+0000", 2024-05-08T18:08:43.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2526000000000003e-05 2024-05-08T18:08:43.738 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.738 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.738 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.739 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.739 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:43.739 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.578321157999994, 2024-05-08T18:08:43.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029270590000000001, 2024-05-08T18:08:43.739 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.739 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.739 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.739 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.739 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.739 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.739 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 760 2024-05-08T18:08:43.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.740 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:43.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:43.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115045+0000", 2024-05-08T18:08:43.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0729999999999999e-06 2024-05-08T18:08:43.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115057+0000", 2024-05-08T18:08:43.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1617000000000001e-05 2024-05-08T18:08:43.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115088+0000", 2024-05-08T18:08:43.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1155999999999998e-05 2024-05-08T18:08:43.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115103+0000", 2024-05-08T18:08:43.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5067e-05 2024-05-08T18:08:43.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115289+0000", 2024-05-08T18:08:43.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186582 2024-05-08T18:08:43.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115506+0000", 2024-05-08T18:08:43.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021690500000000001 2024-05-08T18:08:43.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:43.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115832+0000", 2024-05-08T18:08:43.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032556799999999998 2024-05-08T18:08:43.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.116892+0000", 2024-05-08T18:08:43.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010597989999999999 2024-05-08T18:08:43.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117807+0000", 2024-05-08T18:08:43.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091502599999999999 2024-05-08T18:08:43.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117895+0000", 2024-05-08T18:08:43.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7977000000000001e-05 2024-05-08T18:08:43.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117970+0000", 2024-05-08T18:08:43.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5289000000000004e-05 2024-05-08T18:08:43.745 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.745 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.745 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.745 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.745 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:43.745 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.447323671999996, 2024-05-08T18:08:43.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028290730000000001, 2024-05-08T18:08:43.745 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.745 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.746 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.746 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.746 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.746 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.746 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 817 2024-05-08T18:08:43.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.746 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:43.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:43.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246043+0000", 2024-05-08T18:08:43.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.807e-06 2024-05-08T18:08:43.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246056+0000", 2024-05-08T18:08:43.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2383e-05 2024-05-08T18:08:43.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246087+0000", 2024-05-08T18:08:43.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1937000000000003e-05 2024-05-08T18:08:43.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246104+0000", 2024-05-08T18:08:43.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6643e-05 2024-05-08T18:08:43.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246225+0000", 2024-05-08T18:08:43.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012061900000000001 2024-05-08T18:08:43.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246510+0000", 2024-05-08T18:08:43.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028507100000000002 2024-05-08T18:08:43.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:43.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246881+0000", 2024-05-08T18:08:43.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037163799999999998 2024-05-08T18:08:43.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248078+0000", 2024-05-08T18:08:43.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011968969999999999 2024-05-08T18:08:43.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248715+0000", 2024-05-08T18:08:43.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063698599999999998 2024-05-08T18:08:43.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248801+0000", 2024-05-08T18:08:43.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5772999999999993e-05 2024-05-08T18:08:43.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248869+0000", 2024-05-08T18:08:43.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8318999999999994e-05 2024-05-08T18:08:43.751 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.751 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.751 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.751 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.751 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:43.752 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.393580188000001, 2024-05-08T18:08:43.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003281693, 2024-05-08T18:08:43.752 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.752 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.752 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.752 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.752 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.752 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.752 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 841 2024-05-08T18:08:43.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.752 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:43.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:43.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299786+0000", 2024-05-08T18:08:43.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4770000000000002e-06 2024-05-08T18:08:43.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299798+0000", 2024-05-08T18:08:43.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1493e-05 2024-05-08T18:08:43.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299827+0000", 2024-05-08T18:08:43.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9363e-05 2024-05-08T18:08:43.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299842+0000", 2024-05-08T18:08:43.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.448e-05 2024-05-08T18:08:43.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300001+0000", 2024-05-08T18:08:43.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015909600000000001 2024-05-08T18:08:43.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300384+0000", 2024-05-08T18:08:43.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038306000000000001 2024-05-08T18:08:43.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:43.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300929+0000", 2024-05-08T18:08:43.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054551299999999997 2024-05-08T18:08:43.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302151+0000", 2024-05-08T18:08:43.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012218540000000001 2024-05-08T18:08:43.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302918+0000", 2024-05-08T18:08:43.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076719099999999997 2024-05-08T18:08:43.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303000+0000", 2024-05-08T18:08:43.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1662999999999994e-05 2024-05-08T18:08:43.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303065+0000", 2024-05-08T18:08:43.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5502999999999999e-05 2024-05-08T18:08:43.757 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.757 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.757 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.758 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.758 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:43.758 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.389384731999996, 2024-05-08T18:08:43.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026179150000000002, 2024-05-08T18:08:43.758 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.758 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.758 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.758 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.758 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.758 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.758 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 843 2024-05-08T18:08:43.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.759 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:43.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:43.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303981+0000", 2024-05-08T18:08:43.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9740000000000001e-06 2024-05-08T18:08:43.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303990+0000", 2024-05-08T18:08:43.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9889999999999998e-06 2024-05-08T18:08:43.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304012+0000", 2024-05-08T18:08:43.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1537000000000001e-05 2024-05-08T18:08:43.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304023+0000", 2024-05-08T18:08:43.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:08:43.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304101+0000", 2024-05-08T18:08:43.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7732999999999996e-05 2024-05-08T18:08:43.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304210+0000", 2024-05-08T18:08:43.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010985299999999999 2024-05-08T18:08:43.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:43.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304490+0000", 2024-05-08T18:08:43.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000279564 2024-05-08T18:08:43.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.305542+0000", 2024-05-08T18:08:43.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051976 2024-05-08T18:08:43.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306451+0000", 2024-05-08T18:08:43.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00090901999999999997 2024-05-08T18:08:43.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306533+0000", 2024-05-08T18:08:43.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1790000000000001e-05 2024-05-08T18:08:43.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306597+0000", 2024-05-08T18:08:43.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4332999999999995e-05 2024-05-08T18:08:43.763 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.764 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.764 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.764 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.764 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:43.764 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.379688521999995, 2024-05-08T18:08:43.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00275537, 2024-05-08T18:08:43.764 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.765 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.765 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.765 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.765 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.765 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.765 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 847 2024-05-08T18:08:43.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.765 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:43.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:43.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313678+0000", 2024-05-08T18:08:43.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:08:43.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313689+0000", 2024-05-08T18:08:43.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1273e-05 2024-05-08T18:08:43.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313719+0000", 2024-05-08T18:08:43.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9726e-05 2024-05-08T18:08:43.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313733+0000", 2024-05-08T18:08:43.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4487e-05 2024-05-08T18:08:43.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313858+0000", 2024-05-08T18:08:43.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125172 2024-05-08T18:08:43.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314072+0000", 2024-05-08T18:08:43.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021314200000000001 2024-05-08T18:08:43.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:43.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314378+0000", 2024-05-08T18:08:43.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030653100000000002 2024-05-08T18:08:43.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.315524+0000", 2024-05-08T18:08:43.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011458950000000001 2024-05-08T18:08:43.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316213+0000", 2024-05-08T18:08:43.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068942199999999997 2024-05-08T18:08:43.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316314+0000", 2024-05-08T18:08:43.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100723 2024-05-08T18:08:43.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316431+0000", 2024-05-08T18:08:43.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116759 2024-05-08T18:08:43.770 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.376036584999994, 2024-05-08T18:08:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025522510000000002, 2024-05-08T18:08:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.771 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.772 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.772 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 849 2024-05-08T18:08:43.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.772 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:43.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:43.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317329+0000", 2024-05-08T18:08:43.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9530000000000002e-06 2024-05-08T18:08:43.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317340+0000", 2024-05-08T18:08:43.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.08e-05 2024-05-08T18:08:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317364+0000", 2024-05-08T18:08:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4142999999999999e-05 2024-05-08T18:08:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317377+0000", 2024-05-08T18:08:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2764e-05 2024-05-08T18:08:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317471+0000", 2024-05-08T18:08:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4289000000000005e-05 2024-05-08T18:08:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317600+0000", 2024-05-08T18:08:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012910499999999999 2024-05-08T18:08:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317868+0000", 2024-05-08T18:08:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000267562 2024-05-08T18:08:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319081+0000", 2024-05-08T18:08:43.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001213387 2024-05-08T18:08:43.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319723+0000", 2024-05-08T18:08:43.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064134200000000004 2024-05-08T18:08:43.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319808+0000", 2024-05-08T18:08:43.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:43.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319880+0000", 2024-05-08T18:08:43.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1426000000000004e-05 2024-05-08T18:08:43.777 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.777 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.777 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.777 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.778 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:43.778 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.332604103999998, 2024-05-08T18:08:43.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002815157, 2024-05-08T18:08:43.778 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.778 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.778 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.778 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.778 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.778 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.778 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 868 2024-05-08T18:08:43.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.779 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:43.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:43.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360762+0000", 2024-05-08T18:08:43.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:08:43.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360775+0000", 2024-05-08T18:08:43.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2840000000000001e-05 2024-05-08T18:08:43.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360805+0000", 2024-05-08T18:08:43.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9686e-05 2024-05-08T18:08:43.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360819+0000", 2024-05-08T18:08:43.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.434e-05 2024-05-08T18:08:43.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360948+0000", 2024-05-08T18:08:43.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000129033 2024-05-08T18:08:43.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361166+0000", 2024-05-08T18:08:43.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021747800000000001 2024-05-08T18:08:43.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:43.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361481+0000", 2024-05-08T18:08:43.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031515800000000001 2024-05-08T18:08:43.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.362546+0000", 2024-05-08T18:08:43.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010653889999999999 2024-05-08T18:08:43.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363365+0000", 2024-05-08T18:08:43.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081906100000000005 2024-05-08T18:08:43.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363450+0000", 2024-05-08T18:08:43.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5202000000000002e-05 2024-05-08T18:08:43.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363575+0000", 2024-05-08T18:08:43.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012460999999999999 2024-05-08T18:08:43.784 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.784 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.784 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.784 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.784 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:43.784 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.328911930999993, 2024-05-08T18:08:43.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024676260000000001, 2024-05-08T18:08:43.784 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.785 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.785 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.785 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.785 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.785 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.785 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 870 2024-05-08T18:08:43.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.785 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:43.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:43.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364454+0000", 2024-05-08T18:08:43.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7770000000000001e-06 2024-05-08T18:08:43.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364463+0000", 2024-05-08T18:08:43.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4800000000000007e-06 2024-05-08T18:08:43.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364487+0000", 2024-05-08T18:08:43.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3589999999999999e-05 2024-05-08T18:08:43.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364499+0000", 2024-05-08T18:08:43.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.241e-05 2024-05-08T18:08:43.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364607+0000", 2024-05-08T18:08:43.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010760900000000001 2024-05-08T18:08:43.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364750+0000", 2024-05-08T18:08:43.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014265600000000001 2024-05-08T18:08:43.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:43.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.365021+0000", 2024-05-08T18:08:43.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027115100000000002 2024-05-08T18:08:43.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366163+0000", 2024-05-08T18:08:43.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011419189999999999 2024-05-08T18:08:43.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366727+0000", 2024-05-08T18:08:43.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056400199999999997 2024-05-08T18:08:43.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366810+0000", 2024-05-08T18:08:43.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3133000000000005e-05 2024-05-08T18:08:43.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366920+0000", 2024-05-08T18:08:43.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109899 2024-05-08T18:08:43.790 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.790 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.790 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.791 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.791 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:43.791 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.238997753000007, 2024-05-08T18:08:43.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027893459999999998, 2024-05-08T18:08:43.791 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.791 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.791 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.791 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.791 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.791 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.792 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 907 2024-05-08T18:08:43.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.792 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:43.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:43.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454369+0000", 2024-05-08T18:08:43.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5730000000000002e-06 2024-05-08T18:08:43.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454381+0000", 2024-05-08T18:08:43.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.208e-05 2024-05-08T18:08:43.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454413+0000", 2024-05-08T18:08:43.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2493000000000002e-05 2024-05-08T18:08:43.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454432+0000", 2024-05-08T18:08:43.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8862999999999999e-05 2024-05-08T18:08:43.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454577+0000", 2024-05-08T18:08:43.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014477899999999999 2024-05-08T18:08:43.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454800+0000", 2024-05-08T18:08:43.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223425 2024-05-08T18:08:43.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:43.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.455168+0000", 2024-05-08T18:08:43.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036712799999999999 2024-05-08T18:08:43.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456282+0000", 2024-05-08T18:08:43.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011141580000000001 2024-05-08T18:08:43.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456953+0000", 2024-05-08T18:08:43.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000670956 2024-05-08T18:08:43.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457038+0000", 2024-05-08T18:08:43.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4828999999999997e-05 2024-05-08T18:08:43.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457156+0000", 2024-05-08T18:08:43.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118062 2024-05-08T18:08:43.797 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.797 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.797 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.797 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.797 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:43.797 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.235305389999994, 2024-05-08T18:08:43.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026891609999999998, 2024-05-08T18:08:43.797 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.797 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.798 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.798 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.798 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.798 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.798 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 909 2024-05-08T18:08:43.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.798 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:43.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:43.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458060+0000", 2024-05-08T18:08:43.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:43.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458069+0000", 2024-05-08T18:08:43.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6440000000000006e-06 2024-05-08T18:08:43.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458090+0000", 2024-05-08T18:08:43.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1089000000000001e-05 2024-05-08T18:08:43.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458102+0000", 2024-05-08T18:08:43.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2306999999999999e-05 2024-05-08T18:08:43.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458191+0000", 2024-05-08T18:08:43.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8213000000000004e-05 2024-05-08T18:08:43.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458313+0000", 2024-05-08T18:08:43.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012231500000000001 2024-05-08T18:08:43.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:43.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458581+0000", 2024-05-08T18:08:43.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026762500000000001 2024-05-08T18:08:43.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.459773+0000", 2024-05-08T18:08:43.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001192991 2024-05-08T18:08:43.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460590+0000", 2024-05-08T18:08:43.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081618100000000002 2024-05-08T18:08:43.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460681+0000", 2024-05-08T18:08:43.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0946000000000006e-05 2024-05-08T18:08:43.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460748+0000", 2024-05-08T18:08:43.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7139999999999998e-05 2024-05-08T18:08:43.803 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.803 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.803 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.803 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.803 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:43.803 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.141662371999999, 2024-05-08T18:08:43.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030359179999999999, 2024-05-08T18:08:43.804 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.804 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.804 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.804 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.804 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.804 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.804 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 949 2024-05-08T18:08:43.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.804 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:43.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:43.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551705+0000", 2024-05-08T18:08:43.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2770000000000001e-06 2024-05-08T18:08:43.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551717+0000", 2024-05-08T18:08:43.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.206e-05 2024-05-08T18:08:43.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551747+0000", 2024-05-08T18:08:43.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0168999999999999e-05 2024-05-08T18:08:43.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551763+0000", 2024-05-08T18:08:43.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:08:43.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551880+0000", 2024-05-08T18:08:43.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116976 2024-05-08T18:08:43.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552099+0000", 2024-05-08T18:08:43.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021910199999999999 2024-05-08T18:08:43.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:43.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552476+0000", 2024-05-08T18:08:43.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000376697 2024-05-08T18:08:43.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.553551+0000", 2024-05-08T18:08:43.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001074925 2024-05-08T18:08:43.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554588+0000", 2024-05-08T18:08:43.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010374099999999999 2024-05-08T18:08:43.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554671+0000", 2024-05-08T18:08:43.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3368999999999994e-05 2024-05-08T18:08:43.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554738+0000", 2024-05-08T18:08:43.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6043000000000004e-05 2024-05-08T18:08:43.809 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.809 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.809 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.809 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.809 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:43.809 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.128048934000006, 2024-05-08T18:08:43.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028304160000000001, 2024-05-08T18:08:43.809 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.810 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.810 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.810 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.810 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.810 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.810 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 955 2024-05-08T18:08:43.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.810 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:43.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:43.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565318+0000", 2024-05-08T18:08:43.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7030000000000002e-06 2024-05-08T18:08:43.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565330+0000", 2024-05-08T18:08:43.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.204e-05 2024-05-08T18:08:43.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565363+0000", 2024-05-08T18:08:43.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2722999999999998e-05 2024-05-08T18:08:43.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565389+0000", 2024-05-08T18:08:43.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6412999999999999e-05 2024-05-08T18:08:43.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565510+0000", 2024-05-08T18:08:43.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120932 2024-05-08T18:08:43.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565722+0000", 2024-05-08T18:08:43.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212139 2024-05-08T18:08:43.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:43.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.566034+0000", 2024-05-08T18:08:43.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000312038 2024-05-08T18:08:43.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567340+0000", 2024-05-08T18:08:43.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00130547 2024-05-08T18:08:43.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567998+0000", 2024-05-08T18:08:43.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000658382 2024-05-08T18:08:43.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568081+0000", 2024-05-08T18:08:43.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3269999999999994e-05 2024-05-08T18:08:43.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568145+0000", 2024-05-08T18:08:43.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4306000000000004e-05 2024-05-08T18:08:43.815 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.815 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.815 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.815 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:43.815 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:43.815 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.124329411000005, 2024-05-08T18:08:43.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027506660000000001, 2024-05-08T18:08:43.816 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:43.816 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:43.816 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:43.816 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:43.816 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:43.816 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:43.816 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 957 2024-05-08T18:08:43.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.816 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:43.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:43.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:43.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:43.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:43.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:43.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:43.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569036+0000", 2024-05-08T18:08:43.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.776e-06 2024-05-08T18:08:43.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:43.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569061+0000", 2024-05-08T18:08:43.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5097e-05 2024-05-08T18:08:43.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:43.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569084+0000", 2024-05-08T18:08:43.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.23e-05 2024-05-08T18:08:43.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:43.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569096+0000", 2024-05-08T18:08:43.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.22e-05 2024-05-08T18:08:43.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:43.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569180+0000", 2024-05-08T18:08:43.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4369000000000005e-05 2024-05-08T18:08:43.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:43.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569296+0000", 2024-05-08T18:08:43.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115999 2024-05-08T18:08:43.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:43.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569550+0000", 2024-05-08T18:08:43.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025397499999999998 2024-05-08T18:08:43.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:43.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.570963+0000", 2024-05-08T18:08:43.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001413023 2024-05-08T18:08:43.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:43.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571614+0000", 2024-05-08T18:08:43.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065041199999999995 2024-05-08T18:08:43.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:43.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571701+0000", 2024-05-08T18:08:43.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7569000000000001e-05 2024-05-08T18:08:43.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:43.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:43.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:43.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571785+0000", 2024-05-08T18:08:43.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3945999999999999e-05 2024-05-08T18:08:43.821 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.821 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.821 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.821 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:43.821 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:43.821 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:43.823 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:08:43.824 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:43.821+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:43.924 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:43.924+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:43.957 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:08:43.993 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:43.993 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:43.993 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:44.012 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:08:44.054 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:44.056+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:44.125 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:44.124+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:44.224 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:44.224 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:44.225 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:44.226 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:44.224+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:44.242 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:08:44.330 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:44.332+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:44.427 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:44.428+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:44.458 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:44.458 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:44.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:44.458 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:44.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.458 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:44.458 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:44.458 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.907983877999996, 2024-05-08T18:08:44.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049710090000000002, 2024-05-08T18:08:44.458 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.458 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.459 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-08T18:08:44.459 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.459 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.459 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.459 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 44 2024-05-08T18:08:44.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.459 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:44.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:44.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552775+0000", 2024-05-08T18:08:44.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4450000000000001e-06 2024-05-08T18:08:44.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552790+0000", 2024-05-08T18:08:44.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4363e-05 2024-05-08T18:08:44.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552820+0000", 2024-05-08T18:08:44.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0485999999999999e-05 2024-05-08T18:08:44.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552843+0000", 2024-05-08T18:08:44.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2985000000000001e-05 2024-05-08T18:08:44.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554350+0000", 2024-05-08T18:08:44.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015065149999999999 2024-05-08T18:08:44.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-08T18:08:44.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554374+0000", 2024-05-08T18:08:44.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4097e-05 2024-05-08T18:08:44.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557531+0000", 2024-05-08T18:08:44.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031567169999999999 2024-05-08T18:08:44.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557743+0000", 2024-05-08T18:08:44.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212401 2024-05-08T18:08:44.462 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.463 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.463 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.463 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:44.465 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:44.465 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.872632000999999, 2024-05-08T18:08:44.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050241879999999997, 2024-05-08T18:08:44.465 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.466 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.466 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.466 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.466 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.466 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.466 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 58 2024-05-08T18:08:44.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.466 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:44.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:44.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588125+0000", 2024-05-08T18:08:44.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1399999999999995e-07 2024-05-08T18:08:44.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588129+0000", 2024-05-08T18:08:44.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6779999999999999e-06 2024-05-08T18:08:44.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588142+0000", 2024-05-08T18:08:44.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3047999999999999e-05 2024-05-08T18:08:44.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588174+0000", 2024-05-08T18:08:44.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1270999999999999e-05 2024-05-08T18:08:44.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588307+0000", 2024-05-08T18:08:44.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013307600000000001 2024-05-08T18:08:44.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588477+0000", 2024-05-08T18:08:44.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000170213 2024-05-08T18:08:44.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:44.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588669+0000", 2024-05-08T18:08:44.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019211599999999999 2024-05-08T18:08:44.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.590228+0000", 2024-05-08T18:08:44.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015590059999999999 2024-05-08T18:08:44.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593029+0000", 2024-05-08T18:08:44.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028006400000000001 2024-05-08T18:08:44.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593099+0000", 2024-05-08T18:08:44.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0300000000000001e-05 2024-05-08T18:08:44.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593148+0000", 2024-05-08T18:08:44.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8925999999999999e-05 2024-05-08T18:08:44.470 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.471 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.471 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.471 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:08:44.471 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:44.471 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.876093840999999, 2024-05-08T18:08:44.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00385587, 2024-05-08T18:08:44.471 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.471 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.471 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.471 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.471 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.471 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.471 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207 2024-05-08T18:08:44.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.472 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:44.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:44.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584665+0000", 2024-05-08T18:08:44.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0570000000000001e-06 2024-05-08T18:08:44.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584679+0000", 2024-05-08T18:08:44.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3713000000000001e-05 2024-05-08T18:08:44.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584712+0000", 2024-05-08T18:08:44.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3213999999999997e-05 2024-05-08T18:08:44.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584728+0000", 2024-05-08T18:08:44.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5936000000000001e-05 2024-05-08T18:08:44.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584951+0000", 2024-05-08T18:08:44.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000222955 2024-05-08T18:08:44.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585196+0000", 2024-05-08T18:08:44.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024550800000000002 2024-05-08T18:08:44.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:44.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585643+0000", 2024-05-08T18:08:44.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00044644699999999999 2024-05-08T18:08:44.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.587110+0000", 2024-05-08T18:08:44.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001467323 2024-05-08T18:08:44.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588371+0000", 2024-05-08T18:08:44.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012607180000000001 2024-05-08T18:08:44.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588452+0000", 2024-05-08T18:08:44.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1216000000000003e-05 2024-05-08T18:08:44.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588518+0000", 2024-05-08T18:08:44.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5783000000000004e-05 2024-05-08T18:08:44.476 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.476 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.476 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.476 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.476 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:44.476 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.829918438999997, 2024-05-08T18:08:44.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003249994, 2024-05-08T18:08:44.476 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.476 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.477 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.477 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.477 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.477 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.477 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216 2024-05-08T18:08:44.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.477 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:44.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:44.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630840+0000", 2024-05-08T18:08:44.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0730000000000001e-06 2024-05-08T18:08:44.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630854+0000", 2024-05-08T18:08:44.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3360000000000001e-05 2024-05-08T18:08:44.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630889+0000", 2024-05-08T18:08:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5176999999999999e-05 2024-05-08T18:08:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630911+0000", 2024-05-08T18:08:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.247e-05 2024-05-08T18:08:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631046+0000", 2024-05-08T18:08:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013484599999999999 2024-05-08T18:08:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631272+0000", 2024-05-08T18:08:44.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000225694 2024-05-08T18:08:44.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:44.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631703+0000", 2024-05-08T18:08:44.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000431144 2024-05-08T18:08:44.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633244+0000", 2024-05-08T18:08:44.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001540622 2024-05-08T18:08:44.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633926+0000", 2024-05-08T18:08:44.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068244200000000001 2024-05-08T18:08:44.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634019+0000", 2024-05-08T18:08:44.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3148999999999999e-05 2024-05-08T18:08:44.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634087+0000", 2024-05-08T18:08:44.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8016999999999996e-05 2024-05-08T18:08:44.481 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.481 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.481 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.482 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.482 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:44.482 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.788374390000001, 2024-05-08T18:08:44.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003119854, 2024-05-08T18:08:44.482 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.482 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.482 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.482 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.482 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.482 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.482 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 227 2024-05-08T18:08:44.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.483 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:44.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:44.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672384+0000", 2024-05-08T18:08:44.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7470000000000001e-06 2024-05-08T18:08:44.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672396+0000", 2024-05-08T18:08:44.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.154e-05 2024-05-08T18:08:44.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672427+0000", 2024-05-08T18:08:44.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1676e-05 2024-05-08T18:08:44.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672443+0000", 2024-05-08T18:08:44.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5214e-05 2024-05-08T18:08:44.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672563+0000", 2024-05-08T18:08:44.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120535 2024-05-08T18:08:44.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672778+0000", 2024-05-08T18:08:44.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021446200000000001 2024-05-08T18:08:44.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:44.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.673205+0000", 2024-05-08T18:08:44.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042750699999999998 2024-05-08T18:08:44.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.674848+0000", 2024-05-08T18:08:44.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016432980000000001 2024-05-08T18:08:44.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675346+0000", 2024-05-08T18:08:44.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049711999999999998 2024-05-08T18:08:44.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675432+0000", 2024-05-08T18:08:44.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6798999999999993e-05 2024-05-08T18:08:44.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675501+0000", 2024-05-08T18:08:44.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8955999999999995e-05 2024-05-08T18:08:44.487 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.487 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.487 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.487 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.487 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:44.488 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.781433602999996, 2024-05-08T18:08:44.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034322110000000001, 2024-05-08T18:08:44.488 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.488 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.488 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.488 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.488 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.488 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.488 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 229 2024-05-08T18:08:44.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.488 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:44.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:44.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679325+0000", 2024-05-08T18:08:44.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:08:44.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679339+0000", 2024-05-08T18:08:44.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:08:44.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679370+0000", 2024-05-08T18:08:44.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0280000000000001e-05 2024-05-08T18:08:44.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679385+0000", 2024-05-08T18:08:44.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5026e-05 2024-05-08T18:08:44.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679504+0000", 2024-05-08T18:08:44.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119023 2024-05-08T18:08:44.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679711+0000", 2024-05-08T18:08:44.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020705499999999999 2024-05-08T18:08:44.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:44.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.680115+0000", 2024-05-08T18:08:44.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040396699999999998 2024-05-08T18:08:44.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.681424+0000", 2024-05-08T18:08:44.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001309387 2024-05-08T18:08:44.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682488+0000", 2024-05-08T18:08:44.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010642519999999999 2024-05-08T18:08:44.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682640+0000", 2024-05-08T18:08:44.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015123599999999999 2024-05-08T18:08:44.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682754+0000", 2024-05-08T18:08:44.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011482200000000001 2024-05-08T18:08:44.492 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.492 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.493 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.493 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.493 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:44.493 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.774049394000002, 2024-05-08T18:08:44.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033353329999999998, 2024-05-08T18:08:44.493 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.493 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.493 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.493 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.493 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.493 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.493 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 231 2024-05-08T18:08:44.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.494 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:44.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:44.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686709+0000", 2024-05-08T18:08:44.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4729999999999999e-06 2024-05-08T18:08:44.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686720+0000", 2024-05-08T18:08:44.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1157e-05 2024-05-08T18:08:44.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686750+0000", 2024-05-08T18:08:44.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0417e-05 2024-05-08T18:08:44.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686765+0000", 2024-05-08T18:08:44.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.487e-05 2024-05-08T18:08:44.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686872+0000", 2024-05-08T18:08:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010703499999999999 2024-05-08T18:08:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687085+0000", 2024-05-08T18:08:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021279599999999999 2024-05-08T18:08:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687501+0000", 2024-05-08T18:08:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041554 2024-05-08T18:08:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.688886+0000", 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00138565 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689899+0000", 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010128190000000001 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689978+0000", 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8490000000000002e-05 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.690042+0000", 2024-05-08T18:08:44.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4085999999999996e-05 2024-05-08T18:08:44.498 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.498 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.498 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.498 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:394 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.498 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:44.498 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.716976317000004, 2024-05-08T18:08:44.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034384960000000001, 2024-05-08T18:08:44.498 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.498 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.498 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.499 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.499 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.499 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.499 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 394 2024-05-08T18:08:44.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.499 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:44.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:44.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743781+0000", 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3e-06 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743788+0000", 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7399999999999998e-06 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743801+0000", 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3757000000000001e-05 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743808+0000", 2024-05-08T18:08:44.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6579999999999996e-06 2024-05-08T18:08:44.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743875+0000", 2024-05-08T18:08:44.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6740000000000001e-05 2024-05-08T18:08:44.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743971+0000", 2024-05-08T18:08:44.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6175000000000007e-05 2024-05-08T18:08:44.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:44.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744100+0000", 2024-05-08T18:08:44.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012954899999999999 2024-05-08T18:08:44.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744863+0000", 2024-05-08T18:08:44.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076300100000000002 2024-05-08T18:08:44.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747089+0000", 2024-05-08T18:08:44.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022258540000000002 2024-05-08T18:08:44.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747162+0000", 2024-05-08T18:08:44.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2632000000000005e-05 2024-05-08T18:08:44.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747218+0000", 2024-05-08T18:08:44.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.609e-05 2024-05-08T18:08:44.503 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.503 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.503 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.504 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:535 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.504 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:44.504 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.619263239999995, 2024-05-08T18:08:44.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055640899999999998, 2024-05-08T18:08:44.504 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.504 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.504 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.504 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.504 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.504 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.504 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 535 2024-05-08T18:08:44.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.504 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841494+0000", 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0899999999999999e-06 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841500+0000", 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0249999999999999e-06 2024-05-08T18:08:44.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841513+0000", 2024-05-08T18:08:44.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3658e-05 2024-05-08T18:08:44.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841522+0000", 2024-05-08T18:08:44.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3410000000000003e-06 2024-05-08T18:08:44.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841574+0000", 2024-05-08T18:08:44.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2794000000000003e-05 2024-05-08T18:08:44.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841633+0000", 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8595999999999999e-05 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841755+0000", 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012227399999999999 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.842349+0000", 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00059377699999999998 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.846949+0000", 2024-05-08T18:08:44.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004599723 2024-05-08T18:08:44.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847008+0000", 2024-05-08T18:08:44.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8854999999999998e-05 2024-05-08T18:08:44.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847057+0000", 2024-05-08T18:08:44.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8956999999999999e-05 2024-05-08T18:08:44.508 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.508 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.508 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.509 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:541 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.509 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:44.509 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.612233709999998, 2024-05-08T18:08:44.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037829790000000001, 2024-05-08T18:08:44.509 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.509 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.509 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.509 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.509 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.509 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.509 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 541 2024-05-08T18:08:44.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.509 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:44.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:44.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848523+0000", 2024-05-08T18:08:44.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8599999999999997e-07 2024-05-08T18:08:44.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848526+0000", 2024-05-08T18:08:44.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4690000000000002e-06 2024-05-08T18:08:44.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848536+0000", 2024-05-08T18:08:44.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2029999999999998e-06 2024-05-08T18:08:44.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848540+0000", 2024-05-08T18:08:44.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9169999999999997e-06 2024-05-08T18:08:44.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848591+0000", 2024-05-08T18:08:44.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0328000000000003e-05 2024-05-08T18:08:44.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848646+0000", 2024-05-08T18:08:44.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5281999999999997e-05 2024-05-08T18:08:44.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:44.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848759+0000", 2024-05-08T18:08:44.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011278899999999999 2024-05-08T18:08:44.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.849323+0000", 2024-05-08T18:08:44.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056433999999999998 2024-05-08T18:08:44.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852225+0000", 2024-05-08T18:08:44.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029017320000000002 2024-05-08T18:08:44.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852277+0000", 2024-05-08T18:08:44.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2460999999999998e-05 2024-05-08T18:08:44.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852305+0000", 2024-05-08T18:08:44.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7671999999999999e-05 2024-05-08T18:08:44.514 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.514 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.514 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.514 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.514 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:44.514 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.479086632999994, 2024-05-08T18:08:44.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002973084, 2024-05-08T18:08:44.514 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.514 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.514 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.514 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.514 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.515 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.515 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 703 2024-05-08T18:08:44.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.515 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:44.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:44.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981672+0000", 2024-05-08T18:08:44.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5799999999999999e-06 2024-05-08T18:08:44.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981683+0000", 2024-05-08T18:08:44.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1270000000000001e-05 2024-05-08T18:08:44.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981715+0000", 2024-05-08T18:08:44.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1470000000000002e-05 2024-05-08T18:08:44.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981730+0000", 2024-05-08T18:08:44.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5262999999999999e-05 2024-05-08T18:08:44.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981864+0000", 2024-05-08T18:08:44.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134043 2024-05-08T18:08:44.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982168+0000", 2024-05-08T18:08:44.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030453799999999998 2024-05-08T18:08:44.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:44.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982620+0000", 2024-05-08T18:08:44.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045170900000000001 2024-05-08T18:08:44.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.983648+0000", 2024-05-08T18:08:44.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010276009999999999 2024-05-08T18:08:44.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984486+0000", 2024-05-08T18:08:44.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083874600000000002 2024-05-08T18:08:44.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984571+0000", 2024-05-08T18:08:44.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4370999999999996e-05 2024-05-08T18:08:44.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984642+0000", 2024-05-08T18:08:44.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1493000000000001e-05 2024-05-08T18:08:44.520 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.520 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.520 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.520 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:789 6.0 e32/26 6:0216b5b6:::obj_delete_at_hint.0000000070:head v 32'14, mlcod=32'12)", 2024-05-08T18:08:44.520 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:44.520 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.279659859999995, 2024-05-08T18:08:44.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034621420000000001, 2024-05-08T18:08:44.520 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.520 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.520 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.520 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:44.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:44.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181098+0000", 2024-05-08T18:08:44.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8029999999999999e-06 2024-05-08T18:08:44.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181109+0000", 2024-05-08T18:08:44.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1219999999999999e-05 2024-05-08T18:08:44.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181138+0000", 2024-05-08T18:08:44.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.898e-05 2024-05-08T18:08:44.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181151+0000", 2024-05-08T18:08:44.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.308e-05 2024-05-08T18:08:44.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181268+0000", 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116629 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181321+0000", 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3325999999999997e-05 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184477+0000", 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003156458 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184558+0000", 2024-05-08T18:08:44.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0646e-05 2024-05-08T18:08:44.524 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.524 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.524 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.524 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.524 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:44.524 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.248486356000001, 2024-05-08T18:08:44.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031146310000000001, 2024-05-08T18:08:44.524 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.524 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.524 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.524 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.525 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.525 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.525 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 802 2024-05-08T18:08:44.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.525 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:44.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:44.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212272+0000", 2024-05-08T18:08:44.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.943e-06 2024-05-08T18:08:44.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212284+0000", 2024-05-08T18:08:44.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1747e-05 2024-05-08T18:08:44.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212315+0000", 2024-05-08T18:08:44.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0579e-05 2024-05-08T18:08:44.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212336+0000", 2024-05-08T18:08:44.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1639999999999999e-05 2024-05-08T18:08:44.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212488+0000", 2024-05-08T18:08:44.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151192 2024-05-08T18:08:44.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212703+0000", 2024-05-08T18:08:44.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000215439 2024-05-08T18:08:44.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:44.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.213033+0000", 2024-05-08T18:08:44.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032992699999999999 2024-05-08T18:08:44.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.214306+0000", 2024-05-08T18:08:44.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012726949999999999 2024-05-08T18:08:44.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215232+0000", 2024-05-08T18:08:44.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092652999999999995 2024-05-08T18:08:44.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215321+0000", 2024-05-08T18:08:44.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9272999999999997e-05 2024-05-08T18:08:44.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215384+0000", 2024-05-08T18:08:44.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2665999999999999e-05 2024-05-08T18:08:44.529 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.529 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.529 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.529 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.529 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:44.529 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.167941949999999, 2024-05-08T18:08:44.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030150250000000002, 2024-05-08T18:08:44.530 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.530 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.530 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.530 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.530 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.530 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.530 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 838 2024-05-08T18:08:44.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.530 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:44.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:44.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292816+0000", 2024-05-08T18:08:44.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:08:44.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292828+0000", 2024-05-08T18:08:44.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.184e-05 2024-05-08T18:08:44.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292857+0000", 2024-05-08T18:08:44.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8960000000000001e-05 2024-05-08T18:08:44.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292871+0000", 2024-05-08T18:08:44.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.45e-05 2024-05-08T18:08:44.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293000+0000", 2024-05-08T18:08:44.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128875 2024-05-08T18:08:44.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293231+0000", 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023030500000000001 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293563+0000", 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000332648 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.294882+0000", 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001319183 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295664+0000", 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000781991 2024-05-08T18:08:44.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295754+0000", 2024-05-08T18:08:44.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9176000000000001e-05 2024-05-08T18:08:44.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295829+0000", 2024-05-08T18:08:44.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.525e-05 2024-05-08T18:08:44.534 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.534 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.534 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.535 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.535 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:44.535 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.106808280999999, 2024-05-08T18:08:44.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029338929999999999, 2024-05-08T18:08:44.535 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.535 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.535 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.535 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 865 2024-05-08T18:08:44.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.535 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:44.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:44.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353950+0000", 2024-05-08T18:08:44.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2469999999999998e-06 2024-05-08T18:08:44.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353961+0000", 2024-05-08T18:08:44.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1523e-05 2024-05-08T18:08:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353991+0000", 2024-05-08T18:08:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9920000000000002e-05 2024-05-08T18:08:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354013+0000", 2024-05-08T18:08:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1590000000000002e-05 2024-05-08T18:08:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354206+0000", 2024-05-08T18:08:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019273900000000001 2024-05-08T18:08:44.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354418+0000", 2024-05-08T18:08:44.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212518 2024-05-08T18:08:44.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:44.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354720+0000", 2024-05-08T18:08:44.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030151800000000002 2024-05-08T18:08:44.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.355983+0000", 2024-05-08T18:08:44.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012636780000000001 2024-05-08T18:08:44.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356733+0000", 2024-05-08T18:08:44.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074988400000000003 2024-05-08T18:08:44.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356819+0000", 2024-05-08T18:08:44.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5690000000000001e-05 2024-05-08T18:08:44.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356881+0000", 2024-05-08T18:08:44.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2586e-05 2024-05-08T18:08:44.540 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.540 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.540 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.540 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.540 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:44.540 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.093684916000001, 2024-05-08T18:08:44.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004954511, 2024-05-08T18:08:44.540 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.540 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.540 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.540 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.540 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 871 2024-05-08T18:08:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367073+0000", 2024-05-08T18:08:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2340000000000001e-06 2024-05-08T18:08:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367085+0000", 2024-05-08T18:08:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1483e-05 2024-05-08T18:08:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367111+0000", 2024-05-08T18:08:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5890000000000001e-05 2024-05-08T18:08:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367130+0000", 2024-05-08T18:08:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9700000000000001e-05 2024-05-08T18:08:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367284+0000", 2024-05-08T18:08:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015411799999999999 2024-05-08T18:08:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367516+0000", 2024-05-08T18:08:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000231272 2024-05-08T18:08:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367837+0000", 2024-05-08T18:08:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032173400000000001 2024-05-08T18:08:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371395+0000", 2024-05-08T18:08:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035574719999999999 2024-05-08T18:08:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371882+0000", 2024-05-08T18:08:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048693899999999998 2024-05-08T18:08:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371962+0000", 2024-05-08T18:08:44.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.975e-05 2024-05-08T18:08:44.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372025+0000", 2024-05-08T18:08:44.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3918999999999996e-05 2024-05-08T18:08:44.545 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.545 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.545 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.545 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.545 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:44.546 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.087797211999998, 2024-05-08T18:08:44.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045233640000000002, 2024-05-08T18:08:44.546 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.546 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.546 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.546 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.546 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.546 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.546 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 873 2024-05-08T18:08:44.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.546 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:44.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:44.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372961+0000", 2024-05-08T18:08:44.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:08:44.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372969+0000", 2024-05-08T18:08:44.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2940000000000006e-06 2024-05-08T18:08:44.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372991+0000", 2024-05-08T18:08:44.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1829000000000001e-05 2024-05-08T18:08:44.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373009+0000", 2024-05-08T18:08:44.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8607e-05 2024-05-08T18:08:44.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373127+0000", 2024-05-08T18:08:44.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011728899999999999 2024-05-08T18:08:44.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373260+0000", 2024-05-08T18:08:44.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013301200000000001 2024-05-08T18:08:44.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:44.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373526+0000", 2024-05-08T18:08:44.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026613500000000003 2024-05-08T18:08:44.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.374558+0000", 2024-05-08T18:08:44.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001032156 2024-05-08T18:08:44.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377333+0000", 2024-05-08T18:08:44.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027749329999999998 2024-05-08T18:08:44.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377421+0000", 2024-05-08T18:08:44.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8679999999999998e-05 2024-05-08T18:08:44.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377482+0000", 2024-05-08T18:08:44.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0538999999999998e-05 2024-05-08T18:08:44.551 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.551 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.551 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.551 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.551 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:44.551 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.028188057999998, 2024-05-08T18:08:44.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035261009999999998, 2024-05-08T18:08:44.551 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.551 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.551 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.551 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.551 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.551 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.552 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 898 2024-05-08T18:08:44.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.552 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:44.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:44.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432570+0000", 2024-05-08T18:08:44.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.26e-06 2024-05-08T18:08:44.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432580+0000", 2024-05-08T18:08:44.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8570000000000007e-06 2024-05-08T18:08:44.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432605+0000", 2024-05-08T18:08:44.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5273e-05 2024-05-08T18:08:44.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432618+0000", 2024-05-08T18:08:44.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2999999999999999e-05 2024-05-08T18:08:44.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432742+0000", 2024-05-08T18:08:44.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012369200000000001 2024-05-08T18:08:44.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433109+0000", 2024-05-08T18:08:44.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036760500000000002 2024-05-08T18:08:44.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:44.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433645+0000", 2024-05-08T18:08:44.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053599599999999996 2024-05-08T18:08:44.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435050+0000", 2024-05-08T18:08:44.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001404696 2024-05-08T18:08:44.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435834+0000", 2024-05-08T18:08:44.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078381100000000003 2024-05-08T18:08:44.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435984+0000", 2024-05-08T18:08:44.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015006899999999999 2024-05-08T18:08:44.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.436094+0000", 2024-05-08T18:08:44.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109842 2024-05-08T18:08:44.556 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.556 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.556 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.556 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.556 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:44.556 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.023435208999999, 2024-05-08T18:08:44.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031481899999999999, 2024-05-08T18:08:44.557 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.557 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.557 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.557 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 900 2024-05-08T18:08:44.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.557 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:44.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:44.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437323+0000", 2024-05-08T18:08:44.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.447e-06 2024-05-08T18:08:44.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437334+0000", 2024-05-08T18:08:44.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0835999999999999e-05 2024-05-08T18:08:44.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437364+0000", 2024-05-08T18:08:44.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0463999999999998e-05 2024-05-08T18:08:44.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437379+0000", 2024-05-08T18:08:44.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4806e-05 2024-05-08T18:08:44.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437500+0000", 2024-05-08T18:08:44.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121309 2024-05-08T18:08:44.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437729+0000", 2024-05-08T18:08:44.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022818200000000001 2024-05-08T18:08:44.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:44.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.438199+0000", 2024-05-08T18:08:44.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047025300000000001 2024-05-08T18:08:44.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.439418+0000", 2024-05-08T18:08:44.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012193849999999999 2024-05-08T18:08:44.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440217+0000", 2024-05-08T18:08:44.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00079905999999999998 2024-05-08T18:08:44.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440352+0000", 2024-05-08T18:08:44.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013485299999999999 2024-05-08T18:08:44.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440469+0000", 2024-05-08T18:08:44.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116595 2024-05-08T18:08:44.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.562 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.562 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.562 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:44.562 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 76.937199203999995, 2024-05-08T18:08:44.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003477894, 2024-05-08T18:08:44.562 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:44.562 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:44.562 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.562 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:44.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:44.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.563 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 937 2024-05-08T18:08:44.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.563 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:44.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:44.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:44.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:44.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:44.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:44.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:44.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523559+0000", 2024-05-08T18:08:44.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.95e-06 2024-05-08T18:08:44.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:44.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523567+0000", 2024-05-08T18:08:44.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6799999999999999e-06 2024-05-08T18:08:44.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:44.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523591+0000", 2024-05-08T18:08:44.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3269e-05 2024-05-08T18:08:44.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523611+0000", 2024-05-08T18:08:44.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0100000000000001e-05 2024-05-08T18:08:44.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:44.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523767+0000", 2024-05-08T18:08:44.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015604900000000001 2024-05-08T18:08:44.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:44.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523994+0000", 2024-05-08T18:08:44.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022764199999999999 2024-05-08T18:08:44.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:44.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.524338+0000", 2024-05-08T18:08:44.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034388700000000002 2024-05-08T18:08:44.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:44.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.525707+0000", 2024-05-08T18:08:44.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001368544 2024-05-08T18:08:44.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526843+0000", 2024-05-08T18:08:44.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001136501 2024-05-08T18:08:44.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:44.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526957+0000", 2024-05-08T18:08:44.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011359 2024-05-08T18:08:44.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:44.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:44.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:44.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.527035+0000", 2024-05-08T18:08:44.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7682000000000006e-05 2024-05-08T18:08:44.567 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.567 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.567 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.567 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:44.567 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:44.567 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:44.569 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:08:44.569 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:44.569+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:44.670 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:44.672+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:44.701 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:44.702 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:44.702 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:44.716 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:08:44.771 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:44.772+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:44.821 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:08:44.840 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:44.840 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:44.840 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:44.840 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:44.840 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:44.854 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:08:44.900 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:44.901+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:44.923 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-05-08T18:08:44.975 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:44.976+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:44.982 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:44.982 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:44.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:44.983 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:44.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.983 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:36 5.e 5:71234df9:::zone_info.d0a95a6c-3c84-4d52-915c-e8ea581dfb9b:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:08:44.983 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:44.983 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.407146965999999, 2024-05-08T18:08:44.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028394430000000001, 2024-05-08T18:08:44.983 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:44.983 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:44.983 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.983 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:44.983 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:08:44.983 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:08:44.983 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 36 2024-05-08T18:08:44.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.984 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:44.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:44.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:44.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:44.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:44.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:44.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:44.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:44.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573456+0000", 2024-05-08T18:08:44.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:44.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:44.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573467+0000", 2024-05-08T18:08:44.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1243999999999999e-05 2024-05-08T18:08:44.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:44.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573499+0000", 2024-05-08T18:08:44.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1343000000000001e-05 2024-05-08T18:08:44.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573522+0000", 2024-05-08T18:08:44.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3540000000000002e-05 2024-05-08T18:08:44.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:44.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573634+0000", 2024-05-08T18:08:44.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112249 2024-05-08T18:08:44.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:44.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573841+0000", 2024-05-08T18:08:44.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000206407 2024-05-08T18:08:44.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:44.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.574122+0000", 2024-05-08T18:08:44.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000281475 2024-05-08T18:08:44.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:44.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.575489+0000", 2024-05-08T18:08:44.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001366391 2024-05-08T18:08:44.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576157+0000", 2024-05-08T18:08:44.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00066776200000000002 2024-05-08T18:08:44.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:44.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576234+0000", 2024-05-08T18:08:44.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7285000000000003e-05 2024-05-08T18:08:44.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:44.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576293+0000", 2024-05-08T18:08:44.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9556999999999999e-05 2024-05-08T18:08:44.988 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:44.988 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:44.988 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:44.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.988 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:44.989 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:44.989 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.450387773000003, 2024-05-08T18:08:44.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018560765, 2024-05-08T18:08:44.989 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:44.989 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:44.989 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:08:44.989 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:44.989 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:44.989 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.989 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 43 2024-05-08T18:08:44.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.989 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:44.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:44.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:44.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:44.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:44.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:44.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:44.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:44.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530217+0000", 2024-05-08T18:08:44.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:08:44.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:44.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530253+0000", 2024-05-08T18:08:44.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5621999999999999e-05 2024-05-08T18:08:44.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:44.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530288+0000", 2024-05-08T18:08:44.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5846999999999997e-05 2024-05-08T18:08:44.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530314+0000", 2024-05-08T18:08:44.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5732e-05 2024-05-08T18:08:44.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:44.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530952+0000", 2024-05-08T18:08:44.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00063739999999999999 2024-05-08T18:08:44.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:44.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530977+0000", 2024-05-08T18:08:44.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5375e-05 2024-05-08T18:08:44.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:44.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548506+0000", 2024-05-08T18:08:44.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017528781 2024-05-08T18:08:44.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:44.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548774+0000", 2024-05-08T18:08:44.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026821199999999999 2024-05-08T18:08:44.993 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:44.993 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:44.993 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:44.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.993 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.993 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:44.993 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.368073848999998, 2024-05-08T18:08:44.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003496893, 2024-05-08T18:08:44.993 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:44.993 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:44.993 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.994 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:44.994 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:44.994 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.994 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 211 2024-05-08T18:08:44.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.994 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:44.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:44.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:44.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:44.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:44.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:44.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:44.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:44.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612530+0000", 2024-05-08T18:08:44.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9490000000000001e-06 2024-05-08T18:08:44.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:44.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612544+0000", 2024-05-08T18:08:44.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3779e-05 2024-05-08T18:08:44.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:44.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612578+0000", 2024-05-08T18:08:44.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4421000000000001e-05 2024-05-08T18:08:44.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:44.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612596+0000", 2024-05-08T18:08:44.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7435000000000002e-05 2024-05-08T18:08:44.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:44.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612718+0000", 2024-05-08T18:08:44.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012218600000000001 2024-05-08T18:08:44.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:44.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612951+0000", 2024-05-08T18:08:44.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000232768 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.613370+0000", 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041921200000000002 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.614840+0000", 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014703679999999999 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615860+0000", 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010198220000000001 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:44.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615954+0000", 2024-05-08T18:08:44.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4419000000000005e-05 2024-05-08T18:08:44.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:44.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.616024+0000", 2024-05-08T18:08:44.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9534000000000002e-05 2024-05-08T18:08:44.998 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:44.998 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:44.998 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:44.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.998 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:44.998 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:44.999 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.291384167000004, 2024-05-08T18:08:44.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035800939999999998, 2024-05-08T18:08:44.999 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:44.999 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:44.999 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:44.999 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:44.999 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:44.999 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:44.999 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 232 2024-05-08T18:08:44.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:44.999 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:44.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:44.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:44.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:45.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:45.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689219+0000", 2024-05-08T18:08:45.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4490000000000002e-06 2024-05-08T18:08:45.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689232+0000", 2024-05-08T18:08:45.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3183000000000001e-05 2024-05-08T18:08:45.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689263+0000", 2024-05-08T18:08:45.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400999999999999e-05 2024-05-08T18:08:45.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689279+0000", 2024-05-08T18:08:45.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6078000000000001e-05 2024-05-08T18:08:45.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689401+0000", 2024-05-08T18:08:45.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012243000000000001 2024-05-08T18:08:45.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689656+0000", 2024-05-08T18:08:45.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431899999999998 2024-05-08T18:08:45.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:45.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.690103+0000", 2024-05-08T18:08:45.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044706299999999999 2024-05-08T18:08:45.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:45.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.691780+0000", 2024-05-08T18:08:45.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016774209999999999 2024-05-08T18:08:45.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:45.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692634+0000", 2024-05-08T18:08:45.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085346 2024-05-08T18:08:45.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692728+0000", 2024-05-08T18:08:45.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4429e-05 2024-05-08T18:08:45.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692797+0000", 2024-05-08T18:08:45.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8861000000000004e-05 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:267 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.266739189000006, 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040291739999999999, 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 267 2024-05-08T18:08:45.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.005 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:45.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:45.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:45.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:45.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713863+0000", 2024-05-08T18:08:45.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5200000000000001e-06 2024-05-08T18:08:45.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713873+0000", 2024-05-08T18:08:45.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9089999999999995e-06 2024-05-08T18:08:45.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713896+0000", 2024-05-08T18:08:45.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2595e-05 2024-05-08T18:08:45.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713914+0000", 2024-05-08T18:08:45.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7869000000000001e-05 2024-05-08T18:08:45.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714048+0000", 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134802 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714278+0000", 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022994399999999999 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714777+0000", 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049880499999999995 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:45.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.715976+0000", 2024-05-08T18:08:45.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011991110000000001 2024-05-08T18:08:45.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:45.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717646+0000", 2024-05-08T18:08:45.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016699989999999999 2024-05-08T18:08:45.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717790+0000", 2024-05-08T18:08:45.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014359799999999999 2024-05-08T18:08:45.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717891+0000", 2024-05-08T18:08:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101022 2024-05-08T18:08:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:308 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.259371948999998, 2024-05-08T18:08:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031672779999999999, 2024-05-08T18:08:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:45.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:45.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:45.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:45.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721230+0000", 2024-05-08T18:08:45.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:08:45.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721241+0000", 2024-05-08T18:08:45.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0942e-05 2024-05-08T18:08:45.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721265+0000", 2024-05-08T18:08:45.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3371e-05 2024-05-08T18:08:45.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721278+0000", 2024-05-08T18:08:45.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3586e-05 2024-05-08T18:08:45.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721399+0000", 2024-05-08T18:08:45.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012092 2024-05-08T18:08:45.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721507+0000", 2024-05-08T18:08:45.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107651 2024-05-08T18:08:45.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724292+0000", 2024-05-08T18:08:45.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027851870000000002 2024-05-08T18:08:45.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724396+0000", 2024-05-08T18:08:45.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000104114 2024-05-08T18:08:45.013 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.013 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.013 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.013 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:495 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:45.013 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:45.014 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.176754048000006, 2024-05-08T18:08:45.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005951001, 2024-05-08T18:08:45.014 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:45.014 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:45.014 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:45.014 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:45.014 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:45.014 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:45.014 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 495 2024-05-08T18:08:45.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.014 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:45.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:45.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:45.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803849+0000", 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3580000000000001e-06 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803864+0000", 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4742999999999999e-05 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803895+0000", 2024-05-08T18:08:45.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0970000000000003e-05 2024-05-08T18:08:45.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803908+0000", 2024-05-08T18:08:45.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2588999999999999e-05 2024-05-08T18:08:45.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804005+0000", 2024-05-08T18:08:45.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7107000000000004e-05 2024-05-08T18:08:45.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804291+0000", 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028626900000000002 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804648+0000", 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000356955 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805740+0000", 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001091905 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809636+0000", 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389661 2024-05-08T18:08:45.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809722+0000", 2024-05-08T18:08:45.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:08:45.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809798+0000", 2024-05-08T18:08:45.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5462000000000004e-05 2024-05-08T18:08:45.018 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.018 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.018 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.018 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:45.019 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:45.019 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.170142729999995, 2024-05-08T18:08:45.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051396380000000002, 2024-05-08T18:08:45.019 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:45.019 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:45.019 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:45.019 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:45.019 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:45.019 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:45.019 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 504 2024-05-08T18:08:45.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.019 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:45.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:45.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:45.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:45.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810460+0000", 2024-05-08T18:08:45.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:08:45.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810470+0000", 2024-05-08T18:08:45.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0222e-05 2024-05-08T18:08:45.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810495+0000", 2024-05-08T18:08:45.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4508999999999999e-05 2024-05-08T18:08:45.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810515+0000", 2024-05-08T18:08:45.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9998999999999999e-05 2024-05-08T18:08:45.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810653+0000", 2024-05-08T18:08:45.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013851099999999999 2024-05-08T18:08:45.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810782+0000", 2024-05-08T18:08:45.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128152 2024-05-08T18:08:45.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:45.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811043+0000", 2024-05-08T18:08:45.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026172400000000002 2024-05-08T18:08:45.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:45.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812164+0000", 2024-05-08T18:08:45.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001121024 2024-05-08T18:08:45.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:45.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815415+0000", 2024-05-08T18:08:45.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032510270000000001 2024-05-08T18:08:45.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815538+0000", 2024-05-08T18:08:45.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012256999999999999 2024-05-08T18:08:45.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815598+0000", 2024-05-08T18:08:45.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9923000000000002e-05 2024-05-08T18:08:45.024 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.024 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.024 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.024 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:629 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:45.024 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:45.024 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.061837990000001, 2024-05-08T18:08:45.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611169999999998, 2024-05-08T18:08:45.025 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:45.025 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:45.025 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:45.025 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:45.025 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:45.025 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:45.025 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 629 2024-05-08T18:08:45.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.025 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:45.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:45.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:45.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:45.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918765+0000", 2024-05-08T18:08:45.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5670000000000002e-06 2024-05-08T18:08:45.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918777+0000", 2024-05-08T18:08:45.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1635e-05 2024-05-08T18:08:45.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918808+0000", 2024-05-08T18:08:45.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1024e-05 2024-05-08T18:08:45.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918823+0000", 2024-05-08T18:08:45.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4939e-05 2024-05-08T18:08:45.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918930+0000", 2024-05-08T18:08:45.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107144 2024-05-08T18:08:45.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919147+0000", 2024-05-08T18:08:45.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021682599999999999 2024-05-08T18:08:45.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:45.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919464+0000", 2024-05-08T18:08:45.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031716699999999998 2024-05-08T18:08:45.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:45.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.920561+0000", 2024-05-08T18:08:45.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010970229999999999 2024-05-08T18:08:45.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:45.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921468+0000", 2024-05-08T18:08:45.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00090726800000000003 2024-05-08T18:08:45.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921549+0000", 2024-05-08T18:08:45.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0430000000000001e-05 2024-05-08T18:08:45.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921624+0000", 2024-05-08T18:08:45.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5093999999999996e-05 2024-05-08T18:08:45.030 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.030 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.030 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.030 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:681 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:45.030 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:45.030 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.021517242000002, 2024-05-08T18:08:45.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044793259999999996, 2024-05-08T18:08:45.030 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:45.030 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:45.030 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:45.031 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:45.031 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:45.031 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:45.031 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 681 2024-05-08T18:08:45.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.031 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:45.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:45.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:45.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:45.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959085+0000", 2024-05-08T18:08:45.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.353e-06 2024-05-08T18:08:45.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959092+0000", 2024-05-08T18:08:45.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999999e-06 2024-05-08T18:08:45.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959113+0000", 2024-05-08T18:08:45.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0744e-05 2024-05-08T18:08:45.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959130+0000", 2024-05-08T18:08:45.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7679000000000001e-05 2024-05-08T18:08:45.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959217+0000", 2024-05-08T18:08:45.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6487000000000001e-05 2024-05-08T18:08:45.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959335+0000", 2024-05-08T18:08:45.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118476 2024-05-08T18:08:45.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:45.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959598+0000", 2024-05-08T18:08:45.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000263045 2024-05-08T18:08:45.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:45.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.960551+0000", 2024-05-08T18:08:45.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095251500000000002 2024-05-08T18:08:45.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:45.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963412+0000", 2024-05-08T18:08:45.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611800000000001 2024-05-08T18:08:45.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963498+0000", 2024-05-08T18:08:45.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6145999999999998e-05 2024-05-08T18:08:45.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963563+0000", 2024-05-08T18:08:45.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4701000000000003e-05 2024-05-08T18:08:45.035 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.035 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.035 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.036 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:45.036 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:45.036 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.986568805999994, 2024-05-08T18:08:45.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031621710000000001, 2024-05-08T18:08:45.036 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:45.036 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:45.036 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:45.036 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:45.036 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:45.036 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:45.036 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 709 2024-05-08T18:08:45.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.036 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:45.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994035+0000", 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6460000000000002e-06 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994047+0000", 2024-05-08T18:08:45.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999e-05 2024-05-08T18:08:45.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994076+0000", 2024-05-08T18:08:45.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9564e-05 2024-05-08T18:08:45.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994091+0000", 2024-05-08T18:08:45.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4696e-05 2024-05-08T18:08:45.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994239+0000", 2024-05-08T18:08:45.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014779699999999999 2024-05-08T18:08:45.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994585+0000", 2024-05-08T18:08:45.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034605900000000002 2024-05-08T18:08:45.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:45.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.995084+0000", 2024-05-08T18:08:45.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049904799999999998 2024-05-08T18:08:45.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.996558+0000", 2024-05-08T18:08:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001474532 2024-05-08T18:08:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997045+0000", 2024-05-08T18:08:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048685900000000002 2024-05-08T18:08:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997127+0000", 2024-05-08T18:08:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1280999999999996e-05 2024-05-08T18:08:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997194+0000", 2024-05-08T18:08:45.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7689999999999997e-05 2024-05-08T18:08:45.041 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.041 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.041 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.041 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:45.041 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:45.041 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.951179420000003, 2024-05-08T18:08:45.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003066236, 2024-05-08T18:08:45.041 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:45.041 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:45.041 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:45.041 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:45.041 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:45.041 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:45.042 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 724 2024-05-08T18:08:45.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.042 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:45.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:45.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:45.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:45.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029424+0000", 2024-05-08T18:08:45.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.503e-06 2024-05-08T18:08:45.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029437+0000", 2024-05-08T18:08:45.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3309000000000001e-05 2024-05-08T18:08:45.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029467+0000", 2024-05-08T18:08:45.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9677999999999999e-05 2024-05-08T18:08:45.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029489+0000", 2024-05-08T18:08:45.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2314999999999999e-05 2024-05-08T18:08:45.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029600+0000", 2024-05-08T18:08:45.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110561 2024-05-08T18:08:45.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029896+0000", 2024-05-08T18:08:45.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029632200000000001 2024-05-08T18:08:45.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:45.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.030468+0000", 2024-05-08T18:08:45.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00057224700000000001 2024-05-08T18:08:45.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:45.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.031728+0000", 2024-05-08T18:08:45.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012595429999999999 2024-05-08T18:08:45.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032338+0000", 2024-05-08T18:08:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00061006700000000005 2024-05-08T18:08:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032424+0000", 2024-05-08T18:08:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032488+0000", 2024-05-08T18:08:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4210999999999999e-05 2024-05-08T18:08:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.047 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.047 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:45.047 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:45.047 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.946529006000006, 2024-05-08T18:08:45.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029269769999999999, 2024-05-08T18:08:45.047 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:45.047 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:45.047 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:45.047 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:45.047 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:45.047 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:45.047 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 726 2024-05-08T18:08:45.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.048 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:45.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:45.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:45.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:45.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034074+0000", 2024-05-08T18:08:45.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5900000000000002e-06 2024-05-08T18:08:45.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034086+0000", 2024-05-08T18:08:45.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1265e-05 2024-05-08T18:08:45.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034118+0000", 2024-05-08T18:08:45.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2341000000000001e-05 2024-05-08T18:08:45.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034133+0000", 2024-05-08T18:08:45.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5166e-05 2024-05-08T18:08:45.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034254+0000", 2024-05-08T18:08:45.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121033 2024-05-08T18:08:45.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034492+0000", 2024-05-08T18:08:45.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023727700000000001 2024-05-08T18:08:45.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:45.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034967+0000", 2024-05-08T18:08:45.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047522100000000001 2024-05-08T18:08:45.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:45.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036353+0000", 2024-05-08T18:08:45.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013865800000000001 2024-05-08T18:08:45.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:45.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036841+0000", 2024-05-08T18:08:45.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048788999999999999 2024-05-08T18:08:45.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036929+0000", 2024-05-08T18:08:45.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:08:45.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036999+0000", 2024-05-08T18:08:45.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9448000000000003e-05 2024-05-08T18:08:45.052 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.052 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.052 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.052 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:45.052 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:45.052 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.943234176000004, 2024-05-08T18:08:45.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003040662, 2024-05-08T18:08:45.053 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:45.053 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:45.053 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:45.053 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:45.053 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:45.053 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:45.053 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 727 2024-05-08T18:08:45.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.053 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:45.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:45.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:45.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:45.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037369+0000", 2024-05-08T18:08:45.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:08:45.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037378+0000", 2024-05-08T18:08:45.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5359999999999998e-06 2024-05-08T18:08:45.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037405+0000", 2024-05-08T18:08:45.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6588e-05 2024-05-08T18:08:45.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037418+0000", 2024-05-08T18:08:45.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3642000000000001e-05 2024-05-08T18:08:45.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037531+0000", 2024-05-08T18:08:45.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112304 2024-05-08T18:08:45.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037785+0000", 2024-05-08T18:08:45.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025391299999999998 2024-05-08T18:08:45.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:45.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.038112+0000", 2024-05-08T18:08:45.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000326946 2024-05-08T18:08:45.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:45.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.039316+0000", 2024-05-08T18:08:45.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012043990000000001 2024-05-08T18:08:45.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:45.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040257+0000", 2024-05-08T18:08:45.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000941083 2024-05-08T18:08:45.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040345+0000", 2024-05-08T18:08:45.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8368999999999994e-05 2024-05-08T18:08:45.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040407+0000", 2024-05-08T18:08:45.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1941999999999997e-05 2024-05-08T18:08:45.058 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.058 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.058 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.058 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:45.058 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:45.058 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.828568786999995, 2024-05-08T18:08:45.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028797779999999999, 2024-05-08T18:08:45.058 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:45.058 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:45.058 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:45.058 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:45.058 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:45.058 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:45.058 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 777 2024-05-08T18:08:45.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.059 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:45.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:45.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:45.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:45.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152034+0000", 2024-05-08T18:08:45.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2299999999999998e-06 2024-05-08T18:08:45.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152045+0000", 2024-05-08T18:08:45.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0266e-05 2024-05-08T18:08:45.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152076+0000", 2024-05-08T18:08:45.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1007000000000003e-05 2024-05-08T18:08:45.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152094+0000", 2024-05-08T18:08:45.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8148999999999999e-05 2024-05-08T18:08:45.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152183+0000", 2024-05-08T18:08:45.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8845999999999996e-05 2024-05-08T18:08:45.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152308+0000", 2024-05-08T18:08:45.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012502999999999999 2024-05-08T18:08:45.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152578+0000", 2024-05-08T18:08:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027080099999999998 2024-05-08T18:08:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154238+0000", 2024-05-08T18:08:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016600180000000001 2024-05-08T18:08:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154714+0000", 2024-05-08T18:08:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000475341 2024-05-08T18:08:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154803+0000", 2024-05-08T18:08:45.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9566000000000003e-05 2024-05-08T18:08:45.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154912+0000", 2024-05-08T18:08:45.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010852400000000001 2024-05-08T18:08:45.063 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.063 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.063 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.063 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:45.063 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:45.063 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.585352893999996, 2024-05-08T18:08:45.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002844437, 2024-05-08T18:08:45.064 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:45.064 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:45.064 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:45.064 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:45.064 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:45.064 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:45.064 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 882 2024-05-08T18:08:45.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.064 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:45.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:45.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:45.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:45.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395250+0000", 2024-05-08T18:08:45.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-06 2024-05-08T18:08:45.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395261+0000", 2024-05-08T18:08:45.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1046000000000001e-05 2024-05-08T18:08:45.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395293+0000", 2024-05-08T18:08:45.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1473999999999997e-05 2024-05-08T18:08:45.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395307+0000", 2024-05-08T18:08:45.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4599e-05 2024-05-08T18:08:45.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395481+0000", 2024-05-08T18:08:45.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173499 2024-05-08T18:08:45.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395626+0000", 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000145351 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395902+0000", 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027534499999999997 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397118+0000", 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012168929999999999 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:45.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397951+0000", 2024-05-08T18:08:45.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000832272 2024-05-08T18:08:45.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398028+0000", 2024-05-08T18:08:45.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6921000000000004e-05 2024-05-08T18:08:45.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398092+0000", 2024-05-08T18:08:45.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4783999999999995e-05 2024-05-08T18:08:45.068 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.068 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.068 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.069 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:45.069 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:45.069 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.582292174000003, 2024-05-08T18:08:45.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002853894, 2024-05-08T18:08:45.069 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:45.069 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:45.069 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:45.069 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:45.069 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:45.069 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:45.069 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 883 2024-05-08T18:08:45.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.069 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:45.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:45.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:45.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:45.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398311+0000", 2024-05-08T18:08:45.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:45.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398321+0000", 2024-05-08T18:08:45.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9189999999999994e-06 2024-05-08T18:08:45.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398346+0000", 2024-05-08T18:08:45.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5065000000000001e-05 2024-05-08T18:08:45.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398360+0000", 2024-05-08T18:08:45.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4171999999999999e-05 2024-05-08T18:08:45.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398495+0000", 2024-05-08T18:08:45.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013503199999999999 2024-05-08T18:08:45.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398716+0000", 2024-05-08T18:08:45.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220459 2024-05-08T18:08:45.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:45.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.399054+0000", 2024-05-08T18:08:45.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033806199999999998 2024-05-08T18:08:45.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:45.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.400192+0000", 2024-05-08T18:08:45.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011389169999999999 2024-05-08T18:08:45.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:45.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401020+0000", 2024-05-08T18:08:45.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082746199999999995 2024-05-08T18:08:45.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401099+0000", 2024-05-08T18:08:45.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9157000000000001e-05 2024-05-08T18:08:45.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401163+0000", 2024-05-08T18:08:45.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3498999999999996e-05 2024-05-08T18:08:45.073 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.074 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.074 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.074 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:45.074 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:45.074 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.578503337000001, 2024-05-08T18:08:45.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031354040000000001, 2024-05-08T18:08:45.074 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:45.074 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:45.074 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:45.074 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:45.074 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:45.075 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:45.075 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 885 2024-05-08T18:08:45.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.075 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:45.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:45.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:45.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:45.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402100+0000", 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.063e-06 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402110+0000", 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0453e-05 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402141+0000", 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0651000000000002e-05 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402162+0000", 2024-05-08T18:08:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1373999999999999e-05 2024-05-08T18:08:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402306+0000", 2024-05-08T18:08:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143492 2024-05-08T18:08:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402562+0000", 2024-05-08T18:08:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025671899999999998 2024-05-08T18:08:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:45.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.403047+0000", 2024-05-08T18:08:45.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048419100000000003 2024-05-08T18:08:45.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:45.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404370+0000", 2024-05-08T18:08:45.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013231580000000001 2024-05-08T18:08:45.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:45.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404966+0000", 2024-05-08T18:08:45.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00059601100000000002 2024-05-08T18:08:45.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405115+0000", 2024-05-08T18:08:45.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149665 2024-05-08T18:08:45.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405233+0000", 2024-05-08T18:08:45.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117627 2024-05-08T18:08:45.079 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.079 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.079 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.079 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:45.079 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:45.081 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.481205802000005, 2024-05-08T18:08:45.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003251168, 2024-05-08T18:08:45.081 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:45.081 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:45.081 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:45.082 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:45.082 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:45.082 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:45.082 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 927 2024-05-08T18:08:45.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.082 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:45.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:45.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:45.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:45.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499396+0000", 2024-05-08T18:08:45.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:08:45.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499404+0000", 2024-05-08T18:08:45.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2629999999999997e-06 2024-05-08T18:08:45.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499423+0000", 2024-05-08T18:08:45.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9695e-05 2024-05-08T18:08:45.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499435+0000", 2024-05-08T18:08:45.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1542999999999999e-05 2024-05-08T18:08:45.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499545+0000", 2024-05-08T18:08:45.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110064 2024-05-08T18:08:45.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499764+0000", 2024-05-08T18:08:45.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021856499999999999 2024-05-08T18:08:45.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:45.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.500237+0000", 2024-05-08T18:08:45.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047359499999999999 2024-05-08T18:08:45.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:45.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.501627+0000", 2024-05-08T18:08:45.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013897860000000001 2024-05-08T18:08:45.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:45.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502484+0000", 2024-05-08T18:08:45.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085733300000000005 2024-05-08T18:08:45.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502574+0000", 2024-05-08T18:08:45.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9939999999999996e-05 2024-05-08T18:08:45.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502646+0000", 2024-05-08T18:08:45.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2064000000000007e-05 2024-05-08T18:08:45.086 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.087 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.087 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.087 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:45.087 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:45.087 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.477706260999994, 2024-05-08T18:08:45.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031881129999999998, 2024-05-08T18:08:45.088 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:45.088 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:45.088 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:45.088 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:45.088 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:45.088 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:45.088 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 928 2024-05-08T18:08:45.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.088 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:45.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:45.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:45.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:45.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:45.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:45.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:45.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502897+0000", 2024-05-08T18:08:45.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.916e-06 2024-05-08T18:08:45.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:45.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502906+0000", 2024-05-08T18:08:45.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2699999999999993e-06 2024-05-08T18:08:45.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:45.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502933+0000", 2024-05-08T18:08:45.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6823999999999999e-05 2024-05-08T18:08:45.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:45.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502946+0000", 2024-05-08T18:08:45.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3439e-05 2024-05-08T18:08:45.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:45.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503066+0000", 2024-05-08T18:08:45.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012013700000000001 2024-05-08T18:08:45.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:45.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503399+0000", 2024-05-08T18:08:45.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033298600000000001 2024-05-08T18:08:45.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:45.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503928+0000", 2024-05-08T18:08:45.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052877299999999996 2024-05-08T18:08:45.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:45.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505291+0000", 2024-05-08T18:08:45.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001363319 2024-05-08T18:08:45.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:45.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505933+0000", 2024-05-08T18:08:45.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064135799999999997 2024-05-08T18:08:45.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:45.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506019+0000", 2024-05-08T18:08:45.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6649000000000003e-05 2024-05-08T18:08:45.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:45.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:45.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:45.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506083+0000", 2024-05-08T18:08:45.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3441999999999993e-05 2024-05-08T18:08:45.092 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.092 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.092 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.093 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:45.093 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:45.093 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:45.093 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:45.094 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:45.094 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:45.095 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:45.095 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:08:45.096 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:45.096 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:45.096 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:45.096+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:45.110 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:45.110 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:45.143 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:45.143 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:45.174 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:45.174 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:45.194 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:45.196+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:45.206 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:45.207 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:45.239 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:45.239 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:45.262 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:45.262 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:45.275 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:08:45.302 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:45.304+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:45.396 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:45.396 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:45.397 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:45.396+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:45.410 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:08:45.497 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:45.497+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:45.528 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:45.528 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:45.543 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:08:45.632 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:45.633+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:45.699 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:45.700+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:45.703 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:45.703 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:45.718 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:08:45.808 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:45.809+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:45.886 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:45.887 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:45.900 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:08:45.902 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:45.900+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:46.003 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:46.004+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:46.065 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:46.065 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:46.079 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:08:46.128 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:46.129+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:46.198 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:46.198 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:46.205 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:46.205+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:46.213 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:08:46.307 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:46.305+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:46.375 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:46.375 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:46.390 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:08:46.407 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:46.408+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:46.508 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:46.508+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:46.557 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:46.557 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:46.571 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:08:46.610 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:46.609+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:46.711 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:46.709+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:46.741 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:46.741 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:46.760 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:08:46.811 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:46.809+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:46.912 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:46.912+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:46.929 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:46.929 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:46.950 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:08:46.958 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:08:47.013 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:47.013+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:47.114 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:47.116+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:47.166 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:47.166 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:47.184 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:08:47.230 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:47.232+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:47.261 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:08:47.317 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:47.317+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:47.401 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:47.401 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:47.418 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:47.417+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:47.419 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:08:47.471 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:47.471 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:47.502 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:47.502 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:47.519 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:47.520+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:47.519 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:47.519 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:47.538 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:47.538 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:47.559 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:47.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:47.579 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:47.579 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:47.592 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:47.592 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:47.593 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:47.593 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:47.593 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:47.599 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:47.599 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:47.610 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:08:47.619 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:47.620 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:47.620 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:47.621+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:47.721 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:47.721+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:47.730 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:47.730 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:47.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:47.730 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:47.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.731 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:47.731 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:47.731 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 84.164408813999998, 2024-05-08T18:08:47.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035750999999999999, 2024-05-08T18:08:47.731 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.731 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.731 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.733 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:47.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:47.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570203+0000", 2024-05-08T18:08:47.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6749999999999996e-06 2024-05-08T18:08:47.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570213+0000", 2024-05-08T18:08:47.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0139999999999999e-05 2024-05-08T18:08:47.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570231+0000", 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8402000000000001e-05 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570245+0000", 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3135e-05 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570338+0000", 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3498000000000005e-05 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570373+0000", 2024-05-08T18:08:47.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5179999999999999e-05 2024-05-08T18:08:47.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573694+0000", 2024-05-08T18:08:47.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003320524 2024-05-08T18:08:47.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573771+0000", 2024-05-08T18:08:47.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7546000000000006e-05 2024-05-08T18:08:47.736 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.736 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.736 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 84.159095851999993, 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038280229999999998, 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:47.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575510+0000", 2024-05-08T18:08:47.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0979999999999999e-06 2024-05-08T18:08:47.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575527+0000", 2024-05-08T18:08:47.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6393999999999999e-05 2024-05-08T18:08:47.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575549+0000", 2024-05-08T18:08:47.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1843000000000001e-05 2024-05-08T18:08:47.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575560+0000", 2024-05-08T18:08:47.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.186e-05 2024-05-08T18:08:47.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575651+0000", 2024-05-08T18:08:47.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1068000000000003e-05 2024-05-08T18:08:47.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575685+0000", 2024-05-08T18:08:47.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3614e-05 2024-05-08T18:08:47.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579231+0000", 2024-05-08T18:08:47.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003546249 2024-05-08T18:08:47.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579337+0000", 2024-05-08T18:08:47.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010589700000000001 2024-05-08T18:08:47.740 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.740 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.740 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.740 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-05-08T18:08:47.741 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:47.741 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 84.157058560999999, 2024-05-08T18:08:47.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004223157, 2024-05-08T18:08:47.741 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.741 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.741 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.741 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:47.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:47.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577548+0000", 2024-05-08T18:08:47.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.66e-06 2024-05-08T18:08:47.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577561+0000", 2024-05-08T18:08:47.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2533e-05 2024-05-08T18:08:47.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577585+0000", 2024-05-08T18:08:47.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3873e-05 2024-05-08T18:08:47.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577605+0000", 2024-05-08T18:08:47.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0477000000000001e-05 2024-05-08T18:08:47.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577717+0000", 2024-05-08T18:08:47.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011229499999999999 2024-05-08T18:08:47.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577777+0000", 2024-05-08T18:08:47.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.944e-05 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581704+0000", 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039267800000000004 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581770+0000", 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6099000000000005e-05 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:54 7.d e29/28 7:b4812045:::notify.4:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:47.744 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:47.745 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 84.154245837000005, 2024-05-08T18:08:47.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003988503, 2024-05-08T18:08:47.745 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.745 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.745 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.745 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:47.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:47.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580368+0000", 2024-05-08T18:08:47.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3089999999999996e-06 2024-05-08T18:08:47.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580400+0000", 2024-05-08T18:08:47.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2580000000000003e-05 2024-05-08T18:08:47.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580427+0000", 2024-05-08T18:08:47.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6976999999999999e-05 2024-05-08T18:08:47.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580443+0000", 2024-05-08T18:08:47.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5585000000000001e-05 2024-05-08T18:08:47.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580555+0000", 2024-05-08T18:08:47.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112639 2024-05-08T18:08:47.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580601+0000", 2024-05-08T18:08:47.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6e-05 2024-05-08T18:08:47.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584229+0000", 2024-05-08T18:08:47.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036273659999999999 2024-05-08T18:08:47.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584348+0000", 2024-05-08T18:08:47.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119047 2024-05-08T18:08:47.748 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.748 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.748 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.748 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:47.748 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:47.749 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 84.044832567, 2024-05-08T18:08:47.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032136159999999999, 2024-05-08T18:08:47.749 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.749 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.749 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.749 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:47.749 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:47.749 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:47.749 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 193 2024-05-08T18:08:47.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.749 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:47.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:47.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689775+0000", 2024-05-08T18:08:47.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.357e-06 2024-05-08T18:08:47.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689788+0000", 2024-05-08T18:08:47.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3029e-05 2024-05-08T18:08:47.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689819+0000", 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.065e-05 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689833+0000", 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4790000000000001e-05 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689948+0000", 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115089 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690155+0000", 2024-05-08T18:08:47.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206932 2024-05-08T18:08:47.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:47.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690420+0000", 2024-05-08T18:08:47.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026450200000000001 2024-05-08T18:08:47.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:47.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692229+0000", 2024-05-08T18:08:47.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001808823 2024-05-08T18:08:47.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:47.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692816+0000", 2024-05-08T18:08:47.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058773199999999999 2024-05-08T18:08:47.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692915+0000", 2024-05-08T18:08:47.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8646000000000004e-05 2024-05-08T18:08:47.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692986+0000", 2024-05-08T18:08:47.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1066e-05 2024-05-08T18:08:47.753 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.753 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.753 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.754 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:47.754 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:47.754 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.145866347999998, 2024-05-08T18:08:47.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089431319999999995, 2024-05-08T18:08:47.754 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.754 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.754 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:47.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:47.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:47.754 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 208 2024-05-08T18:08:47.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.754 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:47.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:47.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588741+0000", 2024-05-08T18:08:47.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:08:47.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588752+0000", 2024-05-08T18:08:47.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0813e-05 2024-05-08T18:08:47.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588782+0000", 2024-05-08T18:08:47.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0020000000000001e-05 2024-05-08T18:08:47.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588803+0000", 2024-05-08T18:08:47.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1115999999999999e-05 2024-05-08T18:08:47.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588943+0000", 2024-05-08T18:08:47.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013971599999999999 2024-05-08T18:08:47.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:08:47.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588954+0000", 2024-05-08T18:08:47.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1365999999999999e-05 2024-05-08T18:08:47.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594340+0000", 2024-05-08T18:08:47.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053854910000000001 2024-05-08T18:08:47.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594670+0000", 2024-05-08T18:08:47.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000330055 2024-05-08T18:08:47.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:47.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.595179+0000", 2024-05-08T18:08:47.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050879199999999999 2024-05-08T18:08:47.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:47.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.596408+0000", 2024-05-08T18:08:47.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012295209999999999 2024-05-08T18:08:47.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:47.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597532+0000", 2024-05-08T18:08:47.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011233860000000001 2024-05-08T18:08:47.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597619+0000", 2024-05-08T18:08:47.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7775999999999994e-05 2024-05-08T18:08:47.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597682+0000", 2024-05-08T18:08:47.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2522999999999998e-05 2024-05-08T18:08:47.760 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.760 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.760 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.760 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:47.760 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:47.760 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.117237368999994, 2024-05-08T18:08:47.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031262669999999998, 2024-05-08T18:08:47.760 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.760 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.760 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.761 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:47.761 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:47.761 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:47.761 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 212 2024-05-08T18:08:47.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.761 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:47.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:47.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617370+0000", 2024-05-08T18:08:47.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:08:47.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617379+0000", 2024-05-08T18:08:47.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2359999999999993e-06 2024-05-08T18:08:47.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617405+0000", 2024-05-08T18:08:47.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5639999999999998e-05 2024-05-08T18:08:47.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617425+0000", 2024-05-08T18:08:47.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0457000000000001e-05 2024-05-08T18:08:47.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617573+0000", 2024-05-08T18:08:47.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014776200000000001 2024-05-08T18:08:47.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617786+0000", 2024-05-08T18:08:47.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212418 2024-05-08T18:08:47.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:47.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.618177+0000", 2024-05-08T18:08:47.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039161699999999997 2024-05-08T18:08:47.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:47.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.619563+0000", 2024-05-08T18:08:47.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013852999999999999 2024-05-08T18:08:47.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:47.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620334+0000", 2024-05-08T18:08:47.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00077182200000000002 2024-05-08T18:08:47.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620426+0000", 2024-05-08T18:08:47.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1526000000000004e-05 2024-05-08T18:08:47.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620494+0000", 2024-05-08T18:08:47.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8078999999999997e-05 2024-05-08T18:08:47.765 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.765 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.765 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.765 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:47.766 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:47.766 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.092918815999994, 2024-05-08T18:08:47.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035230880000000002, 2024-05-08T18:08:47.766 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.766 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.766 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.766 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:47.766 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:47.766 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:47.766 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 219 2024-05-08T18:08:47.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.766 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:47.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:47.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641689+0000", 2024-05-08T18:08:47.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:08:47.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641700+0000", 2024-05-08T18:08:47.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1507e-05 2024-05-08T18:08:47.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641732+0000", 2024-05-08T18:08:47.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1585999999999999e-05 2024-05-08T18:08:47.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641754+0000", 2024-05-08T18:08:47.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1480000000000001e-05 2024-05-08T18:08:47.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641942+0000", 2024-05-08T18:08:47.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018826300000000001 2024-05-08T18:08:47.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642165+0000", 2024-05-08T18:08:47.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022301100000000001 2024-05-08T18:08:47.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:47.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642587+0000", 2024-05-08T18:08:47.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042182400000000001 2024-05-08T18:08:47.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:47.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.643767+0000", 2024-05-08T18:08:47.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001180675 2024-05-08T18:08:47.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:47.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645010+0000", 2024-05-08T18:08:47.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012427110000000001 2024-05-08T18:08:47.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645101+0000", 2024-05-08T18:08:47.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0871999999999993e-05 2024-05-08T18:08:47.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645209+0000", 2024-05-08T18:08:47.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108496 2024-05-08T18:08:47.771 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.771 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.771 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.771 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:47.771 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:47.771 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.073121829000002, 2024-05-08T18:08:47.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035793639999999998, 2024-05-08T18:08:47.771 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.771 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.771 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.771 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:47.772 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:47.772 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:47.772 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 224 2024-05-08T18:08:47.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.772 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:47.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:47.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661485+0000", 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9759999999999998e-06 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661494+0000", 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3469999999999999e-06 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661517+0000", 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.389e-05 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661537+0000", 2024-05-08T18:08:47.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9803e-05 2024-05-08T18:08:47.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661696+0000", 2024-05-08T18:08:47.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015865899999999999 2024-05-08T18:08:47.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661910+0000", 2024-05-08T18:08:47.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021434199999999999 2024-05-08T18:08:47.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:47.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.662336+0000", 2024-05-08T18:08:47.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042575300000000001 2024-05-08T18:08:47.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:47.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.663720+0000", 2024-05-08T18:08:47.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013843799999999999 2024-05-08T18:08:47.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:47.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.664909+0000", 2024-05-08T18:08:47.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011889019999999999 2024-05-08T18:08:47.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665001+0000", 2024-05-08T18:08:47.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1649000000000003e-05 2024-05-08T18:08:47.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665063+0000", 2024-05-08T18:08:47.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1662999999999996e-05 2024-05-08T18:08:47.776 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.776 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.776 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.776 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:47.776 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:47.776 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.040528554999995, 2024-05-08T18:08:47.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031551930000000001, 2024-05-08T18:08:47.776 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.777 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.777 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.777 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:47.777 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:47.777 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:47.777 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 233 2024-05-08T18:08:47.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.777 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:47.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:47.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694079+0000", 2024-05-08T18:08:47.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:47.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694090+0000", 2024-05-08T18:08:47.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1182999999999999e-05 2024-05-08T18:08:47.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694119+0000", 2024-05-08T18:08:47.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9076000000000001e-05 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694143+0000", 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4363e-05 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694291+0000", 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147849 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694534+0000", 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000242382 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:47.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694957+0000", 2024-05-08T18:08:47.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042316700000000001 2024-05-08T18:08:47.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:47.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.696306+0000", 2024-05-08T18:08:47.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013489940000000001 2024-05-08T18:08:47.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:47.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697071+0000", 2024-05-08T18:08:47.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076482999999999998 2024-05-08T18:08:47.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697167+0000", 2024-05-08T18:08:47.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6773000000000003e-05 2024-05-08T18:08:47.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697232+0000", 2024-05-08T18:08:47.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4386000000000003e-05 2024-05-08T18:08:47.781 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.781 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.781 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.781 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:328 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:47.781 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:47.781 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.008809967999994, 2024-05-08T18:08:47.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029659439999999999, 2024-05-08T18:08:47.782 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.782 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.782 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.782 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:47.782 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:47.782 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:47.782 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 328 2024-05-08T18:08:47.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.782 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:47.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725796+0000", 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-06 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725802+0000", 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7219999999999996e-06 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725816+0000", 2024-05-08T18:08:47.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3886999999999999e-05 2024-05-08T18:08:47.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725824+0000", 2024-05-08T18:08:47.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5920000000000003e-06 2024-05-08T18:08:47.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725885+0000", 2024-05-08T18:08:47.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1526999999999996e-05 2024-05-08T18:08:47.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725972+0000", 2024-05-08T18:08:47.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7099000000000001e-05 2024-05-08T18:08:47.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:47.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726093+0000", 2024-05-08T18:08:47.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120383 2024-05-08T18:08:47.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:47.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726717+0000", 2024-05-08T18:08:47.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062435099999999999 2024-05-08T18:08:47.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:47.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728693+0000", 2024-05-08T18:08:47.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019758309999999999 2024-05-08T18:08:47.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728731+0000", 2024-05-08T18:08:47.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8591999999999999e-05 2024-05-08T18:08:47.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728761+0000", 2024-05-08T18:08:47.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9770000000000001e-05 2024-05-08T18:08:47.786 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.787 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.787 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.787 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:460 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:47.787 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:47.787 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.954992743999995, 2024-05-08T18:08:47.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040209540000000002, 2024-05-08T18:08:47.787 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.787 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.787 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.787 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:47.787 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:47.787 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:47.787 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 460 2024-05-08T18:08:47.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.788 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:47.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:47.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779613+0000", 2024-05-08T18:08:47.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779619+0000", 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3630000000000002e-06 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779631+0000", 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2211e-05 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779637+0000", 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0430000000000004e-06 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779702+0000", 2024-05-08T18:08:47.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4481999999999997e-05 2024-05-08T18:08:47.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779848+0000", 2024-05-08T18:08:47.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014608500000000001 2024-05-08T18:08:47.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:47.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780056+0000", 2024-05-08T18:08:47.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020889699999999999 2024-05-08T18:08:47.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:47.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780700+0000", 2024-05-08T18:08:47.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064379300000000003 2024-05-08T18:08:47.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:47.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783576+0000", 2024-05-08T18:08:47.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028754919999999999 2024-05-08T18:08:47.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783608+0000", 2024-05-08T18:08:47.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2223e-05 2024-05-08T18:08:47.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5296e-05 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:466 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.950454506, 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028979520000000001, 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:47.792 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:47.793 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 466 2024-05-08T18:08:47.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.793 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:47.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:47.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:47.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.61e-07 2024-05-08T18:08:47.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784155+0000", 2024-05-08T18:08:47.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9299999999999996e-06 2024-05-08T18:08:47.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784165+0000", 2024-05-08T18:08:47.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5680000000000005e-06 2024-05-08T18:08:47.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784170+0000", 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1379999999999998e-06 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784219+0000", 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9231999999999999e-05 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784310+0000", 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0797000000000005e-05 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784490+0000", 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179705 2024-05-08T18:08:47.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:47.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.785090+0000", 2024-05-08T18:08:47.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060073899999999998 2024-05-08T18:08:47.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:47.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.786973+0000", 2024-05-08T18:08:47.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018824460000000001 2024-05-08T18:08:47.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787007+0000", 2024-05-08T18:08:47.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3779999999999998e-05 2024-05-08T18:08:47.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787049+0000", 2024-05-08T18:08:47.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1856e-05 2024-05-08T18:08:47.797 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.797 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.797 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.797 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:477 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:47.797 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:47.797 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.943312512000006, 2024-05-08T18:08:47.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046076989999999998, 2024-05-08T18:08:47.797 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.797 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.797 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.798 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:47.798 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:47.798 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:47.798 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 477 2024-05-08T18:08:47.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.798 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:47.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:47.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791294+0000", 2024-05-08T18:08:47.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-06 2024-05-08T18:08:47.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791300+0000", 2024-05-08T18:08:47.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5320000000000003e-06 2024-05-08T18:08:47.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791313+0000", 2024-05-08T18:08:47.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2576e-05 2024-05-08T18:08:47.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791319+0000", 2024-05-08T18:08:47.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1720000000000004e-06 2024-05-08T18:08:47.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791379+0000", 2024-05-08T18:08:47.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0343000000000001e-05 2024-05-08T18:08:47.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791477+0000", 2024-05-08T18:08:47.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7662000000000001e-05 2024-05-08T18:08:47.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:47.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791678+0000", 2024-05-08T18:08:47.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000200788 2024-05-08T18:08:47.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:47.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.792263+0000", 2024-05-08T18:08:47.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058525700000000005 2024-05-08T18:08:47.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:47.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795842+0000", 2024-05-08T18:08:47.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035787079999999999 2024-05-08T18:08:47.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795874+0000", 2024-05-08T18:08:47.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2205000000000001e-05 2024-05-08T18:08:47.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795900+0000", 2024-05-08T18:08:47.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6222000000000001e-05 2024-05-08T18:08:47.802 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.802 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.802 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.802 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:642 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:47.802 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:47.802 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.804552809, 2024-05-08T18:08:47.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030444059999999999, 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 642 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:47.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930055+0000", 2024-05-08T18:08:47.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7999999999999999e-06 2024-05-08T18:08:47.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930065+0000", 2024-05-08T18:08:47.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0176999999999999e-05 2024-05-08T18:08:47.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930092+0000", 2024-05-08T18:08:47.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6460000000000001e-05 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930112+0000", 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0043000000000001e-05 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930219+0000", 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010698500000000001 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930345+0000", 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012620400000000001 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:47.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930579+0000", 2024-05-08T18:08:47.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234145 2024-05-08T18:08:47.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:47.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.931471+0000", 2024-05-08T18:08:47.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00089161500000000001 2024-05-08T18:08:47.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:47.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.932978+0000", 2024-05-08T18:08:47.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001507296 2024-05-08T18:08:47.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933044+0000", 2024-05-08T18:08:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6402000000000006e-05 2024-05-08T18:08:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933097+0000", 2024-05-08T18:08:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2278999999999999e-05 2024-05-08T18:08:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:681 6.e e32/26 6:748722ff:gc::gc.6:head v 32'7, mlcod=32'5)", 2024-05-08T18:08:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:47.807 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.773757231999994, 2024-05-08T18:08:47.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003318185, 2024-05-08T18:08:47.808 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.808 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.808 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.808 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:47.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:47.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960849+0000", 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.423e-06 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960859+0000", 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3170000000000008e-06 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960874+0000", 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5125e-05 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960884+0000", 2024-05-08T18:08:47.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8120000000000002e-06 2024-05-08T18:08:47.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960972+0000", 2024-05-08T18:08:47.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8540000000000003e-05 2024-05-08T18:08:47.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960996+0000", 2024-05-08T18:08:47.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3479999999999999e-05 2024-05-08T18:08:47.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964110+0000", 2024-05-08T18:08:47.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031142729999999999 2024-05-08T18:08:47.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964166+0000", 2024-05-08T18:08:47.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6215000000000003e-05 2024-05-08T18:08:47.811 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.811 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.811 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.811 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:47.811 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:47.811 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.682721137000001, 2024-05-08T18:08:47.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030648379999999999, 2024-05-08T18:08:47.811 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.812 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.812 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.812 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:47.812 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:47.812 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:47.812 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 733 2024-05-08T18:08:47.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.812 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:47.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:47.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051887+0000", 2024-05-08T18:08:47.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.74e-06 2024-05-08T18:08:47.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051900+0000", 2024-05-08T18:08:47.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3113e-05 2024-05-08T18:08:47.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051931+0000", 2024-05-08T18:08:47.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1665999999999998e-05 2024-05-08T18:08:47.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051946+0000", 2024-05-08T18:08:47.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4780000000000001e-05 2024-05-08T18:08:47.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052078+0000", 2024-05-08T18:08:47.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013133200000000001 2024-05-08T18:08:47.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052338+0000", 2024-05-08T18:08:47.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026056899999999999 2024-05-08T18:08:47.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:47.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052652+0000", 2024-05-08T18:08:47.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031396700000000001 2024-05-08T18:08:47.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:47.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.053668+0000", 2024-05-08T18:08:47.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00101574 2024-05-08T18:08:47.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:47.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054800+0000", 2024-05-08T18:08:47.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011319819999999999 2024-05-08T18:08:47.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054884+0000", 2024-05-08T18:08:47.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4005999999999995e-05 2024-05-08T18:08:47.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054949+0000", 2024-05-08T18:08:47.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4943000000000005e-05 2024-05-08T18:08:47.816 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.816 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.816 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.817 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:47.817 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:47.817 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.678866502000005, 2024-05-08T18:08:47.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029745919999999999, 2024-05-08T18:08:47.817 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.817 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.817 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.817 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:47.817 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:47.817 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:47.817 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 735 2024-05-08T18:08:47.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.817 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:47.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:47.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055741+0000", 2024-05-08T18:08:47.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.984e-06 2024-05-08T18:08:47.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055766+0000", 2024-05-08T18:08:47.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5253e-05 2024-05-08T18:08:47.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055785+0000", 2024-05-08T18:08:47.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9559999999999999e-05 2024-05-08T18:08:47.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055798+0000", 2024-05-08T18:08:47.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-05 2024-05-08T18:08:47.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055932+0000", 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134609 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056184+0000", 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025167800000000003 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056680+0000", 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049576299999999998 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058060+0000", 2024-05-08T18:08:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013801 2024-05-08T18:08:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058447+0000", 2024-05-08T18:08:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038695299999999999 2024-05-08T18:08:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058601+0000", 2024-05-08T18:08:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015396299999999999 2024-05-08T18:08:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058713+0000", 2024-05-08T18:08:47.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112389 2024-05-08T18:08:47.822 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.822 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.822 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.822 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:47.822 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:47.822 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.571851151999994, 2024-05-08T18:08:47.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029913650000000002, 2024-05-08T18:08:47.822 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.822 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.822 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.822 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:47.823 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:47.823 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:47.823 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 781 2024-05-08T18:08:47.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.823 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:47.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:47.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162757+0000", 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162770+0000", 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3406e-05 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162799+0000", 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-05 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162813+0000", 2024-05-08T18:08:47.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:08:47.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162942+0000", 2024-05-08T18:08:47.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012902200000000001 2024-05-08T18:08:47.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163159+0000", 2024-05-08T18:08:47.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021738500000000001 2024-05-08T18:08:47.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:47.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163476+0000", 2024-05-08T18:08:47.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031666499999999999 2024-05-08T18:08:47.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:47.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.164533+0000", 2024-05-08T18:08:47.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010574219999999999 2024-05-08T18:08:47.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:47.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165587+0000", 2024-05-08T18:08:47.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001053476 2024-05-08T18:08:47.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165674+0000", 2024-05-08T18:08:47.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6725999999999996e-05 2024-05-08T18:08:47.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165745+0000", 2024-05-08T18:08:47.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1779000000000005e-05 2024-05-08T18:08:47.827 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.827 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.827 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.827 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:47.827 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:47.827 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.189261303999999, 2024-05-08T18:08:47.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029834750000000002, 2024-05-08T18:08:47.828 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:47.828 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:47.828 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:47.828 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:47.828 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:47.828 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:47.828 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 946 2024-05-08T18:08:47.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.828 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:47.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:47.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:47.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:47.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:47.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:47.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:47.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545346+0000", 2024-05-08T18:08:47.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6570000000000001e-06 2024-05-08T18:08:47.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:47.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545357+0000", 2024-05-08T18:08:47.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0740000000000001e-05 2024-05-08T18:08:47.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:47.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545384+0000", 2024-05-08T18:08:47.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6780000000000001e-05 2024-05-08T18:08:47.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:47.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545398+0000", 2024-05-08T18:08:47.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3936e-05 2024-05-08T18:08:47.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:47.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545515+0000", 2024-05-08T18:08:47.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117413 2024-05-08T18:08:47.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:47.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545751+0000", 2024-05-08T18:08:47.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023559500000000001 2024-05-08T18:08:47.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:47.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.546075+0000", 2024-05-08T18:08:47.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000324357 2024-05-08T18:08:47.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:47.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.547104+0000", 2024-05-08T18:08:47.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010285959999999999 2024-05-08T18:08:47.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:47.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548141+0000", 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001036922 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548223+0000", 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2260000000000002e-05 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548327+0000", 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104219 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:47.832 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:47.834 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:08:47.834 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:47.833+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:47.935 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:47.933+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:47.963 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-05-08T18:08:48.004 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:48.004 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:48.004 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:48.024 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:08:48.036 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:48.037+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:48.137 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:48.137+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:48.234 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:48.235 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:48.235 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:48.235 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:48.235 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:48.237 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:48.237+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:48.253 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:08:48.337 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:48.336+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:48.424 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:48.424 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 84.850471212000002, 2024-05-08T18:08:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002466088, 2024-05-08T18:08:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 52 2024-05-08T18:08:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577062+0000", 2024-05-08T18:08:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.994e-06 2024-05-08T18:08:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577075+0000", 2024-05-08T18:08:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2480000000000001e-05 2024-05-08T18:08:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577108+0000", 2024-05-08T18:08:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3096000000000003e-05 2024-05-08T18:08:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577131+0000", 2024-05-08T18:08:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2993000000000002e-05 2024-05-08T18:08:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577260+0000", 2024-05-08T18:08:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012912899999999999 2024-05-08T18:08:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577453+0000", 2024-05-08T18:08:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000193668 2024-05-08T18:08:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577634+0000", 2024-05-08T18:08:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180576 2024-05-08T18:08:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579082+0000", 2024-05-08T18:08:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001448083 2024-05-08T18:08:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579290+0000", 2024-05-08T18:08:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000208333 2024-05-08T18:08:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579403+0000", 2024-05-08T18:08:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011296800000000001 2024-05-08T18:08:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579525+0000", 2024-05-08T18:08:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121768 2024-05-08T18:08:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 84.838611447000005, 2024-05-08T18:08:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038858310000000002, 2024-05-08T18:08:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.430 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588920+0000", 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.23e-07 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588929+0000", 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3659999999999998e-06 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588948+0000", 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8768000000000001e-05 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588962+0000", 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4e-05 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589110+0000", 2024-05-08T18:08:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148047 2024-05-08T18:08:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589173+0000", 2024-05-08T18:08:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2766000000000002e-05 2024-05-08T18:08:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592728+0000", 2024-05-08T18:08:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035553300000000002 2024-05-08T18:08:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592805+0000", 2024-05-08T18:08:48.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6730999999999994e-05 2024-05-08T18:08:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.722542548999996, 2024-05-08T18:08:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034354310000000001, 2024-05-08T18:08:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.434 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 236 2024-05-08T18:08:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704991+0000", 2024-05-08T18:08:48.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1240000000000001e-06 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705009+0000", 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7819e-05 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705048+0000", 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9632999999999998e-05 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705073+0000", 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4686999999999999e-05 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705241+0000", 2024-05-08T18:08:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759899999999999 2024-05-08T18:08:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705511+0000", 2024-05-08T18:08:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027018799999999998 2024-05-08T18:08:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705965+0000", 2024-05-08T18:08:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045433000000000002 2024-05-08T18:08:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.707487+0000", 2024-05-08T18:08:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015214810000000001 2024-05-08T18:08:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708125+0000", 2024-05-08T18:08:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063870300000000001 2024-05-08T18:08:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708298+0000", 2024-05-08T18:08:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172592 2024-05-08T18:08:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708423+0000", 2024-05-08T18:08:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125275 2024-05-08T18:08:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:308 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.705704647000005, 2024-05-08T18:08:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038707400000000001, 2024-05-08T18:08:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.439 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 308 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721827+0000", 2024-05-08T18:08:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1519999999999999e-06 2024-05-08T18:08:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721840+0000", 2024-05-08T18:08:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.362e-05 2024-05-08T18:08:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721857+0000", 2024-05-08T18:08:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6901e-05 2024-05-08T18:08:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721867+0000", 2024-05-08T18:08:48.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0034000000000001e-05 2024-05-08T18:08:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721922+0000", 2024-05-08T18:08:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4450999999999998e-05 2024-05-08T18:08:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721981+0000", 2024-05-08T18:08:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9267e-05 2024-05-08T18:08:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722103+0000", 2024-05-08T18:08:48.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121502 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722757+0000", 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065419700000000003 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725619+0000", 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002862107 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725654+0000", 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725696+0000", 2024-05-08T18:08:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:08:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:604 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.528421941000005, 2024-05-08T18:08:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002741884, 2024-05-08T18:08:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.444 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 604 2024-05-08T18:08:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899111+0000", 2024-05-08T18:08:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0910000000000001e-06 2024-05-08T18:08:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899126+0000", 2024-05-08T18:08:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:08:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899159+0000", 2024-05-08T18:08:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3241999999999998e-05 2024-05-08T18:08:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899174+0000", 2024-05-08T18:08:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5235000000000001e-05 2024-05-08T18:08:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899316+0000", 2024-05-08T18:08:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014175599999999999 2024-05-08T18:08:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899525+0000", 2024-05-08T18:08:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020915300000000001 2024-05-08T18:08:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899872+0000", 2024-05-08T18:08:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034668299999999997 2024-05-08T18:08:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901064+0000", 2024-05-08T18:08:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001191473 2024-05-08T18:08:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901664+0000", 2024-05-08T18:08:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060054599999999998 2024-05-08T18:08:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901779+0000", 2024-05-08T18:08:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011452500000000001 2024-05-08T18:08:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901850+0000", 2024-05-08T18:08:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1580000000000002e-05 2024-05-08T18:08:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:612 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.522913377999998, 2024-05-08T18:08:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025904750000000001, 2024-05-08T18:08:48.449 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 612 2024-05-08T18:08:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904619+0000", 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8479999999999999e-06 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904628+0000", 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8829999999999995e-06 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904650+0000", 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2467999999999999e-05 2024-05-08T18:08:48.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904669+0000", 2024-05-08T18:08:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9303000000000001e-05 2024-05-08T18:08:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904766+0000", 2024-05-08T18:08:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6917999999999996e-05 2024-05-08T18:08:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904935+0000", 2024-05-08T18:08:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000168441 2024-05-08T18:08:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.905288+0000", 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035312199999999998 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.906520+0000", 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001232005 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907086+0000", 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056658900000000005 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907154+0000", 2024-05-08T18:08:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7197000000000001e-05 2024-05-08T18:08:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907207+0000", 2024-05-08T18:08:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3701e-05 2024-05-08T18:08:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.354895784999997, 2024-05-08T18:08:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032464490000000002, 2024-05-08T18:08:48.454 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 742 2024-05-08T18:08:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072637+0000", 2024-05-08T18:08:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9059999999999998e-06 2024-05-08T18:08:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072651+0000", 2024-05-08T18:08:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3477e-05 2024-05-08T18:08:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072683+0000", 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2116000000000002e-05 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072698+0000", 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5454000000000001e-05 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072845+0000", 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146532 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073241+0000", 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039580699999999997 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073812+0000", 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057164900000000003 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075063+0000", 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001250131 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075723+0000", 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00066039199999999999 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075808+0000", 2024-05-08T18:08:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5458999999999996e-05 2024-05-08T18:08:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075881+0000", 2024-05-08T18:08:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2526000000000003e-05 2024-05-08T18:08:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.459 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.312487419999997, 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029270590000000001, 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 760 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115045+0000", 2024-05-08T18:08:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0729999999999999e-06 2024-05-08T18:08:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115057+0000", 2024-05-08T18:08:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1617000000000001e-05 2024-05-08T18:08:48.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115088+0000", 2024-05-08T18:08:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1155999999999998e-05 2024-05-08T18:08:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115103+0000", 2024-05-08T18:08:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5067e-05 2024-05-08T18:08:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115289+0000", 2024-05-08T18:08:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186582 2024-05-08T18:08:48.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115506+0000", 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021690500000000001 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115832+0000", 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032556799999999998 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.116892+0000", 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010597989999999999 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117807+0000", 2024-05-08T18:08:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091502599999999999 2024-05-08T18:08:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117895+0000", 2024-05-08T18:08:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7977000000000001e-05 2024-05-08T18:08:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117970+0000", 2024-05-08T18:08:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5289000000000004e-05 2024-05-08T18:08:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.464 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.181489933999998, 2024-05-08T18:08:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028290730000000001, 2024-05-08T18:08:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 817 2024-05-08T18:08:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.465 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246043+0000", 2024-05-08T18:08:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.807e-06 2024-05-08T18:08:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246056+0000", 2024-05-08T18:08:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2383e-05 2024-05-08T18:08:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246087+0000", 2024-05-08T18:08:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1937000000000003e-05 2024-05-08T18:08:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246104+0000", 2024-05-08T18:08:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6643e-05 2024-05-08T18:08:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246225+0000", 2024-05-08T18:08:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012061900000000001 2024-05-08T18:08:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246510+0000", 2024-05-08T18:08:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028507100000000002 2024-05-08T18:08:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246881+0000", 2024-05-08T18:08:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037163799999999998 2024-05-08T18:08:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248078+0000", 2024-05-08T18:08:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011968969999999999 2024-05-08T18:08:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248715+0000", 2024-05-08T18:08:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063698599999999998 2024-05-08T18:08:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248801+0000", 2024-05-08T18:08:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5772999999999993e-05 2024-05-08T18:08:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248869+0000", 2024-05-08T18:08:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8318999999999994e-05 2024-05-08T18:08:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.127746450000004, 2024-05-08T18:08:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003281693, 2024-05-08T18:08:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.470 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 841 2024-05-08T18:08:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299786+0000", 2024-05-08T18:08:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4770000000000002e-06 2024-05-08T18:08:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299798+0000", 2024-05-08T18:08:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1493e-05 2024-05-08T18:08:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299827+0000", 2024-05-08T18:08:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9363e-05 2024-05-08T18:08:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299842+0000", 2024-05-08T18:08:48.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.448e-05 2024-05-08T18:08:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300001+0000", 2024-05-08T18:08:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015909600000000001 2024-05-08T18:08:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300384+0000", 2024-05-08T18:08:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038306000000000001 2024-05-08T18:08:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:48.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300929+0000", 2024-05-08T18:08:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054551299999999997 2024-05-08T18:08:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302151+0000", 2024-05-08T18:08:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012218540000000001 2024-05-08T18:08:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302918+0000", 2024-05-08T18:08:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076719099999999997 2024-05-08T18:08:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303000+0000", 2024-05-08T18:08:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1662999999999994e-05 2024-05-08T18:08:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303065+0000", 2024-05-08T18:08:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5502999999999999e-05 2024-05-08T18:08:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.123550993999999, 2024-05-08T18:08:48.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026179150000000002, 2024-05-08T18:08:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 843 2024-05-08T18:08:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303981+0000", 2024-05-08T18:08:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9740000000000001e-06 2024-05-08T18:08:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303990+0000", 2024-05-08T18:08:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9889999999999998e-06 2024-05-08T18:08:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304012+0000", 2024-05-08T18:08:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1537000000000001e-05 2024-05-08T18:08:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304023+0000", 2024-05-08T18:08:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:08:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304101+0000", 2024-05-08T18:08:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7732999999999996e-05 2024-05-08T18:08:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304210+0000", 2024-05-08T18:08:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010985299999999999 2024-05-08T18:08:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304490+0000", 2024-05-08T18:08:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000279564 2024-05-08T18:08:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.305542+0000", 2024-05-08T18:08:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051976 2024-05-08T18:08:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306451+0000", 2024-05-08T18:08:48.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00090901999999999997 2024-05-08T18:08:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306533+0000", 2024-05-08T18:08:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1790000000000001e-05 2024-05-08T18:08:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306597+0000", 2024-05-08T18:08:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4332999999999995e-05 2024-05-08T18:08:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.480 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.113854783999997, 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00275537, 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 847 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313678+0000", 2024-05-08T18:08:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:08:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313689+0000", 2024-05-08T18:08:48.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1273e-05 2024-05-08T18:08:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313719+0000", 2024-05-08T18:08:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9726e-05 2024-05-08T18:08:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313733+0000", 2024-05-08T18:08:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4487e-05 2024-05-08T18:08:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313858+0000", 2024-05-08T18:08:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125172 2024-05-08T18:08:48.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314072+0000", 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021314200000000001 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314378+0000", 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030653100000000002 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.315524+0000", 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011458950000000001 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316213+0000", 2024-05-08T18:08:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068942199999999997 2024-05-08T18:08:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316314+0000", 2024-05-08T18:08:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100723 2024-05-08T18:08:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316431+0000", 2024-05-08T18:08:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116759 2024-05-08T18:08:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.485 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.110202846999996, 2024-05-08T18:08:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025522510000000002, 2024-05-08T18:08:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 849 2024-05-08T18:08:48.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317329+0000", 2024-05-08T18:08:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9530000000000002e-06 2024-05-08T18:08:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317340+0000", 2024-05-08T18:08:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.08e-05 2024-05-08T18:08:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317364+0000", 2024-05-08T18:08:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4142999999999999e-05 2024-05-08T18:08:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317377+0000", 2024-05-08T18:08:48.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2764e-05 2024-05-08T18:08:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317471+0000", 2024-05-08T18:08:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4289000000000005e-05 2024-05-08T18:08:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317600+0000", 2024-05-08T18:08:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012910499999999999 2024-05-08T18:08:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317868+0000", 2024-05-08T18:08:48.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000267562 2024-05-08T18:08:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319081+0000", 2024-05-08T18:08:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001213387 2024-05-08T18:08:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319723+0000", 2024-05-08T18:08:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064134200000000004 2024-05-08T18:08:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319808+0000", 2024-05-08T18:08:48.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319880+0000", 2024-05-08T18:08:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1426000000000004e-05 2024-05-08T18:08:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.066770366, 2024-05-08T18:08:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002815157, 2024-05-08T18:08:48.491 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 868 2024-05-08T18:08:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360762+0000", 2024-05-08T18:08:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:08:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360775+0000", 2024-05-08T18:08:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2840000000000001e-05 2024-05-08T18:08:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360805+0000", 2024-05-08T18:08:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9686e-05 2024-05-08T18:08:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360819+0000", 2024-05-08T18:08:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.434e-05 2024-05-08T18:08:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360948+0000", 2024-05-08T18:08:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000129033 2024-05-08T18:08:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361166+0000", 2024-05-08T18:08:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021747800000000001 2024-05-08T18:08:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361481+0000", 2024-05-08T18:08:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031515800000000001 2024-05-08T18:08:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.362546+0000", 2024-05-08T18:08:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010653889999999999 2024-05-08T18:08:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363365+0000", 2024-05-08T18:08:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081906100000000005 2024-05-08T18:08:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363450+0000", 2024-05-08T18:08:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5202000000000002e-05 2024-05-08T18:08:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363575+0000", 2024-05-08T18:08:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012460999999999999 2024-05-08T18:08:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.063078192999996, 2024-05-08T18:08:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024676260000000001, 2024-05-08T18:08:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 870 2024-05-08T18:08:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364454+0000", 2024-05-08T18:08:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7770000000000001e-06 2024-05-08T18:08:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364463+0000", 2024-05-08T18:08:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4800000000000007e-06 2024-05-08T18:08:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364487+0000", 2024-05-08T18:08:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3589999999999999e-05 2024-05-08T18:08:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364499+0000", 2024-05-08T18:08:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.241e-05 2024-05-08T18:08:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364607+0000", 2024-05-08T18:08:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010760900000000001 2024-05-08T18:08:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364750+0000", 2024-05-08T18:08:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014265600000000001 2024-05-08T18:08:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.365021+0000", 2024-05-08T18:08:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027115100000000002 2024-05-08T18:08:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366163+0000", 2024-05-08T18:08:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011419189999999999 2024-05-08T18:08:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366727+0000", 2024-05-08T18:08:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056400199999999997 2024-05-08T18:08:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366810+0000", 2024-05-08T18:08:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3133000000000005e-05 2024-05-08T18:08:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366920+0000", 2024-05-08T18:08:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109899 2024-05-08T18:08:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.973164014999995, 2024-05-08T18:08:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027893459999999998, 2024-05-08T18:08:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.502 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 907 2024-05-08T18:08:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454369+0000", 2024-05-08T18:08:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5730000000000002e-06 2024-05-08T18:08:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454381+0000", 2024-05-08T18:08:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.208e-05 2024-05-08T18:08:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454413+0000", 2024-05-08T18:08:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2493000000000002e-05 2024-05-08T18:08:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454432+0000", 2024-05-08T18:08:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8862999999999999e-05 2024-05-08T18:08:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454577+0000", 2024-05-08T18:08:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014477899999999999 2024-05-08T18:08:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454800+0000", 2024-05-08T18:08:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223425 2024-05-08T18:08:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.455168+0000", 2024-05-08T18:08:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036712799999999999 2024-05-08T18:08:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456282+0000", 2024-05-08T18:08:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011141580000000001 2024-05-08T18:08:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456953+0000", 2024-05-08T18:08:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000670956 2024-05-08T18:08:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457038+0000", 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4828999999999997e-05 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457156+0000", 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118062 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.969471651999996, 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026891609999999998, 2024-05-08T18:08:48.507 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 909 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:48.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458060+0000", 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458069+0000", 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6440000000000006e-06 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458090+0000", 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1089000000000001e-05 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458102+0000", 2024-05-08T18:08:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2306999999999999e-05 2024-05-08T18:08:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458191+0000", 2024-05-08T18:08:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8213000000000004e-05 2024-05-08T18:08:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458313+0000", 2024-05-08T18:08:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012231500000000001 2024-05-08T18:08:48.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458581+0000", 2024-05-08T18:08:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026762500000000001 2024-05-08T18:08:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.459773+0000", 2024-05-08T18:08:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001192991 2024-05-08T18:08:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460590+0000", 2024-05-08T18:08:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081618100000000002 2024-05-08T18:08:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460681+0000", 2024-05-08T18:08:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0946000000000006e-05 2024-05-08T18:08:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460748+0000", 2024-05-08T18:08:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7139999999999998e-05 2024-05-08T18:08:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:48.512 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.875828634000001, 2024-05-08T18:08:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030359179999999999, 2024-05-08T18:08:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 949 2024-05-08T18:08:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551705+0000", 2024-05-08T18:08:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2770000000000001e-06 2024-05-08T18:08:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551717+0000", 2024-05-08T18:08:48.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.206e-05 2024-05-08T18:08:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551747+0000", 2024-05-08T18:08:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0168999999999999e-05 2024-05-08T18:08:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551763+0000", 2024-05-08T18:08:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:08:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551880+0000", 2024-05-08T18:08:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116976 2024-05-08T18:08:48.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552099+0000", 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021910199999999999 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552476+0000", 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000376697 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.553551+0000", 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001074925 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554588+0000", 2024-05-08T18:08:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010374099999999999 2024-05-08T18:08:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554671+0000", 2024-05-08T18:08:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3368999999999994e-05 2024-05-08T18:08:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554738+0000", 2024-05-08T18:08:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6043000000000004e-05 2024-05-08T18:08:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.862215195999994, 2024-05-08T18:08:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028304160000000001, 2024-05-08T18:08:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 955 2024-05-08T18:08:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565318+0000", 2024-05-08T18:08:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7030000000000002e-06 2024-05-08T18:08:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565330+0000", 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.204e-05 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565363+0000", 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2722999999999998e-05 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565389+0000", 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6412999999999999e-05 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565510+0000", 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120932 2024-05-08T18:08:48.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565722+0000", 2024-05-08T18:08:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212139 2024-05-08T18:08:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.566034+0000", 2024-05-08T18:08:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000312038 2024-05-08T18:08:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567340+0000", 2024-05-08T18:08:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00130547 2024-05-08T18:08:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567998+0000", 2024-05-08T18:08:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000658382 2024-05-08T18:08:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568081+0000", 2024-05-08T18:08:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3269999999999994e-05 2024-05-08T18:08:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568145+0000", 2024-05-08T18:08:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4306000000000004e-05 2024-05-08T18:08:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.522 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 80.858495672999993, 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027506660000000001, 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 957 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:48.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569036+0000", 2024-05-08T18:08:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.776e-06 2024-05-08T18:08:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569061+0000", 2024-05-08T18:08:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5097e-05 2024-05-08T18:08:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569084+0000", 2024-05-08T18:08:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.23e-05 2024-05-08T18:08:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569096+0000", 2024-05-08T18:08:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.22e-05 2024-05-08T18:08:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:48.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569180+0000", 2024-05-08T18:08:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4369000000000005e-05 2024-05-08T18:08:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569296+0000", 2024-05-08T18:08:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115999 2024-05-08T18:08:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569550+0000", 2024-05-08T18:08:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025397499999999998 2024-05-08T18:08:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:48.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.570963+0000", 2024-05-08T18:08:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001413023 2024-05-08T18:08:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571614+0000", 2024-05-08T18:08:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065041199999999995 2024-05-08T18:08:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571701+0000", 2024-05-08T18:08:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7569000000000001e-05 2024-05-08T18:08:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571785+0000", 2024-05-08T18:08:48.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3945999999999999e-05 2024-05-08T18:08:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:48.528 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:48.528 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:48.529 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:08:48.529 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:48.528+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:48.630 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:48.632+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:48.731 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:48.732+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:48.736 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:48.736 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:48.737 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:48.737 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:48.753 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:08:48.838 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:48.840+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:48.934 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:48.932+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:48.961 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:48.961 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:48.961 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:48.961 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:48.961 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:48.980 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:08:49.035 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:49.033+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:49.136 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:49.137+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:49.193 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:49.193 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:49.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:49.193 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:49.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.193 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:49.193 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:49.193 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.643146873000006, 2024-05-08T18:08:49.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049710090000000002, 2024-05-08T18:08:49.193 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.193 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.194 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-08T18:08:49.194 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.194 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.194 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.194 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 44 2024-05-08T18:08:49.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.194 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:49.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:49.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552775+0000", 2024-05-08T18:08:49.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4450000000000001e-06 2024-05-08T18:08:49.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552790+0000", 2024-05-08T18:08:49.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4363e-05 2024-05-08T18:08:49.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552820+0000", 2024-05-08T18:08:49.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0485999999999999e-05 2024-05-08T18:08:49.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552843+0000", 2024-05-08T18:08:49.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2985000000000001e-05 2024-05-08T18:08:49.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554350+0000", 2024-05-08T18:08:49.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015065149999999999 2024-05-08T18:08:49.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-08T18:08:49.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554374+0000", 2024-05-08T18:08:49.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4097e-05 2024-05-08T18:08:49.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557531+0000", 2024-05-08T18:08:49.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031567169999999999 2024-05-08T18:08:49.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557743+0000", 2024-05-08T18:08:49.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212401 2024-05-08T18:08:49.197 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.197 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.197 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.198 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:49.198 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:49.198 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.607794995999996, 2024-05-08T18:08:49.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050241879999999997, 2024-05-08T18:08:49.198 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.198 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.198 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.198 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.198 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.198 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.198 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 58 2024-05-08T18:08:49.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.198 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:49.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:49.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588125+0000", 2024-05-08T18:08:49.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1399999999999995e-07 2024-05-08T18:08:49.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588129+0000", 2024-05-08T18:08:49.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6779999999999999e-06 2024-05-08T18:08:49.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588142+0000", 2024-05-08T18:08:49.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3047999999999999e-05 2024-05-08T18:08:49.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588174+0000", 2024-05-08T18:08:49.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1270999999999999e-05 2024-05-08T18:08:49.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588307+0000", 2024-05-08T18:08:49.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013307600000000001 2024-05-08T18:08:49.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588477+0000", 2024-05-08T18:08:49.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000170213 2024-05-08T18:08:49.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:49.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588669+0000", 2024-05-08T18:08:49.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019211599999999999 2024-05-08T18:08:49.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.590228+0000", 2024-05-08T18:08:49.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015590059999999999 2024-05-08T18:08:49.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593029+0000", 2024-05-08T18:08:49.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028006400000000001 2024-05-08T18:08:49.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593099+0000", 2024-05-08T18:08:49.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0300000000000001e-05 2024-05-08T18:08:49.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593148+0000", 2024-05-08T18:08:49.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8925999999999999e-05 2024-05-08T18:08:49.203 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.203 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.203 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.203 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:08:49.203 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:49.203 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.611256835999995, 2024-05-08T18:08:49.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00385587, 2024-05-08T18:08:49.204 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.204 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.204 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.204 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.204 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.204 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.204 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207 2024-05-08T18:08:49.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.204 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:49.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:49.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584665+0000", 2024-05-08T18:08:49.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0570000000000001e-06 2024-05-08T18:08:49.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584679+0000", 2024-05-08T18:08:49.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3713000000000001e-05 2024-05-08T18:08:49.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584712+0000", 2024-05-08T18:08:49.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3213999999999997e-05 2024-05-08T18:08:49.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584728+0000", 2024-05-08T18:08:49.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5936000000000001e-05 2024-05-08T18:08:49.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584951+0000", 2024-05-08T18:08:49.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000222955 2024-05-08T18:08:49.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585196+0000", 2024-05-08T18:08:49.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024550800000000002 2024-05-08T18:08:49.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:49.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585643+0000", 2024-05-08T18:08:49.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00044644699999999999 2024-05-08T18:08:49.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.587110+0000", 2024-05-08T18:08:49.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001467323 2024-05-08T18:08:49.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588371+0000", 2024-05-08T18:08:49.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012607180000000001 2024-05-08T18:08:49.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588452+0000", 2024-05-08T18:08:49.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1216000000000003e-05 2024-05-08T18:08:49.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588518+0000", 2024-05-08T18:08:49.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5783000000000004e-05 2024-05-08T18:08:49.208 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.208 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.208 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.209 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.209 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:49.209 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.565081434000007, 2024-05-08T18:08:49.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003249994, 2024-05-08T18:08:49.209 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.209 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.209 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.209 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.209 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.209 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.209 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216 2024-05-08T18:08:49.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.209 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:49.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:49.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630840+0000", 2024-05-08T18:08:49.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0730000000000001e-06 2024-05-08T18:08:49.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630854+0000", 2024-05-08T18:08:49.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3360000000000001e-05 2024-05-08T18:08:49.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630889+0000", 2024-05-08T18:08:49.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5176999999999999e-05 2024-05-08T18:08:49.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630911+0000", 2024-05-08T18:08:49.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.247e-05 2024-05-08T18:08:49.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631046+0000", 2024-05-08T18:08:49.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013484599999999999 2024-05-08T18:08:49.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631272+0000", 2024-05-08T18:08:49.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000225694 2024-05-08T18:08:49.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:49.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631703+0000", 2024-05-08T18:08:49.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000431144 2024-05-08T18:08:49.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633244+0000", 2024-05-08T18:08:49.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001540622 2024-05-08T18:08:49.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633926+0000", 2024-05-08T18:08:49.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068244200000000001 2024-05-08T18:08:49.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634019+0000", 2024-05-08T18:08:49.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3148999999999999e-05 2024-05-08T18:08:49.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634087+0000", 2024-05-08T18:08:49.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8016999999999996e-05 2024-05-08T18:08:49.214 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.214 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.214 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.214 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.214 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:49.214 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.523537384999997, 2024-05-08T18:08:49.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003119854, 2024-05-08T18:08:49.214 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.214 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.214 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.214 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 227 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672384+0000", 2024-05-08T18:08:49.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7470000000000001e-06 2024-05-08T18:08:49.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672396+0000", 2024-05-08T18:08:49.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.154e-05 2024-05-08T18:08:49.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672427+0000", 2024-05-08T18:08:49.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1676e-05 2024-05-08T18:08:49.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672443+0000", 2024-05-08T18:08:49.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5214e-05 2024-05-08T18:08:49.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672563+0000", 2024-05-08T18:08:49.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120535 2024-05-08T18:08:49.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672778+0000", 2024-05-08T18:08:49.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021446200000000001 2024-05-08T18:08:49.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:49.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.673205+0000", 2024-05-08T18:08:49.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042750699999999998 2024-05-08T18:08:49.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.674848+0000", 2024-05-08T18:08:49.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016432980000000001 2024-05-08T18:08:49.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675346+0000", 2024-05-08T18:08:49.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049711999999999998 2024-05-08T18:08:49.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675432+0000", 2024-05-08T18:08:49.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6798999999999993e-05 2024-05-08T18:08:49.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675501+0000", 2024-05-08T18:08:49.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8955999999999995e-05 2024-05-08T18:08:49.219 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.219 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.219 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.219 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.219 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:49.219 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.516596598000007, 2024-05-08T18:08:49.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034322110000000001, 2024-05-08T18:08:49.220 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.220 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.220 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.220 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.220 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.220 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.220 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 229 2024-05-08T18:08:49.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.220 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:49.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:49.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679325+0000", 2024-05-08T18:08:49.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:08:49.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679339+0000", 2024-05-08T18:08:49.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:08:49.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679370+0000", 2024-05-08T18:08:49.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0280000000000001e-05 2024-05-08T18:08:49.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679385+0000", 2024-05-08T18:08:49.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5026e-05 2024-05-08T18:08:49.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679504+0000", 2024-05-08T18:08:49.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119023 2024-05-08T18:08:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679711+0000", 2024-05-08T18:08:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020705499999999999 2024-05-08T18:08:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.680115+0000", 2024-05-08T18:08:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040396699999999998 2024-05-08T18:08:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.681424+0000", 2024-05-08T18:08:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001309387 2024-05-08T18:08:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682488+0000", 2024-05-08T18:08:49.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010642519999999999 2024-05-08T18:08:49.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682640+0000", 2024-05-08T18:08:49.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015123599999999999 2024-05-08T18:08:49.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682754+0000", 2024-05-08T18:08:49.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011482200000000001 2024-05-08T18:08:49.224 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.224 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.509212388999998, 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033353329999999998, 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 231 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:49.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:49.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686709+0000", 2024-05-08T18:08:49.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4729999999999999e-06 2024-05-08T18:08:49.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686720+0000", 2024-05-08T18:08:49.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1157e-05 2024-05-08T18:08:49.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686750+0000", 2024-05-08T18:08:49.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0417e-05 2024-05-08T18:08:49.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686765+0000", 2024-05-08T18:08:49.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.487e-05 2024-05-08T18:08:49.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686872+0000", 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010703499999999999 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687085+0000", 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021279599999999999 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687501+0000", 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041554 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.688886+0000", 2024-05-08T18:08:49.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00138565 2024-05-08T18:08:49.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689899+0000", 2024-05-08T18:08:49.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010128190000000001 2024-05-08T18:08:49.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689978+0000", 2024-05-08T18:08:49.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8490000000000002e-05 2024-05-08T18:08:49.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.690042+0000", 2024-05-08T18:08:49.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4085999999999996e-05 2024-05-08T18:08:49.230 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.230 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.230 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.230 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:394 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.230 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:49.230 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.452139312, 2024-05-08T18:08:49.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034384960000000001, 2024-05-08T18:08:49.230 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.230 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.230 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.230 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.230 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.231 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.231 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 394 2024-05-08T18:08:49.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.231 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:49.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:49.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743781+0000", 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3e-06 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743788+0000", 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7399999999999998e-06 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743801+0000", 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3757000000000001e-05 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743808+0000", 2024-05-08T18:08:49.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6579999999999996e-06 2024-05-08T18:08:49.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743875+0000", 2024-05-08T18:08:49.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6740000000000001e-05 2024-05-08T18:08:49.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743971+0000", 2024-05-08T18:08:49.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6175000000000007e-05 2024-05-08T18:08:49.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:49.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744100+0000", 2024-05-08T18:08:49.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012954899999999999 2024-05-08T18:08:49.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744863+0000", 2024-05-08T18:08:49.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076300100000000002 2024-05-08T18:08:49.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747089+0000", 2024-05-08T18:08:49.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022258540000000002 2024-05-08T18:08:49.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747162+0000", 2024-05-08T18:08:49.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2632000000000005e-05 2024-05-08T18:08:49.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747218+0000", 2024-05-08T18:08:49.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.609e-05 2024-05-08T18:08:49.235 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.235 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.235 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.235 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:535 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.235 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:49.235 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.354426235000005, 2024-05-08T18:08:49.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055640899999999998, 2024-05-08T18:08:49.236 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.236 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.236 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.236 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.236 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.236 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.236 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 535 2024-05-08T18:08:49.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.236 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:49.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:49.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841494+0000", 2024-05-08T18:08:49.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0899999999999999e-06 2024-05-08T18:08:49.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841500+0000", 2024-05-08T18:08:49.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0249999999999999e-06 2024-05-08T18:08:49.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841513+0000", 2024-05-08T18:08:49.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3658e-05 2024-05-08T18:08:49.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841522+0000", 2024-05-08T18:08:49.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3410000000000003e-06 2024-05-08T18:08:49.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841574+0000", 2024-05-08T18:08:49.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2794000000000003e-05 2024-05-08T18:08:49.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841633+0000", 2024-05-08T18:08:49.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8595999999999999e-05 2024-05-08T18:08:49.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:49.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841755+0000", 2024-05-08T18:08:49.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012227399999999999 2024-05-08T18:08:49.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.842349+0000", 2024-05-08T18:08:49.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00059377699999999998 2024-05-08T18:08:49.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.846949+0000", 2024-05-08T18:08:49.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004599723 2024-05-08T18:08:49.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847008+0000", 2024-05-08T18:08:49.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8854999999999998e-05 2024-05-08T18:08:49.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847057+0000", 2024-05-08T18:08:49.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8956999999999999e-05 2024-05-08T18:08:49.240 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.240 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.240 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:541 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.347396704999994, 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037829790000000001, 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 541 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:49.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:49.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848523+0000", 2024-05-08T18:08:49.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8599999999999997e-07 2024-05-08T18:08:49.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848526+0000", 2024-05-08T18:08:49.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4690000000000002e-06 2024-05-08T18:08:49.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848536+0000", 2024-05-08T18:08:49.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2029999999999998e-06 2024-05-08T18:08:49.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848540+0000", 2024-05-08T18:08:49.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9169999999999997e-06 2024-05-08T18:08:49.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848591+0000", 2024-05-08T18:08:49.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0328000000000003e-05 2024-05-08T18:08:49.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848646+0000", 2024-05-08T18:08:49.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5281999999999997e-05 2024-05-08T18:08:49.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:49.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848759+0000", 2024-05-08T18:08:49.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011278899999999999 2024-05-08T18:08:49.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.849323+0000", 2024-05-08T18:08:49.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056433999999999998 2024-05-08T18:08:49.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852225+0000", 2024-05-08T18:08:49.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029017320000000002 2024-05-08T18:08:49.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852277+0000", 2024-05-08T18:08:49.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2460999999999998e-05 2024-05-08T18:08:49.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852305+0000", 2024-05-08T18:08:49.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7671999999999999e-05 2024-05-08T18:08:49.245 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.246 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.246 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.246 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.246 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:49.246 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.214249628000005, 2024-05-08T18:08:49.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002973084, 2024-05-08T18:08:49.246 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.246 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.246 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.246 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.247 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.247 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.247 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 703 2024-05-08T18:08:49.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.247 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:49.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:49.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981672+0000", 2024-05-08T18:08:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5799999999999999e-06 2024-05-08T18:08:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981683+0000", 2024-05-08T18:08:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1270000000000001e-05 2024-05-08T18:08:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981715+0000", 2024-05-08T18:08:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1470000000000002e-05 2024-05-08T18:08:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981730+0000", 2024-05-08T18:08:49.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5262999999999999e-05 2024-05-08T18:08:49.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981864+0000", 2024-05-08T18:08:49.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134043 2024-05-08T18:08:49.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982168+0000", 2024-05-08T18:08:49.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030453799999999998 2024-05-08T18:08:49.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:49.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982620+0000", 2024-05-08T18:08:49.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045170900000000001 2024-05-08T18:08:49.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.983648+0000", 2024-05-08T18:08:49.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010276009999999999 2024-05-08T18:08:49.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984486+0000", 2024-05-08T18:08:49.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083874600000000002 2024-05-08T18:08:49.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984571+0000", 2024-05-08T18:08:49.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4370999999999996e-05 2024-05-08T18:08:49.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984642+0000", 2024-05-08T18:08:49.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1493000000000001e-05 2024-05-08T18:08:49.251 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.251 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.251 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.251 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:789 6.0 e32/26 6:0216b5b6:::obj_delete_at_hint.0000000070:head v 32'14, mlcod=32'12)", 2024-05-08T18:08:49.251 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:49.251 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.014822855000006, 2024-05-08T18:08:49.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034621420000000001, 2024-05-08T18:08:49.251 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.252 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.252 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.252 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:49.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:49.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181098+0000", 2024-05-08T18:08:49.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8029999999999999e-06 2024-05-08T18:08:49.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181109+0000", 2024-05-08T18:08:49.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1219999999999999e-05 2024-05-08T18:08:49.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181138+0000", 2024-05-08T18:08:49.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.898e-05 2024-05-08T18:08:49.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181151+0000", 2024-05-08T18:08:49.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.308e-05 2024-05-08T18:08:49.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.254 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181268+0000", 2024-05-08T18:08:49.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116629 2024-05-08T18:08:49.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.254 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181321+0000", 2024-05-08T18:08:49.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3325999999999997e-05 2024-05-08T18:08:49.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.254 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184477+0000", 2024-05-08T18:08:49.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003156458 2024-05-08T18:08:49.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184558+0000", 2024-05-08T18:08:49.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0646e-05 2024-05-08T18:08:49.255 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.255 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.255 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.255 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.255 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:49.255 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.983649350999997, 2024-05-08T18:08:49.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031146310000000001, 2024-05-08T18:08:49.255 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 802 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:49.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212272+0000", 2024-05-08T18:08:49.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.943e-06 2024-05-08T18:08:49.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212284+0000", 2024-05-08T18:08:49.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1747e-05 2024-05-08T18:08:49.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212315+0000", 2024-05-08T18:08:49.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0579e-05 2024-05-08T18:08:49.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212336+0000", 2024-05-08T18:08:49.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1639999999999999e-05 2024-05-08T18:08:49.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212488+0000", 2024-05-08T18:08:49.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151192 2024-05-08T18:08:49.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212703+0000", 2024-05-08T18:08:49.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000215439 2024-05-08T18:08:49.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:49.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.213033+0000", 2024-05-08T18:08:49.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032992699999999999 2024-05-08T18:08:49.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.214306+0000", 2024-05-08T18:08:49.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012726949999999999 2024-05-08T18:08:49.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215232+0000", 2024-05-08T18:08:49.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092652999999999995 2024-05-08T18:08:49.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215321+0000", 2024-05-08T18:08:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9272999999999997e-05 2024-05-08T18:08:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215384+0000", 2024-05-08T18:08:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2665999999999999e-05 2024-05-08T18:08:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:49.260 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.903104944999995, 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030150250000000002, 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 838 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:49.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292816+0000", 2024-05-08T18:08:49.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:08:49.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292828+0000", 2024-05-08T18:08:49.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.184e-05 2024-05-08T18:08:49.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292857+0000", 2024-05-08T18:08:49.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8960000000000001e-05 2024-05-08T18:08:49.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292871+0000", 2024-05-08T18:08:49.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.45e-05 2024-05-08T18:08:49.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293000+0000", 2024-05-08T18:08:49.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128875 2024-05-08T18:08:49.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293231+0000", 2024-05-08T18:08:49.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023030500000000001 2024-05-08T18:08:49.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:49.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293563+0000", 2024-05-08T18:08:49.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000332648 2024-05-08T18:08:49.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.294882+0000", 2024-05-08T18:08:49.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001319183 2024-05-08T18:08:49.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295664+0000", 2024-05-08T18:08:49.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000781991 2024-05-08T18:08:49.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295754+0000", 2024-05-08T18:08:49.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9176000000000001e-05 2024-05-08T18:08:49.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295829+0000", 2024-05-08T18:08:49.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.525e-05 2024-05-08T18:08:49.265 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.265 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.841971275999995, 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029338929999999999, 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 865 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.267 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.267 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:49.267 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.267 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.267 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:49.267 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.267 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.267 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353950+0000", 2024-05-08T18:08:49.267 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2469999999999998e-06 2024-05-08T18:08:49.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353961+0000", 2024-05-08T18:08:49.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1523e-05 2024-05-08T18:08:49.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353991+0000", 2024-05-08T18:08:49.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9920000000000002e-05 2024-05-08T18:08:49.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354013+0000", 2024-05-08T18:08:49.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1590000000000002e-05 2024-05-08T18:08:49.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354206+0000", 2024-05-08T18:08:49.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019273900000000001 2024-05-08T18:08:49.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354418+0000", 2024-05-08T18:08:49.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212518 2024-05-08T18:08:49.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:49.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354720+0000", 2024-05-08T18:08:49.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030151800000000002 2024-05-08T18:08:49.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.355983+0000", 2024-05-08T18:08:49.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012636780000000001 2024-05-08T18:08:49.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356733+0000", 2024-05-08T18:08:49.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074988400000000003 2024-05-08T18:08:49.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356819+0000", 2024-05-08T18:08:49.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5690000000000001e-05 2024-05-08T18:08:49.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.271 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.271 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356881+0000", 2024-05-08T18:08:49.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2586e-05 2024-05-08T18:08:49.271 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.271 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.271 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.271 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.271 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:49.271 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.828847910999997, 2024-05-08T18:08:49.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004954511, 2024-05-08T18:08:49.271 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.271 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.271 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.271 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.272 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.272 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.272 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 871 2024-05-08T18:08:49.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.272 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.272 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:49.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.272 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:49.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367073+0000", 2024-05-08T18:08:49.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2340000000000001e-06 2024-05-08T18:08:49.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367085+0000", 2024-05-08T18:08:49.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1483e-05 2024-05-08T18:08:49.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367111+0000", 2024-05-08T18:08:49.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5890000000000001e-05 2024-05-08T18:08:49.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367130+0000", 2024-05-08T18:08:49.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9700000000000001e-05 2024-05-08T18:08:49.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367284+0000", 2024-05-08T18:08:49.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015411799999999999 2024-05-08T18:08:49.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367516+0000", 2024-05-08T18:08:49.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000231272 2024-05-08T18:08:49.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:49.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367837+0000", 2024-05-08T18:08:49.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032173400000000001 2024-05-08T18:08:49.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371395+0000", 2024-05-08T18:08:49.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035574719999999999 2024-05-08T18:08:49.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371882+0000", 2024-05-08T18:08:49.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048693899999999998 2024-05-08T18:08:49.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.276 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371962+0000", 2024-05-08T18:08:49.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.975e-05 2024-05-08T18:08:49.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.276 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372025+0000", 2024-05-08T18:08:49.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3918999999999996e-05 2024-05-08T18:08:49.276 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.276 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.276 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.276 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.276 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:49.276 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.822960206999994, 2024-05-08T18:08:49.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045233640000000002, 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 873 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:49.278 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.278 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.278 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372961+0000", 2024-05-08T18:08:49.278 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:08:49.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.278 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.278 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372969+0000", 2024-05-08T18:08:49.278 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2940000000000006e-06 2024-05-08T18:08:49.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.278 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372991+0000", 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1829000000000001e-05 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373009+0000", 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8607e-05 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373127+0000", 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011728899999999999 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373260+0000", 2024-05-08T18:08:49.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013301200000000001 2024-05-08T18:08:49.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:49.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373526+0000", 2024-05-08T18:08:49.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026613500000000003 2024-05-08T18:08:49.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.374558+0000", 2024-05-08T18:08:49.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001032156 2024-05-08T18:08:49.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377333+0000", 2024-05-08T18:08:49.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027749329999999998 2024-05-08T18:08:49.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.281 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377421+0000", 2024-05-08T18:08:49.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8679999999999998e-05 2024-05-08T18:08:49.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.281 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377482+0000", 2024-05-08T18:08:49.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0538999999999998e-05 2024-05-08T18:08:49.281 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.281 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.281 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.281 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.281 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:49.282 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.763351052999994, 2024-05-08T18:08:49.282 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035261009999999998, 2024-05-08T18:08:49.282 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.282 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.282 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.282 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.282 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.282 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.282 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 898 2024-05-08T18:08:49.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.282 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.282 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.282 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:49.282 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432570+0000", 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.26e-06 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432580+0000", 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8570000000000007e-06 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.284 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432605+0000", 2024-05-08T18:08:49.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5273e-05 2024-05-08T18:08:49.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.284 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.284 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432618+0000", 2024-05-08T18:08:49.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2999999999999999e-05 2024-05-08T18:08:49.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.284 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.284 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432742+0000", 2024-05-08T18:08:49.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012369200000000001 2024-05-08T18:08:49.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.284 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.284 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433109+0000", 2024-05-08T18:08:49.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036760500000000002 2024-05-08T18:08:49.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:49.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433645+0000", 2024-05-08T18:08:49.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053599599999999996 2024-05-08T18:08:49.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435050+0000", 2024-05-08T18:08:49.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001404696 2024-05-08T18:08:49.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435834+0000", 2024-05-08T18:08:49.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078381100000000003 2024-05-08T18:08:49.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.286 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435984+0000", 2024-05-08T18:08:49.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015006899999999999 2024-05-08T18:08:49.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.286 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.436094+0000", 2024-05-08T18:08:49.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109842 2024-05-08T18:08:49.286 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.286 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.286 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.758598203999995, 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031481899999999999, 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 900 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.287 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:49.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:49.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437323+0000", 2024-05-08T18:08:49.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.447e-06 2024-05-08T18:08:49.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437334+0000", 2024-05-08T18:08:49.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0835999999999999e-05 2024-05-08T18:08:49.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437364+0000", 2024-05-08T18:08:49.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0463999999999998e-05 2024-05-08T18:08:49.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437379+0000", 2024-05-08T18:08:49.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4806e-05 2024-05-08T18:08:49.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437500+0000", 2024-05-08T18:08:49.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121309 2024-05-08T18:08:49.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437729+0000", 2024-05-08T18:08:49.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022818200000000001 2024-05-08T18:08:49.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:49.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.438199+0000", 2024-05-08T18:08:49.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047025300000000001 2024-05-08T18:08:49.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.439418+0000", 2024-05-08T18:08:49.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012193849999999999 2024-05-08T18:08:49.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440217+0000", 2024-05-08T18:08:49.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00079905999999999998 2024-05-08T18:08:49.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440352+0000", 2024-05-08T18:08:49.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013485299999999999 2024-05-08T18:08:49.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440469+0000", 2024-05-08T18:08:49.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116595 2024-05-08T18:08:49.292 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.292 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.292 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.292 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.292 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:49.292 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.672362199000005, 2024-05-08T18:08:49.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003477894, 2024-05-08T18:08:49.292 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:49.292 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:49.292 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.292 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:49.293 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:49.293 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.293 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 937 2024-05-08T18:08:49.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.293 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:49.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.293 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:49.293 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:49.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.293 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:49.293 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:49.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:49.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.294 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:49.294 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523559+0000", 2024-05-08T18:08:49.294 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.95e-06 2024-05-08T18:08:49.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.294 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:49.294 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523567+0000", 2024-05-08T18:08:49.294 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6799999999999999e-06 2024-05-08T18:08:49.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.294 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:49.294 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523591+0000", 2024-05-08T18:08:49.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3269e-05 2024-05-08T18:08:49.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523611+0000", 2024-05-08T18:08:49.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0100000000000001e-05 2024-05-08T18:08:49.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:49.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523767+0000", 2024-05-08T18:08:49.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015604900000000001 2024-05-08T18:08:49.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:49.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523994+0000", 2024-05-08T18:08:49.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022764199999999999 2024-05-08T18:08:49.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:49.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.524338+0000", 2024-05-08T18:08:49.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034388700000000002 2024-05-08T18:08:49.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:49.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.525707+0000", 2024-05-08T18:08:49.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001368544 2024-05-08T18:08:49.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526843+0000", 2024-05-08T18:08:49.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001136501 2024-05-08T18:08:49.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:49.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526957+0000", 2024-05-08T18:08:49.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011359 2024-05-08T18:08:49.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:49.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:49.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:49.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.527035+0000", 2024-05-08T18:08:49.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7682000000000006e-05 2024-05-08T18:08:49.297 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.297 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.298 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.298 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:49.298 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:49.298 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:49.299 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:08:49.300 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:49.297+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:49.400 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:49.400+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:49.429 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:49.429 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:49.429 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:49.429 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:49.443 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:08:49.501 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:49.500+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:49.569 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:49.569 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:49.569 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:49.569 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:49.569 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:49.583 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:08:49.602 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:49.604+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:49.643 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:08:49.703 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:49.701+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:49.708 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:36 5.e 5:71234df9:::zone_info.d0a95a6c-3c84-4d52-915c-e8ea581dfb9b:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:08:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.132736738000006, 2024-05-08T18:08:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028394430000000001, 2024-05-08T18:08:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:08:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:08:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 36 2024-05-08T18:08:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573456+0000", 2024-05-08T18:08:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573467+0000", 2024-05-08T18:08:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1243999999999999e-05 2024-05-08T18:08:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573499+0000", 2024-05-08T18:08:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1343000000000001e-05 2024-05-08T18:08:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573522+0000", 2024-05-08T18:08:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3540000000000002e-05 2024-05-08T18:08:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573634+0000", 2024-05-08T18:08:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112249 2024-05-08T18:08:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573841+0000", 2024-05-08T18:08:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000206407 2024-05-08T18:08:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.574122+0000", 2024-05-08T18:08:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000281475 2024-05-08T18:08:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.575489+0000", 2024-05-08T18:08:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001366391 2024-05-08T18:08:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576157+0000", 2024-05-08T18:08:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00066776200000000002 2024-05-08T18:08:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576234+0000", 2024-05-08T18:08:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7285000000000003e-05 2024-05-08T18:08:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576293+0000", 2024-05-08T18:08:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9556999999999999e-05 2024-05-08T18:08:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.175977544999995, 2024-05-08T18:08:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018560765, 2024-05-08T18:08:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:08:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 43 2024-05-08T18:08:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530217+0000", 2024-05-08T18:08:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:08:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530253+0000", 2024-05-08T18:08:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5621999999999999e-05 2024-05-08T18:08:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530288+0000", 2024-05-08T18:08:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5846999999999997e-05 2024-05-08T18:08:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530314+0000", 2024-05-08T18:08:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5732e-05 2024-05-08T18:08:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530952+0000", 2024-05-08T18:08:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00063739999999999999 2024-05-08T18:08:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530977+0000", 2024-05-08T18:08:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5375e-05 2024-05-08T18:08:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548506+0000", 2024-05-08T18:08:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017528781 2024-05-08T18:08:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548774+0000", 2024-05-08T18:08:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026821199999999999 2024-05-08T18:08:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.093663621000005, 2024-05-08T18:08:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003496893, 2024-05-08T18:08:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 211 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612530+0000", 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9490000000000001e-06 2024-05-08T18:08:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612544+0000", 2024-05-08T18:08:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3779e-05 2024-05-08T18:08:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612578+0000", 2024-05-08T18:08:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4421000000000001e-05 2024-05-08T18:08:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612596+0000", 2024-05-08T18:08:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7435000000000002e-05 2024-05-08T18:08:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612718+0000", 2024-05-08T18:08:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012218600000000001 2024-05-08T18:08:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612951+0000", 2024-05-08T18:08:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000232768 2024-05-08T18:08:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.613370+0000", 2024-05-08T18:08:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041921200000000002 2024-05-08T18:08:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.614840+0000", 2024-05-08T18:08:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014703679999999999 2024-05-08T18:08:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615860+0000", 2024-05-08T18:08:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010198220000000001 2024-05-08T18:08:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615954+0000", 2024-05-08T18:08:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4419000000000005e-05 2024-05-08T18:08:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.616024+0000", 2024-05-08T18:08:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9534000000000002e-05 2024-05-08T18:08:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.016973938999996, 2024-05-08T18:08:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035800939999999998, 2024-05-08T18:08:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 232 2024-05-08T18:08:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689219+0000", 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4490000000000002e-06 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689232+0000", 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3183000000000001e-05 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689263+0000", 2024-05-08T18:08:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400999999999999e-05 2024-05-08T18:08:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689279+0000", 2024-05-08T18:08:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6078000000000001e-05 2024-05-08T18:08:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689401+0000", 2024-05-08T18:08:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012243000000000001 2024-05-08T18:08:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689656+0000", 2024-05-08T18:08:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431899999999998 2024-05-08T18:08:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.690103+0000", 2024-05-08T18:08:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044706299999999999 2024-05-08T18:08:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.691780+0000", 2024-05-08T18:08:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016774209999999999 2024-05-08T18:08:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692634+0000", 2024-05-08T18:08:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085346 2024-05-08T18:08:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692728+0000", 2024-05-08T18:08:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4429e-05 2024-05-08T18:08:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692797+0000", 2024-05-08T18:08:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8861000000000004e-05 2024-05-08T18:08:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:267 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.992328960999998, 2024-05-08T18:08:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040291739999999999, 2024-05-08T18:08:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 267 2024-05-08T18:08:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713863+0000", 2024-05-08T18:08:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5200000000000001e-06 2024-05-08T18:08:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713873+0000", 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9089999999999995e-06 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713896+0000", 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2595e-05 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713914+0000", 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7869000000000001e-05 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714048+0000", 2024-05-08T18:08:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134802 2024-05-08T18:08:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714278+0000", 2024-05-08T18:08:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022994399999999999 2024-05-08T18:08:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714777+0000", 2024-05-08T18:08:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049880499999999995 2024-05-08T18:08:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.715976+0000", 2024-05-08T18:08:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011991110000000001 2024-05-08T18:08:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717646+0000", 2024-05-08T18:08:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016699989999999999 2024-05-08T18:08:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717790+0000", 2024-05-08T18:08:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014359799999999999 2024-05-08T18:08:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717891+0000", 2024-05-08T18:08:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101022 2024-05-08T18:08:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:308 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.984961721000005, 2024-05-08T18:08:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031672779999999999, 2024-05-08T18:08:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721230+0000", 2024-05-08T18:08:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:08:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721241+0000", 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0942e-05 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721265+0000", 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3371e-05 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721278+0000", 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3586e-05 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721399+0000", 2024-05-08T18:08:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012092 2024-05-08T18:08:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721507+0000", 2024-05-08T18:08:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107651 2024-05-08T18:08:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724292+0000", 2024-05-08T18:08:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027851870000000002 2024-05-08T18:08:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724396+0000", 2024-05-08T18:08:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000104114 2024-05-08T18:08:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:495 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.902343819999999, 2024-05-08T18:08:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005951001, 2024-05-08T18:08:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 495 2024-05-08T18:08:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803849+0000", 2024-05-08T18:08:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3580000000000001e-06 2024-05-08T18:08:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803864+0000", 2024-05-08T18:08:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4742999999999999e-05 2024-05-08T18:08:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803895+0000", 2024-05-08T18:08:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0970000000000003e-05 2024-05-08T18:08:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803908+0000", 2024-05-08T18:08:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2588999999999999e-05 2024-05-08T18:08:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804005+0000", 2024-05-08T18:08:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7107000000000004e-05 2024-05-08T18:08:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804291+0000", 2024-05-08T18:08:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028626900000000002 2024-05-08T18:08:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804648+0000", 2024-05-08T18:08:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000356955 2024-05-08T18:08:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805740+0000", 2024-05-08T18:08:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001091905 2024-05-08T18:08:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809636+0000", 2024-05-08T18:08:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389661 2024-05-08T18:08:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809722+0000", 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809798+0000", 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5462000000000004e-05 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.895732502000001, 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051396380000000002, 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 504 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810460+0000", 2024-05-08T18:08:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:08:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810470+0000", 2024-05-08T18:08:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0222e-05 2024-05-08T18:08:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810495+0000", 2024-05-08T18:08:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4508999999999999e-05 2024-05-08T18:08:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810515+0000", 2024-05-08T18:08:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9998999999999999e-05 2024-05-08T18:08:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810653+0000", 2024-05-08T18:08:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013851099999999999 2024-05-08T18:08:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810782+0000", 2024-05-08T18:08:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128152 2024-05-08T18:08:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811043+0000", 2024-05-08T18:08:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026172400000000002 2024-05-08T18:08:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812164+0000", 2024-05-08T18:08:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001121024 2024-05-08T18:08:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815415+0000", 2024-05-08T18:08:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032510270000000001 2024-05-08T18:08:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815538+0000", 2024-05-08T18:08:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012256999999999999 2024-05-08T18:08:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815598+0000", 2024-05-08T18:08:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9923000000000002e-05 2024-05-08T18:08:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:629 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.787427761999993, 2024-05-08T18:08:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611169999999998, 2024-05-08T18:08:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 629 2024-05-08T18:08:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918765+0000", 2024-05-08T18:08:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5670000000000002e-06 2024-05-08T18:08:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918777+0000", 2024-05-08T18:08:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1635e-05 2024-05-08T18:08:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918808+0000", 2024-05-08T18:08:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1024e-05 2024-05-08T18:08:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918823+0000", 2024-05-08T18:08:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4939e-05 2024-05-08T18:08:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918930+0000", 2024-05-08T18:08:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107144 2024-05-08T18:08:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919147+0000", 2024-05-08T18:08:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021682599999999999 2024-05-08T18:08:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919464+0000", 2024-05-08T18:08:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031716699999999998 2024-05-08T18:08:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.920561+0000", 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010970229999999999 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921468+0000", 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00090726800000000003 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921549+0000", 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0430000000000001e-05 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921624+0000", 2024-05-08T18:08:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5093999999999996e-05 2024-05-08T18:08:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:681 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.747107013999994, 2024-05-08T18:08:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044793259999999996, 2024-05-08T18:08:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 681 2024-05-08T18:08:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959085+0000", 2024-05-08T18:08:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.353e-06 2024-05-08T18:08:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959092+0000", 2024-05-08T18:08:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999999e-06 2024-05-08T18:08:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959113+0000", 2024-05-08T18:08:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0744e-05 2024-05-08T18:08:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959130+0000", 2024-05-08T18:08:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7679000000000001e-05 2024-05-08T18:08:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959217+0000", 2024-05-08T18:08:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6487000000000001e-05 2024-05-08T18:08:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959335+0000", 2024-05-08T18:08:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118476 2024-05-08T18:08:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959598+0000", 2024-05-08T18:08:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000263045 2024-05-08T18:08:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.960551+0000", 2024-05-08T18:08:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095251500000000002 2024-05-08T18:08:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963412+0000", 2024-05-08T18:08:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611800000000001 2024-05-08T18:08:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963498+0000", 2024-05-08T18:08:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6145999999999998e-05 2024-05-08T18:08:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963563+0000", 2024-05-08T18:08:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4701000000000003e-05 2024-05-08T18:08:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.712158578, 2024-05-08T18:08:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031621710000000001, 2024-05-08T18:08:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 709 2024-05-08T18:08:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994035+0000", 2024-05-08T18:08:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6460000000000002e-06 2024-05-08T18:08:49.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994047+0000", 2024-05-08T18:08:49.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999e-05 2024-05-08T18:08:49.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994076+0000", 2024-05-08T18:08:49.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9564e-05 2024-05-08T18:08:49.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994091+0000", 2024-05-08T18:08:49.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4696e-05 2024-05-08T18:08:49.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994239+0000", 2024-05-08T18:08:49.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014779699999999999 2024-05-08T18:08:49.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994585+0000", 2024-05-08T18:08:49.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034605900000000002 2024-05-08T18:08:49.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:49.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.995084+0000", 2024-05-08T18:08:49.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049904799999999998 2024-05-08T18:08:49.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.996558+0000", 2024-05-08T18:08:49.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001474532 2024-05-08T18:08:49.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997045+0000", 2024-05-08T18:08:49.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048685900000000002 2024-05-08T18:08:49.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997127+0000", 2024-05-08T18:08:49.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1280999999999996e-05 2024-05-08T18:08:49.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997194+0000", 2024-05-08T18:08:49.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7689999999999997e-05 2024-05-08T18:08:49.765 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.765 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.765 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.766 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.766 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:49.766 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.676769191999995, 2024-05-08T18:08:49.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003066236, 2024-05-08T18:08:49.766 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.766 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.766 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.766 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.766 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.766 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.766 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 724 2024-05-08T18:08:49.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.766 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:49.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:49.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029424+0000", 2024-05-08T18:08:49.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.503e-06 2024-05-08T18:08:49.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029437+0000", 2024-05-08T18:08:49.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3309000000000001e-05 2024-05-08T18:08:49.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029467+0000", 2024-05-08T18:08:49.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9677999999999999e-05 2024-05-08T18:08:49.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029489+0000", 2024-05-08T18:08:49.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2314999999999999e-05 2024-05-08T18:08:49.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029600+0000", 2024-05-08T18:08:49.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110561 2024-05-08T18:08:49.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029896+0000", 2024-05-08T18:08:49.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029632200000000001 2024-05-08T18:08:49.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:49.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.030468+0000", 2024-05-08T18:08:49.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00057224700000000001 2024-05-08T18:08:49.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.031728+0000", 2024-05-08T18:08:49.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012595429999999999 2024-05-08T18:08:49.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032338+0000", 2024-05-08T18:08:49.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00061006700000000005 2024-05-08T18:08:49.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032424+0000", 2024-05-08T18:08:49.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:49.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032488+0000", 2024-05-08T18:08:49.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4210999999999999e-05 2024-05-08T18:08:49.771 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.771 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.771 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.771 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.771 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:49.771 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.672118777999998, 2024-05-08T18:08:49.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029269769999999999, 2024-05-08T18:08:49.772 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.772 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.772 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.772 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.772 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.772 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.772 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 726 2024-05-08T18:08:49.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.772 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:49.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:49.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034074+0000", 2024-05-08T18:08:49.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5900000000000002e-06 2024-05-08T18:08:49.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034086+0000", 2024-05-08T18:08:49.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1265e-05 2024-05-08T18:08:49.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034118+0000", 2024-05-08T18:08:49.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2341000000000001e-05 2024-05-08T18:08:49.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034133+0000", 2024-05-08T18:08:49.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5166e-05 2024-05-08T18:08:49.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034254+0000", 2024-05-08T18:08:49.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121033 2024-05-08T18:08:49.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034492+0000", 2024-05-08T18:08:49.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023727700000000001 2024-05-08T18:08:49.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:49.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034967+0000", 2024-05-08T18:08:49.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047522100000000001 2024-05-08T18:08:49.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036353+0000", 2024-05-08T18:08:49.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013865800000000001 2024-05-08T18:08:49.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036841+0000", 2024-05-08T18:08:49.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048788999999999999 2024-05-08T18:08:49.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036929+0000", 2024-05-08T18:08:49.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:08:49.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036999+0000", 2024-05-08T18:08:49.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9448000000000003e-05 2024-05-08T18:08:49.777 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.777 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.777 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.777 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.777 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:49.777 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.668823947999996, 2024-05-08T18:08:49.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003040662, 2024-05-08T18:08:49.778 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.778 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.778 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.778 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.778 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.778 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.778 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 727 2024-05-08T18:08:49.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.778 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:49.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:49.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037369+0000", 2024-05-08T18:08:49.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:08:49.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037378+0000", 2024-05-08T18:08:49.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5359999999999998e-06 2024-05-08T18:08:49.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037405+0000", 2024-05-08T18:08:49.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6588e-05 2024-05-08T18:08:49.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037418+0000", 2024-05-08T18:08:49.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3642000000000001e-05 2024-05-08T18:08:49.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037531+0000", 2024-05-08T18:08:49.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112304 2024-05-08T18:08:49.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037785+0000", 2024-05-08T18:08:49.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025391299999999998 2024-05-08T18:08:49.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:49.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.038112+0000", 2024-05-08T18:08:49.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000326946 2024-05-08T18:08:49.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.039316+0000", 2024-05-08T18:08:49.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012043990000000001 2024-05-08T18:08:49.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040257+0000", 2024-05-08T18:08:49.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000941083 2024-05-08T18:08:49.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040345+0000", 2024-05-08T18:08:49.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8368999999999994e-05 2024-05-08T18:08:49.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040407+0000", 2024-05-08T18:08:49.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1941999999999997e-05 2024-05-08T18:08:49.782 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.783 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.783 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.783 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.783 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:49.783 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.554158559000001, 2024-05-08T18:08:49.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028797779999999999, 2024-05-08T18:08:49.783 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.783 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.783 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.783 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.783 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.783 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.784 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 777 2024-05-08T18:08:49.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.784 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:49.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:49.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152034+0000", 2024-05-08T18:08:49.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2299999999999998e-06 2024-05-08T18:08:49.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152045+0000", 2024-05-08T18:08:49.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0266e-05 2024-05-08T18:08:49.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152076+0000", 2024-05-08T18:08:49.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1007000000000003e-05 2024-05-08T18:08:49.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152094+0000", 2024-05-08T18:08:49.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8148999999999999e-05 2024-05-08T18:08:49.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152183+0000", 2024-05-08T18:08:49.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8845999999999996e-05 2024-05-08T18:08:49.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152308+0000", 2024-05-08T18:08:49.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012502999999999999 2024-05-08T18:08:49.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:49.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152578+0000", 2024-05-08T18:08:49.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027080099999999998 2024-05-08T18:08:49.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154238+0000", 2024-05-08T18:08:49.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016600180000000001 2024-05-08T18:08:49.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154714+0000", 2024-05-08T18:08:49.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000475341 2024-05-08T18:08:49.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154803+0000", 2024-05-08T18:08:49.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9566000000000003e-05 2024-05-08T18:08:49.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154912+0000", 2024-05-08T18:08:49.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010852400000000001 2024-05-08T18:08:49.788 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.788 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.310942666000003, 2024-05-08T18:08:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002844437, 2024-05-08T18:08:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.789 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 882 2024-05-08T18:08:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395250+0000", 2024-05-08T18:08:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-06 2024-05-08T18:08:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395261+0000", 2024-05-08T18:08:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1046000000000001e-05 2024-05-08T18:08:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395293+0000", 2024-05-08T18:08:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1473999999999997e-05 2024-05-08T18:08:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395307+0000", 2024-05-08T18:08:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4599e-05 2024-05-08T18:08:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395481+0000", 2024-05-08T18:08:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173499 2024-05-08T18:08:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395626+0000", 2024-05-08T18:08:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000145351 2024-05-08T18:08:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395902+0000", 2024-05-08T18:08:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027534499999999997 2024-05-08T18:08:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397118+0000", 2024-05-08T18:08:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012168929999999999 2024-05-08T18:08:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397951+0000", 2024-05-08T18:08:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000832272 2024-05-08T18:08:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398028+0000", 2024-05-08T18:08:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6921000000000004e-05 2024-05-08T18:08:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398092+0000", 2024-05-08T18:08:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4783999999999995e-05 2024-05-08T18:08:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.794 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.307881945999995, 2024-05-08T18:08:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002853894, 2024-05-08T18:08:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 883 2024-05-08T18:08:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:49.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398311+0000", 2024-05-08T18:08:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398321+0000", 2024-05-08T18:08:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9189999999999994e-06 2024-05-08T18:08:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398346+0000", 2024-05-08T18:08:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5065000000000001e-05 2024-05-08T18:08:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398360+0000", 2024-05-08T18:08:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4171999999999999e-05 2024-05-08T18:08:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398495+0000", 2024-05-08T18:08:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013503199999999999 2024-05-08T18:08:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398716+0000", 2024-05-08T18:08:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220459 2024-05-08T18:08:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.399054+0000", 2024-05-08T18:08:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033806199999999998 2024-05-08T18:08:49.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.400192+0000", 2024-05-08T18:08:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011389169999999999 2024-05-08T18:08:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401020+0000", 2024-05-08T18:08:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082746199999999995 2024-05-08T18:08:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401099+0000", 2024-05-08T18:08:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9157000000000001e-05 2024-05-08T18:08:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401163+0000", 2024-05-08T18:08:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3498999999999996e-05 2024-05-08T18:08:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.800 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.304093108999993, 2024-05-08T18:08:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031354040000000001, 2024-05-08T18:08:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 885 2024-05-08T18:08:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:49.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402100+0000", 2024-05-08T18:08:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.063e-06 2024-05-08T18:08:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402110+0000", 2024-05-08T18:08:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0453e-05 2024-05-08T18:08:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402141+0000", 2024-05-08T18:08:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0651000000000002e-05 2024-05-08T18:08:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402162+0000", 2024-05-08T18:08:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1373999999999999e-05 2024-05-08T18:08:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402306+0000", 2024-05-08T18:08:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143492 2024-05-08T18:08:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402562+0000", 2024-05-08T18:08:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025671899999999998 2024-05-08T18:08:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.403047+0000", 2024-05-08T18:08:49.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048419100000000003 2024-05-08T18:08:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404370+0000", 2024-05-08T18:08:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013231580000000001 2024-05-08T18:08:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404966+0000", 2024-05-08T18:08:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00059601100000000002 2024-05-08T18:08:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405115+0000", 2024-05-08T18:08:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149665 2024-05-08T18:08:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405233+0000", 2024-05-08T18:08:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117627 2024-05-08T18:08:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.206795573999997, 2024-05-08T18:08:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003251168, 2024-05-08T18:08:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 927 2024-05-08T18:08:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499396+0000", 2024-05-08T18:08:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:08:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499404+0000", 2024-05-08T18:08:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2629999999999997e-06 2024-05-08T18:08:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499423+0000", 2024-05-08T18:08:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9695e-05 2024-05-08T18:08:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499435+0000", 2024-05-08T18:08:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1542999999999999e-05 2024-05-08T18:08:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499545+0000", 2024-05-08T18:08:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110064 2024-05-08T18:08:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499764+0000", 2024-05-08T18:08:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021856499999999999 2024-05-08T18:08:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.500237+0000", 2024-05-08T18:08:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047359499999999999 2024-05-08T18:08:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.501627+0000", 2024-05-08T18:08:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013897860000000001 2024-05-08T18:08:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502484+0000", 2024-05-08T18:08:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085733300000000005 2024-05-08T18:08:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502574+0000", 2024-05-08T18:08:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9939999999999996e-05 2024-05-08T18:08:49.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502646+0000", 2024-05-08T18:08:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2064000000000007e-05 2024-05-08T18:08:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.203296033000001, 2024-05-08T18:08:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031881129999999998, 2024-05-08T18:08:49.812 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 928 2024-05-08T18:08:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502897+0000", 2024-05-08T18:08:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.916e-06 2024-05-08T18:08:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502906+0000", 2024-05-08T18:08:49.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2699999999999993e-06 2024-05-08T18:08:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502933+0000", 2024-05-08T18:08:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6823999999999999e-05 2024-05-08T18:08:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502946+0000", 2024-05-08T18:08:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3439e-05 2024-05-08T18:08:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:49.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503066+0000", 2024-05-08T18:08:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012013700000000001 2024-05-08T18:08:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503399+0000", 2024-05-08T18:08:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033298600000000001 2024-05-08T18:08:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503928+0000", 2024-05-08T18:08:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052877299999999996 2024-05-08T18:08:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505291+0000", 2024-05-08T18:08:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001363319 2024-05-08T18:08:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505933+0000", 2024-05-08T18:08:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064135799999999997 2024-05-08T18:08:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506019+0000", 2024-05-08T18:08:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6649000000000003e-05 2024-05-08T18:08:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:49.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506083+0000", 2024-05-08T18:08:49.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3441999999999993e-05 2024-05-08T18:08:49.818 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.818 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.818 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.818 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:49.818 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:49.818 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:49.820 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:08:49.820 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:49.820+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:49.839 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:49.839 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:49.869 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:49.869 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:49.899 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:49.899 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:49.920 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:49.921+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:49.928 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:49.929 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:49.960 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:49.960 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:49.988 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:08:49.992 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:49.993 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:49.993 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:49.993 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:50.008 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:08:50.020 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:50.020+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:50.025 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:50.025 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:50.058 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:50.058 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:50.121 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:50.121+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:50.180 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:50.180 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:50.194 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:08:50.221 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:50.220+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:50.322 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:50.321+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:50.362 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:50.362 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:50.375 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:08:50.423 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:50.424+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:50.524 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:50.524+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:50.532 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:50.532 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:50.545 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:08:50.625 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:50.624+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:50.670 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:50.670 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:50.684 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:08:50.728 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:50.729+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:50.801 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:50.801 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:50.815 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:08:50.827 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:50.828+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:50.928 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:50.928+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:50.969 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-05-08T18:08:50.977 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:50.977 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:50.991 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:08:51.036 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:51.037+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:51.112 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:51.112 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:51.126 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:08:51.130 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:51.132+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:51.230 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:51.232+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:51.287 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:51.287 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:51.301 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:08:51.346 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:51.348+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:51.432 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:51.433+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:51.470 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:51.470 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:51.489 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:08:51.578 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:51.580+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:51.632 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:51.632+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:51.638 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:51.639 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:51.652 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:08:51.734 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:51.733+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:51.835 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:51.833+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:51.863 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:51.863 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:51.882 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:08:51.935 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:51.933+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:52.036 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:52.037+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:52.056 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:52.057 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:52.076 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:08:52.083 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:08:52.166 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:52.168+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:52.237 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:52.236+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:52.246 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:52.246 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:52.265 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:08:52.320 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:52.320 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:52.338 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:52.340+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:52.351 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:52.351 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:52.382 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:52.382 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:52.412 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:52.413 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:52.439 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:52.440+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:52.445 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:52.445 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:52.477 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:52.477 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:52.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:52.477 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:52.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.477 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:52.477 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:52.478 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 88.910451320999996, 2024-05-08T18:08:52.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035750999999999999, 2024-05-08T18:08:52.478 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.478 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.478 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.478 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:52.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570196+0000", 2024-05-08T18:08:52.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570203+0000", 2024-05-08T18:08:52.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6749999999999996e-06 2024-05-08T18:08:52.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570213+0000", 2024-05-08T18:08:52.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0139999999999999e-05 2024-05-08T18:08:52.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570231+0000", 2024-05-08T18:08:52.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8402000000000001e-05 2024-05-08T18:08:52.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570245+0000", 2024-05-08T18:08:52.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3135e-05 2024-05-08T18:08:52.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570338+0000", 2024-05-08T18:08:52.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3498000000000005e-05 2024-05-08T18:08:52.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.570373+0000", 2024-05-08T18:08:52.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5179999999999999e-05 2024-05-08T18:08:52.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573694+0000", 2024-05-08T18:08:52.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003320524 2024-05-08T18:08:52.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.573771+0000", 2024-05-08T18:08:52.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7546000000000006e-05 2024-05-08T18:08:52.481 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.481 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.481 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.482 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:49 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'2, mlcod=0'0)", 2024-05-08T18:08:52.482 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:52.482 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 88.905138359000006, 2024-05-08T18:08:52.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038280229999999998, 2024-05-08T18:08:52.482 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.482 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.482 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.482 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:52.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575509+0000", 2024-05-08T18:08:52.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575510+0000", 2024-05-08T18:08:52.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0979999999999999e-06 2024-05-08T18:08:52.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575527+0000", 2024-05-08T18:08:52.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6393999999999999e-05 2024-05-08T18:08:52.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575549+0000", 2024-05-08T18:08:52.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1843000000000001e-05 2024-05-08T18:08:52.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575560+0000", 2024-05-08T18:08:52.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.186e-05 2024-05-08T18:08:52.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575651+0000", 2024-05-08T18:08:52.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1068000000000003e-05 2024-05-08T18:08:52.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.575685+0000", 2024-05-08T18:08:52.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3614e-05 2024-05-08T18:08:52.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579231+0000", 2024-05-08T18:08:52.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003546249 2024-05-08T18:08:52.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579337+0000", 2024-05-08T18:08:52.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010589700000000001 2024-05-08T18:08:52.486 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.486 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.486 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.486 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:51 7.15 e29/28 7:a93a5511:::notify.2:head v 29'2, mlcod=0'0)", 2024-05-08T18:08:52.486 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:52.486 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 88.903101067999998, 2024-05-08T18:08:52.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004223157, 2024-05-08T18:08:52.486 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.486 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.486 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.487 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:52.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577547+0000", 2024-05-08T18:08:52.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577548+0000", 2024-05-08T18:08:52.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.66e-06 2024-05-08T18:08:52.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577561+0000", 2024-05-08T18:08:52.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2533e-05 2024-05-08T18:08:52.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577585+0000", 2024-05-08T18:08:52.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3873e-05 2024-05-08T18:08:52.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577605+0000", 2024-05-08T18:08:52.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0477000000000001e-05 2024-05-08T18:08:52.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577717+0000", 2024-05-08T18:08:52.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011229499999999999 2024-05-08T18:08:52.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577777+0000", 2024-05-08T18:08:52.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.944e-05 2024-05-08T18:08:52.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581704+0000", 2024-05-08T18:08:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039267800000000004 2024-05-08T18:08:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.581770+0000", 2024-05-08T18:08:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6099000000000005e-05 2024-05-08T18:08:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:54 7.d e29/28 7:b4812045:::notify.4:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:52.490 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 88.900288344000003, 2024-05-08T18:08:52.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003988503, 2024-05-08T18:08:52.491 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.491 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.491 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.491 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:52.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580359+0000", 2024-05-08T18:08:52.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580368+0000", 2024-05-08T18:08:52.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3089999999999996e-06 2024-05-08T18:08:52.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580400+0000", 2024-05-08T18:08:52.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2580000000000003e-05 2024-05-08T18:08:52.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580427+0000", 2024-05-08T18:08:52.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6976999999999999e-05 2024-05-08T18:08:52.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580443+0000", 2024-05-08T18:08:52.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5585000000000001e-05 2024-05-08T18:08:52.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580555+0000", 2024-05-08T18:08:52.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112639 2024-05-08T18:08:52.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.580601+0000", 2024-05-08T18:08:52.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6e-05 2024-05-08T18:08:52.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584229+0000", 2024-05-08T18:08:52.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036273659999999999 2024-05-08T18:08:52.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.584348+0000", 2024-05-08T18:08:52.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119047 2024-05-08T18:08:52.495 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.495 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.495 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.495 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:52.495 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:52.495 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 88.790875073999999, 2024-05-08T18:08:52.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032136159999999999, 2024-05-08T18:08:52.495 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.495 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.495 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.495 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:52.495 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:52.496 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:52.496 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 193 2024-05-08T18:08:52.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.496 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:52.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689773+0000", 2024-05-08T18:08:52.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689775+0000", 2024-05-08T18:08:52.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.357e-06 2024-05-08T18:08:52.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689788+0000", 2024-05-08T18:08:52.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3029e-05 2024-05-08T18:08:52.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689819+0000", 2024-05-08T18:08:52.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.065e-05 2024-05-08T18:08:52.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689833+0000", 2024-05-08T18:08:52.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4790000000000001e-05 2024-05-08T18:08:52.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.689948+0000", 2024-05-08T18:08:52.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115089 2024-05-08T18:08:52.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690155+0000", 2024-05-08T18:08:52.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206932 2024-05-08T18:08:52.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:52.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.690420+0000", 2024-05-08T18:08:52.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026450200000000001 2024-05-08T18:08:52.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:52.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692229+0000", 2024-05-08T18:08:52.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001808823 2024-05-08T18:08:52.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:52.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692816+0000", 2024-05-08T18:08:52.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058773199999999999 2024-05-08T18:08:52.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692915+0000", 2024-05-08T18:08:52.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8646000000000004e-05 2024-05-08T18:08:52.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.692986+0000", 2024-05-08T18:08:52.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1066e-05 2024-05-08T18:08:52.500 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.500 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.501 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.501 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:52.501 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:52.501 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.891908854999997, 2024-05-08T18:08:52.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089431319999999995, 2024-05-08T18:08:52.501 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.501 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.501 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.501 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:52.501 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:52.501 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:52.502 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 208 2024-05-08T18:08:52.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.502 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:52.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588739+0000", 2024-05-08T18:08:52.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588741+0000", 2024-05-08T18:08:52.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:08:52.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588752+0000", 2024-05-08T18:08:52.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0813e-05 2024-05-08T18:08:52.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588782+0000", 2024-05-08T18:08:52.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0020000000000001e-05 2024-05-08T18:08:52.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588803+0000", 2024-05-08T18:08:52.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1115999999999999e-05 2024-05-08T18:08:52.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588943+0000", 2024-05-08T18:08:52.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013971599999999999 2024-05-08T18:08:52.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:08:52.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588954+0000", 2024-05-08T18:08:52.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1365999999999999e-05 2024-05-08T18:08:52.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594340+0000", 2024-05-08T18:08:52.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053854910000000001 2024-05-08T18:08:52.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.594670+0000", 2024-05-08T18:08:52.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000330055 2024-05-08T18:08:52.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:52.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.595179+0000", 2024-05-08T18:08:52.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050879199999999999 2024-05-08T18:08:52.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:52.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.596408+0000", 2024-05-08T18:08:52.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012295209999999999 2024-05-08T18:08:52.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:52.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597532+0000", 2024-05-08T18:08:52.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011233860000000001 2024-05-08T18:08:52.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597619+0000", 2024-05-08T18:08:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7775999999999994e-05 2024-05-08T18:08:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.597682+0000", 2024-05-08T18:08:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2522999999999998e-05 2024-05-08T18:08:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:52.507 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.863279876000007, 2024-05-08T18:08:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031262669999999998, 2024-05-08T18:08:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 212 2024-05-08T18:08:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617368+0000", 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617370+0000", 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617379+0000", 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2359999999999993e-06 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617405+0000", 2024-05-08T18:08:52.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5639999999999998e-05 2024-05-08T18:08:52.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617425+0000", 2024-05-08T18:08:52.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0457000000000001e-05 2024-05-08T18:08:52.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617573+0000", 2024-05-08T18:08:52.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014776200000000001 2024-05-08T18:08:52.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.617786+0000", 2024-05-08T18:08:52.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212418 2024-05-08T18:08:52.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:52.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.618177+0000", 2024-05-08T18:08:52.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039161699999999997 2024-05-08T18:08:52.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:52.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.619563+0000", 2024-05-08T18:08:52.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013852999999999999 2024-05-08T18:08:52.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:52.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620334+0000", 2024-05-08T18:08:52.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00077182200000000002 2024-05-08T18:08:52.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620426+0000", 2024-05-08T18:08:52.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1526000000000004e-05 2024-05-08T18:08:52.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.620494+0000", 2024-05-08T18:08:52.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8078999999999997e-05 2024-05-08T18:08:52.512 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.512 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.512 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.513 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:52.513 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:52.513 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.838961323000007, 2024-05-08T18:08:52.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035230880000000002, 2024-05-08T18:08:52.513 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.513 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.513 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.513 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:52.513 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:52.513 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:52.513 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 219 2024-05-08T18:08:52.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.513 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:52.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641686+0000", 2024-05-08T18:08:52.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641689+0000", 2024-05-08T18:08:52.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:08:52.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641700+0000", 2024-05-08T18:08:52.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1507e-05 2024-05-08T18:08:52.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641732+0000", 2024-05-08T18:08:52.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1585999999999999e-05 2024-05-08T18:08:52.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641754+0000", 2024-05-08T18:08:52.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1480000000000001e-05 2024-05-08T18:08:52.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.641942+0000", 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018826300000000001 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642165+0000", 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022301100000000001 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.642587+0000", 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042182400000000001 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.643767+0000", 2024-05-08T18:08:52.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001180675 2024-05-08T18:08:52.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:52.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645010+0000", 2024-05-08T18:08:52.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012427110000000001 2024-05-08T18:08:52.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645101+0000", 2024-05-08T18:08:52.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0871999999999993e-05 2024-05-08T18:08:52.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.645209+0000", 2024-05-08T18:08:52.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108496 2024-05-08T18:08:52.517 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.518 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.518 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.518 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:52.518 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:52.518 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.819164336, 2024-05-08T18:08:52.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035793639999999998, 2024-05-08T18:08:52.518 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.518 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.518 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.518 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:52.518 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:52.518 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:52.518 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 224 2024-05-08T18:08:52.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.519 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:52.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661483+0000", 2024-05-08T18:08:52.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661485+0000", 2024-05-08T18:08:52.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9759999999999998e-06 2024-05-08T18:08:52.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661494+0000", 2024-05-08T18:08:52.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3469999999999999e-06 2024-05-08T18:08:52.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661517+0000", 2024-05-08T18:08:52.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.389e-05 2024-05-08T18:08:52.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661537+0000", 2024-05-08T18:08:52.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9803e-05 2024-05-08T18:08:52.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661696+0000", 2024-05-08T18:08:52.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015865899999999999 2024-05-08T18:08:52.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.661910+0000", 2024-05-08T18:08:52.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021434199999999999 2024-05-08T18:08:52.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:52.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.662336+0000", 2024-05-08T18:08:52.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042575300000000001 2024-05-08T18:08:52.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:52.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.663720+0000", 2024-05-08T18:08:52.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013843799999999999 2024-05-08T18:08:52.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:52.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.664909+0000", 2024-05-08T18:08:52.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011889019999999999 2024-05-08T18:08:52.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665001+0000", 2024-05-08T18:08:52.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1649000000000003e-05 2024-05-08T18:08:52.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.665063+0000", 2024-05-08T18:08:52.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1662999999999996e-05 2024-05-08T18:08:52.523 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.523 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.523 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.523 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:52.523 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:52.523 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.786571061999993, 2024-05-08T18:08:52.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031551930000000001, 2024-05-08T18:08:52.524 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.524 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.524 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.524 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:52.524 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:52.524 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:52.524 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 233 2024-05-08T18:08:52.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.524 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:52.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694077+0000", 2024-05-08T18:08:52.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694079+0000", 2024-05-08T18:08:52.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:52.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694090+0000", 2024-05-08T18:08:52.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1182999999999999e-05 2024-05-08T18:08:52.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694119+0000", 2024-05-08T18:08:52.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9076000000000001e-05 2024-05-08T18:08:52.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694143+0000", 2024-05-08T18:08:52.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4363e-05 2024-05-08T18:08:52.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694291+0000", 2024-05-08T18:08:52.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147849 2024-05-08T18:08:52.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694534+0000", 2024-05-08T18:08:52.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000242382 2024-05-08T18:08:52.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:52.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.694957+0000", 2024-05-08T18:08:52.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042316700000000001 2024-05-08T18:08:52.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:52.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.696306+0000", 2024-05-08T18:08:52.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013489940000000001 2024-05-08T18:08:52.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:52.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697071+0000", 2024-05-08T18:08:52.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076482999999999998 2024-05-08T18:08:52.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697167+0000", 2024-05-08T18:08:52.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6773000000000003e-05 2024-05-08T18:08:52.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.697232+0000", 2024-05-08T18:08:52.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4386000000000003e-05 2024-05-08T18:08:52.529 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.529 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.529 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.529 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:328 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:52.529 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:52.529 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.754852475000007, 2024-05-08T18:08:52.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029659439999999999, 2024-05-08T18:08:52.529 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.529 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.529 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.530 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:52.530 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:52.530 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:52.530 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 328 2024-05-08T18:08:52.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.530 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:52.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725795+0000", 2024-05-08T18:08:52.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725796+0000", 2024-05-08T18:08:52.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-06 2024-05-08T18:08:52.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725802+0000", 2024-05-08T18:08:52.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7219999999999996e-06 2024-05-08T18:08:52.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725816+0000", 2024-05-08T18:08:52.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3886999999999999e-05 2024-05-08T18:08:52.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725824+0000", 2024-05-08T18:08:52.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5920000000000003e-06 2024-05-08T18:08:52.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725885+0000", 2024-05-08T18:08:52.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1526999999999996e-05 2024-05-08T18:08:52.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725972+0000", 2024-05-08T18:08:52.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7099000000000001e-05 2024-05-08T18:08:52.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:52.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726093+0000", 2024-05-08T18:08:52.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120383 2024-05-08T18:08:52.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:52.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.726717+0000", 2024-05-08T18:08:52.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062435099999999999 2024-05-08T18:08:52.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:52.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728693+0000", 2024-05-08T18:08:52.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019758309999999999 2024-05-08T18:08:52.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728731+0000", 2024-05-08T18:08:52.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8591999999999999e-05 2024-05-08T18:08:52.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.728761+0000", 2024-05-08T18:08:52.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9770000000000001e-05 2024-05-08T18:08:52.535 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.535 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.535 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.535 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:460 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:52.535 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:52.535 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.701035250999993, 2024-05-08T18:08:52.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040209540000000002, 2024-05-08T18:08:52.535 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.535 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.535 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:52.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:52.536 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:52.536 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 460 2024-05-08T18:08:52.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.536 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:52.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779612+0000", 2024-05-08T18:08:52.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779613+0000", 2024-05-08T18:08:52.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0690000000000001e-06 2024-05-08T18:08:52.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779619+0000", 2024-05-08T18:08:52.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3630000000000002e-06 2024-05-08T18:08:52.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779631+0000", 2024-05-08T18:08:52.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2211e-05 2024-05-08T18:08:52.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779637+0000", 2024-05-08T18:08:52.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0430000000000004e-06 2024-05-08T18:08:52.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779702+0000", 2024-05-08T18:08:52.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4481999999999997e-05 2024-05-08T18:08:52.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.779848+0000", 2024-05-08T18:08:52.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014608500000000001 2024-05-08T18:08:52.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:52.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780056+0000", 2024-05-08T18:08:52.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020889699999999999 2024-05-08T18:08:52.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:52.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.780700+0000", 2024-05-08T18:08:52.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064379300000000003 2024-05-08T18:08:52.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:52.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783576+0000", 2024-05-08T18:08:52.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028754919999999999 2024-05-08T18:08:52.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783608+0000", 2024-05-08T18:08:52.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2223e-05 2024-05-08T18:08:52.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.783633+0000", 2024-05-08T18:08:52.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5296e-05 2024-05-08T18:08:52.540 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.540 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.540 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.541 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:466 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:52.541 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:52.541 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.696497012999998, 2024-05-08T18:08:52.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028979520000000001, 2024-05-08T18:08:52.541 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.541 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.541 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.541 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:52.541 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:52.541 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:52.541 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 466 2024-05-08T18:08:52.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.541 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:52.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:52.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784151+0000", 2024-05-08T18:08:52.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.61e-07 2024-05-08T18:08:52.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784155+0000", 2024-05-08T18:08:52.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9299999999999996e-06 2024-05-08T18:08:52.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784165+0000", 2024-05-08T18:08:52.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5680000000000005e-06 2024-05-08T18:08:52.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784170+0000", 2024-05-08T18:08:52.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1379999999999998e-06 2024-05-08T18:08:52.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784219+0000", 2024-05-08T18:08:52.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9231999999999999e-05 2024-05-08T18:08:52.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784310+0000", 2024-05-08T18:08:52.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0797000000000005e-05 2024-05-08T18:08:52.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:52.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.784490+0000", 2024-05-08T18:08:52.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179705 2024-05-08T18:08:52.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:52.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.785090+0000", 2024-05-08T18:08:52.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060073899999999998 2024-05-08T18:08:52.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:52.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.786973+0000", 2024-05-08T18:08:52.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018824460000000001 2024-05-08T18:08:52.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787007+0000", 2024-05-08T18:08:52.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3779999999999998e-05 2024-05-08T18:08:52.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.787049+0000", 2024-05-08T18:08:52.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1856e-05 2024-05-08T18:08:52.546 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.546 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.546 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.546 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:477 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:52.546 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:52.547 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.689355019000004, 2024-05-08T18:08:52.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046076989999999998, 2024-05-08T18:08:52.547 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.547 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.547 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.547 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:52.547 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:52.547 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:52.547 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 477 2024-05-08T18:08:52.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.547 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:52.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791293+0000", 2024-05-08T18:08:52.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791294+0000", 2024-05-08T18:08:52.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-06 2024-05-08T18:08:52.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791300+0000", 2024-05-08T18:08:52.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5320000000000003e-06 2024-05-08T18:08:52.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791313+0000", 2024-05-08T18:08:52.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2576e-05 2024-05-08T18:08:52.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791319+0000", 2024-05-08T18:08:52.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1720000000000004e-06 2024-05-08T18:08:52.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791379+0000", 2024-05-08T18:08:52.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0343000000000001e-05 2024-05-08T18:08:52.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791477+0000", 2024-05-08T18:08:52.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7662000000000001e-05 2024-05-08T18:08:52.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:52.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.791678+0000", 2024-05-08T18:08:52.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000200788 2024-05-08T18:08:52.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:52.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.792263+0000", 2024-05-08T18:08:52.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00058525700000000005 2024-05-08T18:08:52.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:52.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795842+0000", 2024-05-08T18:08:52.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035787079999999999 2024-05-08T18:08:52.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795874+0000", 2024-05-08T18:08:52.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2205000000000001e-05 2024-05-08T18:08:52.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.795900+0000", 2024-05-08T18:08:52.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6222000000000001e-05 2024-05-08T18:08:52.552 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.552 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.552 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.552 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:642 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:52.552 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:52.552 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.550595315999999, 2024-05-08T18:08:52.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030444059999999999, 2024-05-08T18:08:52.552 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.552 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.552 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.552 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:52.552 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:52.553 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:52.553 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 642 2024-05-08T18:08:52.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.553 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:52.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930052+0000", 2024-05-08T18:08:52.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930055+0000", 2024-05-08T18:08:52.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7999999999999999e-06 2024-05-08T18:08:52.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930065+0000", 2024-05-08T18:08:52.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0176999999999999e-05 2024-05-08T18:08:52.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930092+0000", 2024-05-08T18:08:52.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6460000000000001e-05 2024-05-08T18:08:52.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930112+0000", 2024-05-08T18:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0043000000000001e-05 2024-05-08T18:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930219+0000", 2024-05-08T18:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010698500000000001 2024-05-08T18:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930345+0000", 2024-05-08T18:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012620400000000001 2024-05-08T18:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.930579+0000", 2024-05-08T18:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234145 2024-05-08T18:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.931471+0000", 2024-05-08T18:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00089161500000000001 2024-05-08T18:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.932978+0000", 2024-05-08T18:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001507296 2024-05-08T18:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933044+0000", 2024-05-08T18:08:52.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6402000000000006e-05 2024-05-08T18:08:52.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.933097+0000", 2024-05-08T18:08:52.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2278999999999999e-05 2024-05-08T18:08:52.557 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.557 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.557 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.557 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:681 6.e e32/26 6:748722ff:gc::gc.6:head v 32'7, mlcod=32'5)", 2024-05-08T18:08:52.557 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:52.557 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.519799739000007, 2024-05-08T18:08:52.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003318185, 2024-05-08T18:08:52.558 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.558 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.558 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.558 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:52.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960848+0000", 2024-05-08T18:08:52.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960849+0000", 2024-05-08T18:08:52.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.423e-06 2024-05-08T18:08:52.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960859+0000", 2024-05-08T18:08:52.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3170000000000008e-06 2024-05-08T18:08:52.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960874+0000", 2024-05-08T18:08:52.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5125e-05 2024-05-08T18:08:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960884+0000", 2024-05-08T18:08:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8120000000000002e-06 2024-05-08T18:08:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960972+0000", 2024-05-08T18:08:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8540000000000003e-05 2024-05-08T18:08:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.960996+0000", 2024-05-08T18:08:52.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3479999999999999e-05 2024-05-08T18:08:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964110+0000", 2024-05-08T18:08:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031142729999999999 2024-05-08T18:08:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.964166+0000", 2024-05-08T18:08:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6215000000000003e-05 2024-05-08T18:08:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.428763644, 2024-05-08T18:08:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030648379999999999, 2024-05-08T18:08:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 733 2024-05-08T18:08:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.562 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051884+0000", 2024-05-08T18:08:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051887+0000", 2024-05-08T18:08:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.74e-06 2024-05-08T18:08:52.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051900+0000", 2024-05-08T18:08:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3113e-05 2024-05-08T18:08:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051931+0000", 2024-05-08T18:08:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1665999999999998e-05 2024-05-08T18:08:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.051946+0000", 2024-05-08T18:08:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4780000000000001e-05 2024-05-08T18:08:52.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052078+0000", 2024-05-08T18:08:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013133200000000001 2024-05-08T18:08:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052338+0000", 2024-05-08T18:08:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026056899999999999 2024-05-08T18:08:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.052652+0000", 2024-05-08T18:08:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031396700000000001 2024-05-08T18:08:52.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:52.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.053668+0000", 2024-05-08T18:08:52.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00101574 2024-05-08T18:08:52.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:52.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054800+0000", 2024-05-08T18:08:52.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011319819999999999 2024-05-08T18:08:52.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054884+0000", 2024-05-08T18:08:52.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4005999999999995e-05 2024-05-08T18:08:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.054949+0000", 2024-05-08T18:08:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4943000000000005e-05 2024-05-08T18:08:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.424909009000004, 2024-05-08T18:08:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029745919999999999, 2024-05-08T18:08:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.567 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.568 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.568 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:52.568 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:52.568 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:52.568 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 735 2024-05-08T18:08:52.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.568 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:52.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055739+0000", 2024-05-08T18:08:52.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055741+0000", 2024-05-08T18:08:52.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.984e-06 2024-05-08T18:08:52.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055766+0000", 2024-05-08T18:08:52.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5253e-05 2024-05-08T18:08:52.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055785+0000", 2024-05-08T18:08:52.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9559999999999999e-05 2024-05-08T18:08:52.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055798+0000", 2024-05-08T18:08:52.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.234e-05 2024-05-08T18:08:52.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.055932+0000", 2024-05-08T18:08:52.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134609 2024-05-08T18:08:52.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056184+0000", 2024-05-08T18:08:52.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025167800000000003 2024-05-08T18:08:52.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:52.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.056680+0000", 2024-05-08T18:08:52.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049576299999999998 2024-05-08T18:08:52.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:52.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058060+0000", 2024-05-08T18:08:52.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013801 2024-05-08T18:08:52.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058447+0000", 2024-05-08T18:08:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038695299999999999 2024-05-08T18:08:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058601+0000", 2024-05-08T18:08:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015396299999999999 2024-05-08T18:08:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.058713+0000", 2024-05-08T18:08:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112389 2024-05-08T18:08:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.572 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.317893659000006, 2024-05-08T18:08:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029913650000000002, 2024-05-08T18:08:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 781 2024-05-08T18:08:52.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162754+0000", 2024-05-08T18:08:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162757+0000", 2024-05-08T18:08:52.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:08:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162770+0000", 2024-05-08T18:08:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3406e-05 2024-05-08T18:08:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162799+0000", 2024-05-08T18:08:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-05 2024-05-08T18:08:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162813+0000", 2024-05-08T18:08:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:08:52.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.162942+0000", 2024-05-08T18:08:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012902200000000001 2024-05-08T18:08:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163159+0000", 2024-05-08T18:08:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021738500000000001 2024-05-08T18:08:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.163476+0000", 2024-05-08T18:08:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031666499999999999 2024-05-08T18:08:52.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.164533+0000", 2024-05-08T18:08:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010574219999999999 2024-05-08T18:08:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165587+0000", 2024-05-08T18:08:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001053476 2024-05-08T18:08:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165674+0000", 2024-05-08T18:08:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6725999999999996e-05 2024-05-08T18:08:52.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.165745+0000", 2024-05-08T18:08:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1779000000000005e-05 2024-05-08T18:08:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 84.935303810999997, 2024-05-08T18:08:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029834750000000002, 2024-05-08T18:08:52.578 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 946 2024-05-08T18:08:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:52.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545344+0000", 2024-05-08T18:08:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545346+0000", 2024-05-08T18:08:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6570000000000001e-06 2024-05-08T18:08:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545357+0000", 2024-05-08T18:08:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0740000000000001e-05 2024-05-08T18:08:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:52.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545384+0000", 2024-05-08T18:08:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6780000000000001e-05 2024-05-08T18:08:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545398+0000", 2024-05-08T18:08:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3936e-05 2024-05-08T18:08:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545515+0000", 2024-05-08T18:08:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117413 2024-05-08T18:08:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.545751+0000", 2024-05-08T18:08:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023559500000000001 2024-05-08T18:08:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.546075+0000", 2024-05-08T18:08:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000324357 2024-05-08T18:08:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.547104+0000", 2024-05-08T18:08:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010285959999999999 2024-05-08T18:08:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548141+0000", 2024-05-08T18:08:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001036922 2024-05-08T18:08:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548223+0000", 2024-05-08T18:08:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2260000000000002e-05 2024-05-08T18:08:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.548327+0000", 2024-05-08T18:08:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104219 2024-05-08T18:08:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.583 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:52.584 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:52.584 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:52.584 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:52.585 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:52.586 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:08:52.586 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:52.586 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:52.586 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:52.587 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:52.585+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:52.686 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:52.685+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:52.787 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:52.785+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:52.798 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:52.798 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:52.798 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:52.798 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:52.815 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:08:52.887 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:52.888+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:52.983 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:52.983 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:52.983 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:52.983 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:52.984 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:52.988 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:52.988+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:53.001 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:08:53.002 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:08:53.089 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:53.089+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:53.189 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:53.188+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:53.214 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:53.214 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:53.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:53.214 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:53.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.214 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 89.641376459, 2024-05-08T18:08:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002466088, 2024-05-08T18:08:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 52 2024-05-08T18:08:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577062+0000", 2024-05-08T18:08:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.994e-06 2024-05-08T18:08:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577075+0000", 2024-05-08T18:08:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2480000000000001e-05 2024-05-08T18:08:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577108+0000", 2024-05-08T18:08:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3096000000000003e-05 2024-05-08T18:08:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577131+0000", 2024-05-08T18:08:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2993000000000002e-05 2024-05-08T18:08:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577260+0000", 2024-05-08T18:08:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012912899999999999 2024-05-08T18:08:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577453+0000", 2024-05-08T18:08:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000193668 2024-05-08T18:08:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577634+0000", 2024-05-08T18:08:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180576 2024-05-08T18:08:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579082+0000", 2024-05-08T18:08:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001448083 2024-05-08T18:08:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579290+0000", 2024-05-08T18:08:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000208333 2024-05-08T18:08:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579403+0000", 2024-05-08T18:08:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011296800000000001 2024-05-08T18:08:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579525+0000", 2024-05-08T18:08:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121768 2024-05-08T18:08:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 89.629516694000003, 2024-05-08T18:08:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038858310000000002, 2024-05-08T18:08:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.220 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588920+0000", 2024-05-08T18:08:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.23e-07 2024-05-08T18:08:53.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588929+0000", 2024-05-08T18:08:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3659999999999998e-06 2024-05-08T18:08:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588948+0000", 2024-05-08T18:08:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8768000000000001e-05 2024-05-08T18:08:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588962+0000", 2024-05-08T18:08:53.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4e-05 2024-05-08T18:08:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589110+0000", 2024-05-08T18:08:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148047 2024-05-08T18:08:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589173+0000", 2024-05-08T18:08:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2766000000000002e-05 2024-05-08T18:08:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592728+0000", 2024-05-08T18:08:53.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035553300000000002 2024-05-08T18:08:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592805+0000", 2024-05-08T18:08:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6730999999999994e-05 2024-05-08T18:08:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.513447795999994, 2024-05-08T18:08:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034354310000000001, 2024-05-08T18:08:53.224 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 236 2024-05-08T18:08:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704991+0000", 2024-05-08T18:08:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1240000000000001e-06 2024-05-08T18:08:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705009+0000", 2024-05-08T18:08:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7819e-05 2024-05-08T18:08:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705048+0000", 2024-05-08T18:08:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9632999999999998e-05 2024-05-08T18:08:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705073+0000", 2024-05-08T18:08:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4686999999999999e-05 2024-05-08T18:08:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705241+0000", 2024-05-08T18:08:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759899999999999 2024-05-08T18:08:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705511+0000", 2024-05-08T18:08:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027018799999999998 2024-05-08T18:08:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705965+0000", 2024-05-08T18:08:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045433000000000002 2024-05-08T18:08:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.707487+0000", 2024-05-08T18:08:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015214810000000001 2024-05-08T18:08:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708125+0000", 2024-05-08T18:08:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063870300000000001 2024-05-08T18:08:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708298+0000", 2024-05-08T18:08:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172592 2024-05-08T18:08:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708423+0000", 2024-05-08T18:08:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125275 2024-05-08T18:08:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.229 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:308 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.496609894000002, 2024-05-08T18:08:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038707400000000001, 2024-05-08T18:08:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 308 2024-05-08T18:08:53.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721827+0000", 2024-05-08T18:08:53.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1519999999999999e-06 2024-05-08T18:08:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721840+0000", 2024-05-08T18:08:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.362e-05 2024-05-08T18:08:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721857+0000", 2024-05-08T18:08:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6901e-05 2024-05-08T18:08:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721867+0000", 2024-05-08T18:08:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0034000000000001e-05 2024-05-08T18:08:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721922+0000", 2024-05-08T18:08:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4450999999999998e-05 2024-05-08T18:08:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721981+0000", 2024-05-08T18:08:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9267e-05 2024-05-08T18:08:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722103+0000", 2024-05-08T18:08:53.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121502 2024-05-08T18:08:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722757+0000", 2024-05-08T18:08:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065419700000000003 2024-05-08T18:08:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725619+0000", 2024-05-08T18:08:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002862107 2024-05-08T18:08:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725654+0000", 2024-05-08T18:08:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:08:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725696+0000", 2024-05-08T18:08:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:08:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:604 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.319327188000003, 2024-05-08T18:08:53.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002741884, 2024-05-08T18:08:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 604 2024-05-08T18:08:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899111+0000", 2024-05-08T18:08:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0910000000000001e-06 2024-05-08T18:08:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899126+0000", 2024-05-08T18:08:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:08:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899159+0000", 2024-05-08T18:08:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3241999999999998e-05 2024-05-08T18:08:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899174+0000", 2024-05-08T18:08:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5235000000000001e-05 2024-05-08T18:08:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899316+0000", 2024-05-08T18:08:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014175599999999999 2024-05-08T18:08:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899525+0000", 2024-05-08T18:08:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020915300000000001 2024-05-08T18:08:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899872+0000", 2024-05-08T18:08:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034668299999999997 2024-05-08T18:08:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901064+0000", 2024-05-08T18:08:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001191473 2024-05-08T18:08:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901664+0000", 2024-05-08T18:08:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060054599999999998 2024-05-08T18:08:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901779+0000", 2024-05-08T18:08:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011452500000000001 2024-05-08T18:08:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901850+0000", 2024-05-08T18:08:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1580000000000002e-05 2024-05-08T18:08:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.240 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:612 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.313818624999996, 2024-05-08T18:08:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025904750000000001, 2024-05-08T18:08:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 612 2024-05-08T18:08:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.241 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904619+0000", 2024-05-08T18:08:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8479999999999999e-06 2024-05-08T18:08:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904628+0000", 2024-05-08T18:08:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8829999999999995e-06 2024-05-08T18:08:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904650+0000", 2024-05-08T18:08:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2467999999999999e-05 2024-05-08T18:08:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904669+0000", 2024-05-08T18:08:53.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9303000000000001e-05 2024-05-08T18:08:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904766+0000", 2024-05-08T18:08:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6917999999999996e-05 2024-05-08T18:08:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904935+0000", 2024-05-08T18:08:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000168441 2024-05-08T18:08:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:53.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.905288+0000", 2024-05-08T18:08:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035312199999999998 2024-05-08T18:08:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.906520+0000", 2024-05-08T18:08:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001232005 2024-05-08T18:08:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907086+0000", 2024-05-08T18:08:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056658900000000005 2024-05-08T18:08:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907154+0000", 2024-05-08T18:08:53.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7197000000000001e-05 2024-05-08T18:08:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907207+0000", 2024-05-08T18:08:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3701e-05 2024-05-08T18:08:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:53.246 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.145801031999994, 2024-05-08T18:08:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032464490000000002, 2024-05-08T18:08:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 742 2024-05-08T18:08:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072637+0000", 2024-05-08T18:08:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9059999999999998e-06 2024-05-08T18:08:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072651+0000", 2024-05-08T18:08:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3477e-05 2024-05-08T18:08:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072683+0000", 2024-05-08T18:08:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2116000000000002e-05 2024-05-08T18:08:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072698+0000", 2024-05-08T18:08:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5454000000000001e-05 2024-05-08T18:08:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072845+0000", 2024-05-08T18:08:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146532 2024-05-08T18:08:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073241+0000", 2024-05-08T18:08:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039580699999999997 2024-05-08T18:08:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073812+0000", 2024-05-08T18:08:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057164900000000003 2024-05-08T18:08:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075063+0000", 2024-05-08T18:08:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001250131 2024-05-08T18:08:53.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075723+0000", 2024-05-08T18:08:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00066039199999999999 2024-05-08T18:08:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075808+0000", 2024-05-08T18:08:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5458999999999996e-05 2024-05-08T18:08:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075881+0000", 2024-05-08T18:08:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2526000000000003e-05 2024-05-08T18:08:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.251 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.252 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.103392666999994, 2024-05-08T18:08:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029270590000000001, 2024-05-08T18:08:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.254 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 760 2024-05-08T18:08:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115045+0000", 2024-05-08T18:08:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0729999999999999e-06 2024-05-08T18:08:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115057+0000", 2024-05-08T18:08:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1617000000000001e-05 2024-05-08T18:08:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115088+0000", 2024-05-08T18:08:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1155999999999998e-05 2024-05-08T18:08:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115103+0000", 2024-05-08T18:08:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5067e-05 2024-05-08T18:08:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115289+0000", 2024-05-08T18:08:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186582 2024-05-08T18:08:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115506+0000", 2024-05-08T18:08:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021690500000000001 2024-05-08T18:08:53.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115832+0000", 2024-05-08T18:08:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032556799999999998 2024-05-08T18:08:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.116892+0000", 2024-05-08T18:08:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010597989999999999 2024-05-08T18:08:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117807+0000", 2024-05-08T18:08:53.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091502599999999999 2024-05-08T18:08:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117895+0000", 2024-05-08T18:08:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7977000000000001e-05 2024-05-08T18:08:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117970+0000", 2024-05-08T18:08:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5289000000000004e-05 2024-05-08T18:08:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.972395180999996, 2024-05-08T18:08:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028290730000000001, 2024-05-08T18:08:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 817 2024-05-08T18:08:53.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246043+0000", 2024-05-08T18:08:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.807e-06 2024-05-08T18:08:53.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246056+0000", 2024-05-08T18:08:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2383e-05 2024-05-08T18:08:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246087+0000", 2024-05-08T18:08:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1937000000000003e-05 2024-05-08T18:08:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246104+0000", 2024-05-08T18:08:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6643e-05 2024-05-08T18:08:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246225+0000", 2024-05-08T18:08:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012061900000000001 2024-05-08T18:08:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246510+0000", 2024-05-08T18:08:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028507100000000002 2024-05-08T18:08:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246881+0000", 2024-05-08T18:08:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037163799999999998 2024-05-08T18:08:53.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248078+0000", 2024-05-08T18:08:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011968969999999999 2024-05-08T18:08:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248715+0000", 2024-05-08T18:08:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063698599999999998 2024-05-08T18:08:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248801+0000", 2024-05-08T18:08:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5772999999999993e-05 2024-05-08T18:08:53.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248869+0000", 2024-05-08T18:08:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8318999999999994e-05 2024-05-08T18:08:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.918651697000001, 2024-05-08T18:08:53.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003281693, 2024-05-08T18:08:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 841 2024-05-08T18:08:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299786+0000", 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4770000000000002e-06 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299798+0000", 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1493e-05 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.267 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299827+0000", 2024-05-08T18:08:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9363e-05 2024-05-08T18:08:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299842+0000", 2024-05-08T18:08:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.448e-05 2024-05-08T18:08:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300001+0000", 2024-05-08T18:08:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015909600000000001 2024-05-08T18:08:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300384+0000", 2024-05-08T18:08:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038306000000000001 2024-05-08T18:08:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300929+0000", 2024-05-08T18:08:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054551299999999997 2024-05-08T18:08:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302151+0000", 2024-05-08T18:08:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012218540000000001 2024-05-08T18:08:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302918+0000", 2024-05-08T18:08:53.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076719099999999997 2024-05-08T18:08:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303000+0000", 2024-05-08T18:08:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1662999999999994e-05 2024-05-08T18:08:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303065+0000", 2024-05-08T18:08:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5502999999999999e-05 2024-05-08T18:08:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.914456240999996, 2024-05-08T18:08:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026179150000000002, 2024-05-08T18:08:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 843 2024-05-08T18:08:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.271 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303981+0000", 2024-05-08T18:08:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9740000000000001e-06 2024-05-08T18:08:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303990+0000", 2024-05-08T18:08:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9889999999999998e-06 2024-05-08T18:08:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304012+0000", 2024-05-08T18:08:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1537000000000001e-05 2024-05-08T18:08:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304023+0000", 2024-05-08T18:08:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:08:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304101+0000", 2024-05-08T18:08:53.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7732999999999996e-05 2024-05-08T18:08:53.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304210+0000", 2024-05-08T18:08:53.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010985299999999999 2024-05-08T18:08:53.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:53.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304490+0000", 2024-05-08T18:08:53.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000279564 2024-05-08T18:08:53.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.305542+0000", 2024-05-08T18:08:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051976 2024-05-08T18:08:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306451+0000", 2024-05-08T18:08:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00090901999999999997 2024-05-08T18:08:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306533+0000", 2024-05-08T18:08:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1790000000000001e-05 2024-05-08T18:08:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306597+0000", 2024-05-08T18:08:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4332999999999995e-05 2024-05-08T18:08:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.904760030999995, 2024-05-08T18:08:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00275537, 2024-05-08T18:08:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.276 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 847 2024-05-08T18:08:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313678+0000", 2024-05-08T18:08:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:08:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313689+0000", 2024-05-08T18:08:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1273e-05 2024-05-08T18:08:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.278 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313719+0000", 2024-05-08T18:08:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9726e-05 2024-05-08T18:08:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313733+0000", 2024-05-08T18:08:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4487e-05 2024-05-08T18:08:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313858+0000", 2024-05-08T18:08:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125172 2024-05-08T18:08:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314072+0000", 2024-05-08T18:08:53.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021314200000000001 2024-05-08T18:08:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314378+0000", 2024-05-08T18:08:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030653100000000002 2024-05-08T18:08:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.315524+0000", 2024-05-08T18:08:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011458950000000001 2024-05-08T18:08:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316213+0000", 2024-05-08T18:08:53.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068942199999999997 2024-05-08T18:08:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316314+0000", 2024-05-08T18:08:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100723 2024-05-08T18:08:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316431+0000", 2024-05-08T18:08:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116759 2024-05-08T18:08:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.901108093999994, 2024-05-08T18:08:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025522510000000002, 2024-05-08T18:08:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.282 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 849 2024-05-08T18:08:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317329+0000", 2024-05-08T18:08:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9530000000000002e-06 2024-05-08T18:08:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317340+0000", 2024-05-08T18:08:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.08e-05 2024-05-08T18:08:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317364+0000", 2024-05-08T18:08:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4142999999999999e-05 2024-05-08T18:08:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.284 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317377+0000", 2024-05-08T18:08:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2764e-05 2024-05-08T18:08:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317471+0000", 2024-05-08T18:08:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4289000000000005e-05 2024-05-08T18:08:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317600+0000", 2024-05-08T18:08:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012910499999999999 2024-05-08T18:08:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317868+0000", 2024-05-08T18:08:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000267562 2024-05-08T18:08:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319081+0000", 2024-05-08T18:08:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001213387 2024-05-08T18:08:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319723+0000", 2024-05-08T18:08:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064134200000000004 2024-05-08T18:08:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319808+0000", 2024-05-08T18:08:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319880+0000", 2024-05-08T18:08:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1426000000000004e-05 2024-05-08T18:08:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.287 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.857675612999998, 2024-05-08T18:08:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002815157, 2024-05-08T18:08:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 868 2024-05-08T18:08:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360762+0000", 2024-05-08T18:08:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:08:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360775+0000", 2024-05-08T18:08:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2840000000000001e-05 2024-05-08T18:08:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360805+0000", 2024-05-08T18:08:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9686e-05 2024-05-08T18:08:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360819+0000", 2024-05-08T18:08:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.434e-05 2024-05-08T18:08:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360948+0000", 2024-05-08T18:08:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000129033 2024-05-08T18:08:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361166+0000", 2024-05-08T18:08:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021747800000000001 2024-05-08T18:08:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361481+0000", 2024-05-08T18:08:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031515800000000001 2024-05-08T18:08:53.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.362546+0000", 2024-05-08T18:08:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010653889999999999 2024-05-08T18:08:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363365+0000", 2024-05-08T18:08:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081906100000000005 2024-05-08T18:08:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363450+0000", 2024-05-08T18:08:53.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5202000000000002e-05 2024-05-08T18:08:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363575+0000", 2024-05-08T18:08:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012460999999999999 2024-05-08T18:08:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.853983439999993, 2024-05-08T18:08:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024676260000000001, 2024-05-08T18:08:53.293 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 870 2024-05-08T18:08:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364454+0000", 2024-05-08T18:08:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7770000000000001e-06 2024-05-08T18:08:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364463+0000", 2024-05-08T18:08:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4800000000000007e-06 2024-05-08T18:08:53.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364487+0000", 2024-05-08T18:08:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3589999999999999e-05 2024-05-08T18:08:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364499+0000", 2024-05-08T18:08:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.241e-05 2024-05-08T18:08:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364607+0000", 2024-05-08T18:08:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010760900000000001 2024-05-08T18:08:53.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364750+0000", 2024-05-08T18:08:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014265600000000001 2024-05-08T18:08:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.365021+0000", 2024-05-08T18:08:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027115100000000002 2024-05-08T18:08:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366163+0000", 2024-05-08T18:08:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011419189999999999 2024-05-08T18:08:53.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.298 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.298 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366727+0000", 2024-05-08T18:08:53.298 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056400199999999997 2024-05-08T18:08:53.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.298 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.298 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366810+0000", 2024-05-08T18:08:53.298 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3133000000000005e-05 2024-05-08T18:08:53.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.298 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.298 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366920+0000", 2024-05-08T18:08:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109899 2024-05-08T18:08:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.764069262000007, 2024-05-08T18:08:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027893459999999998, 2024-05-08T18:08:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.299 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 907 2024-05-08T18:08:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454369+0000", 2024-05-08T18:08:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5730000000000002e-06 2024-05-08T18:08:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454381+0000", 2024-05-08T18:08:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.208e-05 2024-05-08T18:08:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454413+0000", 2024-05-08T18:08:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2493000000000002e-05 2024-05-08T18:08:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454432+0000", 2024-05-08T18:08:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8862999999999999e-05 2024-05-08T18:08:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454577+0000", 2024-05-08T18:08:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014477899999999999 2024-05-08T18:08:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454800+0000", 2024-05-08T18:08:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223425 2024-05-08T18:08:53.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.455168+0000", 2024-05-08T18:08:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036712799999999999 2024-05-08T18:08:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456282+0000", 2024-05-08T18:08:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011141580000000001 2024-05-08T18:08:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456953+0000", 2024-05-08T18:08:53.303 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000670956 2024-05-08T18:08:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457038+0000", 2024-05-08T18:08:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4828999999999997e-05 2024-05-08T18:08:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457156+0000", 2024-05-08T18:08:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118062 2024-05-08T18:08:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.760376898999994, 2024-05-08T18:08:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026891609999999998, 2024-05-08T18:08:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 909 2024-05-08T18:08:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.305 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458060+0000", 2024-05-08T18:08:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458069+0000", 2024-05-08T18:08:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6440000000000006e-06 2024-05-08T18:08:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458090+0000", 2024-05-08T18:08:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1089000000000001e-05 2024-05-08T18:08:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458102+0000", 2024-05-08T18:08:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2306999999999999e-05 2024-05-08T18:08:53.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458191+0000", 2024-05-08T18:08:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8213000000000004e-05 2024-05-08T18:08:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458313+0000", 2024-05-08T18:08:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012231500000000001 2024-05-08T18:08:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458581+0000", 2024-05-08T18:08:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026762500000000001 2024-05-08T18:08:53.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.459773+0000", 2024-05-08T18:08:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001192991 2024-05-08T18:08:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460590+0000", 2024-05-08T18:08:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081618100000000002 2024-05-08T18:08:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460681+0000", 2024-05-08T18:08:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0946000000000006e-05 2024-05-08T18:08:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460748+0000", 2024-05-08T18:08:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7139999999999998e-05 2024-05-08T18:08:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.666733880999999, 2024-05-08T18:08:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030359179999999999, 2024-05-08T18:08:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.310 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 949 2024-05-08T18:08:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.311 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551705+0000", 2024-05-08T18:08:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2770000000000001e-06 2024-05-08T18:08:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551717+0000", 2024-05-08T18:08:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.206e-05 2024-05-08T18:08:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551747+0000", 2024-05-08T18:08:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0168999999999999e-05 2024-05-08T18:08:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551763+0000", 2024-05-08T18:08:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:08:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551880+0000", 2024-05-08T18:08:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116976 2024-05-08T18:08:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552099+0000", 2024-05-08T18:08:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021910199999999999 2024-05-08T18:08:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552476+0000", 2024-05-08T18:08:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000376697 2024-05-08T18:08:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.553551+0000", 2024-05-08T18:08:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001074925 2024-05-08T18:08:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554588+0000", 2024-05-08T18:08:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010374099999999999 2024-05-08T18:08:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554671+0000", 2024-05-08T18:08:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3368999999999994e-05 2024-05-08T18:08:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554738+0000", 2024-05-08T18:08:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6043000000000004e-05 2024-05-08T18:08:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.315 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.653120443000006, 2024-05-08T18:08:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028304160000000001, 2024-05-08T18:08:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 955 2024-05-08T18:08:53.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565318+0000", 2024-05-08T18:08:53.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7030000000000002e-06 2024-05-08T18:08:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565330+0000", 2024-05-08T18:08:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.204e-05 2024-05-08T18:08:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565363+0000", 2024-05-08T18:08:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2722999999999998e-05 2024-05-08T18:08:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565389+0000", 2024-05-08T18:08:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6412999999999999e-05 2024-05-08T18:08:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565510+0000", 2024-05-08T18:08:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120932 2024-05-08T18:08:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565722+0000", 2024-05-08T18:08:53.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212139 2024-05-08T18:08:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.566034+0000", 2024-05-08T18:08:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000312038 2024-05-08T18:08:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567340+0000", 2024-05-08T18:08:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00130547 2024-05-08T18:08:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.320 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567998+0000", 2024-05-08T18:08:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000658382 2024-05-08T18:08:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568081+0000", 2024-05-08T18:08:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3269999999999994e-05 2024-05-08T18:08:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568145+0000", 2024-05-08T18:08:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4306000000000004e-05 2024-05-08T18:08:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.321 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 85.649400920000005, 2024-05-08T18:08:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027506660000000001, 2024-05-08T18:08:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 957 2024-05-08T18:08:53.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569036+0000", 2024-05-08T18:08:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.776e-06 2024-05-08T18:08:53.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569061+0000", 2024-05-08T18:08:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5097e-05 2024-05-08T18:08:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569084+0000", 2024-05-08T18:08:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.23e-05 2024-05-08T18:08:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569096+0000", 2024-05-08T18:08:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.22e-05 2024-05-08T18:08:53.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569180+0000", 2024-05-08T18:08:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4369000000000005e-05 2024-05-08T18:08:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569296+0000", 2024-05-08T18:08:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115999 2024-05-08T18:08:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569550+0000", 2024-05-08T18:08:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025397499999999998 2024-05-08T18:08:53.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.570963+0000", 2024-05-08T18:08:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001413023 2024-05-08T18:08:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571614+0000", 2024-05-08T18:08:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065041199999999995 2024-05-08T18:08:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571701+0000", 2024-05-08T18:08:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7569000000000001e-05 2024-05-08T18:08:53.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571785+0000", 2024-05-08T18:08:53.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3945999999999999e-05 2024-05-08T18:08:53.327 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.327 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.327 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.327 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.327 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.327 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:53.328 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:08:53.329 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:53.329+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:53.429 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:53.429+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:53.482 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:53.482 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:53.496 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:08:53.530 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:53.529+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:53.610 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:53.610 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:53.610 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:53.610 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:53.610 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:53.624 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:08:53.631 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:53.629+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:53.731 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:53.729+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:53.738 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:53.738 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:53.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:53.738 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:53.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.738 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:53.739 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:53.739 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 92.189662909000006, 2024-05-08T18:08:53.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049710090000000002, 2024-05-08T18:08:53.739 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.739 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.739 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-08T18:08:53.739 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.739 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.739 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.739 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 44 2024-05-08T18:08:53.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.739 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:53.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:53.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552775+0000", 2024-05-08T18:08:53.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4450000000000001e-06 2024-05-08T18:08:53.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552790+0000", 2024-05-08T18:08:53.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4363e-05 2024-05-08T18:08:53.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552820+0000", 2024-05-08T18:08:53.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0485999999999999e-05 2024-05-08T18:08:53.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552843+0000", 2024-05-08T18:08:53.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2985000000000001e-05 2024-05-08T18:08:53.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554350+0000", 2024-05-08T18:08:53.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015065149999999999 2024-05-08T18:08:53.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-08T18:08:53.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554374+0000", 2024-05-08T18:08:53.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4097e-05 2024-05-08T18:08:53.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557531+0000", 2024-05-08T18:08:53.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031567169999999999 2024-05-08T18:08:53.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557743+0000", 2024-05-08T18:08:53.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212401 2024-05-08T18:08:53.743 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.743 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.743 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.743 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:53.743 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:53.744 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.154311031999995, 2024-05-08T18:08:53.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050241879999999997, 2024-05-08T18:08:53.744 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.744 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.744 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.744 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.744 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.744 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.744 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 58 2024-05-08T18:08:53.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.744 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:53.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:53.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588125+0000", 2024-05-08T18:08:53.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1399999999999995e-07 2024-05-08T18:08:53.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588129+0000", 2024-05-08T18:08:53.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6779999999999999e-06 2024-05-08T18:08:53.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588142+0000", 2024-05-08T18:08:53.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3047999999999999e-05 2024-05-08T18:08:53.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588174+0000", 2024-05-08T18:08:53.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1270999999999999e-05 2024-05-08T18:08:53.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588307+0000", 2024-05-08T18:08:53.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013307600000000001 2024-05-08T18:08:53.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588477+0000", 2024-05-08T18:08:53.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000170213 2024-05-08T18:08:53.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:53.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588669+0000", 2024-05-08T18:08:53.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019211599999999999 2024-05-08T18:08:53.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.590228+0000", 2024-05-08T18:08:53.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015590059999999999 2024-05-08T18:08:53.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593029+0000", 2024-05-08T18:08:53.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028006400000000001 2024-05-08T18:08:53.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593099+0000", 2024-05-08T18:08:53.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0300000000000001e-05 2024-05-08T18:08:53.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593148+0000", 2024-05-08T18:08:53.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8925999999999999e-05 2024-05-08T18:08:53.749 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.749 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.749 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.750 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:08:53.750 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:53.750 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.157772871999995, 2024-05-08T18:08:53.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00385587, 2024-05-08T18:08:53.750 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.750 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.750 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.750 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.750 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.750 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.750 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207 2024-05-08T18:08:53.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.751 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:53.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:53.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584665+0000", 2024-05-08T18:08:53.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0570000000000001e-06 2024-05-08T18:08:53.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584679+0000", 2024-05-08T18:08:53.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3713000000000001e-05 2024-05-08T18:08:53.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584712+0000", 2024-05-08T18:08:53.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3213999999999997e-05 2024-05-08T18:08:53.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584728+0000", 2024-05-08T18:08:53.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5936000000000001e-05 2024-05-08T18:08:53.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584951+0000", 2024-05-08T18:08:53.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000222955 2024-05-08T18:08:53.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585196+0000", 2024-05-08T18:08:53.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024550800000000002 2024-05-08T18:08:53.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:53.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585643+0000", 2024-05-08T18:08:53.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00044644699999999999 2024-05-08T18:08:53.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.587110+0000", 2024-05-08T18:08:53.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001467323 2024-05-08T18:08:53.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588371+0000", 2024-05-08T18:08:53.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012607180000000001 2024-05-08T18:08:53.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588452+0000", 2024-05-08T18:08:53.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1216000000000003e-05 2024-05-08T18:08:53.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588518+0000", 2024-05-08T18:08:53.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5783000000000004e-05 2024-05-08T18:08:53.755 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.755 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.755 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.756 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.756 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:53.756 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.111597470000007, 2024-05-08T18:08:53.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003249994, 2024-05-08T18:08:53.756 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.756 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.756 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.756 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.756 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.756 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.756 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216 2024-05-08T18:08:53.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.756 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:53.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:53.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630840+0000", 2024-05-08T18:08:53.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0730000000000001e-06 2024-05-08T18:08:53.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630854+0000", 2024-05-08T18:08:53.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3360000000000001e-05 2024-05-08T18:08:53.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630889+0000", 2024-05-08T18:08:53.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5176999999999999e-05 2024-05-08T18:08:53.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630911+0000", 2024-05-08T18:08:53.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.247e-05 2024-05-08T18:08:53.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631046+0000", 2024-05-08T18:08:53.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013484599999999999 2024-05-08T18:08:53.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631272+0000", 2024-05-08T18:08:53.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000225694 2024-05-08T18:08:53.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:53.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631703+0000", 2024-05-08T18:08:53.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000431144 2024-05-08T18:08:53.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633244+0000", 2024-05-08T18:08:53.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001540622 2024-05-08T18:08:53.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633926+0000", 2024-05-08T18:08:53.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068244200000000001 2024-05-08T18:08:53.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634019+0000", 2024-05-08T18:08:53.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3148999999999999e-05 2024-05-08T18:08:53.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634087+0000", 2024-05-08T18:08:53.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8016999999999996e-05 2024-05-08T18:08:53.761 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.761 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.761 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.761 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.761 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:53.761 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.070053420999997, 2024-05-08T18:08:53.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003119854, 2024-05-08T18:08:53.761 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.761 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.761 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.761 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.761 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.762 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.762 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 227 2024-05-08T18:08:53.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.762 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:53.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:53.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672384+0000", 2024-05-08T18:08:53.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7470000000000001e-06 2024-05-08T18:08:53.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672396+0000", 2024-05-08T18:08:53.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.154e-05 2024-05-08T18:08:53.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672427+0000", 2024-05-08T18:08:53.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1676e-05 2024-05-08T18:08:53.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672443+0000", 2024-05-08T18:08:53.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5214e-05 2024-05-08T18:08:53.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672563+0000", 2024-05-08T18:08:53.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120535 2024-05-08T18:08:53.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672778+0000", 2024-05-08T18:08:53.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021446200000000001 2024-05-08T18:08:53.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:53.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.673205+0000", 2024-05-08T18:08:53.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042750699999999998 2024-05-08T18:08:53.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.674848+0000", 2024-05-08T18:08:53.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016432980000000001 2024-05-08T18:08:53.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675346+0000", 2024-05-08T18:08:53.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049711999999999998 2024-05-08T18:08:53.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675432+0000", 2024-05-08T18:08:53.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6798999999999993e-05 2024-05-08T18:08:53.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675501+0000", 2024-05-08T18:08:53.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8955999999999995e-05 2024-05-08T18:08:53.766 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.766 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.766 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.766 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.766 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:53.767 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.063112634000007, 2024-05-08T18:08:53.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034322110000000001, 2024-05-08T18:08:53.767 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.767 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.767 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.767 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.767 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.767 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.767 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 229 2024-05-08T18:08:53.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.767 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:53.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:53.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679325+0000", 2024-05-08T18:08:53.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:08:53.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679339+0000", 2024-05-08T18:08:53.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:08:53.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679370+0000", 2024-05-08T18:08:53.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0280000000000001e-05 2024-05-08T18:08:53.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679385+0000", 2024-05-08T18:08:53.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5026e-05 2024-05-08T18:08:53.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679504+0000", 2024-05-08T18:08:53.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119023 2024-05-08T18:08:53.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679711+0000", 2024-05-08T18:08:53.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020705499999999999 2024-05-08T18:08:53.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:53.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.680115+0000", 2024-05-08T18:08:53.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040396699999999998 2024-05-08T18:08:53.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.681424+0000", 2024-05-08T18:08:53.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001309387 2024-05-08T18:08:53.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682488+0000", 2024-05-08T18:08:53.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010642519999999999 2024-05-08T18:08:53.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682640+0000", 2024-05-08T18:08:53.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015123599999999999 2024-05-08T18:08:53.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682754+0000", 2024-05-08T18:08:53.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011482200000000001 2024-05-08T18:08:53.772 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.772 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.772 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.772 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.772 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:53.772 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.055728424999998, 2024-05-08T18:08:53.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033353329999999998, 2024-05-08T18:08:53.772 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.772 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.772 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.772 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.772 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.772 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.773 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 231 2024-05-08T18:08:53.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.773 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:53.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:53.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686709+0000", 2024-05-08T18:08:53.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4729999999999999e-06 2024-05-08T18:08:53.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686720+0000", 2024-05-08T18:08:53.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1157e-05 2024-05-08T18:08:53.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686750+0000", 2024-05-08T18:08:53.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0417e-05 2024-05-08T18:08:53.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686765+0000", 2024-05-08T18:08:53.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.487e-05 2024-05-08T18:08:53.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686872+0000", 2024-05-08T18:08:53.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010703499999999999 2024-05-08T18:08:53.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687085+0000", 2024-05-08T18:08:53.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021279599999999999 2024-05-08T18:08:53.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:53.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687501+0000", 2024-05-08T18:08:53.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041554 2024-05-08T18:08:53.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.688886+0000", 2024-05-08T18:08:53.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00138565 2024-05-08T18:08:53.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689899+0000", 2024-05-08T18:08:53.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010128190000000001 2024-05-08T18:08:53.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689978+0000", 2024-05-08T18:08:53.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8490000000000002e-05 2024-05-08T18:08:53.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.690042+0000", 2024-05-08T18:08:53.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4085999999999996e-05 2024-05-08T18:08:53.777 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.777 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.777 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.777 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:394 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.777 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:53.777 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.998655348, 2024-05-08T18:08:53.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034384960000000001, 2024-05-08T18:08:53.777 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.778 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.778 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.778 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.778 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.778 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.778 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 394 2024-05-08T18:08:53.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.778 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:53.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:53.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743781+0000", 2024-05-08T18:08:53.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3e-06 2024-05-08T18:08:53.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743788+0000", 2024-05-08T18:08:53.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7399999999999998e-06 2024-05-08T18:08:53.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743801+0000", 2024-05-08T18:08:53.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3757000000000001e-05 2024-05-08T18:08:53.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743808+0000", 2024-05-08T18:08:53.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6579999999999996e-06 2024-05-08T18:08:53.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743875+0000", 2024-05-08T18:08:53.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6740000000000001e-05 2024-05-08T18:08:53.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743971+0000", 2024-05-08T18:08:53.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6175000000000007e-05 2024-05-08T18:08:53.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:53.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744100+0000", 2024-05-08T18:08:53.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012954899999999999 2024-05-08T18:08:53.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744863+0000", 2024-05-08T18:08:53.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076300100000000002 2024-05-08T18:08:53.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747089+0000", 2024-05-08T18:08:53.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022258540000000002 2024-05-08T18:08:53.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747162+0000", 2024-05-08T18:08:53.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2632000000000005e-05 2024-05-08T18:08:53.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747218+0000", 2024-05-08T18:08:53.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.609e-05 2024-05-08T18:08:53.783 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.783 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.783 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.783 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:535 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.783 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:53.783 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.900942271000005, 2024-05-08T18:08:53.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055640899999999998, 2024-05-08T18:08:53.783 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.783 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.783 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.783 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.783 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.784 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.784 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 535 2024-05-08T18:08:53.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.784 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:53.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:53.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841494+0000", 2024-05-08T18:08:53.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0899999999999999e-06 2024-05-08T18:08:53.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841500+0000", 2024-05-08T18:08:53.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0249999999999999e-06 2024-05-08T18:08:53.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841513+0000", 2024-05-08T18:08:53.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3658e-05 2024-05-08T18:08:53.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841522+0000", 2024-05-08T18:08:53.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3410000000000003e-06 2024-05-08T18:08:53.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841574+0000", 2024-05-08T18:08:53.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2794000000000003e-05 2024-05-08T18:08:53.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841633+0000", 2024-05-08T18:08:53.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8595999999999999e-05 2024-05-08T18:08:53.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:53.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841755+0000", 2024-05-08T18:08:53.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012227399999999999 2024-05-08T18:08:53.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.842349+0000", 2024-05-08T18:08:53.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00059377699999999998 2024-05-08T18:08:53.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.846949+0000", 2024-05-08T18:08:53.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004599723 2024-05-08T18:08:53.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847008+0000", 2024-05-08T18:08:53.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8854999999999998e-05 2024-05-08T18:08:53.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847057+0000", 2024-05-08T18:08:53.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8956999999999999e-05 2024-05-08T18:08:53.788 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.788 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.788 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.788 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:541 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.893912740999994, 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037829790000000001, 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 541 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:53.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848523+0000", 2024-05-08T18:08:53.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8599999999999997e-07 2024-05-08T18:08:53.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848526+0000", 2024-05-08T18:08:53.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4690000000000002e-06 2024-05-08T18:08:53.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848536+0000", 2024-05-08T18:08:53.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2029999999999998e-06 2024-05-08T18:08:53.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848540+0000", 2024-05-08T18:08:53.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9169999999999997e-06 2024-05-08T18:08:53.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848591+0000", 2024-05-08T18:08:53.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0328000000000003e-05 2024-05-08T18:08:53.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848646+0000", 2024-05-08T18:08:53.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5281999999999997e-05 2024-05-08T18:08:53.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:53.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848759+0000", 2024-05-08T18:08:53.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011278899999999999 2024-05-08T18:08:53.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.849323+0000", 2024-05-08T18:08:53.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056433999999999998 2024-05-08T18:08:53.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852225+0000", 2024-05-08T18:08:53.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029017320000000002 2024-05-08T18:08:53.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852277+0000", 2024-05-08T18:08:53.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2460999999999998e-05 2024-05-08T18:08:53.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852305+0000", 2024-05-08T18:08:53.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7671999999999999e-05 2024-05-08T18:08:53.796 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.796 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.796 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.796 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.796 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:53.796 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.760765664000004, 2024-05-08T18:08:53.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002973084, 2024-05-08T18:08:53.796 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.796 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.797 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.797 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.797 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.797 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.797 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 703 2024-05-08T18:08:53.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.797 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:53.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:53.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981672+0000", 2024-05-08T18:08:53.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5799999999999999e-06 2024-05-08T18:08:53.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981683+0000", 2024-05-08T18:08:53.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1270000000000001e-05 2024-05-08T18:08:53.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981715+0000", 2024-05-08T18:08:53.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1470000000000002e-05 2024-05-08T18:08:53.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981730+0000", 2024-05-08T18:08:53.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5262999999999999e-05 2024-05-08T18:08:53.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981864+0000", 2024-05-08T18:08:53.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134043 2024-05-08T18:08:53.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982168+0000", 2024-05-08T18:08:53.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030453799999999998 2024-05-08T18:08:53.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:53.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982620+0000", 2024-05-08T18:08:53.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045170900000000001 2024-05-08T18:08:53.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.983648+0000", 2024-05-08T18:08:53.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010276009999999999 2024-05-08T18:08:53.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984486+0000", 2024-05-08T18:08:53.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083874600000000002 2024-05-08T18:08:53.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984571+0000", 2024-05-08T18:08:53.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4370999999999996e-05 2024-05-08T18:08:53.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984642+0000", 2024-05-08T18:08:53.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1493000000000001e-05 2024-05-08T18:08:53.801 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.801 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.801 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.802 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:789 6.0 e32/26 6:0216b5b6:::obj_delete_at_hint.0000000070:head v 32'14, mlcod=32'12)", 2024-05-08T18:08:53.802 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:53.802 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.561338891000005, 2024-05-08T18:08:53.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034621420000000001, 2024-05-08T18:08:53.802 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.802 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.802 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.802 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:53.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181098+0000", 2024-05-08T18:08:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8029999999999999e-06 2024-05-08T18:08:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181109+0000", 2024-05-08T18:08:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1219999999999999e-05 2024-05-08T18:08:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181138+0000", 2024-05-08T18:08:53.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.898e-05 2024-05-08T18:08:53.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181151+0000", 2024-05-08T18:08:53.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.308e-05 2024-05-08T18:08:53.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181268+0000", 2024-05-08T18:08:53.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116629 2024-05-08T18:08:53.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181321+0000", 2024-05-08T18:08:53.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3325999999999997e-05 2024-05-08T18:08:53.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184477+0000", 2024-05-08T18:08:53.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003156458 2024-05-08T18:08:53.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184558+0000", 2024-05-08T18:08:53.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0646e-05 2024-05-08T18:08:53.805 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.805 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.805 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.806 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.806 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:53.806 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.530165386999997, 2024-05-08T18:08:53.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031146310000000001, 2024-05-08T18:08:53.806 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.806 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.806 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.806 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.806 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.806 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.806 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 802 2024-05-08T18:08:53.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.806 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:53.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:53.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212272+0000", 2024-05-08T18:08:53.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.943e-06 2024-05-08T18:08:53.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212284+0000", 2024-05-08T18:08:53.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1747e-05 2024-05-08T18:08:53.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212315+0000", 2024-05-08T18:08:53.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0579e-05 2024-05-08T18:08:53.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212336+0000", 2024-05-08T18:08:53.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1639999999999999e-05 2024-05-08T18:08:53.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212488+0000", 2024-05-08T18:08:53.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151192 2024-05-08T18:08:53.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212703+0000", 2024-05-08T18:08:53.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000215439 2024-05-08T18:08:53.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:53.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.213033+0000", 2024-05-08T18:08:53.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032992699999999999 2024-05-08T18:08:53.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.214306+0000", 2024-05-08T18:08:53.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012726949999999999 2024-05-08T18:08:53.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215232+0000", 2024-05-08T18:08:53.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092652999999999995 2024-05-08T18:08:53.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215321+0000", 2024-05-08T18:08:53.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9272999999999997e-05 2024-05-08T18:08:53.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215384+0000", 2024-05-08T18:08:53.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2665999999999999e-05 2024-05-08T18:08:53.811 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.811 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.811 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.811 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.811 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:53.811 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.449620980999995, 2024-05-08T18:08:53.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030150250000000002, 2024-05-08T18:08:53.811 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.811 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.811 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.812 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.812 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.812 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.812 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 838 2024-05-08T18:08:53.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.812 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:53.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:53.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292816+0000", 2024-05-08T18:08:53.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:08:53.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292828+0000", 2024-05-08T18:08:53.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.184e-05 2024-05-08T18:08:53.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292857+0000", 2024-05-08T18:08:53.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8960000000000001e-05 2024-05-08T18:08:53.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292871+0000", 2024-05-08T18:08:53.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.45e-05 2024-05-08T18:08:53.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293000+0000", 2024-05-08T18:08:53.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128875 2024-05-08T18:08:53.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293231+0000", 2024-05-08T18:08:53.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023030500000000001 2024-05-08T18:08:53.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:53.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293563+0000", 2024-05-08T18:08:53.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000332648 2024-05-08T18:08:53.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.294882+0000", 2024-05-08T18:08:53.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001319183 2024-05-08T18:08:53.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295664+0000", 2024-05-08T18:08:53.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000781991 2024-05-08T18:08:53.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295754+0000", 2024-05-08T18:08:53.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9176000000000001e-05 2024-05-08T18:08:53.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295829+0000", 2024-05-08T18:08:53.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.525e-05 2024-05-08T18:08:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.388487311999995, 2024-05-08T18:08:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029338929999999999, 2024-05-08T18:08:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 865 2024-05-08T18:08:53.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.818 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:53.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:53.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353950+0000", 2024-05-08T18:08:53.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2469999999999998e-06 2024-05-08T18:08:53.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353961+0000", 2024-05-08T18:08:53.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1523e-05 2024-05-08T18:08:53.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353991+0000", 2024-05-08T18:08:53.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9920000000000002e-05 2024-05-08T18:08:53.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354013+0000", 2024-05-08T18:08:53.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1590000000000002e-05 2024-05-08T18:08:53.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354206+0000", 2024-05-08T18:08:53.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019273900000000001 2024-05-08T18:08:53.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354418+0000", 2024-05-08T18:08:53.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212518 2024-05-08T18:08:53.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:53.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354720+0000", 2024-05-08T18:08:53.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030151800000000002 2024-05-08T18:08:53.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.355983+0000", 2024-05-08T18:08:53.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012636780000000001 2024-05-08T18:08:53.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356733+0000", 2024-05-08T18:08:53.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074988400000000003 2024-05-08T18:08:53.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356819+0000", 2024-05-08T18:08:53.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5690000000000001e-05 2024-05-08T18:08:53.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356881+0000", 2024-05-08T18:08:53.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2586e-05 2024-05-08T18:08:53.822 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.822 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.822 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.822 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.823 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:53.823 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.375363946999997, 2024-05-08T18:08:53.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004954511, 2024-05-08T18:08:53.823 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.823 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.823 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.823 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.823 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.823 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.823 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 871 2024-05-08T18:08:53.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.823 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:53.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:53.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367073+0000", 2024-05-08T18:08:53.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2340000000000001e-06 2024-05-08T18:08:53.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367085+0000", 2024-05-08T18:08:53.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1483e-05 2024-05-08T18:08:53.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367111+0000", 2024-05-08T18:08:53.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5890000000000001e-05 2024-05-08T18:08:53.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367130+0000", 2024-05-08T18:08:53.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9700000000000001e-05 2024-05-08T18:08:53.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367284+0000", 2024-05-08T18:08:53.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015411799999999999 2024-05-08T18:08:53.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367516+0000", 2024-05-08T18:08:53.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000231272 2024-05-08T18:08:53.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:53.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367837+0000", 2024-05-08T18:08:53.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032173400000000001 2024-05-08T18:08:53.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371395+0000", 2024-05-08T18:08:53.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035574719999999999 2024-05-08T18:08:53.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371882+0000", 2024-05-08T18:08:53.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048693899999999998 2024-05-08T18:08:53.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371962+0000", 2024-05-08T18:08:53.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.975e-05 2024-05-08T18:08:53.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372025+0000", 2024-05-08T18:08:53.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3918999999999996e-05 2024-05-08T18:08:53.827 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.828 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.828 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.828 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.828 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:53.828 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.369476242999994, 2024-05-08T18:08:53.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045233640000000002, 2024-05-08T18:08:53.828 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.828 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.828 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.828 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.828 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.828 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.829 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 873 2024-05-08T18:08:53.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.829 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:53.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:53.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372961+0000", 2024-05-08T18:08:53.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:08:53.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372969+0000", 2024-05-08T18:08:53.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2940000000000006e-06 2024-05-08T18:08:53.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372991+0000", 2024-05-08T18:08:53.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1829000000000001e-05 2024-05-08T18:08:53.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373009+0000", 2024-05-08T18:08:53.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8607e-05 2024-05-08T18:08:53.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373127+0000", 2024-05-08T18:08:53.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011728899999999999 2024-05-08T18:08:53.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373260+0000", 2024-05-08T18:08:53.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013301200000000001 2024-05-08T18:08:53.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:53.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373526+0000", 2024-05-08T18:08:53.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026613500000000003 2024-05-08T18:08:53.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.374558+0000", 2024-05-08T18:08:53.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001032156 2024-05-08T18:08:53.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377333+0000", 2024-05-08T18:08:53.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027749329999999998 2024-05-08T18:08:53.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377421+0000", 2024-05-08T18:08:53.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8679999999999998e-05 2024-05-08T18:08:53.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377482+0000", 2024-05-08T18:08:53.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0538999999999998e-05 2024-05-08T18:08:53.833 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.833 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.833 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.833 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.833 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:53.834 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.309867088999994, 2024-05-08T18:08:53.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035261009999999998, 2024-05-08T18:08:53.834 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.834 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.834 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.834 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.834 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.834 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.834 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 898 2024-05-08T18:08:53.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.834 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:53.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:53.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432570+0000", 2024-05-08T18:08:53.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.26e-06 2024-05-08T18:08:53.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432580+0000", 2024-05-08T18:08:53.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8570000000000007e-06 2024-05-08T18:08:53.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432605+0000", 2024-05-08T18:08:53.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5273e-05 2024-05-08T18:08:53.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432618+0000", 2024-05-08T18:08:53.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2999999999999999e-05 2024-05-08T18:08:53.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432742+0000", 2024-05-08T18:08:53.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012369200000000001 2024-05-08T18:08:53.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433109+0000", 2024-05-08T18:08:53.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036760500000000002 2024-05-08T18:08:53.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:53.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433645+0000", 2024-05-08T18:08:53.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053599599999999996 2024-05-08T18:08:53.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435050+0000", 2024-05-08T18:08:53.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001404696 2024-05-08T18:08:53.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435834+0000", 2024-05-08T18:08:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078381100000000003 2024-05-08T18:08:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435984+0000", 2024-05-08T18:08:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015006899999999999 2024-05-08T18:08:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.436094+0000", 2024-05-08T18:08:53.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109842 2024-05-08T18:08:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.305114239999995, 2024-05-08T18:08:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031481899999999999, 2024-05-08T18:08:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.839 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 900 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437323+0000", 2024-05-08T18:08:53.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.447e-06 2024-05-08T18:08:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437334+0000", 2024-05-08T18:08:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0835999999999999e-05 2024-05-08T18:08:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437364+0000", 2024-05-08T18:08:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0463999999999998e-05 2024-05-08T18:08:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437379+0000", 2024-05-08T18:08:53.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4806e-05 2024-05-08T18:08:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437500+0000", 2024-05-08T18:08:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121309 2024-05-08T18:08:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437729+0000", 2024-05-08T18:08:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022818200000000001 2024-05-08T18:08:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:53.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.438199+0000", 2024-05-08T18:08:53.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047025300000000001 2024-05-08T18:08:53.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.439418+0000", 2024-05-08T18:08:53.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012193849999999999 2024-05-08T18:08:53.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440217+0000", 2024-05-08T18:08:53.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00079905999999999998 2024-05-08T18:08:53.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440352+0000", 2024-05-08T18:08:53.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013485299999999999 2024-05-08T18:08:53.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440469+0000", 2024-05-08T18:08:53.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116595 2024-05-08T18:08:53.844 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.844 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.844 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.844 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:53.844 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:53.844 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.218878235000005, 2024-05-08T18:08:53.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003477894, 2024-05-08T18:08:53.845 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:53.845 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:53.845 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:53.845 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:53.845 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:53.845 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:53.845 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 937 2024-05-08T18:08:53.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.845 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:53.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:53.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:53.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:53.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:53.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:53.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:53.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523559+0000", 2024-05-08T18:08:53.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.95e-06 2024-05-08T18:08:53.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:53.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523567+0000", 2024-05-08T18:08:53.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6799999999999999e-06 2024-05-08T18:08:53.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:53.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523591+0000", 2024-05-08T18:08:53.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3269e-05 2024-05-08T18:08:53.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:53.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523611+0000", 2024-05-08T18:08:53.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0100000000000001e-05 2024-05-08T18:08:53.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:53.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523767+0000", 2024-05-08T18:08:53.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015604900000000001 2024-05-08T18:08:53.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:53.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523994+0000", 2024-05-08T18:08:53.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022764199999999999 2024-05-08T18:08:53.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:53.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.524338+0000", 2024-05-08T18:08:53.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034388700000000002 2024-05-08T18:08:53.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:53.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.525707+0000", 2024-05-08T18:08:53.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001368544 2024-05-08T18:08:53.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:53.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526843+0000", 2024-05-08T18:08:53.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001136501 2024-05-08T18:08:53.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:53.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526957+0000", 2024-05-08T18:08:53.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011359 2024-05-08T18:08:53.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:53.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:53.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:53.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.527035+0000", 2024-05-08T18:08:53.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7682000000000006e-05 2024-05-08T18:08:53.850 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.850 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.850 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.850 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:53.850 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:53.850 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:53.850 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-08T18:08:53.850 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-08T18:08:53.852 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:08:53.852 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:53.852+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:53.953 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:53.953+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:53.985 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:53.985 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:53.985 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:53.985 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:54.001 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:08:54.001 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-05-08T18:08:54.053 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:54.052+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:54.154 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:54.153+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:54.166 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:54.166 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:54.180 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:08:54.268 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:54.269+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:54.350 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:54.350 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:54.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:54.350 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:54.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.350 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:36 5.e 5:71234df9:::zone_info.d0a95a6c-3c84-4d52-915c-e8ea581dfb9b:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:08:54.350 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:54.350 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.776835782999996, 2024-05-08T18:08:54.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028394430000000001, 2024-05-08T18:08:54.350 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.350 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:08:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:08:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 36 2024-05-08T18:08:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573456+0000", 2024-05-08T18:08:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573467+0000", 2024-05-08T18:08:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1243999999999999e-05 2024-05-08T18:08:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573499+0000", 2024-05-08T18:08:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1343000000000001e-05 2024-05-08T18:08:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573522+0000", 2024-05-08T18:08:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3540000000000002e-05 2024-05-08T18:08:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573634+0000", 2024-05-08T18:08:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112249 2024-05-08T18:08:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573841+0000", 2024-05-08T18:08:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000206407 2024-05-08T18:08:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.574122+0000", 2024-05-08T18:08:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000281475 2024-05-08T18:08:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.575489+0000", 2024-05-08T18:08:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001366391 2024-05-08T18:08:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576157+0000", 2024-05-08T18:08:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00066776200000000002 2024-05-08T18:08:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576234+0000", 2024-05-08T18:08:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7285000000000003e-05 2024-05-08T18:08:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576293+0000", 2024-05-08T18:08:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9556999999999999e-05 2024-05-08T18:08:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.820076589999999, 2024-05-08T18:08:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018560765, 2024-05-08T18:08:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:08:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 43 2024-05-08T18:08:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530217+0000", 2024-05-08T18:08:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:08:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530253+0000", 2024-05-08T18:08:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5621999999999999e-05 2024-05-08T18:08:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530288+0000", 2024-05-08T18:08:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5846999999999997e-05 2024-05-08T18:08:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530314+0000", 2024-05-08T18:08:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5732e-05 2024-05-08T18:08:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530952+0000", 2024-05-08T18:08:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00063739999999999999 2024-05-08T18:08:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530977+0000", 2024-05-08T18:08:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5375e-05 2024-05-08T18:08:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548506+0000", 2024-05-08T18:08:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017528781 2024-05-08T18:08:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548774+0000", 2024-05-08T18:08:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026821199999999999 2024-05-08T18:08:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.737762665999995, 2024-05-08T18:08:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003496893, 2024-05-08T18:08:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 211 2024-05-08T18:08:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612530+0000", 2024-05-08T18:08:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9490000000000001e-06 2024-05-08T18:08:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612544+0000", 2024-05-08T18:08:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3779e-05 2024-05-08T18:08:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612578+0000", 2024-05-08T18:08:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4421000000000001e-05 2024-05-08T18:08:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612596+0000", 2024-05-08T18:08:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7435000000000002e-05 2024-05-08T18:08:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612718+0000", 2024-05-08T18:08:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012218600000000001 2024-05-08T18:08:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612951+0000", 2024-05-08T18:08:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000232768 2024-05-08T18:08:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.613370+0000", 2024-05-08T18:08:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041921200000000002 2024-05-08T18:08:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.614840+0000", 2024-05-08T18:08:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014703679999999999 2024-05-08T18:08:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615860+0000", 2024-05-08T18:08:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010198220000000001 2024-05-08T18:08:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615954+0000", 2024-05-08T18:08:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4419000000000005e-05 2024-05-08T18:08:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.616024+0000", 2024-05-08T18:08:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9534000000000002e-05 2024-05-08T18:08:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.661072984, 2024-05-08T18:08:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035800939999999998, 2024-05-08T18:08:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 232 2024-05-08T18:08:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689219+0000", 2024-05-08T18:08:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4490000000000002e-06 2024-05-08T18:08:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689232+0000", 2024-05-08T18:08:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3183000000000001e-05 2024-05-08T18:08:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689263+0000", 2024-05-08T18:08:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400999999999999e-05 2024-05-08T18:08:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689279+0000", 2024-05-08T18:08:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6078000000000001e-05 2024-05-08T18:08:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689401+0000", 2024-05-08T18:08:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012243000000000001 2024-05-08T18:08:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689656+0000", 2024-05-08T18:08:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431899999999998 2024-05-08T18:08:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.690103+0000", 2024-05-08T18:08:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044706299999999999 2024-05-08T18:08:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.691780+0000", 2024-05-08T18:08:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016774209999999999 2024-05-08T18:08:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692634+0000", 2024-05-08T18:08:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085346 2024-05-08T18:08:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692728+0000", 2024-05-08T18:08:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4429e-05 2024-05-08T18:08:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692797+0000", 2024-05-08T18:08:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8861000000000004e-05 2024-05-08T18:08:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:267 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.636428006000003, 2024-05-08T18:08:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040291739999999999, 2024-05-08T18:08:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 267 2024-05-08T18:08:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713863+0000", 2024-05-08T18:08:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5200000000000001e-06 2024-05-08T18:08:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713873+0000", 2024-05-08T18:08:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9089999999999995e-06 2024-05-08T18:08:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713896+0000", 2024-05-08T18:08:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2595e-05 2024-05-08T18:08:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713914+0000", 2024-05-08T18:08:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7869000000000001e-05 2024-05-08T18:08:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714048+0000", 2024-05-08T18:08:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134802 2024-05-08T18:08:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714278+0000", 2024-05-08T18:08:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022994399999999999 2024-05-08T18:08:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714777+0000", 2024-05-08T18:08:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049880499999999995 2024-05-08T18:08:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.715976+0000", 2024-05-08T18:08:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011991110000000001 2024-05-08T18:08:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717646+0000", 2024-05-08T18:08:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016699989999999999 2024-05-08T18:08:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717790+0000", 2024-05-08T18:08:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014359799999999999 2024-05-08T18:08:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717891+0000", 2024-05-08T18:08:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101022 2024-05-08T18:08:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:308 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.629060765999995, 2024-05-08T18:08:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031672779999999999, 2024-05-08T18:08:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721230+0000", 2024-05-08T18:08:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:08:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721241+0000", 2024-05-08T18:08:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0942e-05 2024-05-08T18:08:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721265+0000", 2024-05-08T18:08:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3371e-05 2024-05-08T18:08:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721278+0000", 2024-05-08T18:08:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3586e-05 2024-05-08T18:08:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721399+0000", 2024-05-08T18:08:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012092 2024-05-08T18:08:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721507+0000", 2024-05-08T18:08:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107651 2024-05-08T18:08:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724292+0000", 2024-05-08T18:08:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027851870000000002 2024-05-08T18:08:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724396+0000", 2024-05-08T18:08:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000104114 2024-05-08T18:08:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:495 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.546442865000003, 2024-05-08T18:08:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005951001, 2024-05-08T18:08:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 495 2024-05-08T18:08:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803849+0000", 2024-05-08T18:08:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3580000000000001e-06 2024-05-08T18:08:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803864+0000", 2024-05-08T18:08:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4742999999999999e-05 2024-05-08T18:08:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803895+0000", 2024-05-08T18:08:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0970000000000003e-05 2024-05-08T18:08:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803908+0000", 2024-05-08T18:08:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2588999999999999e-05 2024-05-08T18:08:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804005+0000", 2024-05-08T18:08:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7107000000000004e-05 2024-05-08T18:08:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804291+0000", 2024-05-08T18:08:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028626900000000002 2024-05-08T18:08:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804648+0000", 2024-05-08T18:08:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000356955 2024-05-08T18:08:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805740+0000", 2024-05-08T18:08:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001091905 2024-05-08T18:08:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809636+0000", 2024-05-08T18:08:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389661 2024-05-08T18:08:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809722+0000", 2024-05-08T18:08:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:08:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809798+0000", 2024-05-08T18:08:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5462000000000004e-05 2024-05-08T18:08:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.539831547000006, 2024-05-08T18:08:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051396380000000002, 2024-05-08T18:08:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 504 2024-05-08T18:08:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810460+0000", 2024-05-08T18:08:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:08:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810470+0000", 2024-05-08T18:08:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0222e-05 2024-05-08T18:08:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810495+0000", 2024-05-08T18:08:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4508999999999999e-05 2024-05-08T18:08:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810515+0000", 2024-05-08T18:08:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9998999999999999e-05 2024-05-08T18:08:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810653+0000", 2024-05-08T18:08:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013851099999999999 2024-05-08T18:08:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810782+0000", 2024-05-08T18:08:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128152 2024-05-08T18:08:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811043+0000", 2024-05-08T18:08:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026172400000000002 2024-05-08T18:08:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812164+0000", 2024-05-08T18:08:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001121024 2024-05-08T18:08:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815415+0000", 2024-05-08T18:08:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032510270000000001 2024-05-08T18:08:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815538+0000", 2024-05-08T18:08:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012256999999999999 2024-05-08T18:08:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815598+0000", 2024-05-08T18:08:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9923000000000002e-05 2024-05-08T18:08:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:629 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.431526806999997, 2024-05-08T18:08:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611169999999998, 2024-05-08T18:08:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 629 2024-05-08T18:08:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918765+0000", 2024-05-08T18:08:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5670000000000002e-06 2024-05-08T18:08:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918777+0000", 2024-05-08T18:08:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1635e-05 2024-05-08T18:08:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918808+0000", 2024-05-08T18:08:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1024e-05 2024-05-08T18:08:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918823+0000", 2024-05-08T18:08:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4939e-05 2024-05-08T18:08:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918930+0000", 2024-05-08T18:08:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107144 2024-05-08T18:08:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919147+0000", 2024-05-08T18:08:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021682599999999999 2024-05-08T18:08:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919464+0000", 2024-05-08T18:08:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031716699999999998 2024-05-08T18:08:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.920561+0000", 2024-05-08T18:08:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010970229999999999 2024-05-08T18:08:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921468+0000", 2024-05-08T18:08:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00090726800000000003 2024-05-08T18:08:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921549+0000", 2024-05-08T18:08:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0430000000000001e-05 2024-05-08T18:08:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921624+0000", 2024-05-08T18:08:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5093999999999996e-05 2024-05-08T18:08:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:681 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.391206058999998, 2024-05-08T18:08:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044793259999999996, 2024-05-08T18:08:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 681 2024-05-08T18:08:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959085+0000", 2024-05-08T18:08:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.353e-06 2024-05-08T18:08:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959092+0000", 2024-05-08T18:08:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999999e-06 2024-05-08T18:08:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959113+0000", 2024-05-08T18:08:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0744e-05 2024-05-08T18:08:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959130+0000", 2024-05-08T18:08:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7679000000000001e-05 2024-05-08T18:08:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959217+0000", 2024-05-08T18:08:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6487000000000001e-05 2024-05-08T18:08:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959335+0000", 2024-05-08T18:08:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118476 2024-05-08T18:08:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959598+0000", 2024-05-08T18:08:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000263045 2024-05-08T18:08:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.960551+0000", 2024-05-08T18:08:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095251500000000002 2024-05-08T18:08:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963412+0000", 2024-05-08T18:08:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611800000000001 2024-05-08T18:08:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963498+0000", 2024-05-08T18:08:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6145999999999998e-05 2024-05-08T18:08:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963563+0000", 2024-05-08T18:08:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4701000000000003e-05 2024-05-08T18:08:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.356257623000005, 2024-05-08T18:08:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031621710000000001, 2024-05-08T18:08:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 709 2024-05-08T18:08:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994035+0000", 2024-05-08T18:08:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6460000000000002e-06 2024-05-08T18:08:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994047+0000", 2024-05-08T18:08:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999e-05 2024-05-08T18:08:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994076+0000", 2024-05-08T18:08:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9564e-05 2024-05-08T18:08:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994091+0000", 2024-05-08T18:08:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4696e-05 2024-05-08T18:08:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994239+0000", 2024-05-08T18:08:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014779699999999999 2024-05-08T18:08:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994585+0000", 2024-05-08T18:08:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034605900000000002 2024-05-08T18:08:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.995084+0000", 2024-05-08T18:08:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049904799999999998 2024-05-08T18:08:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.996558+0000", 2024-05-08T18:08:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001474532 2024-05-08T18:08:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997045+0000", 2024-05-08T18:08:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048685900000000002 2024-05-08T18:08:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997127+0000", 2024-05-08T18:08:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1280999999999996e-05 2024-05-08T18:08:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997194+0000", 2024-05-08T18:08:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7689999999999997e-05 2024-05-08T18:08:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.320868236999999, 2024-05-08T18:08:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003066236, 2024-05-08T18:08:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 724 2024-05-08T18:08:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029424+0000", 2024-05-08T18:08:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.503e-06 2024-05-08T18:08:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029437+0000", 2024-05-08T18:08:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3309000000000001e-05 2024-05-08T18:08:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029467+0000", 2024-05-08T18:08:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9677999999999999e-05 2024-05-08T18:08:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029489+0000", 2024-05-08T18:08:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2314999999999999e-05 2024-05-08T18:08:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029600+0000", 2024-05-08T18:08:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110561 2024-05-08T18:08:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029896+0000", 2024-05-08T18:08:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029632200000000001 2024-05-08T18:08:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.030468+0000", 2024-05-08T18:08:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00057224700000000001 2024-05-08T18:08:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.031728+0000", 2024-05-08T18:08:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012595429999999999 2024-05-08T18:08:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032338+0000", 2024-05-08T18:08:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00061006700000000005 2024-05-08T18:08:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032424+0000", 2024-05-08T18:08:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032488+0000", 2024-05-08T18:08:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4210999999999999e-05 2024-05-08T18:08:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.316217823000002, 2024-05-08T18:08:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029269769999999999, 2024-05-08T18:08:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 726 2024-05-08T18:08:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034074+0000", 2024-05-08T18:08:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5900000000000002e-06 2024-05-08T18:08:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034086+0000", 2024-05-08T18:08:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1265e-05 2024-05-08T18:08:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034118+0000", 2024-05-08T18:08:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2341000000000001e-05 2024-05-08T18:08:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034133+0000", 2024-05-08T18:08:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5166e-05 2024-05-08T18:08:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034254+0000", 2024-05-08T18:08:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121033 2024-05-08T18:08:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034492+0000", 2024-05-08T18:08:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023727700000000001 2024-05-08T18:08:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034967+0000", 2024-05-08T18:08:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047522100000000001 2024-05-08T18:08:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036353+0000", 2024-05-08T18:08:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013865800000000001 2024-05-08T18:08:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036841+0000", 2024-05-08T18:08:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048788999999999999 2024-05-08T18:08:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036929+0000", 2024-05-08T18:08:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:08:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036999+0000", 2024-05-08T18:08:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9448000000000003e-05 2024-05-08T18:08:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.312922993000001, 2024-05-08T18:08:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003040662, 2024-05-08T18:08:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 727 2024-05-08T18:08:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037369+0000", 2024-05-08T18:08:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:08:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037378+0000", 2024-05-08T18:08:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5359999999999998e-06 2024-05-08T18:08:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037405+0000", 2024-05-08T18:08:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6588e-05 2024-05-08T18:08:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037418+0000", 2024-05-08T18:08:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3642000000000001e-05 2024-05-08T18:08:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037531+0000", 2024-05-08T18:08:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112304 2024-05-08T18:08:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037785+0000", 2024-05-08T18:08:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025391299999999998 2024-05-08T18:08:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.038112+0000", 2024-05-08T18:08:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000326946 2024-05-08T18:08:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.039316+0000", 2024-05-08T18:08:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012043990000000001 2024-05-08T18:08:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040257+0000", 2024-05-08T18:08:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000941083 2024-05-08T18:08:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040345+0000", 2024-05-08T18:08:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8368999999999994e-05 2024-05-08T18:08:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040407+0000", 2024-05-08T18:08:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1941999999999997e-05 2024-05-08T18:08:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.198257604000005, 2024-05-08T18:08:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028797779999999999, 2024-05-08T18:08:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 777 2024-05-08T18:08:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152034+0000", 2024-05-08T18:08:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2299999999999998e-06 2024-05-08T18:08:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152045+0000", 2024-05-08T18:08:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0266e-05 2024-05-08T18:08:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152076+0000", 2024-05-08T18:08:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1007000000000003e-05 2024-05-08T18:08:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152094+0000", 2024-05-08T18:08:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8148999999999999e-05 2024-05-08T18:08:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152183+0000", 2024-05-08T18:08:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8845999999999996e-05 2024-05-08T18:08:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152308+0000", 2024-05-08T18:08:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012502999999999999 2024-05-08T18:08:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152578+0000", 2024-05-08T18:08:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027080099999999998 2024-05-08T18:08:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154238+0000", 2024-05-08T18:08:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016600180000000001 2024-05-08T18:08:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154714+0000", 2024-05-08T18:08:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000475341 2024-05-08T18:08:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154803+0000", 2024-05-08T18:08:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9566000000000003e-05 2024-05-08T18:08:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154912+0000", 2024-05-08T18:08:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010852400000000001 2024-05-08T18:08:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.955041711000007, 2024-05-08T18:08:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002844437, 2024-05-08T18:08:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 882 2024-05-08T18:08:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395250+0000", 2024-05-08T18:08:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-06 2024-05-08T18:08:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395261+0000", 2024-05-08T18:08:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1046000000000001e-05 2024-05-08T18:08:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395293+0000", 2024-05-08T18:08:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1473999999999997e-05 2024-05-08T18:08:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395307+0000", 2024-05-08T18:08:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4599e-05 2024-05-08T18:08:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395481+0000", 2024-05-08T18:08:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173499 2024-05-08T18:08:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395626+0000", 2024-05-08T18:08:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000145351 2024-05-08T18:08:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395902+0000", 2024-05-08T18:08:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027534499999999997 2024-05-08T18:08:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397118+0000", 2024-05-08T18:08:54.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012168929999999999 2024-05-08T18:08:54.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397951+0000", 2024-05-08T18:08:54.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000832272 2024-05-08T18:08:54.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398028+0000", 2024-05-08T18:08:54.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6921000000000004e-05 2024-05-08T18:08:54.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398092+0000", 2024-05-08T18:08:54.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4783999999999995e-05 2024-05-08T18:08:54.439 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.439 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.439 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.439 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.439 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:54.439 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.951980990999999, 2024-05-08T18:08:54.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002853894, 2024-05-08T18:08:54.439 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.439 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.440 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.440 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.440 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.440 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.440 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 883 2024-05-08T18:08:54.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.440 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:54.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:54.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398311+0000", 2024-05-08T18:08:54.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:54.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398321+0000", 2024-05-08T18:08:54.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9189999999999994e-06 2024-05-08T18:08:54.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398346+0000", 2024-05-08T18:08:54.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5065000000000001e-05 2024-05-08T18:08:54.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398360+0000", 2024-05-08T18:08:54.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4171999999999999e-05 2024-05-08T18:08:54.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398495+0000", 2024-05-08T18:08:54.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013503199999999999 2024-05-08T18:08:54.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398716+0000", 2024-05-08T18:08:54.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220459 2024-05-08T18:08:54.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:54.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.399054+0000", 2024-05-08T18:08:54.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033806199999999998 2024-05-08T18:08:54.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.400192+0000", 2024-05-08T18:08:54.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011389169999999999 2024-05-08T18:08:54.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401020+0000", 2024-05-08T18:08:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082746199999999995 2024-05-08T18:08:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401099+0000", 2024-05-08T18:08:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9157000000000001e-05 2024-05-08T18:08:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401163+0000", 2024-05-08T18:08:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3498999999999996e-05 2024-05-08T18:08:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.445 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.445 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:54.445 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.948192153999997, 2024-05-08T18:08:54.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031354040000000001, 2024-05-08T18:08:54.445 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.445 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.445 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.445 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.445 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.445 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.445 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 885 2024-05-08T18:08:54.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.445 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:54.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:54.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402100+0000", 2024-05-08T18:08:54.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.063e-06 2024-05-08T18:08:54.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402110+0000", 2024-05-08T18:08:54.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0453e-05 2024-05-08T18:08:54.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402141+0000", 2024-05-08T18:08:54.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0651000000000002e-05 2024-05-08T18:08:54.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402162+0000", 2024-05-08T18:08:54.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1373999999999999e-05 2024-05-08T18:08:54.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402306+0000", 2024-05-08T18:08:54.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143492 2024-05-08T18:08:54.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402562+0000", 2024-05-08T18:08:54.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025671899999999998 2024-05-08T18:08:54.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:54.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.403047+0000", 2024-05-08T18:08:54.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048419100000000003 2024-05-08T18:08:54.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404370+0000", 2024-05-08T18:08:54.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013231580000000001 2024-05-08T18:08:54.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404966+0000", 2024-05-08T18:08:54.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00059601100000000002 2024-05-08T18:08:54.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405115+0000", 2024-05-08T18:08:54.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149665 2024-05-08T18:08:54.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405233+0000", 2024-05-08T18:08:54.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117627 2024-05-08T18:08:54.450 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.450 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.450 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.450 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.450 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:54.450 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.850894619000002, 2024-05-08T18:08:54.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003251168, 2024-05-08T18:08:54.450 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.451 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.451 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.451 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.451 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.451 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.451 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 927 2024-05-08T18:08:54.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.451 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:54.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:54.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499396+0000", 2024-05-08T18:08:54.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:08:54.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499404+0000", 2024-05-08T18:08:54.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2629999999999997e-06 2024-05-08T18:08:54.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499423+0000", 2024-05-08T18:08:54.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9695e-05 2024-05-08T18:08:54.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499435+0000", 2024-05-08T18:08:54.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1542999999999999e-05 2024-05-08T18:08:54.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499545+0000", 2024-05-08T18:08:54.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110064 2024-05-08T18:08:54.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499764+0000", 2024-05-08T18:08:54.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021856499999999999 2024-05-08T18:08:54.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:54.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.500237+0000", 2024-05-08T18:08:54.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047359499999999999 2024-05-08T18:08:54.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.501627+0000", 2024-05-08T18:08:54.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013897860000000001 2024-05-08T18:08:54.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502484+0000", 2024-05-08T18:08:54.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085733300000000005 2024-05-08T18:08:54.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502574+0000", 2024-05-08T18:08:54.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9939999999999996e-05 2024-05-08T18:08:54.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502646+0000", 2024-05-08T18:08:54.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2064000000000007e-05 2024-05-08T18:08:54.456 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.456 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.457 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.457 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:54.457 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:54.457 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.847395078000005, 2024-05-08T18:08:54.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031881129999999998, 2024-05-08T18:08:54.457 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:54.457 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:54.457 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:54.457 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:54.457 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:54.457 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:54.457 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 928 2024-05-08T18:08:54.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.458 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:54.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:54.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:54.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:54.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:54.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:54.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:54.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502897+0000", 2024-05-08T18:08:54.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.916e-06 2024-05-08T18:08:54.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:54.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502906+0000", 2024-05-08T18:08:54.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2699999999999993e-06 2024-05-08T18:08:54.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:54.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502933+0000", 2024-05-08T18:08:54.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6823999999999999e-05 2024-05-08T18:08:54.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:54.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502946+0000", 2024-05-08T18:08:54.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3439e-05 2024-05-08T18:08:54.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:54.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503066+0000", 2024-05-08T18:08:54.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012013700000000001 2024-05-08T18:08:54.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:54.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503399+0000", 2024-05-08T18:08:54.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033298600000000001 2024-05-08T18:08:54.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:54.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503928+0000", 2024-05-08T18:08:54.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052877299999999996 2024-05-08T18:08:54.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:54.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505291+0000", 2024-05-08T18:08:54.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001363319 2024-05-08T18:08:54.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:54.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505933+0000", 2024-05-08T18:08:54.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064135799999999997 2024-05-08T18:08:54.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:54.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506019+0000", 2024-05-08T18:08:54.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6649000000000003e-05 2024-05-08T18:08:54.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:54.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:54.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:54.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506083+0000", 2024-05-08T18:08:54.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3441999999999993e-05 2024-05-08T18:08:54.464 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.464 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.464 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.464 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:54.464 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:54.464 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:54.466 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:08:54.467 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:54.465+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:54.567 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:54.565+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:54.588 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:08:54.636 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:54.636 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:54.636 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:54.636 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:54.651 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:08:54.667 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:54.668+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:54.768 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:54.769+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:54.785 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:54.785 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:54.812 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:54.813 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:54.813 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:54.813 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:54.813 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:54.815 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:54.815 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:54.827 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:08:54.845 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:54.845 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:54.868 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:54.868+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:54.875 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:54.876 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:54.906 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:54.906 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:54.937 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:54.937 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:54.969 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:54.969 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:54.970 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:54.969+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:54.994 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:54.994 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:55.002 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.0 to 1 (10000) 2024-05-08T18:08:55.005 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:55.006 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:55.011 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:08:55.037 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-08T18:08:55.078 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:55.080+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:55.171 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:55.172+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:55.173 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:55.173 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:55.188 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:08:55.272 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:55.272+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:55.308 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:55.309 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:55.324 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:08:55.373 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:55.373+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:55.444 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:55.444 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:55.458 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:08:55.474 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:55.472+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:55.574 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:55.576+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:55.627 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:55.627 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:55.641 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:08:55.675 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:55.676+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:55.759 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:55.759 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:55.774 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:08:55.775 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:55.776+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:55.877 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:55.877+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:55.896 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:55.896 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:55.910 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:08:55.978 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:55.977+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:56.007 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.1 to 1 (10000) 2024-05-08T18:08:56.030 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:08:56.040 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-08T18:08:56.084 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:56.084 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:56.084 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:56.084+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:56.104 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:08:56.180 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:56.181+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:56.280 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:56.280+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:56.325 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:56.325 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:56.344 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:08:56.381 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:56.381+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:56.483 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:56.481+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:56.557 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:56.558 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:56.574 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:08:56.618 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:56.620+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:56.683 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:56.684+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:56.742 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:56.742 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:56.759 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:08:56.784 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:56.785+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:56.885 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:56.885+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:56.968 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:56.968 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:56.986 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:08:56.987 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:56.988+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:57.025 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.2 to 1 (10000) 2024-05-08T18:08:57.029 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-05-08T18:08:57.032 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:08:57.056 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-08T18:08:57.087 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:57.089+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:57.188 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:57.189+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:57.199 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:57.199 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:08:57.219 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:08:57.289 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:57.289+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:57.302 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:57.302 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:57.332 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:57.333 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:57.369 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:57.369 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:57.390 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:57.392+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:57.395 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:57.395 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:57.395 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:57.395 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:57.401 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:57.401 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:57.414 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:08:57.435 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:57.435 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:57.468 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:57.469 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:57.491 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:57.489+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:57.502 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:57.502 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:57.532 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:57.532 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:57.592 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:57.593+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:57.605 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:57.605 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:57.605 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:57.605 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:57.605 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:57.622 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:08:57.692 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:08:57.692+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:08:57.793 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:57.793 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.219488225000006, 2024-05-08T18:08:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002466088, 2024-05-08T18:08:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.794 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 52 2024-05-08T18:08:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:08:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577062+0000", 2024-05-08T18:08:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.994e-06 2024-05-08T18:08:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577075+0000", 2024-05-08T18:08:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2480000000000001e-05 2024-05-08T18:08:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577108+0000", 2024-05-08T18:08:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3096000000000003e-05 2024-05-08T18:08:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577131+0000", 2024-05-08T18:08:57.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2993000000000002e-05 2024-05-08T18:08:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577260+0000", 2024-05-08T18:08:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012912899999999999 2024-05-08T18:08:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577453+0000", 2024-05-08T18:08:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000193668 2024-05-08T18:08:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:57.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577634+0000", 2024-05-08T18:08:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180576 2024-05-08T18:08:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579082+0000", 2024-05-08T18:08:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001448083 2024-05-08T18:08:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579290+0000", 2024-05-08T18:08:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000208333 2024-05-08T18:08:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579403+0000", 2024-05-08T18:08:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011296800000000001 2024-05-08T18:08:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579525+0000", 2024-05-08T18:08:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121768 2024-05-08T18:08:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-05-08T18:08:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.207628459999995, 2024-05-08T18:08:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038858310000000002, 2024-05-08T18:08:57.799 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:08:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588920+0000", 2024-05-08T18:08:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.23e-07 2024-05-08T18:08:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588929+0000", 2024-05-08T18:08:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3659999999999998e-06 2024-05-08T18:08:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588948+0000", 2024-05-08T18:08:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8768000000000001e-05 2024-05-08T18:08:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588962+0000", 2024-05-08T18:08:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4e-05 2024-05-08T18:08:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589110+0000", 2024-05-08T18:08:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148047 2024-05-08T18:08:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589173+0000", 2024-05-08T18:08:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2766000000000002e-05 2024-05-08T18:08:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592728+0000", 2024-05-08T18:08:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035553300000000002 2024-05-08T18:08:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592805+0000", 2024-05-08T18:08:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6730999999999994e-05 2024-05-08T18:08:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:57.803 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.091559562, 2024-05-08T18:08:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034354310000000001, 2024-05-08T18:08:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 236 2024-05-08T18:08:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:08:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704991+0000", 2024-05-08T18:08:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1240000000000001e-06 2024-05-08T18:08:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705009+0000", 2024-05-08T18:08:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7819e-05 2024-05-08T18:08:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705048+0000", 2024-05-08T18:08:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9632999999999998e-05 2024-05-08T18:08:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705073+0000", 2024-05-08T18:08:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4686999999999999e-05 2024-05-08T18:08:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705241+0000", 2024-05-08T18:08:57.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759899999999999 2024-05-08T18:08:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705511+0000", 2024-05-08T18:08:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027018799999999998 2024-05-08T18:08:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705965+0000", 2024-05-08T18:08:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045433000000000002 2024-05-08T18:08:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.707487+0000", 2024-05-08T18:08:57.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015214810000000001 2024-05-08T18:08:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708125+0000", 2024-05-08T18:08:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063870300000000001 2024-05-08T18:08:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708298+0000", 2024-05-08T18:08:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172592 2024-05-08T18:08:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708423+0000", 2024-05-08T18:08:57.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125275 2024-05-08T18:08:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:308 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.074721659999994, 2024-05-08T18:08:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038707400000000001, 2024-05-08T18:08:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 308 2024-05-08T18:08:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:08:57.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721827+0000", 2024-05-08T18:08:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1519999999999999e-06 2024-05-08T18:08:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721840+0000", 2024-05-08T18:08:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.362e-05 2024-05-08T18:08:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721857+0000", 2024-05-08T18:08:57.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6901e-05 2024-05-08T18:08:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721867+0000", 2024-05-08T18:08:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0034000000000001e-05 2024-05-08T18:08:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721922+0000", 2024-05-08T18:08:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4450999999999998e-05 2024-05-08T18:08:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721981+0000", 2024-05-08T18:08:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9267e-05 2024-05-08T18:08:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722103+0000", 2024-05-08T18:08:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121502 2024-05-08T18:08:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722757+0000", 2024-05-08T18:08:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065419700000000003 2024-05-08T18:08:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725619+0000", 2024-05-08T18:08:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002862107 2024-05-08T18:08:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725654+0000", 2024-05-08T18:08:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:08:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725696+0000", 2024-05-08T18:08:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:08:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:604 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.897438953999995, 2024-05-08T18:08:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002741884, 2024-05-08T18:08:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 604 2024-05-08T18:08:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:08:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899111+0000", 2024-05-08T18:08:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0910000000000001e-06 2024-05-08T18:08:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899126+0000", 2024-05-08T18:08:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:08:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899159+0000", 2024-05-08T18:08:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3241999999999998e-05 2024-05-08T18:08:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899174+0000", 2024-05-08T18:08:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5235000000000001e-05 2024-05-08T18:08:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899316+0000", 2024-05-08T18:08:57.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014175599999999999 2024-05-08T18:08:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899525+0000", 2024-05-08T18:08:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020915300000000001 2024-05-08T18:08:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899872+0000", 2024-05-08T18:08:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034668299999999997 2024-05-08T18:08:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901064+0000", 2024-05-08T18:08:57.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001191473 2024-05-08T18:08:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901664+0000", 2024-05-08T18:08:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060054599999999998 2024-05-08T18:08:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901779+0000", 2024-05-08T18:08:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011452500000000001 2024-05-08T18:08:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901850+0000", 2024-05-08T18:08:57.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1580000000000002e-05 2024-05-08T18:08:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:612 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.891930391000002, 2024-05-08T18:08:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025904750000000001, 2024-05-08T18:08:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.820 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 612 2024-05-08T18:08:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:08:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904619+0000", 2024-05-08T18:08:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8479999999999999e-06 2024-05-08T18:08:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904628+0000", 2024-05-08T18:08:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8829999999999995e-06 2024-05-08T18:08:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904650+0000", 2024-05-08T18:08:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2467999999999999e-05 2024-05-08T18:08:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904669+0000", 2024-05-08T18:08:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9303000000000001e-05 2024-05-08T18:08:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904766+0000", 2024-05-08T18:08:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6917999999999996e-05 2024-05-08T18:08:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904935+0000", 2024-05-08T18:08:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000168441 2024-05-08T18:08:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.905288+0000", 2024-05-08T18:08:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035312199999999998 2024-05-08T18:08:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.906520+0000", 2024-05-08T18:08:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001232005 2024-05-08T18:08:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907086+0000", 2024-05-08T18:08:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056658900000000005 2024-05-08T18:08:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907154+0000", 2024-05-08T18:08:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7197000000000001e-05 2024-05-08T18:08:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907207+0000", 2024-05-08T18:08:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3701e-05 2024-05-08T18:08:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.723912798000001, 2024-05-08T18:08:57.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032464490000000002, 2024-05-08T18:08:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 742 2024-05-08T18:08:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:08:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072637+0000", 2024-05-08T18:08:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9059999999999998e-06 2024-05-08T18:08:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072651+0000", 2024-05-08T18:08:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3477e-05 2024-05-08T18:08:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072683+0000", 2024-05-08T18:08:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2116000000000002e-05 2024-05-08T18:08:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072698+0000", 2024-05-08T18:08:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5454000000000001e-05 2024-05-08T18:08:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072845+0000", 2024-05-08T18:08:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146532 2024-05-08T18:08:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073241+0000", 2024-05-08T18:08:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039580699999999997 2024-05-08T18:08:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073812+0000", 2024-05-08T18:08:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057164900000000003 2024-05-08T18:08:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075063+0000", 2024-05-08T18:08:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001250131 2024-05-08T18:08:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075723+0000", 2024-05-08T18:08:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00066039199999999999 2024-05-08T18:08:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075808+0000", 2024-05-08T18:08:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5458999999999996e-05 2024-05-08T18:08:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075881+0000", 2024-05-08T18:08:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2526000000000003e-05 2024-05-08T18:08:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.681504433000001, 2024-05-08T18:08:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029270590000000001, 2024-05-08T18:08:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 760 2024-05-08T18:08:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.831 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:08:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115045+0000", 2024-05-08T18:08:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0729999999999999e-06 2024-05-08T18:08:57.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115057+0000", 2024-05-08T18:08:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1617000000000001e-05 2024-05-08T18:08:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115088+0000", 2024-05-08T18:08:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1155999999999998e-05 2024-05-08T18:08:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115103+0000", 2024-05-08T18:08:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5067e-05 2024-05-08T18:08:57.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115289+0000", 2024-05-08T18:08:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186582 2024-05-08T18:08:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115506+0000", 2024-05-08T18:08:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021690500000000001 2024-05-08T18:08:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115832+0000", 2024-05-08T18:08:57.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032556799999999998 2024-05-08T18:08:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.116892+0000", 2024-05-08T18:08:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010597989999999999 2024-05-08T18:08:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117807+0000", 2024-05-08T18:08:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091502599999999999 2024-05-08T18:08:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117895+0000", 2024-05-08T18:08:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7977000000000001e-05 2024-05-08T18:08:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117970+0000", 2024-05-08T18:08:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5289000000000004e-05 2024-05-08T18:08:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.550506947000002, 2024-05-08T18:08:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028290730000000001, 2024-05-08T18:08:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.836 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 817 2024-05-08T18:08:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:08:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246043+0000", 2024-05-08T18:08:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.807e-06 2024-05-08T18:08:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246056+0000", 2024-05-08T18:08:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2383e-05 2024-05-08T18:08:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246087+0000", 2024-05-08T18:08:57.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1937000000000003e-05 2024-05-08T18:08:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246104+0000", 2024-05-08T18:08:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6643e-05 2024-05-08T18:08:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246225+0000", 2024-05-08T18:08:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012061900000000001 2024-05-08T18:08:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.839 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246510+0000", 2024-05-08T18:08:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028507100000000002 2024-05-08T18:08:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246881+0000", 2024-05-08T18:08:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037163799999999998 2024-05-08T18:08:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248078+0000", 2024-05-08T18:08:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011968969999999999 2024-05-08T18:08:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248715+0000", 2024-05-08T18:08:57.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063698599999999998 2024-05-08T18:08:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248801+0000", 2024-05-08T18:08:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5772999999999993e-05 2024-05-08T18:08:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248869+0000", 2024-05-08T18:08:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8318999999999994e-05 2024-05-08T18:08:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.496763462999994, 2024-05-08T18:08:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003281693, 2024-05-08T18:08:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 841 2024-05-08T18:08:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.842 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:08:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299786+0000", 2024-05-08T18:08:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4770000000000002e-06 2024-05-08T18:08:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299798+0000", 2024-05-08T18:08:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1493e-05 2024-05-08T18:08:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299827+0000", 2024-05-08T18:08:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9363e-05 2024-05-08T18:08:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299842+0000", 2024-05-08T18:08:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.448e-05 2024-05-08T18:08:57.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300001+0000", 2024-05-08T18:08:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015909600000000001 2024-05-08T18:08:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300384+0000", 2024-05-08T18:08:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038306000000000001 2024-05-08T18:08:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300929+0000", 2024-05-08T18:08:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054551299999999997 2024-05-08T18:08:57.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302151+0000", 2024-05-08T18:08:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012218540000000001 2024-05-08T18:08:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302918+0000", 2024-05-08T18:08:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076719099999999997 2024-05-08T18:08:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303000+0000", 2024-05-08T18:08:57.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1662999999999994e-05 2024-05-08T18:08:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303065+0000", 2024-05-08T18:08:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5502999999999999e-05 2024-05-08T18:08:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.492568007000003, 2024-05-08T18:08:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026179150000000002, 2024-05-08T18:08:57.847 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 843 2024-05-08T18:08:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:08:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303981+0000", 2024-05-08T18:08:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9740000000000001e-06 2024-05-08T18:08:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303990+0000", 2024-05-08T18:08:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9889999999999998e-06 2024-05-08T18:08:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304012+0000", 2024-05-08T18:08:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1537000000000001e-05 2024-05-08T18:08:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304023+0000", 2024-05-08T18:08:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:08:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304101+0000", 2024-05-08T18:08:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7732999999999996e-05 2024-05-08T18:08:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304210+0000", 2024-05-08T18:08:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010985299999999999 2024-05-08T18:08:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304490+0000", 2024-05-08T18:08:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000279564 2024-05-08T18:08:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.305542+0000", 2024-05-08T18:08:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051976 2024-05-08T18:08:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306451+0000", 2024-05-08T18:08:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00090901999999999997 2024-05-08T18:08:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306533+0000", 2024-05-08T18:08:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1790000000000001e-05 2024-05-08T18:08:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306597+0000", 2024-05-08T18:08:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4332999999999995e-05 2024-05-08T18:08:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.482871797000001, 2024-05-08T18:08:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00275537, 2024-05-08T18:08:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.853 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 847 2024-05-08T18:08:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:08:57.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313678+0000", 2024-05-08T18:08:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:08:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313689+0000", 2024-05-08T18:08:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1273e-05 2024-05-08T18:08:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313719+0000", 2024-05-08T18:08:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9726e-05 2024-05-08T18:08:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313733+0000", 2024-05-08T18:08:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4487e-05 2024-05-08T18:08:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313858+0000", 2024-05-08T18:08:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125172 2024-05-08T18:08:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314072+0000", 2024-05-08T18:08:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021314200000000001 2024-05-08T18:08:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314378+0000", 2024-05-08T18:08:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030653100000000002 2024-05-08T18:08:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.315524+0000", 2024-05-08T18:08:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011458950000000001 2024-05-08T18:08:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316213+0000", 2024-05-08T18:08:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068942199999999997 2024-05-08T18:08:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316314+0000", 2024-05-08T18:08:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100723 2024-05-08T18:08:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316431+0000", 2024-05-08T18:08:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116759 2024-05-08T18:08:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.858 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.479219860000001, 2024-05-08T18:08:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025522510000000002, 2024-05-08T18:08:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 849 2024-05-08T18:08:57.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:08:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317329+0000", 2024-05-08T18:08:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9530000000000002e-06 2024-05-08T18:08:57.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317340+0000", 2024-05-08T18:08:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.08e-05 2024-05-08T18:08:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317364+0000", 2024-05-08T18:08:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4142999999999999e-05 2024-05-08T18:08:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317377+0000", 2024-05-08T18:08:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2764e-05 2024-05-08T18:08:57.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317471+0000", 2024-05-08T18:08:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4289000000000005e-05 2024-05-08T18:08:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317600+0000", 2024-05-08T18:08:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012910499999999999 2024-05-08T18:08:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317868+0000", 2024-05-08T18:08:57.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000267562 2024-05-08T18:08:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319081+0000", 2024-05-08T18:08:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001213387 2024-05-08T18:08:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319723+0000", 2024-05-08T18:08:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064134200000000004 2024-05-08T18:08:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319808+0000", 2024-05-08T18:08:57.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:57.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.864 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.864 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.864 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319880+0000", 2024-05-08T18:08:57.864 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1426000000000004e-05 2024-05-08T18:08:57.864 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.864 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.864 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.864 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.864 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.864 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:57.864 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.435787379000004, 2024-05-08T18:08:57.864 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002815157, 2024-05-08T18:08:57.864 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.865 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.865 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.865 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.865 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.865 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.865 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 868 2024-05-08T18:08:57.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.865 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.865 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.865 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:57.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.865 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.866 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:08:57.866 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.866 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.866 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360762+0000", 2024-05-08T18:08:57.866 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:08:57.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.866 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.866 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360775+0000", 2024-05-08T18:08:57.866 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2840000000000001e-05 2024-05-08T18:08:57.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360805+0000", 2024-05-08T18:08:57.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9686e-05 2024-05-08T18:08:57.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360819+0000", 2024-05-08T18:08:57.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.434e-05 2024-05-08T18:08:57.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360948+0000", 2024-05-08T18:08:57.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000129033 2024-05-08T18:08:57.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361166+0000", 2024-05-08T18:08:57.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021747800000000001 2024-05-08T18:08:57.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.868 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:57.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361481+0000", 2024-05-08T18:08:57.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031515800000000001 2024-05-08T18:08:57.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.868 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.362546+0000", 2024-05-08T18:08:57.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010653889999999999 2024-05-08T18:08:57.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.869 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.869 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363365+0000", 2024-05-08T18:08:57.869 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081906100000000005 2024-05-08T18:08:57.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.869 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.869 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363450+0000", 2024-05-08T18:08:57.869 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5202000000000002e-05 2024-05-08T18:08:57.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.869 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.869 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363575+0000", 2024-05-08T18:08:57.869 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012460999999999999 2024-05-08T18:08:57.869 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.869 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.869 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.870 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.870 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:57.870 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.432095206, 2024-05-08T18:08:57.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024676260000000001, 2024-05-08T18:08:57.870 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.870 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.870 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.870 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.870 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.870 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.870 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 870 2024-05-08T18:08:57.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.871 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.871 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.871 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:57.871 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.871 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.871 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:08:57.871 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.871 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.871 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364454+0000", 2024-05-08T18:08:57.871 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7770000000000001e-06 2024-05-08T18:08:57.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.872 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.872 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364463+0000", 2024-05-08T18:08:57.872 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4800000000000007e-06 2024-05-08T18:08:57.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.872 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.872 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364487+0000", 2024-05-08T18:08:57.872 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3589999999999999e-05 2024-05-08T18:08:57.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.872 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.872 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364499+0000", 2024-05-08T18:08:57.872 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.241e-05 2024-05-08T18:08:57.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364607+0000", 2024-05-08T18:08:57.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010760900000000001 2024-05-08T18:08:57.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364750+0000", 2024-05-08T18:08:57.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014265600000000001 2024-05-08T18:08:57.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:57.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.365021+0000", 2024-05-08T18:08:57.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027115100000000002 2024-05-08T18:08:57.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.874 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.874 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366163+0000", 2024-05-08T18:08:57.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011419189999999999 2024-05-08T18:08:57.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.874 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.874 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366727+0000", 2024-05-08T18:08:57.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056400199999999997 2024-05-08T18:08:57.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.874 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.874 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366810+0000", 2024-05-08T18:08:57.875 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3133000000000005e-05 2024-05-08T18:08:57.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.875 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.875 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366920+0000", 2024-05-08T18:08:57.875 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109899 2024-05-08T18:08:57.875 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.875 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.875 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.875 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.875 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:57.876 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.342181027999999, 2024-05-08T18:08:57.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027893459999999998, 2024-05-08T18:08:57.876 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.876 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.876 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.876 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.876 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.876 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.876 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 907 2024-05-08T18:08:57.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.876 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.876 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.876 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:57.877 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.877 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.877 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:08:57.877 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.877 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.877 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454369+0000", 2024-05-08T18:08:57.877 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5730000000000002e-06 2024-05-08T18:08:57.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.877 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.877 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454381+0000", 2024-05-08T18:08:57.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.208e-05 2024-05-08T18:08:57.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454413+0000", 2024-05-08T18:08:57.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2493000000000002e-05 2024-05-08T18:08:57.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454432+0000", 2024-05-08T18:08:57.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8862999999999999e-05 2024-05-08T18:08:57.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454577+0000", 2024-05-08T18:08:57.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014477899999999999 2024-05-08T18:08:57.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454800+0000", 2024-05-08T18:08:57.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223425 2024-05-08T18:08:57.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:57.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.455168+0000", 2024-05-08T18:08:57.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036712799999999999 2024-05-08T18:08:57.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.880 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456282+0000", 2024-05-08T18:08:57.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011141580000000001 2024-05-08T18:08:57.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.880 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.880 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456953+0000", 2024-05-08T18:08:57.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000670956 2024-05-08T18:08:57.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.880 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.880 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457038+0000", 2024-05-08T18:08:57.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4828999999999997e-05 2024-05-08T18:08:57.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.880 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.881 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457156+0000", 2024-05-08T18:08:57.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118062 2024-05-08T18:08:57.881 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.881 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.881 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.881 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.881 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:57.881 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.338488665, 2024-05-08T18:08:57.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026891609999999998, 2024-05-08T18:08:57.881 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.881 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.881 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.881 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.882 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.882 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.882 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 909 2024-05-08T18:08:57.882 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.882 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.882 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.882 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.882 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:57.882 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.882 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.882 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.882 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.882 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:08:57.882 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458060+0000", 2024-05-08T18:08:57.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:08:57.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458069+0000", 2024-05-08T18:08:57.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6440000000000006e-06 2024-05-08T18:08:57.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458090+0000", 2024-05-08T18:08:57.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1089000000000001e-05 2024-05-08T18:08:57.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458102+0000", 2024-05-08T18:08:57.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2306999999999999e-05 2024-05-08T18:08:57.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458191+0000", 2024-05-08T18:08:57.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8213000000000004e-05 2024-05-08T18:08:57.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458313+0000", 2024-05-08T18:08:57.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012231500000000001 2024-05-08T18:08:57.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:08:57.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458581+0000", 2024-05-08T18:08:57.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026762500000000001 2024-05-08T18:08:57.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.459773+0000", 2024-05-08T18:08:57.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001192991 2024-05-08T18:08:57.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460590+0000", 2024-05-08T18:08:57.886 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081618100000000002 2024-05-08T18:08:57.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.886 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.886 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460681+0000", 2024-05-08T18:08:57.886 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0946000000000006e-05 2024-05-08T18:08:57.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.886 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.886 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460748+0000", 2024-05-08T18:08:57.886 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7139999999999998e-05 2024-05-08T18:08:57.886 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.886 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.886 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.887 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.887 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:57.887 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.244845647000005, 2024-05-08T18:08:57.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030359179999999999, 2024-05-08T18:08:57.887 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.887 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.887 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.887 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.887 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.887 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.887 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 949 2024-05-08T18:08:57.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.887 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.888 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.888 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:57.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.888 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.888 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:08:57.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.888 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.888 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551705+0000", 2024-05-08T18:08:57.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2770000000000001e-06 2024-05-08T18:08:57.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.889 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551717+0000", 2024-05-08T18:08:57.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.206e-05 2024-05-08T18:08:57.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.889 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551747+0000", 2024-05-08T18:08:57.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0168999999999999e-05 2024-05-08T18:08:57.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.889 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551763+0000", 2024-05-08T18:08:57.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:08:57.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551880+0000", 2024-05-08T18:08:57.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116976 2024-05-08T18:08:57.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552099+0000", 2024-05-08T18:08:57.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021910199999999999 2024-05-08T18:08:57.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:57.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552476+0000", 2024-05-08T18:08:57.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000376697 2024-05-08T18:08:57.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.553551+0000", 2024-05-08T18:08:57.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001074925 2024-05-08T18:08:57.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554588+0000", 2024-05-08T18:08:57.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010374099999999999 2024-05-08T18:08:57.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554671+0000", 2024-05-08T18:08:57.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3368999999999994e-05 2024-05-08T18:08:57.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554738+0000", 2024-05-08T18:08:57.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6043000000000004e-05 2024-05-08T18:08:57.892 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.892 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.892 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.892 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.892 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:57.892 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.231232208999998, 2024-05-08T18:08:57.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028304160000000001, 2024-05-08T18:08:57.892 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.892 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.892 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.893 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.893 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.893 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.893 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 955 2024-05-08T18:08:57.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.893 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:57.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:08:57.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565318+0000", 2024-05-08T18:08:57.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7030000000000002e-06 2024-05-08T18:08:57.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565330+0000", 2024-05-08T18:08:57.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.204e-05 2024-05-08T18:08:57.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565363+0000", 2024-05-08T18:08:57.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2722999999999998e-05 2024-05-08T18:08:57.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565389+0000", 2024-05-08T18:08:57.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6412999999999999e-05 2024-05-08T18:08:57.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565510+0000", 2024-05-08T18:08:57.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120932 2024-05-08T18:08:57.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565722+0000", 2024-05-08T18:08:57.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212139 2024-05-08T18:08:57.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:57.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.566034+0000", 2024-05-08T18:08:57.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000312038 2024-05-08T18:08:57.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567340+0000", 2024-05-08T18:08:57.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00130547 2024-05-08T18:08:57.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567998+0000", 2024-05-08T18:08:57.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000658382 2024-05-08T18:08:57.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568081+0000", 2024-05-08T18:08:57.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3269999999999994e-05 2024-05-08T18:08:57.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568145+0000", 2024-05-08T18:08:57.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4306000000000004e-05 2024-05-08T18:08:57.897 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.897 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.897 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.897 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:57.898 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:57.898 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.227512685999997, 2024-05-08T18:08:57.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027506660000000001, 2024-05-08T18:08:57.898 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:57.898 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:57.898 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:57.898 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:57.898 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:57.898 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:57.898 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 957 2024-05-08T18:08:57.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.898 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:57.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:57.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:57.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:57.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:08:57.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:57.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:57.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569036+0000", 2024-05-08T18:08:57.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.776e-06 2024-05-08T18:08:57.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:57.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569061+0000", 2024-05-08T18:08:57.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5097e-05 2024-05-08T18:08:57.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:57.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569084+0000", 2024-05-08T18:08:57.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.23e-05 2024-05-08T18:08:57.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:57.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569096+0000", 2024-05-08T18:08:57.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.22e-05 2024-05-08T18:08:57.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:57.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569180+0000", 2024-05-08T18:08:57.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4369000000000005e-05 2024-05-08T18:08:57.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:57.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569296+0000", 2024-05-08T18:08:57.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115999 2024-05-08T18:08:57.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:57.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569550+0000", 2024-05-08T18:08:57.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025397499999999998 2024-05-08T18:08:57.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:57.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.570963+0000", 2024-05-08T18:08:57.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001413023 2024-05-08T18:08:57.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:57.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571614+0000", 2024-05-08T18:08:57.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065041199999999995 2024-05-08T18:08:57.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:57.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571701+0000", 2024-05-08T18:08:57.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7569000000000001e-05 2024-05-08T18:08:57.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:57.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:57.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:57.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571785+0000", 2024-05-08T18:08:57.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3945999999999999e-05 2024-05-08T18:08:57.903 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.903 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.903 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.903 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:57.903 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:57.903 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:57.904 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:57.793+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:57.905 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:08:57.905 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:57.905+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:58.006 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:58.005+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:58.027 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.3 to 1 (10000) 2024-05-08T18:08:58.055 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-08T18:08:58.106 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:58.108+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:58.119 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:58.119 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:58.119 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:08:58.119 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:58.138 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:08:58.226 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:58.228+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:58.308 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:58.308+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:58.353 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:58.353 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:08:58.353 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:08:58.354 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:08:58.354 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:58.372 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:08:58.409 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:58.409+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:58.510 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:58.512+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:58.586 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:08:58.586 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:08:58.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:08:58.586 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:08:58.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.586 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:58.586 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:58.586 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 97.035951896, 2024-05-08T18:08:58.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049710090000000002, 2024-05-08T18:08:58.586 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.586 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.587 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-08T18:08:58.587 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.587 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.587 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.587 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 44 2024-05-08T18:08:58.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.587 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:58.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:08:58.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552775+0000", 2024-05-08T18:08:58.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4450000000000001e-06 2024-05-08T18:08:58.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552790+0000", 2024-05-08T18:08:58.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4363e-05 2024-05-08T18:08:58.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552820+0000", 2024-05-08T18:08:58.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0485999999999999e-05 2024-05-08T18:08:58.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552843+0000", 2024-05-08T18:08:58.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2985000000000001e-05 2024-05-08T18:08:58.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554350+0000", 2024-05-08T18:08:58.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015065149999999999 2024-05-08T18:08:58.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-08T18:08:58.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554374+0000", 2024-05-08T18:08:58.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4097e-05 2024-05-08T18:08:58.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557531+0000", 2024-05-08T18:08:58.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031567169999999999 2024-05-08T18:08:58.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557743+0000", 2024-05-08T18:08:58.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212401 2024-05-08T18:08:58.591 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.591 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.591 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.591 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:58.591 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:58.591 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.000600019000004, 2024-05-08T18:08:58.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050241879999999997, 2024-05-08T18:08:58.591 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.591 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.591 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.591 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.591 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.592 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.592 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 58 2024-05-08T18:08:58.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.592 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:58.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:08:58.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588125+0000", 2024-05-08T18:08:58.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1399999999999995e-07 2024-05-08T18:08:58.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588129+0000", 2024-05-08T18:08:58.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6779999999999999e-06 2024-05-08T18:08:58.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588142+0000", 2024-05-08T18:08:58.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3047999999999999e-05 2024-05-08T18:08:58.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588174+0000", 2024-05-08T18:08:58.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1270999999999999e-05 2024-05-08T18:08:58.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588307+0000", 2024-05-08T18:08:58.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013307600000000001 2024-05-08T18:08:58.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588477+0000", 2024-05-08T18:08:58.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000170213 2024-05-08T18:08:58.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:58.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588669+0000", 2024-05-08T18:08:58.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019211599999999999 2024-05-08T18:08:58.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.590228+0000", 2024-05-08T18:08:58.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015590059999999999 2024-05-08T18:08:58.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593029+0000", 2024-05-08T18:08:58.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028006400000000001 2024-05-08T18:08:58.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593099+0000", 2024-05-08T18:08:58.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0300000000000001e-05 2024-05-08T18:08:58.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593148+0000", 2024-05-08T18:08:58.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8925999999999999e-05 2024-05-08T18:08:58.596 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.596 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.596 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.597 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:08:58.597 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:58.597 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 92.004061859000004, 2024-05-08T18:08:58.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00385587, 2024-05-08T18:08:58.597 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.597 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.597 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.597 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.597 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.597 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.597 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207 2024-05-08T18:08:58.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.597 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:58.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:08:58.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584665+0000", 2024-05-08T18:08:58.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0570000000000001e-06 2024-05-08T18:08:58.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584679+0000", 2024-05-08T18:08:58.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3713000000000001e-05 2024-05-08T18:08:58.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584712+0000", 2024-05-08T18:08:58.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3213999999999997e-05 2024-05-08T18:08:58.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584728+0000", 2024-05-08T18:08:58.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5936000000000001e-05 2024-05-08T18:08:58.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584951+0000", 2024-05-08T18:08:58.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000222955 2024-05-08T18:08:58.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585196+0000", 2024-05-08T18:08:58.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024550800000000002 2024-05-08T18:08:58.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:58.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585643+0000", 2024-05-08T18:08:58.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00044644699999999999 2024-05-08T18:08:58.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.587110+0000", 2024-05-08T18:08:58.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001467323 2024-05-08T18:08:58.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588371+0000", 2024-05-08T18:08:58.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012607180000000001 2024-05-08T18:08:58.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588452+0000", 2024-05-08T18:08:58.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1216000000000003e-05 2024-05-08T18:08:58.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588518+0000", 2024-05-08T18:08:58.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5783000000000004e-05 2024-05-08T18:08:58.602 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.602 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.602 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.602 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:58.602 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:58.602 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.957886457000001, 2024-05-08T18:08:58.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003249994, 2024-05-08T18:08:58.602 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.603 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.603 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.603 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.603 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.603 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.603 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216 2024-05-08T18:08:58.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.603 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:58.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:08:58.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630840+0000", 2024-05-08T18:08:58.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0730000000000001e-06 2024-05-08T18:08:58.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630854+0000", 2024-05-08T18:08:58.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3360000000000001e-05 2024-05-08T18:08:58.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630889+0000", 2024-05-08T18:08:58.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5176999999999999e-05 2024-05-08T18:08:58.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630911+0000", 2024-05-08T18:08:58.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.247e-05 2024-05-08T18:08:58.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631046+0000", 2024-05-08T18:08:58.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013484599999999999 2024-05-08T18:08:58.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631272+0000", 2024-05-08T18:08:58.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000225694 2024-05-08T18:08:58.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:58.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631703+0000", 2024-05-08T18:08:58.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000431144 2024-05-08T18:08:58.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633244+0000", 2024-05-08T18:08:58.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001540622 2024-05-08T18:08:58.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633926+0000", 2024-05-08T18:08:58.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068244200000000001 2024-05-08T18:08:58.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634019+0000", 2024-05-08T18:08:58.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3148999999999999e-05 2024-05-08T18:08:58.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634087+0000", 2024-05-08T18:08:58.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8016999999999996e-05 2024-05-08T18:08:58.607 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.608 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.608 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.608 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:58.608 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:58.608 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.916342408000006, 2024-05-08T18:08:58.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003119854, 2024-05-08T18:08:58.608 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.608 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.608 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.608 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 227 2024-05-08T18:08:58.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.609 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:58.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:08:58.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672384+0000", 2024-05-08T18:08:58.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7470000000000001e-06 2024-05-08T18:08:58.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672396+0000", 2024-05-08T18:08:58.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.154e-05 2024-05-08T18:08:58.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672427+0000", 2024-05-08T18:08:58.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1676e-05 2024-05-08T18:08:58.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672443+0000", 2024-05-08T18:08:58.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5214e-05 2024-05-08T18:08:58.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672563+0000", 2024-05-08T18:08:58.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120535 2024-05-08T18:08:58.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672778+0000", 2024-05-08T18:08:58.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021446200000000001 2024-05-08T18:08:58.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:58.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.673205+0000", 2024-05-08T18:08:58.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042750699999999998 2024-05-08T18:08:58.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.674848+0000", 2024-05-08T18:08:58.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016432980000000001 2024-05-08T18:08:58.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675346+0000", 2024-05-08T18:08:58.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049711999999999998 2024-05-08T18:08:58.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675432+0000", 2024-05-08T18:08:58.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6798999999999993e-05 2024-05-08T18:08:58.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675501+0000", 2024-05-08T18:08:58.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8955999999999995e-05 2024-05-08T18:08:58.613 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.613 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.613 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.613 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:58.613 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:58.614 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.909401621000001, 2024-05-08T18:08:58.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034322110000000001, 2024-05-08T18:08:58.614 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.614 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.614 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.614 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.614 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.614 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.614 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 229 2024-05-08T18:08:58.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.614 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:58.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:08:58.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679325+0000", 2024-05-08T18:08:58.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:08:58.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679339+0000", 2024-05-08T18:08:58.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:08:58.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679370+0000", 2024-05-08T18:08:58.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0280000000000001e-05 2024-05-08T18:08:58.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679385+0000", 2024-05-08T18:08:58.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5026e-05 2024-05-08T18:08:58.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679504+0000", 2024-05-08T18:08:58.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119023 2024-05-08T18:08:58.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679711+0000", 2024-05-08T18:08:58.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020705499999999999 2024-05-08T18:08:58.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:58.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.680115+0000", 2024-05-08T18:08:58.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040396699999999998 2024-05-08T18:08:58.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.681424+0000", 2024-05-08T18:08:58.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001309387 2024-05-08T18:08:58.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682488+0000", 2024-05-08T18:08:58.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010642519999999999 2024-05-08T18:08:58.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682640+0000", 2024-05-08T18:08:58.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015123599999999999 2024-05-08T18:08:58.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682754+0000", 2024-05-08T18:08:58.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011482200000000001 2024-05-08T18:08:58.619 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.619 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.620 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.620 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:58.620 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:58.620 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.902017412000006, 2024-05-08T18:08:58.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033353329999999998, 2024-05-08T18:08:58.620 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.620 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.620 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.620 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.620 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.620 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.620 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 231 2024-05-08T18:08:58.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.621 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:58.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:08:58.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686709+0000", 2024-05-08T18:08:58.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4729999999999999e-06 2024-05-08T18:08:58.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686720+0000", 2024-05-08T18:08:58.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1157e-05 2024-05-08T18:08:58.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686750+0000", 2024-05-08T18:08:58.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0417e-05 2024-05-08T18:08:58.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686765+0000", 2024-05-08T18:08:58.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.487e-05 2024-05-08T18:08:58.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686872+0000", 2024-05-08T18:08:58.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010703499999999999 2024-05-08T18:08:58.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687085+0000", 2024-05-08T18:08:58.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021279599999999999 2024-05-08T18:08:58.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:58.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687501+0000", 2024-05-08T18:08:58.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041554 2024-05-08T18:08:58.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.688886+0000", 2024-05-08T18:08:58.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00138565 2024-05-08T18:08:58.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689899+0000", 2024-05-08T18:08:58.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010128190000000001 2024-05-08T18:08:58.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689978+0000", 2024-05-08T18:08:58.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8490000000000002e-05 2024-05-08T18:08:58.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.690042+0000", 2024-05-08T18:08:58.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4085999999999996e-05 2024-05-08T18:08:58.625 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.625 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.625 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.625 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:394 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:58.625 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:58.626 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.844944334999994, 2024-05-08T18:08:58.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034384960000000001, 2024-05-08T18:08:58.626 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.626 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.626 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.626 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.626 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.626 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.626 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 394 2024-05-08T18:08:58.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.626 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:58.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:08:58.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743781+0000", 2024-05-08T18:08:58.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3e-06 2024-05-08T18:08:58.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743788+0000", 2024-05-08T18:08:58.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7399999999999998e-06 2024-05-08T18:08:58.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743801+0000", 2024-05-08T18:08:58.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3757000000000001e-05 2024-05-08T18:08:58.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743808+0000", 2024-05-08T18:08:58.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6579999999999996e-06 2024-05-08T18:08:58.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743875+0000", 2024-05-08T18:08:58.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6740000000000001e-05 2024-05-08T18:08:58.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743971+0000", 2024-05-08T18:08:58.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6175000000000007e-05 2024-05-08T18:08:58.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:58.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744100+0000", 2024-05-08T18:08:58.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012954899999999999 2024-05-08T18:08:58.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744863+0000", 2024-05-08T18:08:58.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076300100000000002 2024-05-08T18:08:58.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747089+0000", 2024-05-08T18:08:58.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022258540000000002 2024-05-08T18:08:58.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747162+0000", 2024-05-08T18:08:58.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2632000000000005e-05 2024-05-08T18:08:58.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747218+0000", 2024-05-08T18:08:58.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.609e-05 2024-05-08T18:08:58.631 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.631 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.631 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.631 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:535 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:58.631 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:58.632 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.747231257999999, 2024-05-08T18:08:58.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055640899999999998, 2024-05-08T18:08:58.632 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.632 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.632 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.632 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.632 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.632 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.632 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 535 2024-05-08T18:08:58.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.632 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:58.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:08:58.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841494+0000", 2024-05-08T18:08:58.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0899999999999999e-06 2024-05-08T18:08:58.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841500+0000", 2024-05-08T18:08:58.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0249999999999999e-06 2024-05-08T18:08:58.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841513+0000", 2024-05-08T18:08:58.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3658e-05 2024-05-08T18:08:58.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841522+0000", 2024-05-08T18:08:58.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3410000000000003e-06 2024-05-08T18:08:58.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841574+0000", 2024-05-08T18:08:58.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2794000000000003e-05 2024-05-08T18:08:58.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841633+0000", 2024-05-08T18:08:58.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8595999999999999e-05 2024-05-08T18:08:58.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:58.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841755+0000", 2024-05-08T18:08:58.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012227399999999999 2024-05-08T18:08:58.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.842349+0000", 2024-05-08T18:08:58.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00059377699999999998 2024-05-08T18:08:58.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.846949+0000", 2024-05-08T18:08:58.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004599723 2024-05-08T18:08:58.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847008+0000", 2024-05-08T18:08:58.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8854999999999998e-05 2024-05-08T18:08:58.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847057+0000", 2024-05-08T18:08:58.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8956999999999999e-05 2024-05-08T18:08:58.637 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.637 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.637 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.638 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:541 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:58.638 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:58.638 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.740201728000002, 2024-05-08T18:08:58.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037829790000000001, 2024-05-08T18:08:58.638 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.638 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.638 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.638 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.638 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.638 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.638 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 541 2024-05-08T18:08:58.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.638 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:58.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:08:58.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848523+0000", 2024-05-08T18:08:58.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8599999999999997e-07 2024-05-08T18:08:58.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848526+0000", 2024-05-08T18:08:58.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4690000000000002e-06 2024-05-08T18:08:58.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848536+0000", 2024-05-08T18:08:58.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2029999999999998e-06 2024-05-08T18:08:58.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848540+0000", 2024-05-08T18:08:58.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9169999999999997e-06 2024-05-08T18:08:58.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848591+0000", 2024-05-08T18:08:58.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0328000000000003e-05 2024-05-08T18:08:58.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848646+0000", 2024-05-08T18:08:58.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5281999999999997e-05 2024-05-08T18:08:58.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:58.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848759+0000", 2024-05-08T18:08:58.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011278899999999999 2024-05-08T18:08:58.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.849323+0000", 2024-05-08T18:08:58.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056433999999999998 2024-05-08T18:08:58.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852225+0000", 2024-05-08T18:08:58.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029017320000000002 2024-05-08T18:08:58.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852277+0000", 2024-05-08T18:08:58.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2460999999999998e-05 2024-05-08T18:08:58.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852305+0000", 2024-05-08T18:08:58.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7671999999999999e-05 2024-05-08T18:08:58.643 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.643 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.643 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.644 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:58.644 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:58.644 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.607054650999999, 2024-05-08T18:08:58.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002973084, 2024-05-08T18:08:58.644 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.644 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.644 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.644 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 703 2024-05-08T18:08:58.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.644 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:58.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:08:58.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981672+0000", 2024-05-08T18:08:58.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5799999999999999e-06 2024-05-08T18:08:58.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981683+0000", 2024-05-08T18:08:58.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1270000000000001e-05 2024-05-08T18:08:58.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981715+0000", 2024-05-08T18:08:58.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1470000000000002e-05 2024-05-08T18:08:58.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981730+0000", 2024-05-08T18:08:58.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5262999999999999e-05 2024-05-08T18:08:58.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981864+0000", 2024-05-08T18:08:58.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134043 2024-05-08T18:08:58.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982168+0000", 2024-05-08T18:08:58.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030453799999999998 2024-05-08T18:08:58.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:58.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982620+0000", 2024-05-08T18:08:58.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045170900000000001 2024-05-08T18:08:58.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.983648+0000", 2024-05-08T18:08:58.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010276009999999999 2024-05-08T18:08:58.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984486+0000", 2024-05-08T18:08:58.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083874600000000002 2024-05-08T18:08:58.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984571+0000", 2024-05-08T18:08:58.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4370999999999996e-05 2024-05-08T18:08:58.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984642+0000", 2024-05-08T18:08:58.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1493000000000001e-05 2024-05-08T18:08:58.649 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.649 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.649 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.650 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:789 6.0 e32/26 6:0216b5b6:::obj_delete_at_hint.0000000070:head v 32'14, mlcod=32'12)", 2024-05-08T18:08:58.650 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:58.650 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.407627878, 2024-05-08T18:08:58.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034621420000000001, 2024-05-08T18:08:58.650 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.650 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.650 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.650 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:58.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:08:58.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181098+0000", 2024-05-08T18:08:58.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8029999999999999e-06 2024-05-08T18:08:58.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181109+0000", 2024-05-08T18:08:58.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1219999999999999e-05 2024-05-08T18:08:58.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181138+0000", 2024-05-08T18:08:58.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.898e-05 2024-05-08T18:08:58.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181151+0000", 2024-05-08T18:08:58.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.308e-05 2024-05-08T18:08:58.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181268+0000", 2024-05-08T18:08:58.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116629 2024-05-08T18:08:58.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181321+0000", 2024-05-08T18:08:58.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3325999999999997e-05 2024-05-08T18:08:58.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184477+0000", 2024-05-08T18:08:58.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003156458 2024-05-08T18:08:58.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184558+0000", 2024-05-08T18:08:58.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0646e-05 2024-05-08T18:08:58.654 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.654 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.654 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.654 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:58.654 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:58.654 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.376454374000005, 2024-05-08T18:08:58.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031146310000000001, 2024-05-08T18:08:58.654 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.654 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.654 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.654 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.655 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.655 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.655 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 802 2024-05-08T18:08:58.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.655 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:58.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:08:58.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212272+0000", 2024-05-08T18:08:58.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.943e-06 2024-05-08T18:08:58.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212284+0000", 2024-05-08T18:08:58.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1747e-05 2024-05-08T18:08:58.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212315+0000", 2024-05-08T18:08:58.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0579e-05 2024-05-08T18:08:58.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212336+0000", 2024-05-08T18:08:58.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1639999999999999e-05 2024-05-08T18:08:58.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212488+0000", 2024-05-08T18:08:58.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151192 2024-05-08T18:08:58.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212703+0000", 2024-05-08T18:08:58.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000215439 2024-05-08T18:08:58.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:58.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.213033+0000", 2024-05-08T18:08:58.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032992699999999999 2024-05-08T18:08:58.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.214306+0000", 2024-05-08T18:08:58.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012726949999999999 2024-05-08T18:08:58.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215232+0000", 2024-05-08T18:08:58.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092652999999999995 2024-05-08T18:08:58.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215321+0000", 2024-05-08T18:08:58.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9272999999999997e-05 2024-05-08T18:08:58.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215384+0000", 2024-05-08T18:08:58.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2665999999999999e-05 2024-05-08T18:08:58.659 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.660 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.660 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.660 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:58.660 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:58.660 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.295909968000004, 2024-05-08T18:08:58.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030150250000000002, 2024-05-08T18:08:58.660 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.660 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.660 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.660 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.660 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.660 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.660 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 838 2024-05-08T18:08:58.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.661 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:58.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:08:58.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292816+0000", 2024-05-08T18:08:58.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:08:58.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292828+0000", 2024-05-08T18:08:58.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.184e-05 2024-05-08T18:08:58.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292857+0000", 2024-05-08T18:08:58.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8960000000000001e-05 2024-05-08T18:08:58.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292871+0000", 2024-05-08T18:08:58.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.45e-05 2024-05-08T18:08:58.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293000+0000", 2024-05-08T18:08:58.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128875 2024-05-08T18:08:58.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293231+0000", 2024-05-08T18:08:58.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023030500000000001 2024-05-08T18:08:58.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:58.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293563+0000", 2024-05-08T18:08:58.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000332648 2024-05-08T18:08:58.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.294882+0000", 2024-05-08T18:08:58.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001319183 2024-05-08T18:08:58.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295664+0000", 2024-05-08T18:08:58.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000781991 2024-05-08T18:08:58.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295754+0000", 2024-05-08T18:08:58.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9176000000000001e-05 2024-05-08T18:08:58.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295829+0000", 2024-05-08T18:08:58.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.525e-05 2024-05-08T18:08:58.665 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.665 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.665 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.666 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:58.666 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:58.666 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.234776299000004, 2024-05-08T18:08:58.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029338929999999999, 2024-05-08T18:08:58.666 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.666 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.666 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.666 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.666 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.666 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.666 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 865 2024-05-08T18:08:58.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.667 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:58.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:08:58.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353950+0000", 2024-05-08T18:08:58.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2469999999999998e-06 2024-05-08T18:08:58.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353961+0000", 2024-05-08T18:08:58.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1523e-05 2024-05-08T18:08:58.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353991+0000", 2024-05-08T18:08:58.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9920000000000002e-05 2024-05-08T18:08:58.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354013+0000", 2024-05-08T18:08:58.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1590000000000002e-05 2024-05-08T18:08:58.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354206+0000", 2024-05-08T18:08:58.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019273900000000001 2024-05-08T18:08:58.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354418+0000", 2024-05-08T18:08:58.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212518 2024-05-08T18:08:58.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:58.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354720+0000", 2024-05-08T18:08:58.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030151800000000002 2024-05-08T18:08:58.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.355983+0000", 2024-05-08T18:08:58.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012636780000000001 2024-05-08T18:08:58.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356733+0000", 2024-05-08T18:08:58.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074988400000000003 2024-05-08T18:08:58.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356819+0000", 2024-05-08T18:08:58.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5690000000000001e-05 2024-05-08T18:08:58.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356881+0000", 2024-05-08T18:08:58.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2586e-05 2024-05-08T18:08:58.671 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.671 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.671 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.672 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:58.672 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:58.672 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.221652934000005, 2024-05-08T18:08:58.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004954511, 2024-05-08T18:08:58.672 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.672 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.672 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.672 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.672 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.672 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.672 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 871 2024-05-08T18:08:58.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.672 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:58.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:08:58.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367073+0000", 2024-05-08T18:08:58.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2340000000000001e-06 2024-05-08T18:08:58.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367085+0000", 2024-05-08T18:08:58.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1483e-05 2024-05-08T18:08:58.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367111+0000", 2024-05-08T18:08:58.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5890000000000001e-05 2024-05-08T18:08:58.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367130+0000", 2024-05-08T18:08:58.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9700000000000001e-05 2024-05-08T18:08:58.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367284+0000", 2024-05-08T18:08:58.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015411799999999999 2024-05-08T18:08:58.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367516+0000", 2024-05-08T18:08:58.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000231272 2024-05-08T18:08:58.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:58.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367837+0000", 2024-05-08T18:08:58.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032173400000000001 2024-05-08T18:08:58.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371395+0000", 2024-05-08T18:08:58.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035574719999999999 2024-05-08T18:08:58.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371882+0000", 2024-05-08T18:08:58.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048693899999999998 2024-05-08T18:08:58.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371962+0000", 2024-05-08T18:08:58.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.975e-05 2024-05-08T18:08:58.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372025+0000", 2024-05-08T18:08:58.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3918999999999996e-05 2024-05-08T18:08:58.677 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.677 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.677 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.678 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:58.678 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:58.678 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.215765230000002, 2024-05-08T18:08:58.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045233640000000002, 2024-05-08T18:08:58.678 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.678 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.678 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.678 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.678 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.678 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.678 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 873 2024-05-08T18:08:58.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.678 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:58.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:08:58.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372961+0000", 2024-05-08T18:08:58.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:08:58.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372969+0000", 2024-05-08T18:08:58.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2940000000000006e-06 2024-05-08T18:08:58.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372991+0000", 2024-05-08T18:08:58.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1829000000000001e-05 2024-05-08T18:08:58.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373009+0000", 2024-05-08T18:08:58.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8607e-05 2024-05-08T18:08:58.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373127+0000", 2024-05-08T18:08:58.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011728899999999999 2024-05-08T18:08:58.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373260+0000", 2024-05-08T18:08:58.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013301200000000001 2024-05-08T18:08:58.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:08:58.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373526+0000", 2024-05-08T18:08:58.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026613500000000003 2024-05-08T18:08:58.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.374558+0000", 2024-05-08T18:08:58.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001032156 2024-05-08T18:08:58.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377333+0000", 2024-05-08T18:08:58.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027749329999999998 2024-05-08T18:08:58.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377421+0000", 2024-05-08T18:08:58.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8679999999999998e-05 2024-05-08T18:08:58.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377482+0000", 2024-05-08T18:08:58.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0538999999999998e-05 2024-05-08T18:08:58.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.683 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.683 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:58.683 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:58.683 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.156156076000002, 2024-05-08T18:08:58.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035261009999999998, 2024-05-08T18:08:58.683 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.684 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.684 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.684 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.684 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.684 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.684 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 898 2024-05-08T18:08:58.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.684 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:58.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:08:58.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432570+0000", 2024-05-08T18:08:58.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.26e-06 2024-05-08T18:08:58.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432580+0000", 2024-05-08T18:08:58.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8570000000000007e-06 2024-05-08T18:08:58.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432605+0000", 2024-05-08T18:08:58.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5273e-05 2024-05-08T18:08:58.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432618+0000", 2024-05-08T18:08:58.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2999999999999999e-05 2024-05-08T18:08:58.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432742+0000", 2024-05-08T18:08:58.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012369200000000001 2024-05-08T18:08:58.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433109+0000", 2024-05-08T18:08:58.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036760500000000002 2024-05-08T18:08:58.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:58.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433645+0000", 2024-05-08T18:08:58.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053599599999999996 2024-05-08T18:08:58.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435050+0000", 2024-05-08T18:08:58.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001404696 2024-05-08T18:08:58.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435834+0000", 2024-05-08T18:08:58.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078381100000000003 2024-05-08T18:08:58.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435984+0000", 2024-05-08T18:08:58.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015006899999999999 2024-05-08T18:08:58.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.436094+0000", 2024-05-08T18:08:58.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109842 2024-05-08T18:08:58.689 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.689 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.689 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.689 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:58.689 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:58.689 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.151403227000003, 2024-05-08T18:08:58.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031481899999999999, 2024-05-08T18:08:58.689 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.689 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.689 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.689 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.689 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.690 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.690 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 900 2024-05-08T18:08:58.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.690 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:58.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:08:58.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437323+0000", 2024-05-08T18:08:58.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.447e-06 2024-05-08T18:08:58.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437334+0000", 2024-05-08T18:08:58.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0835999999999999e-05 2024-05-08T18:08:58.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437364+0000", 2024-05-08T18:08:58.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0463999999999998e-05 2024-05-08T18:08:58.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437379+0000", 2024-05-08T18:08:58.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4806e-05 2024-05-08T18:08:58.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437500+0000", 2024-05-08T18:08:58.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121309 2024-05-08T18:08:58.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437729+0000", 2024-05-08T18:08:58.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022818200000000001 2024-05-08T18:08:58.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:08:58.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.438199+0000", 2024-05-08T18:08:58.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047025300000000001 2024-05-08T18:08:58.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.439418+0000", 2024-05-08T18:08:58.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012193849999999999 2024-05-08T18:08:58.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440217+0000", 2024-05-08T18:08:58.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00079905999999999998 2024-05-08T18:08:58.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440352+0000", 2024-05-08T18:08:58.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013485299999999999 2024-05-08T18:08:58.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440469+0000", 2024-05-08T18:08:58.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116595 2024-05-08T18:08:58.694 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.694 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.694 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.694 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:58.695 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:58.695 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.065167221999999, 2024-05-08T18:08:58.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003477894, 2024-05-08T18:08:58.695 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:08:58.695 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:08:58.695 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:58.695 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:08:58.695 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:08:58.695 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:58.695 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 937 2024-05-08T18:08:58.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.695 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:08:58.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:08:58.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:58.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:08:58.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:08:58.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:08:58.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:08:58.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523559+0000", 2024-05-08T18:08:58.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.95e-06 2024-05-08T18:08:58.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:08:58.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523567+0000", 2024-05-08T18:08:58.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6799999999999999e-06 2024-05-08T18:08:58.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:08:58.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523591+0000", 2024-05-08T18:08:58.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3269e-05 2024-05-08T18:08:58.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:08:58.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523611+0000", 2024-05-08T18:08:58.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0100000000000001e-05 2024-05-08T18:08:58.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:08:58.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523767+0000", 2024-05-08T18:08:58.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015604900000000001 2024-05-08T18:08:58.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:08:58.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523994+0000", 2024-05-08T18:08:58.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022764199999999999 2024-05-08T18:08:58.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:58.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.524338+0000", 2024-05-08T18:08:58.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034388700000000002 2024-05-08T18:08:58.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:08:58.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.525707+0000", 2024-05-08T18:08:58.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001368544 2024-05-08T18:08:58.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:58.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526843+0000", 2024-05-08T18:08:58.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001136501 2024-05-08T18:08:58.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:08:58.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526957+0000", 2024-05-08T18:08:58.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011359 2024-05-08T18:08:58.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:08:58.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:08:58.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:08:58.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.527035+0000", 2024-05-08T18:08:58.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7682000000000006e-05 2024-05-08T18:08:58.700 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.700 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.700 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.700 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:08:58.700 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:08:58.700 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:08:58.702 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:08:58.702 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:08:58.700+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:08:58.802 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:58.804+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:58.833 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:58.833 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:58.833 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:58.833 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:58.847 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:08:58.903 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:58.904+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:58.966 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:58.966 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:58.966 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:58.966 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:58.966 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:58.980 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:08:59.024 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:08:59.025+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:08:59.034 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.4 to 1 (10000) 2024-05-08T18:08:59.058 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:08:59.065 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-08T18:08:59.103 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:59.103 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:59.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:59.103 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:59.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.103 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:36 5.e 5:71234df9:::zone_info.d0a95a6c-3c84-4d52-915c-e8ea581dfb9b:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:08:59.104 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:59.104 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.528164259999997, 2024-05-08T18:08:59.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028394430000000001, 2024-05-08T18:08:59.104 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.104 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.104 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.104 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.104 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:08:59.104 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:08:59.104 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 36 2024-05-08T18:08:59.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.104 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:59.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:08:59.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573456+0000", 2024-05-08T18:08:59.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:08:59.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573467+0000", 2024-05-08T18:08:59.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1243999999999999e-05 2024-05-08T18:08:59.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573499+0000", 2024-05-08T18:08:59.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1343000000000001e-05 2024-05-08T18:08:59.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573522+0000", 2024-05-08T18:08:59.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3540000000000002e-05 2024-05-08T18:08:59.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573634+0000", 2024-05-08T18:08:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112249 2024-05-08T18:08:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573841+0000", 2024-05-08T18:08:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000206407 2024-05-08T18:08:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.574122+0000", 2024-05-08T18:08:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000281475 2024-05-08T18:08:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.575489+0000", 2024-05-08T18:08:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001366391 2024-05-08T18:08:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576157+0000", 2024-05-08T18:08:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00066776200000000002 2024-05-08T18:08:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576234+0000", 2024-05-08T18:08:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7285000000000003e-05 2024-05-08T18:08:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576293+0000", 2024-05-08T18:08:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9556999999999999e-05 2024-05-08T18:08:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:08:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.571405067000001, 2024-05-08T18:08:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018560765, 2024-05-08T18:08:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:08:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 43 2024-05-08T18:08:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:08:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530217+0000", 2024-05-08T18:08:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:08:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530253+0000", 2024-05-08T18:08:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5621999999999999e-05 2024-05-08T18:08:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530288+0000", 2024-05-08T18:08:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5846999999999997e-05 2024-05-08T18:08:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530314+0000", 2024-05-08T18:08:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5732e-05 2024-05-08T18:08:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530952+0000", 2024-05-08T18:08:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00063739999999999999 2024-05-08T18:08:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:08:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530977+0000", 2024-05-08T18:08:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5375e-05 2024-05-08T18:08:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548506+0000", 2024-05-08T18:08:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017528781 2024-05-08T18:08:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548774+0000", 2024-05-08T18:08:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026821199999999999 2024-05-08T18:08:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.489091142999996, 2024-05-08T18:08:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003496893, 2024-05-08T18:08:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 211 2024-05-08T18:08:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:08:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612530+0000", 2024-05-08T18:08:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9490000000000001e-06 2024-05-08T18:08:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612544+0000", 2024-05-08T18:08:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3779e-05 2024-05-08T18:08:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612578+0000", 2024-05-08T18:08:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4421000000000001e-05 2024-05-08T18:08:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612596+0000", 2024-05-08T18:08:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7435000000000002e-05 2024-05-08T18:08:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612718+0000", 2024-05-08T18:08:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012218600000000001 2024-05-08T18:08:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612951+0000", 2024-05-08T18:08:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000232768 2024-05-08T18:08:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.613370+0000", 2024-05-08T18:08:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041921200000000002 2024-05-08T18:08:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.614840+0000", 2024-05-08T18:08:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014703679999999999 2024-05-08T18:08:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615860+0000", 2024-05-08T18:08:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010198220000000001 2024-05-08T18:08:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615954+0000", 2024-05-08T18:08:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4419000000000005e-05 2024-05-08T18:08:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.616024+0000", 2024-05-08T18:08:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9534000000000002e-05 2024-05-08T18:08:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.412401461000002, 2024-05-08T18:08:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035800939999999998, 2024-05-08T18:08:59.121 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.121 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.121 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.121 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.121 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.121 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.121 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 232 2024-05-08T18:08:59.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.121 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:59.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:08:59.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689219+0000", 2024-05-08T18:08:59.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4490000000000002e-06 2024-05-08T18:08:59.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689232+0000", 2024-05-08T18:08:59.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3183000000000001e-05 2024-05-08T18:08:59.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689263+0000", 2024-05-08T18:08:59.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400999999999999e-05 2024-05-08T18:08:59.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689279+0000", 2024-05-08T18:08:59.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6078000000000001e-05 2024-05-08T18:08:59.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689401+0000", 2024-05-08T18:08:59.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012243000000000001 2024-05-08T18:08:59.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689656+0000", 2024-05-08T18:08:59.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431899999999998 2024-05-08T18:08:59.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:59.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.690103+0000", 2024-05-08T18:08:59.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044706299999999999 2024-05-08T18:08:59.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.691780+0000", 2024-05-08T18:08:59.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016774209999999999 2024-05-08T18:08:59.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692634+0000", 2024-05-08T18:08:59.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085346 2024-05-08T18:08:59.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692728+0000", 2024-05-08T18:08:59.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4429e-05 2024-05-08T18:08:59.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692797+0000", 2024-05-08T18:08:59.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8861000000000004e-05 2024-05-08T18:08:59.125 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.126 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.126 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.126 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:267 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.126 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:59.126 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.387756483000004, 2024-05-08T18:08:59.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040291739999999999, 2024-05-08T18:08:59.126 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.126 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.126 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.126 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.126 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.126 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.127 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 267 2024-05-08T18:08:59.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.127 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:59.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:08:59.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713863+0000", 2024-05-08T18:08:59.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5200000000000001e-06 2024-05-08T18:08:59.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713873+0000", 2024-05-08T18:08:59.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9089999999999995e-06 2024-05-08T18:08:59.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713896+0000", 2024-05-08T18:08:59.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2595e-05 2024-05-08T18:08:59.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713914+0000", 2024-05-08T18:08:59.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7869000000000001e-05 2024-05-08T18:08:59.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714048+0000", 2024-05-08T18:08:59.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134802 2024-05-08T18:08:59.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714278+0000", 2024-05-08T18:08:59.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022994399999999999 2024-05-08T18:08:59.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:59.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714777+0000", 2024-05-08T18:08:59.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049880499999999995 2024-05-08T18:08:59.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.715976+0000", 2024-05-08T18:08:59.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011991110000000001 2024-05-08T18:08:59.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717646+0000", 2024-05-08T18:08:59.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016699989999999999 2024-05-08T18:08:59.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717790+0000", 2024-05-08T18:08:59.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014359799999999999 2024-05-08T18:08:59.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717891+0000", 2024-05-08T18:08:59.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101022 2024-05-08T18:08:59.131 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.131 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.131 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.132 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:308 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:59.132 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:59.132 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.380389242999996, 2024-05-08T18:08:59.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031672779999999999, 2024-05-08T18:08:59.132 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.132 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.132 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.132 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:59.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:08:59.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721230+0000", 2024-05-08T18:08:59.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:08:59.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721241+0000", 2024-05-08T18:08:59.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0942e-05 2024-05-08T18:08:59.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721265+0000", 2024-05-08T18:08:59.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3371e-05 2024-05-08T18:08:59.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721278+0000", 2024-05-08T18:08:59.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3586e-05 2024-05-08T18:08:59.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721399+0000", 2024-05-08T18:08:59.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012092 2024-05-08T18:08:59.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721507+0000", 2024-05-08T18:08:59.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107651 2024-05-08T18:08:59.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724292+0000", 2024-05-08T18:08:59.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027851870000000002 2024-05-08T18:08:59.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724396+0000", 2024-05-08T18:08:59.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000104114 2024-05-08T18:08:59.136 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.136 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.136 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.136 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:495 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.136 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:59.136 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.297771342000004, 2024-05-08T18:08:59.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005951001, 2024-05-08T18:08:59.136 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.136 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.136 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.136 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.137 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.137 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.137 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 495 2024-05-08T18:08:59.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.137 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:59.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:08:59.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803849+0000", 2024-05-08T18:08:59.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3580000000000001e-06 2024-05-08T18:08:59.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803864+0000", 2024-05-08T18:08:59.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4742999999999999e-05 2024-05-08T18:08:59.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803895+0000", 2024-05-08T18:08:59.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0970000000000003e-05 2024-05-08T18:08:59.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803908+0000", 2024-05-08T18:08:59.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2588999999999999e-05 2024-05-08T18:08:59.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804005+0000", 2024-05-08T18:08:59.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7107000000000004e-05 2024-05-08T18:08:59.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804291+0000", 2024-05-08T18:08:59.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028626900000000002 2024-05-08T18:08:59.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:59.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804648+0000", 2024-05-08T18:08:59.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000356955 2024-05-08T18:08:59.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805740+0000", 2024-05-08T18:08:59.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001091905 2024-05-08T18:08:59.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809636+0000", 2024-05-08T18:08:59.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389661 2024-05-08T18:08:59.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809722+0000", 2024-05-08T18:08:59.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:08:59.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809798+0000", 2024-05-08T18:08:59.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5462000000000004e-05 2024-05-08T18:08:59.142 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.142 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.142 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.142 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.142 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:59.142 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.291160024000007, 2024-05-08T18:08:59.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051396380000000002, 2024-05-08T18:08:59.142 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.142 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.142 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.142 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.142 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.143 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.143 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 504 2024-05-08T18:08:59.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.143 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:59.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:08:59.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810460+0000", 2024-05-08T18:08:59.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:08:59.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810470+0000", 2024-05-08T18:08:59.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0222e-05 2024-05-08T18:08:59.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810495+0000", 2024-05-08T18:08:59.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4508999999999999e-05 2024-05-08T18:08:59.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810515+0000", 2024-05-08T18:08:59.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9998999999999999e-05 2024-05-08T18:08:59.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810653+0000", 2024-05-08T18:08:59.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013851099999999999 2024-05-08T18:08:59.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810782+0000", 2024-05-08T18:08:59.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128152 2024-05-08T18:08:59.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:59.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811043+0000", 2024-05-08T18:08:59.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026172400000000002 2024-05-08T18:08:59.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812164+0000", 2024-05-08T18:08:59.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001121024 2024-05-08T18:08:59.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815415+0000", 2024-05-08T18:08:59.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032510270000000001 2024-05-08T18:08:59.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815538+0000", 2024-05-08T18:08:59.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012256999999999999 2024-05-08T18:08:59.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815598+0000", 2024-05-08T18:08:59.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9923000000000002e-05 2024-05-08T18:08:59.147 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.147 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.147 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.147 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:629 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.148 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:59.148 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.182855283999999, 2024-05-08T18:08:59.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611169999999998, 2024-05-08T18:08:59.148 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.148 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.148 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.148 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.148 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.148 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.148 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 629 2024-05-08T18:08:59.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.148 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:59.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:08:59.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918765+0000", 2024-05-08T18:08:59.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5670000000000002e-06 2024-05-08T18:08:59.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918777+0000", 2024-05-08T18:08:59.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1635e-05 2024-05-08T18:08:59.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918808+0000", 2024-05-08T18:08:59.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1024e-05 2024-05-08T18:08:59.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918823+0000", 2024-05-08T18:08:59.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4939e-05 2024-05-08T18:08:59.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918930+0000", 2024-05-08T18:08:59.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107144 2024-05-08T18:08:59.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919147+0000", 2024-05-08T18:08:59.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021682599999999999 2024-05-08T18:08:59.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:08:59.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919464+0000", 2024-05-08T18:08:59.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031716699999999998 2024-05-08T18:08:59.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.920561+0000", 2024-05-08T18:08:59.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010970229999999999 2024-05-08T18:08:59.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921468+0000", 2024-05-08T18:08:59.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00090726800000000003 2024-05-08T18:08:59.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921549+0000", 2024-05-08T18:08:59.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0430000000000001e-05 2024-05-08T18:08:59.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921624+0000", 2024-05-08T18:08:59.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5093999999999996e-05 2024-05-08T18:08:59.153 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.153 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.153 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.154 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:681 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.154 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:59.154 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.142534535999999, 2024-05-08T18:08:59.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044793259999999996, 2024-05-08T18:08:59.154 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.154 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.154 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.154 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.154 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.154 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.154 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 681 2024-05-08T18:08:59.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.154 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:59.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:08:59.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959085+0000", 2024-05-08T18:08:59.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.353e-06 2024-05-08T18:08:59.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959092+0000", 2024-05-08T18:08:59.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999999e-06 2024-05-08T18:08:59.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959113+0000", 2024-05-08T18:08:59.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0744e-05 2024-05-08T18:08:59.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959130+0000", 2024-05-08T18:08:59.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7679000000000001e-05 2024-05-08T18:08:59.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959217+0000", 2024-05-08T18:08:59.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6487000000000001e-05 2024-05-08T18:08:59.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959335+0000", 2024-05-08T18:08:59.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118476 2024-05-08T18:08:59.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:59.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959598+0000", 2024-05-08T18:08:59.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000263045 2024-05-08T18:08:59.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.960551+0000", 2024-05-08T18:08:59.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095251500000000002 2024-05-08T18:08:59.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963412+0000", 2024-05-08T18:08:59.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611800000000001 2024-05-08T18:08:59.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963498+0000", 2024-05-08T18:08:59.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6145999999999998e-05 2024-05-08T18:08:59.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963563+0000", 2024-05-08T18:08:59.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4701000000000003e-05 2024-05-08T18:08:59.159 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.159 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.159 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.159 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.159 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:59.160 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.107586100000006, 2024-05-08T18:08:59.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031621710000000001, 2024-05-08T18:08:59.160 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.160 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.160 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.160 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.160 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.160 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.160 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 709 2024-05-08T18:08:59.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.160 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:59.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:08:59.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994035+0000", 2024-05-08T18:08:59.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6460000000000002e-06 2024-05-08T18:08:59.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994047+0000", 2024-05-08T18:08:59.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999e-05 2024-05-08T18:08:59.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994076+0000", 2024-05-08T18:08:59.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9564e-05 2024-05-08T18:08:59.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994091+0000", 2024-05-08T18:08:59.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4696e-05 2024-05-08T18:08:59.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994239+0000", 2024-05-08T18:08:59.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014779699999999999 2024-05-08T18:08:59.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994585+0000", 2024-05-08T18:08:59.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034605900000000002 2024-05-08T18:08:59.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:59.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.995084+0000", 2024-05-08T18:08:59.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049904799999999998 2024-05-08T18:08:59.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.996558+0000", 2024-05-08T18:08:59.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001474532 2024-05-08T18:08:59.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997045+0000", 2024-05-08T18:08:59.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048685900000000002 2024-05-08T18:08:59.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997127+0000", 2024-05-08T18:08:59.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1280999999999996e-05 2024-05-08T18:08:59.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997194+0000", 2024-05-08T18:08:59.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7689999999999997e-05 2024-05-08T18:08:59.165 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.165 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.165 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.165 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.165 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:59.165 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.072196714, 2024-05-08T18:08:59.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003066236, 2024-05-08T18:08:59.165 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.165 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.166 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.166 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.166 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.166 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.166 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 724 2024-05-08T18:08:59.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.166 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:59.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:08:59.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029424+0000", 2024-05-08T18:08:59.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.503e-06 2024-05-08T18:08:59.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029437+0000", 2024-05-08T18:08:59.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3309000000000001e-05 2024-05-08T18:08:59.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029467+0000", 2024-05-08T18:08:59.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9677999999999999e-05 2024-05-08T18:08:59.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029489+0000", 2024-05-08T18:08:59.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2314999999999999e-05 2024-05-08T18:08:59.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029600+0000", 2024-05-08T18:08:59.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110561 2024-05-08T18:08:59.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029896+0000", 2024-05-08T18:08:59.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029632200000000001 2024-05-08T18:08:59.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:59.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.030468+0000", 2024-05-08T18:08:59.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00057224700000000001 2024-05-08T18:08:59.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.031728+0000", 2024-05-08T18:08:59.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012595429999999999 2024-05-08T18:08:59.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032338+0000", 2024-05-08T18:08:59.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00061006700000000005 2024-05-08T18:08:59.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032424+0000", 2024-05-08T18:08:59.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:08:59.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032488+0000", 2024-05-08T18:08:59.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4210999999999999e-05 2024-05-08T18:08:59.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.171 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.171 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.171 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:59.171 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.067546300000004, 2024-05-08T18:08:59.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029269769999999999, 2024-05-08T18:08:59.171 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.171 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.171 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.171 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.171 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.172 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.172 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 726 2024-05-08T18:08:59.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.172 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:59.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:08:59.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034074+0000", 2024-05-08T18:08:59.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5900000000000002e-06 2024-05-08T18:08:59.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034086+0000", 2024-05-08T18:08:59.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1265e-05 2024-05-08T18:08:59.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034118+0000", 2024-05-08T18:08:59.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2341000000000001e-05 2024-05-08T18:08:59.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034133+0000", 2024-05-08T18:08:59.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5166e-05 2024-05-08T18:08:59.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034254+0000", 2024-05-08T18:08:59.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121033 2024-05-08T18:08:59.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034492+0000", 2024-05-08T18:08:59.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023727700000000001 2024-05-08T18:08:59.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:59.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034967+0000", 2024-05-08T18:08:59.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047522100000000001 2024-05-08T18:08:59.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036353+0000", 2024-05-08T18:08:59.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013865800000000001 2024-05-08T18:08:59.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036841+0000", 2024-05-08T18:08:59.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048788999999999999 2024-05-08T18:08:59.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036929+0000", 2024-05-08T18:08:59.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:08:59.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036999+0000", 2024-05-08T18:08:59.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9448000000000003e-05 2024-05-08T18:08:59.176 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.177 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.177 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.177 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.177 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:59.178 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.064251470000002, 2024-05-08T18:08:59.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003040662, 2024-05-08T18:08:59.178 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.178 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.178 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.178 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.178 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.178 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.178 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 727 2024-05-08T18:08:59.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.178 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:59.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:08:59.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037369+0000", 2024-05-08T18:08:59.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:08:59.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037378+0000", 2024-05-08T18:08:59.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5359999999999998e-06 2024-05-08T18:08:59.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037405+0000", 2024-05-08T18:08:59.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6588e-05 2024-05-08T18:08:59.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037418+0000", 2024-05-08T18:08:59.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3642000000000001e-05 2024-05-08T18:08:59.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037531+0000", 2024-05-08T18:08:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112304 2024-05-08T18:08:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037785+0000", 2024-05-08T18:08:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025391299999999998 2024-05-08T18:08:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.038112+0000", 2024-05-08T18:08:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000326946 2024-05-08T18:08:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.039316+0000", 2024-05-08T18:08:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012043990000000001 2024-05-08T18:08:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040257+0000", 2024-05-08T18:08:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000941083 2024-05-08T18:08:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040345+0000", 2024-05-08T18:08:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8368999999999994e-05 2024-05-08T18:08:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040407+0000", 2024-05-08T18:08:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1941999999999997e-05 2024-05-08T18:08:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.949586081000007, 2024-05-08T18:08:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028797779999999999, 2024-05-08T18:08:59.183 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 777 2024-05-08T18:08:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:08:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152034+0000", 2024-05-08T18:08:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2299999999999998e-06 2024-05-08T18:08:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152045+0000", 2024-05-08T18:08:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0266e-05 2024-05-08T18:08:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152076+0000", 2024-05-08T18:08:59.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1007000000000003e-05 2024-05-08T18:08:59.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152094+0000", 2024-05-08T18:08:59.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8148999999999999e-05 2024-05-08T18:08:59.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152183+0000", 2024-05-08T18:08:59.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8845999999999996e-05 2024-05-08T18:08:59.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152308+0000", 2024-05-08T18:08:59.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012502999999999999 2024-05-08T18:08:59.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:59.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152578+0000", 2024-05-08T18:08:59.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027080099999999998 2024-05-08T18:08:59.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154238+0000", 2024-05-08T18:08:59.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016600180000000001 2024-05-08T18:08:59.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154714+0000", 2024-05-08T18:08:59.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000475341 2024-05-08T18:08:59.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154803+0000", 2024-05-08T18:08:59.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9566000000000003e-05 2024-05-08T18:08:59.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154912+0000", 2024-05-08T18:08:59.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010852400000000001 2024-05-08T18:08:59.189 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.189 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.189 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.189 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.189 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:59.189 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.706370187999994, 2024-05-08T18:08:59.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002844437, 2024-05-08T18:08:59.190 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.190 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.190 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.190 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.190 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.190 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.190 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 882 2024-05-08T18:08:59.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.190 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:59.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:08:59.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395250+0000", 2024-05-08T18:08:59.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-06 2024-05-08T18:08:59.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395261+0000", 2024-05-08T18:08:59.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1046000000000001e-05 2024-05-08T18:08:59.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395293+0000", 2024-05-08T18:08:59.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1473999999999997e-05 2024-05-08T18:08:59.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395307+0000", 2024-05-08T18:08:59.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4599e-05 2024-05-08T18:08:59.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395481+0000", 2024-05-08T18:08:59.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173499 2024-05-08T18:08:59.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395626+0000", 2024-05-08T18:08:59.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000145351 2024-05-08T18:08:59.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:59.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395902+0000", 2024-05-08T18:08:59.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027534499999999997 2024-05-08T18:08:59.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397118+0000", 2024-05-08T18:08:59.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012168929999999999 2024-05-08T18:08:59.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397951+0000", 2024-05-08T18:08:59.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000832272 2024-05-08T18:08:59.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398028+0000", 2024-05-08T18:08:59.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6921000000000004e-05 2024-05-08T18:08:59.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398092+0000", 2024-05-08T18:08:59.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4783999999999995e-05 2024-05-08T18:08:59.195 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.195 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.195 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.196 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.196 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:59.196 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.703309468, 2024-05-08T18:08:59.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002853894, 2024-05-08T18:08:59.196 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.196 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.196 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.196 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.196 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.196 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.197 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 883 2024-05-08T18:08:59.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.197 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:59.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:08:59.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398311+0000", 2024-05-08T18:08:59.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:59.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398321+0000", 2024-05-08T18:08:59.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9189999999999994e-06 2024-05-08T18:08:59.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398346+0000", 2024-05-08T18:08:59.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5065000000000001e-05 2024-05-08T18:08:59.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398360+0000", 2024-05-08T18:08:59.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4171999999999999e-05 2024-05-08T18:08:59.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398495+0000", 2024-05-08T18:08:59.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013503199999999999 2024-05-08T18:08:59.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398716+0000", 2024-05-08T18:08:59.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220459 2024-05-08T18:08:59.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:59.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.399054+0000", 2024-05-08T18:08:59.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033806199999999998 2024-05-08T18:08:59.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.400192+0000", 2024-05-08T18:08:59.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011389169999999999 2024-05-08T18:08:59.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401020+0000", 2024-05-08T18:08:59.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082746199999999995 2024-05-08T18:08:59.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401099+0000", 2024-05-08T18:08:59.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9157000000000001e-05 2024-05-08T18:08:59.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401163+0000", 2024-05-08T18:08:59.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3498999999999996e-05 2024-05-08T18:08:59.202 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.202 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.202 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.202 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.202 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:59.202 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.699520630999999, 2024-05-08T18:08:59.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031354040000000001, 2024-05-08T18:08:59.203 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.203 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.203 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.203 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.203 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.203 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.203 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 885 2024-05-08T18:08:59.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.203 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:59.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:08:59.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402100+0000", 2024-05-08T18:08:59.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.063e-06 2024-05-08T18:08:59.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402110+0000", 2024-05-08T18:08:59.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0453e-05 2024-05-08T18:08:59.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402141+0000", 2024-05-08T18:08:59.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0651000000000002e-05 2024-05-08T18:08:59.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402162+0000", 2024-05-08T18:08:59.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1373999999999999e-05 2024-05-08T18:08:59.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402306+0000", 2024-05-08T18:08:59.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143492 2024-05-08T18:08:59.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402562+0000", 2024-05-08T18:08:59.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025671899999999998 2024-05-08T18:08:59.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:08:59.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.403047+0000", 2024-05-08T18:08:59.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048419100000000003 2024-05-08T18:08:59.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404370+0000", 2024-05-08T18:08:59.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013231580000000001 2024-05-08T18:08:59.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404966+0000", 2024-05-08T18:08:59.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00059601100000000002 2024-05-08T18:08:59.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405115+0000", 2024-05-08T18:08:59.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149665 2024-05-08T18:08:59.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405233+0000", 2024-05-08T18:08:59.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117627 2024-05-08T18:08:59.208 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.208 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.208 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.208 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.208 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:59.208 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.602223096000003, 2024-05-08T18:08:59.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003251168, 2024-05-08T18:08:59.209 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.209 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.209 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.209 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.209 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.209 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.209 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 927 2024-05-08T18:08:59.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.209 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:59.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:08:59.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499396+0000", 2024-05-08T18:08:59.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:08:59.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499404+0000", 2024-05-08T18:08:59.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2629999999999997e-06 2024-05-08T18:08:59.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499423+0000", 2024-05-08T18:08:59.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9695e-05 2024-05-08T18:08:59.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499435+0000", 2024-05-08T18:08:59.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1542999999999999e-05 2024-05-08T18:08:59.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499545+0000", 2024-05-08T18:08:59.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110064 2024-05-08T18:08:59.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499764+0000", 2024-05-08T18:08:59.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021856499999999999 2024-05-08T18:08:59.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:59.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.500237+0000", 2024-05-08T18:08:59.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047359499999999999 2024-05-08T18:08:59.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.501627+0000", 2024-05-08T18:08:59.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013897860000000001 2024-05-08T18:08:59.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502484+0000", 2024-05-08T18:08:59.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085733300000000005 2024-05-08T18:08:59.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502574+0000", 2024-05-08T18:08:59.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9939999999999996e-05 2024-05-08T18:08:59.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502646+0000", 2024-05-08T18:08:59.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2064000000000007e-05 2024-05-08T18:08:59.214 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.214 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.214 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.215 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.215 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:59.215 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.598723555000007, 2024-05-08T18:08:59.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031881129999999998, 2024-05-08T18:08:59.215 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.215 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.215 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.215 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.215 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.215 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.215 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 928 2024-05-08T18:08:59.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.215 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:59.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:08:59.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502897+0000", 2024-05-08T18:08:59.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.916e-06 2024-05-08T18:08:59.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502906+0000", 2024-05-08T18:08:59.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2699999999999993e-06 2024-05-08T18:08:59.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502933+0000", 2024-05-08T18:08:59.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6823999999999999e-05 2024-05-08T18:08:59.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502946+0000", 2024-05-08T18:08:59.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3439e-05 2024-05-08T18:08:59.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503066+0000", 2024-05-08T18:08:59.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012013700000000001 2024-05-08T18:08:59.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503399+0000", 2024-05-08T18:08:59.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033298600000000001 2024-05-08T18:08:59.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:59.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503928+0000", 2024-05-08T18:08:59.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052877299999999996 2024-05-08T18:08:59.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505291+0000", 2024-05-08T18:08:59.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001363319 2024-05-08T18:08:59.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505933+0000", 2024-05-08T18:08:59.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064135799999999997 2024-05-08T18:08:59.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506019+0000", 2024-05-08T18:08:59.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6649000000000003e-05 2024-05-08T18:08:59.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506083+0000", 2024-05-08T18:08:59.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3441999999999993e-05 2024-05-08T18:08:59.220 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.220 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.220 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.220 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.220 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.220 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:59.222 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:08:59.223 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:59.221+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:59.322 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:59.324+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:59.390 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:59.391 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:59.391 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:08:59.391 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:59.405 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:08:59.423 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:08:59.424+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:08:59.524 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:08:59.525+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:08:59.530 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:59.530 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:08:59.530 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:08:59.530 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:08:59.530 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:59.544 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:08:59.552 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:08:59.632 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:08:59.633+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:08:59.711 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:08:59.712 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:08:59.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:08:59.712 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:08:59.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.712 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:3 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:08:59.712 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:59.712 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.175698209, 2024-05-08T18:08:59.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046964590000000001, 2024-05-08T18:08:59.712 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.712 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.712 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:08:59.712 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.712 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:08:59.713 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:08:59.713 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 3 2024-05-08T18:08:59.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.713 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:59.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:08:59.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534906+0000", 2024-05-08T18:08:59.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1030000000000002e-06 2024-05-08T18:08:59.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534918+0000", 2024-05-08T18:08:59.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1732999999999999e-05 2024-05-08T18:08:59.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534950+0000", 2024-05-08T18:08:59.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1420000000000001e-05 2024-05-08T18:08:59.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534974+0000", 2024-05-08T18:08:59.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4473000000000001e-05 2024-05-08T18:08:59.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.539338+0000", 2024-05-08T18:08:59.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043636719999999999 2024-05-08T18:08:59.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.539600+0000", 2024-05-08T18:08:59.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026205800000000002 2024-05-08T18:08:59.716 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.716 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.716 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.716 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:59.716 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:59.716 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.142624545000004, 2024-05-08T18:08:59.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054299370000000001, 2024-05-08T18:08:59.716 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.716 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.716 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.716 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.716 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.717 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.717 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 48 2024-05-08T18:08:59.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.717 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:59.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:08:59.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567980+0000", 2024-05-08T18:08:59.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.554e-06 2024-05-08T18:08:59.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567990+0000", 2024-05-08T18:08:59.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0961999999999999e-05 2024-05-08T18:08:59.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568023+0000", 2024-05-08T18:08:59.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441999999999999e-05 2024-05-08T18:08:59.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568042+0000", 2024-05-08T18:08:59.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8760999999999999e-05 2024-05-08T18:08:59.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568165+0000", 2024-05-08T18:08:59.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012333400000000001 2024-05-08T18:08:59.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568426+0000", 2024-05-08T18:08:59.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026132999999999999 2024-05-08T18:08:59.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:59.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568666+0000", 2024-05-08T18:08:59.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024009500000000001 2024-05-08T18:08:59.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.569886+0000", 2024-05-08T18:08:59.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012194790000000001 2024-05-08T18:08:59.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573254+0000", 2024-05-08T18:08:59.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033677109999999998 2024-05-08T18:08:59.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573339+0000", 2024-05-08T18:08:59.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5666000000000003e-05 2024-05-08T18:08:59.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573407+0000", 2024-05-08T18:08:59.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7602999999999996e-05 2024-05-08T18:08:59.721 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.721 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.721 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.722 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94206896343168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:08:59.722 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:59.722 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.136944382999999, 2024-05-08T18:08:59.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054113640000000001, 2024-05-08T18:08:59.722 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.722 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.722 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.722 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.722 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.722 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.722 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 49 2024-05-08T18:08:59.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.722 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:59.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:08:59.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573659+0000", 2024-05-08T18:08:59.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.762e-06 2024-05-08T18:08:59.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573667+0000", 2024-05-08T18:08:59.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8120000000000008e-06 2024-05-08T18:08:59.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573693+0000", 2024-05-08T18:08:59.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6057000000000001e-05 2024-05-08T18:08:59.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573710+0000", 2024-05-08T18:08:59.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7555999999999999e-05 2024-05-08T18:08:59.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573851+0000", 2024-05-08T18:08:59.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014109800000000001 2024-05-08T18:08:59.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.574072+0000", 2024-05-08T18:08:59.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022062899999999999 2024-05-08T18:08:59.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:59.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.574500+0000", 2024-05-08T18:08:59.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042798100000000002 2024-05-08T18:08:59.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.575719+0000", 2024-05-08T18:08:59.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001218717 2024-05-08T18:08:59.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578840+0000", 2024-05-08T18:08:59.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031215380000000001 2024-05-08T18:08:59.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578925+0000", 2024-05-08T18:08:59.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5191999999999993e-05 2024-05-08T18:08:59.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579069+0000", 2024-05-08T18:08:59.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143022 2024-05-08T18:08:59.727 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.727 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.727 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.727 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:08:59.727 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:59.727 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 93.134156403999995, 2024-05-08T18:08:59.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034814389999999998, 2024-05-08T18:08:59.727 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.727 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.728 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.728 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.728 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.728 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.728 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 205 2024-05-08T18:08:59.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.728 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:59.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:08:59.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576448+0000", 2024-05-08T18:08:59.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7839999999999999e-06 2024-05-08T18:08:59.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576462+0000", 2024-05-08T18:08:59.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4348999999999999e-05 2024-05-08T18:08:59.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576500+0000", 2024-05-08T18:08:59.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7252999999999997e-05 2024-05-08T18:08:59.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576528+0000", 2024-05-08T18:08:59.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8691e-05 2024-05-08T18:08:59.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576686+0000", 2024-05-08T18:08:59.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015810999999999999 2024-05-08T18:08:59.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576927+0000", 2024-05-08T18:08:59.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000240337 2024-05-08T18:08:59.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:59.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.577354+0000", 2024-05-08T18:08:59.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042767499999999997 2024-05-08T18:08:59.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.578866+0000", 2024-05-08T18:08:59.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001511271 2024-05-08T18:08:59.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579762+0000", 2024-05-08T18:08:59.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089618599999999999 2024-05-08T18:08:59.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579858+0000", 2024-05-08T18:08:59.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6686000000000002e-05 2024-05-08T18:08:59.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579927+0000", 2024-05-08T18:08:59.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8096999999999995e-05 2024-05-08T18:08:59.732 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.733 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.733 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.733 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.733 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:59.733 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 93.066160564, 2024-05-08T18:08:59.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035139590000000001, 2024-05-08T18:08:59.733 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.733 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.733 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.733 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.733 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.733 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.734 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 220 2024-05-08T18:08:59.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.734 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:59.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:08:59.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644444+0000", 2024-05-08T18:08:59.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6759999999999999e-06 2024-05-08T18:08:59.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644455+0000", 2024-05-08T18:08:59.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:08:59.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644487+0000", 2024-05-08T18:08:59.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2199999999999997e-05 2024-05-08T18:08:59.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644503+0000", 2024-05-08T18:08:59.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5452e-05 2024-05-08T18:08:59.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644689+0000", 2024-05-08T18:08:59.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000186541 2024-05-08T18:08:59.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644902+0000", 2024-05-08T18:08:59.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021321299999999999 2024-05-08T18:08:59.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:59.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.645299+0000", 2024-05-08T18:08:59.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039702699999999999 2024-05-08T18:08:59.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647459+0000", 2024-05-08T18:08:59.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021598279999999999 2024-05-08T18:08:59.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647803+0000", 2024-05-08T18:08:59.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034338199999999999 2024-05-08T18:08:59.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647888+0000", 2024-05-08T18:08:59.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5125999999999998e-05 2024-05-08T18:08:59.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647955+0000", 2024-05-08T18:08:59.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7280999999999995e-05 2024-05-08T18:08:59.738 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.738 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.738 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.739 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.739 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:59.739 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 93.046296045000005, 2024-05-08T18:08:59.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003220367, 2024-05-08T18:08:59.739 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.739 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.739 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.739 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.739 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.739 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.739 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 225 2024-05-08T18:08:59.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.739 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:59.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:08:59.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664308+0000", 2024-05-08T18:08:59.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:08:59.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664333+0000", 2024-05-08T18:08:59.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5361e-05 2024-05-08T18:08:59.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664362+0000", 2024-05-08T18:08:59.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8671999999999999e-05 2024-05-08T18:08:59.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664376+0000", 2024-05-08T18:08:59.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4741e-05 2024-05-08T18:08:59.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664541+0000", 2024-05-08T18:08:59.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016484400000000001 2024-05-08T18:08:59.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664767+0000", 2024-05-08T18:08:59.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000226061 2024-05-08T18:08:59.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:59.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.665199+0000", 2024-05-08T18:08:59.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000431674 2024-05-08T18:08:59.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.666428+0000", 2024-05-08T18:08:59.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001228605 2024-05-08T18:08:59.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667367+0000", 2024-05-08T18:08:59.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093924199999999996 2024-05-08T18:08:59.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667461+0000", 2024-05-08T18:08:59.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3762000000000001e-05 2024-05-08T18:08:59.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667526+0000", 2024-05-08T18:08:59.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5254999999999998e-05 2024-05-08T18:08:59.744 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.744 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.744 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.744 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.744 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:59.744 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 93.014068546999994, 2024-05-08T18:08:59.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037451559999999999, 2024-05-08T18:08:59.745 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.745 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.745 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.745 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.745 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.745 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.745 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 234 2024-05-08T18:08:59.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.745 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:59.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:08:59.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696535+0000", 2024-05-08T18:08:59.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0760000000000001e-06 2024-05-08T18:08:59.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696546+0000", 2024-05-08T18:08:59.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0556e-05 2024-05-08T18:08:59.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696577+0000", 2024-05-08T18:08:59.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0904000000000001e-05 2024-05-08T18:08:59.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696592+0000", 2024-05-08T18:08:59.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5316e-05 2024-05-08T18:08:59.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696731+0000", 2024-05-08T18:08:59.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138818 2024-05-08T18:08:59.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.697085+0000", 2024-05-08T18:08:59.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00035397800000000002 2024-05-08T18:08:59.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:59.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.697838+0000", 2024-05-08T18:08:59.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00075314800000000003 2024-05-08T18:08:59.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.699440+0000", 2024-05-08T18:08:59.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016023470000000001 2024-05-08T18:08:59.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700067+0000", 2024-05-08T18:08:59.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062698400000000003 2024-05-08T18:08:59.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700161+0000", 2024-05-08T18:08:59.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3762000000000001e-05 2024-05-08T18:08:59.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700278+0000", 2024-05-08T18:08:59.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117267 2024-05-08T18:08:59.750 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.750 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.750 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.750 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:431 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.750 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:59.750 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.948576535000001, 2024-05-08T18:08:59.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040957049999999998, 2024-05-08T18:08:59.751 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.751 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.751 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.751 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.751 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.751 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.751 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 431 2024-05-08T18:08:59.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.751 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:59.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:08:59.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762027+0000", 2024-05-08T18:08:59.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7889999999999999e-06 2024-05-08T18:08:59.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762036+0000", 2024-05-08T18:08:59.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6029999999999994e-06 2024-05-08T18:08:59.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762061+0000", 2024-05-08T18:08:59.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4831e-05 2024-05-08T18:08:59.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762076+0000", 2024-05-08T18:08:59.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4996e-05 2024-05-08T18:08:59.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.763559+0000", 2024-05-08T18:08:59.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001482501 2024-05-08T18:08:59.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.763747+0000", 2024-05-08T18:08:59.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018864399999999999 2024-05-08T18:08:59.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:59.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.764172+0000", 2024-05-08T18:08:59.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042445900000000002 2024-05-08T18:08:59.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.765292+0000", 2024-05-08T18:08:59.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001120196 2024-05-08T18:08:59.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.765812+0000", 2024-05-08T18:08:59.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052044000000000005 2024-05-08T18:08:59.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.766007+0000", 2024-05-08T18:08:59.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019423500000000001 2024-05-08T18:08:59.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.766121+0000", 2024-05-08T18:08:59.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114011 2024-05-08T18:08:59.756 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.756 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.756 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.756 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.756 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:59.756 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.941919064000004, 2024-05-08T18:08:59.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031982880000000001, 2024-05-08T18:08:59.756 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.756 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.756 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.756 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.757 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.757 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.757 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 438 2024-05-08T18:08:59.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.757 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:59.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:08:59.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768684+0000", 2024-05-08T18:08:59.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0049999999999999e-06 2024-05-08T18:08:59.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768697+0000", 2024-05-08T18:08:59.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2211e-05 2024-05-08T18:08:59.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768726+0000", 2024-05-08T18:08:59.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8949e-05 2024-05-08T18:08:59.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768743+0000", 2024-05-08T18:08:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7478000000000001e-05 2024-05-08T18:08:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768852+0000", 2024-05-08T18:08:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010889499999999999 2024-05-08T18:08:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.769168+0000", 2024-05-08T18:08:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031610900000000002 2024-05-08T18:08:59.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:59.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.769542+0000", 2024-05-08T18:08:59.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037368299999999998 2024-05-08T18:08:59.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.770721+0000", 2024-05-08T18:08:59.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001179591 2024-05-08T18:08:59.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771722+0000", 2024-05-08T18:08:59.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001000463 2024-05-08T18:08:59.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771819+0000", 2024-05-08T18:08:59.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6909000000000003e-05 2024-05-08T18:08:59.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771881+0000", 2024-05-08T18:08:59.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1995000000000005e-05 2024-05-08T18:08:59.761 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.761 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.761 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.762 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:477 6.4 e32/26 6:24c8e1ae:gc::gc.19:head v 32'12, mlcod=32'10)", 2024-05-08T18:08:59.762 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:59.762 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.919824035999994, 2024-05-08T18:08:59.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038511489999999999, 2024-05-08T18:08:59.762 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.762 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.762 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.762 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:59.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:08:59.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790779+0000", 2024-05-08T18:08:59.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4559999999999999e-06 2024-05-08T18:08:59.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790791+0000", 2024-05-08T18:08:59.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1780000000000001e-05 2024-05-08T18:08:59.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790817+0000", 2024-05-08T18:08:59.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5874999999999999e-05 2024-05-08T18:08:59.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790832+0000", 2024-05-08T18:08:59.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4909000000000001e-05 2024-05-08T18:08:59.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790959+0000", 2024-05-08T18:08:59.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012728199999999999 2024-05-08T18:08:59.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791007+0000", 2024-05-08T18:08:59.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7766000000000003e-05 2024-05-08T18:08:59.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794549+0000", 2024-05-08T18:08:59.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035422959999999999 2024-05-08T18:08:59.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794629+0000", 2024-05-08T18:08:59.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9784999999999996e-05 2024-05-08T18:08:59.766 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.766 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.766 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.766 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:487 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.766 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:59.766 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.914486788000005, 2024-05-08T18:08:59.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046865559999999997, 2024-05-08T18:08:59.766 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.766 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.766 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.767 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.767 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.767 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.767 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 487 2024-05-08T18:08:59.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.767 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:59.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:08:59.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796116+0000", 2024-05-08T18:08:59.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5650000000000001e-06 2024-05-08T18:08:59.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796124+0000", 2024-05-08T18:08:59.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6909999999999997e-06 2024-05-08T18:08:59.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796143+0000", 2024-05-08T18:08:59.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9483999999999998e-05 2024-05-08T18:08:59.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796154+0000", 2024-05-08T18:08:59.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0416e-05 2024-05-08T18:08:59.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796266+0000", 2024-05-08T18:08:59.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112011 2024-05-08T18:08:59.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796432+0000", 2024-05-08T18:08:59.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016641799999999999 2024-05-08T18:08:59.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:59.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796718+0000", 2024-05-08T18:08:59.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028548000000000001 2024-05-08T18:08:59.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798117+0000", 2024-05-08T18:08:59.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001399151 2024-05-08T18:08:59.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800656+0000", 2024-05-08T18:08:59.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025392689999999998 2024-05-08T18:08:59.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800733+0000", 2024-05-08T18:08:59.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6508000000000007e-05 2024-05-08T18:08:59.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800801+0000", 2024-05-08T18:08:59.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8563000000000001e-05 2024-05-08T18:08:59.772 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.772 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.772 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.772 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:489 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.772 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:59.772 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.912540289999995, 2024-05-08T18:08:59.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058220679999999997, 2024-05-08T18:08:59.772 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.772 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.772 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.772 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.773 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.773 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.773 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 489 2024-05-08T18:08:59.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.773 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:59.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:08:59.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798064+0000", 2024-05-08T18:08:59.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:08:59.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798074+0000", 2024-05-08T18:08:59.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0438999999999999e-05 2024-05-08T18:08:59.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798097+0000", 2024-05-08T18:08:59.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3019000000000001e-05 2024-05-08T18:08:59.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798115+0000", 2024-05-08T18:08:59.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7638e-05 2024-05-08T18:08:59.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798230+0000", 2024-05-08T18:08:59.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115375 2024-05-08T18:08:59.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798395+0000", 2024-05-08T18:08:59.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016542099999999999 2024-05-08T18:08:59.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:59.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798633+0000", 2024-05-08T18:08:59.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000237977 2024-05-08T18:08:59.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.799628+0000", 2024-05-08T18:08:59.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00099459099999999996 2024-05-08T18:08:59.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803706+0000", 2024-05-08T18:08:59.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040776199999999997 2024-05-08T18:08:59.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803796+0000", 2024-05-08T18:08:59.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0704000000000004e-05 2024-05-08T18:08:59.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803883+0000", 2024-05-08T18:08:59.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6923999999999996e-05 2024-05-08T18:08:59.778 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.778 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.778 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.778 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:491 6.10 e32/26 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 32'1, mlcod=0'0)", 2024-05-08T18:08:59.778 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:59.778 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.909316830999998, 2024-05-08T18:08:59.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052480360000000002, 2024-05-08T18:08:59.778 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.778 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.779 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.779 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:59.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:08:59.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801286+0000", 2024-05-08T18:08:59.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.085e-06 2024-05-08T18:08:59.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801293+0000", 2024-05-08T18:08:59.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.627e-06 2024-05-08T18:08:59.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801311+0000", 2024-05-08T18:08:59.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-05-08T18:08:59.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801320+0000", 2024-05-08T18:08:59.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5710000000000004e-06 2024-05-08T18:08:59.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801401+0000", 2024-05-08T18:08:59.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0798999999999997e-05 2024-05-08T18:08:59.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801439+0000", 2024-05-08T18:08:59.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7994000000000002e-05 2024-05-08T18:08:59.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806447+0000", 2024-05-08T18:08:59.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050077339999999998 2024-05-08T18:08:59.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806533+0000", 2024-05-08T18:08:59.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.577e-05 2024-05-08T18:08:59.782 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.782 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.782 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.783 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:495 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:59.783 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:59.783 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.905779940000002, 2024-05-08T18:08:59.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045481219999999999, 2024-05-08T18:08:59.783 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.783 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.783 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.783 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:59.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:08:59.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804823+0000", 2024-05-08T18:08:59.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.42e-06 2024-05-08T18:08:59.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804834+0000", 2024-05-08T18:08:59.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0584999999999999e-05 2024-05-08T18:08:59.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804848+0000", 2024-05-08T18:08:59.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:08:59.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804857+0000", 2024-05-08T18:08:59.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.302e-06 2024-05-08T18:08:59.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804967+0000", 2024-05-08T18:08:59.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109543 2024-05-08T18:08:59.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805018+0000", 2024-05-08T18:08:59.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0924000000000002e-05 2024-05-08T18:08:59.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809281+0000", 2024-05-08T18:08:59.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042631479999999996 2024-05-08T18:08:59.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809370+0000", 2024-05-08T18:08:59.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8787000000000002e-05 2024-05-08T18:08:59.787 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.787 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.787 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.787 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:500 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.787 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:59.787 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.904221526000001, 2024-05-08T18:08:59.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061595829999999997, 2024-05-08T18:08:59.787 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.787 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.787 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.788 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.788 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.788 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.788 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 500 2024-05-08T18:08:59.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.788 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:59.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:08:59.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806382+0000", 2024-05-08T18:08:59.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2709999999999999e-06 2024-05-08T18:08:59.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806395+0000", 2024-05-08T18:08:59.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2782000000000001e-05 2024-05-08T18:08:59.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806419+0000", 2024-05-08T18:08:59.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3841000000000001e-05 2024-05-08T18:08:59.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806437+0000", 2024-05-08T18:08:59.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8318999999999999e-05 2024-05-08T18:08:59.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806554+0000", 2024-05-08T18:08:59.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116507 2024-05-08T18:08:59.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806732+0000", 2024-05-08T18:08:59.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017828200000000001 2024-05-08T18:08:59.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:08:59.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806986+0000", 2024-05-08T18:08:59.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431100000000001 2024-05-08T18:08:59.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.808032+0000", 2024-05-08T18:08:59.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010455530000000001 2024-05-08T18:08:59.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812373+0000", 2024-05-08T18:08:59.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043410139999999998 2024-05-08T18:08:59.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812485+0000", 2024-05-08T18:08:59.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011234999999999999 2024-05-08T18:08:59.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812540+0000", 2024-05-08T18:08:59.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4353e-05 2024-05-08T18:08:59.792 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.792 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.792 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.793 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:502 6.10 e32/26 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 32'2, mlcod=0'0)", 2024-05-08T18:08:59.793 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:59.793 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.903047923000003, 2024-05-08T18:08:59.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049263659999999997, 2024-05-08T18:08:59.793 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.793 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.793 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.793 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:59.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:08:59.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807555+0000", 2024-05-08T18:08:59.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2079999999999999e-06 2024-05-08T18:08:59.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807563+0000", 2024-05-08T18:08:59.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3280000000000006e-06 2024-05-08T18:08:59.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807585+0000", 2024-05-08T18:08:59.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2361000000000002e-05 2024-05-08T18:08:59.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807596+0000", 2024-05-08T18:08:59.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0968000000000001e-05 2024-05-08T18:08:59.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807700+0000", 2024-05-08T18:08:59.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103232 2024-05-08T18:08:59.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807732+0000", 2024-05-08T18:08:59.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2373999999999999e-05 2024-05-08T18:08:59.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812391+0000", 2024-05-08T18:08:59.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046590140000000004 2024-05-08T18:08:59.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812480+0000", 2024-05-08T18:08:59.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8881000000000005e-05 2024-05-08T18:08:59.797 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.797 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.797 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.797 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:504 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'3, mlcod=32'1)", 2024-05-08T18:08:59.797 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:59.797 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.899375117999995, 2024-05-08T18:08:59.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389472, 2024-05-08T18:08:59.797 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.797 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.797 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.798 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:59.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:08:59.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811228+0000", 2024-05-08T18:08:59.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8819999999999999e-06 2024-05-08T18:08:59.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811240+0000", 2024-05-08T18:08:59.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1276e-05 2024-05-08T18:08:59.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811266+0000", 2024-05-08T18:08:59.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.601e-05 2024-05-08T18:08:59.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811283+0000", 2024-05-08T18:08:59.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7473e-05 2024-05-08T18:08:59.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811444+0000", 2024-05-08T18:08:59.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000161249 2024-05-08T18:08:59.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811501+0000", 2024-05-08T18:08:59.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6394999999999998e-05 2024-05-08T18:08:59.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815025+0000", 2024-05-08T18:08:59.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003524335 2024-05-08T18:08:59.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815121+0000", 2024-05-08T18:08:59.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6100000000000005e-05 2024-05-08T18:08:59.801 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.801 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.801 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.801 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:505 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.801 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:59.801 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.897745822999994, 2024-05-08T18:08:59.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007675075, 2024-05-08T18:08:59.802 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.802 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.802 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.802 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.802 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.802 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.802 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 505 2024-05-08T18:08:59.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.802 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:59.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:08:59.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812857+0000", 2024-05-08T18:08:59.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.621e-06 2024-05-08T18:08:59.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812865+0000", 2024-05-08T18:08:59.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0600000000000008e-06 2024-05-08T18:08:59.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812889+0000", 2024-05-08T18:08:59.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3569000000000001e-05 2024-05-08T18:08:59.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812901+0000", 2024-05-08T18:08:59.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1610000000000001e-05 2024-05-08T18:08:59.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813025+0000", 2024-05-08T18:08:59.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012430399999999999 2024-05-08T18:08:59.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813168+0000", 2024-05-08T18:08:59.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014329699999999999 2024-05-08T18:08:59.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:08:59.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813419+0000", 2024-05-08T18:08:59.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000250788 2024-05-08T18:08:59.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815462+0000", 2024-05-08T18:08:59.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002042865 2024-05-08T18:08:59.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820385+0000", 2024-05-08T18:08:59.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049229529999999999 2024-05-08T18:08:59.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820462+0000", 2024-05-08T18:08:59.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7101000000000006e-05 2024-05-08T18:08:59.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820531+0000", 2024-05-08T18:08:59.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8906999999999996e-05 2024-05-08T18:08:59.807 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.807 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.807 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.807 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:506 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'4, mlcod=32'2)", 2024-05-08T18:08:59.807 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:59.807 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.89652298, 2024-05-08T18:08:59.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006383143, 2024-05-08T18:08:59.807 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.807 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.807 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.807 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:59.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:08:59.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814081+0000", 2024-05-08T18:08:59.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0080000000000001e-06 2024-05-08T18:08:59.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814094+0000", 2024-05-08T18:08:59.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3407999999999999e-05 2024-05-08T18:08:59.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814125+0000", 2024-05-08T18:08:59.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0688999999999997e-05 2024-05-08T18:08:59.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814142+0000", 2024-05-08T18:08:59.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7192000000000001e-05 2024-05-08T18:08:59.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814245+0000", 2024-05-08T18:08:59.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103164 2024-05-08T18:08:59.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814302+0000", 2024-05-08T18:08:59.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6613999999999997e-05 2024-05-08T18:08:59.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820398+0000", 2024-05-08T18:08:59.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060967620000000004 2024-05-08T18:08:59.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820462+0000", 2024-05-08T18:08:59.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3305999999999993e-05 2024-05-08T18:08:59.811 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.811 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.811 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.811 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:750 6.19 6:9fecf831:::obj_delete_at_hint.0000000057:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:08:59.811 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:59.811 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.621284609, 2024-05-08T18:08:59.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035713440000000002, 2024-05-08T18:08:59.812 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:08:59.812 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:08:59.812 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:08:59.812 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:08:59.812 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:08:59.812 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:08:59.812 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 750 2024-05-08T18:08:59.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.812 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:08:59.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:08:59.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:59.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:08:59.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:08:59.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:08:59.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:08:59.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089318+0000", 2024-05-08T18:08:59.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.446e-06 2024-05-08T18:08:59.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:08:59.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089325+0000", 2024-05-08T18:08:59.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8560000000000001e-06 2024-05-08T18:08:59.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:08:59.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089345+0000", 2024-05-08T18:08:59.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9641999999999999e-05 2024-05-08T18:08:59.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:08:59.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089355+0000", 2024-05-08T18:08:59.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0586e-05 2024-05-08T18:08:59.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:08:59.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089469+0000", 2024-05-08T18:08:59.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113324 2024-05-08T18:08:59.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:08:59.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089692+0000", 2024-05-08T18:08:59.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022334500000000001 2024-05-08T18:08:59.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:08:59.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.090160+0000", 2024-05-08T18:08:59.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00046827799999999998 2024-05-08T18:08:59.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:08:59.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.091322+0000", 2024-05-08T18:08:59.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001161282 2024-05-08T18:08:59.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:08:59.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092750+0000", 2024-05-08T18:08:59.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014281299999999999 2024-05-08T18:08:59.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:08:59.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092829+0000", 2024-05-08T18:08:59.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9376999999999996e-05 2024-05-08T18:08:59.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:08:59.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:08:59.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:08:59.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092888+0000", 2024-05-08T18:08:59.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9077999999999999e-05 2024-05-08T18:08:59.817 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.817 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.817 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.817 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:08:59.817 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:08:59.817 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:08:59.818 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:08:59.819 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:08:59.819 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:08:59.820 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:08:59.820 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:08:59.817+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:08:59.820 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:08:59.820 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:08:59.821 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:08:59.841 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:08:59.842 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:08:59.872 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:08:59.873 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:08:59.902 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:08:59.903 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:08:59.919 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:08:59.920+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:08:59.934 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:08:59.934 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:08:59.966 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:08:59.966 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:08:59.987 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:08:59.987 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:00.002 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:09:00.048 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-05-08T18:09:00.048 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.5 to 1 (10000) 2024-05-08T18:09:00.048 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:00.049+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:00.080 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-08T18:09:00.120 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:00.120 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:00.122 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:00.124+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:00.134 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:09:00.222 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:00.224+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:00.298 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:00.298 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:00.312 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:09:00.356 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:00.357+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:00.424 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:00.425+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:00.430 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:00.431 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:00.445 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:09:00.524 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:00.524+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:00.608 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:00.608 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:00.622 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:09:00.626 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:00.625+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:00.726 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:00.728+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:00.746 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:00.746 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:00.760 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:09:00.827 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:00.825+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:00.927 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:00.928+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:00.928 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:00.928 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:00.946 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:09:01.029 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:01.029+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:01.060 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.6 to 1 (10000) 2024-05-08T18:09:01.086 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-08T18:09:01.130 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:01.132+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:01.160 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:01.160 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:01.179 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:09:01.231 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:01.229+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:01.331 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:01.329+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:01.392 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:01.392 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:01.410 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:09:01.454 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:01.456+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:01.532 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:01.532+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:01.580 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:01.580 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:01.598 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:09:01.634 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:01.633+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:01.734 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:01.733+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:01.808 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:01.809 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:01.827 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:09:01.870 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:01.872+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:01.936 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:01.936+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:01.949 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:01.950 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:01.963 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:09:01.989 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:09:02.036 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:02.037+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:02.053 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.7 to 1 (10000) 2024-05-08T18:09:02.079 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:09:02.087 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-08T18:09:02.087 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:09:02.127 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:02.127 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:02.147 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:09:02.147 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:02.148+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:02.156 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:02.156 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:02.182 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:02.183 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:02.215 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:02.215 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:02.237 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:02.236+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:02.247 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:02.247 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:02.277 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:02.277 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:02.290 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:02.291 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:02.291 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:02.291 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:02.291 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:02.302 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:02.302 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:02.305 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:09:02.322 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:02.322 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:02.339 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:02.337+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:02.343 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:02.343 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:02.436 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:02.436 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:02.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:02.436 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:02.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.437 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:09:02.437 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:09:02.437 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 98.862632144000003, 2024-05-08T18:09:02.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002466088, 2024-05-08T18:09:02.437 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.437 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.437 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.437 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.437 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.437 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.437 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 52 2024-05-08T18:09:02.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.437 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:09:02.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:09:02.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577062+0000", 2024-05-08T18:09:02.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.994e-06 2024-05-08T18:09:02.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577075+0000", 2024-05-08T18:09:02.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2480000000000001e-05 2024-05-08T18:09:02.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577108+0000", 2024-05-08T18:09:02.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3096000000000003e-05 2024-05-08T18:09:02.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577131+0000", 2024-05-08T18:09:02.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2993000000000002e-05 2024-05-08T18:09:02.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577260+0000", 2024-05-08T18:09:02.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012912899999999999 2024-05-08T18:09:02.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577453+0000", 2024-05-08T18:09:02.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000193668 2024-05-08T18:09:02.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:02.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577634+0000", 2024-05-08T18:09:02.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180576 2024-05-08T18:09:02.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579082+0000", 2024-05-08T18:09:02.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001448083 2024-05-08T18:09:02.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579290+0000", 2024-05-08T18:09:02.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000208333 2024-05-08T18:09:02.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579403+0000", 2024-05-08T18:09:02.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011296800000000001 2024-05-08T18:09:02.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579525+0000", 2024-05-08T18:09:02.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121768 2024-05-08T18:09:02.442 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.442 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.442 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.443 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-05-08T18:09:02.443 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:09:02.443 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 98.850772379000006, 2024-05-08T18:09:02.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038858310000000002, 2024-05-08T18:09:02.443 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.443 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.443 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.443 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:09:02.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:09:02.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588920+0000", 2024-05-08T18:09:02.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.23e-07 2024-05-08T18:09:02.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588929+0000", 2024-05-08T18:09:02.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3659999999999998e-06 2024-05-08T18:09:02.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588948+0000", 2024-05-08T18:09:02.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8768000000000001e-05 2024-05-08T18:09:02.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588962+0000", 2024-05-08T18:09:02.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4e-05 2024-05-08T18:09:02.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589110+0000", 2024-05-08T18:09:02.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148047 2024-05-08T18:09:02.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589173+0000", 2024-05-08T18:09:02.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2766000000000002e-05 2024-05-08T18:09:02.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592728+0000", 2024-05-08T18:09:02.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035553300000000002 2024-05-08T18:09:02.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592805+0000", 2024-05-08T18:09:02.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6730999999999994e-05 2024-05-08T18:09:02.446 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.446 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.447 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.447 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.447 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:09:02.447 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.734703480999997, 2024-05-08T18:09:02.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034354310000000001, 2024-05-08T18:09:02.447 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.447 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.447 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.447 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.447 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.447 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.447 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 236 2024-05-08T18:09:02.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.448 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:09:02.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:09:02.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704991+0000", 2024-05-08T18:09:02.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1240000000000001e-06 2024-05-08T18:09:02.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705009+0000", 2024-05-08T18:09:02.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7819e-05 2024-05-08T18:09:02.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705048+0000", 2024-05-08T18:09:02.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9632999999999998e-05 2024-05-08T18:09:02.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705073+0000", 2024-05-08T18:09:02.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4686999999999999e-05 2024-05-08T18:09:02.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705241+0000", 2024-05-08T18:09:02.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759899999999999 2024-05-08T18:09:02.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705511+0000", 2024-05-08T18:09:02.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027018799999999998 2024-05-08T18:09:02.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:02.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705965+0000", 2024-05-08T18:09:02.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045433000000000002 2024-05-08T18:09:02.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.707487+0000", 2024-05-08T18:09:02.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015214810000000001 2024-05-08T18:09:02.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708125+0000", 2024-05-08T18:09:02.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063870300000000001 2024-05-08T18:09:02.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708298+0000", 2024-05-08T18:09:02.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172592 2024-05-08T18:09:02.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708423+0000", 2024-05-08T18:09:02.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125275 2024-05-08T18:09:02.452 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.452 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.452 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.452 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:308 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.452 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:09:02.453 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.717865579000005, 2024-05-08T18:09:02.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038707400000000001, 2024-05-08T18:09:02.453 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.453 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.453 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.453 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.453 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.453 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.453 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 308 2024-05-08T18:09:02.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.453 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:09:02.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:09:02.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721827+0000", 2024-05-08T18:09:02.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1519999999999999e-06 2024-05-08T18:09:02.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721840+0000", 2024-05-08T18:09:02.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.362e-05 2024-05-08T18:09:02.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721857+0000", 2024-05-08T18:09:02.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6901e-05 2024-05-08T18:09:02.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721867+0000", 2024-05-08T18:09:02.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0034000000000001e-05 2024-05-08T18:09:02.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721922+0000", 2024-05-08T18:09:02.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4450999999999998e-05 2024-05-08T18:09:02.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721981+0000", 2024-05-08T18:09:02.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9267e-05 2024-05-08T18:09:02.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:02.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722103+0000", 2024-05-08T18:09:02.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121502 2024-05-08T18:09:02.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722757+0000", 2024-05-08T18:09:02.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065419700000000003 2024-05-08T18:09:02.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725619+0000", 2024-05-08T18:09:02.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002862107 2024-05-08T18:09:02.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725654+0000", 2024-05-08T18:09:02.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:09:02.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725696+0000", 2024-05-08T18:09:02.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:09:02.458 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.458 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.458 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.458 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:604 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.458 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:09:02.458 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.540582873000005, 2024-05-08T18:09:02.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002741884, 2024-05-08T18:09:02.458 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.459 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.459 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.459 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.459 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.459 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.459 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 604 2024-05-08T18:09:02.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.459 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:09:02.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:09:02.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899111+0000", 2024-05-08T18:09:02.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0910000000000001e-06 2024-05-08T18:09:02.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899126+0000", 2024-05-08T18:09:02.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:09:02.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899159+0000", 2024-05-08T18:09:02.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3241999999999998e-05 2024-05-08T18:09:02.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899174+0000", 2024-05-08T18:09:02.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5235000000000001e-05 2024-05-08T18:09:02.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899316+0000", 2024-05-08T18:09:02.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014175599999999999 2024-05-08T18:09:02.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899525+0000", 2024-05-08T18:09:02.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020915300000000001 2024-05-08T18:09:02.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:02.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899872+0000", 2024-05-08T18:09:02.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034668299999999997 2024-05-08T18:09:02.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901064+0000", 2024-05-08T18:09:02.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001191473 2024-05-08T18:09:02.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901664+0000", 2024-05-08T18:09:02.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060054599999999998 2024-05-08T18:09:02.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901779+0000", 2024-05-08T18:09:02.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011452500000000001 2024-05-08T18:09:02.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901850+0000", 2024-05-08T18:09:02.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1580000000000002e-05 2024-05-08T18:09:02.463 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.463 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.464 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.464 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:612 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.464 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:09:02.464 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.535074309999999, 2024-05-08T18:09:02.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025904750000000001, 2024-05-08T18:09:02.464 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.464 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.464 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.464 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.464 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.464 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.464 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 612 2024-05-08T18:09:02.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.465 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:09:02.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:09:02.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904619+0000", 2024-05-08T18:09:02.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8479999999999999e-06 2024-05-08T18:09:02.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904628+0000", 2024-05-08T18:09:02.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8829999999999995e-06 2024-05-08T18:09:02.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904650+0000", 2024-05-08T18:09:02.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2467999999999999e-05 2024-05-08T18:09:02.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904669+0000", 2024-05-08T18:09:02.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9303000000000001e-05 2024-05-08T18:09:02.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904766+0000", 2024-05-08T18:09:02.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6917999999999996e-05 2024-05-08T18:09:02.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904935+0000", 2024-05-08T18:09:02.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000168441 2024-05-08T18:09:02.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:02.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.905288+0000", 2024-05-08T18:09:02.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035312199999999998 2024-05-08T18:09:02.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.906520+0000", 2024-05-08T18:09:02.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001232005 2024-05-08T18:09:02.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907086+0000", 2024-05-08T18:09:02.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056658900000000005 2024-05-08T18:09:02.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907154+0000", 2024-05-08T18:09:02.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7197000000000001e-05 2024-05-08T18:09:02.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907207+0000", 2024-05-08T18:09:02.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3701e-05 2024-05-08T18:09:02.469 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.469 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.469 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.469 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.469 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:09:02.470 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.367056716999997, 2024-05-08T18:09:02.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032464490000000002, 2024-05-08T18:09:02.470 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.470 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.470 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.470 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.470 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.470 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.470 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 742 2024-05-08T18:09:02.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.470 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:09:02.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:09:02.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072637+0000", 2024-05-08T18:09:02.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9059999999999998e-06 2024-05-08T18:09:02.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072651+0000", 2024-05-08T18:09:02.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3477e-05 2024-05-08T18:09:02.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072683+0000", 2024-05-08T18:09:02.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2116000000000002e-05 2024-05-08T18:09:02.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072698+0000", 2024-05-08T18:09:02.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5454000000000001e-05 2024-05-08T18:09:02.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072845+0000", 2024-05-08T18:09:02.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146532 2024-05-08T18:09:02.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073241+0000", 2024-05-08T18:09:02.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039580699999999997 2024-05-08T18:09:02.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:02.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073812+0000", 2024-05-08T18:09:02.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057164900000000003 2024-05-08T18:09:02.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075063+0000", 2024-05-08T18:09:02.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001250131 2024-05-08T18:09:02.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075723+0000", 2024-05-08T18:09:02.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00066039199999999999 2024-05-08T18:09:02.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075808+0000", 2024-05-08T18:09:02.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5458999999999996e-05 2024-05-08T18:09:02.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075881+0000", 2024-05-08T18:09:02.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2526000000000003e-05 2024-05-08T18:09:02.475 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.475 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.475 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.475 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.475 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:09:02.475 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.324648351999997, 2024-05-08T18:09:02.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029270590000000001, 2024-05-08T18:09:02.475 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.475 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.475 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.476 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.476 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.476 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.476 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 760 2024-05-08T18:09:02.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.476 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:09:02.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:09:02.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115045+0000", 2024-05-08T18:09:02.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0729999999999999e-06 2024-05-08T18:09:02.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115057+0000", 2024-05-08T18:09:02.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1617000000000001e-05 2024-05-08T18:09:02.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115088+0000", 2024-05-08T18:09:02.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1155999999999998e-05 2024-05-08T18:09:02.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115103+0000", 2024-05-08T18:09:02.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5067e-05 2024-05-08T18:09:02.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115289+0000", 2024-05-08T18:09:02.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186582 2024-05-08T18:09:02.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115506+0000", 2024-05-08T18:09:02.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021690500000000001 2024-05-08T18:09:02.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:02.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115832+0000", 2024-05-08T18:09:02.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032556799999999998 2024-05-08T18:09:02.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.116892+0000", 2024-05-08T18:09:02.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010597989999999999 2024-05-08T18:09:02.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117807+0000", 2024-05-08T18:09:02.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091502599999999999 2024-05-08T18:09:02.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117895+0000", 2024-05-08T18:09:02.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7977000000000001e-05 2024-05-08T18:09:02.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117970+0000", 2024-05-08T18:09:02.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5289000000000004e-05 2024-05-08T18:09:02.480 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.481 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.481 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.481 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.481 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:09:02.481 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.193650865999999, 2024-05-08T18:09:02.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028290730000000001, 2024-05-08T18:09:02.481 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.481 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.481 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.481 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.481 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.481 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.481 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 817 2024-05-08T18:09:02.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.482 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:09:02.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:09:02.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246043+0000", 2024-05-08T18:09:02.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.807e-06 2024-05-08T18:09:02.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246056+0000", 2024-05-08T18:09:02.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2383e-05 2024-05-08T18:09:02.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246087+0000", 2024-05-08T18:09:02.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1937000000000003e-05 2024-05-08T18:09:02.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246104+0000", 2024-05-08T18:09:02.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6643e-05 2024-05-08T18:09:02.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246225+0000", 2024-05-08T18:09:02.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012061900000000001 2024-05-08T18:09:02.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246510+0000", 2024-05-08T18:09:02.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028507100000000002 2024-05-08T18:09:02.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:02.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246881+0000", 2024-05-08T18:09:02.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037163799999999998 2024-05-08T18:09:02.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248078+0000", 2024-05-08T18:09:02.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011968969999999999 2024-05-08T18:09:02.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248715+0000", 2024-05-08T18:09:02.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063698599999999998 2024-05-08T18:09:02.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248801+0000", 2024-05-08T18:09:02.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5772999999999993e-05 2024-05-08T18:09:02.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248869+0000", 2024-05-08T18:09:02.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8318999999999994e-05 2024-05-08T18:09:02.486 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.486 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.486 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.486 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.486 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:09:02.487 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.139907382000004, 2024-05-08T18:09:02.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003281693, 2024-05-08T18:09:02.487 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.487 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.487 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.487 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.487 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.487 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.487 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 841 2024-05-08T18:09:02.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.487 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:09:02.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:09:02.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299786+0000", 2024-05-08T18:09:02.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4770000000000002e-06 2024-05-08T18:09:02.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299798+0000", 2024-05-08T18:09:02.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1493e-05 2024-05-08T18:09:02.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299827+0000", 2024-05-08T18:09:02.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9363e-05 2024-05-08T18:09:02.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299842+0000", 2024-05-08T18:09:02.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.448e-05 2024-05-08T18:09:02.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300001+0000", 2024-05-08T18:09:02.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015909600000000001 2024-05-08T18:09:02.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300384+0000", 2024-05-08T18:09:02.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038306000000000001 2024-05-08T18:09:02.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:02.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300929+0000", 2024-05-08T18:09:02.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054551299999999997 2024-05-08T18:09:02.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302151+0000", 2024-05-08T18:09:02.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012218540000000001 2024-05-08T18:09:02.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302918+0000", 2024-05-08T18:09:02.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076719099999999997 2024-05-08T18:09:02.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303000+0000", 2024-05-08T18:09:02.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1662999999999994e-05 2024-05-08T18:09:02.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303065+0000", 2024-05-08T18:09:02.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5502999999999999e-05 2024-05-08T18:09:02.492 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.492 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.492 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.492 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.492 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:09:02.492 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.135711925999999, 2024-05-08T18:09:02.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026179150000000002, 2024-05-08T18:09:02.493 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.493 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.493 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.493 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.493 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.493 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.493 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 843 2024-05-08T18:09:02.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.493 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:09:02.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:09:02.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303981+0000", 2024-05-08T18:09:02.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9740000000000001e-06 2024-05-08T18:09:02.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303990+0000", 2024-05-08T18:09:02.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9889999999999998e-06 2024-05-08T18:09:02.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304012+0000", 2024-05-08T18:09:02.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1537000000000001e-05 2024-05-08T18:09:02.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304023+0000", 2024-05-08T18:09:02.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:09:02.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304101+0000", 2024-05-08T18:09:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7732999999999996e-05 2024-05-08T18:09:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304210+0000", 2024-05-08T18:09:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010985299999999999 2024-05-08T18:09:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304490+0000", 2024-05-08T18:09:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000279564 2024-05-08T18:09:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.305542+0000", 2024-05-08T18:09:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051976 2024-05-08T18:09:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306451+0000", 2024-05-08T18:09:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00090901999999999997 2024-05-08T18:09:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306533+0000", 2024-05-08T18:09:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1790000000000001e-05 2024-05-08T18:09:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306597+0000", 2024-05-08T18:09:02.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4332999999999995e-05 2024-05-08T18:09:02.498 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.498 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.498 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.498 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.498 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:09:02.498 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.126015715999998, 2024-05-08T18:09:02.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00275537, 2024-05-08T18:09:02.498 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.498 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.498 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.498 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.498 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.499 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.499 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 847 2024-05-08T18:09:02.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.499 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:09:02.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:09:02.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313678+0000", 2024-05-08T18:09:02.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:09:02.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313689+0000", 2024-05-08T18:09:02.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1273e-05 2024-05-08T18:09:02.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313719+0000", 2024-05-08T18:09:02.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9726e-05 2024-05-08T18:09:02.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313733+0000", 2024-05-08T18:09:02.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4487e-05 2024-05-08T18:09:02.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313858+0000", 2024-05-08T18:09:02.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125172 2024-05-08T18:09:02.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314072+0000", 2024-05-08T18:09:02.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021314200000000001 2024-05-08T18:09:02.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:02.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314378+0000", 2024-05-08T18:09:02.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030653100000000002 2024-05-08T18:09:02.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.315524+0000", 2024-05-08T18:09:02.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011458950000000001 2024-05-08T18:09:02.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316213+0000", 2024-05-08T18:09:02.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068942199999999997 2024-05-08T18:09:02.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316314+0000", 2024-05-08T18:09:02.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100723 2024-05-08T18:09:02.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316431+0000", 2024-05-08T18:09:02.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116759 2024-05-08T18:09:02.504 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.504 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.504 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.504 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.504 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:09:02.504 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.122363778999997, 2024-05-08T18:09:02.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025522510000000002, 2024-05-08T18:09:02.504 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.504 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.504 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.505 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.505 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.505 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.505 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 849 2024-05-08T18:09:02.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.505 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:09:02.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:09:02.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317329+0000", 2024-05-08T18:09:02.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9530000000000002e-06 2024-05-08T18:09:02.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317340+0000", 2024-05-08T18:09:02.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.08e-05 2024-05-08T18:09:02.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317364+0000", 2024-05-08T18:09:02.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4142999999999999e-05 2024-05-08T18:09:02.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317377+0000", 2024-05-08T18:09:02.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2764e-05 2024-05-08T18:09:02.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317471+0000", 2024-05-08T18:09:02.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4289000000000005e-05 2024-05-08T18:09:02.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317600+0000", 2024-05-08T18:09:02.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012910499999999999 2024-05-08T18:09:02.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:02.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317868+0000", 2024-05-08T18:09:02.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000267562 2024-05-08T18:09:02.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319081+0000", 2024-05-08T18:09:02.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001213387 2024-05-08T18:09:02.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319723+0000", 2024-05-08T18:09:02.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064134200000000004 2024-05-08T18:09:02.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319808+0000", 2024-05-08T18:09:02.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:09:02.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319880+0000", 2024-05-08T18:09:02.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1426000000000004e-05 2024-05-08T18:09:02.509 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.509 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.510 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.510 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.510 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:09:02.510 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.078931298000001, 2024-05-08T18:09:02.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002815157, 2024-05-08T18:09:02.510 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.510 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.510 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.510 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.510 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.510 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.511 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 868 2024-05-08T18:09:02.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.511 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:09:02.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:09:02.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360762+0000", 2024-05-08T18:09:02.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:09:02.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360775+0000", 2024-05-08T18:09:02.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2840000000000001e-05 2024-05-08T18:09:02.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360805+0000", 2024-05-08T18:09:02.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9686e-05 2024-05-08T18:09:02.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360819+0000", 2024-05-08T18:09:02.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.434e-05 2024-05-08T18:09:02.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360948+0000", 2024-05-08T18:09:02.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000129033 2024-05-08T18:09:02.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361166+0000", 2024-05-08T18:09:02.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021747800000000001 2024-05-08T18:09:02.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:02.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361481+0000", 2024-05-08T18:09:02.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031515800000000001 2024-05-08T18:09:02.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.362546+0000", 2024-05-08T18:09:02.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010653889999999999 2024-05-08T18:09:02.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363365+0000", 2024-05-08T18:09:02.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081906100000000005 2024-05-08T18:09:02.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363450+0000", 2024-05-08T18:09:02.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5202000000000002e-05 2024-05-08T18:09:02.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363575+0000", 2024-05-08T18:09:02.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012460999999999999 2024-05-08T18:09:02.515 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.515 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.515 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.516 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.516 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:09:02.516 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.075239124999996, 2024-05-08T18:09:02.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024676260000000001, 2024-05-08T18:09:02.516 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.516 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.516 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.516 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.516 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.516 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.516 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 870 2024-05-08T18:09:02.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.516 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:09:02.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:09:02.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364454+0000", 2024-05-08T18:09:02.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7770000000000001e-06 2024-05-08T18:09:02.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364463+0000", 2024-05-08T18:09:02.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4800000000000007e-06 2024-05-08T18:09:02.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364487+0000", 2024-05-08T18:09:02.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3589999999999999e-05 2024-05-08T18:09:02.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364499+0000", 2024-05-08T18:09:02.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.241e-05 2024-05-08T18:09:02.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364607+0000", 2024-05-08T18:09:02.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010760900000000001 2024-05-08T18:09:02.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364750+0000", 2024-05-08T18:09:02.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014265600000000001 2024-05-08T18:09:02.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:02.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.365021+0000", 2024-05-08T18:09:02.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027115100000000002 2024-05-08T18:09:02.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366163+0000", 2024-05-08T18:09:02.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011419189999999999 2024-05-08T18:09:02.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366727+0000", 2024-05-08T18:09:02.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056400199999999997 2024-05-08T18:09:02.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366810+0000", 2024-05-08T18:09:02.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3133000000000005e-05 2024-05-08T18:09:02.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366920+0000", 2024-05-08T18:09:02.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109899 2024-05-08T18:09:02.521 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.521 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.521 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.521 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.521 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:09:02.521 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.985324946999995, 2024-05-08T18:09:02.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027893459999999998, 2024-05-08T18:09:02.522 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.522 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.522 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.522 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.522 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.522 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.522 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 907 2024-05-08T18:09:02.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.522 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:09:02.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:09:02.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454369+0000", 2024-05-08T18:09:02.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5730000000000002e-06 2024-05-08T18:09:02.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454381+0000", 2024-05-08T18:09:02.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.208e-05 2024-05-08T18:09:02.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454413+0000", 2024-05-08T18:09:02.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2493000000000002e-05 2024-05-08T18:09:02.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454432+0000", 2024-05-08T18:09:02.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8862999999999999e-05 2024-05-08T18:09:02.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454577+0000", 2024-05-08T18:09:02.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014477899999999999 2024-05-08T18:09:02.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454800+0000", 2024-05-08T18:09:02.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223425 2024-05-08T18:09:02.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:02.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.455168+0000", 2024-05-08T18:09:02.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036712799999999999 2024-05-08T18:09:02.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456282+0000", 2024-05-08T18:09:02.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011141580000000001 2024-05-08T18:09:02.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456953+0000", 2024-05-08T18:09:02.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000670956 2024-05-08T18:09:02.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457038+0000", 2024-05-08T18:09:02.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4828999999999997e-05 2024-05-08T18:09:02.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457156+0000", 2024-05-08T18:09:02.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118062 2024-05-08T18:09:02.527 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.527 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.527 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.527 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.527 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:09:02.527 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.981632583999996, 2024-05-08T18:09:02.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026891609999999998, 2024-05-08T18:09:02.527 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.527 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.527 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.528 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.528 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 909 2024-05-08T18:09:02.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.528 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:09:02.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:09:02.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458060+0000", 2024-05-08T18:09:02.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:09:02.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458069+0000", 2024-05-08T18:09:02.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6440000000000006e-06 2024-05-08T18:09:02.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458090+0000", 2024-05-08T18:09:02.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1089000000000001e-05 2024-05-08T18:09:02.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458102+0000", 2024-05-08T18:09:02.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2306999999999999e-05 2024-05-08T18:09:02.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458191+0000", 2024-05-08T18:09:02.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8213000000000004e-05 2024-05-08T18:09:02.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458313+0000", 2024-05-08T18:09:02.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012231500000000001 2024-05-08T18:09:02.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:02.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458581+0000", 2024-05-08T18:09:02.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026762500000000001 2024-05-08T18:09:02.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.459773+0000", 2024-05-08T18:09:02.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001192991 2024-05-08T18:09:02.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460590+0000", 2024-05-08T18:09:02.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081618100000000002 2024-05-08T18:09:02.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460681+0000", 2024-05-08T18:09:02.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0946000000000006e-05 2024-05-08T18:09:02.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460748+0000", 2024-05-08T18:09:02.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7139999999999998e-05 2024-05-08T18:09:02.532 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.533 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.533 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.533 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.533 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:09:02.533 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.887989566000002, 2024-05-08T18:09:02.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030359179999999999, 2024-05-08T18:09:02.533 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.533 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.533 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.533 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.533 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.534 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.534 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 949 2024-05-08T18:09:02.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.534 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:09:02.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:09:02.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551705+0000", 2024-05-08T18:09:02.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2770000000000001e-06 2024-05-08T18:09:02.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551717+0000", 2024-05-08T18:09:02.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.206e-05 2024-05-08T18:09:02.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551747+0000", 2024-05-08T18:09:02.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0168999999999999e-05 2024-05-08T18:09:02.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551763+0000", 2024-05-08T18:09:02.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:09:02.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551880+0000", 2024-05-08T18:09:02.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116976 2024-05-08T18:09:02.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552099+0000", 2024-05-08T18:09:02.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021910199999999999 2024-05-08T18:09:02.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:02.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552476+0000", 2024-05-08T18:09:02.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000376697 2024-05-08T18:09:02.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.553551+0000", 2024-05-08T18:09:02.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001074925 2024-05-08T18:09:02.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554588+0000", 2024-05-08T18:09:02.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010374099999999999 2024-05-08T18:09:02.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554671+0000", 2024-05-08T18:09:02.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3368999999999994e-05 2024-05-08T18:09:02.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554738+0000", 2024-05-08T18:09:02.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6043000000000004e-05 2024-05-08T18:09:02.538 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.538 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.538 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.539 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.539 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:09:02.539 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.874376127999994, 2024-05-08T18:09:02.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028304160000000001, 2024-05-08T18:09:02.539 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.539 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.539 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.539 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.539 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.539 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.539 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 955 2024-05-08T18:09:02.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.540 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:09:02.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:09:02.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565318+0000", 2024-05-08T18:09:02.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7030000000000002e-06 2024-05-08T18:09:02.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565330+0000", 2024-05-08T18:09:02.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.204e-05 2024-05-08T18:09:02.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565363+0000", 2024-05-08T18:09:02.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2722999999999998e-05 2024-05-08T18:09:02.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565389+0000", 2024-05-08T18:09:02.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6412999999999999e-05 2024-05-08T18:09:02.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565510+0000", 2024-05-08T18:09:02.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120932 2024-05-08T18:09:02.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565722+0000", 2024-05-08T18:09:02.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212139 2024-05-08T18:09:02.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:02.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.566034+0000", 2024-05-08T18:09:02.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000312038 2024-05-08T18:09:02.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567340+0000", 2024-05-08T18:09:02.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00130547 2024-05-08T18:09:02.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567998+0000", 2024-05-08T18:09:02.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000658382 2024-05-08T18:09:02.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568081+0000", 2024-05-08T18:09:02.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3269999999999994e-05 2024-05-08T18:09:02.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568145+0000", 2024-05-08T18:09:02.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4306000000000004e-05 2024-05-08T18:09:02.544 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.544 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.544 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.544 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:02.544 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:09:02.544 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 94.870656604999994, 2024-05-08T18:09:02.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027506660000000001, 2024-05-08T18:09:02.545 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:02.545 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:02.545 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:02.545 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:02.545 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:02.545 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:02.545 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 957 2024-05-08T18:09:02.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.545 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:02.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:02.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:09:02.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:02.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:09:02.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:02.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:02.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569036+0000", 2024-05-08T18:09:02.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.776e-06 2024-05-08T18:09:02.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:02.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569061+0000", 2024-05-08T18:09:02.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5097e-05 2024-05-08T18:09:02.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:02.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569084+0000", 2024-05-08T18:09:02.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.23e-05 2024-05-08T18:09:02.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:02.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569096+0000", 2024-05-08T18:09:02.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.22e-05 2024-05-08T18:09:02.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:02.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569180+0000", 2024-05-08T18:09:02.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4369000000000005e-05 2024-05-08T18:09:02.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:02.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569296+0000", 2024-05-08T18:09:02.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115999 2024-05-08T18:09:02.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:02.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569550+0000", 2024-05-08T18:09:02.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025397499999999998 2024-05-08T18:09:02.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:02.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.570963+0000", 2024-05-08T18:09:02.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001413023 2024-05-08T18:09:02.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:02.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571614+0000", 2024-05-08T18:09:02.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065041199999999995 2024-05-08T18:09:02.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:02.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571701+0000", 2024-05-08T18:09:02.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7569000000000001e-05 2024-05-08T18:09:02.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:02.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:02.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:02.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571785+0000", 2024-05-08T18:09:02.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3945999999999999e-05 2024-05-08T18:09:02.550 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.550 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.550 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.550 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:02.550 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:02.550 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:02.552 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:09:02.558 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:09:02.564 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:02.549+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:02.564 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:09:02.566 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-05-08T18:09:02.062478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":759,"num_read_kb":507,"num_write":530,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229184,"kb_used_data":8840,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754745536,"statfs":{"total":773094113280,"available":772859428864,"internally_reserved":0,"allocated":9052160,"data_stored":5444646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.028712"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844188+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:09:00.844188+0000","last_peered":"2024-05-08T18:09:00.844188+0000","last_clean":"2024-05-08T18:09:00.844188+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:09:00.844188+0000","last_undegraded":"2024-05-08T18:09:00.844188+0000","last_fullsized":"2024-05-08T18:09:00.844188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375854+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:09:00.375854+0000","last_peered":"2024-05-08T18:09:00.375854+0000","last_clean":"2024-05-08T18:09:00.375854+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:09:00.375854+0000","last_undegraded":"2024-05-08T18:09:00.375854+0000","last_fullsized":"2024-05-08T18:09:00.375854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373705+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:09:01.373705+0000","last_peered":"2024-05-08T18:09:01.373705+0000","last_clean":"2024-05-08T18:09:01.373705+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:09:01.373705+0000","last_undegraded":"2024-05-08T18:09:01.373705+0000","last_fullsized":"2024-05-08T18:09:01.373705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844223+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:09:00.844223+0000","last_peered":"2024-05-08T18:09:00.844223+0000","last_clean":"2024-05-08T18:09:00.844223+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:09:00.844223+0000","last_undegraded":"2024-05-08T18:09:00.844223+0000","last_fullsized":"2024-05-08T18:09:00.844223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852758+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:09:00.852758+0000","last_peered":"2024-05-08T18:09:00.852758+0000","last_clean":"2024-05-08T18:09:00.852758+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:09:00.852758+0000","last_undegraded":"2024-05-08T18:09:00.852758+0000","last_fullsized":"2024-05-08T18:09:00.852758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059667+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:09:01.059667+0000","last_peered":"2024-05-08T18:09:01.059667+0000","last_clean":"2024-05-08T18:09:01.059667+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:09:01.059667+0000","last_undegraded":"2024-05-08T18:09:01.059667+0000","last_fullsized":"2024-05-08T18:09:01.059667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376577+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:09:00.376577+0000","last_peered":"2024-05-08T18:09:00.376577+0000","last_clean":"2024-05-08T18:09:00.376577+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:09:00.376577+0000","last_undegraded":"2024-05-08T18:09:00.376577+0000","last_fullsized":"2024-05-08T18:09:00.376577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851780+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:09:00.851780+0000","last_peered":"2024-05-08T18:09:00.851780+0000","last_clean":"2024-05-08T18:09:00.851780+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:09:00.851780+0000","last_undegraded":"2024-05-08T18:09:00.851780+0000","last_fullsized":"2024-05-08T18:09:00.851780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844051+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:09:00.844051+0000","last_peered":"2024-05-08T18:09:00.844051+0000","last_clean":"2024-05-08T18:09:00.844051+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:09:00.844051+0000","last_undegraded":"2024-05-08T18:09:00.844051+0000","last_fullsized":"2024-05-08T18:09:00.844051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845573+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:09:00.845573+0000","last_peered":"2024-05-08T18:09:00.845573+0000","last_clean":"2024-05-08T18:09:00.845573+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:09:00.845573+0000","last_undegraded":"2024-05-08T18:09:00.845573+0000","last_fullsized":"2024-05-08T18:09:00.845573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063579+0000","last_change":"2024-05-08T18:07:55.439965+0000","last_active":"2024-05-08T18:09:01.063579+0000","last_peered":"2024-05-08T18:09:01.063579+0000","last_clean":"2024-05-08T18:09:01.063579+0000","last_became_active":"2024-05-08T18:07:55.439578+0000","last_became_peered":"2024-05-08T18:07:55.439578+0000","last_unstale":"2024-05-08T18:09:01.063579+0000","last_undegraded":"2024-05-08T18:09:01.063579+0000","last_fullsized":"2024-05-08T18:09:01.063579+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:30.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060897+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:09:01.060897+0000","last_peered":"2024-05-08T18:09:01.060897+0000","last_clean":"2024-05-08T18:09:01.060897+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:09:01.060897+0000","last_undegraded":"2024-05-08T18:09:01.060897+0000","last_fullsized":"2024-05-08T18:09:01.060897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844470+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:09:00.844470+0000","last_peered":"2024-05-08T18:09:00.844470+0000","last_clean":"2024-05-08T18:09:00.844470+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:09:00.844470+0000","last_undegraded":"2024-05-08T18:09:00.844470+0000","last_fullsized":"2024-05-08T18:09:00.844470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376806+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:09:00.376806+0000","last_peered":"2024-05-08T18:09:00.376806+0000","last_clean":"2024-05-08T18:09:00.376806+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:09:00.376806+0000","last_undegraded":"2024-05-08T18:09:00.376806+0000","last_fullsized":"2024-05-08T18:09:00.376806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060877+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:09:01.060877+0000","last_peered":"2024-05-08T18:09:01.060877+0000","last_clean":"2024-05-08T18:09:01.060877+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:09:01.060877+0000","last_undegraded":"2024-05-08T18:09:01.060877+0000","last_fullsized":"2024-05-08T18:09:01.060877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.068352+0000","last_change":"2024-05-08T18:07:47.007132+0000","last_active":"2024-05-08T18:09:01.068352+0000","last_peered":"2024-05-08T18:09:01.068352+0000","last_clean":"2024-05-08T18:09:01.068352+0000","last_became_active":"2024-05-08T18:07:47.006744+0000","last_became_peered":"2024-05-08T18:07:47.006744+0000","last_unstale":"2024-05-08T18:09:01.068352+0000","last_undegraded":"2024-05-08T18:09:01.068352+0000","last_fullsized":"2024-05-08T18:09:01.068352+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:32.802677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.058884+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:09:01.058884+0000","last_peered":"2024-05-08T18:09:01.058884+0000","last_clean":"2024-05-08T18:09:01.058884+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:09:01.058884+0000","last_undegraded":"2024-05-08T18:09:01.058884+0000","last_fullsized":"2024-05-08T18:09:01.058884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844280+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:09:00.844280+0000","last_peered":"2024-05-08T18:09:00.844280+0000","last_clean":"2024-05-08T18:09:00.844280+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:09:00.844280+0000","last_undegraded":"2024-05-08T18:09:00.844280+0000","last_fullsized":"2024-05-08T18:09:00.844280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844283+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:09:00.844283+0000","last_peered":"2024-05-08T18:09:00.844283+0000","last_clean":"2024-05-08T18:09:00.844283+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:09:00.844283+0000","last_undegraded":"2024-05-08T18:09:00.844283+0000","last_fullsized":"2024-05-08T18:09:00.844283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845363+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:09:00.845363+0000","last_peered":"2024-05-08T18:09:00.845363+0000","last_clean":"2024-05-08T18:09:00.845363+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:09:00.845363+0000","last_undegraded":"2024-05-08T18:09:00.845363+0000","last_fullsized":"2024-05-08T18:09:00.845363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376162+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:09:00.376162+0000","last_peered":"2024-05-08T18:09:00.376162+0000","last_clean":"2024-05-08T18:09:00.376162+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:09:00.376162+0000","last_undegraded":"2024-05-08T18:09:00.376162+0000","last_fullsized":"2024-05-08T18:09:00.376162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845410+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:09:00.845410+0000","last_peered":"2024-05-08T18:09:00.845410+0000","last_clean":"2024-05-08T18:09:00.845410+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:09:00.845410+0000","last_undegraded":"2024-05-08T18:09:00.845410+0000","last_fullsized":"2024-05-08T18:09:00.845410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064097+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:09:01.064097+0000","last_peered":"2024-05-08T18:09:01.064097+0000","last_clean":"2024-05-08T18:09:01.064097+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:09:01.064097+0000","last_undegraded":"2024-05-08T18:09:01.064097+0000","last_fullsized":"2024-05-08T18:09:01.064097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059894+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:09:01.059894+0000","last_peered":"2024-05-08T18:09:01.059894+0000","last_clean":"2024-05-08T18:09:01.059894+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:09:01.059894+0000","last_undegraded":"2024-05-08T18:09:01.059894+0000","last_fullsized":"2024-05-08T18:09:01.059894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.066706+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:09:01.066706+0000","last_peered":"2024-05-08T18:09:01.066706+0000","last_clean":"2024-05-08T18:09:01.066706+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:09:01.066706+0000","last_undegraded":"2024-05-08T18:09:01.066706+0000","last_fullsized":"2024-05-08T18:09:01.066706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064458+0000","last_change":"2024-05-08T18:07:15.480500+0000","last_active":"2024-05-08T18:09:01.064458+0000","last_peered":"2024-05-08T18:09:01.064458+0000","last_clean":"2024-05-08T18:09:01.064458+0000","last_became_active":"2024-05-08T18:07:15.480192+0000","last_became_peered":"2024-05-08T18:07:15.480192+0000","last_unstale":"2024-05-08T18:09:01.064458+0000","last_undegraded":"2024-05-08T18:09:01.064458+0000","last_fullsized":"2024-05-08T18:09:01.064458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061112+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:09:01.061112+0000","last_peered":"2024-05-08T18:09:01.061112+0000","last_clean":"2024-05-08T18:09:01.061112+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:09:01.061112+0000","last_undegraded":"2024-05-08T18:09:01.061112+0000","last_fullsized":"2024-05-08T18:09:01.061112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851370+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:09:00.851370+0000","last_peered":"2024-05-08T18:09:00.851370+0000","last_clean":"2024-05-08T18:09:00.851370+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:09:00.851370+0000","last_undegraded":"2024-05-08T18:09:00.851370+0000","last_fullsized":"2024-05-08T18:09:00.851370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.058601+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:09:01.058601+0000","last_peered":"2024-05-08T18:09:01.058601+0000","last_clean":"2024-05-08T18:09:01.058601+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:09:01.058601+0000","last_undegraded":"2024-05-08T18:09:01.058601+0000","last_fullsized":"2024-05-08T18:09:01.058601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065604+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:09:01.065604+0000","last_peered":"2024-05-08T18:09:01.065604+0000","last_clean":"2024-05-08T18:09:01.065604+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:09:01.065604+0000","last_undegraded":"2024-05-08T18:09:01.065604+0000","last_fullsized":"2024-05-08T18:09:01.065604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844180+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:09:00.844180+0000","last_peered":"2024-05-08T18:09:00.844180+0000","last_clean":"2024-05-08T18:09:00.844180+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:09:00.844180+0000","last_undegraded":"2024-05-08T18:09:00.844180+0000","last_fullsized":"2024-05-08T18:09:00.844180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376525+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:09:00.376525+0000","last_peered":"2024-05-08T18:09:00.376525+0000","last_clean":"2024-05-08T18:09:00.376525+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:09:00.376525+0000","last_undegraded":"2024-05-08T18:09:00.376525+0000","last_fullsized":"2024-05-08T18:09:00.376525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853029+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:09:00.853029+0000","last_peered":"2024-05-08T18:09:00.853029+0000","last_clean":"2024-05-08T18:09:00.853029+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:09:00.853029+0000","last_undegraded":"2024-05-08T18:09:00.853029+0000","last_fullsized":"2024-05-08T18:09:00.853029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843908+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:09:00.843908+0000","last_peered":"2024-05-08T18:09:00.843908+0000","last_clean":"2024-05-08T18:09:00.843908+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:09:00.843908+0000","last_undegraded":"2024-05-08T18:09:00.843908+0000","last_fullsized":"2024-05-08T18:09:00.843908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375792+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:09:00.375792+0000","last_peered":"2024-05-08T18:09:00.375792+0000","last_clean":"2024-05-08T18:09:00.375792+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:09:00.375792+0000","last_undegraded":"2024-05-08T18:09:00.375792+0000","last_fullsized":"2024-05-08T18:09:00.375792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376865+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:09:00.376865+0000","last_peered":"2024-05-08T18:09:00.376865+0000","last_clean":"2024-05-08T18:09:00.376865+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:09:00.376865+0000","last_undegraded":"2024-05-08T18:09:00.376865+0000","last_fullsized":"2024-05-08T18:09:00.376865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851449+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:09:00.851449+0000","last_peered":"2024-05-08T18:09:00.851449+0000","last_clean":"2024-05-08T18:09:00.851449+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:09:00.851449+0000","last_undegraded":"2024-05-08T18:09:00.851449+0000","last_fullsized":"2024-05-08T18:09:00.851449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065525+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:09:01.065525+0000","last_peered":"2024-05-08T18:09:01.065525+0000","last_clean":"2024-05-08T18:09:01.065525+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:09:01.065525+0000","last_undegraded":"2024-05-08T18:09:01.065525+0000","last_fullsized":"2024-05-08T18:09:01.065525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060791+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:09:01.060791+0000","last_peered":"2024-05-08T18:09:01.060791+0000","last_clean":"2024-05-08T18:09:01.060791+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:09:01.060791+0000","last_undegraded":"2024-05-08T18:09:01.060791+0000","last_fullsized":"2024-05-08T18:09:01.060791+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":113,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060612+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:09:01.060612+0000","last_peered":"2024-05-08T18:09:01.060612+0000","last_clean":"2024-05-08T18:09:01.060612+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:09:01.060612+0000","last_undegraded":"2024-05-08T18:09:01.060612+0000","last_fullsized":"2024-05-08T18:09:01.060612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851140+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:09:00.851140+0000","last_peered":"2024-05-08T18:09:00.851140+0000","last_clean":"2024-05-08T18:09:00.851140+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:09:00.851140+0000","last_undegraded":"2024-05-08T18:09:00.851140+0000","last_fullsized":"2024-05-08T18:09:00.851140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853600+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:09:00.853600+0000","last_peered":"2024-05-08T18:09:00.853600+0000","last_clean":"2024-05-08T18:09:00.853600+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:09:00.853600+0000","last_undegraded":"2024-05-08T18:09:00.853600+0000","last_fullsized":"2024-05-08T18:09:00.853600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844715+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:09:00.844715+0000","last_peered":"2024-05-08T18:09:00.844715+0000","last_clean":"2024-05-08T18:09:00.844715+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:09:00.844715+0000","last_undegraded":"2024-05-08T18:09:00.844715+0000","last_fullsized":"2024-05-08T18:09:00.844715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.068029+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:09:01.068029+0000","last_peered":"2024-05-08T18:09:01.068029+0000","last_clean":"2024-05-08T18:09:01.068029+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:09:01.068029+0000","last_undegraded":"2024-05-08T18:09:01.068029+0000","last_fullsized":"2024-05-08T18:09:01.068029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.066521+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:09:01.066521+0000","last_peered":"2024-05-08T18:09:01.066521+0000","last_clean":"2024-05-08T18:09:01.066521+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:09:01.066521+0000","last_undegraded":"2024-05-08T18:09:01.066521+0000","last_fullsized":"2024-05-08T18:09:01.066521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843529+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:09:00.843529+0000","last_peered":"2024-05-08T18:09:00.843529+0000","last_clean":"2024-05-08T18:09:00.843529+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:09:00.843529+0000","last_undegraded":"2024-05-08T18:09:00.843529+0000","last_fullsized":"2024-05-08T18:09:00.843529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059428+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:09:01.059428+0000","last_peered":"2024-05-08T18:09:01.059428+0000","last_clean":"2024-05-08T18:09:01.059428+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:09:01.059428+0000","last_undegraded":"2024-05-08T18:09:01.059428+0000","last_fullsized":"2024-05-08T18:09:01.059428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065604+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:09:01.065604+0000","last_peered":"2024-05-08T18:09:01.065604+0000","last_clean":"2024-05-08T18:09:01.065604+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:09:01.065604+0000","last_undegraded":"2024-05-08T18:09:01.065604+0000","last_fullsized":"2024-05-08T18:09:01.065604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842743+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:09:00.842743+0000","last_peered":"2024-05-08T18:09:00.842743+0000","last_clean":"2024-05-08T18:09:00.842743+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:09:00.842743+0000","last_undegraded":"2024-05-08T18:09:00.842743+0000","last_fullsized":"2024-05-08T18:09:00.842743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376735+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:09:00.376735+0000","last_peered":"2024-05-08T18:09:00.376735+0000","last_clean":"2024-05-08T18:09:00.376735+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:09:00.376735+0000","last_undegraded":"2024-05-08T18:09:00.376735+0000","last_fullsized":"2024-05-08T18:09:00.376735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843802+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:09:00.843802+0000","last_peered":"2024-05-08T18:09:00.843802+0000","last_clean":"2024-05-08T18:09:00.843802+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:09:00.843802+0000","last_undegraded":"2024-05-08T18:09:00.843802+0000","last_fullsized":"2024-05-08T18:09:00.843802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065241+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:09:01.065241+0000","last_peered":"2024-05-08T18:09:01.065241+0000","last_clean":"2024-05-08T18:09:01.065241+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:09:01.065241+0000","last_undegraded":"2024-05-08T18:09:01.065241+0000","last_fullsized":"2024-05-08T18:09:01.065241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376186+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:09:00.376186+0000","last_peered":"2024-05-08T18:09:00.376186+0000","last_clean":"2024-05-08T18:09:00.376186+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:09:00.376186+0000","last_undegraded":"2024-05-08T18:09:00.376186+0000","last_fullsized":"2024-05-08T18:09:00.376186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064493+0000","last_change":"2024-05-08T18:07:55.357969+0000","last_active":"2024-05-08T18:09:01.064493+0000","last_peered":"2024-05-08T18:09:01.064493+0000","last_clean":"2024-05-08T18:09:01.064493+0000","last_became_active":"2024-05-08T18:07:55.357205+0000","last_became_peered":"2024-05-08T18:07:55.357205+0000","last_unstale":"2024-05-08T18:09:01.064493+0000","last_undegraded":"2024-05-08T18:09:01.064493+0000","last_fullsized":"2024-05-08T18:09:01.064493+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:04.667292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843604+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:09:00.843604+0000","last_peered":"2024-05-08T18:09:00.843604+0000","last_clean":"2024-05-08T18:09:00.843604+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:09:00.843604+0000","last_undegraded":"2024-05-08T18:09:00.843604+0000","last_fullsized":"2024-05-08T18:09:00.843604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":146,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375865+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:09:00.375865+0000","last_peered":"2024-05-08T18:09:00.375865+0000","last_clean":"2024-05-08T18:09:00.375865+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:09:00.375865+0000","last_undegraded":"2024-05-08T18:09:00.375865+0000","last_fullsized":"2024-05-08T18:09:00.375865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371877+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:09:01.371877+0000","last_peered":"2024-05-08T18:09:01.371877+0000","last_clean":"2024-05-08T18:09:01.371877+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:09:01.371877+0000","last_undegraded":"2024-05-08T18:09:01.371877+0000","last_fullsized":"2024-05-08T18:09:01.371877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376383+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:09:00.376383+0000","last_peered":"2024-05-08T18:09:00.376383+0000","last_clean":"2024-05-08T18:09:00.376383+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:09:00.376383+0000","last_undegraded":"2024-05-08T18:09:00.376383+0000","last_fullsized":"2024-05-08T18:09:00.376383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059098+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:09:01.059098+0000","last_peered":"2024-05-08T18:09:01.059098+0000","last_clean":"2024-05-08T18:09:01.059098+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:09:01.059098+0000","last_undegraded":"2024-05-08T18:09:01.059098+0000","last_fullsized":"2024-05-08T18:09:01.059098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844012+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:09:00.844012+0000","last_peered":"2024-05-08T18:09:00.844012+0000","last_clean":"2024-05-08T18:09:00.844012+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:09:00.844012+0000","last_undegraded":"2024-05-08T18:09:00.844012+0000","last_fullsized":"2024-05-08T18:09:00.844012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063106+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:09:01.063106+0000","last_peered":"2024-05-08T18:09:01.063106+0000","last_clean":"2024-05-08T18:09:01.063106+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:09:01.063106+0000","last_undegraded":"2024-05-08T18:09:01.063106+0000","last_fullsized":"2024-05-08T18:09:01.063106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064810+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:09:01.064810+0000","last_peered":"2024-05-08T18:09:01.064810+0000","last_clean":"2024-05-08T18:09:01.064810+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:09:01.064810+0000","last_undegraded":"2024-05-08T18:09:01.064810+0000","last_fullsized":"2024-05-08T18:09:01.064810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063044+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:09:01.063044+0000","last_peered":"2024-05-08T18:09:01.063044+0000","last_clean":"2024-05-08T18:09:01.063044+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:09:01.063044+0000","last_undegraded":"2024-05-08T18:09:01.063044+0000","last_fullsized":"2024-05-08T18:09:01.063044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844962+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:09:00.844962+0000","last_peered":"2024-05-08T18:09:00.844962+0000","last_clean":"2024-05-08T18:09:00.844962+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:09:00.844962+0000","last_undegraded":"2024-05-08T18:09:00.844962+0000","last_fullsized":"2024-05-08T18:09:00.844962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845453+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:09:00.845453+0000","last_peered":"2024-05-08T18:09:00.845453+0000","last_clean":"2024-05-08T18:09:00.845453+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:09:00.845453+0000","last_undegraded":"2024-05-08T18:09:00.845453+0000","last_fullsized":"2024-05-08T18:09:00.845453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844677+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:09:00.844677+0000","last_peered":"2024-05-08T18:09:00.844677+0000","last_clean":"2024-05-08T18:09:00.844677+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:09:00.844677+0000","last_undegraded":"2024-05-08T18:09:00.844677+0000","last_fullsized":"2024-05-08T18:09:00.844677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064333+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:09:01.064333+0000","last_peered":"2024-05-08T18:09:01.064333+0000","last_clean":"2024-05-08T18:09:01.064333+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:09:01.064333+0000","last_undegraded":"2024-05-08T18:09:01.064333+0000","last_fullsized":"2024-05-08T18:09:01.064333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844314+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:09:00.844314+0000","last_peered":"2024-05-08T18:09:00.844314+0000","last_clean":"2024-05-08T18:09:00.844314+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:09:00.844314+0000","last_undegraded":"2024-05-08T18:09:00.844314+0000","last_fullsized":"2024-05-08T18:09:00.844314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850549+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:09:00.850549+0000","last_peered":"2024-05-08T18:09:00.850549+0000","last_clean":"2024-05-08T18:09:00.850549+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:09:00.850549+0000","last_undegraded":"2024-05-08T18:09:00.850549+0000","last_fullsized":"2024-05-08T18:09:00.850549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853117+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:09:00.853117+0000","last_peered":"2024-05-08T18:09:00.853117+0000","last_clean":"2024-05-08T18:09:00.853117+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:09:00.853117+0000","last_undegraded":"2024-05-08T18:09:00.853117+0000","last_fullsized":"2024-05-08T18:09:00.853117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852359+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:09:00.852359+0000","last_peered":"2024-05-08T18:09:00.852359+0000","last_clean":"2024-05-08T18:09:00.852359+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:09:00.852359+0000","last_undegraded":"2024-05-08T18:09:00.852359+0000","last_fullsized":"2024-05-08T18:09:00.852359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376737+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:09:00.376737+0000","last_peered":"2024-05-08T18:09:00.376737+0000","last_clean":"2024-05-08T18:09:00.376737+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:09:00.376737+0000","last_undegraded":"2024-05-08T18:09:00.376737+0000","last_fullsized":"2024-05-08T18:09:00.376737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063873+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:09:01.063873+0000","last_peered":"2024-05-08T18:09:01.063873+0000","last_clean":"2024-05-08T18:09:01.063873+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:09:01.063873+0000","last_undegraded":"2024-05-08T18:09:01.063873+0000","last_fullsized":"2024-05-08T18:09:01.063873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850786+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:09:00.850786+0000","last_peered":"2024-05-08T18:09:00.850786+0000","last_clean":"2024-05-08T18:09:00.850786+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:09:00.850786+0000","last_undegraded":"2024-05-08T18:09:00.850786+0000","last_fullsized":"2024-05-08T18:09:00.850786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.062962+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:09:01.062962+0000","last_peered":"2024-05-08T18:09:01.062962+0000","last_clean":"2024-05-08T18:09:01.062962+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:09:01.062962+0000","last_undegraded":"2024-05-08T18:09:01.062962+0000","last_fullsized":"2024-05-08T18:09:01.062962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373871+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:09:01.373871+0000","last_peered":"2024-05-08T18:09:01.373871+0000","last_clean":"2024-05-08T18:09:01.373871+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:09:01.373871+0000","last_undegraded":"2024-05-08T18:09:01.373871+0000","last_fullsized":"2024-05-08T18:09:01.373871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060404+0000","last_change":"2024-05-08T18:07:55.356946+0000","last_active":"2024-05-08T18:09:01.060404+0000","last_peered":"2024-05-08T18:09:01.060404+0000","last_clean":"2024-05-08T18:09:01.060404+0000","last_became_active":"2024-05-08T18:07:55.355948+0000","last_became_peered":"2024-05-08T18:07:55.355948+0000","last_unstale":"2024-05-08T18:09:01.060404+0000","last_undegraded":"2024-05-08T18:09:01.060404+0000","last_fullsized":"2024-05-08T18:09:01.060404+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:04.163382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064246+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:09:01.064246+0000","last_peered":"2024-05-08T18:09:01.064246+0000","last_clean":"2024-05-08T18:09:01.064246+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:09:01.064246+0000","last_undegraded":"2024-05-08T18:09:01.064246+0000","last_fullsized":"2024-05-08T18:09:01.064246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.066923+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:09:01.066923+0000","last_peered":"2024-05-08T18:09:01.066923+0000","last_clean":"2024-05-08T18:09:01.066923+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:09:01.066923+0000","last_undegraded":"2024-05-08T18:09:01.066923+0000","last_fullsized":"2024-05-08T18:09:01.066923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060565+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:09:01.060565+0000","last_peered":"2024-05-08T18:09:01.060565+0000","last_clean":"2024-05-08T18:09:01.060565+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:09:01.060565+0000","last_undegraded":"2024-05-08T18:09:01.060565+0000","last_fullsized":"2024-05-08T18:09:01.060565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853947+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:09:00.853947+0000","last_peered":"2024-05-08T18:09:00.853947+0000","last_clean":"2024-05-08T18:09:00.853947+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:09:00.853947+0000","last_undegraded":"2024-05-08T18:09:00.853947+0000","last_fullsized":"2024-05-08T18:09:00.853947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060337+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:09:01.060337+0000","last_peered":"2024-05-08T18:09:01.060337+0000","last_clean":"2024-05-08T18:09:01.060337+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:09:01.060337+0000","last_undegraded":"2024-05-08T18:09:01.060337+0000","last_fullsized":"2024-05-08T18:09:01.060337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061202+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:09:01.061202+0000","last_peered":"2024-05-08T18:09:01.061202+0000","last_clean":"2024-05-08T18:09:01.061202+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:09:01.061202+0000","last_undegraded":"2024-05-08T18:09:01.061202+0000","last_fullsized":"2024-05-08T18:09:01.061202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845695+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:09:00.845695+0000","last_peered":"2024-05-08T18:09:00.845695+0000","last_clean":"2024-05-08T18:09:00.845695+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:09:00.845695+0000","last_undegraded":"2024-05-08T18:09:00.845695+0000","last_fullsized":"2024-05-08T18:09:00.845695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372091+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:09:01.372091+0000","last_peered":"2024-05-08T18:09:01.372091+0000","last_clean":"2024-05-08T18:09:01.372091+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:09:01.372091+0000","last_undegraded":"2024-05-08T18:09:01.372091+0000","last_fullsized":"2024-05-08T18:09:01.372091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064627+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:09:01.064627+0000","last_peered":"2024-05-08T18:09:01.064627+0000","last_clean":"2024-05-08T18:09:01.064627+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:09:01.064627+0000","last_undegraded":"2024-05-08T18:09:01.064627+0000","last_fullsized":"2024-05-08T18:09:01.064627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064391+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:09:01.064391+0000","last_peered":"2024-05-08T18:09:01.064391+0000","last_clean":"2024-05-08T18:09:01.064391+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:09:01.064391+0000","last_undegraded":"2024-05-08T18:09:01.064391+0000","last_fullsized":"2024-05-08T18:09:01.064391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.370828+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:09:01.370828+0000","last_peered":"2024-05-08T18:09:01.370828+0000","last_clean":"2024-05-08T18:09:01.370828+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:09:01.370828+0000","last_undegraded":"2024-05-08T18:09:01.370828+0000","last_fullsized":"2024-05-08T18:09:01.370828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061243+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:09:01.061243+0000","last_peered":"2024-05-08T18:09:01.061243+0000","last_clean":"2024-05-08T18:09:01.061243+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:09:01.061243+0000","last_undegraded":"2024-05-08T18:09:01.061243+0000","last_fullsized":"2024-05-08T18:09:01.061243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059883+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:09:01.059883+0000","last_peered":"2024-05-08T18:09:01.059883+0000","last_clean":"2024-05-08T18:09:01.059883+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:09:01.059883+0000","last_undegraded":"2024-05-08T18:09:01.059883+0000","last_fullsized":"2024-05-08T18:09:01.059883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376771+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:09:00.376771+0000","last_peered":"2024-05-08T18:09:00.376771+0000","last_clean":"2024-05-08T18:09:00.376771+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:09:00.376771+0000","last_undegraded":"2024-05-08T18:09:00.376771+0000","last_fullsized":"2024-05-08T18:09:00.376771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065337+0000","last_change":"2024-05-08T18:07:21.533056+0000","last_active":"2024-05-08T18:09:01.065337+0000","last_peered":"2024-05-08T18:09:01.065337+0000","last_clean":"2024-05-08T18:09:01.065337+0000","last_became_active":"2024-05-08T18:07:21.532184+0000","last_became_peered":"2024-05-08T18:07:21.532184+0000","last_unstale":"2024-05-08T18:09:01.065337+0000","last_undegraded":"2024-05-08T18:09:01.065337+0000","last_fullsized":"2024-05-08T18:09:01.065337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:50.629014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845045+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:09:00.845045+0000","last_peered":"2024-05-08T18:09:00.845045+0000","last_clean":"2024-05-08T18:09:00.845045+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:09:00.845045+0000","last_undegraded":"2024-05-08T18:09:00.845045+0000","last_fullsized":"2024-05-08T18:09:00.845045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059501+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:09:01.059501+0000","last_peered":"2024-05-08T18:09:01.059501+0000","last_clean":"2024-05-08T18:09:01.059501+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:09:01.059501+0000","last_undegraded":"2024-05-08T18:09:01.059501+0000","last_fullsized":"2024-05-08T18:09:01.059501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.374110+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:09:01.374110+0000","last_peered":"2024-05-08T18:09:01.374110+0000","last_clean":"2024-05-08T18:09:01.374110+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:09:01.374110+0000","last_undegraded":"2024-05-08T18:09:01.374110+0000","last_fullsized":"2024-05-08T18:09:01.374110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061023+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:09:01.061023+0000","last_peered":"2024-05-08T18:09:01.061023+0000","last_clean":"2024-05-08T18:09:01.061023+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:09:01.061023+0000","last_undegraded":"2024-05-08T18:09:01.061023+0000","last_fullsized":"2024-05-08T18:09:01.061023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061026+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:09:01.061026+0000","last_peered":"2024-05-08T18:09:01.061026+0000","last_clean":"2024-05-08T18:09:01.061026+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:09:01.061026+0000","last_undegraded":"2024-05-08T18:09:01.061026+0000","last_fullsized":"2024-05-08T18:09:01.061026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":143,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376506+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:09:00.376506+0000","last_peered":"2024-05-08T18:09:00.376506+0000","last_clean":"2024-05-08T18:09:00.376506+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:09:00.376506+0000","last_undegraded":"2024-05-08T18:09:00.376506+0000","last_fullsized":"2024-05-08T18:09:00.376506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844965+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:09:00.844965+0000","last_peered":"2024-05-08T18:09:00.844965+0000","last_clean":"2024-05-08T18:09:00.844965+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:09:00.844965+0000","last_undegraded":"2024-05-08T18:09:00.844965+0000","last_fullsized":"2024-05-08T18:09:00.844965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371799+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:09:01.371799+0000","last_peered":"2024-05-08T18:09:01.371799+0000","last_clean":"2024-05-08T18:09:01.371799+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:09:01.371799+0000","last_undegraded":"2024-05-08T18:09:01.371799+0000","last_fullsized":"2024-05-08T18:09:01.371799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845188+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:09:00.845188+0000","last_peered":"2024-05-08T18:09:00.845188+0000","last_clean":"2024-05-08T18:09:00.845188+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:09:00.845188+0000","last_undegraded":"2024-05-08T18:09:00.845188+0000","last_fullsized":"2024-05-08T18:09:00.845188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":230,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844587+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:09:00.844587+0000","last_peered":"2024-05-08T18:09:00.844587+0000","last_clean":"2024-05-08T18:09:00.844587+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:09:00.844587+0000","last_undegraded":"2024-05-08T18:09:00.844587+0000","last_fullsized":"2024-05-08T18:09:00.844587+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376336+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:09:00.376336+0000","last_peered":"2024-05-08T18:09:00.376336+0000","last_clean":"2024-05-08T18:09:00.376336+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:09:00.376336+0000","last_undegraded":"2024-05-08T18:09:00.376336+0000","last_fullsized":"2024-05-08T18:09:00.376336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064004+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:09:01.064004+0000","last_peered":"2024-05-08T18:09:01.064004+0000","last_clean":"2024-05-08T18:09:01.064004+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:09:01.064004+0000","last_undegraded":"2024-05-08T18:09:01.064004+0000","last_fullsized":"2024-05-08T18:09:01.064004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843389+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:09:00.843389+0000","last_peered":"2024-05-08T18:09:00.843389+0000","last_clean":"2024-05-08T18:09:00.843389+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:09:00.843389+0000","last_undegraded":"2024-05-08T18:09:00.843389+0000","last_fullsized":"2024-05-08T18:09:00.843389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":142,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376993+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:09:00.376993+0000","last_peered":"2024-05-08T18:09:00.376993+0000","last_clean":"2024-05-08T18:09:00.376993+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:09:00.376993+0000","last_undegraded":"2024-05-08T18:09:00.376993+0000","last_fullsized":"2024-05-08T18:09:00.376993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853195+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:09:00.853195+0000","last_peered":"2024-05-08T18:09:00.853195+0000","last_clean":"2024-05-08T18:09:00.853195+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:09:00.853195+0000","last_undegraded":"2024-05-08T18:09:00.853195+0000","last_fullsized":"2024-05-08T18:09:00.853195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842692+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:09:00.842692+0000","last_peered":"2024-05-08T18:09:00.842692+0000","last_clean":"2024-05-08T18:09:00.842692+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:09:00.842692+0000","last_undegraded":"2024-05-08T18:09:00.842692+0000","last_fullsized":"2024-05-08T18:09:00.842692+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853478+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:09:00.853478+0000","last_peered":"2024-05-08T18:09:00.853478+0000","last_clean":"2024-05-08T18:09:00.853478+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:09:00.853478+0000","last_undegraded":"2024-05-08T18:09:00.853478+0000","last_fullsized":"2024-05-08T18:09:00.853478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843318+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:09:00.843318+0000","last_peered":"2024-05-08T18:09:00.843318+0000","last_clean":"2024-05-08T18:09:00.843318+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:09:00.843318+0000","last_undegraded":"2024-05-08T18:09:00.843318+0000","last_fullsized":"2024-05-08T18:09:00.843318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850874+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:09:00.850874+0000","last_peered":"2024-05-08T18:09:00.850874+0000","last_clean":"2024-05-08T18:09:00.850874+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:09:00.850874+0000","last_undegraded":"2024-05-08T18:09:00.850874+0000","last_fullsized":"2024-05-08T18:09:00.850874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.377151+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:09:00.377151+0000","last_peered":"2024-05-08T18:09:00.377151+0000","last_clean":"2024-05-08T18:09:00.377151+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:09:00.377151+0000","last_undegraded":"2024-05-08T18:09:00.377151+0000","last_fullsized":"2024-05-08T18:09:00.377151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":179,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372011+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:09:01.372011+0000","last_peered":"2024-05-08T18:09:01.372011+0000","last_clean":"2024-05-08T18:09:01.372011+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:09:01.372011+0000","last_undegraded":"2024-05-08T18:09:01.372011+0000","last_fullsized":"2024-05-08T18:09:01.372011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843670+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:09:00.843670+0000","last_peered":"2024-05-08T18:09:00.843670+0000","last_clean":"2024-05-08T18:09:00.843670+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:09:00.843670+0000","last_undegraded":"2024-05-08T18:09:00.843670+0000","last_fullsized":"2024-05-08T18:09:00.843670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371210+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:09:01.371210+0000","last_peered":"2024-05-08T18:09:01.371210+0000","last_clean":"2024-05-08T18:09:01.371210+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:09:01.371210+0000","last_undegraded":"2024-05-08T18:09:01.371210+0000","last_fullsized":"2024-05-08T18:09:01.371210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.374184+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:09:01.374184+0000","last_peered":"2024-05-08T18:09:01.374184+0000","last_clean":"2024-05-08T18:09:01.374184+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:09:01.374184+0000","last_undegraded":"2024-05-08T18:09:01.374184+0000","last_fullsized":"2024-05-08T18:09:01.374184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063490+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:09:01.063490+0000","last_peered":"2024-05-08T18:09:01.063490+0000","last_clean":"2024-05-08T18:09:01.063490+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:09:01.063490+0000","last_undegraded":"2024-05-08T18:09:01.063490+0000","last_fullsized":"2024-05-08T18:09:01.063490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.370334+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:09:01.370334+0000","last_peered":"2024-05-08T18:09:01.370334+0000","last_clean":"2024-05-08T18:09:01.370334+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:09:01.370334+0000","last_undegraded":"2024-05-08T18:09:01.370334+0000","last_fullsized":"2024-05-08T18:09:01.370334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064497+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:09:01.064497+0000","last_peered":"2024-05-08T18:09:01.064497+0000","last_clean":"2024-05-08T18:09:01.064497+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:09:01.064497+0000","last_undegraded":"2024-05-08T18:09:01.064497+0000","last_fullsized":"2024-05-08T18:09:01.064497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":157,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844103+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:09:00.844103+0000","last_peered":"2024-05-08T18:09:00.844103+0000","last_clean":"2024-05-08T18:09:00.844103+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:09:00.844103+0000","last_undegraded":"2024-05-08T18:09:00.844103+0000","last_fullsized":"2024-05-08T18:09:00.844103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850615+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:09:00.850615+0000","last_peered":"2024-05-08T18:09:00.850615+0000","last_clean":"2024-05-08T18:09:00.850615+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:09:00.850615+0000","last_undegraded":"2024-05-08T18:09:00.850615+0000","last_fullsized":"2024-05-08T18:09:00.850615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064605+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:09:01.064605+0000","last_peered":"2024-05-08T18:09:01.064605+0000","last_clean":"2024-05-08T18:09:01.064605+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:09:01.064605+0000","last_undegraded":"2024-05-08T18:09:01.064605+0000","last_fullsized":"2024-05-08T18:09:01.064605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372258+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:09:01.372258+0000","last_peered":"2024-05-08T18:09:01.372258+0000","last_clean":"2024-05-08T18:09:01.372258+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:09:01.372258+0000","last_undegraded":"2024-05-08T18:09:01.372258+0000","last_fullsized":"2024-05-08T18:09:01.372258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376297+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:09:00.376297+0000","last_peered":"2024-05-08T18:09:00.376297+0000","last_clean":"2024-05-08T18:09:00.376297+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:09:00.376297+0000","last_undegraded":"2024-05-08T18:09:00.376297+0000","last_fullsized":"2024-05-08T18:09:00.376297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060627+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:09:01.060627+0000","last_peered":"2024-05-08T18:09:01.060627+0000","last_clean":"2024-05-08T18:09:01.060627+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:09:01.060627+0000","last_undegraded":"2024-05-08T18:09:01.060627+0000","last_fullsized":"2024-05-08T18:09:01.060627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852636+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:09:00.852636+0000","last_peered":"2024-05-08T18:09:00.852636+0000","last_clean":"2024-05-08T18:09:00.852636+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:09:00.852636+0000","last_undegraded":"2024-05-08T18:09:00.852636+0000","last_fullsized":"2024-05-08T18:09:00.852636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067671+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:09:01.067671+0000","last_peered":"2024-05-08T18:09:01.067671+0000","last_clean":"2024-05-08T18:09:01.067671+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:09:01.067671+0000","last_undegraded":"2024-05-08T18:09:01.067671+0000","last_fullsized":"2024-05-08T18:09:01.067671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":109,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845620+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:09:00.845620+0000","last_peered":"2024-05-08T18:09:00.845620+0000","last_clean":"2024-05-08T18:09:00.845620+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:09:00.845620+0000","last_undegraded":"2024-05-08T18:09:00.845620+0000","last_fullsized":"2024-05-08T18:09:00.845620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375710+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:09:00.375710+0000","last_peered":"2024-05-08T18:09:00.375710+0000","last_clean":"2024-05-08T18:09:00.375710+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:09:00.375710+0000","last_undegraded":"2024-05-08T18:09:00.375710+0000","last_fullsized":"2024-05-08T18:09:00.375710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371492+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:09:01.371492+0000","last_peered":"2024-05-08T18:09:01.371492+0000","last_clean":"2024-05-08T18:09:01.371492+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:09:01.371492+0000","last_undegraded":"2024-05-08T18:09:01.371492+0000","last_fullsized":"2024-05-08T18:09:01.371492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376996+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:09:00.376996+0000","last_peered":"2024-05-08T18:09:00.376996+0000","last_clean":"2024-05-08T18:09:00.376996+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:09:00.376996+0000","last_undegraded":"2024-05-08T18:09:00.376996+0000","last_fullsized":"2024-05-08T18:09:00.376996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372475+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:09:01.372475+0000","last_peered":"2024-05-08T18:09:01.372475+0000","last_clean":"2024-05-08T18:09:01.372475+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:09:01.372475+0000","last_undegraded":"2024-05-08T18:09:01.372475+0000","last_fullsized":"2024-05-08T18:09:01.372475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851930+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:09:00.851930+0000","last_peered":"2024-05-08T18:09:00.851930+0000","last_clean":"2024-05-08T18:09:00.851930+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:09:00.851930+0000","last_undegraded":"2024-05-08T18:09:00.851930+0000","last_fullsized":"2024-05-08T18:09:00.851930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":147,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850042+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:09:00.850042+0000","last_peered":"2024-05-08T18:09:00.850042+0000","last_clean":"2024-05-08T18:09:00.850042+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:09:00.850042+0000","last_undegraded":"2024-05-08T18:09:00.850042+0000","last_fullsized":"2024-05-08T18:09:00.850042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":113,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.058801+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:09:01.058801+0000","last_peered":"2024-05-08T18:09:01.058801+0000","last_clean":"2024-05-08T18:09:01.058801+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:09:01.058801+0000","last_undegraded":"2024-05-08T18:09:01.058801+0000","last_fullsized":"2024-05-08T18:09:01.058801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852898+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:09:00.852898+0000","last_peered":"2024-05-08T18:09:00.852898+0000","last_clean":"2024-05-08T18:09:00.852898+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:09:00.852898+0000","last_undegraded":"2024-05-08T18:09:00.852898+0000","last_fullsized":"2024-05-08T18:09:00.852898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852282+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:09:00.852282+0000","last_peered":"2024-05-08T18:09:00.852282+0000","last_clean":"2024-05-08T18:09:00.852282+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:09:00.852282+0000","last_undegraded":"2024-05-08T18:09:00.852282+0000","last_fullsized":"2024-05-08T18:09:00.852282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372331+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:09:01.372331+0000","last_peered":"2024-05-08T18:09:01.372331+0000","last_clean":"2024-05-08T18:09:01.372331+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:09:01.372331+0000","last_undegraded":"2024-05-08T18:09:01.372331+0000","last_fullsized":"2024-05-08T18:09:01.372331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845025+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:09:00.845025+0000","last_peered":"2024-05-08T18:09:00.845025+0000","last_clean":"2024-05-08T18:09:00.845025+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:09:00.845025+0000","last_undegraded":"2024-05-08T18:09:00.845025+0000","last_fullsized":"2024-05-08T18:09:00.845025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":118,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845023+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:09:00.845023+0000","last_peered":"2024-05-08T18:09:00.845023+0000","last_clean":"2024-05-08T18:09:00.845023+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:09:00.845023+0000","last_undegraded":"2024-05-08T18:09:00.845023+0000","last_fullsized":"2024-05-08T18:09:00.845023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.370545+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:09:01.370545+0000","last_peered":"2024-05-08T18:09:01.370545+0000","last_clean":"2024-05-08T18:09:01.370545+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:09:01.370545+0000","last_undegraded":"2024-05-08T18:09:01.370545+0000","last_fullsized":"2024-05-08T18:09:01.370545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375932+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:09:00.375932+0000","last_peered":"2024-05-08T18:09:00.375932+0000","last_clean":"2024-05-08T18:09:00.375932+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:09:00.375932+0000","last_undegraded":"2024-05-08T18:09:00.375932+0000","last_fullsized":"2024-05-08T18:09:00.375932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067921+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:09:01.067921+0000","last_peered":"2024-05-08T18:09:01.067921+0000","last_clean":"2024-05-08T18:09:01.067921+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:09:01.067921+0000","last_undegraded":"2024-05-08T18:09:01.067921+0000","last_fullsized":"2024-05-08T18:09:01.067921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060686+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:09:01.060686+0000","last_peered":"2024-05-08T18:09:01.060686+0000","last_clean":"2024-05-08T18:09:01.060686+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:09:01.060686+0000","last_undegraded":"2024-05-08T18:09:01.060686+0000","last_fullsized":"2024-05-08T18:09:01.060686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065476+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:09:01.065476+0000","last_peered":"2024-05-08T18:09:01.065476+0000","last_clean":"2024-05-08T18:09:01.065476+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:09:01.065476+0000","last_undegraded":"2024-05-08T18:09:01.065476+0000","last_fullsized":"2024-05-08T18:09:01.065476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373779+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:09:01.373779+0000","last_peered":"2024-05-08T18:09:01.373779+0000","last_clean":"2024-05-08T18:09:01.373779+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:09:01.373779+0000","last_undegraded":"2024-05-08T18:09:01.373779+0000","last_fullsized":"2024-05-08T18:09:01.373779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":121,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059095+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:09:01.059095+0000","last_peered":"2024-05-08T18:09:01.059095+0000","last_clean":"2024-05-08T18:09:01.059095+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:09:01.059095+0000","last_undegraded":"2024-05-08T18:09:01.059095+0000","last_fullsized":"2024-05-08T18:09:01.059095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059778+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:09:01.059778+0000","last_peered":"2024-05-08T18:09:01.059778+0000","last_clean":"2024-05-08T18:09:01.059778+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:09:01.059778+0000","last_undegraded":"2024-05-08T18:09:01.059778+0000","last_fullsized":"2024-05-08T18:09:01.059778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065123+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:09:01.065123+0000","last_peered":"2024-05-08T18:09:01.065123+0000","last_clean":"2024-05-08T18:09:01.065123+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:09:01.065123+0000","last_undegraded":"2024-05-08T18:09:01.065123+0000","last_fullsized":"2024-05-08T18:09:01.065123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850698+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:09:00.850698+0000","last_peered":"2024-05-08T18:09:00.850698+0000","last_clean":"2024-05-08T18:09:00.850698+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:09:00.850698+0000","last_undegraded":"2024-05-08T18:09:00.850698+0000","last_fullsized":"2024-05-08T18:09:00.850698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059387+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:09:01.059387+0000","last_peered":"2024-05-08T18:09:01.059387+0000","last_clean":"2024-05-08T18:09:01.059387+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:09:01.059387+0000","last_undegraded":"2024-05-08T18:09:01.059387+0000","last_fullsized":"2024-05-08T18:09:01.059387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853675+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:09:00.853675+0000","last_peered":"2024-05-08T18:09:00.853675+0000","last_clean":"2024-05-08T18:09:00.853675+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:09:00.853675+0000","last_undegraded":"2024-05-08T18:09:00.853675+0000","last_fullsized":"2024-05-08T18:09:00.853675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845800+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:09:00.845800+0000","last_peered":"2024-05-08T18:09:00.845800+0000","last_clean":"2024-05-08T18:09:00.845800+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:09:00.845800+0000","last_undegraded":"2024-05-08T18:09:00.845800+0000","last_fullsized":"2024-05-08T18:09:00.845800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060563+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:09:01.060563+0000","last_peered":"2024-05-08T18:09:01.060563+0000","last_clean":"2024-05-08T18:09:01.060563+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:09:01.060563+0000","last_undegraded":"2024-05-08T18:09:01.060563+0000","last_fullsized":"2024-05-08T18:09:01.060563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":152,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843301+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:09:00.843301+0000","last_peered":"2024-05-08T18:09:00.843301+0000","last_clean":"2024-05-08T18:09:00.843301+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:09:00.843301+0000","last_undegraded":"2024-05-08T18:09:00.843301+0000","last_fullsized":"2024-05-08T18:09:00.843301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063774+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:09:01.063774+0000","last_peered":"2024-05-08T18:09:01.063774+0000","last_clean":"2024-05-08T18:09:01.063774+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:09:01.063774+0000","last_undegraded":"2024-05-08T18:09:01.063774+0000","last_fullsized":"2024-05-08T18:09:01.063774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376451+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:09:00.376451+0000","last_peered":"2024-05-08T18:09:00.376451+0000","last_clean":"2024-05-08T18:09:00.376451+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:09:00.376451+0000","last_undegraded":"2024-05-08T18:09:00.376451+0000","last_fullsized":"2024-05-08T18:09:00.376451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853824+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:09:00.853824+0000","last_peered":"2024-05-08T18:09:00.853824+0000","last_clean":"2024-05-08T18:09:00.853824+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:09:00.853824+0000","last_undegraded":"2024-05-08T18:09:00.853824+0000","last_fullsized":"2024-05-08T18:09:00.853824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059879+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:09:01.059879+0000","last_peered":"2024-05-08T18:09:01.059879+0000","last_clean":"2024-05-08T18:09:01.059879+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:09:01.059879+0000","last_undegraded":"2024-05-08T18:09:01.059879+0000","last_fullsized":"2024-05-08T18:09:01.059879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059792+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:09:01.059792+0000","last_peered":"2024-05-08T18:09:01.059792+0000","last_clean":"2024-05-08T18:09:01.059792+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:09:01.059792+0000","last_undegraded":"2024-05-08T18:09:01.059792+0000","last_fullsized":"2024-05-08T18:09:01.059792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371564+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:09:01.371564+0000","last_peered":"2024-05-08T18:09:01.371564+0000","last_clean":"2024-05-08T18:09:01.371564+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:09:01.371564+0000","last_undegraded":"2024-05-08T18:09:01.371564+0000","last_fullsized":"2024-05-08T18:09:01.371564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060195+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:09:01.060195+0000","last_peered":"2024-05-08T18:09:01.060195+0000","last_clean":"2024-05-08T18:09:01.060195+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:09:01.060195+0000","last_undegraded":"2024-05-08T18:09:01.060195+0000","last_fullsized":"2024-05-08T18:09:01.060195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060424+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:09:01.060424+0000","last_peered":"2024-05-08T18:09:01.060424+0000","last_clean":"2024-05-08T18:09:01.060424+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:09:01.060424+0000","last_undegraded":"2024-05-08T18:09:01.060424+0000","last_fullsized":"2024-05-08T18:09:01.060424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067450+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:09:01.067450+0000","last_peered":"2024-05-08T18:09:01.067450+0000","last_clean":"2024-05-08T18:09:01.067450+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:09:01.067450+0000","last_undegraded":"2024-05-08T18:09:01.067450+0000","last_fullsized":"2024-05-08T18:09:01.067450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371418+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:09:01.371418+0000","last_peered":"2024-05-08T18:09:01.371418+0000","last_clean":"2024-05-08T18:09:01.371418+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:09:01.371418+0000","last_undegraded":"2024-05-08T18:09:01.371418+0000","last_fullsized":"2024-05-08T18:09:01.371418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844543+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:09:00.844543+0000","last_peered":"2024-05-08T18:09:00.844543+0000","last_clean":"2024-05-08T18:09:00.844543+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:09:00.844543+0000","last_undegraded":"2024-05-08T18:09:00.844543+0000","last_fullsized":"2024-05-08T18:09:00.844543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064531+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:09:01.064531+0000","last_peered":"2024-05-08T18:09:01.064531+0000","last_clean":"2024-05-08T18:09:01.064531+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:09:01.064531+0000","last_undegraded":"2024-05-08T18:09:01.064531+0000","last_fullsized":"2024-05-08T18:09:01.064531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"48'5","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850180+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:09:00.850180+0000","last_peered":"2024-05-08T18:09:00.850180+0000","last_clean":"2024-05-08T18:09:00.850180+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:09:00.850180+0000","last_undegraded":"2024-05-08T18:09:00.850180+0000","last_fullsized":"2024-05-08T18:09:00.850180+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843956+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:09:00.843956+0000","last_peered":"2024-05-08T18:09:00.843956+0000","last_clean":"2024-05-08T18:09:00.843956+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:09:00.843956+0000","last_undegraded":"2024-05-08T18:09:00.843956+0000","last_fullsized":"2024-05-08T18:09:00.843956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852550+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:09:00.852550+0000","last_peered":"2024-05-08T18:09:00.852550+0000","last_clean":"2024-05-08T18:09:00.852550+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:09:00.852550+0000","last_undegraded":"2024-05-08T18:09:00.852550+0000","last_fullsized":"2024-05-08T18:09:00.852550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063388+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:09:01.063388+0000","last_peered":"2024-05-08T18:09:01.063388+0000","last_clean":"2024-05-08T18:09:01.063388+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:09:01.063388+0000","last_undegraded":"2024-05-08T18:09:01.063388+0000","last_fullsized":"2024-05-08T18:09:01.063388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.377070+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:09:00.377070+0000","last_peered":"2024-05-08T18:09:00.377070+0000","last_clean":"2024-05-08T18:09:00.377070+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:09:00.377070+0000","last_undegraded":"2024-05-08T18:09:00.377070+0000","last_fullsized":"2024-05-08T18:09:00.377070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842876+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:09:00.842876+0000","last_peered":"2024-05-08T18:09:00.842876+0000","last_clean":"2024-05-08T18:09:00.842876+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:09:00.842876+0000","last_undegraded":"2024-05-08T18:09:00.842876+0000","last_fullsized":"2024-05-08T18:09:00.842876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064375+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:09:01.064375+0000","last_peered":"2024-05-08T18:09:01.064375+0000","last_clean":"2024-05-08T18:09:01.064375+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:09:01.064375+0000","last_undegraded":"2024-05-08T18:09:01.064375+0000","last_fullsized":"2024-05-08T18:09:01.064375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844839+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:09:00.844839+0000","last_peered":"2024-05-08T18:09:00.844839+0000","last_clean":"2024-05-08T18:09:00.844839+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:09:00.844839+0000","last_undegraded":"2024-05-08T18:09:00.844839+0000","last_fullsized":"2024-05-08T18:09:00.844839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376399+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:09:00.376399+0000","last_peered":"2024-05-08T18:09:00.376399+0000","last_clean":"2024-05-08T18:09:00.376399+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:09:00.376399+0000","last_undegraded":"2024-05-08T18:09:00.376399+0000","last_fullsized":"2024-05-08T18:09:00.376399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060803+0000","last_change":"2024-05-08T18:07:55.359230+0000","last_active":"2024-05-08T18:09:01.060803+0000","last_peered":"2024-05-08T18:09:01.060803+0000","last_clean":"2024-05-08T18:09:01.060803+0000","last_became_active":"2024-05-08T18:07:55.358047+0000","last_became_peered":"2024-05-08T18:07:55.358047+0000","last_unstale":"2024-05-08T18:09:01.060803+0000","last_undegraded":"2024-05-08T18:09:01.060803+0000","last_fullsized":"2024-05-08T18:09:01.060803+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:52.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.854254+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:09:00.854254+0000","last_peered":"2024-05-08T18:09:00.854254+0000","last_clean":"2024-05-08T18:09:00.854254+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:09:00.854254+0000","last_undegraded":"2024-05-08T18:09:00.854254+0000","last_fullsized":"2024-05-08T18:09:00.854254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":118,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843173+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:09:00.843173+0000","last_peered":"2024-05-08T18:09:00.843173+0000","last_clean":"2024-05-08T18:09:00.843173+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:09:00.843173+0000","last_undegraded":"2024-05-08T18:09:00.843173+0000","last_fullsized":"2024-05-08T18:09:00.843173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843271+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:09:00.843271+0000","last_peered":"2024-05-08T18:09:00.843271+0000","last_clean":"2024-05-08T18:09:00.843271+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:09:00.843271+0000","last_undegraded":"2024-05-08T18:09:00.843271+0000","last_fullsized":"2024-05-08T18:09:00.843271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851626+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:09:00.851626+0000","last_peered":"2024-05-08T18:09:00.851626+0000","last_clean":"2024-05-08T18:09:00.851626+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:09:00.851626+0000","last_undegraded":"2024-05-08T18:09:00.851626+0000","last_fullsized":"2024-05-08T18:09:00.851626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":121,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845712+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:09:00.845712+0000","last_peered":"2024-05-08T18:09:00.845712+0000","last_clean":"2024-05-08T18:09:00.845712+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:09:00.845712+0000","last_undegraded":"2024-05-08T18:09:00.845712+0000","last_fullsized":"2024-05-08T18:09:00.845712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060950+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:09:01.060950+0000","last_peered":"2024-05-08T18:09:01.060950+0000","last_clean":"2024-05-08T18:09:01.060950+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:09:01.060950+0000","last_undegraded":"2024-05-08T18:09:01.060950+0000","last_fullsized":"2024-05-08T18:09:01.060950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":121,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853275+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:09:00.853275+0000","last_peered":"2024-05-08T18:09:00.853275+0000","last_clean":"2024-05-08T18:09:00.853275+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:09:00.853275+0000","last_undegraded":"2024-05-08T18:09:00.853275+0000","last_fullsized":"2024-05-08T18:09:00.853275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372664+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:09:01.372664+0000","last_peered":"2024-05-08T18:09:01.372664+0000","last_clean":"2024-05-08T18:09:01.372664+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:09:01.372664+0000","last_undegraded":"2024-05-08T18:09:01.372664+0000","last_fullsized":"2024-05-08T18:09:01.372664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376482+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:09:00.376482+0000","last_peered":"2024-05-08T18:09:00.376482+0000","last_clean":"2024-05-08T18:09:00.376482+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:09:00.376482+0000","last_undegraded":"2024-05-08T18:09:00.376482+0000","last_fullsized":"2024-05-08T18:09:00.376482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063774+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:09:01.063774+0000","last_peered":"2024-05-08T18:09:01.063774+0000","last_clean":"2024-05-08T18:09:01.063774+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:09:01.063774+0000","last_undegraded":"2024-05-08T18:09:01.063774+0000","last_fullsized":"2024-05-08T18:09:01.063774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853404+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:09:00.853404+0000","last_peered":"2024-05-08T18:09:00.853404+0000","last_clean":"2024-05-08T18:09:00.853404+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:09:00.853404+0000","last_undegraded":"2024-05-08T18:09:00.853404+0000","last_fullsized":"2024-05-08T18:09:00.853404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371115+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:09:01.371115+0000","last_peered":"2024-05-08T18:09:01.371115+0000","last_clean":"2024-05-08T18:09:01.371115+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:09:01.371115+0000","last_undegraded":"2024-05-08T18:09:01.371115+0000","last_fullsized":"2024-05-08T18:09:01.371115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":117,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845644+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:09:00.845644+0000","last_peered":"2024-05-08T18:09:00.845644+0000","last_clean":"2024-05-08T18:09:00.845644+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:09:00.845644+0000","last_undegraded":"2024-05-08T18:09:00.845644+0000","last_fullsized":"2024-05-08T18:09:00.845644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843269+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:09:00.843269+0000","last_peered":"2024-05-08T18:09:00.843269+0000","last_clean":"2024-05-08T18:09:00.843269+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:09:00.843269+0000","last_undegraded":"2024-05-08T18:09:00.843269+0000","last_fullsized":"2024-05-08T18:09:00.843269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372748+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:09:01.372748+0000","last_peered":"2024-05-08T18:09:01.372748+0000","last_clean":"2024-05-08T18:09:01.372748+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:09:01.372748+0000","last_undegraded":"2024-05-08T18:09:01.372748+0000","last_fullsized":"2024-05-08T18:09:01.372748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844529+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:09:00.844529+0000","last_peered":"2024-05-08T18:09:00.844529+0000","last_clean":"2024-05-08T18:09:00.844529+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:09:00.844529+0000","last_undegraded":"2024-05-08T18:09:00.844529+0000","last_fullsized":"2024-05-08T18:09:00.844529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067302+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:09:01.067302+0000","last_peered":"2024-05-08T18:09:01.067302+0000","last_clean":"2024-05-08T18:09:01.067302+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:09:01.067302+0000","last_undegraded":"2024-05-08T18:09:01.067302+0000","last_fullsized":"2024-05-08T18:09:01.067302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060191+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:09:01.060191+0000","last_peered":"2024-05-08T18:09:01.060191+0000","last_clean":"2024-05-08T18:09:01.060191+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:09:01.060191+0000","last_undegraded":"2024-05-08T18:09:01.060191+0000","last_fullsized":"2024-05-08T18:09:01.060191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":121,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060860+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:09:01.060860+0000","last_peered":"2024-05-08T18:09:01.060860+0000","last_clean":"2024-05-08T18:09:01.060860+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:09:01.060860+0000","last_undegraded":"2024-05-08T18:09:01.060860+0000","last_fullsized":"2024-05-08T18:09:01.060860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.068008+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:09:01.068008+0000","last_peered":"2024-05-08T18:09:01.068008+0000","last_clean":"2024-05-08T18:09:01.068008+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:09:01.068008+0000","last_undegraded":"2024-05-08T18:09:01.068008+0000","last_fullsized":"2024-05-08T18:09:01.068008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373382+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:09:01.373382+0000","last_peered":"2024-05-08T18:09:01.373382+0000","last_clean":"2024-05-08T18:09:01.373382+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:09:01.373382+0000","last_undegraded":"2024-05-08T18:09:01.373382+0000","last_fullsized":"2024-05-08T18:09:01.373382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375902+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:09:00.375902+0000","last_peered":"2024-05-08T18:09:00.375902+0000","last_clean":"2024-05-08T18:09:00.375902+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:09:00.375902+0000","last_undegraded":"2024-05-08T18:09:00.375902+0000","last_fullsized":"2024-05-08T18:09:00.375902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.066781+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:09:01.066781+0000","last_peered":"2024-05-08T18:09:01.066781+0000","last_clean":"2024-05-08T18:09:01.066781+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:09:01.066781+0000","last_undegraded":"2024-05-08T18:09:01.066781+0000","last_fullsized":"2024-05-08T18:09:01.066781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851703+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:09:00.851703+0000","last_peered":"2024-05-08T18:09:00.851703+0000","last_clean":"2024-05-08T18:09:00.851703+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:09:00.851703+0000","last_undegraded":"2024-05-08T18:09:00.851703+0000","last_fullsized":"2024-05-08T18:09:00.851703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373006+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:09:01.373006+0000","last_peered":"2024-05-08T18:09:01.373006+0000","last_clean":"2024-05-08T18:09:01.373006+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:09:01.373006+0000","last_undegraded":"2024-05-08T18:09:01.373006+0000","last_fullsized":"2024-05-08T18:09:01.373006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060843+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:09:01.060843+0000","last_peered":"2024-05-08T18:09:01.060843+0000","last_clean":"2024-05-08T18:09:01.060843+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:09:01.060843+0000","last_undegraded":"2024-05-08T18:09:01.060843+0000","last_fullsized":"2024-05-08T18:09:01.060843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845417+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:09:00.845417+0000","last_peered":"2024-05-08T18:09:00.845417+0000","last_clean":"2024-05-08T18:09:00.845417+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:09:00.845417+0000","last_undegraded":"2024-05-08T18:09:00.845417+0000","last_fullsized":"2024-05-08T18:09:00.845417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842893+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:09:00.842893+0000","last_peered":"2024-05-08T18:09:00.842893+0000","last_clean":"2024-05-08T18:09:00.842893+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:09:00.842893+0000","last_undegraded":"2024-05-08T18:09:00.842893+0000","last_fullsized":"2024-05-08T18:09:00.842893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059692+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:09:01.059692+0000","last_peered":"2024-05-08T18:09:01.059692+0000","last_clean":"2024-05-08T18:09:01.059692+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:09:01.059692+0000","last_undegraded":"2024-05-08T18:09:01.059692+0000","last_fullsized":"2024-05-08T18:09:01.059692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376632+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:09:00.376632+0000","last_peered":"2024-05-08T18:09:00.376632+0000","last_clean":"2024-05-08T18:09:00.376632+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:09:00.376632+0000","last_undegraded":"2024-05-08T18:09:00.376632+0000","last_fullsized":"2024-05-08T18:09:00.376632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843596+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:09:00.843596+0000","last_peered":"2024-05-08T18:09:00.843596+0000","last_clean":"2024-05-08T18:09:00.843596+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:09:00.843596+0000","last_undegraded":"2024-05-08T18:09:00.843596+0000","last_fullsized":"2024-05-08T18:09:00.843596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376021+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:09:00.376021+0000","last_peered":"2024-05-08T18:09:00.376021+0000","last_clean":"2024-05-08T18:09:00.376021+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:09:00.376021+0000","last_undegraded":"2024-05-08T18:09:00.376021+0000","last_fullsized":"2024-05-08T18:09:00.376021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.849747+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:09:00.849747+0000","last_peered":"2024-05-08T18:09:00.849747+0000","last_clean":"2024-05-08T18:09:00.849747+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:09:00.849747+0000","last_undegraded":"2024-05-08T18:09:00.849747+0000","last_fullsized":"2024-05-08T18:09:00.849747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844359+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:09:00.844359+0000","last_peered":"2024-05-08T18:09:00.844359+0000","last_clean":"2024-05-08T18:09:00.844359+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:09:00.844359+0000","last_undegraded":"2024-05-08T18:09:00.844359+0000","last_fullsized":"2024-05-08T18:09:00.844359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059931+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:09:01.059931+0000","last_peered":"2024-05-08T18:09:01.059931+0000","last_clean":"2024-05-08T18:09:01.059931+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:09:01.059931+0000","last_undegraded":"2024-05-08T18:09:01.059931+0000","last_fullsized":"2024-05-08T18:09:01.059931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376868+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:09:00.376868+0000","last_peered":"2024-05-08T18:09:00.376868+0000","last_clean":"2024-05-08T18:09:00.376868+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:09:00.376868+0000","last_undegraded":"2024-05-08T18:09:00.376868+0000","last_fullsized":"2024-05-08T18:09:00.376868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376218+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:09:00.376218+0000","last_peered":"2024-05-08T18:09:00.376218+0000","last_clean":"2024-05-08T18:09:00.376218+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:09:00.376218+0000","last_undegraded":"2024-05-08T18:09:00.376218+0000","last_fullsized":"2024-05-08T18:09:00.376218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.849848+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:09:00.849848+0000","last_peered":"2024-05-08T18:09:00.849848+0000","last_clean":"2024-05-08T18:09:00.849848+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:09:00.849848+0000","last_undegraded":"2024-05-08T18:09:00.849848+0000","last_fullsized":"2024-05-08T18:09:00.849848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842918+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:09:00.842918+0000","last_peered":"2024-05-08T18:09:00.842918+0000","last_clean":"2024-05-08T18:09:00.842918+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:09:00.842918+0000","last_undegraded":"2024-05-08T18:09:00.842918+0000","last_fullsized":"2024-05-08T18:09:00.842918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067542+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:09:01.067542+0000","last_peered":"2024-05-08T18:09:01.067542+0000","last_clean":"2024-05-08T18:09:01.067542+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:09:01.067542+0000","last_undegraded":"2024-05-08T18:09:01.067542+0000","last_fullsized":"2024-05-08T18:09:01.067542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063510+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:09:01.063510+0000","last_peered":"2024-05-08T18:09:01.063510+0000","last_clean":"2024-05-08T18:09:01.063510+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:09:01.063510+0000","last_undegraded":"2024-05-08T18:09:01.063510+0000","last_fullsized":"2024-05-08T18:09:01.063510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373308+0000","last_change":"2024-05-08T18:07:55.439856+0000","last_active":"2024-05-08T18:09:01.373308+0000","last_peered":"2024-05-08T18:09:01.373308+0000","last_clean":"2024-05-08T18:09:01.373308+0000","last_became_active":"2024-05-08T18:07:55.439188+0000","last_became_peered":"2024-05-08T18:07:55.439188+0000","last_unstale":"2024-05-08T18:09:01.373308+0000","last_undegraded":"2024-05-08T18:09:01.373308+0000","last_fullsized":"2024-05-08T18:09:01.373308+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:40.273251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":121,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.058614+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:09:01.058614+0000","last_peered":"2024-05-08T18:09:01.058614+0000","last_clean":"2024-05-08T18:09:01.058614+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:09:01.058614+0000","last_undegraded":"2024-05-08T18:09:01.058614+0000","last_fullsized":"2024-05-08T18:09:01.058614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064985+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:09:01.064985+0000","last_peered":"2024-05-08T18:09:01.064985+0000","last_clean":"2024-05-08T18:09:01.064985+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:09:01.064985+0000","last_undegraded":"2024-05-08T18:09:01.064985+0000","last_fullsized":"2024-05-08T18:09:01.064985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":113,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059095+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:09:01.059095+0000","last_peered":"2024-05-08T18:09:01.059095+0000","last_clean":"2024-05-08T18:09:01.059095+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:09:01.059095+0000","last_undegraded":"2024-05-08T18:09:01.059095+0000","last_fullsized":"2024-05-08T18:09:01.059095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843958+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:09:00.843958+0000","last_peered":"2024-05-08T18:09:00.843958+0000","last_clean":"2024-05-08T18:09:00.843958+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:09:00.843958+0000","last_undegraded":"2024-05-08T18:09:00.843958+0000","last_fullsized":"2024-05-08T18:09:00.843958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059057+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:09:01.059057+0000","last_peered":"2024-05-08T18:09:01.059057+0000","last_clean":"2024-05-08T18:09:01.059057+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:09:01.059057+0000","last_undegraded":"2024-05-08T18:09:01.059057+0000","last_fullsized":"2024-05-08T18:09:01.059057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.854179+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:09:00.854179+0000","last_peered":"2024-05-08T18:09:00.854179+0000","last_clean":"2024-05-08T18:09:00.854179+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:09:00.854179+0000","last_undegraded":"2024-05-08T18:09:00.854179+0000","last_fullsized":"2024-05-08T18:09:00.854179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.370641+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:09:01.370641+0000","last_peered":"2024-05-08T18:09:01.370641+0000","last_clean":"2024-05-08T18:09:01.370641+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:09:01.370641+0000","last_undegraded":"2024-05-08T18:09:01.370641+0000","last_fullsized":"2024-05-08T18:09:01.370641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059338+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:09:01.059338+0000","last_peered":"2024-05-08T18:09:01.059338+0000","last_clean":"2024-05-08T18:09:01.059338+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:09:01.059338+0000","last_undegraded":"2024-05-08T18:09:01.059338+0000","last_fullsized":"2024-05-08T18:09:01.059338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851548+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:09:00.851548+0000","last_peered":"2024-05-08T18:09:00.851548+0000","last_clean":"2024-05-08T18:09:00.851548+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:09:00.851548+0000","last_undegraded":"2024-05-08T18:09:00.851548+0000","last_fullsized":"2024-05-08T18:09:00.851548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060935+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:09:01.060935+0000","last_peered":"2024-05-08T18:09:01.060935+0000","last_clean":"2024-05-08T18:09:01.060935+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:09:01.060935+0000","last_undegraded":"2024-05-08T18:09:01.060935+0000","last_fullsized":"2024-05-08T18:09:01.060935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.374036+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:09:01.374036+0000","last_peered":"2024-05-08T18:09:01.374036+0000","last_clean":"2024-05-08T18:09:01.374036+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:09:01.374036+0000","last_undegraded":"2024-05-08T18:09:01.374036+0000","last_fullsized":"2024-05-08T18:09:01.374036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842720+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:09:00.842720+0000","last_peered":"2024-05-08T18:09:00.842720+0000","last_clean":"2024-05-08T18:09:00.842720+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:09:00.842720+0000","last_undegraded":"2024-05-08T18:09:00.842720+0000","last_fullsized":"2024-05-08T18:09:00.842720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373591+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:09:01.373591+0000","last_peered":"2024-05-08T18:09:01.373591+0000","last_clean":"2024-05-08T18:09:01.373591+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:09:01.373591+0000","last_undegraded":"2024-05-08T18:09:01.373591+0000","last_fullsized":"2024-05-08T18:09:01.373591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063374+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:09:01.063374+0000","last_peered":"2024-05-08T18:09:01.063374+0000","last_clean":"2024-05-08T18:09:01.063374+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:09:01.063374+0000","last_undegraded":"2024-05-08T18:09:01.063374+0000","last_fullsized":"2024-05-08T18:09:01.063374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376649+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:09:00.376649+0000","last_peered":"2024-05-08T18:09:00.376649+0000","last_clean":"2024-05-08T18:09:00.376649+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:09:00.376649+0000","last_undegraded":"2024-05-08T18:09:00.376649+0000","last_fullsized":"2024-05-08T18:09:00.376649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376179+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:09:00.376179+0000","last_peered":"2024-05-08T18:09:00.376179+0000","last_clean":"2024-05-08T18:09:00.376179+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:09:00.376179+0000","last_undegraded":"2024-05-08T18:09:00.376179+0000","last_fullsized":"2024-05-08T18:09:00.376179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372401+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:09:01.372401+0000","last_peered":"2024-05-08T18:09:01.372401+0000","last_clean":"2024-05-08T18:09:01.372401+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:09:01.372401+0000","last_undegraded":"2024-05-08T18:09:01.372401+0000","last_fullsized":"2024-05-08T18:09:01.372401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851854+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:09:00.851854+0000","last_peered":"2024-05-08T18:09:00.851854+0000","last_clean":"2024-05-08T18:09:00.851854+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:09:00.851854+0000","last_undegraded":"2024-05-08T18:09:00.851854+0000","last_fullsized":"2024-05-08T18:09:00.851854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064733+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:09:01.064733+0000","last_peered":"2024-05-08T18:09:01.064733+0000","last_clean":"2024-05-08T18:09:01.064733+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:09:01.064733+0000","last_undegraded":"2024-05-08T18:09:01.064733+0000","last_fullsized":"2024-05-08T18:09:01.064733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.068327+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:09:01.068327+0000","last_peered":"2024-05-08T18:09:01.068327+0000","last_clean":"2024-05-08T18:09:01.068327+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:09:01.068327+0000","last_undegraded":"2024-05-08T18:09:01.068327+0000","last_fullsized":"2024-05-08T18:09:01.068327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060189+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:09:01.060189+0000","last_peered":"2024-05-08T18:09:01.060189+0000","last_clean":"2024-05-08T18:09:01.060189+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:09:01.060189+0000","last_undegraded":"2024-05-08T18:09:01.060189+0000","last_fullsized":"2024-05-08T18:09:01.060189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373214+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:09:01.373214+0000","last_peered":"2024-05-08T18:09:01.373214+0000","last_clean":"2024-05-08T18:09:01.373214+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:09:01.373214+0000","last_undegraded":"2024-05-08T18:09:01.373214+0000","last_fullsized":"2024-05-08T18:09:01.373214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063311+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:09:01.063311+0000","last_peered":"2024-05-08T18:09:01.063311+0000","last_clean":"2024-05-08T18:09:01.063311+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:09:01.063311+0000","last_undegraded":"2024-05-08T18:09:01.063311+0000","last_fullsized":"2024-05-08T18:09:01.063311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845502+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:09:00.845502+0000","last_peered":"2024-05-08T18:09:00.845502+0000","last_clean":"2024-05-08T18:09:00.845502+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:09:00.845502+0000","last_undegraded":"2024-05-08T18:09:00.845502+0000","last_fullsized":"2024-05-08T18:09:00.845502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842645+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:09:00.842645+0000","last_peered":"2024-05-08T18:09:00.842645+0000","last_clean":"2024-05-08T18:09:00.842645+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:09:00.842645+0000","last_undegraded":"2024-05-08T18:09:00.842645+0000","last_fullsized":"2024-05-08T18:09:00.842645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067895+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:09:01.067895+0000","last_peered":"2024-05-08T18:09:01.067895+0000","last_clean":"2024-05-08T18:09:01.067895+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:09:01.067895+0000","last_undegraded":"2024-05-08T18:09:01.067895+0000","last_fullsized":"2024-05-08T18:09:01.067895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.854101+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:09:00.854101+0000","last_peered":"2024-05-08T18:09:00.854101+0000","last_clean":"2024-05-08T18:09:00.854101+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:09:00.854101+0000","last_undegraded":"2024-05-08T18:09:00.854101+0000","last_fullsized":"2024-05-08T18:09:00.854101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376335+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:09:00.376335+0000","last_peered":"2024-05-08T18:09:00.376335+0000","last_clean":"2024-05-08T18:09:00.376335+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:09:00.376335+0000","last_undegraded":"2024-05-08T18:09:00.376335+0000","last_fullsized":"2024-05-08T18:09:00.376335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061143+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:09:01.061143+0000","last_peered":"2024-05-08T18:09:01.061143+0000","last_clean":"2024-05-08T18:09:01.061143+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:09:01.061143+0000","last_undegraded":"2024-05-08T18:09:01.061143+0000","last_fullsized":"2024-05-08T18:09:01.061143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063586+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:09:01.063586+0000","last_peered":"2024-05-08T18:09:01.063586+0000","last_clean":"2024-05-08T18:09:01.063586+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:09:01.063586+0000","last_undegraded":"2024-05-08T18:09:01.063586+0000","last_fullsized":"2024-05-08T18:09:01.063586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067087+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:09:01.067087+0000","last_peered":"2024-05-08T18:09:01.067087+0000","last_clean":"2024-05-08T18:09:01.067087+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:09:01.067087+0000","last_undegraded":"2024-05-08T18:09:01.067087+0000","last_fullsized":"2024-05-08T18:09:01.067087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063746+0000","last_change":"2024-05-08T18:07:55.445745+0000","last_active":"2024-05-08T18:09:01.063746+0000","last_peered":"2024-05-08T18:09:01.063746+0000","last_clean":"2024-05-08T18:09:01.063746+0000","last_became_active":"2024-05-08T18:07:55.444935+0000","last_became_peered":"2024-05-08T18:07:55.444935+0000","last_unstale":"2024-05-08T18:09:01.063746+0000","last_undegraded":"2024-05-08T18:09:01.063746+0000","last_fullsized":"2024-05-08T18:09:01.063746+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:37.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060599+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:09:01.060599+0000","last_peered":"2024-05-08T18:09:01.060599+0000","last_clean":"2024-05-08T18:09:01.060599+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:09:01.060599+0000","last_undegraded":"2024-05-08T18:09:01.060599+0000","last_fullsized":"2024-05-08T18:09:01.060599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852006+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:09:00.852006+0000","last_peered":"2024-05-08T18:09:00.852006+0000","last_clean":"2024-05-08T18:09:00.852006+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:09:00.852006+0000","last_undegraded":"2024-05-08T18:09:00.852006+0000","last_fullsized":"2024-05-08T18:09:00.852006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843480+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:09:00.843480+0000","last_peered":"2024-05-08T18:09:00.843480+0000","last_clean":"2024-05-08T18:09:00.843480+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:09:00.843480+0000","last_undegraded":"2024-05-08T18:09:00.843480+0000","last_fullsized":"2024-05-08T18:09:00.843480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845868+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:09:00.845868+0000","last_peered":"2024-05-08T18:09:00.845868+0000","last_clean":"2024-05-08T18:09:00.845868+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:09:00.845868+0000","last_undegraded":"2024-05-08T18:09:00.845868+0000","last_fullsized":"2024-05-08T18:09:00.845868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851060+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:09:00.851060+0000","last_peered":"2024-05-08T18:09:00.851060+0000","last_clean":"2024-05-08T18:09:00.851060+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:09:00.851060+0000","last_undegraded":"2024-05-08T18:09:00.851060+0000","last_fullsized":"2024-05-08T18:09:00.851060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844910+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:09:00.844910+0000","last_peered":"2024-05-08T18:09:00.844910+0000","last_clean":"2024-05-08T18:09:00.844910+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:09:00.844910+0000","last_undegraded":"2024-05-08T18:09:00.844910+0000","last_fullsized":"2024-05-08T18:09:00.844910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063233+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:09:01.063233+0000","last_peered":"2024-05-08T18:09:01.063233+0000","last_clean":"2024-05-08T18:09:01.063233+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:09:01.063233+0000","last_undegraded":"2024-05-08T18:09:01.063233+0000","last_fullsized":"2024-05-08T18:09:01.063233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067263+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:09:01.067263+0000","last_peered":"2024-05-08T18:09:01.067263+0000","last_clean":"2024-05-08T18:09:01.067263+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:09:01.067263+0000","last_undegraded":"2024-05-08T18:09:01.067263+0000","last_fullsized":"2024-05-08T18:09:01.067263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843086+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:09:00.843086+0000","last_peered":"2024-05-08T18:09:00.843086+0000","last_clean":"2024-05-08T18:09:00.843086+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:09:00.843086+0000","last_undegraded":"2024-05-08T18:09:00.843086+0000","last_fullsized":"2024-05-08T18:09:00.843086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.377222+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:09:00.377222+0000","last_peered":"2024-05-08T18:09:00.377222+0000","last_clean":"2024-05-08T18:09:00.377222+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:09:00.377222+0000","last_undegraded":"2024-05-08T18:09:00.377222+0000","last_fullsized":"2024-05-08T18:09:00.377222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376275+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:09:00.376275+0000","last_peered":"2024-05-08T18:09:00.376275+0000","last_clean":"2024-05-08T18:09:00.376275+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:09:00.376275+0000","last_undegraded":"2024-05-08T18:09:00.376275+0000","last_fullsized":"2024-05-08T18:09:00.376275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.854025+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:09:00.854025+0000","last_peered":"2024-05-08T18:09:00.854025+0000","last_clean":"2024-05-08T18:09:00.854025+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:09:00.854025+0000","last_undegraded":"2024-05-08T18:09:00.854025+0000","last_fullsized":"2024-05-08T18:09:00.854025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371000+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:09:01.371000+0000","last_peered":"2024-05-08T18:09:01.371000+0000","last_clean":"2024-05-08T18:09:01.371000+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:09:01.371000+0000","last_undegraded":"2024-05-08T18:09:01.371000+0000","last_fullsized":"2024-05-08T18:09:01.371000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376962+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:09:00.376962+0000","last_peered":"2024-05-08T18:09:00.376962+0000","last_clean":"2024-05-08T18:09:00.376962+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:09:00.376962+0000","last_undegraded":"2024-05-08T18:09:00.376962+0000","last_fullsized":"2024-05-08T18:09:00.376962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28580,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343260,"statfs":{"total":96636764160,"available":96607498240,"internally_reserved":0,"allocated":1593344,"data_stored":1123938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":532474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":534295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":962560,"data_stored":532965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":532870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":532036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":987136,"data_stored":532724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28560,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343280,"statfs":{"total":96636764160,"available":96607518720,"internally_reserved":0,"allocated":1572864,"data_stored":1123344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:09:02.576 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:09:02.652 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:02.653+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:02.715 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:02.715 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:02.715 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:02.715 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:02.731 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:09:02.753 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:02.753+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:02.840 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:02.840 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:02.841 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:02.841 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:02.841 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:02.854 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:09:02.854 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:02.856+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:02.911 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:09:02.917 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:09:02.931 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-05-08T18:09:02.062478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":759,"num_read_kb":507,"num_write":530,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229184,"kb_used_data":8840,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754745536,"statfs":{"total":773094113280,"available":772859428864,"internally_reserved":0,"allocated":9052160,"data_stored":5444646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.028712"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844188+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:09:00.844188+0000","last_peered":"2024-05-08T18:09:00.844188+0000","last_clean":"2024-05-08T18:09:00.844188+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:09:00.844188+0000","last_undegraded":"2024-05-08T18:09:00.844188+0000","last_fullsized":"2024-05-08T18:09:00.844188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375854+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:09:00.375854+0000","last_peered":"2024-05-08T18:09:00.375854+0000","last_clean":"2024-05-08T18:09:00.375854+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:09:00.375854+0000","last_undegraded":"2024-05-08T18:09:00.375854+0000","last_fullsized":"2024-05-08T18:09:00.375854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373705+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:09:01.373705+0000","last_peered":"2024-05-08T18:09:01.373705+0000","last_clean":"2024-05-08T18:09:01.373705+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:09:01.373705+0000","last_undegraded":"2024-05-08T18:09:01.373705+0000","last_fullsized":"2024-05-08T18:09:01.373705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844223+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:09:00.844223+0000","last_peered":"2024-05-08T18:09:00.844223+0000","last_clean":"2024-05-08T18:09:00.844223+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:09:00.844223+0000","last_undegraded":"2024-05-08T18:09:00.844223+0000","last_fullsized":"2024-05-08T18:09:00.844223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852758+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:09:00.852758+0000","last_peered":"2024-05-08T18:09:00.852758+0000","last_clean":"2024-05-08T18:09:00.852758+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:09:00.852758+0000","last_undegraded":"2024-05-08T18:09:00.852758+0000","last_fullsized":"2024-05-08T18:09:00.852758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059667+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:09:01.059667+0000","last_peered":"2024-05-08T18:09:01.059667+0000","last_clean":"2024-05-08T18:09:01.059667+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:09:01.059667+0000","last_undegraded":"2024-05-08T18:09:01.059667+0000","last_fullsized":"2024-05-08T18:09:01.059667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376577+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:09:00.376577+0000","last_peered":"2024-05-08T18:09:00.376577+0000","last_clean":"2024-05-08T18:09:00.376577+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:09:00.376577+0000","last_undegraded":"2024-05-08T18:09:00.376577+0000","last_fullsized":"2024-05-08T18:09:00.376577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851780+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:09:00.851780+0000","last_peered":"2024-05-08T18:09:00.851780+0000","last_clean":"2024-05-08T18:09:00.851780+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:09:00.851780+0000","last_undegraded":"2024-05-08T18:09:00.851780+0000","last_fullsized":"2024-05-08T18:09:00.851780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844051+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:09:00.844051+0000","last_peered":"2024-05-08T18:09:00.844051+0000","last_clean":"2024-05-08T18:09:00.844051+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:09:00.844051+0000","last_undegraded":"2024-05-08T18:09:00.844051+0000","last_fullsized":"2024-05-08T18:09:00.844051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845573+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:09:00.845573+0000","last_peered":"2024-05-08T18:09:00.845573+0000","last_clean":"2024-05-08T18:09:00.845573+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:09:00.845573+0000","last_undegraded":"2024-05-08T18:09:00.845573+0000","last_fullsized":"2024-05-08T18:09:00.845573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063579+0000","last_change":"2024-05-08T18:07:55.439965+0000","last_active":"2024-05-08T18:09:01.063579+0000","last_peered":"2024-05-08T18:09:01.063579+0000","last_clean":"2024-05-08T18:09:01.063579+0000","last_became_active":"2024-05-08T18:07:55.439578+0000","last_became_peered":"2024-05-08T18:07:55.439578+0000","last_unstale":"2024-05-08T18:09:01.063579+0000","last_undegraded":"2024-05-08T18:09:01.063579+0000","last_fullsized":"2024-05-08T18:09:01.063579+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:30.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060897+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:09:01.060897+0000","last_peered":"2024-05-08T18:09:01.060897+0000","last_clean":"2024-05-08T18:09:01.060897+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:09:01.060897+0000","last_undegraded":"2024-05-08T18:09:01.060897+0000","last_fullsized":"2024-05-08T18:09:01.060897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844470+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:09:00.844470+0000","last_peered":"2024-05-08T18:09:00.844470+0000","last_clean":"2024-05-08T18:09:00.844470+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:09:00.844470+0000","last_undegraded":"2024-05-08T18:09:00.844470+0000","last_fullsized":"2024-05-08T18:09:00.844470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376806+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:09:00.376806+0000","last_peered":"2024-05-08T18:09:00.376806+0000","last_clean":"2024-05-08T18:09:00.376806+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:09:00.376806+0000","last_undegraded":"2024-05-08T18:09:00.376806+0000","last_fullsized":"2024-05-08T18:09:00.376806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060877+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:09:01.060877+0000","last_peered":"2024-05-08T18:09:01.060877+0000","last_clean":"2024-05-08T18:09:01.060877+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:09:01.060877+0000","last_undegraded":"2024-05-08T18:09:01.060877+0000","last_fullsized":"2024-05-08T18:09:01.060877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.068352+0000","last_change":"2024-05-08T18:07:47.007132+0000","last_active":"2024-05-08T18:09:01.068352+0000","last_peered":"2024-05-08T18:09:01.068352+0000","last_clean":"2024-05-08T18:09:01.068352+0000","last_became_active":"2024-05-08T18:07:47.006744+0000","last_became_peered":"2024-05-08T18:07:47.006744+0000","last_unstale":"2024-05-08T18:09:01.068352+0000","last_undegraded":"2024-05-08T18:09:01.068352+0000","last_fullsized":"2024-05-08T18:09:01.068352+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:32.802677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.058884+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:09:01.058884+0000","last_peered":"2024-05-08T18:09:01.058884+0000","last_clean":"2024-05-08T18:09:01.058884+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:09:01.058884+0000","last_undegraded":"2024-05-08T18:09:01.058884+0000","last_fullsized":"2024-05-08T18:09:01.058884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844280+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:09:00.844280+0000","last_peered":"2024-05-08T18:09:00.844280+0000","last_clean":"2024-05-08T18:09:00.844280+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:09:00.844280+0000","last_undegraded":"2024-05-08T18:09:00.844280+0000","last_fullsized":"2024-05-08T18:09:00.844280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844283+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:09:00.844283+0000","last_peered":"2024-05-08T18:09:00.844283+0000","last_clean":"2024-05-08T18:09:00.844283+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:09:00.844283+0000","last_undegraded":"2024-05-08T18:09:00.844283+0000","last_fullsized":"2024-05-08T18:09:00.844283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845363+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:09:00.845363+0000","last_peered":"2024-05-08T18:09:00.845363+0000","last_clean":"2024-05-08T18:09:00.845363+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:09:00.845363+0000","last_undegraded":"2024-05-08T18:09:00.845363+0000","last_fullsized":"2024-05-08T18:09:00.845363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376162+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:09:00.376162+0000","last_peered":"2024-05-08T18:09:00.376162+0000","last_clean":"2024-05-08T18:09:00.376162+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:09:00.376162+0000","last_undegraded":"2024-05-08T18:09:00.376162+0000","last_fullsized":"2024-05-08T18:09:00.376162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845410+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:09:00.845410+0000","last_peered":"2024-05-08T18:09:00.845410+0000","last_clean":"2024-05-08T18:09:00.845410+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:09:00.845410+0000","last_undegraded":"2024-05-08T18:09:00.845410+0000","last_fullsized":"2024-05-08T18:09:00.845410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064097+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:09:01.064097+0000","last_peered":"2024-05-08T18:09:01.064097+0000","last_clean":"2024-05-08T18:09:01.064097+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:09:01.064097+0000","last_undegraded":"2024-05-08T18:09:01.064097+0000","last_fullsized":"2024-05-08T18:09:01.064097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059894+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:09:01.059894+0000","last_peered":"2024-05-08T18:09:01.059894+0000","last_clean":"2024-05-08T18:09:01.059894+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:09:01.059894+0000","last_undegraded":"2024-05-08T18:09:01.059894+0000","last_fullsized":"2024-05-08T18:09:01.059894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.066706+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:09:01.066706+0000","last_peered":"2024-05-08T18:09:01.066706+0000","last_clean":"2024-05-08T18:09:01.066706+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:09:01.066706+0000","last_undegraded":"2024-05-08T18:09:01.066706+0000","last_fullsized":"2024-05-08T18:09:01.066706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064458+0000","last_change":"2024-05-08T18:07:15.480500+0000","last_active":"2024-05-08T18:09:01.064458+0000","last_peered":"2024-05-08T18:09:01.064458+0000","last_clean":"2024-05-08T18:09:01.064458+0000","last_became_active":"2024-05-08T18:07:15.480192+0000","last_became_peered":"2024-05-08T18:07:15.480192+0000","last_unstale":"2024-05-08T18:09:01.064458+0000","last_undegraded":"2024-05-08T18:09:01.064458+0000","last_fullsized":"2024-05-08T18:09:01.064458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061112+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:09:01.061112+0000","last_peered":"2024-05-08T18:09:01.061112+0000","last_clean":"2024-05-08T18:09:01.061112+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:09:01.061112+0000","last_undegraded":"2024-05-08T18:09:01.061112+0000","last_fullsized":"2024-05-08T18:09:01.061112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851370+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:09:00.851370+0000","last_peered":"2024-05-08T18:09:00.851370+0000","last_clean":"2024-05-08T18:09:00.851370+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:09:00.851370+0000","last_undegraded":"2024-05-08T18:09:00.851370+0000","last_fullsized":"2024-05-08T18:09:00.851370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.058601+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:09:01.058601+0000","last_peered":"2024-05-08T18:09:01.058601+0000","last_clean":"2024-05-08T18:09:01.058601+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:09:01.058601+0000","last_undegraded":"2024-05-08T18:09:01.058601+0000","last_fullsized":"2024-05-08T18:09:01.058601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065604+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:09:01.065604+0000","last_peered":"2024-05-08T18:09:01.065604+0000","last_clean":"2024-05-08T18:09:01.065604+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:09:01.065604+0000","last_undegraded":"2024-05-08T18:09:01.065604+0000","last_fullsized":"2024-05-08T18:09:01.065604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844180+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:09:00.844180+0000","last_peered":"2024-05-08T18:09:00.844180+0000","last_clean":"2024-05-08T18:09:00.844180+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:09:00.844180+0000","last_undegraded":"2024-05-08T18:09:00.844180+0000","last_fullsized":"2024-05-08T18:09:00.844180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376525+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:09:00.376525+0000","last_peered":"2024-05-08T18:09:00.376525+0000","last_clean":"2024-05-08T18:09:00.376525+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:09:00.376525+0000","last_undegraded":"2024-05-08T18:09:00.376525+0000","last_fullsized":"2024-05-08T18:09:00.376525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853029+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:09:00.853029+0000","last_peered":"2024-05-08T18:09:00.853029+0000","last_clean":"2024-05-08T18:09:00.853029+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:09:00.853029+0000","last_undegraded":"2024-05-08T18:09:00.853029+0000","last_fullsized":"2024-05-08T18:09:00.853029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843908+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:09:00.843908+0000","last_peered":"2024-05-08T18:09:00.843908+0000","last_clean":"2024-05-08T18:09:00.843908+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:09:00.843908+0000","last_undegraded":"2024-05-08T18:09:00.843908+0000","last_fullsized":"2024-05-08T18:09:00.843908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375792+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:09:00.375792+0000","last_peered":"2024-05-08T18:09:00.375792+0000","last_clean":"2024-05-08T18:09:00.375792+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:09:00.375792+0000","last_undegraded":"2024-05-08T18:09:00.375792+0000","last_fullsized":"2024-05-08T18:09:00.375792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376865+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:09:00.376865+0000","last_peered":"2024-05-08T18:09:00.376865+0000","last_clean":"2024-05-08T18:09:00.376865+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:09:00.376865+0000","last_undegraded":"2024-05-08T18:09:00.376865+0000","last_fullsized":"2024-05-08T18:09:00.376865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851449+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:09:00.851449+0000","last_peered":"2024-05-08T18:09:00.851449+0000","last_clean":"2024-05-08T18:09:00.851449+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:09:00.851449+0000","last_undegraded":"2024-05-08T18:09:00.851449+0000","last_fullsized":"2024-05-08T18:09:00.851449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065525+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:09:01.065525+0000","last_peered":"2024-05-08T18:09:01.065525+0000","last_clean":"2024-05-08T18:09:01.065525+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:09:01.065525+0000","last_undegraded":"2024-05-08T18:09:01.065525+0000","last_fullsized":"2024-05-08T18:09:01.065525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060791+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:09:01.060791+0000","last_peered":"2024-05-08T18:09:01.060791+0000","last_clean":"2024-05-08T18:09:01.060791+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:09:01.060791+0000","last_undegraded":"2024-05-08T18:09:01.060791+0000","last_fullsized":"2024-05-08T18:09:01.060791+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":113,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060612+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:09:01.060612+0000","last_peered":"2024-05-08T18:09:01.060612+0000","last_clean":"2024-05-08T18:09:01.060612+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:09:01.060612+0000","last_undegraded":"2024-05-08T18:09:01.060612+0000","last_fullsized":"2024-05-08T18:09:01.060612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851140+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:09:00.851140+0000","last_peered":"2024-05-08T18:09:00.851140+0000","last_clean":"2024-05-08T18:09:00.851140+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:09:00.851140+0000","last_undegraded":"2024-05-08T18:09:00.851140+0000","last_fullsized":"2024-05-08T18:09:00.851140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853600+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:09:00.853600+0000","last_peered":"2024-05-08T18:09:00.853600+0000","last_clean":"2024-05-08T18:09:00.853600+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:09:00.853600+0000","last_undegraded":"2024-05-08T18:09:00.853600+0000","last_fullsized":"2024-05-08T18:09:00.853600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844715+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:09:00.844715+0000","last_peered":"2024-05-08T18:09:00.844715+0000","last_clean":"2024-05-08T18:09:00.844715+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:09:00.844715+0000","last_undegraded":"2024-05-08T18:09:00.844715+0000","last_fullsized":"2024-05-08T18:09:00.844715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.068029+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:09:01.068029+0000","last_peered":"2024-05-08T18:09:01.068029+0000","last_clean":"2024-05-08T18:09:01.068029+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:09:01.068029+0000","last_undegraded":"2024-05-08T18:09:01.068029+0000","last_fullsized":"2024-05-08T18:09:01.068029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.066521+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:09:01.066521+0000","last_peered":"2024-05-08T18:09:01.066521+0000","last_clean":"2024-05-08T18:09:01.066521+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:09:01.066521+0000","last_undegraded":"2024-05-08T18:09:01.066521+0000","last_fullsized":"2024-05-08T18:09:01.066521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843529+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:09:00.843529+0000","last_peered":"2024-05-08T18:09:00.843529+0000","last_clean":"2024-05-08T18:09:00.843529+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:09:00.843529+0000","last_undegraded":"2024-05-08T18:09:00.843529+0000","last_fullsized":"2024-05-08T18:09:00.843529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059428+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:09:01.059428+0000","last_peered":"2024-05-08T18:09:01.059428+0000","last_clean":"2024-05-08T18:09:01.059428+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:09:01.059428+0000","last_undegraded":"2024-05-08T18:09:01.059428+0000","last_fullsized":"2024-05-08T18:09:01.059428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065604+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:09:01.065604+0000","last_peered":"2024-05-08T18:09:01.065604+0000","last_clean":"2024-05-08T18:09:01.065604+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:09:01.065604+0000","last_undegraded":"2024-05-08T18:09:01.065604+0000","last_fullsized":"2024-05-08T18:09:01.065604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842743+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:09:00.842743+0000","last_peered":"2024-05-08T18:09:00.842743+0000","last_clean":"2024-05-08T18:09:00.842743+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:09:00.842743+0000","last_undegraded":"2024-05-08T18:09:00.842743+0000","last_fullsized":"2024-05-08T18:09:00.842743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376735+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:09:00.376735+0000","last_peered":"2024-05-08T18:09:00.376735+0000","last_clean":"2024-05-08T18:09:00.376735+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:09:00.376735+0000","last_undegraded":"2024-05-08T18:09:00.376735+0000","last_fullsized":"2024-05-08T18:09:00.376735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843802+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:09:00.843802+0000","last_peered":"2024-05-08T18:09:00.843802+0000","last_clean":"2024-05-08T18:09:00.843802+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:09:00.843802+0000","last_undegraded":"2024-05-08T18:09:00.843802+0000","last_fullsized":"2024-05-08T18:09:00.843802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065241+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:09:01.065241+0000","last_peered":"2024-05-08T18:09:01.065241+0000","last_clean":"2024-05-08T18:09:01.065241+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:09:01.065241+0000","last_undegraded":"2024-05-08T18:09:01.065241+0000","last_fullsized":"2024-05-08T18:09:01.065241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376186+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:09:00.376186+0000","last_peered":"2024-05-08T18:09:00.376186+0000","last_clean":"2024-05-08T18:09:00.376186+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:09:00.376186+0000","last_undegraded":"2024-05-08T18:09:00.376186+0000","last_fullsized":"2024-05-08T18:09:00.376186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064493+0000","last_change":"2024-05-08T18:07:55.357969+0000","last_active":"2024-05-08T18:09:01.064493+0000","last_peered":"2024-05-08T18:09:01.064493+0000","last_clean":"2024-05-08T18:09:01.064493+0000","last_became_active":"2024-05-08T18:07:55.357205+0000","last_became_peered":"2024-05-08T18:07:55.357205+0000","last_unstale":"2024-05-08T18:09:01.064493+0000","last_undegraded":"2024-05-08T18:09:01.064493+0000","last_fullsized":"2024-05-08T18:09:01.064493+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:04.667292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843604+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:09:00.843604+0000","last_peered":"2024-05-08T18:09:00.843604+0000","last_clean":"2024-05-08T18:09:00.843604+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:09:00.843604+0000","last_undegraded":"2024-05-08T18:09:00.843604+0000","last_fullsized":"2024-05-08T18:09:00.843604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":146,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375865+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:09:00.375865+0000","last_peered":"2024-05-08T18:09:00.375865+0000","last_clean":"2024-05-08T18:09:00.375865+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:09:00.375865+0000","last_undegraded":"2024-05-08T18:09:00.375865+0000","last_fullsized":"2024-05-08T18:09:00.375865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371877+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:09:01.371877+0000","last_peered":"2024-05-08T18:09:01.371877+0000","last_clean":"2024-05-08T18:09:01.371877+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:09:01.371877+0000","last_undegraded":"2024-05-08T18:09:01.371877+0000","last_fullsized":"2024-05-08T18:09:01.371877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376383+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:09:00.376383+0000","last_peered":"2024-05-08T18:09:00.376383+0000","last_clean":"2024-05-08T18:09:00.376383+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:09:00.376383+0000","last_undegraded":"2024-05-08T18:09:00.376383+0000","last_fullsized":"2024-05-08T18:09:00.376383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059098+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:09:01.059098+0000","last_peered":"2024-05-08T18:09:01.059098+0000","last_clean":"2024-05-08T18:09:01.059098+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:09:01.059098+0000","last_undegraded":"2024-05-08T18:09:01.059098+0000","last_fullsized":"2024-05-08T18:09:01.059098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844012+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:09:00.844012+0000","last_peered":"2024-05-08T18:09:00.844012+0000","last_clean":"2024-05-08T18:09:00.844012+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:09:00.844012+0000","last_undegraded":"2024-05-08T18:09:00.844012+0000","last_fullsized":"2024-05-08T18:09:00.844012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063106+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:09:01.063106+0000","last_peered":"2024-05-08T18:09:01.063106+0000","last_clean":"2024-05-08T18:09:01.063106+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:09:01.063106+0000","last_undegraded":"2024-05-08T18:09:01.063106+0000","last_fullsized":"2024-05-08T18:09:01.063106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064810+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:09:01.064810+0000","last_peered":"2024-05-08T18:09:01.064810+0000","last_clean":"2024-05-08T18:09:01.064810+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:09:01.064810+0000","last_undegraded":"2024-05-08T18:09:01.064810+0000","last_fullsized":"2024-05-08T18:09:01.064810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063044+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:09:01.063044+0000","last_peered":"2024-05-08T18:09:01.063044+0000","last_clean":"2024-05-08T18:09:01.063044+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:09:01.063044+0000","last_undegraded":"2024-05-08T18:09:01.063044+0000","last_fullsized":"2024-05-08T18:09:01.063044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844962+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:09:00.844962+0000","last_peered":"2024-05-08T18:09:00.844962+0000","last_clean":"2024-05-08T18:09:00.844962+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:09:00.844962+0000","last_undegraded":"2024-05-08T18:09:00.844962+0000","last_fullsized":"2024-05-08T18:09:00.844962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845453+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:09:00.845453+0000","last_peered":"2024-05-08T18:09:00.845453+0000","last_clean":"2024-05-08T18:09:00.845453+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:09:00.845453+0000","last_undegraded":"2024-05-08T18:09:00.845453+0000","last_fullsized":"2024-05-08T18:09:00.845453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844677+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:09:00.844677+0000","last_peered":"2024-05-08T18:09:00.844677+0000","last_clean":"2024-05-08T18:09:00.844677+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:09:00.844677+0000","last_undegraded":"2024-05-08T18:09:00.844677+0000","last_fullsized":"2024-05-08T18:09:00.844677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064333+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:09:01.064333+0000","last_peered":"2024-05-08T18:09:01.064333+0000","last_clean":"2024-05-08T18:09:01.064333+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:09:01.064333+0000","last_undegraded":"2024-05-08T18:09:01.064333+0000","last_fullsized":"2024-05-08T18:09:01.064333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844314+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:09:00.844314+0000","last_peered":"2024-05-08T18:09:00.844314+0000","last_clean":"2024-05-08T18:09:00.844314+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:09:00.844314+0000","last_undegraded":"2024-05-08T18:09:00.844314+0000","last_fullsized":"2024-05-08T18:09:00.844314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850549+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:09:00.850549+0000","last_peered":"2024-05-08T18:09:00.850549+0000","last_clean":"2024-05-08T18:09:00.850549+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:09:00.850549+0000","last_undegraded":"2024-05-08T18:09:00.850549+0000","last_fullsized":"2024-05-08T18:09:00.850549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853117+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:09:00.853117+0000","last_peered":"2024-05-08T18:09:00.853117+0000","last_clean":"2024-05-08T18:09:00.853117+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:09:00.853117+0000","last_undegraded":"2024-05-08T18:09:00.853117+0000","last_fullsized":"2024-05-08T18:09:00.853117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852359+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:09:00.852359+0000","last_peered":"2024-05-08T18:09:00.852359+0000","last_clean":"2024-05-08T18:09:00.852359+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:09:00.852359+0000","last_undegraded":"2024-05-08T18:09:00.852359+0000","last_fullsized":"2024-05-08T18:09:00.852359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376737+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:09:00.376737+0000","last_peered":"2024-05-08T18:09:00.376737+0000","last_clean":"2024-05-08T18:09:00.376737+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:09:00.376737+0000","last_undegraded":"2024-05-08T18:09:00.376737+0000","last_fullsized":"2024-05-08T18:09:00.376737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063873+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:09:01.063873+0000","last_peered":"2024-05-08T18:09:01.063873+0000","last_clean":"2024-05-08T18:09:01.063873+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:09:01.063873+0000","last_undegraded":"2024-05-08T18:09:01.063873+0000","last_fullsized":"2024-05-08T18:09:01.063873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850786+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:09:00.850786+0000","last_peered":"2024-05-08T18:09:00.850786+0000","last_clean":"2024-05-08T18:09:00.850786+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:09:00.850786+0000","last_undegraded":"2024-05-08T18:09:00.850786+0000","last_fullsized":"2024-05-08T18:09:00.850786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.062962+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:09:01.062962+0000","last_peered":"2024-05-08T18:09:01.062962+0000","last_clean":"2024-05-08T18:09:01.062962+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:09:01.062962+0000","last_undegraded":"2024-05-08T18:09:01.062962+0000","last_fullsized":"2024-05-08T18:09:01.062962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373871+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:09:01.373871+0000","last_peered":"2024-05-08T18:09:01.373871+0000","last_clean":"2024-05-08T18:09:01.373871+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:09:01.373871+0000","last_undegraded":"2024-05-08T18:09:01.373871+0000","last_fullsized":"2024-05-08T18:09:01.373871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060404+0000","last_change":"2024-05-08T18:07:55.356946+0000","last_active":"2024-05-08T18:09:01.060404+0000","last_peered":"2024-05-08T18:09:01.060404+0000","last_clean":"2024-05-08T18:09:01.060404+0000","last_became_active":"2024-05-08T18:07:55.355948+0000","last_became_peered":"2024-05-08T18:07:55.355948+0000","last_unstale":"2024-05-08T18:09:01.060404+0000","last_undegraded":"2024-05-08T18:09:01.060404+0000","last_fullsized":"2024-05-08T18:09:01.060404+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:04.163382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064246+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:09:01.064246+0000","last_peered":"2024-05-08T18:09:01.064246+0000","last_clean":"2024-05-08T18:09:01.064246+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:09:01.064246+0000","last_undegraded":"2024-05-08T18:09:01.064246+0000","last_fullsized":"2024-05-08T18:09:01.064246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.066923+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:09:01.066923+0000","last_peered":"2024-05-08T18:09:01.066923+0000","last_clean":"2024-05-08T18:09:01.066923+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:09:01.066923+0000","last_undegraded":"2024-05-08T18:09:01.066923+0000","last_fullsized":"2024-05-08T18:09:01.066923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060565+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:09:01.060565+0000","last_peered":"2024-05-08T18:09:01.060565+0000","last_clean":"2024-05-08T18:09:01.060565+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:09:01.060565+0000","last_undegraded":"2024-05-08T18:09:01.060565+0000","last_fullsized":"2024-05-08T18:09:01.060565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853947+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:09:00.853947+0000","last_peered":"2024-05-08T18:09:00.853947+0000","last_clean":"2024-05-08T18:09:00.853947+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:09:00.853947+0000","last_undegraded":"2024-05-08T18:09:00.853947+0000","last_fullsized":"2024-05-08T18:09:00.853947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060337+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:09:01.060337+0000","last_peered":"2024-05-08T18:09:01.060337+0000","last_clean":"2024-05-08T18:09:01.060337+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:09:01.060337+0000","last_undegraded":"2024-05-08T18:09:01.060337+0000","last_fullsized":"2024-05-08T18:09:01.060337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061202+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:09:01.061202+0000","last_peered":"2024-05-08T18:09:01.061202+0000","last_clean":"2024-05-08T18:09:01.061202+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:09:01.061202+0000","last_undegraded":"2024-05-08T18:09:01.061202+0000","last_fullsized":"2024-05-08T18:09:01.061202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845695+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:09:00.845695+0000","last_peered":"2024-05-08T18:09:00.845695+0000","last_clean":"2024-05-08T18:09:00.845695+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:09:00.845695+0000","last_undegraded":"2024-05-08T18:09:00.845695+0000","last_fullsized":"2024-05-08T18:09:00.845695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372091+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:09:01.372091+0000","last_peered":"2024-05-08T18:09:01.372091+0000","last_clean":"2024-05-08T18:09:01.372091+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:09:01.372091+0000","last_undegraded":"2024-05-08T18:09:01.372091+0000","last_fullsized":"2024-05-08T18:09:01.372091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064627+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:09:01.064627+0000","last_peered":"2024-05-08T18:09:01.064627+0000","last_clean":"2024-05-08T18:09:01.064627+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:09:01.064627+0000","last_undegraded":"2024-05-08T18:09:01.064627+0000","last_fullsized":"2024-05-08T18:09:01.064627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064391+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:09:01.064391+0000","last_peered":"2024-05-08T18:09:01.064391+0000","last_clean":"2024-05-08T18:09:01.064391+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:09:01.064391+0000","last_undegraded":"2024-05-08T18:09:01.064391+0000","last_fullsized":"2024-05-08T18:09:01.064391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.370828+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:09:01.370828+0000","last_peered":"2024-05-08T18:09:01.370828+0000","last_clean":"2024-05-08T18:09:01.370828+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:09:01.370828+0000","last_undegraded":"2024-05-08T18:09:01.370828+0000","last_fullsized":"2024-05-08T18:09:01.370828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061243+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:09:01.061243+0000","last_peered":"2024-05-08T18:09:01.061243+0000","last_clean":"2024-05-08T18:09:01.061243+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:09:01.061243+0000","last_undegraded":"2024-05-08T18:09:01.061243+0000","last_fullsized":"2024-05-08T18:09:01.061243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059883+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:09:01.059883+0000","last_peered":"2024-05-08T18:09:01.059883+0000","last_clean":"2024-05-08T18:09:01.059883+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:09:01.059883+0000","last_undegraded":"2024-05-08T18:09:01.059883+0000","last_fullsized":"2024-05-08T18:09:01.059883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376771+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:09:00.376771+0000","last_peered":"2024-05-08T18:09:00.376771+0000","last_clean":"2024-05-08T18:09:00.376771+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:09:00.376771+0000","last_undegraded":"2024-05-08T18:09:00.376771+0000","last_fullsized":"2024-05-08T18:09:00.376771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065337+0000","last_change":"2024-05-08T18:07:21.533056+0000","last_active":"2024-05-08T18:09:01.065337+0000","last_peered":"2024-05-08T18:09:01.065337+0000","last_clean":"2024-05-08T18:09:01.065337+0000","last_became_active":"2024-05-08T18:07:21.532184+0000","last_became_peered":"2024-05-08T18:07:21.532184+0000","last_unstale":"2024-05-08T18:09:01.065337+0000","last_undegraded":"2024-05-08T18:09:01.065337+0000","last_fullsized":"2024-05-08T18:09:01.065337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:50.629014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845045+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:09:00.845045+0000","last_peered":"2024-05-08T18:09:00.845045+0000","last_clean":"2024-05-08T18:09:00.845045+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:09:00.845045+0000","last_undegraded":"2024-05-08T18:09:00.845045+0000","last_fullsized":"2024-05-08T18:09:00.845045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059501+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:09:01.059501+0000","last_peered":"2024-05-08T18:09:01.059501+0000","last_clean":"2024-05-08T18:09:01.059501+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:09:01.059501+0000","last_undegraded":"2024-05-08T18:09:01.059501+0000","last_fullsized":"2024-05-08T18:09:01.059501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.374110+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:09:01.374110+0000","last_peered":"2024-05-08T18:09:01.374110+0000","last_clean":"2024-05-08T18:09:01.374110+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:09:01.374110+0000","last_undegraded":"2024-05-08T18:09:01.374110+0000","last_fullsized":"2024-05-08T18:09:01.374110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061023+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:09:01.061023+0000","last_peered":"2024-05-08T18:09:01.061023+0000","last_clean":"2024-05-08T18:09:01.061023+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:09:01.061023+0000","last_undegraded":"2024-05-08T18:09:01.061023+0000","last_fullsized":"2024-05-08T18:09:01.061023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061026+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:09:01.061026+0000","last_peered":"2024-05-08T18:09:01.061026+0000","last_clean":"2024-05-08T18:09:01.061026+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:09:01.061026+0000","last_undegraded":"2024-05-08T18:09:01.061026+0000","last_fullsized":"2024-05-08T18:09:01.061026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":143,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376506+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:09:00.376506+0000","last_peered":"2024-05-08T18:09:00.376506+0000","last_clean":"2024-05-08T18:09:00.376506+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:09:00.376506+0000","last_undegraded":"2024-05-08T18:09:00.376506+0000","last_fullsized":"2024-05-08T18:09:00.376506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844965+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:09:00.844965+0000","last_peered":"2024-05-08T18:09:00.844965+0000","last_clean":"2024-05-08T18:09:00.844965+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:09:00.844965+0000","last_undegraded":"2024-05-08T18:09:00.844965+0000","last_fullsized":"2024-05-08T18:09:00.844965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371799+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:09:01.371799+0000","last_peered":"2024-05-08T18:09:01.371799+0000","last_clean":"2024-05-08T18:09:01.371799+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:09:01.371799+0000","last_undegraded":"2024-05-08T18:09:01.371799+0000","last_fullsized":"2024-05-08T18:09:01.371799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845188+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:09:00.845188+0000","last_peered":"2024-05-08T18:09:00.845188+0000","last_clean":"2024-05-08T18:09:00.845188+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:09:00.845188+0000","last_undegraded":"2024-05-08T18:09:00.845188+0000","last_fullsized":"2024-05-08T18:09:00.845188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":230,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844587+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:09:00.844587+0000","last_peered":"2024-05-08T18:09:00.844587+0000","last_clean":"2024-05-08T18:09:00.844587+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:09:00.844587+0000","last_undegraded":"2024-05-08T18:09:00.844587+0000","last_fullsized":"2024-05-08T18:09:00.844587+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376336+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:09:00.376336+0000","last_peered":"2024-05-08T18:09:00.376336+0000","last_clean":"2024-05-08T18:09:00.376336+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:09:00.376336+0000","last_undegraded":"2024-05-08T18:09:00.376336+0000","last_fullsized":"2024-05-08T18:09:00.376336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064004+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:09:01.064004+0000","last_peered":"2024-05-08T18:09:01.064004+0000","last_clean":"2024-05-08T18:09:01.064004+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:09:01.064004+0000","last_undegraded":"2024-05-08T18:09:01.064004+0000","last_fullsized":"2024-05-08T18:09:01.064004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843389+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:09:00.843389+0000","last_peered":"2024-05-08T18:09:00.843389+0000","last_clean":"2024-05-08T18:09:00.843389+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:09:00.843389+0000","last_undegraded":"2024-05-08T18:09:00.843389+0000","last_fullsized":"2024-05-08T18:09:00.843389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":142,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376993+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:09:00.376993+0000","last_peered":"2024-05-08T18:09:00.376993+0000","last_clean":"2024-05-08T18:09:00.376993+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:09:00.376993+0000","last_undegraded":"2024-05-08T18:09:00.376993+0000","last_fullsized":"2024-05-08T18:09:00.376993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853195+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:09:00.853195+0000","last_peered":"2024-05-08T18:09:00.853195+0000","last_clean":"2024-05-08T18:09:00.853195+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:09:00.853195+0000","last_undegraded":"2024-05-08T18:09:00.853195+0000","last_fullsized":"2024-05-08T18:09:00.853195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842692+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:09:00.842692+0000","last_peered":"2024-05-08T18:09:00.842692+0000","last_clean":"2024-05-08T18:09:00.842692+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:09:00.842692+0000","last_undegraded":"2024-05-08T18:09:00.842692+0000","last_fullsized":"2024-05-08T18:09:00.842692+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853478+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:09:00.853478+0000","last_peered":"2024-05-08T18:09:00.853478+0000","last_clean":"2024-05-08T18:09:00.853478+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:09:00.853478+0000","last_undegraded":"2024-05-08T18:09:00.853478+0000","last_fullsized":"2024-05-08T18:09:00.853478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843318+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:09:00.843318+0000","last_peered":"2024-05-08T18:09:00.843318+0000","last_clean":"2024-05-08T18:09:00.843318+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:09:00.843318+0000","last_undegraded":"2024-05-08T18:09:00.843318+0000","last_fullsized":"2024-05-08T18:09:00.843318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850874+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:09:00.850874+0000","last_peered":"2024-05-08T18:09:00.850874+0000","last_clean":"2024-05-08T18:09:00.850874+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:09:00.850874+0000","last_undegraded":"2024-05-08T18:09:00.850874+0000","last_fullsized":"2024-05-08T18:09:00.850874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.377151+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:09:00.377151+0000","last_peered":"2024-05-08T18:09:00.377151+0000","last_clean":"2024-05-08T18:09:00.377151+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:09:00.377151+0000","last_undegraded":"2024-05-08T18:09:00.377151+0000","last_fullsized":"2024-05-08T18:09:00.377151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":179,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372011+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:09:01.372011+0000","last_peered":"2024-05-08T18:09:01.372011+0000","last_clean":"2024-05-08T18:09:01.372011+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:09:01.372011+0000","last_undegraded":"2024-05-08T18:09:01.372011+0000","last_fullsized":"2024-05-08T18:09:01.372011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843670+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:09:00.843670+0000","last_peered":"2024-05-08T18:09:00.843670+0000","last_clean":"2024-05-08T18:09:00.843670+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:09:00.843670+0000","last_undegraded":"2024-05-08T18:09:00.843670+0000","last_fullsized":"2024-05-08T18:09:00.843670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371210+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:09:01.371210+0000","last_peered":"2024-05-08T18:09:01.371210+0000","last_clean":"2024-05-08T18:09:01.371210+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:09:01.371210+0000","last_undegraded":"2024-05-08T18:09:01.371210+0000","last_fullsized":"2024-05-08T18:09:01.371210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.374184+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:09:01.374184+0000","last_peered":"2024-05-08T18:09:01.374184+0000","last_clean":"2024-05-08T18:09:01.374184+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:09:01.374184+0000","last_undegraded":"2024-05-08T18:09:01.374184+0000","last_fullsized":"2024-05-08T18:09:01.374184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063490+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:09:01.063490+0000","last_peered":"2024-05-08T18:09:01.063490+0000","last_clean":"2024-05-08T18:09:01.063490+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:09:01.063490+0000","last_undegraded":"2024-05-08T18:09:01.063490+0000","last_fullsized":"2024-05-08T18:09:01.063490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.370334+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:09:01.370334+0000","last_peered":"2024-05-08T18:09:01.370334+0000","last_clean":"2024-05-08T18:09:01.370334+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:09:01.370334+0000","last_undegraded":"2024-05-08T18:09:01.370334+0000","last_fullsized":"2024-05-08T18:09:01.370334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064497+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:09:01.064497+0000","last_peered":"2024-05-08T18:09:01.064497+0000","last_clean":"2024-05-08T18:09:01.064497+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:09:01.064497+0000","last_undegraded":"2024-05-08T18:09:01.064497+0000","last_fullsized":"2024-05-08T18:09:01.064497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":157,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844103+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:09:00.844103+0000","last_peered":"2024-05-08T18:09:00.844103+0000","last_clean":"2024-05-08T18:09:00.844103+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:09:00.844103+0000","last_undegraded":"2024-05-08T18:09:00.844103+0000","last_fullsized":"2024-05-08T18:09:00.844103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850615+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:09:00.850615+0000","last_peered":"2024-05-08T18:09:00.850615+0000","last_clean":"2024-05-08T18:09:00.850615+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:09:00.850615+0000","last_undegraded":"2024-05-08T18:09:00.850615+0000","last_fullsized":"2024-05-08T18:09:00.850615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064605+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:09:01.064605+0000","last_peered":"2024-05-08T18:09:01.064605+0000","last_clean":"2024-05-08T18:09:01.064605+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:09:01.064605+0000","last_undegraded":"2024-05-08T18:09:01.064605+0000","last_fullsized":"2024-05-08T18:09:01.064605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372258+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:09:01.372258+0000","last_peered":"2024-05-08T18:09:01.372258+0000","last_clean":"2024-05-08T18:09:01.372258+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:09:01.372258+0000","last_undegraded":"2024-05-08T18:09:01.372258+0000","last_fullsized":"2024-05-08T18:09:01.372258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376297+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:09:00.376297+0000","last_peered":"2024-05-08T18:09:00.376297+0000","last_clean":"2024-05-08T18:09:00.376297+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:09:00.376297+0000","last_undegraded":"2024-05-08T18:09:00.376297+0000","last_fullsized":"2024-05-08T18:09:00.376297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060627+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:09:01.060627+0000","last_peered":"2024-05-08T18:09:01.060627+0000","last_clean":"2024-05-08T18:09:01.060627+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:09:01.060627+0000","last_undegraded":"2024-05-08T18:09:01.060627+0000","last_fullsized":"2024-05-08T18:09:01.060627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852636+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:09:00.852636+0000","last_peered":"2024-05-08T18:09:00.852636+0000","last_clean":"2024-05-08T18:09:00.852636+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:09:00.852636+0000","last_undegraded":"2024-05-08T18:09:00.852636+0000","last_fullsized":"2024-05-08T18:09:00.852636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067671+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:09:01.067671+0000","last_peered":"2024-05-08T18:09:01.067671+0000","last_clean":"2024-05-08T18:09:01.067671+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:09:01.067671+0000","last_undegraded":"2024-05-08T18:09:01.067671+0000","last_fullsized":"2024-05-08T18:09:01.067671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":109,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845620+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:09:00.845620+0000","last_peered":"2024-05-08T18:09:00.845620+0000","last_clean":"2024-05-08T18:09:00.845620+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:09:00.845620+0000","last_undegraded":"2024-05-08T18:09:00.845620+0000","last_fullsized":"2024-05-08T18:09:00.845620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375710+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:09:00.375710+0000","last_peered":"2024-05-08T18:09:00.375710+0000","last_clean":"2024-05-08T18:09:00.375710+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:09:00.375710+0000","last_undegraded":"2024-05-08T18:09:00.375710+0000","last_fullsized":"2024-05-08T18:09:00.375710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371492+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:09:01.371492+0000","last_peered":"2024-05-08T18:09:01.371492+0000","last_clean":"2024-05-08T18:09:01.371492+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:09:01.371492+0000","last_undegraded":"2024-05-08T18:09:01.371492+0000","last_fullsized":"2024-05-08T18:09:01.371492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376996+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:09:00.376996+0000","last_peered":"2024-05-08T18:09:00.376996+0000","last_clean":"2024-05-08T18:09:00.376996+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:09:00.376996+0000","last_undegraded":"2024-05-08T18:09:00.376996+0000","last_fullsized":"2024-05-08T18:09:00.376996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372475+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:09:01.372475+0000","last_peered":"2024-05-08T18:09:01.372475+0000","last_clean":"2024-05-08T18:09:01.372475+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:09:01.372475+0000","last_undegraded":"2024-05-08T18:09:01.372475+0000","last_fullsized":"2024-05-08T18:09:01.372475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851930+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:09:00.851930+0000","last_peered":"2024-05-08T18:09:00.851930+0000","last_clean":"2024-05-08T18:09:00.851930+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:09:00.851930+0000","last_undegraded":"2024-05-08T18:09:00.851930+0000","last_fullsized":"2024-05-08T18:09:00.851930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":147,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850042+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:09:00.850042+0000","last_peered":"2024-05-08T18:09:00.850042+0000","last_clean":"2024-05-08T18:09:00.850042+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:09:00.850042+0000","last_undegraded":"2024-05-08T18:09:00.850042+0000","last_fullsized":"2024-05-08T18:09:00.850042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":113,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.058801+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:09:01.058801+0000","last_peered":"2024-05-08T18:09:01.058801+0000","last_clean":"2024-05-08T18:09:01.058801+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:09:01.058801+0000","last_undegraded":"2024-05-08T18:09:01.058801+0000","last_fullsized":"2024-05-08T18:09:01.058801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852898+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:09:00.852898+0000","last_peered":"2024-05-08T18:09:00.852898+0000","last_clean":"2024-05-08T18:09:00.852898+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:09:00.852898+0000","last_undegraded":"2024-05-08T18:09:00.852898+0000","last_fullsized":"2024-05-08T18:09:00.852898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852282+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:09:00.852282+0000","last_peered":"2024-05-08T18:09:00.852282+0000","last_clean":"2024-05-08T18:09:00.852282+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:09:00.852282+0000","last_undegraded":"2024-05-08T18:09:00.852282+0000","last_fullsized":"2024-05-08T18:09:00.852282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372331+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:09:01.372331+0000","last_peered":"2024-05-08T18:09:01.372331+0000","last_clean":"2024-05-08T18:09:01.372331+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:09:01.372331+0000","last_undegraded":"2024-05-08T18:09:01.372331+0000","last_fullsized":"2024-05-08T18:09:01.372331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845025+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:09:00.845025+0000","last_peered":"2024-05-08T18:09:00.845025+0000","last_clean":"2024-05-08T18:09:00.845025+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:09:00.845025+0000","last_undegraded":"2024-05-08T18:09:00.845025+0000","last_fullsized":"2024-05-08T18:09:00.845025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":118,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845023+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:09:00.845023+0000","last_peered":"2024-05-08T18:09:00.845023+0000","last_clean":"2024-05-08T18:09:00.845023+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:09:00.845023+0000","last_undegraded":"2024-05-08T18:09:00.845023+0000","last_fullsized":"2024-05-08T18:09:00.845023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.370545+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:09:01.370545+0000","last_peered":"2024-05-08T18:09:01.370545+0000","last_clean":"2024-05-08T18:09:01.370545+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:09:01.370545+0000","last_undegraded":"2024-05-08T18:09:01.370545+0000","last_fullsized":"2024-05-08T18:09:01.370545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375932+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:09:00.375932+0000","last_peered":"2024-05-08T18:09:00.375932+0000","last_clean":"2024-05-08T18:09:00.375932+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:09:00.375932+0000","last_undegraded":"2024-05-08T18:09:00.375932+0000","last_fullsized":"2024-05-08T18:09:00.375932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067921+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:09:01.067921+0000","last_peered":"2024-05-08T18:09:01.067921+0000","last_clean":"2024-05-08T18:09:01.067921+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:09:01.067921+0000","last_undegraded":"2024-05-08T18:09:01.067921+0000","last_fullsized":"2024-05-08T18:09:01.067921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060686+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:09:01.060686+0000","last_peered":"2024-05-08T18:09:01.060686+0000","last_clean":"2024-05-08T18:09:01.060686+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:09:01.060686+0000","last_undegraded":"2024-05-08T18:09:01.060686+0000","last_fullsized":"2024-05-08T18:09:01.060686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065476+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:09:01.065476+0000","last_peered":"2024-05-08T18:09:01.065476+0000","last_clean":"2024-05-08T18:09:01.065476+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:09:01.065476+0000","last_undegraded":"2024-05-08T18:09:01.065476+0000","last_fullsized":"2024-05-08T18:09:01.065476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373779+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:09:01.373779+0000","last_peered":"2024-05-08T18:09:01.373779+0000","last_clean":"2024-05-08T18:09:01.373779+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:09:01.373779+0000","last_undegraded":"2024-05-08T18:09:01.373779+0000","last_fullsized":"2024-05-08T18:09:01.373779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":121,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059095+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:09:01.059095+0000","last_peered":"2024-05-08T18:09:01.059095+0000","last_clean":"2024-05-08T18:09:01.059095+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:09:01.059095+0000","last_undegraded":"2024-05-08T18:09:01.059095+0000","last_fullsized":"2024-05-08T18:09:01.059095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059778+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:09:01.059778+0000","last_peered":"2024-05-08T18:09:01.059778+0000","last_clean":"2024-05-08T18:09:01.059778+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:09:01.059778+0000","last_undegraded":"2024-05-08T18:09:01.059778+0000","last_fullsized":"2024-05-08T18:09:01.059778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065123+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:09:01.065123+0000","last_peered":"2024-05-08T18:09:01.065123+0000","last_clean":"2024-05-08T18:09:01.065123+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:09:01.065123+0000","last_undegraded":"2024-05-08T18:09:01.065123+0000","last_fullsized":"2024-05-08T18:09:01.065123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850698+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:09:00.850698+0000","last_peered":"2024-05-08T18:09:00.850698+0000","last_clean":"2024-05-08T18:09:00.850698+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:09:00.850698+0000","last_undegraded":"2024-05-08T18:09:00.850698+0000","last_fullsized":"2024-05-08T18:09:00.850698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059387+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:09:01.059387+0000","last_peered":"2024-05-08T18:09:01.059387+0000","last_clean":"2024-05-08T18:09:01.059387+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:09:01.059387+0000","last_undegraded":"2024-05-08T18:09:01.059387+0000","last_fullsized":"2024-05-08T18:09:01.059387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853675+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:09:00.853675+0000","last_peered":"2024-05-08T18:09:00.853675+0000","last_clean":"2024-05-08T18:09:00.853675+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:09:00.853675+0000","last_undegraded":"2024-05-08T18:09:00.853675+0000","last_fullsized":"2024-05-08T18:09:00.853675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845800+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:09:00.845800+0000","last_peered":"2024-05-08T18:09:00.845800+0000","last_clean":"2024-05-08T18:09:00.845800+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:09:00.845800+0000","last_undegraded":"2024-05-08T18:09:00.845800+0000","last_fullsized":"2024-05-08T18:09:00.845800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060563+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:09:01.060563+0000","last_peered":"2024-05-08T18:09:01.060563+0000","last_clean":"2024-05-08T18:09:01.060563+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:09:01.060563+0000","last_undegraded":"2024-05-08T18:09:01.060563+0000","last_fullsized":"2024-05-08T18:09:01.060563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":152,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843301+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:09:00.843301+0000","last_peered":"2024-05-08T18:09:00.843301+0000","last_clean":"2024-05-08T18:09:00.843301+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:09:00.843301+0000","last_undegraded":"2024-05-08T18:09:00.843301+0000","last_fullsized":"2024-05-08T18:09:00.843301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063774+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:09:01.063774+0000","last_peered":"2024-05-08T18:09:01.063774+0000","last_clean":"2024-05-08T18:09:01.063774+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:09:01.063774+0000","last_undegraded":"2024-05-08T18:09:01.063774+0000","last_fullsized":"2024-05-08T18:09:01.063774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376451+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:09:00.376451+0000","last_peered":"2024-05-08T18:09:00.376451+0000","last_clean":"2024-05-08T18:09:00.376451+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:09:00.376451+0000","last_undegraded":"2024-05-08T18:09:00.376451+0000","last_fullsized":"2024-05-08T18:09:00.376451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853824+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:09:00.853824+0000","last_peered":"2024-05-08T18:09:00.853824+0000","last_clean":"2024-05-08T18:09:00.853824+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:09:00.853824+0000","last_undegraded":"2024-05-08T18:09:00.853824+0000","last_fullsized":"2024-05-08T18:09:00.853824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059879+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:09:01.059879+0000","last_peered":"2024-05-08T18:09:01.059879+0000","last_clean":"2024-05-08T18:09:01.059879+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:09:01.059879+0000","last_undegraded":"2024-05-08T18:09:01.059879+0000","last_fullsized":"2024-05-08T18:09:01.059879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059792+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:09:01.059792+0000","last_peered":"2024-05-08T18:09:01.059792+0000","last_clean":"2024-05-08T18:09:01.059792+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:09:01.059792+0000","last_undegraded":"2024-05-08T18:09:01.059792+0000","last_fullsized":"2024-05-08T18:09:01.059792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371564+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:09:01.371564+0000","last_peered":"2024-05-08T18:09:01.371564+0000","last_clean":"2024-05-08T18:09:01.371564+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:09:01.371564+0000","last_undegraded":"2024-05-08T18:09:01.371564+0000","last_fullsized":"2024-05-08T18:09:01.371564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060195+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:09:01.060195+0000","last_peered":"2024-05-08T18:09:01.060195+0000","last_clean":"2024-05-08T18:09:01.060195+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:09:01.060195+0000","last_undegraded":"2024-05-08T18:09:01.060195+0000","last_fullsized":"2024-05-08T18:09:01.060195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060424+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:09:01.060424+0000","last_peered":"2024-05-08T18:09:01.060424+0000","last_clean":"2024-05-08T18:09:01.060424+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:09:01.060424+0000","last_undegraded":"2024-05-08T18:09:01.060424+0000","last_fullsized":"2024-05-08T18:09:01.060424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067450+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:09:01.067450+0000","last_peered":"2024-05-08T18:09:01.067450+0000","last_clean":"2024-05-08T18:09:01.067450+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:09:01.067450+0000","last_undegraded":"2024-05-08T18:09:01.067450+0000","last_fullsized":"2024-05-08T18:09:01.067450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371418+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:09:01.371418+0000","last_peered":"2024-05-08T18:09:01.371418+0000","last_clean":"2024-05-08T18:09:01.371418+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:09:01.371418+0000","last_undegraded":"2024-05-08T18:09:01.371418+0000","last_fullsized":"2024-05-08T18:09:01.371418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844543+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:09:00.844543+0000","last_peered":"2024-05-08T18:09:00.844543+0000","last_clean":"2024-05-08T18:09:00.844543+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:09:00.844543+0000","last_undegraded":"2024-05-08T18:09:00.844543+0000","last_fullsized":"2024-05-08T18:09:00.844543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064531+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:09:01.064531+0000","last_peered":"2024-05-08T18:09:01.064531+0000","last_clean":"2024-05-08T18:09:01.064531+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:09:01.064531+0000","last_undegraded":"2024-05-08T18:09:01.064531+0000","last_fullsized":"2024-05-08T18:09:01.064531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"48'5","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850180+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:09:00.850180+0000","last_peered":"2024-05-08T18:09:00.850180+0000","last_clean":"2024-05-08T18:09:00.850180+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:09:00.850180+0000","last_undegraded":"2024-05-08T18:09:00.850180+0000","last_fullsized":"2024-05-08T18:09:00.850180+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843956+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:09:00.843956+0000","last_peered":"2024-05-08T18:09:00.843956+0000","last_clean":"2024-05-08T18:09:00.843956+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:09:00.843956+0000","last_undegraded":"2024-05-08T18:09:00.843956+0000","last_fullsized":"2024-05-08T18:09:00.843956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852550+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:09:00.852550+0000","last_peered":"2024-05-08T18:09:00.852550+0000","last_clean":"2024-05-08T18:09:00.852550+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:09:00.852550+0000","last_undegraded":"2024-05-08T18:09:00.852550+0000","last_fullsized":"2024-05-08T18:09:00.852550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063388+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:09:01.063388+0000","last_peered":"2024-05-08T18:09:01.063388+0000","last_clean":"2024-05-08T18:09:01.063388+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:09:01.063388+0000","last_undegraded":"2024-05-08T18:09:01.063388+0000","last_fullsized":"2024-05-08T18:09:01.063388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.377070+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:09:00.377070+0000","last_peered":"2024-05-08T18:09:00.377070+0000","last_clean":"2024-05-08T18:09:00.377070+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:09:00.377070+0000","last_undegraded":"2024-05-08T18:09:00.377070+0000","last_fullsized":"2024-05-08T18:09:00.377070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842876+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:09:00.842876+0000","last_peered":"2024-05-08T18:09:00.842876+0000","last_clean":"2024-05-08T18:09:00.842876+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:09:00.842876+0000","last_undegraded":"2024-05-08T18:09:00.842876+0000","last_fullsized":"2024-05-08T18:09:00.842876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064375+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:09:01.064375+0000","last_peered":"2024-05-08T18:09:01.064375+0000","last_clean":"2024-05-08T18:09:01.064375+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:09:01.064375+0000","last_undegraded":"2024-05-08T18:09:01.064375+0000","last_fullsized":"2024-05-08T18:09:01.064375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844839+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:09:00.844839+0000","last_peered":"2024-05-08T18:09:00.844839+0000","last_clean":"2024-05-08T18:09:00.844839+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:09:00.844839+0000","last_undegraded":"2024-05-08T18:09:00.844839+0000","last_fullsized":"2024-05-08T18:09:00.844839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376399+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:09:00.376399+0000","last_peered":"2024-05-08T18:09:00.376399+0000","last_clean":"2024-05-08T18:09:00.376399+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:09:00.376399+0000","last_undegraded":"2024-05-08T18:09:00.376399+0000","last_fullsized":"2024-05-08T18:09:00.376399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060803+0000","last_change":"2024-05-08T18:07:55.359230+0000","last_active":"2024-05-08T18:09:01.060803+0000","last_peered":"2024-05-08T18:09:01.060803+0000","last_clean":"2024-05-08T18:09:01.060803+0000","last_became_active":"2024-05-08T18:07:55.358047+0000","last_became_peered":"2024-05-08T18:07:55.358047+0000","last_unstale":"2024-05-08T18:09:01.060803+0000","last_undegraded":"2024-05-08T18:09:01.060803+0000","last_fullsized":"2024-05-08T18:09:01.060803+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:52.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.854254+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:09:00.854254+0000","last_peered":"2024-05-08T18:09:00.854254+0000","last_clean":"2024-05-08T18:09:00.854254+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:09:00.854254+0000","last_undegraded":"2024-05-08T18:09:00.854254+0000","last_fullsized":"2024-05-08T18:09:00.854254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":118,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843173+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:09:00.843173+0000","last_peered":"2024-05-08T18:09:00.843173+0000","last_clean":"2024-05-08T18:09:00.843173+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:09:00.843173+0000","last_undegraded":"2024-05-08T18:09:00.843173+0000","last_fullsized":"2024-05-08T18:09:00.843173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843271+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:09:00.843271+0000","last_peered":"2024-05-08T18:09:00.843271+0000","last_clean":"2024-05-08T18:09:00.843271+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:09:00.843271+0000","last_undegraded":"2024-05-08T18:09:00.843271+0000","last_fullsized":"2024-05-08T18:09:00.843271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851626+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:09:00.851626+0000","last_peered":"2024-05-08T18:09:00.851626+0000","last_clean":"2024-05-08T18:09:00.851626+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:09:00.851626+0000","last_undegraded":"2024-05-08T18:09:00.851626+0000","last_fullsized":"2024-05-08T18:09:00.851626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":121,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845712+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:09:00.845712+0000","last_peered":"2024-05-08T18:09:00.845712+0000","last_clean":"2024-05-08T18:09:00.845712+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:09:00.845712+0000","last_undegraded":"2024-05-08T18:09:00.845712+0000","last_fullsized":"2024-05-08T18:09:00.845712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060950+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:09:01.060950+0000","last_peered":"2024-05-08T18:09:01.060950+0000","last_clean":"2024-05-08T18:09:01.060950+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:09:01.060950+0000","last_undegraded":"2024-05-08T18:09:01.060950+0000","last_fullsized":"2024-05-08T18:09:01.060950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":121,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853275+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:09:00.853275+0000","last_peered":"2024-05-08T18:09:00.853275+0000","last_clean":"2024-05-08T18:09:00.853275+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:09:00.853275+0000","last_undegraded":"2024-05-08T18:09:00.853275+0000","last_fullsized":"2024-05-08T18:09:00.853275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372664+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:09:01.372664+0000","last_peered":"2024-05-08T18:09:01.372664+0000","last_clean":"2024-05-08T18:09:01.372664+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:09:01.372664+0000","last_undegraded":"2024-05-08T18:09:01.372664+0000","last_fullsized":"2024-05-08T18:09:01.372664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376482+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:09:00.376482+0000","last_peered":"2024-05-08T18:09:00.376482+0000","last_clean":"2024-05-08T18:09:00.376482+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:09:00.376482+0000","last_undegraded":"2024-05-08T18:09:00.376482+0000","last_fullsized":"2024-05-08T18:09:00.376482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063774+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:09:01.063774+0000","last_peered":"2024-05-08T18:09:01.063774+0000","last_clean":"2024-05-08T18:09:01.063774+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:09:01.063774+0000","last_undegraded":"2024-05-08T18:09:01.063774+0000","last_fullsized":"2024-05-08T18:09:01.063774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853404+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:09:00.853404+0000","last_peered":"2024-05-08T18:09:00.853404+0000","last_clean":"2024-05-08T18:09:00.853404+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:09:00.853404+0000","last_undegraded":"2024-05-08T18:09:00.853404+0000","last_fullsized":"2024-05-08T18:09:00.853404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371115+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:09:01.371115+0000","last_peered":"2024-05-08T18:09:01.371115+0000","last_clean":"2024-05-08T18:09:01.371115+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:09:01.371115+0000","last_undegraded":"2024-05-08T18:09:01.371115+0000","last_fullsized":"2024-05-08T18:09:01.371115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":117,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845644+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:09:00.845644+0000","last_peered":"2024-05-08T18:09:00.845644+0000","last_clean":"2024-05-08T18:09:00.845644+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:09:00.845644+0000","last_undegraded":"2024-05-08T18:09:00.845644+0000","last_fullsized":"2024-05-08T18:09:00.845644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843269+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:09:00.843269+0000","last_peered":"2024-05-08T18:09:00.843269+0000","last_clean":"2024-05-08T18:09:00.843269+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:09:00.843269+0000","last_undegraded":"2024-05-08T18:09:00.843269+0000","last_fullsized":"2024-05-08T18:09:00.843269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372748+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:09:01.372748+0000","last_peered":"2024-05-08T18:09:01.372748+0000","last_clean":"2024-05-08T18:09:01.372748+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:09:01.372748+0000","last_undegraded":"2024-05-08T18:09:01.372748+0000","last_fullsized":"2024-05-08T18:09:01.372748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844529+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:09:00.844529+0000","last_peered":"2024-05-08T18:09:00.844529+0000","last_clean":"2024-05-08T18:09:00.844529+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:09:00.844529+0000","last_undegraded":"2024-05-08T18:09:00.844529+0000","last_fullsized":"2024-05-08T18:09:00.844529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067302+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:09:01.067302+0000","last_peered":"2024-05-08T18:09:01.067302+0000","last_clean":"2024-05-08T18:09:01.067302+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:09:01.067302+0000","last_undegraded":"2024-05-08T18:09:01.067302+0000","last_fullsized":"2024-05-08T18:09:01.067302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060191+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:09:01.060191+0000","last_peered":"2024-05-08T18:09:01.060191+0000","last_clean":"2024-05-08T18:09:01.060191+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:09:01.060191+0000","last_undegraded":"2024-05-08T18:09:01.060191+0000","last_fullsized":"2024-05-08T18:09:01.060191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":121,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060860+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:09:01.060860+0000","last_peered":"2024-05-08T18:09:01.060860+0000","last_clean":"2024-05-08T18:09:01.060860+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:09:01.060860+0000","last_undegraded":"2024-05-08T18:09:01.060860+0000","last_fullsized":"2024-05-08T18:09:01.060860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.068008+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:09:01.068008+0000","last_peered":"2024-05-08T18:09:01.068008+0000","last_clean":"2024-05-08T18:09:01.068008+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:09:01.068008+0000","last_undegraded":"2024-05-08T18:09:01.068008+0000","last_fullsized":"2024-05-08T18:09:01.068008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373382+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:09:01.373382+0000","last_peered":"2024-05-08T18:09:01.373382+0000","last_clean":"2024-05-08T18:09:01.373382+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:09:01.373382+0000","last_undegraded":"2024-05-08T18:09:01.373382+0000","last_fullsized":"2024-05-08T18:09:01.373382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375902+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:09:00.375902+0000","last_peered":"2024-05-08T18:09:00.375902+0000","last_clean":"2024-05-08T18:09:00.375902+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:09:00.375902+0000","last_undegraded":"2024-05-08T18:09:00.375902+0000","last_fullsized":"2024-05-08T18:09:00.375902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.066781+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:09:01.066781+0000","last_peered":"2024-05-08T18:09:01.066781+0000","last_clean":"2024-05-08T18:09:01.066781+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:09:01.066781+0000","last_undegraded":"2024-05-08T18:09:01.066781+0000","last_fullsized":"2024-05-08T18:09:01.066781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851703+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:09:00.851703+0000","last_peered":"2024-05-08T18:09:00.851703+0000","last_clean":"2024-05-08T18:09:00.851703+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:09:00.851703+0000","last_undegraded":"2024-05-08T18:09:00.851703+0000","last_fullsized":"2024-05-08T18:09:00.851703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373006+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:09:01.373006+0000","last_peered":"2024-05-08T18:09:01.373006+0000","last_clean":"2024-05-08T18:09:01.373006+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:09:01.373006+0000","last_undegraded":"2024-05-08T18:09:01.373006+0000","last_fullsized":"2024-05-08T18:09:01.373006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060843+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:09:01.060843+0000","last_peered":"2024-05-08T18:09:01.060843+0000","last_clean":"2024-05-08T18:09:01.060843+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:09:01.060843+0000","last_undegraded":"2024-05-08T18:09:01.060843+0000","last_fullsized":"2024-05-08T18:09:01.060843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845417+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:09:00.845417+0000","last_peered":"2024-05-08T18:09:00.845417+0000","last_clean":"2024-05-08T18:09:00.845417+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:09:00.845417+0000","last_undegraded":"2024-05-08T18:09:00.845417+0000","last_fullsized":"2024-05-08T18:09:00.845417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842893+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:09:00.842893+0000","last_peered":"2024-05-08T18:09:00.842893+0000","last_clean":"2024-05-08T18:09:00.842893+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:09:00.842893+0000","last_undegraded":"2024-05-08T18:09:00.842893+0000","last_fullsized":"2024-05-08T18:09:00.842893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059692+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:09:01.059692+0000","last_peered":"2024-05-08T18:09:01.059692+0000","last_clean":"2024-05-08T18:09:01.059692+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:09:01.059692+0000","last_undegraded":"2024-05-08T18:09:01.059692+0000","last_fullsized":"2024-05-08T18:09:01.059692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376632+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:09:00.376632+0000","last_peered":"2024-05-08T18:09:00.376632+0000","last_clean":"2024-05-08T18:09:00.376632+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:09:00.376632+0000","last_undegraded":"2024-05-08T18:09:00.376632+0000","last_fullsized":"2024-05-08T18:09:00.376632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843596+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:09:00.843596+0000","last_peered":"2024-05-08T18:09:00.843596+0000","last_clean":"2024-05-08T18:09:00.843596+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:09:00.843596+0000","last_undegraded":"2024-05-08T18:09:00.843596+0000","last_fullsized":"2024-05-08T18:09:00.843596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376021+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:09:00.376021+0000","last_peered":"2024-05-08T18:09:00.376021+0000","last_clean":"2024-05-08T18:09:00.376021+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:09:00.376021+0000","last_undegraded":"2024-05-08T18:09:00.376021+0000","last_fullsized":"2024-05-08T18:09:00.376021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.849747+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:09:00.849747+0000","last_peered":"2024-05-08T18:09:00.849747+0000","last_clean":"2024-05-08T18:09:00.849747+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:09:00.849747+0000","last_undegraded":"2024-05-08T18:09:00.849747+0000","last_fullsized":"2024-05-08T18:09:00.849747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844359+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:09:00.844359+0000","last_peered":"2024-05-08T18:09:00.844359+0000","last_clean":"2024-05-08T18:09:00.844359+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:09:00.844359+0000","last_undegraded":"2024-05-08T18:09:00.844359+0000","last_fullsized":"2024-05-08T18:09:00.844359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059931+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:09:01.059931+0000","last_peered":"2024-05-08T18:09:01.059931+0000","last_clean":"2024-05-08T18:09:01.059931+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:09:01.059931+0000","last_undegraded":"2024-05-08T18:09:01.059931+0000","last_fullsized":"2024-05-08T18:09:01.059931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376868+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:09:00.376868+0000","last_peered":"2024-05-08T18:09:00.376868+0000","last_clean":"2024-05-08T18:09:00.376868+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:09:00.376868+0000","last_undegraded":"2024-05-08T18:09:00.376868+0000","last_fullsized":"2024-05-08T18:09:00.376868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376218+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:09:00.376218+0000","last_peered":"2024-05-08T18:09:00.376218+0000","last_clean":"2024-05-08T18:09:00.376218+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:09:00.376218+0000","last_undegraded":"2024-05-08T18:09:00.376218+0000","last_fullsized":"2024-05-08T18:09:00.376218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.849848+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:09:00.849848+0000","last_peered":"2024-05-08T18:09:00.849848+0000","last_clean":"2024-05-08T18:09:00.849848+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:09:00.849848+0000","last_undegraded":"2024-05-08T18:09:00.849848+0000","last_fullsized":"2024-05-08T18:09:00.849848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842918+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:09:00.842918+0000","last_peered":"2024-05-08T18:09:00.842918+0000","last_clean":"2024-05-08T18:09:00.842918+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:09:00.842918+0000","last_undegraded":"2024-05-08T18:09:00.842918+0000","last_fullsized":"2024-05-08T18:09:00.842918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067542+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:09:01.067542+0000","last_peered":"2024-05-08T18:09:01.067542+0000","last_clean":"2024-05-08T18:09:01.067542+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:09:01.067542+0000","last_undegraded":"2024-05-08T18:09:01.067542+0000","last_fullsized":"2024-05-08T18:09:01.067542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063510+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:09:01.063510+0000","last_peered":"2024-05-08T18:09:01.063510+0000","last_clean":"2024-05-08T18:09:01.063510+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:09:01.063510+0000","last_undegraded":"2024-05-08T18:09:01.063510+0000","last_fullsized":"2024-05-08T18:09:01.063510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373308+0000","last_change":"2024-05-08T18:07:55.439856+0000","last_active":"2024-05-08T18:09:01.373308+0000","last_peered":"2024-05-08T18:09:01.373308+0000","last_clean":"2024-05-08T18:09:01.373308+0000","last_became_active":"2024-05-08T18:07:55.439188+0000","last_became_peered":"2024-05-08T18:07:55.439188+0000","last_unstale":"2024-05-08T18:09:01.373308+0000","last_undegraded":"2024-05-08T18:09:01.373308+0000","last_fullsized":"2024-05-08T18:09:01.373308+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:40.273251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":121,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.058614+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:09:01.058614+0000","last_peered":"2024-05-08T18:09:01.058614+0000","last_clean":"2024-05-08T18:09:01.058614+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:09:01.058614+0000","last_undegraded":"2024-05-08T18:09:01.058614+0000","last_fullsized":"2024-05-08T18:09:01.058614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064985+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:09:01.064985+0000","last_peered":"2024-05-08T18:09:01.064985+0000","last_clean":"2024-05-08T18:09:01.064985+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:09:01.064985+0000","last_undegraded":"2024-05-08T18:09:01.064985+0000","last_fullsized":"2024-05-08T18:09:01.064985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":113,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059095+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:09:01.059095+0000","last_peered":"2024-05-08T18:09:01.059095+0000","last_clean":"2024-05-08T18:09:01.059095+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:09:01.059095+0000","last_undegraded":"2024-05-08T18:09:01.059095+0000","last_fullsized":"2024-05-08T18:09:01.059095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843958+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:09:00.843958+0000","last_peered":"2024-05-08T18:09:00.843958+0000","last_clean":"2024-05-08T18:09:00.843958+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:09:00.843958+0000","last_undegraded":"2024-05-08T18:09:00.843958+0000","last_fullsized":"2024-05-08T18:09:00.843958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059057+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:09:01.059057+0000","last_peered":"2024-05-08T18:09:01.059057+0000","last_clean":"2024-05-08T18:09:01.059057+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:09:01.059057+0000","last_undegraded":"2024-05-08T18:09:01.059057+0000","last_fullsized":"2024-05-08T18:09:01.059057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.854179+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:09:00.854179+0000","last_peered":"2024-05-08T18:09:00.854179+0000","last_clean":"2024-05-08T18:09:00.854179+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:09:00.854179+0000","last_undegraded":"2024-05-08T18:09:00.854179+0000","last_fullsized":"2024-05-08T18:09:00.854179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.370641+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:09:01.370641+0000","last_peered":"2024-05-08T18:09:01.370641+0000","last_clean":"2024-05-08T18:09:01.370641+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:09:01.370641+0000","last_undegraded":"2024-05-08T18:09:01.370641+0000","last_fullsized":"2024-05-08T18:09:01.370641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059338+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:09:01.059338+0000","last_peered":"2024-05-08T18:09:01.059338+0000","last_clean":"2024-05-08T18:09:01.059338+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:09:01.059338+0000","last_undegraded":"2024-05-08T18:09:01.059338+0000","last_fullsized":"2024-05-08T18:09:01.059338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851548+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:09:00.851548+0000","last_peered":"2024-05-08T18:09:00.851548+0000","last_clean":"2024-05-08T18:09:00.851548+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:09:00.851548+0000","last_undegraded":"2024-05-08T18:09:00.851548+0000","last_fullsized":"2024-05-08T18:09:00.851548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060935+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:09:01.060935+0000","last_peered":"2024-05-08T18:09:01.060935+0000","last_clean":"2024-05-08T18:09:01.060935+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:09:01.060935+0000","last_undegraded":"2024-05-08T18:09:01.060935+0000","last_fullsized":"2024-05-08T18:09:01.060935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.374036+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:09:01.374036+0000","last_peered":"2024-05-08T18:09:01.374036+0000","last_clean":"2024-05-08T18:09:01.374036+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:09:01.374036+0000","last_undegraded":"2024-05-08T18:09:01.374036+0000","last_fullsized":"2024-05-08T18:09:01.374036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842720+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:09:00.842720+0000","last_peered":"2024-05-08T18:09:00.842720+0000","last_clean":"2024-05-08T18:09:00.842720+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:09:00.842720+0000","last_undegraded":"2024-05-08T18:09:00.842720+0000","last_fullsized":"2024-05-08T18:09:00.842720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373591+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:09:01.373591+0000","last_peered":"2024-05-08T18:09:01.373591+0000","last_clean":"2024-05-08T18:09:01.373591+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:09:01.373591+0000","last_undegraded":"2024-05-08T18:09:01.373591+0000","last_fullsized":"2024-05-08T18:09:01.373591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063374+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:09:01.063374+0000","last_peered":"2024-05-08T18:09:01.063374+0000","last_clean":"2024-05-08T18:09:01.063374+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:09:01.063374+0000","last_undegraded":"2024-05-08T18:09:01.063374+0000","last_fullsized":"2024-05-08T18:09:01.063374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376649+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:09:00.376649+0000","last_peered":"2024-05-08T18:09:00.376649+0000","last_clean":"2024-05-08T18:09:00.376649+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:09:00.376649+0000","last_undegraded":"2024-05-08T18:09:00.376649+0000","last_fullsized":"2024-05-08T18:09:00.376649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376179+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:09:00.376179+0000","last_peered":"2024-05-08T18:09:00.376179+0000","last_clean":"2024-05-08T18:09:00.376179+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:09:00.376179+0000","last_undegraded":"2024-05-08T18:09:00.376179+0000","last_fullsized":"2024-05-08T18:09:00.376179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372401+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:09:01.372401+0000","last_peered":"2024-05-08T18:09:01.372401+0000","last_clean":"2024-05-08T18:09:01.372401+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:09:01.372401+0000","last_undegraded":"2024-05-08T18:09:01.372401+0000","last_fullsized":"2024-05-08T18:09:01.372401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851854+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:09:00.851854+0000","last_peered":"2024-05-08T18:09:00.851854+0000","last_clean":"2024-05-08T18:09:00.851854+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:09:00.851854+0000","last_undegraded":"2024-05-08T18:09:00.851854+0000","last_fullsized":"2024-05-08T18:09:00.851854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064733+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:09:01.064733+0000","last_peered":"2024-05-08T18:09:01.064733+0000","last_clean":"2024-05-08T18:09:01.064733+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:09:01.064733+0000","last_undegraded":"2024-05-08T18:09:01.064733+0000","last_fullsized":"2024-05-08T18:09:01.064733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.068327+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:09:01.068327+0000","last_peered":"2024-05-08T18:09:01.068327+0000","last_clean":"2024-05-08T18:09:01.068327+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:09:01.068327+0000","last_undegraded":"2024-05-08T18:09:01.068327+0000","last_fullsized":"2024-05-08T18:09:01.068327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060189+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:09:01.060189+0000","last_peered":"2024-05-08T18:09:01.060189+0000","last_clean":"2024-05-08T18:09:01.060189+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:09:01.060189+0000","last_undegraded":"2024-05-08T18:09:01.060189+0000","last_fullsized":"2024-05-08T18:09:01.060189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373214+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:09:01.373214+0000","last_peered":"2024-05-08T18:09:01.373214+0000","last_clean":"2024-05-08T18:09:01.373214+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:09:01.373214+0000","last_undegraded":"2024-05-08T18:09:01.373214+0000","last_fullsized":"2024-05-08T18:09:01.373214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063311+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:09:01.063311+0000","last_peered":"2024-05-08T18:09:01.063311+0000","last_clean":"2024-05-08T18:09:01.063311+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:09:01.063311+0000","last_undegraded":"2024-05-08T18:09:01.063311+0000","last_fullsized":"2024-05-08T18:09:01.063311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845502+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:09:00.845502+0000","last_peered":"2024-05-08T18:09:00.845502+0000","last_clean":"2024-05-08T18:09:00.845502+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:09:00.845502+0000","last_undegraded":"2024-05-08T18:09:00.845502+0000","last_fullsized":"2024-05-08T18:09:00.845502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842645+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:09:00.842645+0000","last_peered":"2024-05-08T18:09:00.842645+0000","last_clean":"2024-05-08T18:09:00.842645+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:09:00.842645+0000","last_undegraded":"2024-05-08T18:09:00.842645+0000","last_fullsized":"2024-05-08T18:09:00.842645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067895+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:09:01.067895+0000","last_peered":"2024-05-08T18:09:01.067895+0000","last_clean":"2024-05-08T18:09:01.067895+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:09:01.067895+0000","last_undegraded":"2024-05-08T18:09:01.067895+0000","last_fullsized":"2024-05-08T18:09:01.067895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.854101+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:09:00.854101+0000","last_peered":"2024-05-08T18:09:00.854101+0000","last_clean":"2024-05-08T18:09:00.854101+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:09:00.854101+0000","last_undegraded":"2024-05-08T18:09:00.854101+0000","last_fullsized":"2024-05-08T18:09:00.854101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376335+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:09:00.376335+0000","last_peered":"2024-05-08T18:09:00.376335+0000","last_clean":"2024-05-08T18:09:00.376335+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:09:00.376335+0000","last_undegraded":"2024-05-08T18:09:00.376335+0000","last_fullsized":"2024-05-08T18:09:00.376335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061143+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:09:01.061143+0000","last_peered":"2024-05-08T18:09:01.061143+0000","last_clean":"2024-05-08T18:09:01.061143+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:09:01.061143+0000","last_undegraded":"2024-05-08T18:09:01.061143+0000","last_fullsized":"2024-05-08T18:09:01.061143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063586+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:09:01.063586+0000","last_peered":"2024-05-08T18:09:01.063586+0000","last_clean":"2024-05-08T18:09:01.063586+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:09:01.063586+0000","last_undegraded":"2024-05-08T18:09:01.063586+0000","last_fullsized":"2024-05-08T18:09:01.063586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067087+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:09:01.067087+0000","last_peered":"2024-05-08T18:09:01.067087+0000","last_clean":"2024-05-08T18:09:01.067087+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:09:01.067087+0000","last_undegraded":"2024-05-08T18:09:01.067087+0000","last_fullsized":"2024-05-08T18:09:01.067087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063746+0000","last_change":"2024-05-08T18:07:55.445745+0000","last_active":"2024-05-08T18:09:01.063746+0000","last_peered":"2024-05-08T18:09:01.063746+0000","last_clean":"2024-05-08T18:09:01.063746+0000","last_became_active":"2024-05-08T18:07:55.444935+0000","last_became_peered":"2024-05-08T18:07:55.444935+0000","last_unstale":"2024-05-08T18:09:01.063746+0000","last_undegraded":"2024-05-08T18:09:01.063746+0000","last_fullsized":"2024-05-08T18:09:01.063746+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:37.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060599+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:09:01.060599+0000","last_peered":"2024-05-08T18:09:01.060599+0000","last_clean":"2024-05-08T18:09:01.060599+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:09:01.060599+0000","last_undegraded":"2024-05-08T18:09:01.060599+0000","last_fullsized":"2024-05-08T18:09:01.060599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852006+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:09:00.852006+0000","last_peered":"2024-05-08T18:09:00.852006+0000","last_clean":"2024-05-08T18:09:00.852006+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:09:00.852006+0000","last_undegraded":"2024-05-08T18:09:00.852006+0000","last_fullsized":"2024-05-08T18:09:00.852006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843480+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:09:00.843480+0000","last_peered":"2024-05-08T18:09:00.843480+0000","last_clean":"2024-05-08T18:09:00.843480+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:09:00.843480+0000","last_undegraded":"2024-05-08T18:09:00.843480+0000","last_fullsized":"2024-05-08T18:09:00.843480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845868+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:09:00.845868+0000","last_peered":"2024-05-08T18:09:00.845868+0000","last_clean":"2024-05-08T18:09:00.845868+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:09:00.845868+0000","last_undegraded":"2024-05-08T18:09:00.845868+0000","last_fullsized":"2024-05-08T18:09:00.845868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851060+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:09:00.851060+0000","last_peered":"2024-05-08T18:09:00.851060+0000","last_clean":"2024-05-08T18:09:00.851060+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:09:00.851060+0000","last_undegraded":"2024-05-08T18:09:00.851060+0000","last_fullsized":"2024-05-08T18:09:00.851060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844910+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:09:00.844910+0000","last_peered":"2024-05-08T18:09:00.844910+0000","last_clean":"2024-05-08T18:09:00.844910+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:09:00.844910+0000","last_undegraded":"2024-05-08T18:09:00.844910+0000","last_fullsized":"2024-05-08T18:09:00.844910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063233+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:09:01.063233+0000","last_peered":"2024-05-08T18:09:01.063233+0000","last_clean":"2024-05-08T18:09:01.063233+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:09:01.063233+0000","last_undegraded":"2024-05-08T18:09:01.063233+0000","last_fullsized":"2024-05-08T18:09:01.063233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067263+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:09:01.067263+0000","last_peered":"2024-05-08T18:09:01.067263+0000","last_clean":"2024-05-08T18:09:01.067263+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:09:01.067263+0000","last_undegraded":"2024-05-08T18:09:01.067263+0000","last_fullsized":"2024-05-08T18:09:01.067263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843086+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:09:00.843086+0000","last_peered":"2024-05-08T18:09:00.843086+0000","last_clean":"2024-05-08T18:09:00.843086+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:09:00.843086+0000","last_undegraded":"2024-05-08T18:09:00.843086+0000","last_fullsized":"2024-05-08T18:09:00.843086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.377222+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:09:00.377222+0000","last_peered":"2024-05-08T18:09:00.377222+0000","last_clean":"2024-05-08T18:09:00.377222+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:09:00.377222+0000","last_undegraded":"2024-05-08T18:09:00.377222+0000","last_fullsized":"2024-05-08T18:09:00.377222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376275+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:09:00.376275+0000","last_peered":"2024-05-08T18:09:00.376275+0000","last_clean":"2024-05-08T18:09:00.376275+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:09:00.376275+0000","last_undegraded":"2024-05-08T18:09:00.376275+0000","last_fullsized":"2024-05-08T18:09:00.376275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.854025+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:09:00.854025+0000","last_peered":"2024-05-08T18:09:00.854025+0000","last_clean":"2024-05-08T18:09:00.854025+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:09:00.854025+0000","last_undegraded":"2024-05-08T18:09:00.854025+0000","last_fullsized":"2024-05-08T18:09:00.854025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371000+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:09:01.371000+0000","last_peered":"2024-05-08T18:09:01.371000+0000","last_clean":"2024-05-08T18:09:01.371000+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:09:01.371000+0000","last_undegraded":"2024-05-08T18:09:01.371000+0000","last_fullsized":"2024-05-08T18:09:01.371000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376962+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:09:00.376962+0000","last_peered":"2024-05-08T18:09:00.376962+0000","last_clean":"2024-05-08T18:09:00.376962+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:09:00.376962+0000","last_undegraded":"2024-05-08T18:09:00.376962+0000","last_fullsized":"2024-05-08T18:09:00.376962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28580,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343260,"statfs":{"total":96636764160,"available":96607498240,"internally_reserved":0,"allocated":1593344,"data_stored":1123938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":532474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":534295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":962560,"data_stored":532965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":532870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":532036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":987136,"data_stored":532724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28560,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343280,"statfs":{"total":96636764160,"available":96607518720,"internally_reserved":0,"allocated":1572864,"data_stored":1123344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:09:02.941 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-08T18:09:02.941 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-08T18:09:02.941 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-05-08T18:09:02.941 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-05-08T18:09:02.974 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:02.976+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:03.016 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:03.016 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:03.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:03.016 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:03.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.016 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:09:03.016 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:09:03.016 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 101.466316991, 2024-05-08T18:09:03.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049710090000000002, 2024-05-08T18:09:03.016 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.016 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.017 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-08T18:09:03.017 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.017 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.017 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.017 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 44 2024-05-08T18:09:03.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.017 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:09:03.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:09:03.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552775+0000", 2024-05-08T18:09:03.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4450000000000001e-06 2024-05-08T18:09:03.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552790+0000", 2024-05-08T18:09:03.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4363e-05 2024-05-08T18:09:03.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552820+0000", 2024-05-08T18:09:03.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0485999999999999e-05 2024-05-08T18:09:03.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552843+0000", 2024-05-08T18:09:03.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2985000000000001e-05 2024-05-08T18:09:03.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554350+0000", 2024-05-08T18:09:03.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015065149999999999 2024-05-08T18:09:03.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-08T18:09:03.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554374+0000", 2024-05-08T18:09:03.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4097e-05 2024-05-08T18:09:03.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557531+0000", 2024-05-08T18:09:03.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031567169999999999 2024-05-08T18:09:03.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557743+0000", 2024-05-08T18:09:03.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212401 2024-05-08T18:09:03.020 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.020 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.020 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.021 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:09:03.021 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:09:03.021 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.430965114000003, 2024-05-08T18:09:03.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050241879999999997, 2024-05-08T18:09:03.021 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.021 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.021 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.021 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.021 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.021 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.021 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 58 2024-05-08T18:09:03.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.021 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:09:03.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:09:03.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588125+0000", 2024-05-08T18:09:03.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1399999999999995e-07 2024-05-08T18:09:03.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588129+0000", 2024-05-08T18:09:03.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6779999999999999e-06 2024-05-08T18:09:03.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588142+0000", 2024-05-08T18:09:03.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3047999999999999e-05 2024-05-08T18:09:03.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588174+0000", 2024-05-08T18:09:03.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1270999999999999e-05 2024-05-08T18:09:03.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588307+0000", 2024-05-08T18:09:03.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013307600000000001 2024-05-08T18:09:03.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588477+0000", 2024-05-08T18:09:03.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000170213 2024-05-08T18:09:03.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:03.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588669+0000", 2024-05-08T18:09:03.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019211599999999999 2024-05-08T18:09:03.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.590228+0000", 2024-05-08T18:09:03.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015590059999999999 2024-05-08T18:09:03.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593029+0000", 2024-05-08T18:09:03.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028006400000000001 2024-05-08T18:09:03.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593099+0000", 2024-05-08T18:09:03.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0300000000000001e-05 2024-05-08T18:09:03.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593148+0000", 2024-05-08T18:09:03.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8925999999999999e-05 2024-05-08T18:09:03.026 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.026 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.026 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.026 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:09:03.026 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:09:03.026 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 96.434426954000003, 2024-05-08T18:09:03.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00385587, 2024-05-08T18:09:03.027 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.027 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.027 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.027 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.027 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.027 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.027 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207 2024-05-08T18:09:03.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.027 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:09:03.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:09:03.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584665+0000", 2024-05-08T18:09:03.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0570000000000001e-06 2024-05-08T18:09:03.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584679+0000", 2024-05-08T18:09:03.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3713000000000001e-05 2024-05-08T18:09:03.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584712+0000", 2024-05-08T18:09:03.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3213999999999997e-05 2024-05-08T18:09:03.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584728+0000", 2024-05-08T18:09:03.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5936000000000001e-05 2024-05-08T18:09:03.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584951+0000", 2024-05-08T18:09:03.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000222955 2024-05-08T18:09:03.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585196+0000", 2024-05-08T18:09:03.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024550800000000002 2024-05-08T18:09:03.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:03.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585643+0000", 2024-05-08T18:09:03.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00044644699999999999 2024-05-08T18:09:03.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.587110+0000", 2024-05-08T18:09:03.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001467323 2024-05-08T18:09:03.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588371+0000", 2024-05-08T18:09:03.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012607180000000001 2024-05-08T18:09:03.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588452+0000", 2024-05-08T18:09:03.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1216000000000003e-05 2024-05-08T18:09:03.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588518+0000", 2024-05-08T18:09:03.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5783000000000004e-05 2024-05-08T18:09:03.032 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.032 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.032 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.032 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.032 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:09:03.032 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 96.388251552, 2024-05-08T18:09:03.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003249994, 2024-05-08T18:09:03.032 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.032 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.033 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.033 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.033 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.033 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.033 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 216 2024-05-08T18:09:03.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.033 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:09:03.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630837+0000", 2024-05-08T18:09:03.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630840+0000", 2024-05-08T18:09:03.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0730000000000001e-06 2024-05-08T18:09:03.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630854+0000", 2024-05-08T18:09:03.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3360000000000001e-05 2024-05-08T18:09:03.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630889+0000", 2024-05-08T18:09:03.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5176999999999999e-05 2024-05-08T18:09:03.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.630911+0000", 2024-05-08T18:09:03.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.247e-05 2024-05-08T18:09:03.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631046+0000", 2024-05-08T18:09:03.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013484599999999999 2024-05-08T18:09:03.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631272+0000", 2024-05-08T18:09:03.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000225694 2024-05-08T18:09:03.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:03.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.631703+0000", 2024-05-08T18:09:03.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000431144 2024-05-08T18:09:03.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633244+0000", 2024-05-08T18:09:03.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001540622 2024-05-08T18:09:03.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.633926+0000", 2024-05-08T18:09:03.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068244200000000001 2024-05-08T18:09:03.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634019+0000", 2024-05-08T18:09:03.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3148999999999999e-05 2024-05-08T18:09:03.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.634087+0000", 2024-05-08T18:09:03.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8016999999999996e-05 2024-05-08T18:09:03.037 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.038 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.038 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.038 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.038 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:09:03.038 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 96.346707503000005, 2024-05-08T18:09:03.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003119854, 2024-05-08T18:09:03.038 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.038 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.038 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.038 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.038 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.038 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.038 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 227 2024-05-08T18:09:03.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.039 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:09:03.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672381+0000", 2024-05-08T18:09:03.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672384+0000", 2024-05-08T18:09:03.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7470000000000001e-06 2024-05-08T18:09:03.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672396+0000", 2024-05-08T18:09:03.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.154e-05 2024-05-08T18:09:03.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672427+0000", 2024-05-08T18:09:03.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1676e-05 2024-05-08T18:09:03.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672443+0000", 2024-05-08T18:09:03.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5214e-05 2024-05-08T18:09:03.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672563+0000", 2024-05-08T18:09:03.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120535 2024-05-08T18:09:03.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.672778+0000", 2024-05-08T18:09:03.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021446200000000001 2024-05-08T18:09:03.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:03.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.673205+0000", 2024-05-08T18:09:03.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042750699999999998 2024-05-08T18:09:03.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.674848+0000", 2024-05-08T18:09:03.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016432980000000001 2024-05-08T18:09:03.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675346+0000", 2024-05-08T18:09:03.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00049711999999999998 2024-05-08T18:09:03.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675432+0000", 2024-05-08T18:09:03.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6798999999999993e-05 2024-05-08T18:09:03.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.675501+0000", 2024-05-08T18:09:03.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8955999999999995e-05 2024-05-08T18:09:03.043 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.043 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.043 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.043 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.043 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:09:03.044 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 96.339766716, 2024-05-08T18:09:03.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034322110000000001, 2024-05-08T18:09:03.044 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.044 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.044 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.044 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.044 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.044 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.044 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 229 2024-05-08T18:09:03.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.044 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:09:03.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679322+0000", 2024-05-08T18:09:03.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679325+0000", 2024-05-08T18:09:03.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:09:03.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679339+0000", 2024-05-08T18:09:03.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:09:03.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679370+0000", 2024-05-08T18:09:03.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0280000000000001e-05 2024-05-08T18:09:03.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679385+0000", 2024-05-08T18:09:03.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5026e-05 2024-05-08T18:09:03.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679504+0000", 2024-05-08T18:09:03.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119023 2024-05-08T18:09:03.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.679711+0000", 2024-05-08T18:09:03.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020705499999999999 2024-05-08T18:09:03.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:03.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.680115+0000", 2024-05-08T18:09:03.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040396699999999998 2024-05-08T18:09:03.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.681424+0000", 2024-05-08T18:09:03.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001309387 2024-05-08T18:09:03.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682488+0000", 2024-05-08T18:09:03.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010642519999999999 2024-05-08T18:09:03.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682640+0000", 2024-05-08T18:09:03.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015123599999999999 2024-05-08T18:09:03.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.682754+0000", 2024-05-08T18:09:03.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011482200000000001 2024-05-08T18:09:03.049 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.049 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.049 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.049 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.049 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:09:03.049 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 96.332382507000005, 2024-05-08T18:09:03.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033353329999999998, 2024-05-08T18:09:03.050 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.050 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.050 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.050 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.050 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.050 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.050 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 231 2024-05-08T18:09:03.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.050 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:09:03.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686706+0000", 2024-05-08T18:09:03.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686709+0000", 2024-05-08T18:09:03.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4729999999999999e-06 2024-05-08T18:09:03.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686720+0000", 2024-05-08T18:09:03.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1157e-05 2024-05-08T18:09:03.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686750+0000", 2024-05-08T18:09:03.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0417e-05 2024-05-08T18:09:03.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686765+0000", 2024-05-08T18:09:03.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.487e-05 2024-05-08T18:09:03.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.686872+0000", 2024-05-08T18:09:03.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010703499999999999 2024-05-08T18:09:03.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687085+0000", 2024-05-08T18:09:03.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021279599999999999 2024-05-08T18:09:03.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:03.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.687501+0000", 2024-05-08T18:09:03.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041554 2024-05-08T18:09:03.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.688886+0000", 2024-05-08T18:09:03.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00138565 2024-05-08T18:09:03.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689899+0000", 2024-05-08T18:09:03.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010128190000000001 2024-05-08T18:09:03.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.689978+0000", 2024-05-08T18:09:03.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8490000000000002e-05 2024-05-08T18:09:03.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.690042+0000", 2024-05-08T18:09:03.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4085999999999996e-05 2024-05-08T18:09:03.055 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.055 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.055 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.055 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:394 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.055 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:09:03.055 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 96.275309429999993, 2024-05-08T18:09:03.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034384960000000001, 2024-05-08T18:09:03.055 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.056 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.056 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.056 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.056 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.056 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.056 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 394 2024-05-08T18:09:03.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.056 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:09:03.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:09:03.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743781+0000", 2024-05-08T18:09:03.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3e-06 2024-05-08T18:09:03.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743788+0000", 2024-05-08T18:09:03.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7399999999999998e-06 2024-05-08T18:09:03.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743801+0000", 2024-05-08T18:09:03.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3757000000000001e-05 2024-05-08T18:09:03.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743808+0000", 2024-05-08T18:09:03.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6579999999999996e-06 2024-05-08T18:09:03.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743875+0000", 2024-05-08T18:09:03.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6740000000000001e-05 2024-05-08T18:09:03.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743971+0000", 2024-05-08T18:09:03.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6175000000000007e-05 2024-05-08T18:09:03.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:03.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744100+0000", 2024-05-08T18:09:03.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012954899999999999 2024-05-08T18:09:03.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744863+0000", 2024-05-08T18:09:03.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076300100000000002 2024-05-08T18:09:03.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747089+0000", 2024-05-08T18:09:03.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022258540000000002 2024-05-08T18:09:03.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747162+0000", 2024-05-08T18:09:03.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2632000000000005e-05 2024-05-08T18:09:03.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747218+0000", 2024-05-08T18:09:03.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.609e-05 2024-05-08T18:09:03.061 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.061 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.061 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.061 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:535 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.061 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:09:03.061 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 96.177596352999998, 2024-05-08T18:09:03.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055640899999999998, 2024-05-08T18:09:03.061 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.061 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.061 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.062 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.062 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.062 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.062 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 535 2024-05-08T18:09:03.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.062 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:09:03.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:09:03.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841494+0000", 2024-05-08T18:09:03.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0899999999999999e-06 2024-05-08T18:09:03.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841500+0000", 2024-05-08T18:09:03.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0249999999999999e-06 2024-05-08T18:09:03.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841513+0000", 2024-05-08T18:09:03.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3658e-05 2024-05-08T18:09:03.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841522+0000", 2024-05-08T18:09:03.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3410000000000003e-06 2024-05-08T18:09:03.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841574+0000", 2024-05-08T18:09:03.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2794000000000003e-05 2024-05-08T18:09:03.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841633+0000", 2024-05-08T18:09:03.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8595999999999999e-05 2024-05-08T18:09:03.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:03.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841755+0000", 2024-05-08T18:09:03.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012227399999999999 2024-05-08T18:09:03.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.842349+0000", 2024-05-08T18:09:03.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00059377699999999998 2024-05-08T18:09:03.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.846949+0000", 2024-05-08T18:09:03.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004599723 2024-05-08T18:09:03.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847008+0000", 2024-05-08T18:09:03.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8854999999999998e-05 2024-05-08T18:09:03.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847057+0000", 2024-05-08T18:09:03.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8956999999999999e-05 2024-05-08T18:09:03.067 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.067 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.067 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.067 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:541 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.067 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:09:03.067 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 96.170566823000001, 2024-05-08T18:09:03.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037829790000000001, 2024-05-08T18:09:03.067 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.067 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.067 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.067 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.068 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.068 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.068 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 541 2024-05-08T18:09:03.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.068 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:09:03.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:09:03.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848523+0000", 2024-05-08T18:09:03.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8599999999999997e-07 2024-05-08T18:09:03.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848526+0000", 2024-05-08T18:09:03.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4690000000000002e-06 2024-05-08T18:09:03.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848536+0000", 2024-05-08T18:09:03.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2029999999999998e-06 2024-05-08T18:09:03.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848540+0000", 2024-05-08T18:09:03.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9169999999999997e-06 2024-05-08T18:09:03.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848591+0000", 2024-05-08T18:09:03.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0328000000000003e-05 2024-05-08T18:09:03.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848646+0000", 2024-05-08T18:09:03.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5281999999999997e-05 2024-05-08T18:09:03.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:03.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848759+0000", 2024-05-08T18:09:03.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011278899999999999 2024-05-08T18:09:03.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.849323+0000", 2024-05-08T18:09:03.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056433999999999998 2024-05-08T18:09:03.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852225+0000", 2024-05-08T18:09:03.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029017320000000002 2024-05-08T18:09:03.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852277+0000", 2024-05-08T18:09:03.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2460999999999998e-05 2024-05-08T18:09:03.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852305+0000", 2024-05-08T18:09:03.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7671999999999999e-05 2024-05-08T18:09:03.073 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.073 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.073 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.073 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.073 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:09:03.073 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 96.037419745999998, 2024-05-08T18:09:03.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002973084, 2024-05-08T18:09:03.073 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.073 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.073 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.074 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.074 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.074 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.074 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 703 2024-05-08T18:09:03.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.074 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:09:03.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981669+0000", 2024-05-08T18:09:03.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981672+0000", 2024-05-08T18:09:03.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5799999999999999e-06 2024-05-08T18:09:03.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981683+0000", 2024-05-08T18:09:03.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1270000000000001e-05 2024-05-08T18:09:03.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981715+0000", 2024-05-08T18:09:03.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1470000000000002e-05 2024-05-08T18:09:03.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981730+0000", 2024-05-08T18:09:03.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5262999999999999e-05 2024-05-08T18:09:03.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.981864+0000", 2024-05-08T18:09:03.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134043 2024-05-08T18:09:03.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982168+0000", 2024-05-08T18:09:03.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030453799999999998 2024-05-08T18:09:03.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:03.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.982620+0000", 2024-05-08T18:09:03.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045170900000000001 2024-05-08T18:09:03.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.983648+0000", 2024-05-08T18:09:03.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010276009999999999 2024-05-08T18:09:03.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984486+0000", 2024-05-08T18:09:03.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083874600000000002 2024-05-08T18:09:03.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984571+0000", 2024-05-08T18:09:03.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4370999999999996e-05 2024-05-08T18:09:03.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.984642+0000", 2024-05-08T18:09:03.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1493000000000001e-05 2024-05-08T18:09:03.078 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.078 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.079 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.079 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:789 6.0 e32/26 6:0216b5b6:::obj_delete_at_hint.0000000070:head v 32'14, mlcod=32'12)", 2024-05-08T18:09:03.079 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:09:03.079 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.837992972999999, 2024-05-08T18:09:03.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034621420000000001, 2024-05-08T18:09:03.079 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.079 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.079 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.079 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:09:03.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:09:03.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181098+0000", 2024-05-08T18:09:03.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8029999999999999e-06 2024-05-08T18:09:03.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181109+0000", 2024-05-08T18:09:03.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1219999999999999e-05 2024-05-08T18:09:03.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181138+0000", 2024-05-08T18:09:03.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.898e-05 2024-05-08T18:09:03.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181151+0000", 2024-05-08T18:09:03.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.308e-05 2024-05-08T18:09:03.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181268+0000", 2024-05-08T18:09:03.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116629 2024-05-08T18:09:03.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181321+0000", 2024-05-08T18:09:03.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3325999999999997e-05 2024-05-08T18:09:03.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184477+0000", 2024-05-08T18:09:03.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003156458 2024-05-08T18:09:03.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184558+0000", 2024-05-08T18:09:03.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0646e-05 2024-05-08T18:09:03.083 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.083 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.083 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.083 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.083 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:09:03.083 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.806819469000004, 2024-05-08T18:09:03.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031146310000000001, 2024-05-08T18:09:03.084 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.084 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.084 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.084 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.084 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.084 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.084 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 802 2024-05-08T18:09:03.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.084 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:09:03.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212269+0000", 2024-05-08T18:09:03.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212272+0000", 2024-05-08T18:09:03.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.943e-06 2024-05-08T18:09:03.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212284+0000", 2024-05-08T18:09:03.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1747e-05 2024-05-08T18:09:03.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212315+0000", 2024-05-08T18:09:03.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0579e-05 2024-05-08T18:09:03.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212336+0000", 2024-05-08T18:09:03.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1639999999999999e-05 2024-05-08T18:09:03.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212488+0000", 2024-05-08T18:09:03.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151192 2024-05-08T18:09:03.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.212703+0000", 2024-05-08T18:09:03.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000215439 2024-05-08T18:09:03.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:03.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.213033+0000", 2024-05-08T18:09:03.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032992699999999999 2024-05-08T18:09:03.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.214306+0000", 2024-05-08T18:09:03.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012726949999999999 2024-05-08T18:09:03.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215232+0000", 2024-05-08T18:09:03.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092652999999999995 2024-05-08T18:09:03.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215321+0000", 2024-05-08T18:09:03.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9272999999999997e-05 2024-05-08T18:09:03.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.215384+0000", 2024-05-08T18:09:03.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2665999999999999e-05 2024-05-08T18:09:03.089 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.089 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.089 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.089 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.089 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:09:03.089 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.726275063000003, 2024-05-08T18:09:03.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030150250000000002, 2024-05-08T18:09:03.089 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.090 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.090 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.090 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.090 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.090 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.090 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 838 2024-05-08T18:09:03.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.090 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:09:03.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292814+0000", 2024-05-08T18:09:03.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292816+0000", 2024-05-08T18:09:03.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:09:03.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292828+0000", 2024-05-08T18:09:03.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.184e-05 2024-05-08T18:09:03.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292857+0000", 2024-05-08T18:09:03.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8960000000000001e-05 2024-05-08T18:09:03.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.292871+0000", 2024-05-08T18:09:03.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.45e-05 2024-05-08T18:09:03.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293000+0000", 2024-05-08T18:09:03.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128875 2024-05-08T18:09:03.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293231+0000", 2024-05-08T18:09:03.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023030500000000001 2024-05-08T18:09:03.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:03.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.293563+0000", 2024-05-08T18:09:03.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000332648 2024-05-08T18:09:03.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.294882+0000", 2024-05-08T18:09:03.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001319183 2024-05-08T18:09:03.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295664+0000", 2024-05-08T18:09:03.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000781991 2024-05-08T18:09:03.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295754+0000", 2024-05-08T18:09:03.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9176000000000001e-05 2024-05-08T18:09:03.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.295829+0000", 2024-05-08T18:09:03.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.525e-05 2024-05-08T18:09:03.095 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.095 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.095 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.095 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.095 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:09:03.095 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.665141394000003, 2024-05-08T18:09:03.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029338929999999999, 2024-05-08T18:09:03.096 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.096 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.096 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.096 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.096 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.096 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.096 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 865 2024-05-08T18:09:03.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.096 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:09:03.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353948+0000", 2024-05-08T18:09:03.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353950+0000", 2024-05-08T18:09:03.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2469999999999998e-06 2024-05-08T18:09:03.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353961+0000", 2024-05-08T18:09:03.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1523e-05 2024-05-08T18:09:03.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.353991+0000", 2024-05-08T18:09:03.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9920000000000002e-05 2024-05-08T18:09:03.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354013+0000", 2024-05-08T18:09:03.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1590000000000002e-05 2024-05-08T18:09:03.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354206+0000", 2024-05-08T18:09:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019273900000000001 2024-05-08T18:09:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354418+0000", 2024-05-08T18:09:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212518 2024-05-08T18:09:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.354720+0000", 2024-05-08T18:09:03.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030151800000000002 2024-05-08T18:09:03.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.355983+0000", 2024-05-08T18:09:03.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012636780000000001 2024-05-08T18:09:03.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356733+0000", 2024-05-08T18:09:03.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074988400000000003 2024-05-08T18:09:03.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356819+0000", 2024-05-08T18:09:03.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5690000000000001e-05 2024-05-08T18:09:03.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.356881+0000", 2024-05-08T18:09:03.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2586e-05 2024-05-08T18:09:03.101 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.101 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.101 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.101 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.101 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:09:03.101 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.652018029000004, 2024-05-08T18:09:03.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004954511, 2024-05-08T18:09:03.102 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.102 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.102 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.102 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.102 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.102 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.102 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 871 2024-05-08T18:09:03.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.102 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:09:03.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:09:03.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367073+0000", 2024-05-08T18:09:03.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2340000000000001e-06 2024-05-08T18:09:03.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367085+0000", 2024-05-08T18:09:03.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1483e-05 2024-05-08T18:09:03.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367111+0000", 2024-05-08T18:09:03.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5890000000000001e-05 2024-05-08T18:09:03.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367130+0000", 2024-05-08T18:09:03.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9700000000000001e-05 2024-05-08T18:09:03.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367284+0000", 2024-05-08T18:09:03.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015411799999999999 2024-05-08T18:09:03.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367516+0000", 2024-05-08T18:09:03.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000231272 2024-05-08T18:09:03.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:03.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367837+0000", 2024-05-08T18:09:03.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032173400000000001 2024-05-08T18:09:03.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371395+0000", 2024-05-08T18:09:03.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035574719999999999 2024-05-08T18:09:03.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371882+0000", 2024-05-08T18:09:03.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048693899999999998 2024-05-08T18:09:03.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371962+0000", 2024-05-08T18:09:03.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.975e-05 2024-05-08T18:09:03.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372025+0000", 2024-05-08T18:09:03.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3918999999999996e-05 2024-05-08T18:09:03.107 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.107 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.107 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.107 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.107 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:09:03.107 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.646130325000001, 2024-05-08T18:09:03.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045233640000000002, 2024-05-08T18:09:03.107 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.108 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.108 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.108 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.108 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.108 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.108 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 873 2024-05-08T18:09:03.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.108 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:09:03.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:09:03.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372961+0000", 2024-05-08T18:09:03.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:09:03.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372969+0000", 2024-05-08T18:09:03.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2940000000000006e-06 2024-05-08T18:09:03.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372991+0000", 2024-05-08T18:09:03.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1829000000000001e-05 2024-05-08T18:09:03.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373009+0000", 2024-05-08T18:09:03.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8607e-05 2024-05-08T18:09:03.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373127+0000", 2024-05-08T18:09:03.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011728899999999999 2024-05-08T18:09:03.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373260+0000", 2024-05-08T18:09:03.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013301200000000001 2024-05-08T18:09:03.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:03.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373526+0000", 2024-05-08T18:09:03.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026613500000000003 2024-05-08T18:09:03.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.374558+0000", 2024-05-08T18:09:03.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001032156 2024-05-08T18:09:03.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377333+0000", 2024-05-08T18:09:03.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027749329999999998 2024-05-08T18:09:03.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377421+0000", 2024-05-08T18:09:03.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8679999999999998e-05 2024-05-08T18:09:03.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377482+0000", 2024-05-08T18:09:03.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0538999999999998e-05 2024-05-08T18:09:03.113 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.113 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.113 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.113 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.113 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:09:03.113 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.586521171000001, 2024-05-08T18:09:03.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035261009999999998, 2024-05-08T18:09:03.113 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.114 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.114 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.114 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.114 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.114 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.114 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 898 2024-05-08T18:09:03.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.114 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:09:03.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:09:03.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432570+0000", 2024-05-08T18:09:03.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.26e-06 2024-05-08T18:09:03.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432580+0000", 2024-05-08T18:09:03.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8570000000000007e-06 2024-05-08T18:09:03.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432605+0000", 2024-05-08T18:09:03.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5273e-05 2024-05-08T18:09:03.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432618+0000", 2024-05-08T18:09:03.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2999999999999999e-05 2024-05-08T18:09:03.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432742+0000", 2024-05-08T18:09:03.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012369200000000001 2024-05-08T18:09:03.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433109+0000", 2024-05-08T18:09:03.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036760500000000002 2024-05-08T18:09:03.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:03.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433645+0000", 2024-05-08T18:09:03.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053599599999999996 2024-05-08T18:09:03.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435050+0000", 2024-05-08T18:09:03.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001404696 2024-05-08T18:09:03.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435834+0000", 2024-05-08T18:09:03.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078381100000000003 2024-05-08T18:09:03.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435984+0000", 2024-05-08T18:09:03.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015006899999999999 2024-05-08T18:09:03.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.436094+0000", 2024-05-08T18:09:03.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109842 2024-05-08T18:09:03.119 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.119 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.119 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.119 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.119 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:09:03.119 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.581768322000002, 2024-05-08T18:09:03.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031481899999999999, 2024-05-08T18:09:03.119 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.119 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.120 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.120 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.120 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.120 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.120 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 900 2024-05-08T18:09:03.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.120 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:09:03.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437321+0000", 2024-05-08T18:09:03.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437323+0000", 2024-05-08T18:09:03.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.447e-06 2024-05-08T18:09:03.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437334+0000", 2024-05-08T18:09:03.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0835999999999999e-05 2024-05-08T18:09:03.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437364+0000", 2024-05-08T18:09:03.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0463999999999998e-05 2024-05-08T18:09:03.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437379+0000", 2024-05-08T18:09:03.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4806e-05 2024-05-08T18:09:03.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437500+0000", 2024-05-08T18:09:03.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121309 2024-05-08T18:09:03.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.437729+0000", 2024-05-08T18:09:03.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022818200000000001 2024-05-08T18:09:03.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:03.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.438199+0000", 2024-05-08T18:09:03.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047025300000000001 2024-05-08T18:09:03.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.439418+0000", 2024-05-08T18:09:03.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012193849999999999 2024-05-08T18:09:03.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440217+0000", 2024-05-08T18:09:03.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00079905999999999998 2024-05-08T18:09:03.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440352+0000", 2024-05-08T18:09:03.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013485299999999999 2024-05-08T18:09:03.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.440469+0000", 2024-05-08T18:09:03.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116595 2024-05-08T18:09:03.124 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.125 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.125 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.125 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.125 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:09:03.125 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 95.495532316999999, 2024-05-08T18:09:03.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003477894, 2024-05-08T18:09:03.125 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:03.125 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:03.125 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.125 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:03.125 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:03.125 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.125 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 937 2024-05-08T18:09:03.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.126 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:03.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:03.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:09:03.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:03.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:09:03.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:03.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:03.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523559+0000", 2024-05-08T18:09:03.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.95e-06 2024-05-08T18:09:03.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:03.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523567+0000", 2024-05-08T18:09:03.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6799999999999999e-06 2024-05-08T18:09:03.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:03.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523591+0000", 2024-05-08T18:09:03.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3269e-05 2024-05-08T18:09:03.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523611+0000", 2024-05-08T18:09:03.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0100000000000001e-05 2024-05-08T18:09:03.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:03.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523767+0000", 2024-05-08T18:09:03.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015604900000000001 2024-05-08T18:09:03.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:03.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523994+0000", 2024-05-08T18:09:03.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022764199999999999 2024-05-08T18:09:03.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:03.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.524338+0000", 2024-05-08T18:09:03.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034388700000000002 2024-05-08T18:09:03.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:03.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.525707+0000", 2024-05-08T18:09:03.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001368544 2024-05-08T18:09:03.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526843+0000", 2024-05-08T18:09:03.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001136501 2024-05-08T18:09:03.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:03.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526957+0000", 2024-05-08T18:09:03.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011359 2024-05-08T18:09:03.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:03.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.527035+0000", 2024-05-08T18:09:03.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7682000000000006e-05 2024-05-08T18:09:03.130 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.130 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.130 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.130 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.130 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.131 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:03.132 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:09:03.133 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-05-08T18:09:03.133 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:03.133+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:03.233 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:03.232+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:03.264 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:03.264 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:03.268 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:09:03.268 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:03.268 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 83, 2024-05-08T18:09:03.268 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "0d8284a2-bb69-4df9-9f45-9ef5b469ca40", 2024-05-08T18:09:03.268 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2024-05-08T18:06:48.916680+0000", 2024-05-08T18:09:03.268 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2024-05-08T18:09:03.071473+0000", 2024-05-08T18:09:03.268 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2024-05-08T18:07:00.796481+0000", 2024-05-08T18:09:03.268 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2024-05-08T18:06:51.530709+0000", 2024-05-08T18:09:03.268 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-05-08T18:09:03.268 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5806080, 2024-05-08T18:09:03.269 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2024-05-08T18:09:03.269 INFO:teuthology.orchestra.run.smithi080.stdout: "nodeep-scrub", 2024-05-08T18:09:03.269 INFO:teuthology.orchestra.run.smithi080.stdout: "noscrub", 2024-05-08T18:09:03.269 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2024-05-08T18:09:03.269 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2024-05-08T18:09:03.269 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2024-05-08T18:09:03.269 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2024-05-08T18:09:03.269 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-05-08T18:09:03.269 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 4, 2024-05-08T18:09:03.269 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2024-05-08T18:09:03.269 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-05-08T18:09:03.269 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2024-05-08T18:09:03.269 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2024-05-08T18:09:03.269 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 8, 2024-05-08T18:09:03.269 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2024-05-08T18:09:03.270 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "luminous", 2024-05-08T18:09:03.270 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "luminous", 2024-05-08T18:09:03.270 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "squid", 2024-05-08T18:09:03.270 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_crimson": false, 2024-05-08T18:09:03.270 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2024-05-08T18:09:03.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.270 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2024-05-08T18:09:03.270 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": ".mgr", 2024-05-08T18:09:03.270 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:01.699859+0000", 2024-05-08T18:09:03.270 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:09:03.270 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:09:03.270 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:09:03.270 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:09:03.270 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:09:03.271 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:09:03.271 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:09:03.271 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:09:03.271 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:09:03.271 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:09:03.271 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:09:03.271 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:09:03.271 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 1, 2024-05-08T18:09:03.271 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 1, 2024-05-08T18:09:03.271 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 1, 2024-05-08T18:09:03.271 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 1, 2024-05-08T18:09:03.271 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 1, 2024-05-08T18:09:03.271 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:09:03.271 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:09:03.272 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:09:03.272 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:09:03.272 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:09:03.272 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:09:03.272 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:09:03.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.272 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "16", 2024-05-08T18:09:03.272 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:09:03.272 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:09:03.272 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:09:03.272 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:09:03.272 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:09:03.272 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:09:03.273 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:09:03.273 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:09:03.273 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:09:03.273 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:09:03.273 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:09:03.273 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:09:03.273 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:09:03.273 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:09:03.273 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:09:03.273 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:09:03.273 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:09:03.273 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:09:03.273 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:09:03.273 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:09:03.274 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:09:03.274 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:09:03.274 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:09:03.274 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:09:03.274 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:09:03.274 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:09:03.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.274 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:09:03.274 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:09:03.274 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:09:03.274 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:09:03.274 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:09:03.274 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:09:03.274 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:09:03.275 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:09:03.275 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:09:03.275 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:09:03.275 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:09:03.275 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-05-08T18:09:03.275 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_max": 32, 2024-05-08T18:09:03.275 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 1 2024-05-08T18:09:03.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.275 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:09:03.275 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": {} 2024-05-08T18:09:03.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.275 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:09:03.275 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:09:03.275 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 8, 2024-05-08T18:09:03.276 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 8, 2024-05-08T18:09:03.276 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 0.25, 2024-05-08T18:09:03.276 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 2, 2024-05-08T18:09:03.276 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 2, 2024-05-08T18:09:03.276 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:09:03.276 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:09:03.276 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:09:03.276 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.276 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 2, 2024-05-08T18:09:03.276 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2024-05-08T18:09:03.276 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:07.479756+0000", 2024-05-08T18:09:03.276 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:09:03.277 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:09:03.277 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:09:03.277 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:09:03.277 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:09:03.277 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:09:03.277 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:09:03.277 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:09:03.277 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:09:03.277 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:09:03.277 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:09:03.277 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:09:03.277 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2024-05-08T18:09:03.277 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2024-05-08T18:09:03.277 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2024-05-08T18:09:03.277 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2024-05-08T18:09:03.278 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2024-05-08T18:09:03.278 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:09:03.278 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:09:03.278 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:09:03.278 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:09:03.278 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:09:03.278 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:09:03.278 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:09:03.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.278 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "19", 2024-05-08T18:09:03.278 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:09:03.278 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:09:03.278 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:09:03.278 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:09:03.279 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:09:03.279 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:09:03.279 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:09:03.279 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:09:03.279 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:09:03.279 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:09:03.279 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:09:03.279 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:09:03.279 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:09:03.279 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:09:03.279 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:09:03.279 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:09:03.279 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:09:03.280 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:09:03.280 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:09:03.280 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:09:03.280 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:09:03.280 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:09:03.280 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:09:03.280 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:09:03.280 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:09:03.280 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:09:03.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.280 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:09:03.280 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:09:03.280 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:09:03.280 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:09:03.280 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:09:03.281 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:09:03.281 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:09:03.281 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:09:03.281 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:09:03.281 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:09:03.281 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:09:03.281 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:09:03.281 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:09:03.281 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2024-05-08T18:09:03.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.281 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:09:03.281 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:09:03.281 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.9900000095367432, 2024-05-08T18:09:03.281 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.9900000095367432, 2024-05-08T18:09:03.282 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 0.87999999523162842, 2024-05-08T18:09:03.282 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.75, 2024-05-08T18:09:03.282 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.75, 2024-05-08T18:09:03.282 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:09:03.282 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:09:03.282 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:09:03.282 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.282 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 3, 2024-05-08T18:09:03.282 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.buckets.data", 2024-05-08T18:09:03.282 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:14.110093+0000", 2024-05-08T18:09:03.282 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:09:03.283 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:09:03.283 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:09:03.283 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:09:03.283 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:09:03.283 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:09:03.283 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:09:03.283 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:09:03.283 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:09:03.283 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:09:03.283 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:09:03.283 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:09:03.283 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 64, 2024-05-08T18:09:03.283 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 64, 2024-05-08T18:09:03.284 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 64, 2024-05-08T18:09:03.284 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 64, 2024-05-08T18:09:03.284 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 64, 2024-05-08T18:09:03.284 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:09:03.284 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:09:03.284 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:09:03.284 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:09:03.284 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:09:03.284 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:09:03.284 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:09:03.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.284 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "22", 2024-05-08T18:09:03.285 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:09:03.285 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:09:03.285 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:09:03.285 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:09:03.285 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:09:03.285 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:09:03.285 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:09:03.285 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:09:03.285 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:09:03.285 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:09:03.285 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:09:03.285 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:09:03.285 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:09:03.286 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:09:03.286 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:09:03.286 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:09:03.286 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:09:03.286 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:09:03.286 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:09:03.286 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:09:03.286 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:09:03.286 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:09:03.286 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:09:03.286 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:09:03.286 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:09:03.286 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:09:03.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.287 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:09:03.287 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:09:03.287 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:09:03.287 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:09:03.287 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:09:03.287 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:09:03.287 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:09:03.287 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:09:03.287 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:09:03.287 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:09:03.287 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:09:03.287 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:09:03.287 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:09:03.287 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:09:03.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.288 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:09:03.288 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:09:03.288 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.25, 2024-05-08T18:09:03.288 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.25, 2024-05-08T18:09:03.288 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:09:03.288 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.25, 2024-05-08T18:09:03.288 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.25, 2024-05-08T18:09:03.288 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:09:03.288 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:09:03.288 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:09:03.288 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.288 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 4, 2024-05-08T18:09:03.289 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.buckets.index", 2024-05-08T18:09:03.289 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:15.798248+0000", 2024-05-08T18:09:03.289 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:09:03.289 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:09:03.289 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:09:03.289 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:09:03.289 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:09:03.289 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:09:03.289 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:09:03.289 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:09:03.289 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:09:03.289 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:09:03.289 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:09:03.289 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:09:03.290 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 64, 2024-05-08T18:09:03.290 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 64, 2024-05-08T18:09:03.290 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 64, 2024-05-08T18:09:03.290 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 64, 2024-05-08T18:09:03.290 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 64, 2024-05-08T18:09:03.290 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:09:03.290 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:09:03.290 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:09:03.290 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:09:03.290 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:09:03.290 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:09:03.290 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:09:03.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.290 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "24", 2024-05-08T18:09:03.290 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:09:03.291 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:09:03.291 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:09:03.291 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:09:03.291 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:09:03.291 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:09:03.291 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:09:03.291 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:09:03.291 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:09:03.291 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:09:03.291 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:09:03.291 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:09:03.291 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:09:03.291 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:09:03.291 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:09:03.292 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:09:03.292 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:09:03.292 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:09:03.292 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:09:03.292 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:09:03.292 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:09:03.292 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:09:03.292 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:09:03.292 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:09:03.292 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:09:03.292 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:09:03.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.292 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:09:03.292 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:09:03.293 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:09:03.293 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:09:03.293 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:09:03.293 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:09:03.293 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:09:03.293 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:09:03.293 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:09:03.293 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:09:03.293 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:09:03.293 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:09:03.293 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:09:03.293 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:09:03.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.293 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:09:03.293 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:09:03.294 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 2, 2024-05-08T18:09:03.294 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 2, 2024-05-08T18:09:03.294 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:09:03.294 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 2, 2024-05-08T18:09:03.294 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 2, 2024-05-08T18:09:03.294 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:09:03.294 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:09:03.294 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:09:03.294 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.294 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 5, 2024-05-08T18:09:03.294 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": ".rgw.root", 2024-05-08T18:09:03.294 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:17.763573+0000", 2024-05-08T18:09:03.295 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:09:03.295 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:09:03.295 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:09:03.295 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:09:03.295 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:09:03.295 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:09:03.295 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:09:03.295 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:09:03.295 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:09:03.295 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:09:03.295 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:09:03.295 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:09:03.295 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-05-08T18:09:03.295 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-05-08T18:09:03.296 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-05-08T18:09:03.296 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-05-08T18:09:03.296 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-05-08T18:09:03.296 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:09:03.296 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:09:03.296 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:09:03.296 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:09:03.296 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:09:03.296 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:09:03.296 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:09:03.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.296 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "26", 2024-05-08T18:09:03.296 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:09:03.296 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:09:03.297 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:09:03.297 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:09:03.297 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:09:03.297 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:09:03.297 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:09:03.297 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:09:03.297 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:09:03.297 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:09:03.297 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:09:03.297 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:09:03.297 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:09:03.297 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:09:03.297 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:09:03.298 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:09:03.298 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:09:03.298 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:09:03.298 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:09:03.298 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:09:03.298 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:09:03.298 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:09:03.298 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:09:03.298 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:09:03.298 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:09:03.298 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:09:03.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.298 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:09:03.298 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:09:03.299 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:09:03.299 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:09:03.299 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:09:03.299 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:09:03.299 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:09:03.299 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:09:03.299 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:09:03.299 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:09:03.299 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:09:03.299 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:09:03.299 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:09:03.299 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:09:03.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.299 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:09:03.299 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:09:03.300 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.25, 2024-05-08T18:09:03.300 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.25, 2024-05-08T18:09:03.300 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:09:03.300 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.25, 2024-05-08T18:09:03.300 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.25, 2024-05-08T18:09:03.300 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:09:03.300 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:09:03.300 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:09:03.300 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.300 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 6, 2024-05-08T18:09:03.300 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.log", 2024-05-08T18:09:03.300 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:19.656809+0000", 2024-05-08T18:09:03.300 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:09:03.301 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:09:03.301 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:09:03.301 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:09:03.301 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:09:03.301 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:09:03.301 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:09:03.301 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:09:03.301 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:09:03.301 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:09:03.301 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:09:03.301 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:09:03.301 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-05-08T18:09:03.301 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-05-08T18:09:03.302 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-05-08T18:09:03.302 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-05-08T18:09:03.302 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-05-08T18:09:03.302 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:09:03.302 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:09:03.302 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:09:03.302 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:09:03.302 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:09:03.302 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:09:03.302 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:09:03.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.302 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "28", 2024-05-08T18:09:03.302 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:09:03.302 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:09:03.303 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:09:03.303 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:09:03.303 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:09:03.303 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:09:03.303 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:09:03.303 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:09:03.303 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:09:03.303 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:09:03.303 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:09:03.303 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:09:03.303 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:09:03.303 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:09:03.303 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:09:03.303 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:09:03.304 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:09:03.304 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:09:03.304 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:09:03.304 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:09:03.304 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:09:03.304 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:09:03.304 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:09:03.304 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:09:03.304 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:09:03.304 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:09:03.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.304 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:09:03.304 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:09:03.304 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:09:03.305 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:09:03.305 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:09:03.305 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:09:03.305 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:09:03.305 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:09:03.305 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:09:03.305 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:09:03.305 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:09:03.305 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:09:03.305 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:09:03.305 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:09:03.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.305 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:09:03.305 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:09:03.306 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.75, 2024-05-08T18:09:03.306 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.75, 2024-05-08T18:09:03.306 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:09:03.306 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.75, 2024-05-08T18:09:03.306 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.75, 2024-05-08T18:09:03.306 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:09:03.306 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:09:03.306 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:09:03.306 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.306 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 7, 2024-05-08T18:09:03.306 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.control", 2024-05-08T18:09:03.307 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:21.569514+0000", 2024-05-08T18:09:03.307 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:09:03.307 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:09:03.307 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:09:03.307 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:09:03.307 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:09:03.307 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:09:03.307 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:09:03.307 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:09:03.307 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:09:03.307 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:09:03.307 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:09:03.307 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:09:03.307 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-05-08T18:09:03.307 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-05-08T18:09:03.308 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-05-08T18:09:03.308 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-05-08T18:09:03.308 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-05-08T18:09:03.308 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:09:03.308 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:09:03.308 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:09:03.308 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:09:03.308 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:09:03.308 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:09:03.308 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:09:03.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.308 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "30", 2024-05-08T18:09:03.308 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:09:03.308 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:09:03.309 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:09:03.309 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:09:03.309 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:09:03.309 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:09:03.309 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:09:03.309 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:09:03.309 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:09:03.309 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:09:03.309 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:09:03.309 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:09:03.309 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:09:03.309 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:09:03.309 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:09:03.309 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:09:03.310 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:09:03.310 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:09:03.310 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:09:03.310 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:09:03.310 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:09:03.310 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:09:03.310 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:09:03.310 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:09:03.310 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:09:03.310 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:09:03.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.310 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:09:03.310 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:09:03.310 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:09:03.311 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:09:03.311 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:09:03.311 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:09:03.311 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:09:03.311 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:09:03.311 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:09:03.311 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:09:03.311 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:09:03.311 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:09:03.311 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:09:03.311 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:09:03.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.311 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:09:03.312 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:09:03.312 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.75, 2024-05-08T18:09:03.312 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.75, 2024-05-08T18:09:03.312 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:09:03.312 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.75, 2024-05-08T18:09:03.312 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.75, 2024-05-08T18:09:03.312 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:09:03.312 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:09:03.312 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:09:03.312 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.312 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 8, 2024-05-08T18:09:03.313 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.meta", 2024-05-08T18:09:03.313 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:23.704646+0000", 2024-05-08T18:09:03.313 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:09:03.313 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:09:03.313 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:09:03.313 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:09:03.313 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:09:03.313 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:09:03.313 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:09:03.313 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:09:03.313 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:09:03.313 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:09:03.314 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:09:03.314 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:09:03.314 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-05-08T18:09:03.314 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-05-08T18:09:03.314 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-05-08T18:09:03.314 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-05-08T18:09:03.314 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-05-08T18:09:03.314 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:09:03.314 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:09:03.314 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:09:03.314 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:09:03.314 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:09:03.314 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:09:03.315 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:09:03.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.315 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "32", 2024-05-08T18:09:03.315 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:09:03.315 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:09:03.315 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:09:03.315 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:09:03.315 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:09:03.315 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:09:03.315 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:09:03.315 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:09:03.315 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:09:03.315 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:09:03.316 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:09:03.316 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:09:03.316 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:09:03.316 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:09:03.316 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:09:03.316 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:09:03.316 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:09:03.316 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:09:03.316 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:09:03.316 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:09:03.316 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:09:03.316 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:09:03.316 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:09:03.316 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:09:03.317 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:09:03.317 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:09:03.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.317 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:09:03.317 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:09:03.317 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:09:03.317 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:09:03.317 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:09:03.317 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:09:03.317 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:09:03.317 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:09:03.317 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:09:03.317 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:09:03.317 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:09:03.318 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-05-08T18:09:03.318 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4 2024-05-08T18:09:03.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.318 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:09:03.318 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:09:03.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.318 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:09:03.318 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:09:03.318 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.5, 2024-05-08T18:09:03.318 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.5, 2024-05-08T18:09:03.318 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:09:03.318 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.5, 2024-05-08T18:09:03.318 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.5, 2024-05-08T18:09:03.319 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:09:03.319 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:09:03.319 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:09:03.319 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.319 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.319 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-05-08T18:09:03.319 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-05-08T18:09:03.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.319 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-05-08T18:09:03.319 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "e14e7bbc-18b8-4961-bcde-109f22cc52e6", 2024-05-08T18:09:03.319 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:09:03.319 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:09:03.319 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:09:03.319 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:09:03.320 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:09:03.320 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:09:03.320 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:09:03.320 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 30, 2024-05-08T18:09:03.320 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:09:03.320 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:09:03.320 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:09:03.320 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.320 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.320 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2024-05-08T18:09:03.320 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:09:03.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.320 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.321 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2024-05-08T18:09:03.321 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:09:03.321 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.321 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.321 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:09:03.321 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.321 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.321 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2024-05-08T18:09:03.321 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:09:03.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.321 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.322 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2024-05-08T18:09:03.322 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:09:03.322 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.322 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.322 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:09:03.322 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.322 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.322 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2024-05-08T18:09:03.322 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:09:03.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.323 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.323 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2024-05-08T18:09:03.323 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:09:03.323 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.323 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.323 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:09:03.323 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.323 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.323 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2024-05-08T18:09:03.323 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:09:03.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.323 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.324 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2024-05-08T18:09:03.324 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:09:03.324 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.324 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.324 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6812/3565382691", 2024-05-08T18:09:03.324 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6817/3565382691", 2024-05-08T18:09:03.324 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/3565382691", 2024-05-08T18:09:03.324 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/3565382691", 2024-05-08T18:09:03.324 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:09:03.324 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:09:03.324 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:09:03.325 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.325 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-05-08T18:09:03.325 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "d4ce30c2-52b8-45a3-8a34-b0addc8311dd", 2024-05-08T18:09:03.325 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:09:03.325 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:09:03.325 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:09:03.325 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:09:03.325 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:09:03.325 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:09:03.325 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:09:03.325 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 47, 2024-05-08T18:09:03.326 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:09:03.326 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:09:03.326 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:09:03.326 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.326 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.326 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2024-05-08T18:09:03.326 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:09:03.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.326 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.326 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2024-05-08T18:09:03.326 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:09:03.326 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.327 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.327 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:09:03.327 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.327 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.327 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2024-05-08T18:09:03.327 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:09:03.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.327 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.327 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2024-05-08T18:09:03.327 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:09:03.327 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.328 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.328 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:09:03.328 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.328 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.328 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2024-05-08T18:09:03.328 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:09:03.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.328 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.328 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2024-05-08T18:09:03.328 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:09:03.328 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.328 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.329 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:09:03.329 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.329 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.329 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2024-05-08T18:09:03.329 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:09:03.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.329 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.329 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2024-05-08T18:09:03.329 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:09:03.329 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.330 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.330 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/3922502534", 2024-05-08T18:09:03.330 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/3922502534", 2024-05-08T18:09:03.330 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/3922502534", 2024-05-08T18:09:03.330 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/3922502534", 2024-05-08T18:09:03.330 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:09:03.330 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:09:03.330 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:09:03.330 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.330 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-05-08T18:09:03.331 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "0049cbe1-578f-4202-a572-2328d79f0496", 2024-05-08T18:09:03.331 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:09:03.331 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:09:03.331 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:09:03.331 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:09:03.331 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:09:03.331 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:09:03.331 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:09:03.331 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 47, 2024-05-08T18:09:03.331 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:09:03.331 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:09:03.331 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:09:03.331 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.332 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.332 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2024-05-08T18:09:03.332 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:09:03.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.332 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.332 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2024-05-08T18:09:03.332 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:09:03.332 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.332 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.332 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:09:03.332 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.333 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.333 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2024-05-08T18:09:03.333 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:09:03.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.333 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.333 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2024-05-08T18:09:03.333 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:09:03.333 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.333 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.333 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:09:03.333 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.334 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.334 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2024-05-08T18:09:03.334 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:09:03.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.334 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.334 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2024-05-08T18:09:03.334 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:09:03.334 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.334 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.334 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:09:03.334 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.335 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.335 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2024-05-08T18:09:03.335 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:09:03.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.335 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.335 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2024-05-08T18:09:03.335 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:09:03.335 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.335 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.335 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/3474282780", 2024-05-08T18:09:03.335 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/3474282780", 2024-05-08T18:09:03.336 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/3474282780", 2024-05-08T18:09:03.336 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/3474282780", 2024-05-08T18:09:03.336 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:09:03.336 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:09:03.336 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:09:03.336 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.336 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-05-08T18:09:03.336 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3ec754a0-b0ca-4d44-bce0-7c380245ec0a", 2024-05-08T18:09:03.336 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:09:03.336 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:09:03.336 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:09:03.336 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:09:03.337 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:09:03.337 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:09:03.337 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:09:03.337 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 47, 2024-05-08T18:09:03.337 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:09:03.337 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:09:03.337 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:09:03.337 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.337 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.337 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2024-05-08T18:09:03.337 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:09:03.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.338 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.338 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2024-05-08T18:09:03.338 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:09:03.338 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.338 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.338 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:09:03.338 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.338 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.338 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2024-05-08T18:09:03.338 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:09:03.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.339 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.339 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2024-05-08T18:09:03.339 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:09:03.339 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.339 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.339 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:09:03.339 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.339 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.339 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2024-05-08T18:09:03.339 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:09:03.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.340 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.340 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2024-05-08T18:09:03.340 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:09:03.340 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.340 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.340 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:09:03.340 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.340 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.340 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2024-05-08T18:09:03.340 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:09:03.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.341 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.341 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2024-05-08T18:09:03.341 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:09:03.341 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.341 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.341 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6810/3525633066", 2024-05-08T18:09:03.341 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6813/3525633066", 2024-05-08T18:09:03.341 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6820/3525633066", 2024-05-08T18:09:03.341 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6816/3525633066", 2024-05-08T18:09:03.341 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:09:03.341 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:09:03.342 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:09:03.342 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.342 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-05-08T18:09:03.342 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d", 2024-05-08T18:09:03.342 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:09:03.342 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:09:03.342 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:09:03.342 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:09:03.342 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:09:03.342 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:09:03.342 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:09:03.342 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 47, 2024-05-08T18:09:03.343 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:09:03.343 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:09:03.343 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:09:03.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.343 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6816", 2024-05-08T18:09:03.343 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:09:03.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.343 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.343 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6817", 2024-05-08T18:09:03.343 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:09:03.343 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.344 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.344 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:09:03.344 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.344 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.344 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6819", 2024-05-08T18:09:03.344 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:09:03.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.344 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.344 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6821", 2024-05-08T18:09:03.344 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:09:03.344 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.345 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.345 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:09:03.345 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.345 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.345 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6827", 2024-05-08T18:09:03.345 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:09:03.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.345 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.345 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6829", 2024-05-08T18:09:03.345 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:09:03.345 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.346 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.346 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:09:03.346 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.346 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.346 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6823", 2024-05-08T18:09:03.346 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:09:03.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.346 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.346 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6825", 2024-05-08T18:09:03.346 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:09:03.347 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.347 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.347 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.115:6817/4103080494", 2024-05-08T18:09:03.347 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.115:6821/4103080494", 2024-05-08T18:09:03.347 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.115:6829/4103080494", 2024-05-08T18:09:03.347 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.115:6825/4103080494", 2024-05-08T18:09:03.347 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:09:03.347 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:09:03.347 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:09:03.347 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.347 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-05-08T18:09:03.347 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3dc618ad-e40d-418e-844c-57572043f866", 2024-05-08T18:09:03.348 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:09:03.348 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:09:03.348 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:09:03.348 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:09:03.348 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:09:03.348 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:09:03.348 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:09:03.348 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 30, 2024-05-08T18:09:03.348 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:09:03.348 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:09:03.348 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:09:03.348 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.348 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.349 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6818", 2024-05-08T18:09:03.349 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:09:03.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.349 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.349 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6820", 2024-05-08T18:09:03.349 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:09:03.349 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.349 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.349 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:09:03.349 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.349 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.349 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6822", 2024-05-08T18:09:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:09:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6824", 2024-05-08T18:09:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:09:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:09:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.350 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.351 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6830", 2024-05-08T18:09:03.351 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:09:03.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.351 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.351 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6831", 2024-05-08T18:09:03.351 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:09:03.351 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.351 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.351 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:09:03.351 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.351 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.352 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6826", 2024-05-08T18:09:03.352 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:09:03.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.352 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.352 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6828", 2024-05-08T18:09:03.352 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:09:03.352 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.352 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.352 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.115:6820/87947085", 2024-05-08T18:09:03.352 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.115:6824/87947085", 2024-05-08T18:09:03.352 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.115:6831/87947085", 2024-05-08T18:09:03.353 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.115:6828/87947085", 2024-05-08T18:09:03.353 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:09:03.353 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:09:03.353 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:09:03.353 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.353 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-05-08T18:09:03.353 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "1f8172c6-5d27-4542-80a6-1c630dddf752", 2024-05-08T18:09:03.353 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:09:03.353 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:09:03.353 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:09:03.353 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:09:03.353 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:09:03.354 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:09:03.354 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:09:03.354 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 30, 2024-05-08T18:09:03.354 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:09:03.354 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:09:03.354 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:09:03.354 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.354 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.354 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6800", 2024-05-08T18:09:03.354 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:09:03.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.354 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.355 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6801", 2024-05-08T18:09:03.355 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:09:03.355 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.355 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.355 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:09:03.355 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.355 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.355 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6802", 2024-05-08T18:09:03.355 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:09:03.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.356 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.356 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6803", 2024-05-08T18:09:03.356 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:09:03.356 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.356 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.356 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:09:03.356 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.356 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.356 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6806", 2024-05-08T18:09:03.356 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:09:03.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.357 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.357 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6807", 2024-05-08T18:09:03.357 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:09:03.357 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.357 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.357 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:09:03.357 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.357 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.357 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6804", 2024-05-08T18:09:03.357 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:09:03.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.358 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.358 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6805", 2024-05-08T18:09:03.358 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:09:03.358 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.358 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.358 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.115:6801/2090404725", 2024-05-08T18:09:03.358 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.115:6803/2090404725", 2024-05-08T18:09:03.358 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.115:6807/2090404725", 2024-05-08T18:09:03.358 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.115:6805/2090404725", 2024-05-08T18:09:03.358 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:09:03.359 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:09:03.359 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:09:03.359 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.359 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-05-08T18:09:03.359 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "e4146a73-11ca-4499-afa7-23e23d70a662", 2024-05-08T18:09:03.359 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:09:03.359 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:09:03.359 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:09:03.359 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:09:03.359 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:09:03.359 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:09:03.359 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:09:03.360 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 30, 2024-05-08T18:09:03.360 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:09:03.360 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:09:03.360 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:09:03.360 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.360 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.360 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6808", 2024-05-08T18:09:03.360 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:09:03.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.360 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.360 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6809", 2024-05-08T18:09:03.361 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:09:03.361 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.361 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.361 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:09:03.361 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.361 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.361 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6810", 2024-05-08T18:09:03.361 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:09:03.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.361 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.361 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6811", 2024-05-08T18:09:03.361 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:09:03.362 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.362 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.362 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:09:03.362 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.362 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.362 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6814", 2024-05-08T18:09:03.362 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:09:03.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.362 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.362 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6815", 2024-05-08T18:09:03.363 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:09:03.363 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.363 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.363 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:09:03.363 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:03.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.363 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:03.363 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6812", 2024-05-08T18:09:03.363 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:09:03.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.363 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:03.363 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6813", 2024-05-08T18:09:03.364 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:09:03.364 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.364 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.364 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.115:6809/133828553", 2024-05-08T18:09:03.364 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.115:6811/133828553", 2024-05-08T18:09:03.364 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.115:6815/133828553", 2024-05-08T18:09:03.364 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.115:6813/133828553", 2024-05-08T18:09:03.364 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:09:03.364 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:09:03.364 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:09:03.364 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.364 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.364 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-05-08T18:09:03.365 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2024-05-08T18:09:03.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.365 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-05-08T18:09:03.365 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:09:03.365 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:09:03.365 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:09:03.365 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:09:03.365 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:09:03.365 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:56.936317+0000", 2024-05-08T18:09:03.365 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:09:03.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.365 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-05-08T18:09:03.365 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:09:03.366 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:09:03.366 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:09:03.366 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:09:03.366 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:09:03.366 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:56.814583+0000", 2024-05-08T18:09:03.366 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:09:03.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.366 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-05-08T18:09:03.366 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:09:03.366 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:09:03.366 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:09:03.366 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:09:03.367 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:09:03.367 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:57.168294+0000", 2024-05-08T18:09:03.367 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:09:03.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.367 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-05-08T18:09:03.367 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:09:03.367 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:09:03.367 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:09:03.367 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:09:03.367 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:09:03.367 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:56.751445+0000", 2024-05-08T18:09:03.367 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:09:03.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.368 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-05-08T18:09:03.368 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:09:03.368 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:09:03.368 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:09:03.368 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:09:03.368 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:09:03.368 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:57.091268+0000", 2024-05-08T18:09:03.368 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:09:03.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.368 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-05-08T18:09:03.368 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:09:03.368 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:09:03.368 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:09:03.369 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:09:03.369 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:09:03.369 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:57.113133+0000", 2024-05-08T18:09:03.369 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:09:03.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.369 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-05-08T18:09:03.369 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:09:03.369 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:09:03.369 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:09:03.369 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:09:03.369 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:09:03.369 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:57.054822+0000", 2024-05-08T18:09:03.369 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:09:03.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.370 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-05-08T18:09:03.370 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:09:03.370 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:09:03.370 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:09:03.370 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:09:03.370 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:09:03.370 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:57.057214+0000", 2024-05-08T18:09:03.370 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:09:03.370 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.370 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-05-08T18:09:03.370 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [ 2024-05-08T18:09:03.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.370 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.3f", 2024-05-08T18:09:03.370 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-05-08T18:09:03.371 INFO:teuthology.orchestra.run.smithi080.stdout: 3, 2024-05-08T18:09:03.371 INFO:teuthology.orchestra.run.smithi080.stdout: 7 2024-05-08T18:09:03.371 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.371 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.371 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-05-08T18:09:03.371 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [ 2024-05-08T18:09:03.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.371 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "3.f", 2024-05-08T18:09:03.371 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-05-08T18:09:03.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.371 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 7, 2024-05-08T18:09:03.371 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 2 2024-05-08T18:09:03.371 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.371 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.372 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "3.1e", 2024-05-08T18:09:03.372 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-05-08T18:09:03.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.372 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 3, 2024-05-08T18:09:03.372 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 1 2024-05-08T18:09:03.372 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.372 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.372 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "3.2a", 2024-05-08T18:09:03.372 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-05-08T18:09:03.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.373 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 5, 2024-05-08T18:09:03.373 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 2 2024-05-08T18:09:03.373 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.373 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.373 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "3.3a", 2024-05-08T18:09:03.373 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-05-08T18:09:03.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.373 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 5, 2024-05-08T18:09:03.373 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 2 2024-05-08T18:09:03.373 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.373 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.373 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.c", 2024-05-08T18:09:03.374 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-05-08T18:09:03.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.374 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 3, 2024-05-08T18:09:03.374 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 2 2024-05-08T18:09:03.374 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.374 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.374 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.10", 2024-05-08T18:09:03.374 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-05-08T18:09:03.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:03.374 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-05-08T18:09:03.374 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 2 2024-05-08T18:09:03.374 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.375 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:03.375 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.375 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-05-08T18:09:03.375 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_primaries": [], 2024-05-08T18:09:03.375 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2024-05-08T18:09:03.375 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2024-05-08T18:09:03.375 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklist": {}, 2024-05-08T18:09:03.375 INFO:teuthology.orchestra.run.smithi080.stdout: "range_blocklist": {}, 2024-05-08T18:09:03.375 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2024-05-08T18:09:03.375 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2024-05-08T18:09:03.375 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2024-05-08T18:09:03.375 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2024-05-08T18:09:03.375 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2024-05-08T18:09:03.375 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2024-05-08T18:09:03.375 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2024-05-08T18:09:03.376 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:03.376 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2024-05-08T18:09:03.376 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2024-05-08T18:09:03.376 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2024-05-08T18:09:03.376 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2024-05-08T18:09:03.376 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {}, 2024-05-08T18:09:03.376 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode": { 2024-05-08T18:09:03.376 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_enabled": false, 2024-05-08T18:09:03.376 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_bucket_count": 0, 2024-05-08T18:09:03.376 INFO:teuthology.orchestra.run.smithi080.stdout: "degraded_stretch_mode": 0, 2024-05-08T18:09:03.376 INFO:teuthology.orchestra.run.smithi080.stdout: "recovering_stretch_mode": 0, 2024-05-08T18:09:03.376 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_bucket": 0 2024-05-08T18:09:03.376 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:03.377 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:03.379 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:09:03.379 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:03.377+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:03.380 INFO:tasks.thrashosds.thrasher:j is {'epoch': 83, 'fsid': '0d8284a2-bb69-4df9-9f45-9ef5b469ca40', 'created': '2024-05-08T18:06:48.916680+0000', 'modified': '2024-05-08T18:09:03.071473+0000', 'last_up_change': '2024-05-08T18:07:00.796481+0000', 'last_in_change': '2024-05-08T18:06:51.530709+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T18:07:01.699859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-08T18:07:07.479756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2024-05-08T18:07:14.110093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2024-05-08T18:07:15.798248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': '.rgw.root', 'create_time': '2024-05-08T18:07:17.763573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'default.rgw.log', 'create_time': '2024-05-08T18:07:19.656809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'default.rgw.control', 'create_time': '2024-05-08T18:07:21.569514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2024-05-08T18:07:23.704646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'e14e7bbc-18b8-4961-bcde-109f22cc52e6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6809', 'nonce': 3565382691}, {'type': 'v1', 'addr': '172.21.15.80:6812', 'nonce': 3565382691}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6815', 'nonce': 3565382691}, {'type': 'v1', 'addr': '172.21.15.80:6817', 'nonce': 3565382691}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6822', 'nonce': 3565382691}, {'type': 'v1', 'addr': '172.21.15.80:6823', 'nonce': 3565382691}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6819', 'nonce': 3565382691}, {'type': 'v1', 'addr': '172.21.15.80:6821', 'nonce': 3565382691}]}, 'public_addr': '172.21.15.80:6812/3565382691', 'cluster_addr': '172.21.15.80:6817/3565382691', 'heartbeat_back_addr': '172.21.15.80:6823/3565382691', 'heartbeat_front_addr': '172.21.15.80:6821/3565382691', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'd4ce30c2-52b8-45a3-8a34-b0addc8311dd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 47, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6800', 'nonce': 3922502534}, {'type': 'v1', 'addr': '172.21.15.80:6801', 'nonce': 3922502534}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6802', 'nonce': 3922502534}, {'type': 'v1', 'addr': '172.21.15.80:6803', 'nonce': 3922502534}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6806', 'nonce': 3922502534}, {'type': 'v1', 'addr': '172.21.15.80:6807', 'nonce': 3922502534}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6804', 'nonce': 3922502534}, {'type': 'v1', 'addr': '172.21.15.80:6805', 'nonce': 3922502534}]}, 'public_addr': '172.21.15.80:6801/3922502534', 'cluster_addr': '172.21.15.80:6803/3922502534', 'heartbeat_back_addr': '172.21.15.80:6807/3922502534', 'heartbeat_front_addr': '172.21.15.80:6805/3922502534', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0049cbe1-578f-4202-a572-2328d79f0496', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 47, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6824', 'nonce': 3474282780}, {'type': 'v1', 'addr': '172.21.15.80:6825', 'nonce': 3474282780}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6826', 'nonce': 3474282780}, {'type': 'v1', 'addr': '172.21.15.80:6827', 'nonce': 3474282780}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6830', 'nonce': 3474282780}, {'type': 'v1', 'addr': '172.21.15.80:6831', 'nonce': 3474282780}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6828', 'nonce': 3474282780}, {'type': 'v1', 'addr': '172.21.15.80:6829', 'nonce': 3474282780}]}, 'public_addr': '172.21.15.80:6825/3474282780', 'cluster_addr': '172.21.15.80:6827/3474282780', 'heartbeat_back_addr': '172.21.15.80:6831/3474282780', 'heartbeat_front_addr': '172.21.15.80:6829/3474282780', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '3ec754a0-b0ca-4d44-bce0-7c380245ec0a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 47, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6808', 'nonce': 3525633066}, {'type': 'v1', 'addr': '172.21.15.80:6810', 'nonce': 3525633066}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6811', 'nonce': 3525633066}, {'type': 'v1', 'addr': '172.21.15.80:6813', 'nonce': 3525633066}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6818', 'nonce': 3525633066}, {'type': 'v1', 'addr': '172.21.15.80:6820', 'nonce': 3525633066}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6814', 'nonce': 3525633066}, {'type': 'v1', 'addr': '172.21.15.80:6816', 'nonce': 3525633066}]}, 'public_addr': '172.21.15.80:6810/3525633066', 'cluster_addr': '172.21.15.80:6813/3525633066', 'heartbeat_back_addr': '172.21.15.80:6820/3525633066', 'heartbeat_front_addr': '172.21.15.80:6816/3525633066', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 47, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6816', 'nonce': 4103080494}, {'type': 'v1', 'addr': '172.21.15.115:6817', 'nonce': 4103080494}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6819', 'nonce': 4103080494}, {'type': 'v1', 'addr': '172.21.15.115:6821', 'nonce': 4103080494}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6827', 'nonce': 4103080494}, {'type': 'v1', 'addr': '172.21.15.115:6829', 'nonce': 4103080494}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6823', 'nonce': 4103080494}, {'type': 'v1', 'addr': '172.21.15.115:6825', 'nonce': 4103080494}]}, 'public_addr': '172.21.15.115:6817/4103080494', 'cluster_addr': '172.21.15.115:6821/4103080494', 'heartbeat_back_addr': '172.21.15.115:6829/4103080494', 'heartbeat_front_addr': '172.21.15.115:6825/4103080494', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '3dc618ad-e40d-418e-844c-57572043f866', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6818', 'nonce': 87947085}, {'type': 'v1', 'addr': '172.21.15.115:6820', 'nonce': 87947085}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6822', 'nonce': 87947085}, {'type': 'v1', 'addr': '172.21.15.115:6824', 'nonce': 87947085}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6830', 'nonce': 87947085}, {'type': 'v1', 'addr': '172.21.15.115:6831', 'nonce': 87947085}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6826', 'nonce': 87947085}, {'type': 'v1', 'addr': '172.21.15.115:6828', 'nonce': 87947085}]}, 'public_addr': '172.21.15.115:6820/87947085', 'cluster_addr': '172.21.15.115:6824/87947085', 'heartbeat_back_addr': '172.21.15.115:6831/87947085', 'heartbeat_front_addr': '172.21.15.115:6828/87947085', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '1f8172c6-5d27-4542-80a6-1c630dddf752', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6800', 'nonce': 2090404725}, {'type': 'v1', 'addr': '172.21.15.115:6801', 'nonce': 2090404725}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6802', 'nonce': 2090404725}, {'type': 'v1', 'addr': '172.21.15.115:6803', 'nonce': 2090404725}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6806', 'nonce': 2090404725}, {'type': 'v1', 'addr': '172.21.15.115:6807', 'nonce': 2090404725}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6804', 'nonce': 2090404725}, {'type': 'v1', 'addr': '172.21.15.115:6805', 'nonce': 2090404725}]}, 'public_addr': '172.21.15.115:6801/2090404725', 'cluster_addr': '172.21.15.115:6803/2090404725', 'heartbeat_back_addr': '172.21.15.115:6807/2090404725', 'heartbeat_front_addr': '172.21.15.115:6805/2090404725', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e4146a73-11ca-4499-afa7-23e23d70a662', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6808', 'nonce': 133828553}, {'type': 'v1', 'addr': '172.21.15.115:6809', 'nonce': 133828553}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6810', 'nonce': 133828553}, {'type': 'v1', 'addr': '172.21.15.115:6811', 'nonce': 133828553}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6814', 'nonce': 133828553}, {'type': 'v1', 'addr': '172.21.15.115:6815', 'nonce': 133828553}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6812', 'nonce': 133828553}, {'type': 'v1', 'addr': '172.21.15.115:6813', 'nonce': 133828553}]}, 'public_addr': '172.21.15.115:6809/133828553', 'cluster_addr': '172.21.15.115:6811/133828553', 'heartbeat_back_addr': '172.21.15.115:6815/133828553', 'heartbeat_front_addr': '172.21.15.115:6813/133828553', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:56.936317+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:56.814583+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:57.168294+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:56.751445+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:57.091268+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:57.113133+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:57.054822+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:57.057214+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.3f', 'osds': [3, 7]}], 'pg_upmap_items': [{'pgid': '3.f', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '3.1e', 'mappings': [{'from': 3, 'to': 1}]}, {'pgid': '3.2a', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '3.3a', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '4.c', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '4.10', 'mappings': [{'from': 1, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-05-08T18:09:03.380 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:09:03.479 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:03.480+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:03.547 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:03.547 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:03.547 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:03.547 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:03.547 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:03.562 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:09:03.580 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:03.580+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:03.681 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:03.681+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:03.686 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:03.687 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:03.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:03.687 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:03.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.687 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:36 5.e 5:71234df9:::zone_info.d0a95a6c-3c84-4d52-915c-e8ea581dfb9b:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:09:03.687 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:09:03.687 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.10918769200001, 2024-05-08T18:09:03.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028394430000000001, 2024-05-08T18:09:03.687 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.687 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.687 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.687 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.687 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:09:03.688 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:09:03.688 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 36 2024-05-08T18:09:03.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.688 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:09:03.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573454+0000", 2024-05-08T18:09:03.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573456+0000", 2024-05-08T18:09:03.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1900000000000002e-06 2024-05-08T18:09:03.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573467+0000", 2024-05-08T18:09:03.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1243999999999999e-05 2024-05-08T18:09:03.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573499+0000", 2024-05-08T18:09:03.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1343000000000001e-05 2024-05-08T18:09:03.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573522+0000", 2024-05-08T18:09:03.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3540000000000002e-05 2024-05-08T18:09:03.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573634+0000", 2024-05-08T18:09:03.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112249 2024-05-08T18:09:03.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.573841+0000", 2024-05-08T18:09:03.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000206407 2024-05-08T18:09:03.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:03.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.574122+0000", 2024-05-08T18:09:03.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000281475 2024-05-08T18:09:03.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.575489+0000", 2024-05-08T18:09:03.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001366391 2024-05-08T18:09:03.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576157+0000", 2024-05-08T18:09:03.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00066776200000000002 2024-05-08T18:09:03.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576234+0000", 2024-05-08T18:09:03.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7285000000000003e-05 2024-05-08T18:09:03.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.576293+0000", 2024-05-08T18:09:03.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9556999999999999e-05 2024-05-08T18:09:03.692 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.692 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.692 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.692 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:09:03.692 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:09:03.692 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.152428499, 2024-05-08T18:09:03.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018560765, 2024-05-08T18:09:03.693 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.693 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.693 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:09:03.693 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.693 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.693 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.693 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 43 2024-05-08T18:09:03.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.693 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:09:03.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:09:03.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530217+0000", 2024-05-08T18:09:03.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:09:03.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530253+0000", 2024-05-08T18:09:03.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5621999999999999e-05 2024-05-08T18:09:03.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530288+0000", 2024-05-08T18:09:03.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5846999999999997e-05 2024-05-08T18:09:03.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530314+0000", 2024-05-08T18:09:03.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5732e-05 2024-05-08T18:09:03.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530952+0000", 2024-05-08T18:09:03.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00063739999999999999 2024-05-08T18:09:03.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:03.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530977+0000", 2024-05-08T18:09:03.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5375e-05 2024-05-08T18:09:03.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548506+0000", 2024-05-08T18:09:03.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017528781 2024-05-08T18:09:03.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548774+0000", 2024-05-08T18:09:03.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026821199999999999 2024-05-08T18:09:03.696 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.696 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.696 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.697 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.697 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:09:03.697 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.070114575000005, 2024-05-08T18:09:03.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003496893, 2024-05-08T18:09:03.697 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.697 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.697 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.697 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.697 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.697 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.697 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 211 2024-05-08T18:09:03.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.697 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:09:03.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612527+0000", 2024-05-08T18:09:03.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612530+0000", 2024-05-08T18:09:03.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9490000000000001e-06 2024-05-08T18:09:03.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612544+0000", 2024-05-08T18:09:03.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3779e-05 2024-05-08T18:09:03.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612578+0000", 2024-05-08T18:09:03.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4421000000000001e-05 2024-05-08T18:09:03.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612596+0000", 2024-05-08T18:09:03.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7435000000000002e-05 2024-05-08T18:09:03.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612718+0000", 2024-05-08T18:09:03.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012218600000000001 2024-05-08T18:09:03.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.612951+0000", 2024-05-08T18:09:03.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000232768 2024-05-08T18:09:03.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:03.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.613370+0000", 2024-05-08T18:09:03.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041921200000000002 2024-05-08T18:09:03.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.614840+0000", 2024-05-08T18:09:03.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014703679999999999 2024-05-08T18:09:03.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615860+0000", 2024-05-08T18:09:03.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010198220000000001 2024-05-08T18:09:03.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.615954+0000", 2024-05-08T18:09:03.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4419000000000005e-05 2024-05-08T18:09:03.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.616024+0000", 2024-05-08T18:09:03.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9534000000000002e-05 2024-05-08T18:09:03.702 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.702 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.702 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.702 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.702 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:09:03.702 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.993424892999997, 2024-05-08T18:09:03.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035800939999999998, 2024-05-08T18:09:03.702 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.702 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.703 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.703 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.703 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.703 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.703 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 232 2024-05-08T18:09:03.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.703 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:09:03.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689217+0000", 2024-05-08T18:09:03.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689219+0000", 2024-05-08T18:09:03.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4490000000000002e-06 2024-05-08T18:09:03.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689232+0000", 2024-05-08T18:09:03.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3183000000000001e-05 2024-05-08T18:09:03.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689263+0000", 2024-05-08T18:09:03.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400999999999999e-05 2024-05-08T18:09:03.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689279+0000", 2024-05-08T18:09:03.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6078000000000001e-05 2024-05-08T18:09:03.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689401+0000", 2024-05-08T18:09:03.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012243000000000001 2024-05-08T18:09:03.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.689656+0000", 2024-05-08T18:09:03.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431899999999998 2024-05-08T18:09:03.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:03.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.690103+0000", 2024-05-08T18:09:03.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044706299999999999 2024-05-08T18:09:03.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.691780+0000", 2024-05-08T18:09:03.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016774209999999999 2024-05-08T18:09:03.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692634+0000", 2024-05-08T18:09:03.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085346 2024-05-08T18:09:03.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692728+0000", 2024-05-08T18:09:03.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4429e-05 2024-05-08T18:09:03.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.692797+0000", 2024-05-08T18:09:03.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8861000000000004e-05 2024-05-08T18:09:03.707 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.707 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.707 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.708 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:267 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.708 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:09:03.708 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.968779914999999, 2024-05-08T18:09:03.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040291739999999999, 2024-05-08T18:09:03.708 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.708 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.708 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.708 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.708 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.708 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.708 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 267 2024-05-08T18:09:03.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.708 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:09:03.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713862+0000", 2024-05-08T18:09:03.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713863+0000", 2024-05-08T18:09:03.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5200000000000001e-06 2024-05-08T18:09:03.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713873+0000", 2024-05-08T18:09:03.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9089999999999995e-06 2024-05-08T18:09:03.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713896+0000", 2024-05-08T18:09:03.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2595e-05 2024-05-08T18:09:03.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.713914+0000", 2024-05-08T18:09:03.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7869000000000001e-05 2024-05-08T18:09:03.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714048+0000", 2024-05-08T18:09:03.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134802 2024-05-08T18:09:03.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714278+0000", 2024-05-08T18:09:03.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022994399999999999 2024-05-08T18:09:03.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:03.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.714777+0000", 2024-05-08T18:09:03.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049880499999999995 2024-05-08T18:09:03.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.715976+0000", 2024-05-08T18:09:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011991110000000001 2024-05-08T18:09:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717646+0000", 2024-05-08T18:09:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016699989999999999 2024-05-08T18:09:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717790+0000", 2024-05-08T18:09:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014359799999999999 2024-05-08T18:09:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.717891+0000", 2024-05-08T18:09:03.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101022 2024-05-08T18:09:03.713 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.713 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.713 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.713 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:308 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'2, mlcod=0'0)", 2024-05-08T18:09:03.713 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:09:03.713 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.961412675000005, 2024-05-08T18:09:03.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031672779999999999, 2024-05-08T18:09:03.713 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.713 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.713 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.714 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:09:03.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721229+0000", 2024-05-08T18:09:03.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721230+0000", 2024-05-08T18:09:03.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:09:03.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721241+0000", 2024-05-08T18:09:03.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0942e-05 2024-05-08T18:09:03.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721265+0000", 2024-05-08T18:09:03.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3371e-05 2024-05-08T18:09:03.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721278+0000", 2024-05-08T18:09:03.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3586e-05 2024-05-08T18:09:03.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721399+0000", 2024-05-08T18:09:03.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012092 2024-05-08T18:09:03.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.721507+0000", 2024-05-08T18:09:03.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107651 2024-05-08T18:09:03.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724292+0000", 2024-05-08T18:09:03.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027851870000000002 2024-05-08T18:09:03.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.724396+0000", 2024-05-08T18:09:03.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000104114 2024-05-08T18:09:03.717 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.717 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.717 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.717 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:495 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.717 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:09:03.717 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.878794773999999, 2024-05-08T18:09:03.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005951001, 2024-05-08T18:09:03.717 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.717 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.717 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.718 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.718 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.718 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.718 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 495 2024-05-08T18:09:03.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.718 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:09:03.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:09:03.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803849+0000", 2024-05-08T18:09:03.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3580000000000001e-06 2024-05-08T18:09:03.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803864+0000", 2024-05-08T18:09:03.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4742999999999999e-05 2024-05-08T18:09:03.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803895+0000", 2024-05-08T18:09:03.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0970000000000003e-05 2024-05-08T18:09:03.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803908+0000", 2024-05-08T18:09:03.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2588999999999999e-05 2024-05-08T18:09:03.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804005+0000", 2024-05-08T18:09:03.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7107000000000004e-05 2024-05-08T18:09:03.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804291+0000", 2024-05-08T18:09:03.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028626900000000002 2024-05-08T18:09:03.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:03.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804648+0000", 2024-05-08T18:09:03.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000356955 2024-05-08T18:09:03.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805740+0000", 2024-05-08T18:09:03.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001091905 2024-05-08T18:09:03.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809636+0000", 2024-05-08T18:09:03.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389661 2024-05-08T18:09:03.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809722+0000", 2024-05-08T18:09:03.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:09:03.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809798+0000", 2024-05-08T18:09:03.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5462000000000004e-05 2024-05-08T18:09:03.722 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.722 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.722 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.723 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.723 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:09:03.723 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.872183456000002, 2024-05-08T18:09:03.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051396380000000002, 2024-05-08T18:09:03.723 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.723 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.723 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.723 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.723 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.723 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.723 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 504 2024-05-08T18:09:03.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.723 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:09:03.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:09:03.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810460+0000", 2024-05-08T18:09:03.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:09:03.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810470+0000", 2024-05-08T18:09:03.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0222e-05 2024-05-08T18:09:03.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810495+0000", 2024-05-08T18:09:03.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4508999999999999e-05 2024-05-08T18:09:03.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810515+0000", 2024-05-08T18:09:03.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9998999999999999e-05 2024-05-08T18:09:03.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810653+0000", 2024-05-08T18:09:03.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013851099999999999 2024-05-08T18:09:03.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810782+0000", 2024-05-08T18:09:03.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128152 2024-05-08T18:09:03.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:03.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811043+0000", 2024-05-08T18:09:03.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026172400000000002 2024-05-08T18:09:03.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812164+0000", 2024-05-08T18:09:03.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001121024 2024-05-08T18:09:03.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815415+0000", 2024-05-08T18:09:03.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032510270000000001 2024-05-08T18:09:03.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815538+0000", 2024-05-08T18:09:03.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012256999999999999 2024-05-08T18:09:03.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815598+0000", 2024-05-08T18:09:03.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9923000000000002e-05 2024-05-08T18:09:03.728 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.728 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.728 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.728 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:629 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.728 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:09:03.728 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.763878715999994, 2024-05-08T18:09:03.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611169999999998, 2024-05-08T18:09:03.728 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.728 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.728 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.728 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.729 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.729 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.729 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 629 2024-05-08T18:09:03.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.729 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:09:03.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918763+0000", 2024-05-08T18:09:03.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918765+0000", 2024-05-08T18:09:03.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5670000000000002e-06 2024-05-08T18:09:03.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918777+0000", 2024-05-08T18:09:03.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1635e-05 2024-05-08T18:09:03.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918808+0000", 2024-05-08T18:09:03.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1024e-05 2024-05-08T18:09:03.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918823+0000", 2024-05-08T18:09:03.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4939e-05 2024-05-08T18:09:03.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.918930+0000", 2024-05-08T18:09:03.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000107144 2024-05-08T18:09:03.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919147+0000", 2024-05-08T18:09:03.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021682599999999999 2024-05-08T18:09:03.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:03.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.919464+0000", 2024-05-08T18:09:03.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031716699999999998 2024-05-08T18:09:03.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.920561+0000", 2024-05-08T18:09:03.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010970229999999999 2024-05-08T18:09:03.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921468+0000", 2024-05-08T18:09:03.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00090726800000000003 2024-05-08T18:09:03.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921549+0000", 2024-05-08T18:09:03.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0430000000000001e-05 2024-05-08T18:09:03.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.921624+0000", 2024-05-08T18:09:03.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5093999999999996e-05 2024-05-08T18:09:03.733 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.733 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.733 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.733 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:681 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:09:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.723557967999994, 2024-05-08T18:09:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044793259999999996, 2024-05-08T18:09:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 681 2024-05-08T18:09:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:09:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:09:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959085+0000", 2024-05-08T18:09:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.353e-06 2024-05-08T18:09:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959092+0000", 2024-05-08T18:09:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999999e-06 2024-05-08T18:09:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959113+0000", 2024-05-08T18:09:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0744e-05 2024-05-08T18:09:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959130+0000", 2024-05-08T18:09:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7679000000000001e-05 2024-05-08T18:09:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959217+0000", 2024-05-08T18:09:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6487000000000001e-05 2024-05-08T18:09:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959335+0000", 2024-05-08T18:09:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118476 2024-05-08T18:09:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959598+0000", 2024-05-08T18:09:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000263045 2024-05-08T18:09:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.960551+0000", 2024-05-08T18:09:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095251500000000002 2024-05-08T18:09:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963412+0000", 2024-05-08T18:09:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611800000000001 2024-05-08T18:09:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963498+0000", 2024-05-08T18:09:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6145999999999998e-05 2024-05-08T18:09:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963563+0000", 2024-05-08T18:09:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4701000000000003e-05 2024-05-08T18:09:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:09:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.688609532000001, 2024-05-08T18:09:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031621710000000001, 2024-05-08T18:09:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 709 2024-05-08T18:09:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:09:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994032+0000", 2024-05-08T18:09:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994035+0000", 2024-05-08T18:09:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6460000000000002e-06 2024-05-08T18:09:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994047+0000", 2024-05-08T18:09:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999e-05 2024-05-08T18:09:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994076+0000", 2024-05-08T18:09:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9564e-05 2024-05-08T18:09:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994091+0000", 2024-05-08T18:09:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4696e-05 2024-05-08T18:09:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994239+0000", 2024-05-08T18:09:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014779699999999999 2024-05-08T18:09:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.994585+0000", 2024-05-08T18:09:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034605900000000002 2024-05-08T18:09:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.995084+0000", 2024-05-08T18:09:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00049904799999999998 2024-05-08T18:09:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.996558+0000", 2024-05-08T18:09:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001474532 2024-05-08T18:09:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997045+0000", 2024-05-08T18:09:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048685900000000002 2024-05-08T18:09:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997127+0000", 2024-05-08T18:09:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1280999999999996e-05 2024-05-08T18:09:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.997194+0000", 2024-05-08T18:09:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7689999999999997e-05 2024-05-08T18:09:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:09:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.653220145999995, 2024-05-08T18:09:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003066236, 2024-05-08T18:09:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 724 2024-05-08T18:09:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:09:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029421+0000", 2024-05-08T18:09:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029424+0000", 2024-05-08T18:09:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.503e-06 2024-05-08T18:09:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029437+0000", 2024-05-08T18:09:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3309000000000001e-05 2024-05-08T18:09:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029467+0000", 2024-05-08T18:09:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9677999999999999e-05 2024-05-08T18:09:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029489+0000", 2024-05-08T18:09:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2314999999999999e-05 2024-05-08T18:09:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029600+0000", 2024-05-08T18:09:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110561 2024-05-08T18:09:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.029896+0000", 2024-05-08T18:09:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029632200000000001 2024-05-08T18:09:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.030468+0000", 2024-05-08T18:09:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00057224700000000001 2024-05-08T18:09:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.031728+0000", 2024-05-08T18:09:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012595429999999999 2024-05-08T18:09:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032338+0000", 2024-05-08T18:09:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00061006700000000005 2024-05-08T18:09:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032424+0000", 2024-05-08T18:09:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:09:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.032488+0000", 2024-05-08T18:09:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4210999999999999e-05 2024-05-08T18:09:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:726 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:09:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.648569731999999, 2024-05-08T18:09:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029269769999999999, 2024-05-08T18:09:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 726 2024-05-08T18:09:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:09:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034072+0000", 2024-05-08T18:09:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034074+0000", 2024-05-08T18:09:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5900000000000002e-06 2024-05-08T18:09:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034086+0000", 2024-05-08T18:09:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1265e-05 2024-05-08T18:09:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034118+0000", 2024-05-08T18:09:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2341000000000001e-05 2024-05-08T18:09:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034133+0000", 2024-05-08T18:09:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5166e-05 2024-05-08T18:09:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034254+0000", 2024-05-08T18:09:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121033 2024-05-08T18:09:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034492+0000", 2024-05-08T18:09:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023727700000000001 2024-05-08T18:09:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.034967+0000", 2024-05-08T18:09:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047522100000000001 2024-05-08T18:09:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036353+0000", 2024-05-08T18:09:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013865800000000001 2024-05-08T18:09:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036841+0000", 2024-05-08T18:09:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048788999999999999 2024-05-08T18:09:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036929+0000", 2024-05-08T18:09:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:09:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.036999+0000", 2024-05-08T18:09:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9448000000000003e-05 2024-05-08T18:09:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:09:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.645274901999997, 2024-05-08T18:09:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003040662, 2024-05-08T18:09:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 727 2024-05-08T18:09:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:09:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037367+0000", 2024-05-08T18:09:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037369+0000", 2024-05-08T18:09:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:09:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037378+0000", 2024-05-08T18:09:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5359999999999998e-06 2024-05-08T18:09:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037405+0000", 2024-05-08T18:09:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6588e-05 2024-05-08T18:09:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037418+0000", 2024-05-08T18:09:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3642000000000001e-05 2024-05-08T18:09:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037531+0000", 2024-05-08T18:09:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112304 2024-05-08T18:09:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.037785+0000", 2024-05-08T18:09:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025391299999999998 2024-05-08T18:09:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.038112+0000", 2024-05-08T18:09:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000326946 2024-05-08T18:09:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.039316+0000", 2024-05-08T18:09:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012043990000000001 2024-05-08T18:09:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040257+0000", 2024-05-08T18:09:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000941083 2024-05-08T18:09:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040345+0000", 2024-05-08T18:09:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8368999999999994e-05 2024-05-08T18:09:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.040407+0000", 2024-05-08T18:09:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1941999999999997e-05 2024-05-08T18:09:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:09:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.530609513000002, 2024-05-08T18:09:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028797779999999999, 2024-05-08T18:09:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 777 2024-05-08T18:09:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:09:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152032+0000", 2024-05-08T18:09:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152034+0000", 2024-05-08T18:09:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2299999999999998e-06 2024-05-08T18:09:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152045+0000", 2024-05-08T18:09:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0266e-05 2024-05-08T18:09:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152076+0000", 2024-05-08T18:09:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1007000000000003e-05 2024-05-08T18:09:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152094+0000", 2024-05-08T18:09:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8148999999999999e-05 2024-05-08T18:09:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152183+0000", 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8845999999999996e-05 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152308+0000", 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012502999999999999 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.152578+0000", 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027080099999999998 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154238+0000", 2024-05-08T18:09:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016600180000000001 2024-05-08T18:09:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154714+0000", 2024-05-08T18:09:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000475341 2024-05-08T18:09:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154803+0000", 2024-05-08T18:09:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9566000000000003e-05 2024-05-08T18:09:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.154912+0000", 2024-05-08T18:09:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010852400000000001 2024-05-08T18:09:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:09:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.287393620000003, 2024-05-08T18:09:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002844437, 2024-05-08T18:09:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 882 2024-05-08T18:09:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:09:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395248+0000", 2024-05-08T18:09:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395250+0000", 2024-05-08T18:09:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-06 2024-05-08T18:09:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395261+0000", 2024-05-08T18:09:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1046000000000001e-05 2024-05-08T18:09:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395293+0000", 2024-05-08T18:09:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1473999999999997e-05 2024-05-08T18:09:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395307+0000", 2024-05-08T18:09:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4599e-05 2024-05-08T18:09:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395481+0000", 2024-05-08T18:09:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173499 2024-05-08T18:09:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395626+0000", 2024-05-08T18:09:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000145351 2024-05-08T18:09:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.395902+0000", 2024-05-08T18:09:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027534499999999997 2024-05-08T18:09:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397118+0000", 2024-05-08T18:09:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012168929999999999 2024-05-08T18:09:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.397951+0000", 2024-05-08T18:09:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000832272 2024-05-08T18:09:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398028+0000", 2024-05-08T18:09:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6921000000000004e-05 2024-05-08T18:09:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398092+0000", 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4783999999999995e-05 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.284332899999995, 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002853894, 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 883 2024-05-08T18:09:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:09:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398309+0000", 2024-05-08T18:09:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398311+0000", 2024-05-08T18:09:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398321+0000", 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9189999999999994e-06 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398346+0000", 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5065000000000001e-05 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398360+0000", 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4171999999999999e-05 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398495+0000", 2024-05-08T18:09:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013503199999999999 2024-05-08T18:09:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.398716+0000", 2024-05-08T18:09:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220459 2024-05-08T18:09:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.399054+0000", 2024-05-08T18:09:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033806199999999998 2024-05-08T18:09:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.400192+0000", 2024-05-08T18:09:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011389169999999999 2024-05-08T18:09:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401020+0000", 2024-05-08T18:09:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082746199999999995 2024-05-08T18:09:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401099+0000", 2024-05-08T18:09:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9157000000000001e-05 2024-05-08T18:09:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.401163+0000", 2024-05-08T18:09:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3498999999999996e-05 2024-05-08T18:09:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:09:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.280544062999994, 2024-05-08T18:09:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031354040000000001, 2024-05-08T18:09:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 885 2024-05-08T18:09:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:09:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402098+0000", 2024-05-08T18:09:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402100+0000", 2024-05-08T18:09:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.063e-06 2024-05-08T18:09:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402110+0000", 2024-05-08T18:09:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0453e-05 2024-05-08T18:09:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402141+0000", 2024-05-08T18:09:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0651000000000002e-05 2024-05-08T18:09:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402162+0000", 2024-05-08T18:09:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1373999999999999e-05 2024-05-08T18:09:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402306+0000", 2024-05-08T18:09:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143492 2024-05-08T18:09:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.402562+0000", 2024-05-08T18:09:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025671899999999998 2024-05-08T18:09:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.403047+0000", 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048419100000000003 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404370+0000", 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013231580000000001 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.404966+0000", 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00059601100000000002 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405115+0000", 2024-05-08T18:09:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149665 2024-05-08T18:09:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.405233+0000", 2024-05-08T18:09:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117627 2024-05-08T18:09:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:09:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.183246527999998, 2024-05-08T18:09:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003251168, 2024-05-08T18:09:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 927 2024-05-08T18:09:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:09:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499395+0000", 2024-05-08T18:09:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499396+0000", 2024-05-08T18:09:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3200000000000001e-06 2024-05-08T18:09:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499404+0000", 2024-05-08T18:09:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2629999999999997e-06 2024-05-08T18:09:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499423+0000", 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9695e-05 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499435+0000", 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1542999999999999e-05 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499545+0000", 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110064 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.499764+0000", 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021856499999999999 2024-05-08T18:09:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.500237+0000", 2024-05-08T18:09:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047359499999999999 2024-05-08T18:09:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.501627+0000", 2024-05-08T18:09:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013897860000000001 2024-05-08T18:09:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502484+0000", 2024-05-08T18:09:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085733300000000005 2024-05-08T18:09:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502574+0000", 2024-05-08T18:09:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9939999999999996e-05 2024-05-08T18:09:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502646+0000", 2024-05-08T18:09:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2064000000000007e-05 2024-05-08T18:09:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:09:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.179746987000001, 2024-05-08T18:09:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031881129999999998, 2024-05-08T18:09:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 928 2024-05-08T18:09:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:09:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502895+0000", 2024-05-08T18:09:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502897+0000", 2024-05-08T18:09:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.916e-06 2024-05-08T18:09:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502906+0000", 2024-05-08T18:09:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2699999999999993e-06 2024-05-08T18:09:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502933+0000", 2024-05-08T18:09:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6823999999999999e-05 2024-05-08T18:09:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.502946+0000", 2024-05-08T18:09:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3439e-05 2024-05-08T18:09:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503066+0000", 2024-05-08T18:09:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012013700000000001 2024-05-08T18:09:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503399+0000", 2024-05-08T18:09:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033298600000000001 2024-05-08T18:09:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.503928+0000", 2024-05-08T18:09:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052877299999999996 2024-05-08T18:09:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505291+0000", 2024-05-08T18:09:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001363319 2024-05-08T18:09:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.505933+0000", 2024-05-08T18:09:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064135799999999997 2024-05-08T18:09:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506019+0000", 2024-05-08T18:09:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6649000000000003e-05 2024-05-08T18:09:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.506083+0000", 2024-05-08T18:09:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3441999999999993e-05 2024-05-08T18:09:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:03.792 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:03.795 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:09:03.798 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:09:03.803 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:09:03.804 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-05-08T18:09:03.693103+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":759,"num_read_kb":507,"num_write":530,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229184,"kb_used_data":8840,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754745536,"statfs":{"total":773094113280,"available":772859428864,"internally_reserved":0,"allocated":9052160,"data_stored":5444646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000901"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844188+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:09:00.844188+0000","last_peered":"2024-05-08T18:09:00.844188+0000","last_clean":"2024-05-08T18:09:00.844188+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:09:00.844188+0000","last_undegraded":"2024-05-08T18:09:00.844188+0000","last_fullsized":"2024-05-08T18:09:00.844188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375854+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:09:00.375854+0000","last_peered":"2024-05-08T18:09:00.375854+0000","last_clean":"2024-05-08T18:09:00.375854+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:09:00.375854+0000","last_undegraded":"2024-05-08T18:09:00.375854+0000","last_fullsized":"2024-05-08T18:09:00.375854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373705+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:09:01.373705+0000","last_peered":"2024-05-08T18:09:01.373705+0000","last_clean":"2024-05-08T18:09:01.373705+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:09:01.373705+0000","last_undegraded":"2024-05-08T18:09:01.373705+0000","last_fullsized":"2024-05-08T18:09:01.373705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844223+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:09:00.844223+0000","last_peered":"2024-05-08T18:09:00.844223+0000","last_clean":"2024-05-08T18:09:00.844223+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:09:00.844223+0000","last_undegraded":"2024-05-08T18:09:00.844223+0000","last_fullsized":"2024-05-08T18:09:00.844223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852758+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:09:00.852758+0000","last_peered":"2024-05-08T18:09:00.852758+0000","last_clean":"2024-05-08T18:09:00.852758+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:09:00.852758+0000","last_undegraded":"2024-05-08T18:09:00.852758+0000","last_fullsized":"2024-05-08T18:09:00.852758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059667+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:09:01.059667+0000","last_peered":"2024-05-08T18:09:01.059667+0000","last_clean":"2024-05-08T18:09:01.059667+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:09:01.059667+0000","last_undegraded":"2024-05-08T18:09:01.059667+0000","last_fullsized":"2024-05-08T18:09:01.059667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376577+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:09:00.376577+0000","last_peered":"2024-05-08T18:09:00.376577+0000","last_clean":"2024-05-08T18:09:00.376577+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:09:00.376577+0000","last_undegraded":"2024-05-08T18:09:00.376577+0000","last_fullsized":"2024-05-08T18:09:00.376577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851780+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:09:00.851780+0000","last_peered":"2024-05-08T18:09:00.851780+0000","last_clean":"2024-05-08T18:09:00.851780+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:09:00.851780+0000","last_undegraded":"2024-05-08T18:09:00.851780+0000","last_fullsized":"2024-05-08T18:09:00.851780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844051+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:09:00.844051+0000","last_peered":"2024-05-08T18:09:00.844051+0000","last_clean":"2024-05-08T18:09:00.844051+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:09:00.844051+0000","last_undegraded":"2024-05-08T18:09:00.844051+0000","last_fullsized":"2024-05-08T18:09:00.844051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845573+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:09:00.845573+0000","last_peered":"2024-05-08T18:09:00.845573+0000","last_clean":"2024-05-08T18:09:00.845573+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:09:00.845573+0000","last_undegraded":"2024-05-08T18:09:00.845573+0000","last_fullsized":"2024-05-08T18:09:00.845573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063579+0000","last_change":"2024-05-08T18:07:55.439965+0000","last_active":"2024-05-08T18:09:01.063579+0000","last_peered":"2024-05-08T18:09:01.063579+0000","last_clean":"2024-05-08T18:09:01.063579+0000","last_became_active":"2024-05-08T18:07:55.439578+0000","last_became_peered":"2024-05-08T18:07:55.439578+0000","last_unstale":"2024-05-08T18:09:01.063579+0000","last_undegraded":"2024-05-08T18:09:01.063579+0000","last_fullsized":"2024-05-08T18:09:01.063579+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:30.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060897+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:09:01.060897+0000","last_peered":"2024-05-08T18:09:01.060897+0000","last_clean":"2024-05-08T18:09:01.060897+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:09:01.060897+0000","last_undegraded":"2024-05-08T18:09:01.060897+0000","last_fullsized":"2024-05-08T18:09:01.060897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844470+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:09:00.844470+0000","last_peered":"2024-05-08T18:09:00.844470+0000","last_clean":"2024-05-08T18:09:00.844470+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:09:00.844470+0000","last_undegraded":"2024-05-08T18:09:00.844470+0000","last_fullsized":"2024-05-08T18:09:00.844470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376806+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:09:00.376806+0000","last_peered":"2024-05-08T18:09:00.376806+0000","last_clean":"2024-05-08T18:09:00.376806+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:09:00.376806+0000","last_undegraded":"2024-05-08T18:09:00.376806+0000","last_fullsized":"2024-05-08T18:09:00.376806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060877+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:09:01.060877+0000","last_peered":"2024-05-08T18:09:01.060877+0000","last_clean":"2024-05-08T18:09:01.060877+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:09:01.060877+0000","last_undegraded":"2024-05-08T18:09:01.060877+0000","last_fullsized":"2024-05-08T18:09:01.060877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.068352+0000","last_change":"2024-05-08T18:07:47.007132+0000","last_active":"2024-05-08T18:09:01.068352+0000","last_peered":"2024-05-08T18:09:01.068352+0000","last_clean":"2024-05-08T18:09:01.068352+0000","last_became_active":"2024-05-08T18:07:47.006744+0000","last_became_peered":"2024-05-08T18:07:47.006744+0000","last_unstale":"2024-05-08T18:09:01.068352+0000","last_undegraded":"2024-05-08T18:09:01.068352+0000","last_fullsized":"2024-05-08T18:09:01.068352+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:32.802677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.058884+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:09:01.058884+0000","last_peered":"2024-05-08T18:09:01.058884+0000","last_clean":"2024-05-08T18:09:01.058884+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:09:01.058884+0000","last_undegraded":"2024-05-08T18:09:01.058884+0000","last_fullsized":"2024-05-08T18:09:01.058884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844280+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:09:00.844280+0000","last_peered":"2024-05-08T18:09:00.844280+0000","last_clean":"2024-05-08T18:09:00.844280+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:09:00.844280+0000","last_undegraded":"2024-05-08T18:09:00.844280+0000","last_fullsized":"2024-05-08T18:09:00.844280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844283+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:09:00.844283+0000","last_peered":"2024-05-08T18:09:00.844283+0000","last_clean":"2024-05-08T18:09:00.844283+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:09:00.844283+0000","last_undegraded":"2024-05-08T18:09:00.844283+0000","last_fullsized":"2024-05-08T18:09:00.844283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845363+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:09:00.845363+0000","last_peered":"2024-05-08T18:09:00.845363+0000","last_clean":"2024-05-08T18:09:00.845363+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:09:00.845363+0000","last_undegraded":"2024-05-08T18:09:00.845363+0000","last_fullsized":"2024-05-08T18:09:00.845363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376162+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:09:00.376162+0000","last_peered":"2024-05-08T18:09:00.376162+0000","last_clean":"2024-05-08T18:09:00.376162+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:09:00.376162+0000","last_undegraded":"2024-05-08T18:09:00.376162+0000","last_fullsized":"2024-05-08T18:09:00.376162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845410+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:09:00.845410+0000","last_peered":"2024-05-08T18:09:00.845410+0000","last_clean":"2024-05-08T18:09:00.845410+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:09:00.845410+0000","last_undegraded":"2024-05-08T18:09:00.845410+0000","last_fullsized":"2024-05-08T18:09:00.845410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064097+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:09:01.064097+0000","last_peered":"2024-05-08T18:09:01.064097+0000","last_clean":"2024-05-08T18:09:01.064097+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:09:01.064097+0000","last_undegraded":"2024-05-08T18:09:01.064097+0000","last_fullsized":"2024-05-08T18:09:01.064097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059894+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:09:01.059894+0000","last_peered":"2024-05-08T18:09:01.059894+0000","last_clean":"2024-05-08T18:09:01.059894+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:09:01.059894+0000","last_undegraded":"2024-05-08T18:09:01.059894+0000","last_fullsized":"2024-05-08T18:09:01.059894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.066706+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:09:01.066706+0000","last_peered":"2024-05-08T18:09:01.066706+0000","last_clean":"2024-05-08T18:09:01.066706+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:09:01.066706+0000","last_undegraded":"2024-05-08T18:09:01.066706+0000","last_fullsized":"2024-05-08T18:09:01.066706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064458+0000","last_change":"2024-05-08T18:07:15.480500+0000","last_active":"2024-05-08T18:09:01.064458+0000","last_peered":"2024-05-08T18:09:01.064458+0000","last_clean":"2024-05-08T18:09:01.064458+0000","last_became_active":"2024-05-08T18:07:15.480192+0000","last_became_peered":"2024-05-08T18:07:15.480192+0000","last_unstale":"2024-05-08T18:09:01.064458+0000","last_undegraded":"2024-05-08T18:09:01.064458+0000","last_fullsized":"2024-05-08T18:09:01.064458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061112+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:09:01.061112+0000","last_peered":"2024-05-08T18:09:01.061112+0000","last_clean":"2024-05-08T18:09:01.061112+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:09:01.061112+0000","last_undegraded":"2024-05-08T18:09:01.061112+0000","last_fullsized":"2024-05-08T18:09:01.061112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851370+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:09:00.851370+0000","last_peered":"2024-05-08T18:09:00.851370+0000","last_clean":"2024-05-08T18:09:00.851370+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:09:00.851370+0000","last_undegraded":"2024-05-08T18:09:00.851370+0000","last_fullsized":"2024-05-08T18:09:00.851370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.058601+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:09:01.058601+0000","last_peered":"2024-05-08T18:09:01.058601+0000","last_clean":"2024-05-08T18:09:01.058601+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:09:01.058601+0000","last_undegraded":"2024-05-08T18:09:01.058601+0000","last_fullsized":"2024-05-08T18:09:01.058601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065604+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:09:01.065604+0000","last_peered":"2024-05-08T18:09:01.065604+0000","last_clean":"2024-05-08T18:09:01.065604+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:09:01.065604+0000","last_undegraded":"2024-05-08T18:09:01.065604+0000","last_fullsized":"2024-05-08T18:09:01.065604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844180+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:09:00.844180+0000","last_peered":"2024-05-08T18:09:00.844180+0000","last_clean":"2024-05-08T18:09:00.844180+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:09:00.844180+0000","last_undegraded":"2024-05-08T18:09:00.844180+0000","last_fullsized":"2024-05-08T18:09:00.844180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376525+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:09:00.376525+0000","last_peered":"2024-05-08T18:09:00.376525+0000","last_clean":"2024-05-08T18:09:00.376525+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:09:00.376525+0000","last_undegraded":"2024-05-08T18:09:00.376525+0000","last_fullsized":"2024-05-08T18:09:00.376525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853029+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:09:00.853029+0000","last_peered":"2024-05-08T18:09:00.853029+0000","last_clean":"2024-05-08T18:09:00.853029+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:09:00.853029+0000","last_undegraded":"2024-05-08T18:09:00.853029+0000","last_fullsized":"2024-05-08T18:09:00.853029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843908+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:09:00.843908+0000","last_peered":"2024-05-08T18:09:00.843908+0000","last_clean":"2024-05-08T18:09:00.843908+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:09:00.843908+0000","last_undegraded":"2024-05-08T18:09:00.843908+0000","last_fullsized":"2024-05-08T18:09:00.843908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375792+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:09:00.375792+0000","last_peered":"2024-05-08T18:09:00.375792+0000","last_clean":"2024-05-08T18:09:00.375792+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:09:00.375792+0000","last_undegraded":"2024-05-08T18:09:00.375792+0000","last_fullsized":"2024-05-08T18:09:00.375792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376865+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:09:00.376865+0000","last_peered":"2024-05-08T18:09:00.376865+0000","last_clean":"2024-05-08T18:09:00.376865+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:09:00.376865+0000","last_undegraded":"2024-05-08T18:09:00.376865+0000","last_fullsized":"2024-05-08T18:09:00.376865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851449+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:09:00.851449+0000","last_peered":"2024-05-08T18:09:00.851449+0000","last_clean":"2024-05-08T18:09:00.851449+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:09:00.851449+0000","last_undegraded":"2024-05-08T18:09:00.851449+0000","last_fullsized":"2024-05-08T18:09:00.851449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065525+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:09:01.065525+0000","last_peered":"2024-05-08T18:09:01.065525+0000","last_clean":"2024-05-08T18:09:01.065525+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:09:01.065525+0000","last_undegraded":"2024-05-08T18:09:01.065525+0000","last_fullsized":"2024-05-08T18:09:01.065525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060791+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:09:01.060791+0000","last_peered":"2024-05-08T18:09:01.060791+0000","last_clean":"2024-05-08T18:09:01.060791+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:09:01.060791+0000","last_undegraded":"2024-05-08T18:09:01.060791+0000","last_fullsized":"2024-05-08T18:09:01.060791+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":113,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060612+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:09:01.060612+0000","last_peered":"2024-05-08T18:09:01.060612+0000","last_clean":"2024-05-08T18:09:01.060612+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:09:01.060612+0000","last_undegraded":"2024-05-08T18:09:01.060612+0000","last_fullsized":"2024-05-08T18:09:01.060612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851140+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:09:00.851140+0000","last_peered":"2024-05-08T18:09:00.851140+0000","last_clean":"2024-05-08T18:09:00.851140+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:09:00.851140+0000","last_undegraded":"2024-05-08T18:09:00.851140+0000","last_fullsized":"2024-05-08T18:09:00.851140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853600+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:09:00.853600+0000","last_peered":"2024-05-08T18:09:00.853600+0000","last_clean":"2024-05-08T18:09:00.853600+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:09:00.853600+0000","last_undegraded":"2024-05-08T18:09:00.853600+0000","last_fullsized":"2024-05-08T18:09:00.853600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844715+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:09:00.844715+0000","last_peered":"2024-05-08T18:09:00.844715+0000","last_clean":"2024-05-08T18:09:00.844715+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:09:00.844715+0000","last_undegraded":"2024-05-08T18:09:00.844715+0000","last_fullsized":"2024-05-08T18:09:00.844715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.068029+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:09:01.068029+0000","last_peered":"2024-05-08T18:09:01.068029+0000","last_clean":"2024-05-08T18:09:01.068029+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:09:01.068029+0000","last_undegraded":"2024-05-08T18:09:01.068029+0000","last_fullsized":"2024-05-08T18:09:01.068029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.066521+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:09:01.066521+0000","last_peered":"2024-05-08T18:09:01.066521+0000","last_clean":"2024-05-08T18:09:01.066521+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:09:01.066521+0000","last_undegraded":"2024-05-08T18:09:01.066521+0000","last_fullsized":"2024-05-08T18:09:01.066521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843529+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:09:00.843529+0000","last_peered":"2024-05-08T18:09:00.843529+0000","last_clean":"2024-05-08T18:09:00.843529+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:09:00.843529+0000","last_undegraded":"2024-05-08T18:09:00.843529+0000","last_fullsized":"2024-05-08T18:09:00.843529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059428+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:09:01.059428+0000","last_peered":"2024-05-08T18:09:01.059428+0000","last_clean":"2024-05-08T18:09:01.059428+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:09:01.059428+0000","last_undegraded":"2024-05-08T18:09:01.059428+0000","last_fullsized":"2024-05-08T18:09:01.059428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065604+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:09:01.065604+0000","last_peered":"2024-05-08T18:09:01.065604+0000","last_clean":"2024-05-08T18:09:01.065604+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:09:01.065604+0000","last_undegraded":"2024-05-08T18:09:01.065604+0000","last_fullsized":"2024-05-08T18:09:01.065604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842743+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:09:00.842743+0000","last_peered":"2024-05-08T18:09:00.842743+0000","last_clean":"2024-05-08T18:09:00.842743+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:09:00.842743+0000","last_undegraded":"2024-05-08T18:09:00.842743+0000","last_fullsized":"2024-05-08T18:09:00.842743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376735+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:09:00.376735+0000","last_peered":"2024-05-08T18:09:00.376735+0000","last_clean":"2024-05-08T18:09:00.376735+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:09:00.376735+0000","last_undegraded":"2024-05-08T18:09:00.376735+0000","last_fullsized":"2024-05-08T18:09:00.376735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843802+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:09:00.843802+0000","last_peered":"2024-05-08T18:09:00.843802+0000","last_clean":"2024-05-08T18:09:00.843802+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:09:00.843802+0000","last_undegraded":"2024-05-08T18:09:00.843802+0000","last_fullsized":"2024-05-08T18:09:00.843802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065241+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:09:01.065241+0000","last_peered":"2024-05-08T18:09:01.065241+0000","last_clean":"2024-05-08T18:09:01.065241+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:09:01.065241+0000","last_undegraded":"2024-05-08T18:09:01.065241+0000","last_fullsized":"2024-05-08T18:09:01.065241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376186+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:09:00.376186+0000","last_peered":"2024-05-08T18:09:00.376186+0000","last_clean":"2024-05-08T18:09:00.376186+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:09:00.376186+0000","last_undegraded":"2024-05-08T18:09:00.376186+0000","last_fullsized":"2024-05-08T18:09:00.376186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064493+0000","last_change":"2024-05-08T18:07:55.357969+0000","last_active":"2024-05-08T18:09:01.064493+0000","last_peered":"2024-05-08T18:09:01.064493+0000","last_clean":"2024-05-08T18:09:01.064493+0000","last_became_active":"2024-05-08T18:07:55.357205+0000","last_became_peered":"2024-05-08T18:07:55.357205+0000","last_unstale":"2024-05-08T18:09:01.064493+0000","last_undegraded":"2024-05-08T18:09:01.064493+0000","last_fullsized":"2024-05-08T18:09:01.064493+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:04.667292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843604+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:09:00.843604+0000","last_peered":"2024-05-08T18:09:00.843604+0000","last_clean":"2024-05-08T18:09:00.843604+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:09:00.843604+0000","last_undegraded":"2024-05-08T18:09:00.843604+0000","last_fullsized":"2024-05-08T18:09:00.843604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":146,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375865+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:09:00.375865+0000","last_peered":"2024-05-08T18:09:00.375865+0000","last_clean":"2024-05-08T18:09:00.375865+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:09:00.375865+0000","last_undegraded":"2024-05-08T18:09:00.375865+0000","last_fullsized":"2024-05-08T18:09:00.375865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371877+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:09:01.371877+0000","last_peered":"2024-05-08T18:09:01.371877+0000","last_clean":"2024-05-08T18:09:01.371877+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:09:01.371877+0000","last_undegraded":"2024-05-08T18:09:01.371877+0000","last_fullsized":"2024-05-08T18:09:01.371877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376383+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:09:00.376383+0000","last_peered":"2024-05-08T18:09:00.376383+0000","last_clean":"2024-05-08T18:09:00.376383+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:09:00.376383+0000","last_undegraded":"2024-05-08T18:09:00.376383+0000","last_fullsized":"2024-05-08T18:09:00.376383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059098+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:09:01.059098+0000","last_peered":"2024-05-08T18:09:01.059098+0000","last_clean":"2024-05-08T18:09:01.059098+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:09:01.059098+0000","last_undegraded":"2024-05-08T18:09:01.059098+0000","last_fullsized":"2024-05-08T18:09:01.059098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844012+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:09:00.844012+0000","last_peered":"2024-05-08T18:09:00.844012+0000","last_clean":"2024-05-08T18:09:00.844012+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:09:00.844012+0000","last_undegraded":"2024-05-08T18:09:00.844012+0000","last_fullsized":"2024-05-08T18:09:00.844012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063106+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:09:01.063106+0000","last_peered":"2024-05-08T18:09:01.063106+0000","last_clean":"2024-05-08T18:09:01.063106+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:09:01.063106+0000","last_undegraded":"2024-05-08T18:09:01.063106+0000","last_fullsized":"2024-05-08T18:09:01.063106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064810+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:09:01.064810+0000","last_peered":"2024-05-08T18:09:01.064810+0000","last_clean":"2024-05-08T18:09:01.064810+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:09:01.064810+0000","last_undegraded":"2024-05-08T18:09:01.064810+0000","last_fullsized":"2024-05-08T18:09:01.064810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063044+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:09:01.063044+0000","last_peered":"2024-05-08T18:09:01.063044+0000","last_clean":"2024-05-08T18:09:01.063044+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:09:01.063044+0000","last_undegraded":"2024-05-08T18:09:01.063044+0000","last_fullsized":"2024-05-08T18:09:01.063044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844962+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:09:00.844962+0000","last_peered":"2024-05-08T18:09:00.844962+0000","last_clean":"2024-05-08T18:09:00.844962+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:09:00.844962+0000","last_undegraded":"2024-05-08T18:09:00.844962+0000","last_fullsized":"2024-05-08T18:09:00.844962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845453+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:09:00.845453+0000","last_peered":"2024-05-08T18:09:00.845453+0000","last_clean":"2024-05-08T18:09:00.845453+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:09:00.845453+0000","last_undegraded":"2024-05-08T18:09:00.845453+0000","last_fullsized":"2024-05-08T18:09:00.845453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844677+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:09:00.844677+0000","last_peered":"2024-05-08T18:09:00.844677+0000","last_clean":"2024-05-08T18:09:00.844677+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:09:00.844677+0000","last_undegraded":"2024-05-08T18:09:00.844677+0000","last_fullsized":"2024-05-08T18:09:00.844677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064333+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:09:01.064333+0000","last_peered":"2024-05-08T18:09:01.064333+0000","last_clean":"2024-05-08T18:09:01.064333+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:09:01.064333+0000","last_undegraded":"2024-05-08T18:09:01.064333+0000","last_fullsized":"2024-05-08T18:09:01.064333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844314+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:09:00.844314+0000","last_peered":"2024-05-08T18:09:00.844314+0000","last_clean":"2024-05-08T18:09:00.844314+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:09:00.844314+0000","last_undegraded":"2024-05-08T18:09:00.844314+0000","last_fullsized":"2024-05-08T18:09:00.844314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850549+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:09:00.850549+0000","last_peered":"2024-05-08T18:09:00.850549+0000","last_clean":"2024-05-08T18:09:00.850549+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:09:00.850549+0000","last_undegraded":"2024-05-08T18:09:00.850549+0000","last_fullsized":"2024-05-08T18:09:00.850549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853117+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:09:00.853117+0000","last_peered":"2024-05-08T18:09:00.853117+0000","last_clean":"2024-05-08T18:09:00.853117+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:09:00.853117+0000","last_undegraded":"2024-05-08T18:09:00.853117+0000","last_fullsized":"2024-05-08T18:09:00.853117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852359+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:09:00.852359+0000","last_peered":"2024-05-08T18:09:00.852359+0000","last_clean":"2024-05-08T18:09:00.852359+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:09:00.852359+0000","last_undegraded":"2024-05-08T18:09:00.852359+0000","last_fullsized":"2024-05-08T18:09:00.852359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376737+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:09:00.376737+0000","last_peered":"2024-05-08T18:09:00.376737+0000","last_clean":"2024-05-08T18:09:00.376737+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:09:00.376737+0000","last_undegraded":"2024-05-08T18:09:00.376737+0000","last_fullsized":"2024-05-08T18:09:00.376737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063873+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:09:01.063873+0000","last_peered":"2024-05-08T18:09:01.063873+0000","last_clean":"2024-05-08T18:09:01.063873+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:09:01.063873+0000","last_undegraded":"2024-05-08T18:09:01.063873+0000","last_fullsized":"2024-05-08T18:09:01.063873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850786+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:09:00.850786+0000","last_peered":"2024-05-08T18:09:00.850786+0000","last_clean":"2024-05-08T18:09:00.850786+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:09:00.850786+0000","last_undegraded":"2024-05-08T18:09:00.850786+0000","last_fullsized":"2024-05-08T18:09:00.850786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.062962+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:09:01.062962+0000","last_peered":"2024-05-08T18:09:01.062962+0000","last_clean":"2024-05-08T18:09:01.062962+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:09:01.062962+0000","last_undegraded":"2024-05-08T18:09:01.062962+0000","last_fullsized":"2024-05-08T18:09:01.062962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373871+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:09:01.373871+0000","last_peered":"2024-05-08T18:09:01.373871+0000","last_clean":"2024-05-08T18:09:01.373871+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:09:01.373871+0000","last_undegraded":"2024-05-08T18:09:01.373871+0000","last_fullsized":"2024-05-08T18:09:01.373871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060404+0000","last_change":"2024-05-08T18:07:55.356946+0000","last_active":"2024-05-08T18:09:01.060404+0000","last_peered":"2024-05-08T18:09:01.060404+0000","last_clean":"2024-05-08T18:09:01.060404+0000","last_became_active":"2024-05-08T18:07:55.355948+0000","last_became_peered":"2024-05-08T18:07:55.355948+0000","last_unstale":"2024-05-08T18:09:01.060404+0000","last_undegraded":"2024-05-08T18:09:01.060404+0000","last_fullsized":"2024-05-08T18:09:01.060404+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:04.163382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064246+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:09:01.064246+0000","last_peered":"2024-05-08T18:09:01.064246+0000","last_clean":"2024-05-08T18:09:01.064246+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:09:01.064246+0000","last_undegraded":"2024-05-08T18:09:01.064246+0000","last_fullsized":"2024-05-08T18:09:01.064246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.066923+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:09:01.066923+0000","last_peered":"2024-05-08T18:09:01.066923+0000","last_clean":"2024-05-08T18:09:01.066923+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:09:01.066923+0000","last_undegraded":"2024-05-08T18:09:01.066923+0000","last_fullsized":"2024-05-08T18:09:01.066923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060565+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:09:01.060565+0000","last_peered":"2024-05-08T18:09:01.060565+0000","last_clean":"2024-05-08T18:09:01.060565+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:09:01.060565+0000","last_undegraded":"2024-05-08T18:09:01.060565+0000","last_fullsized":"2024-05-08T18:09:01.060565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853947+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:09:00.853947+0000","last_peered":"2024-05-08T18:09:00.853947+0000","last_clean":"2024-05-08T18:09:00.853947+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:09:00.853947+0000","last_undegraded":"2024-05-08T18:09:00.853947+0000","last_fullsized":"2024-05-08T18:09:00.853947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060337+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:09:01.060337+0000","last_peered":"2024-05-08T18:09:01.060337+0000","last_clean":"2024-05-08T18:09:01.060337+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:09:01.060337+0000","last_undegraded":"2024-05-08T18:09:01.060337+0000","last_fullsized":"2024-05-08T18:09:01.060337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061202+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:09:01.061202+0000","last_peered":"2024-05-08T18:09:01.061202+0000","last_clean":"2024-05-08T18:09:01.061202+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:09:01.061202+0000","last_undegraded":"2024-05-08T18:09:01.061202+0000","last_fullsized":"2024-05-08T18:09:01.061202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845695+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:09:00.845695+0000","last_peered":"2024-05-08T18:09:00.845695+0000","last_clean":"2024-05-08T18:09:00.845695+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:09:00.845695+0000","last_undegraded":"2024-05-08T18:09:00.845695+0000","last_fullsized":"2024-05-08T18:09:00.845695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372091+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:09:01.372091+0000","last_peered":"2024-05-08T18:09:01.372091+0000","last_clean":"2024-05-08T18:09:01.372091+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:09:01.372091+0000","last_undegraded":"2024-05-08T18:09:01.372091+0000","last_fullsized":"2024-05-08T18:09:01.372091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064627+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:09:01.064627+0000","last_peered":"2024-05-08T18:09:01.064627+0000","last_clean":"2024-05-08T18:09:01.064627+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:09:01.064627+0000","last_undegraded":"2024-05-08T18:09:01.064627+0000","last_fullsized":"2024-05-08T18:09:01.064627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064391+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:09:01.064391+0000","last_peered":"2024-05-08T18:09:01.064391+0000","last_clean":"2024-05-08T18:09:01.064391+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:09:01.064391+0000","last_undegraded":"2024-05-08T18:09:01.064391+0000","last_fullsized":"2024-05-08T18:09:01.064391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.370828+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:09:01.370828+0000","last_peered":"2024-05-08T18:09:01.370828+0000","last_clean":"2024-05-08T18:09:01.370828+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:09:01.370828+0000","last_undegraded":"2024-05-08T18:09:01.370828+0000","last_fullsized":"2024-05-08T18:09:01.370828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061243+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:09:01.061243+0000","last_peered":"2024-05-08T18:09:01.061243+0000","last_clean":"2024-05-08T18:09:01.061243+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:09:01.061243+0000","last_undegraded":"2024-05-08T18:09:01.061243+0000","last_fullsized":"2024-05-08T18:09:01.061243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059883+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:09:01.059883+0000","last_peered":"2024-05-08T18:09:01.059883+0000","last_clean":"2024-05-08T18:09:01.059883+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:09:01.059883+0000","last_undegraded":"2024-05-08T18:09:01.059883+0000","last_fullsized":"2024-05-08T18:09:01.059883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376771+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:09:00.376771+0000","last_peered":"2024-05-08T18:09:00.376771+0000","last_clean":"2024-05-08T18:09:00.376771+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:09:00.376771+0000","last_undegraded":"2024-05-08T18:09:00.376771+0000","last_fullsized":"2024-05-08T18:09:00.376771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065337+0000","last_change":"2024-05-08T18:07:21.533056+0000","last_active":"2024-05-08T18:09:01.065337+0000","last_peered":"2024-05-08T18:09:01.065337+0000","last_clean":"2024-05-08T18:09:01.065337+0000","last_became_active":"2024-05-08T18:07:21.532184+0000","last_became_peered":"2024-05-08T18:07:21.532184+0000","last_unstale":"2024-05-08T18:09:01.065337+0000","last_undegraded":"2024-05-08T18:09:01.065337+0000","last_fullsized":"2024-05-08T18:09:01.065337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:50.629014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845045+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:09:00.845045+0000","last_peered":"2024-05-08T18:09:00.845045+0000","last_clean":"2024-05-08T18:09:00.845045+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:09:00.845045+0000","last_undegraded":"2024-05-08T18:09:00.845045+0000","last_fullsized":"2024-05-08T18:09:00.845045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059501+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:09:01.059501+0000","last_peered":"2024-05-08T18:09:01.059501+0000","last_clean":"2024-05-08T18:09:01.059501+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:09:01.059501+0000","last_undegraded":"2024-05-08T18:09:01.059501+0000","last_fullsized":"2024-05-08T18:09:01.059501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.374110+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:09:01.374110+0000","last_peered":"2024-05-08T18:09:01.374110+0000","last_clean":"2024-05-08T18:09:01.374110+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:09:01.374110+0000","last_undegraded":"2024-05-08T18:09:01.374110+0000","last_fullsized":"2024-05-08T18:09:01.374110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061023+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:09:01.061023+0000","last_peered":"2024-05-08T18:09:01.061023+0000","last_clean":"2024-05-08T18:09:01.061023+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:09:01.061023+0000","last_undegraded":"2024-05-08T18:09:01.061023+0000","last_fullsized":"2024-05-08T18:09:01.061023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061026+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:09:01.061026+0000","last_peered":"2024-05-08T18:09:01.061026+0000","last_clean":"2024-05-08T18:09:01.061026+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:09:01.061026+0000","last_undegraded":"2024-05-08T18:09:01.061026+0000","last_fullsized":"2024-05-08T18:09:01.061026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":143,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376506+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:09:00.376506+0000","last_peered":"2024-05-08T18:09:00.376506+0000","last_clean":"2024-05-08T18:09:00.376506+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:09:00.376506+0000","last_undegraded":"2024-05-08T18:09:00.376506+0000","last_fullsized":"2024-05-08T18:09:00.376506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844965+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:09:00.844965+0000","last_peered":"2024-05-08T18:09:00.844965+0000","last_clean":"2024-05-08T18:09:00.844965+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:09:00.844965+0000","last_undegraded":"2024-05-08T18:09:00.844965+0000","last_fullsized":"2024-05-08T18:09:00.844965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371799+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:09:01.371799+0000","last_peered":"2024-05-08T18:09:01.371799+0000","last_clean":"2024-05-08T18:09:01.371799+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:09:01.371799+0000","last_undegraded":"2024-05-08T18:09:01.371799+0000","last_fullsized":"2024-05-08T18:09:01.371799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845188+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:09:00.845188+0000","last_peered":"2024-05-08T18:09:00.845188+0000","last_clean":"2024-05-08T18:09:00.845188+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:09:00.845188+0000","last_undegraded":"2024-05-08T18:09:00.845188+0000","last_fullsized":"2024-05-08T18:09:00.845188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":230,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844587+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:09:00.844587+0000","last_peered":"2024-05-08T18:09:00.844587+0000","last_clean":"2024-05-08T18:09:00.844587+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:09:00.844587+0000","last_undegraded":"2024-05-08T18:09:00.844587+0000","last_fullsized":"2024-05-08T18:09:00.844587+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376336+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:09:00.376336+0000","last_peered":"2024-05-08T18:09:00.376336+0000","last_clean":"2024-05-08T18:09:00.376336+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:09:00.376336+0000","last_undegraded":"2024-05-08T18:09:00.376336+0000","last_fullsized":"2024-05-08T18:09:00.376336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064004+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:09:01.064004+0000","last_peered":"2024-05-08T18:09:01.064004+0000","last_clean":"2024-05-08T18:09:01.064004+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:09:01.064004+0000","last_undegraded":"2024-05-08T18:09:01.064004+0000","last_fullsized":"2024-05-08T18:09:01.064004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843389+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:09:00.843389+0000","last_peered":"2024-05-08T18:09:00.843389+0000","last_clean":"2024-05-08T18:09:00.843389+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:09:00.843389+0000","last_undegraded":"2024-05-08T18:09:00.843389+0000","last_fullsized":"2024-05-08T18:09:00.843389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":142,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376993+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:09:00.376993+0000","last_peered":"2024-05-08T18:09:00.376993+0000","last_clean":"2024-05-08T18:09:00.376993+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:09:00.376993+0000","last_undegraded":"2024-05-08T18:09:00.376993+0000","last_fullsized":"2024-05-08T18:09:00.376993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853195+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:09:00.853195+0000","last_peered":"2024-05-08T18:09:00.853195+0000","last_clean":"2024-05-08T18:09:00.853195+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:09:00.853195+0000","last_undegraded":"2024-05-08T18:09:00.853195+0000","last_fullsized":"2024-05-08T18:09:00.853195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842692+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:09:00.842692+0000","last_peered":"2024-05-08T18:09:00.842692+0000","last_clean":"2024-05-08T18:09:00.842692+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:09:00.842692+0000","last_undegraded":"2024-05-08T18:09:00.842692+0000","last_fullsized":"2024-05-08T18:09:00.842692+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853478+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:09:00.853478+0000","last_peered":"2024-05-08T18:09:00.853478+0000","last_clean":"2024-05-08T18:09:00.853478+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:09:00.853478+0000","last_undegraded":"2024-05-08T18:09:00.853478+0000","last_fullsized":"2024-05-08T18:09:00.853478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843318+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:09:00.843318+0000","last_peered":"2024-05-08T18:09:00.843318+0000","last_clean":"2024-05-08T18:09:00.843318+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:09:00.843318+0000","last_undegraded":"2024-05-08T18:09:00.843318+0000","last_fullsized":"2024-05-08T18:09:00.843318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850874+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:09:00.850874+0000","last_peered":"2024-05-08T18:09:00.850874+0000","last_clean":"2024-05-08T18:09:00.850874+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:09:00.850874+0000","last_undegraded":"2024-05-08T18:09:00.850874+0000","last_fullsized":"2024-05-08T18:09:00.850874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.377151+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:09:00.377151+0000","last_peered":"2024-05-08T18:09:00.377151+0000","last_clean":"2024-05-08T18:09:00.377151+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:09:00.377151+0000","last_undegraded":"2024-05-08T18:09:00.377151+0000","last_fullsized":"2024-05-08T18:09:00.377151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":179,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372011+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:09:01.372011+0000","last_peered":"2024-05-08T18:09:01.372011+0000","last_clean":"2024-05-08T18:09:01.372011+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:09:01.372011+0000","last_undegraded":"2024-05-08T18:09:01.372011+0000","last_fullsized":"2024-05-08T18:09:01.372011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843670+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:09:00.843670+0000","last_peered":"2024-05-08T18:09:00.843670+0000","last_clean":"2024-05-08T18:09:00.843670+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:09:00.843670+0000","last_undegraded":"2024-05-08T18:09:00.843670+0000","last_fullsized":"2024-05-08T18:09:00.843670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371210+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:09:01.371210+0000","last_peered":"2024-05-08T18:09:01.371210+0000","last_clean":"2024-05-08T18:09:01.371210+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:09:01.371210+0000","last_undegraded":"2024-05-08T18:09:01.371210+0000","last_fullsized":"2024-05-08T18:09:01.371210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.374184+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:09:01.374184+0000","last_peered":"2024-05-08T18:09:01.374184+0000","last_clean":"2024-05-08T18:09:01.374184+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:09:01.374184+0000","last_undegraded":"2024-05-08T18:09:01.374184+0000","last_fullsized":"2024-05-08T18:09:01.374184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063490+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:09:01.063490+0000","last_peered":"2024-05-08T18:09:01.063490+0000","last_clean":"2024-05-08T18:09:01.063490+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:09:01.063490+0000","last_undegraded":"2024-05-08T18:09:01.063490+0000","last_fullsized":"2024-05-08T18:09:01.063490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.370334+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:09:01.370334+0000","last_peered":"2024-05-08T18:09:01.370334+0000","last_clean":"2024-05-08T18:09:01.370334+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:09:01.370334+0000","last_undegraded":"2024-05-08T18:09:01.370334+0000","last_fullsized":"2024-05-08T18:09:01.370334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064497+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:09:01.064497+0000","last_peered":"2024-05-08T18:09:01.064497+0000","last_clean":"2024-05-08T18:09:01.064497+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:09:01.064497+0000","last_undegraded":"2024-05-08T18:09:01.064497+0000","last_fullsized":"2024-05-08T18:09:01.064497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":157,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844103+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:09:00.844103+0000","last_peered":"2024-05-08T18:09:00.844103+0000","last_clean":"2024-05-08T18:09:00.844103+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:09:00.844103+0000","last_undegraded":"2024-05-08T18:09:00.844103+0000","last_fullsized":"2024-05-08T18:09:00.844103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850615+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:09:00.850615+0000","last_peered":"2024-05-08T18:09:00.850615+0000","last_clean":"2024-05-08T18:09:00.850615+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:09:00.850615+0000","last_undegraded":"2024-05-08T18:09:00.850615+0000","last_fullsized":"2024-05-08T18:09:00.850615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064605+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:09:01.064605+0000","last_peered":"2024-05-08T18:09:01.064605+0000","last_clean":"2024-05-08T18:09:01.064605+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:09:01.064605+0000","last_undegraded":"2024-05-08T18:09:01.064605+0000","last_fullsized":"2024-05-08T18:09:01.064605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372258+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:09:01.372258+0000","last_peered":"2024-05-08T18:09:01.372258+0000","last_clean":"2024-05-08T18:09:01.372258+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:09:01.372258+0000","last_undegraded":"2024-05-08T18:09:01.372258+0000","last_fullsized":"2024-05-08T18:09:01.372258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376297+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:09:00.376297+0000","last_peered":"2024-05-08T18:09:00.376297+0000","last_clean":"2024-05-08T18:09:00.376297+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:09:00.376297+0000","last_undegraded":"2024-05-08T18:09:00.376297+0000","last_fullsized":"2024-05-08T18:09:00.376297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060627+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:09:01.060627+0000","last_peered":"2024-05-08T18:09:01.060627+0000","last_clean":"2024-05-08T18:09:01.060627+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:09:01.060627+0000","last_undegraded":"2024-05-08T18:09:01.060627+0000","last_fullsized":"2024-05-08T18:09:01.060627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852636+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:09:00.852636+0000","last_peered":"2024-05-08T18:09:00.852636+0000","last_clean":"2024-05-08T18:09:00.852636+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:09:00.852636+0000","last_undegraded":"2024-05-08T18:09:00.852636+0000","last_fullsized":"2024-05-08T18:09:00.852636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067671+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:09:01.067671+0000","last_peered":"2024-05-08T18:09:01.067671+0000","last_clean":"2024-05-08T18:09:01.067671+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:09:01.067671+0000","last_undegraded":"2024-05-08T18:09:01.067671+0000","last_fullsized":"2024-05-08T18:09:01.067671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":109,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845620+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:09:00.845620+0000","last_peered":"2024-05-08T18:09:00.845620+0000","last_clean":"2024-05-08T18:09:00.845620+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:09:00.845620+0000","last_undegraded":"2024-05-08T18:09:00.845620+0000","last_fullsized":"2024-05-08T18:09:00.845620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375710+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:09:00.375710+0000","last_peered":"2024-05-08T18:09:00.375710+0000","last_clean":"2024-05-08T18:09:00.375710+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:09:00.375710+0000","last_undegraded":"2024-05-08T18:09:00.375710+0000","last_fullsized":"2024-05-08T18:09:00.375710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371492+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:09:01.371492+0000","last_peered":"2024-05-08T18:09:01.371492+0000","last_clean":"2024-05-08T18:09:01.371492+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:09:01.371492+0000","last_undegraded":"2024-05-08T18:09:01.371492+0000","last_fullsized":"2024-05-08T18:09:01.371492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376996+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:09:00.376996+0000","last_peered":"2024-05-08T18:09:00.376996+0000","last_clean":"2024-05-08T18:09:00.376996+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:09:00.376996+0000","last_undegraded":"2024-05-08T18:09:00.376996+0000","last_fullsized":"2024-05-08T18:09:00.376996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372475+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:09:01.372475+0000","last_peered":"2024-05-08T18:09:01.372475+0000","last_clean":"2024-05-08T18:09:01.372475+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:09:01.372475+0000","last_undegraded":"2024-05-08T18:09:01.372475+0000","last_fullsized":"2024-05-08T18:09:01.372475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851930+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:09:00.851930+0000","last_peered":"2024-05-08T18:09:00.851930+0000","last_clean":"2024-05-08T18:09:00.851930+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:09:00.851930+0000","last_undegraded":"2024-05-08T18:09:00.851930+0000","last_fullsized":"2024-05-08T18:09:00.851930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":147,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850042+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:09:00.850042+0000","last_peered":"2024-05-08T18:09:00.850042+0000","last_clean":"2024-05-08T18:09:00.850042+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:09:00.850042+0000","last_undegraded":"2024-05-08T18:09:00.850042+0000","last_fullsized":"2024-05-08T18:09:00.850042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":113,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.058801+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:09:01.058801+0000","last_peered":"2024-05-08T18:09:01.058801+0000","last_clean":"2024-05-08T18:09:01.058801+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:09:01.058801+0000","last_undegraded":"2024-05-08T18:09:01.058801+0000","last_fullsized":"2024-05-08T18:09:01.058801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852898+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:09:00.852898+0000","last_peered":"2024-05-08T18:09:00.852898+0000","last_clean":"2024-05-08T18:09:00.852898+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:09:00.852898+0000","last_undegraded":"2024-05-08T18:09:00.852898+0000","last_fullsized":"2024-05-08T18:09:00.852898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852282+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:09:00.852282+0000","last_peered":"2024-05-08T18:09:00.852282+0000","last_clean":"2024-05-08T18:09:00.852282+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:09:00.852282+0000","last_undegraded":"2024-05-08T18:09:00.852282+0000","last_fullsized":"2024-05-08T18:09:00.852282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372331+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:09:01.372331+0000","last_peered":"2024-05-08T18:09:01.372331+0000","last_clean":"2024-05-08T18:09:01.372331+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:09:01.372331+0000","last_undegraded":"2024-05-08T18:09:01.372331+0000","last_fullsized":"2024-05-08T18:09:01.372331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845025+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:09:00.845025+0000","last_peered":"2024-05-08T18:09:00.845025+0000","last_clean":"2024-05-08T18:09:00.845025+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:09:00.845025+0000","last_undegraded":"2024-05-08T18:09:00.845025+0000","last_fullsized":"2024-05-08T18:09:00.845025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":118,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845023+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:09:00.845023+0000","last_peered":"2024-05-08T18:09:00.845023+0000","last_clean":"2024-05-08T18:09:00.845023+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:09:00.845023+0000","last_undegraded":"2024-05-08T18:09:00.845023+0000","last_fullsized":"2024-05-08T18:09:00.845023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.370545+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:09:01.370545+0000","last_peered":"2024-05-08T18:09:01.370545+0000","last_clean":"2024-05-08T18:09:01.370545+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:09:01.370545+0000","last_undegraded":"2024-05-08T18:09:01.370545+0000","last_fullsized":"2024-05-08T18:09:01.370545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375932+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:09:00.375932+0000","last_peered":"2024-05-08T18:09:00.375932+0000","last_clean":"2024-05-08T18:09:00.375932+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:09:00.375932+0000","last_undegraded":"2024-05-08T18:09:00.375932+0000","last_fullsized":"2024-05-08T18:09:00.375932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067921+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:09:01.067921+0000","last_peered":"2024-05-08T18:09:01.067921+0000","last_clean":"2024-05-08T18:09:01.067921+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:09:01.067921+0000","last_undegraded":"2024-05-08T18:09:01.067921+0000","last_fullsized":"2024-05-08T18:09:01.067921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060686+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:09:01.060686+0000","last_peered":"2024-05-08T18:09:01.060686+0000","last_clean":"2024-05-08T18:09:01.060686+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:09:01.060686+0000","last_undegraded":"2024-05-08T18:09:01.060686+0000","last_fullsized":"2024-05-08T18:09:01.060686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065476+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:09:01.065476+0000","last_peered":"2024-05-08T18:09:01.065476+0000","last_clean":"2024-05-08T18:09:01.065476+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:09:01.065476+0000","last_undegraded":"2024-05-08T18:09:01.065476+0000","last_fullsized":"2024-05-08T18:09:01.065476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373779+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:09:01.373779+0000","last_peered":"2024-05-08T18:09:01.373779+0000","last_clean":"2024-05-08T18:09:01.373779+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:09:01.373779+0000","last_undegraded":"2024-05-08T18:09:01.373779+0000","last_fullsized":"2024-05-08T18:09:01.373779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":121,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059095+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:09:01.059095+0000","last_peered":"2024-05-08T18:09:01.059095+0000","last_clean":"2024-05-08T18:09:01.059095+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:09:01.059095+0000","last_undegraded":"2024-05-08T18:09:01.059095+0000","last_fullsized":"2024-05-08T18:09:01.059095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059778+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:09:01.059778+0000","last_peered":"2024-05-08T18:09:01.059778+0000","last_clean":"2024-05-08T18:09:01.059778+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:09:01.059778+0000","last_undegraded":"2024-05-08T18:09:01.059778+0000","last_fullsized":"2024-05-08T18:09:01.059778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.065123+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:09:01.065123+0000","last_peered":"2024-05-08T18:09:01.065123+0000","last_clean":"2024-05-08T18:09:01.065123+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:09:01.065123+0000","last_undegraded":"2024-05-08T18:09:01.065123+0000","last_fullsized":"2024-05-08T18:09:01.065123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850698+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:09:00.850698+0000","last_peered":"2024-05-08T18:09:00.850698+0000","last_clean":"2024-05-08T18:09:00.850698+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:09:00.850698+0000","last_undegraded":"2024-05-08T18:09:00.850698+0000","last_fullsized":"2024-05-08T18:09:00.850698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059387+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:09:01.059387+0000","last_peered":"2024-05-08T18:09:01.059387+0000","last_clean":"2024-05-08T18:09:01.059387+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:09:01.059387+0000","last_undegraded":"2024-05-08T18:09:01.059387+0000","last_fullsized":"2024-05-08T18:09:01.059387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853675+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:09:00.853675+0000","last_peered":"2024-05-08T18:09:00.853675+0000","last_clean":"2024-05-08T18:09:00.853675+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:09:00.853675+0000","last_undegraded":"2024-05-08T18:09:00.853675+0000","last_fullsized":"2024-05-08T18:09:00.853675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845800+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:09:00.845800+0000","last_peered":"2024-05-08T18:09:00.845800+0000","last_clean":"2024-05-08T18:09:00.845800+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:09:00.845800+0000","last_undegraded":"2024-05-08T18:09:00.845800+0000","last_fullsized":"2024-05-08T18:09:00.845800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060563+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:09:01.060563+0000","last_peered":"2024-05-08T18:09:01.060563+0000","last_clean":"2024-05-08T18:09:01.060563+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:09:01.060563+0000","last_undegraded":"2024-05-08T18:09:01.060563+0000","last_fullsized":"2024-05-08T18:09:01.060563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":152,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843301+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:09:00.843301+0000","last_peered":"2024-05-08T18:09:00.843301+0000","last_clean":"2024-05-08T18:09:00.843301+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:09:00.843301+0000","last_undegraded":"2024-05-08T18:09:00.843301+0000","last_fullsized":"2024-05-08T18:09:00.843301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063774+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:09:01.063774+0000","last_peered":"2024-05-08T18:09:01.063774+0000","last_clean":"2024-05-08T18:09:01.063774+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:09:01.063774+0000","last_undegraded":"2024-05-08T18:09:01.063774+0000","last_fullsized":"2024-05-08T18:09:01.063774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376451+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:09:00.376451+0000","last_peered":"2024-05-08T18:09:00.376451+0000","last_clean":"2024-05-08T18:09:00.376451+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:09:00.376451+0000","last_undegraded":"2024-05-08T18:09:00.376451+0000","last_fullsized":"2024-05-08T18:09:00.376451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853824+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:09:00.853824+0000","last_peered":"2024-05-08T18:09:00.853824+0000","last_clean":"2024-05-08T18:09:00.853824+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:09:00.853824+0000","last_undegraded":"2024-05-08T18:09:00.853824+0000","last_fullsized":"2024-05-08T18:09:00.853824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059879+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:09:01.059879+0000","last_peered":"2024-05-08T18:09:01.059879+0000","last_clean":"2024-05-08T18:09:01.059879+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:09:01.059879+0000","last_undegraded":"2024-05-08T18:09:01.059879+0000","last_fullsized":"2024-05-08T18:09:01.059879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059792+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:09:01.059792+0000","last_peered":"2024-05-08T18:09:01.059792+0000","last_clean":"2024-05-08T18:09:01.059792+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:09:01.059792+0000","last_undegraded":"2024-05-08T18:09:01.059792+0000","last_fullsized":"2024-05-08T18:09:01.059792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371564+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:09:01.371564+0000","last_peered":"2024-05-08T18:09:01.371564+0000","last_clean":"2024-05-08T18:09:01.371564+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:09:01.371564+0000","last_undegraded":"2024-05-08T18:09:01.371564+0000","last_fullsized":"2024-05-08T18:09:01.371564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060195+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:09:01.060195+0000","last_peered":"2024-05-08T18:09:01.060195+0000","last_clean":"2024-05-08T18:09:01.060195+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:09:01.060195+0000","last_undegraded":"2024-05-08T18:09:01.060195+0000","last_fullsized":"2024-05-08T18:09:01.060195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060424+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:09:01.060424+0000","last_peered":"2024-05-08T18:09:01.060424+0000","last_clean":"2024-05-08T18:09:01.060424+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:09:01.060424+0000","last_undegraded":"2024-05-08T18:09:01.060424+0000","last_fullsized":"2024-05-08T18:09:01.060424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067450+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:09:01.067450+0000","last_peered":"2024-05-08T18:09:01.067450+0000","last_clean":"2024-05-08T18:09:01.067450+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:09:01.067450+0000","last_undegraded":"2024-05-08T18:09:01.067450+0000","last_fullsized":"2024-05-08T18:09:01.067450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371418+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:09:01.371418+0000","last_peered":"2024-05-08T18:09:01.371418+0000","last_clean":"2024-05-08T18:09:01.371418+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:09:01.371418+0000","last_undegraded":"2024-05-08T18:09:01.371418+0000","last_fullsized":"2024-05-08T18:09:01.371418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844543+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:09:00.844543+0000","last_peered":"2024-05-08T18:09:00.844543+0000","last_clean":"2024-05-08T18:09:00.844543+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:09:00.844543+0000","last_undegraded":"2024-05-08T18:09:00.844543+0000","last_fullsized":"2024-05-08T18:09:00.844543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064531+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:09:01.064531+0000","last_peered":"2024-05-08T18:09:01.064531+0000","last_clean":"2024-05-08T18:09:01.064531+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:09:01.064531+0000","last_undegraded":"2024-05-08T18:09:01.064531+0000","last_fullsized":"2024-05-08T18:09:01.064531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"48'5","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.850180+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:09:00.850180+0000","last_peered":"2024-05-08T18:09:00.850180+0000","last_clean":"2024-05-08T18:09:00.850180+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:09:00.850180+0000","last_undegraded":"2024-05-08T18:09:00.850180+0000","last_fullsized":"2024-05-08T18:09:00.850180+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":112,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843956+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:09:00.843956+0000","last_peered":"2024-05-08T18:09:00.843956+0000","last_clean":"2024-05-08T18:09:00.843956+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:09:00.843956+0000","last_undegraded":"2024-05-08T18:09:00.843956+0000","last_fullsized":"2024-05-08T18:09:00.843956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852550+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:09:00.852550+0000","last_peered":"2024-05-08T18:09:00.852550+0000","last_clean":"2024-05-08T18:09:00.852550+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:09:00.852550+0000","last_undegraded":"2024-05-08T18:09:00.852550+0000","last_fullsized":"2024-05-08T18:09:00.852550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063388+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:09:01.063388+0000","last_peered":"2024-05-08T18:09:01.063388+0000","last_clean":"2024-05-08T18:09:01.063388+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:09:01.063388+0000","last_undegraded":"2024-05-08T18:09:01.063388+0000","last_fullsized":"2024-05-08T18:09:01.063388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.377070+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:09:00.377070+0000","last_peered":"2024-05-08T18:09:00.377070+0000","last_clean":"2024-05-08T18:09:00.377070+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:09:00.377070+0000","last_undegraded":"2024-05-08T18:09:00.377070+0000","last_fullsized":"2024-05-08T18:09:00.377070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842876+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:09:00.842876+0000","last_peered":"2024-05-08T18:09:00.842876+0000","last_clean":"2024-05-08T18:09:00.842876+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:09:00.842876+0000","last_undegraded":"2024-05-08T18:09:00.842876+0000","last_fullsized":"2024-05-08T18:09:00.842876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064375+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:09:01.064375+0000","last_peered":"2024-05-08T18:09:01.064375+0000","last_clean":"2024-05-08T18:09:01.064375+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:09:01.064375+0000","last_undegraded":"2024-05-08T18:09:01.064375+0000","last_fullsized":"2024-05-08T18:09:01.064375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844839+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:09:00.844839+0000","last_peered":"2024-05-08T18:09:00.844839+0000","last_clean":"2024-05-08T18:09:00.844839+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:09:00.844839+0000","last_undegraded":"2024-05-08T18:09:00.844839+0000","last_fullsized":"2024-05-08T18:09:00.844839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376399+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:09:00.376399+0000","last_peered":"2024-05-08T18:09:00.376399+0000","last_clean":"2024-05-08T18:09:00.376399+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:09:00.376399+0000","last_undegraded":"2024-05-08T18:09:00.376399+0000","last_fullsized":"2024-05-08T18:09:00.376399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060803+0000","last_change":"2024-05-08T18:07:55.359230+0000","last_active":"2024-05-08T18:09:01.060803+0000","last_peered":"2024-05-08T18:09:01.060803+0000","last_clean":"2024-05-08T18:09:01.060803+0000","last_became_active":"2024-05-08T18:07:55.358047+0000","last_became_peered":"2024-05-08T18:07:55.358047+0000","last_unstale":"2024-05-08T18:09:01.060803+0000","last_undegraded":"2024-05-08T18:09:01.060803+0000","last_fullsized":"2024-05-08T18:09:01.060803+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:52.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.854254+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:09:00.854254+0000","last_peered":"2024-05-08T18:09:00.854254+0000","last_clean":"2024-05-08T18:09:00.854254+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:09:00.854254+0000","last_undegraded":"2024-05-08T18:09:00.854254+0000","last_fullsized":"2024-05-08T18:09:00.854254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":118,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843173+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:09:00.843173+0000","last_peered":"2024-05-08T18:09:00.843173+0000","last_clean":"2024-05-08T18:09:00.843173+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:09:00.843173+0000","last_undegraded":"2024-05-08T18:09:00.843173+0000","last_fullsized":"2024-05-08T18:09:00.843173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843271+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:09:00.843271+0000","last_peered":"2024-05-08T18:09:00.843271+0000","last_clean":"2024-05-08T18:09:00.843271+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:09:00.843271+0000","last_undegraded":"2024-05-08T18:09:00.843271+0000","last_fullsized":"2024-05-08T18:09:00.843271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851626+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:09:00.851626+0000","last_peered":"2024-05-08T18:09:00.851626+0000","last_clean":"2024-05-08T18:09:00.851626+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:09:00.851626+0000","last_undegraded":"2024-05-08T18:09:00.851626+0000","last_fullsized":"2024-05-08T18:09:00.851626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":121,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845712+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:09:00.845712+0000","last_peered":"2024-05-08T18:09:00.845712+0000","last_clean":"2024-05-08T18:09:00.845712+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:09:00.845712+0000","last_undegraded":"2024-05-08T18:09:00.845712+0000","last_fullsized":"2024-05-08T18:09:00.845712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060950+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:09:01.060950+0000","last_peered":"2024-05-08T18:09:01.060950+0000","last_clean":"2024-05-08T18:09:01.060950+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:09:01.060950+0000","last_undegraded":"2024-05-08T18:09:01.060950+0000","last_fullsized":"2024-05-08T18:09:01.060950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":121,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853275+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:09:00.853275+0000","last_peered":"2024-05-08T18:09:00.853275+0000","last_clean":"2024-05-08T18:09:00.853275+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:09:00.853275+0000","last_undegraded":"2024-05-08T18:09:00.853275+0000","last_fullsized":"2024-05-08T18:09:00.853275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372664+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:09:01.372664+0000","last_peered":"2024-05-08T18:09:01.372664+0000","last_clean":"2024-05-08T18:09:01.372664+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:09:01.372664+0000","last_undegraded":"2024-05-08T18:09:01.372664+0000","last_fullsized":"2024-05-08T18:09:01.372664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376482+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:09:00.376482+0000","last_peered":"2024-05-08T18:09:00.376482+0000","last_clean":"2024-05-08T18:09:00.376482+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:09:00.376482+0000","last_undegraded":"2024-05-08T18:09:00.376482+0000","last_fullsized":"2024-05-08T18:09:00.376482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063774+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:09:01.063774+0000","last_peered":"2024-05-08T18:09:01.063774+0000","last_clean":"2024-05-08T18:09:01.063774+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:09:01.063774+0000","last_undegraded":"2024-05-08T18:09:01.063774+0000","last_fullsized":"2024-05-08T18:09:01.063774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.853404+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:09:00.853404+0000","last_peered":"2024-05-08T18:09:00.853404+0000","last_clean":"2024-05-08T18:09:00.853404+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:09:00.853404+0000","last_undegraded":"2024-05-08T18:09:00.853404+0000","last_fullsized":"2024-05-08T18:09:00.853404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371115+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:09:01.371115+0000","last_peered":"2024-05-08T18:09:01.371115+0000","last_clean":"2024-05-08T18:09:01.371115+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:09:01.371115+0000","last_undegraded":"2024-05-08T18:09:01.371115+0000","last_fullsized":"2024-05-08T18:09:01.371115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":117,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845644+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:09:00.845644+0000","last_peered":"2024-05-08T18:09:00.845644+0000","last_clean":"2024-05-08T18:09:00.845644+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:09:00.845644+0000","last_undegraded":"2024-05-08T18:09:00.845644+0000","last_fullsized":"2024-05-08T18:09:00.845644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843269+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:09:00.843269+0000","last_peered":"2024-05-08T18:09:00.843269+0000","last_clean":"2024-05-08T18:09:00.843269+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:09:00.843269+0000","last_undegraded":"2024-05-08T18:09:00.843269+0000","last_fullsized":"2024-05-08T18:09:00.843269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372748+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:09:01.372748+0000","last_peered":"2024-05-08T18:09:01.372748+0000","last_clean":"2024-05-08T18:09:01.372748+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:09:01.372748+0000","last_undegraded":"2024-05-08T18:09:01.372748+0000","last_fullsized":"2024-05-08T18:09:01.372748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844529+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:09:00.844529+0000","last_peered":"2024-05-08T18:09:00.844529+0000","last_clean":"2024-05-08T18:09:00.844529+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:09:00.844529+0000","last_undegraded":"2024-05-08T18:09:00.844529+0000","last_fullsized":"2024-05-08T18:09:00.844529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067302+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:09:01.067302+0000","last_peered":"2024-05-08T18:09:01.067302+0000","last_clean":"2024-05-08T18:09:01.067302+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:09:01.067302+0000","last_undegraded":"2024-05-08T18:09:01.067302+0000","last_fullsized":"2024-05-08T18:09:01.067302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060191+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:09:01.060191+0000","last_peered":"2024-05-08T18:09:01.060191+0000","last_clean":"2024-05-08T18:09:01.060191+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:09:01.060191+0000","last_undegraded":"2024-05-08T18:09:01.060191+0000","last_fullsized":"2024-05-08T18:09:01.060191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":121,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060860+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:09:01.060860+0000","last_peered":"2024-05-08T18:09:01.060860+0000","last_clean":"2024-05-08T18:09:01.060860+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:09:01.060860+0000","last_undegraded":"2024-05-08T18:09:01.060860+0000","last_fullsized":"2024-05-08T18:09:01.060860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.068008+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:09:01.068008+0000","last_peered":"2024-05-08T18:09:01.068008+0000","last_clean":"2024-05-08T18:09:01.068008+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:09:01.068008+0000","last_undegraded":"2024-05-08T18:09:01.068008+0000","last_fullsized":"2024-05-08T18:09:01.068008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":114,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373382+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:09:01.373382+0000","last_peered":"2024-05-08T18:09:01.373382+0000","last_clean":"2024-05-08T18:09:01.373382+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:09:01.373382+0000","last_undegraded":"2024-05-08T18:09:01.373382+0000","last_fullsized":"2024-05-08T18:09:01.373382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":107,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.375902+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:09:00.375902+0000","last_peered":"2024-05-08T18:09:00.375902+0000","last_clean":"2024-05-08T18:09:00.375902+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:09:00.375902+0000","last_undegraded":"2024-05-08T18:09:00.375902+0000","last_fullsized":"2024-05-08T18:09:00.375902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.066781+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:09:01.066781+0000","last_peered":"2024-05-08T18:09:01.066781+0000","last_clean":"2024-05-08T18:09:01.066781+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:09:01.066781+0000","last_undegraded":"2024-05-08T18:09:01.066781+0000","last_fullsized":"2024-05-08T18:09:01.066781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851703+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:09:00.851703+0000","last_peered":"2024-05-08T18:09:00.851703+0000","last_clean":"2024-05-08T18:09:00.851703+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:09:00.851703+0000","last_undegraded":"2024-05-08T18:09:00.851703+0000","last_fullsized":"2024-05-08T18:09:00.851703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373006+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:09:01.373006+0000","last_peered":"2024-05-08T18:09:01.373006+0000","last_clean":"2024-05-08T18:09:01.373006+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:09:01.373006+0000","last_undegraded":"2024-05-08T18:09:01.373006+0000","last_fullsized":"2024-05-08T18:09:01.373006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060843+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:09:01.060843+0000","last_peered":"2024-05-08T18:09:01.060843+0000","last_clean":"2024-05-08T18:09:01.060843+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:09:01.060843+0000","last_undegraded":"2024-05-08T18:09:01.060843+0000","last_fullsized":"2024-05-08T18:09:01.060843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845417+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:09:00.845417+0000","last_peered":"2024-05-08T18:09:00.845417+0000","last_clean":"2024-05-08T18:09:00.845417+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:09:00.845417+0000","last_undegraded":"2024-05-08T18:09:00.845417+0000","last_fullsized":"2024-05-08T18:09:00.845417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842893+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:09:00.842893+0000","last_peered":"2024-05-08T18:09:00.842893+0000","last_clean":"2024-05-08T18:09:00.842893+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:09:00.842893+0000","last_undegraded":"2024-05-08T18:09:00.842893+0000","last_fullsized":"2024-05-08T18:09:00.842893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059692+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:09:01.059692+0000","last_peered":"2024-05-08T18:09:01.059692+0000","last_clean":"2024-05-08T18:09:01.059692+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:09:01.059692+0000","last_undegraded":"2024-05-08T18:09:01.059692+0000","last_fullsized":"2024-05-08T18:09:01.059692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376632+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:09:00.376632+0000","last_peered":"2024-05-08T18:09:00.376632+0000","last_clean":"2024-05-08T18:09:00.376632+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:09:00.376632+0000","last_undegraded":"2024-05-08T18:09:00.376632+0000","last_fullsized":"2024-05-08T18:09:00.376632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843596+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:09:00.843596+0000","last_peered":"2024-05-08T18:09:00.843596+0000","last_clean":"2024-05-08T18:09:00.843596+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:09:00.843596+0000","last_undegraded":"2024-05-08T18:09:00.843596+0000","last_fullsized":"2024-05-08T18:09:00.843596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376021+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:09:00.376021+0000","last_peered":"2024-05-08T18:09:00.376021+0000","last_clean":"2024-05-08T18:09:00.376021+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:09:00.376021+0000","last_undegraded":"2024-05-08T18:09:00.376021+0000","last_fullsized":"2024-05-08T18:09:00.376021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.849747+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:09:00.849747+0000","last_peered":"2024-05-08T18:09:00.849747+0000","last_clean":"2024-05-08T18:09:00.849747+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:09:00.849747+0000","last_undegraded":"2024-05-08T18:09:00.849747+0000","last_fullsized":"2024-05-08T18:09:00.849747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844359+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:09:00.844359+0000","last_peered":"2024-05-08T18:09:00.844359+0000","last_clean":"2024-05-08T18:09:00.844359+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:09:00.844359+0000","last_undegraded":"2024-05-08T18:09:00.844359+0000","last_fullsized":"2024-05-08T18:09:00.844359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059931+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:09:01.059931+0000","last_peered":"2024-05-08T18:09:01.059931+0000","last_clean":"2024-05-08T18:09:01.059931+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:09:01.059931+0000","last_undegraded":"2024-05-08T18:09:01.059931+0000","last_fullsized":"2024-05-08T18:09:01.059931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376868+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:09:00.376868+0000","last_peered":"2024-05-08T18:09:00.376868+0000","last_clean":"2024-05-08T18:09:00.376868+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:09:00.376868+0000","last_undegraded":"2024-05-08T18:09:00.376868+0000","last_fullsized":"2024-05-08T18:09:00.376868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376218+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:09:00.376218+0000","last_peered":"2024-05-08T18:09:00.376218+0000","last_clean":"2024-05-08T18:09:00.376218+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:09:00.376218+0000","last_undegraded":"2024-05-08T18:09:00.376218+0000","last_fullsized":"2024-05-08T18:09:00.376218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.849848+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:09:00.849848+0000","last_peered":"2024-05-08T18:09:00.849848+0000","last_clean":"2024-05-08T18:09:00.849848+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:09:00.849848+0000","last_undegraded":"2024-05-08T18:09:00.849848+0000","last_fullsized":"2024-05-08T18:09:00.849848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":110,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842918+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:09:00.842918+0000","last_peered":"2024-05-08T18:09:00.842918+0000","last_clean":"2024-05-08T18:09:00.842918+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:09:00.842918+0000","last_undegraded":"2024-05-08T18:09:00.842918+0000","last_fullsized":"2024-05-08T18:09:00.842918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067542+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:09:01.067542+0000","last_peered":"2024-05-08T18:09:01.067542+0000","last_clean":"2024-05-08T18:09:01.067542+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:09:01.067542+0000","last_undegraded":"2024-05-08T18:09:01.067542+0000","last_fullsized":"2024-05-08T18:09:01.067542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063510+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:09:01.063510+0000","last_peered":"2024-05-08T18:09:01.063510+0000","last_clean":"2024-05-08T18:09:01.063510+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:09:01.063510+0000","last_undegraded":"2024-05-08T18:09:01.063510+0000","last_fullsized":"2024-05-08T18:09:01.063510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373308+0000","last_change":"2024-05-08T18:07:55.439856+0000","last_active":"2024-05-08T18:09:01.373308+0000","last_peered":"2024-05-08T18:09:01.373308+0000","last_clean":"2024-05-08T18:09:01.373308+0000","last_became_active":"2024-05-08T18:07:55.439188+0000","last_became_peered":"2024-05-08T18:07:55.439188+0000","last_unstale":"2024-05-08T18:09:01.373308+0000","last_undegraded":"2024-05-08T18:09:01.373308+0000","last_fullsized":"2024-05-08T18:09:01.373308+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:40.273251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":121,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.058614+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:09:01.058614+0000","last_peered":"2024-05-08T18:09:01.058614+0000","last_clean":"2024-05-08T18:09:01.058614+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:09:01.058614+0000","last_undegraded":"2024-05-08T18:09:01.058614+0000","last_fullsized":"2024-05-08T18:09:01.058614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064985+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:09:01.064985+0000","last_peered":"2024-05-08T18:09:01.064985+0000","last_clean":"2024-05-08T18:09:01.064985+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:09:01.064985+0000","last_undegraded":"2024-05-08T18:09:01.064985+0000","last_fullsized":"2024-05-08T18:09:01.064985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":113,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059095+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:09:01.059095+0000","last_peered":"2024-05-08T18:09:01.059095+0000","last_clean":"2024-05-08T18:09:01.059095+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:09:01.059095+0000","last_undegraded":"2024-05-08T18:09:01.059095+0000","last_fullsized":"2024-05-08T18:09:01.059095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843958+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:09:00.843958+0000","last_peered":"2024-05-08T18:09:00.843958+0000","last_clean":"2024-05-08T18:09:00.843958+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:09:00.843958+0000","last_undegraded":"2024-05-08T18:09:00.843958+0000","last_fullsized":"2024-05-08T18:09:00.843958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059057+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:09:01.059057+0000","last_peered":"2024-05-08T18:09:01.059057+0000","last_clean":"2024-05-08T18:09:01.059057+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:09:01.059057+0000","last_undegraded":"2024-05-08T18:09:01.059057+0000","last_fullsized":"2024-05-08T18:09:01.059057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.854179+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:09:00.854179+0000","last_peered":"2024-05-08T18:09:00.854179+0000","last_clean":"2024-05-08T18:09:00.854179+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:09:00.854179+0000","last_undegraded":"2024-05-08T18:09:00.854179+0000","last_fullsized":"2024-05-08T18:09:00.854179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.370641+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:09:01.370641+0000","last_peered":"2024-05-08T18:09:01.370641+0000","last_clean":"2024-05-08T18:09:01.370641+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:09:01.370641+0000","last_undegraded":"2024-05-08T18:09:01.370641+0000","last_fullsized":"2024-05-08T18:09:01.370641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.059338+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:09:01.059338+0000","last_peered":"2024-05-08T18:09:01.059338+0000","last_clean":"2024-05-08T18:09:01.059338+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:09:01.059338+0000","last_undegraded":"2024-05-08T18:09:01.059338+0000","last_fullsized":"2024-05-08T18:09:01.059338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851548+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:09:00.851548+0000","last_peered":"2024-05-08T18:09:00.851548+0000","last_clean":"2024-05-08T18:09:00.851548+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:09:00.851548+0000","last_undegraded":"2024-05-08T18:09:00.851548+0000","last_fullsized":"2024-05-08T18:09:00.851548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060935+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:09:01.060935+0000","last_peered":"2024-05-08T18:09:01.060935+0000","last_clean":"2024-05-08T18:09:01.060935+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:09:01.060935+0000","last_undegraded":"2024-05-08T18:09:01.060935+0000","last_fullsized":"2024-05-08T18:09:01.060935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.374036+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:09:01.374036+0000","last_peered":"2024-05-08T18:09:01.374036+0000","last_clean":"2024-05-08T18:09:01.374036+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:09:01.374036+0000","last_undegraded":"2024-05-08T18:09:01.374036+0000","last_fullsized":"2024-05-08T18:09:01.374036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842720+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:09:00.842720+0000","last_peered":"2024-05-08T18:09:00.842720+0000","last_clean":"2024-05-08T18:09:00.842720+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:09:00.842720+0000","last_undegraded":"2024-05-08T18:09:00.842720+0000","last_fullsized":"2024-05-08T18:09:00.842720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373591+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:09:01.373591+0000","last_peered":"2024-05-08T18:09:01.373591+0000","last_clean":"2024-05-08T18:09:01.373591+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:09:01.373591+0000","last_undegraded":"2024-05-08T18:09:01.373591+0000","last_fullsized":"2024-05-08T18:09:01.373591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063374+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:09:01.063374+0000","last_peered":"2024-05-08T18:09:01.063374+0000","last_clean":"2024-05-08T18:09:01.063374+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:09:01.063374+0000","last_undegraded":"2024-05-08T18:09:01.063374+0000","last_fullsized":"2024-05-08T18:09:01.063374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376649+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:09:00.376649+0000","last_peered":"2024-05-08T18:09:00.376649+0000","last_clean":"2024-05-08T18:09:00.376649+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:09:00.376649+0000","last_undegraded":"2024-05-08T18:09:00.376649+0000","last_fullsized":"2024-05-08T18:09:00.376649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376179+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:09:00.376179+0000","last_peered":"2024-05-08T18:09:00.376179+0000","last_clean":"2024-05-08T18:09:00.376179+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:09:00.376179+0000","last_undegraded":"2024-05-08T18:09:00.376179+0000","last_fullsized":"2024-05-08T18:09:00.376179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.372401+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:09:01.372401+0000","last_peered":"2024-05-08T18:09:01.372401+0000","last_clean":"2024-05-08T18:09:01.372401+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:09:01.372401+0000","last_undegraded":"2024-05-08T18:09:01.372401+0000","last_fullsized":"2024-05-08T18:09:01.372401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851854+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:09:00.851854+0000","last_peered":"2024-05-08T18:09:00.851854+0000","last_clean":"2024-05-08T18:09:00.851854+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:09:00.851854+0000","last_undegraded":"2024-05-08T18:09:00.851854+0000","last_fullsized":"2024-05-08T18:09:00.851854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.064733+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:09:01.064733+0000","last_peered":"2024-05-08T18:09:01.064733+0000","last_clean":"2024-05-08T18:09:01.064733+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:09:01.064733+0000","last_undegraded":"2024-05-08T18:09:01.064733+0000","last_fullsized":"2024-05-08T18:09:01.064733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.068327+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:09:01.068327+0000","last_peered":"2024-05-08T18:09:01.068327+0000","last_clean":"2024-05-08T18:09:01.068327+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:09:01.068327+0000","last_undegraded":"2024-05-08T18:09:01.068327+0000","last_fullsized":"2024-05-08T18:09:01.068327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060189+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:09:01.060189+0000","last_peered":"2024-05-08T18:09:01.060189+0000","last_clean":"2024-05-08T18:09:01.060189+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:09:01.060189+0000","last_undegraded":"2024-05-08T18:09:01.060189+0000","last_fullsized":"2024-05-08T18:09:01.060189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.373214+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:09:01.373214+0000","last_peered":"2024-05-08T18:09:01.373214+0000","last_clean":"2024-05-08T18:09:01.373214+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:09:01.373214+0000","last_undegraded":"2024-05-08T18:09:01.373214+0000","last_fullsized":"2024-05-08T18:09:01.373214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063311+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:09:01.063311+0000","last_peered":"2024-05-08T18:09:01.063311+0000","last_clean":"2024-05-08T18:09:01.063311+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:09:01.063311+0000","last_undegraded":"2024-05-08T18:09:01.063311+0000","last_fullsized":"2024-05-08T18:09:01.063311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845502+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:09:00.845502+0000","last_peered":"2024-05-08T18:09:00.845502+0000","last_clean":"2024-05-08T18:09:00.845502+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:09:00.845502+0000","last_undegraded":"2024-05-08T18:09:00.845502+0000","last_fullsized":"2024-05-08T18:09:00.845502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.842645+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:09:00.842645+0000","last_peered":"2024-05-08T18:09:00.842645+0000","last_clean":"2024-05-08T18:09:00.842645+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:09:00.842645+0000","last_undegraded":"2024-05-08T18:09:00.842645+0000","last_fullsized":"2024-05-08T18:09:00.842645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067895+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:09:01.067895+0000","last_peered":"2024-05-08T18:09:01.067895+0000","last_clean":"2024-05-08T18:09:01.067895+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:09:01.067895+0000","last_undegraded":"2024-05-08T18:09:01.067895+0000","last_fullsized":"2024-05-08T18:09:01.067895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.854101+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:09:00.854101+0000","last_peered":"2024-05-08T18:09:00.854101+0000","last_clean":"2024-05-08T18:09:00.854101+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:09:00.854101+0000","last_undegraded":"2024-05-08T18:09:00.854101+0000","last_fullsized":"2024-05-08T18:09:00.854101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376335+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:09:00.376335+0000","last_peered":"2024-05-08T18:09:00.376335+0000","last_clean":"2024-05-08T18:09:00.376335+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:09:00.376335+0000","last_undegraded":"2024-05-08T18:09:00.376335+0000","last_fullsized":"2024-05-08T18:09:00.376335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.061143+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:09:01.061143+0000","last_peered":"2024-05-08T18:09:01.061143+0000","last_clean":"2024-05-08T18:09:01.061143+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:09:01.061143+0000","last_undegraded":"2024-05-08T18:09:01.061143+0000","last_fullsized":"2024-05-08T18:09:01.061143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063586+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:09:01.063586+0000","last_peered":"2024-05-08T18:09:01.063586+0000","last_clean":"2024-05-08T18:09:01.063586+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:09:01.063586+0000","last_undegraded":"2024-05-08T18:09:01.063586+0000","last_fullsized":"2024-05-08T18:09:01.063586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067087+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:09:01.067087+0000","last_peered":"2024-05-08T18:09:01.067087+0000","last_clean":"2024-05-08T18:09:01.067087+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:09:01.067087+0000","last_undegraded":"2024-05-08T18:09:01.067087+0000","last_fullsized":"2024-05-08T18:09:01.067087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063746+0000","last_change":"2024-05-08T18:07:55.445745+0000","last_active":"2024-05-08T18:09:01.063746+0000","last_peered":"2024-05-08T18:09:01.063746+0000","last_clean":"2024-05-08T18:09:01.063746+0000","last_became_active":"2024-05-08T18:07:55.444935+0000","last_became_peered":"2024-05-08T18:07:55.444935+0000","last_unstale":"2024-05-08T18:09:01.063746+0000","last_undegraded":"2024-05-08T18:09:01.063746+0000","last_fullsized":"2024-05-08T18:09:01.063746+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:37.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.060599+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:09:01.060599+0000","last_peered":"2024-05-08T18:09:01.060599+0000","last_clean":"2024-05-08T18:09:01.060599+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:09:01.060599+0000","last_undegraded":"2024-05-08T18:09:01.060599+0000","last_fullsized":"2024-05-08T18:09:01.060599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.852006+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:09:00.852006+0000","last_peered":"2024-05-08T18:09:00.852006+0000","last_clean":"2024-05-08T18:09:00.852006+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:09:00.852006+0000","last_undegraded":"2024-05-08T18:09:00.852006+0000","last_fullsized":"2024-05-08T18:09:00.852006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843480+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:09:00.843480+0000","last_peered":"2024-05-08T18:09:00.843480+0000","last_clean":"2024-05-08T18:09:00.843480+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:09:00.843480+0000","last_undegraded":"2024-05-08T18:09:00.843480+0000","last_fullsized":"2024-05-08T18:09:00.843480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.845868+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:09:00.845868+0000","last_peered":"2024-05-08T18:09:00.845868+0000","last_clean":"2024-05-08T18:09:00.845868+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:09:00.845868+0000","last_undegraded":"2024-05-08T18:09:00.845868+0000","last_fullsized":"2024-05-08T18:09:00.845868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.851060+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:09:00.851060+0000","last_peered":"2024-05-08T18:09:00.851060+0000","last_clean":"2024-05-08T18:09:00.851060+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:09:00.851060+0000","last_undegraded":"2024-05-08T18:09:00.851060+0000","last_fullsized":"2024-05-08T18:09:00.851060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.844910+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:09:00.844910+0000","last_peered":"2024-05-08T18:09:00.844910+0000","last_clean":"2024-05-08T18:09:00.844910+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:09:00.844910+0000","last_undegraded":"2024-05-08T18:09:00.844910+0000","last_fullsized":"2024-05-08T18:09:00.844910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.063233+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:09:01.063233+0000","last_peered":"2024-05-08T18:09:01.063233+0000","last_clean":"2024-05-08T18:09:01.063233+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:09:01.063233+0000","last_undegraded":"2024-05-08T18:09:01.063233+0000","last_fullsized":"2024-05-08T18:09:01.063233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.067263+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:09:01.067263+0000","last_peered":"2024-05-08T18:09:01.067263+0000","last_clean":"2024-05-08T18:09:01.067263+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:09:01.067263+0000","last_undegraded":"2024-05-08T18:09:01.067263+0000","last_fullsized":"2024-05-08T18:09:01.067263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.843086+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:09:00.843086+0000","last_peered":"2024-05-08T18:09:00.843086+0000","last_clean":"2024-05-08T18:09:00.843086+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:09:00.843086+0000","last_undegraded":"2024-05-08T18:09:00.843086+0000","last_fullsized":"2024-05-08T18:09:00.843086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.377222+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:09:00.377222+0000","last_peered":"2024-05-08T18:09:00.377222+0000","last_clean":"2024-05-08T18:09:00.377222+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:09:00.377222+0000","last_undegraded":"2024-05-08T18:09:00.377222+0000","last_fullsized":"2024-05-08T18:09:00.377222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":127,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376275+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:09:00.376275+0000","last_peered":"2024-05-08T18:09:00.376275+0000","last_clean":"2024-05-08T18:09:00.376275+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:09:00.376275+0000","last_undegraded":"2024-05-08T18:09:00.376275+0000","last_fullsized":"2024-05-08T18:09:00.376275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.854025+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:09:00.854025+0000","last_peered":"2024-05-08T18:09:00.854025+0000","last_clean":"2024-05-08T18:09:00.854025+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:09:00.854025+0000","last_undegraded":"2024-05-08T18:09:00.854025+0000","last_fullsized":"2024-05-08T18:09:00.854025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-08T18:09:01.371000+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:09:01.371000+0000","last_peered":"2024-05-08T18:09:01.371000+0000","last_clean":"2024-05-08T18:09:01.371000+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:09:01.371000+0000","last_undegraded":"2024-05-08T18:09:01.371000+0000","last_fullsized":"2024-05-08T18:09:01.371000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T18:09:00.376962+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:09:00.376962+0000","last_peered":"2024-05-08T18:09:00.376962+0000","last_clean":"2024-05-08T18:09:00.376962+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:09:00.376962+0000","last_undegraded":"2024-05-08T18:09:00.376962+0000","last_fullsized":"2024-05-08T18:09:00.376962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28580,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343260,"statfs":{"total":96636764160,"available":96607498240,"internally_reserved":0,"allocated":1593344,"data_stored":1123938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":532474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":534295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":962560,"data_stored":532965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":532870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":532036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":987136,"data_stored":532724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28560,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343280,"statfs":{"total":96636764160,"available":96607518720,"internally_reserved":0,"allocated":1572864,"data_stored":1123344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:09:03.813 INFO:tasks.thrashosds.thrasher:Setting 6.c to [1, 7] 2024-05-08T18:09:03.813 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '6.c', '1', '7'] 2024-05-08T18:09:03.813 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 6.c 1 7 2024-05-08T18:09:03.814 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:03.792+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:03.893 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:03.893+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:03.969 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:03.969 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:03.969 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:03.969 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:03.983 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:09:03.994 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:03.996+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:04.095 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:04.093+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:04.147 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:04.148 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:04.148 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:04.148 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:04.148 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:04.162 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:09:04.204 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:04.205+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:04.297 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:04.297+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:04.332 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:04.332 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:04.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:04.332 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:04.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.332 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4379.0:3 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-05-08T18:09:04.332 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:09:04.332 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.795830561, 2024-05-08T18:09:04.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046964590000000001, 2024-05-08T18:09:04.333 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.333 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.333 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:09:04.333 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:04.333 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4379", 2024-05-08T18:09:04.333 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/427078987", 2024-05-08T18:09:04.333 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 3 2024-05-08T18:09:04.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.333 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:09:04.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534903+0000", 2024-05-08T18:09:04.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534906+0000", 2024-05-08T18:09:04.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1030000000000002e-06 2024-05-08T18:09:04.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534918+0000", 2024-05-08T18:09:04.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1732999999999999e-05 2024-05-08T18:09:04.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534950+0000", 2024-05-08T18:09:04.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1420000000000001e-05 2024-05-08T18:09:04.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.534974+0000", 2024-05-08T18:09:04.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4473000000000001e-05 2024-05-08T18:09:04.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.539338+0000", 2024-05-08T18:09:04.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043636719999999999 2024-05-08T18:09:04.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:19.539600+0000", 2024-05-08T18:09:04.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026205800000000002 2024-05-08T18:09:04.336 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.336 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.336 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.336 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:09:04.336 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:09:04.336 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.762756897, 2024-05-08T18:09:04.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054299370000000001, 2024-05-08T18:09:04.336 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.336 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.337 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.337 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:04.337 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:04.337 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:04.337 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 48 2024-05-08T18:09:04.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.337 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:09:04.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567977+0000", 2024-05-08T18:09:04.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567980+0000", 2024-05-08T18:09:04.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.554e-06 2024-05-08T18:09:04.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567990+0000", 2024-05-08T18:09:04.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0961999999999999e-05 2024-05-08T18:09:04.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568023+0000", 2024-05-08T18:09:04.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441999999999999e-05 2024-05-08T18:09:04.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568042+0000", 2024-05-08T18:09:04.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8760999999999999e-05 2024-05-08T18:09:04.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568165+0000", 2024-05-08T18:09:04.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012333400000000001 2024-05-08T18:09:04.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568426+0000", 2024-05-08T18:09:04.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026132999999999999 2024-05-08T18:09:04.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:04.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.568666+0000", 2024-05-08T18:09:04.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024009500000000001 2024-05-08T18:09:04.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:04.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.569886+0000", 2024-05-08T18:09:04.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012194790000000001 2024-05-08T18:09:04.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:04.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573254+0000", 2024-05-08T18:09:04.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033677109999999998 2024-05-08T18:09:04.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573339+0000", 2024-05-08T18:09:04.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5666000000000003e-05 2024-05-08T18:09:04.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573407+0000", 2024-05-08T18:09:04.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7602999999999996e-05 2024-05-08T18:09:04.341 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.342 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.342 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.342 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94206896343168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:09:04.342 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:09:04.342 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.757076735, 2024-05-08T18:09:04.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054113640000000001, 2024-05-08T18:09:04.342 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.342 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.342 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.342 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:04.342 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:04.342 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:04.343 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 49 2024-05-08T18:09:04.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.343 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:09:04.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573657+0000", 2024-05-08T18:09:04.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573659+0000", 2024-05-08T18:09:04.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.762e-06 2024-05-08T18:09:04.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573667+0000", 2024-05-08T18:09:04.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8120000000000008e-06 2024-05-08T18:09:04.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573693+0000", 2024-05-08T18:09:04.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6057000000000001e-05 2024-05-08T18:09:04.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573710+0000", 2024-05-08T18:09:04.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7555999999999999e-05 2024-05-08T18:09:04.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.573851+0000", 2024-05-08T18:09:04.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014109800000000001 2024-05-08T18:09:04.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.574072+0000", 2024-05-08T18:09:04.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022062899999999999 2024-05-08T18:09:04.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:04.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.574500+0000", 2024-05-08T18:09:04.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042798100000000002 2024-05-08T18:09:04.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:04.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.575719+0000", 2024-05-08T18:09:04.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001218717 2024-05-08T18:09:04.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:04.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578840+0000", 2024-05-08T18:09:04.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031215380000000001 2024-05-08T18:09:04.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.578925+0000", 2024-05-08T18:09:04.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5191999999999993e-05 2024-05-08T18:09:04.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.579069+0000", 2024-05-08T18:09:04.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143022 2024-05-08T18:09:04.347 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.347 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.347 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.347 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:09:04.347 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:09:04.348 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.754288755999994, 2024-05-08T18:09:04.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034814389999999998, 2024-05-08T18:09:04.348 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.348 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.348 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.348 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:04.348 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:04.348 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:04.348 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 205 2024-05-08T18:09:04.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.348 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:09:04.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576445+0000", 2024-05-08T18:09:04.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576448+0000", 2024-05-08T18:09:04.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7839999999999999e-06 2024-05-08T18:09:04.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576462+0000", 2024-05-08T18:09:04.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4348999999999999e-05 2024-05-08T18:09:04.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576500+0000", 2024-05-08T18:09:04.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7252999999999997e-05 2024-05-08T18:09:04.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576528+0000", 2024-05-08T18:09:04.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8691e-05 2024-05-08T18:09:04.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576686+0000", 2024-05-08T18:09:04.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015810999999999999 2024-05-08T18:09:04.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.576927+0000", 2024-05-08T18:09:04.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000240337 2024-05-08T18:09:04.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:04.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.577354+0000", 2024-05-08T18:09:04.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042767499999999997 2024-05-08T18:09:04.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:04.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.578866+0000", 2024-05-08T18:09:04.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001511271 2024-05-08T18:09:04.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:04.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579762+0000", 2024-05-08T18:09:04.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089618599999999999 2024-05-08T18:09:04.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579858+0000", 2024-05-08T18:09:04.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6686000000000002e-05 2024-05-08T18:09:04.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.579927+0000", 2024-05-08T18:09:04.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8096999999999995e-05 2024-05-08T18:09:04.353 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.353 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.353 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.353 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:04.353 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:09:04.353 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.686292915999999, 2024-05-08T18:09:04.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035139590000000001, 2024-05-08T18:09:04.353 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.353 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.354 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.354 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:04.354 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:04.354 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:04.354 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 220 2024-05-08T18:09:04.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.354 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:09:04.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644441+0000", 2024-05-08T18:09:04.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644444+0000", 2024-05-08T18:09:04.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6759999999999999e-06 2024-05-08T18:09:04.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644455+0000", 2024-05-08T18:09:04.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:09:04.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644487+0000", 2024-05-08T18:09:04.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2199999999999997e-05 2024-05-08T18:09:04.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644503+0000", 2024-05-08T18:09:04.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5452e-05 2024-05-08T18:09:04.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644689+0000", 2024-05-08T18:09:04.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000186541 2024-05-08T18:09:04.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.644902+0000", 2024-05-08T18:09:04.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021321299999999999 2024-05-08T18:09:04.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:04.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.645299+0000", 2024-05-08T18:09:04.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039702699999999999 2024-05-08T18:09:04.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:04.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647459+0000", 2024-05-08T18:09:04.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021598279999999999 2024-05-08T18:09:04.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:04.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647803+0000", 2024-05-08T18:09:04.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034338199999999999 2024-05-08T18:09:04.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647888+0000", 2024-05-08T18:09:04.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5125999999999998e-05 2024-05-08T18:09:04.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.647955+0000", 2024-05-08T18:09:04.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7280999999999995e-05 2024-05-08T18:09:04.358 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.359 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.359 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.359 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:04.359 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:09:04.359 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.666428397000004, 2024-05-08T18:09:04.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003220367, 2024-05-08T18:09:04.359 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.359 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.359 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.359 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:04.359 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:04.360 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:04.360 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 225 2024-05-08T18:09:04.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.360 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:09:04.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664305+0000", 2024-05-08T18:09:04.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664308+0000", 2024-05-08T18:09:04.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1500000000000002e-06 2024-05-08T18:09:04.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664333+0000", 2024-05-08T18:09:04.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5361e-05 2024-05-08T18:09:04.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664362+0000", 2024-05-08T18:09:04.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8671999999999999e-05 2024-05-08T18:09:04.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664376+0000", 2024-05-08T18:09:04.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4741e-05 2024-05-08T18:09:04.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664541+0000", 2024-05-08T18:09:04.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016484400000000001 2024-05-08T18:09:04.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.664767+0000", 2024-05-08T18:09:04.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000226061 2024-05-08T18:09:04.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:04.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.665199+0000", 2024-05-08T18:09:04.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000431674 2024-05-08T18:09:04.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:04.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.666428+0000", 2024-05-08T18:09:04.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001228605 2024-05-08T18:09:04.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:04.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667367+0000", 2024-05-08T18:09:04.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093924199999999996 2024-05-08T18:09:04.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667461+0000", 2024-05-08T18:09:04.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3762000000000001e-05 2024-05-08T18:09:04.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.667526+0000", 2024-05-08T18:09:04.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5254999999999998e-05 2024-05-08T18:09:04.364 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.365 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.365 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.365 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:04.365 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:09:04.365 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.634200899000007, 2024-05-08T18:09:04.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037451559999999999, 2024-05-08T18:09:04.365 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.365 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.365 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.365 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:04.365 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:04.365 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:04.366 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 234 2024-05-08T18:09:04.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.366 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:09:04.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696533+0000", 2024-05-08T18:09:04.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696535+0000", 2024-05-08T18:09:04.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0760000000000001e-06 2024-05-08T18:09:04.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696546+0000", 2024-05-08T18:09:04.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0556e-05 2024-05-08T18:09:04.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696577+0000", 2024-05-08T18:09:04.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0904000000000001e-05 2024-05-08T18:09:04.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696592+0000", 2024-05-08T18:09:04.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5316e-05 2024-05-08T18:09:04.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.696731+0000", 2024-05-08T18:09:04.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138818 2024-05-08T18:09:04.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.697085+0000", 2024-05-08T18:09:04.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00035397800000000002 2024-05-08T18:09:04.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:04.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.697838+0000", 2024-05-08T18:09:04.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00075314800000000003 2024-05-08T18:09:04.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:04.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.699440+0000", 2024-05-08T18:09:04.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016023470000000001 2024-05-08T18:09:04.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:04.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700067+0000", 2024-05-08T18:09:04.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062698400000000003 2024-05-08T18:09:04.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700161+0000", 2024-05-08T18:09:04.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3762000000000001e-05 2024-05-08T18:09:04.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.700278+0000", 2024-05-08T18:09:04.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117267 2024-05-08T18:09:04.370 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.370 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.370 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.371 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:431 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:04.371 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:09:04.371 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.568708887, 2024-05-08T18:09:04.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040957049999999998, 2024-05-08T18:09:04.371 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.371 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.371 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.371 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:04.371 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:04.371 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:04.371 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 431 2024-05-08T18:09:04.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.371 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:09:04.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762025+0000", 2024-05-08T18:09:04.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762027+0000", 2024-05-08T18:09:04.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7889999999999999e-06 2024-05-08T18:09:04.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762036+0000", 2024-05-08T18:09:04.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6029999999999994e-06 2024-05-08T18:09:04.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762061+0000", 2024-05-08T18:09:04.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4831e-05 2024-05-08T18:09:04.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.762076+0000", 2024-05-08T18:09:04.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4996e-05 2024-05-08T18:09:04.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.763559+0000", 2024-05-08T18:09:04.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001482501 2024-05-08T18:09:04.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.763747+0000", 2024-05-08T18:09:04.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018864399999999999 2024-05-08T18:09:04.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:04.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.764172+0000", 2024-05-08T18:09:04.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042445900000000002 2024-05-08T18:09:04.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:04.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.765292+0000", 2024-05-08T18:09:04.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001120196 2024-05-08T18:09:04.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:04.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.765812+0000", 2024-05-08T18:09:04.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052044000000000005 2024-05-08T18:09:04.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.766007+0000", 2024-05-08T18:09:04.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019423500000000001 2024-05-08T18:09:04.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.766121+0000", 2024-05-08T18:09:04.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114011 2024-05-08T18:09:04.376 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.376 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.376 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.376 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:04.376 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:09:04.376 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.562051416000003, 2024-05-08T18:09:04.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031982880000000001, 2024-05-08T18:09:04.376 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.376 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.377 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.377 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:04.377 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:04.377 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:04.377 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 438 2024-05-08T18:09:04.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.377 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:09:04.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768682+0000", 2024-05-08T18:09:04.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768684+0000", 2024-05-08T18:09:04.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0049999999999999e-06 2024-05-08T18:09:04.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768697+0000", 2024-05-08T18:09:04.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2211e-05 2024-05-08T18:09:04.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768726+0000", 2024-05-08T18:09:04.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8949e-05 2024-05-08T18:09:04.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768743+0000", 2024-05-08T18:09:04.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7478000000000001e-05 2024-05-08T18:09:04.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.768852+0000", 2024-05-08T18:09:04.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010889499999999999 2024-05-08T18:09:04.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.769168+0000", 2024-05-08T18:09:04.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031610900000000002 2024-05-08T18:09:04.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:04.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.769542+0000", 2024-05-08T18:09:04.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037368299999999998 2024-05-08T18:09:04.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:04.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.770721+0000", 2024-05-08T18:09:04.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001179591 2024-05-08T18:09:04.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:04.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771722+0000", 2024-05-08T18:09:04.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001000463 2024-05-08T18:09:04.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771819+0000", 2024-05-08T18:09:04.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6909000000000003e-05 2024-05-08T18:09:04.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.771881+0000", 2024-05-08T18:09:04.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1995000000000005e-05 2024-05-08T18:09:04.382 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.382 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.382 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.382 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:477 6.4 e32/26 6:24c8e1ae:gc::gc.19:head v 32'12, mlcod=32'10)", 2024-05-08T18:09:04.382 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:09:04.382 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.539956387999993, 2024-05-08T18:09:04.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038511489999999999, 2024-05-08T18:09:04.382 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.382 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.382 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.382 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:09:04.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790777+0000", 2024-05-08T18:09:04.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790779+0000", 2024-05-08T18:09:04.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4559999999999999e-06 2024-05-08T18:09:04.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790791+0000", 2024-05-08T18:09:04.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1780000000000001e-05 2024-05-08T18:09:04.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790817+0000", 2024-05-08T18:09:04.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5874999999999999e-05 2024-05-08T18:09:04.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790832+0000", 2024-05-08T18:09:04.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4909000000000001e-05 2024-05-08T18:09:04.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.790959+0000", 2024-05-08T18:09:04.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012728199999999999 2024-05-08T18:09:04.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.791007+0000", 2024-05-08T18:09:04.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7766000000000003e-05 2024-05-08T18:09:04.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794549+0000", 2024-05-08T18:09:04.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035422959999999999 2024-05-08T18:09:04.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.794629+0000", 2024-05-08T18:09:04.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9784999999999996e-05 2024-05-08T18:09:04.386 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.386 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.386 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.386 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:487 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:04.386 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:09:04.386 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.534619140000004, 2024-05-08T18:09:04.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046865559999999997, 2024-05-08T18:09:04.386 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.386 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.387 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.387 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:04.387 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:04.387 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:04.387 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 487 2024-05-08T18:09:04.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.387 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:09:04.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796115+0000", 2024-05-08T18:09:04.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796116+0000", 2024-05-08T18:09:04.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5650000000000001e-06 2024-05-08T18:09:04.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796124+0000", 2024-05-08T18:09:04.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6909999999999997e-06 2024-05-08T18:09:04.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796143+0000", 2024-05-08T18:09:04.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9483999999999998e-05 2024-05-08T18:09:04.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796154+0000", 2024-05-08T18:09:04.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0416e-05 2024-05-08T18:09:04.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796266+0000", 2024-05-08T18:09:04.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112011 2024-05-08T18:09:04.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796432+0000", 2024-05-08T18:09:04.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016641799999999999 2024-05-08T18:09:04.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:04.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.796718+0000", 2024-05-08T18:09:04.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028548000000000001 2024-05-08T18:09:04.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:04.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798117+0000", 2024-05-08T18:09:04.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001399151 2024-05-08T18:09:04.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:04.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800656+0000", 2024-05-08T18:09:04.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025392689999999998 2024-05-08T18:09:04.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800733+0000", 2024-05-08T18:09:04.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6508000000000007e-05 2024-05-08T18:09:04.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.800801+0000", 2024-05-08T18:09:04.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8563000000000001e-05 2024-05-08T18:09:04.391 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.391 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.392 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.392 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:489 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:04.392 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:09:04.392 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.532672641999994, 2024-05-08T18:09:04.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058220679999999997, 2024-05-08T18:09:04.392 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.392 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.392 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.392 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:04.392 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:04.392 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:04.392 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 489 2024-05-08T18:09:04.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.393 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:09:04.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798061+0000", 2024-05-08T18:09:04.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798064+0000", 2024-05-08T18:09:04.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:09:04.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798074+0000", 2024-05-08T18:09:04.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0438999999999999e-05 2024-05-08T18:09:04.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798097+0000", 2024-05-08T18:09:04.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3019000000000001e-05 2024-05-08T18:09:04.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798115+0000", 2024-05-08T18:09:04.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7638e-05 2024-05-08T18:09:04.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798230+0000", 2024-05-08T18:09:04.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115375 2024-05-08T18:09:04.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798395+0000", 2024-05-08T18:09:04.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016542099999999999 2024-05-08T18:09:04.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:04.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.798633+0000", 2024-05-08T18:09:04.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000237977 2024-05-08T18:09:04.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:04.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.799628+0000", 2024-05-08T18:09:04.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00099459099999999996 2024-05-08T18:09:04.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:04.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803706+0000", 2024-05-08T18:09:04.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040776199999999997 2024-05-08T18:09:04.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803796+0000", 2024-05-08T18:09:04.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0704000000000004e-05 2024-05-08T18:09:04.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803883+0000", 2024-05-08T18:09:04.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6923999999999996e-05 2024-05-08T18:09:04.397 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.397 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.397 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.398 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:491 6.10 e32/26 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 32'1, mlcod=0'0)", 2024-05-08T18:09:04.398 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:09:04.398 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.529449182999997, 2024-05-08T18:09:04.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052480360000000002, 2024-05-08T18:09:04.398 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.398 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.398 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.398 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:09:04.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801285+0000", 2024-05-08T18:09:04.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801286+0000", 2024-05-08T18:09:04.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.085e-06 2024-05-08T18:09:04.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801293+0000", 2024-05-08T18:09:04.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.627e-06 2024-05-08T18:09:04.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801311+0000", 2024-05-08T18:09:04.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-05-08T18:09:04.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801320+0000", 2024-05-08T18:09:04.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5710000000000004e-06 2024-05-08T18:09:04.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801401+0000", 2024-05-08T18:09:04.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0798999999999997e-05 2024-05-08T18:09:04.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.801439+0000", 2024-05-08T18:09:04.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7994000000000002e-05 2024-05-08T18:09:04.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806447+0000", 2024-05-08T18:09:04.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050077339999999998 2024-05-08T18:09:04.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806533+0000", 2024-05-08T18:09:04.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.577e-05 2024-05-08T18:09:04.402 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.402 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.402 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.402 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:495 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'2, mlcod=0'0)", 2024-05-08T18:09:04.402 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:09:04.402 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.525912292000001, 2024-05-08T18:09:04.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045481219999999999, 2024-05-08T18:09:04.402 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.402 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.402 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.402 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:09:04.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804822+0000", 2024-05-08T18:09:04.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804823+0000", 2024-05-08T18:09:04.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.42e-06 2024-05-08T18:09:04.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804834+0000", 2024-05-08T18:09:04.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0584999999999999e-05 2024-05-08T18:09:04.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804848+0000", 2024-05-08T18:09:04.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4413000000000001e-05 2024-05-08T18:09:04.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804857+0000", 2024-05-08T18:09:04.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.302e-06 2024-05-08T18:09:04.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804967+0000", 2024-05-08T18:09:04.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109543 2024-05-08T18:09:04.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805018+0000", 2024-05-08T18:09:04.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0924000000000002e-05 2024-05-08T18:09:04.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809281+0000", 2024-05-08T18:09:04.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042631479999999996 2024-05-08T18:09:04.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809370+0000", 2024-05-08T18:09:04.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8787000000000002e-05 2024-05-08T18:09:04.406 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.406 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.406 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.406 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:500 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:04.406 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:09:04.407 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.524353877999999, 2024-05-08T18:09:04.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061595829999999997, 2024-05-08T18:09:04.407 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.407 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.407 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.407 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:04.407 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:04.407 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:04.407 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 500 2024-05-08T18:09:04.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.407 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:09:04.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806380+0000", 2024-05-08T18:09:04.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806382+0000", 2024-05-08T18:09:04.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2709999999999999e-06 2024-05-08T18:09:04.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806395+0000", 2024-05-08T18:09:04.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2782000000000001e-05 2024-05-08T18:09:04.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806419+0000", 2024-05-08T18:09:04.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3841000000000001e-05 2024-05-08T18:09:04.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806437+0000", 2024-05-08T18:09:04.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8318999999999999e-05 2024-05-08T18:09:04.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806554+0000", 2024-05-08T18:09:04.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116507 2024-05-08T18:09:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806732+0000", 2024-05-08T18:09:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017828200000000001 2024-05-08T18:09:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.806986+0000", 2024-05-08T18:09:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025431100000000001 2024-05-08T18:09:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:04.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.808032+0000", 2024-05-08T18:09:04.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010455530000000001 2024-05-08T18:09:04.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:04.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812373+0000", 2024-05-08T18:09:04.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043410139999999998 2024-05-08T18:09:04.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812485+0000", 2024-05-08T18:09:04.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011234999999999999 2024-05-08T18:09:04.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812540+0000", 2024-05-08T18:09:04.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4353e-05 2024-05-08T18:09:04.412 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.412 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.412 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.412 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:502 6.10 e32/26 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 32'2, mlcod=0'0)", 2024-05-08T18:09:04.412 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:09:04.412 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.523180275000001, 2024-05-08T18:09:04.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049263659999999997, 2024-05-08T18:09:04.412 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.412 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.412 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.413 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:09:04.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807554+0000", 2024-05-08T18:09:04.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807555+0000", 2024-05-08T18:09:04.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2079999999999999e-06 2024-05-08T18:09:04.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807563+0000", 2024-05-08T18:09:04.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3280000000000006e-06 2024-05-08T18:09:04.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807585+0000", 2024-05-08T18:09:04.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2361000000000002e-05 2024-05-08T18:09:04.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807596+0000", 2024-05-08T18:09:04.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0968000000000001e-05 2024-05-08T18:09:04.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807700+0000", 2024-05-08T18:09:04.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103232 2024-05-08T18:09:04.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.807732+0000", 2024-05-08T18:09:04.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2373999999999999e-05 2024-05-08T18:09:04.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812391+0000", 2024-05-08T18:09:04.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046590140000000004 2024-05-08T18:09:04.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812480+0000", 2024-05-08T18:09:04.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8881000000000005e-05 2024-05-08T18:09:04.416 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.416 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.416 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.416 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:504 6.1a e32/26 6:5c7e8a6d:reshard::reshard.0000000015:head v 32'3, mlcod=32'1)", 2024-05-08T18:09:04.416 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:09:04.416 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.519507469999994, 2024-05-08T18:09:04.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389472, 2024-05-08T18:09:04.417 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.417 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.417 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.417 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:09:04.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811226+0000", 2024-05-08T18:09:04.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811228+0000", 2024-05-08T18:09:04.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8819999999999999e-06 2024-05-08T18:09:04.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811240+0000", 2024-05-08T18:09:04.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1276e-05 2024-05-08T18:09:04.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811266+0000", 2024-05-08T18:09:04.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.601e-05 2024-05-08T18:09:04.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811283+0000", 2024-05-08T18:09:04.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7473e-05 2024-05-08T18:09:04.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811444+0000", 2024-05-08T18:09:04.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000161249 2024-05-08T18:09:04.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811501+0000", 2024-05-08T18:09:04.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6394999999999998e-05 2024-05-08T18:09:04.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815025+0000", 2024-05-08T18:09:04.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003524335 2024-05-08T18:09:04.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815121+0000", 2024-05-08T18:09:04.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6100000000000005e-05 2024-05-08T18:09:04.420 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.420 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.420 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.420 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:505 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:04.420 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:09:04.421 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.517878175000007, 2024-05-08T18:09:04.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007675075, 2024-05-08T18:09:04.421 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.421 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.421 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.421 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:04.421 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:04.421 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:04.421 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 505 2024-05-08T18:09:04.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.421 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:09:04.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812856+0000", 2024-05-08T18:09:04.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812857+0000", 2024-05-08T18:09:04.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.621e-06 2024-05-08T18:09:04.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812865+0000", 2024-05-08T18:09:04.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0600000000000008e-06 2024-05-08T18:09:04.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812889+0000", 2024-05-08T18:09:04.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3569000000000001e-05 2024-05-08T18:09:04.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812901+0000", 2024-05-08T18:09:04.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1610000000000001e-05 2024-05-08T18:09:04.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813025+0000", 2024-05-08T18:09:04.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012430399999999999 2024-05-08T18:09:04.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813168+0000", 2024-05-08T18:09:04.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014329699999999999 2024-05-08T18:09:04.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:04.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.813419+0000", 2024-05-08T18:09:04.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000250788 2024-05-08T18:09:04.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815462+0000", 2024-05-08T18:09:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002042865 2024-05-08T18:09:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820385+0000", 2024-05-08T18:09:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049229529999999999 2024-05-08T18:09:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820462+0000", 2024-05-08T18:09:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7101000000000006e-05 2024-05-08T18:09:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820531+0000", 2024-05-08T18:09:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8906999999999996e-05 2024-05-08T18:09:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:506 6.1c e32/26 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 32'4, mlcod=32'2)", 2024-05-08T18:09:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:09:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.516655331999999, 2024-05-08T18:09:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006383143, 2024-05-08T18:09:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:09:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814079+0000", 2024-05-08T18:09:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814081+0000", 2024-05-08T18:09:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0080000000000001e-06 2024-05-08T18:09:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814094+0000", 2024-05-08T18:09:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3407999999999999e-05 2024-05-08T18:09:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814125+0000", 2024-05-08T18:09:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0688999999999997e-05 2024-05-08T18:09:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814142+0000", 2024-05-08T18:09:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7192000000000001e-05 2024-05-08T18:09:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814245+0000", 2024-05-08T18:09:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103164 2024-05-08T18:09:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.814302+0000", 2024-05-08T18:09:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6613999999999997e-05 2024-05-08T18:09:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820398+0000", 2024-05-08T18:09:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060967620000000004 2024-05-08T18:09:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.820462+0000", 2024-05-08T18:09:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3305999999999993e-05 2024-05-08T18:09:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:750 6.19 6:9fecf831:::obj_delete_at_hint.0000000057:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:09:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.241416960999999, 2024-05-08T18:09:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035713440000000002, 2024-05-08T18:09:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 750 2024-05-08T18:09:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:09:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089317+0000", 2024-05-08T18:09:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089318+0000", 2024-05-08T18:09:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.446e-06 2024-05-08T18:09:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089325+0000", 2024-05-08T18:09:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8560000000000001e-06 2024-05-08T18:09:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089345+0000", 2024-05-08T18:09:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9641999999999999e-05 2024-05-08T18:09:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089355+0000", 2024-05-08T18:09:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0586e-05 2024-05-08T18:09:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089469+0000", 2024-05-08T18:09:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113324 2024-05-08T18:09:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.089692+0000", 2024-05-08T18:09:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022334500000000001 2024-05-08T18:09:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.090160+0000", 2024-05-08T18:09:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00046827799999999998 2024-05-08T18:09:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.091322+0000", 2024-05-08T18:09:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001161282 2024-05-08T18:09:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092750+0000", 2024-05-08T18:09:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014281299999999999 2024-05-08T18:09:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092829+0000", 2024-05-08T18:09:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9376999999999996e-05 2024-05-08T18:09:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:27.092888+0000", 2024-05-08T18:09:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9077999999999999e-05 2024-05-08T18:09:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.436 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.436 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.436 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:04.436 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:04.436 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:04.436 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:09:04.438 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:09:04.438 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:04.437+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:04.539 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:04.537+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:04.564 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:04.565 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:04.581 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:04.581 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:04.597 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:04.597 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:04.605 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:04.605 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:04.606 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:04.606 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:04.612 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:04.612 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:04.620 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:09:04.630 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:04.630 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:04.639 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:04.640+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:04.646 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:04.646 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:04.663 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:04.663 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:04.681 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:04.681 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:04.740 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:04.741+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:04.791 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:04.791 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:04.805 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:09:04.848 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:04.849+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:04.941 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:04.941+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:04.971 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:04.971 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:04.985 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:09:05.014 INFO:tasks.workunit.client.0.smithi080.stderr:Note: switching to '27d371685027569bcfa4efc661d3d3186f3a1776'. 2024-05-08T18:09:05.015 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-05-08T18:09:05.015 INFO:tasks.workunit.client.0.smithi080.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-08T18:09:05.015 INFO:tasks.workunit.client.0.smithi080.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-08T18:09:05.015 INFO:tasks.workunit.client.0.smithi080.stderr:state without impacting any branches by switching back to a branch. 2024-05-08T18:09:05.015 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-05-08T18:09:05.015 INFO:tasks.workunit.client.0.smithi080.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-08T18:09:05.015 INFO:tasks.workunit.client.0.smithi080.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-08T18:09:05.015 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-05-08T18:09:05.015 INFO:tasks.workunit.client.0.smithi080.stderr: git switch -c 2024-05-08T18:09:05.015 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-05-08T18:09:05.015 INFO:tasks.workunit.client.0.smithi080.stderr:Or undo this operation with: 2024-05-08T18:09:05.015 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-05-08T18:09:05.015 INFO:tasks.workunit.client.0.smithi080.stderr: git switch - 2024-05-08T18:09:05.016 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-05-08T18:09:05.016 INFO:tasks.workunit.client.0.smithi080.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-08T18:09:05.016 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-05-08T18:09:05.016 INFO:tasks.workunit.client.0.smithi080.stderr:HEAD is now at 27d37168502 TEMPORARY for retry 2024-05-08T18:09:05.023 DEBUG:teuthology.orchestra.run.smithi080:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-08T18:09:05.029 INFO:tasks.workunit.client.0.smithi080.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-08T18:09:05.032 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T18:09:05.033 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-08T18:09:05.042 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:05.044+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:set 6.c pg_upmap mapping to [1,7] 2024-05-08T18:09:05.133 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:09:05.157 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:05.157 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:05.162 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:05.164+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:05.171 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:09:05.244 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:05.245+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:05.290 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:05.290 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:05.304 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:09:05.345 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:05.344+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:05.446 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:05.448+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:05.472 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:05.472 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:05.486 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:09:05.547 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:05.548+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:05.599 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:05.599 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:05.612 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:09:05.654 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:05.656+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:05.749 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:05.749+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:05.769 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-08T18:09:05.769 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:05.769 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:05.784 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:09:05.846 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-08T18:09:05.850 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:05.849+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:05.895 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:05.896 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:05.896 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T18:09:05.897 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T18:09:05.897 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-08T18:09:05.909 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:09:05.936 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T18:09:05.939 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T18:09:05.939 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-08T18:09:05.986 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:05.988+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:05.990 INFO:tasks.workunit:Running workunits matching rgw/s3_multipart_upload.pl on client.0... 2024-05-08T18:09:05.991 INFO:tasks.workunit:Running workunit rgw/s3_multipart_upload.pl... 2024-05-08T18:09:05.992 DEBUG:teuthology.orchestra.run.smithi080:workunit test rgw/s3_multipart_upload.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=27d371685027569bcfa4efc661d3d3186f3a1776 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_multipart_upload.pl 2024-05-08T18:09:06.022 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:06.022 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:06.037 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:09:06.082 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:06.084+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:06.107 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-05-08T18:09:06.154 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:06.153+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:06.206 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:06.206 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:06.222 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:09:06.252 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:06.253+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:06.338 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:06.338 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:06.353 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:09:06.353 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:06.352+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:06.454 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:06.456+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:06.526 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:06.526 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:06.542 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:09:06.586 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:06.588+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:06.641 INFO:tasks.workunit.client.0.smithi080.stdout:Bucket Created: buck_2024_04_8_18_09_06 2024-05-08T18:09:06.641 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 1 2024-05-08T18:09:06.656 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:06.656+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:06.697 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:09:06.708 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:06.708 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:06.717 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records in 2024-05-08T18:09:06.717 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records out 2024-05-08T18:09:06.717 INFO:tasks.workunit.client.0.smithi080.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.074287 s, 1.4 GB/s 2024-05-08T18:09:06.727 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:09:06.757 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:06.757+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:06.835 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:06.854 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:06.854 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:06.857 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:06.857+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:06.870 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:06.870 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:06.887 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:06.887 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:06.888 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:06.888 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:06.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:06.888 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:06.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.888 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 103.315383755, 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002466088, 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 52 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:09:06.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577059+0000", 2024-05-08T18:09:06.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577062+0000", 2024-05-08T18:09:06.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.994e-06 2024-05-08T18:09:06.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577075+0000", 2024-05-08T18:09:06.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2480000000000001e-05 2024-05-08T18:09:06.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577108+0000", 2024-05-08T18:09:06.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3096000000000003e-05 2024-05-08T18:09:06.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577131+0000", 2024-05-08T18:09:06.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2993000000000002e-05 2024-05-08T18:09:06.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577260+0000", 2024-05-08T18:09:06.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012912899999999999 2024-05-08T18:09:06.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577453+0000", 2024-05-08T18:09:06.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000193668 2024-05-08T18:09:06.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:06.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.577634+0000", 2024-05-08T18:09:06.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180576 2024-05-08T18:09:06.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579082+0000", 2024-05-08T18:09:06.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001448083 2024-05-08T18:09:06.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579290+0000", 2024-05-08T18:09:06.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000208333 2024-05-08T18:09:06.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579403+0000", 2024-05-08T18:09:06.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011296800000000001 2024-05-08T18:09:06.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.579525+0000", 2024-05-08T18:09:06.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121768 2024-05-08T18:09:06.894 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.894 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.894 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.894 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:58 7.14 e29/28 7:2b04a3e9:::notify.6:head v 29'1, mlcod=0'0)", 2024-05-08T18:09:06.894 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:09:06.895 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 103.30352399, 2024-05-08T18:09:06.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038858310000000002, 2024-05-08T18:09:06.895 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.895 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.895 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.895 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:09:06.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588919+0000", 2024-05-08T18:09:06.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588920+0000", 2024-05-08T18:09:06.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.23e-07 2024-05-08T18:09:06.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588929+0000", 2024-05-08T18:09:06.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3659999999999998e-06 2024-05-08T18:09:06.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588948+0000", 2024-05-08T18:09:06.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8768000000000001e-05 2024-05-08T18:09:06.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588962+0000", 2024-05-08T18:09:06.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4e-05 2024-05-08T18:09:06.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.897 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.897 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589110+0000", 2024-05-08T18:09:06.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148047 2024-05-08T18:09:06.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.589173+0000", 2024-05-08T18:09:06.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2766000000000002e-05 2024-05-08T18:09:06.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592728+0000", 2024-05-08T18:09:06.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035553300000000002 2024-05-08T18:09:06.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.592805+0000", 2024-05-08T18:09:06.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6730999999999994e-05 2024-05-08T18:09:06.899 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.899 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.899 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.899 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:06.899 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:09:06.899 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 100.18745509199999, 2024-05-08T18:09:06.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034354310000000001, 2024-05-08T18:09:06.899 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.899 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.899 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.900 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.900 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.900 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.900 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 236 2024-05-08T18:09:06.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.900 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:09:06.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704988+0000", 2024-05-08T18:09:06.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.704991+0000", 2024-05-08T18:09:06.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1240000000000001e-06 2024-05-08T18:09:06.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705009+0000", 2024-05-08T18:09:06.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7819e-05 2024-05-08T18:09:06.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705048+0000", 2024-05-08T18:09:06.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9632999999999998e-05 2024-05-08T18:09:06.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705073+0000", 2024-05-08T18:09:06.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4686999999999999e-05 2024-05-08T18:09:06.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705241+0000", 2024-05-08T18:09:06.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759899999999999 2024-05-08T18:09:06.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705511+0000", 2024-05-08T18:09:06.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027018799999999998 2024-05-08T18:09:06.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:06.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.705965+0000", 2024-05-08T18:09:06.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045433000000000002 2024-05-08T18:09:06.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.707487+0000", 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015214810000000001 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708125+0000", 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063870300000000001 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708298+0000", 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172592 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.708423+0000", 2024-05-08T18:09:06.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125275 2024-05-08T18:09:06.905 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.905 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.905 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.905 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:308 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:06.905 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:09:06.905 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 100.17061719, 2024-05-08T18:09:06.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038707400000000001, 2024-05-08T18:09:06.906 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.906 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.906 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.906 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.906 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.906 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.906 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 308 2024-05-08T18:09:06.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.906 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:09:06.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721826+0000", 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721827+0000", 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1519999999999999e-06 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721840+0000", 2024-05-08T18:09:06.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.362e-05 2024-05-08T18:09:06.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721857+0000", 2024-05-08T18:09:06.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6901e-05 2024-05-08T18:09:06.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721867+0000", 2024-05-08T18:09:06.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0034000000000001e-05 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721922+0000", 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4450999999999998e-05 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.721981+0000", 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9267e-05 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:06.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722103+0000", 2024-05-08T18:09:06.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121502 2024-05-08T18:09:06.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.722757+0000", 2024-05-08T18:09:06.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065419700000000003 2024-05-08T18:09:06.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725619+0000", 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002862107 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725654+0000", 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.725696+0000", 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.912 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.912 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:604 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:06.912 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:09:06.912 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.993334484000002, 2024-05-08T18:09:06.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002741884, 2024-05-08T18:09:06.912 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.912 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.912 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.912 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.912 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.912 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 604 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899108+0000", 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899111+0000", 2024-05-08T18:09:06.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0910000000000001e-06 2024-05-08T18:09:06.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899126+0000", 2024-05-08T18:09:06.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:09:06.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899159+0000", 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3241999999999998e-05 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899174+0000", 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5235000000000001e-05 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899316+0000", 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014175599999999999 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899525+0000", 2024-05-08T18:09:06.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020915300000000001 2024-05-08T18:09:06.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:06.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.899872+0000", 2024-05-08T18:09:06.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034668299999999997 2024-05-08T18:09:06.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901064+0000", 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001191473 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901664+0000", 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060054599999999998 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901779+0000", 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011452500000000001 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.901850+0000", 2024-05-08T18:09:06.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1580000000000002e-05 2024-05-08T18:09:06.918 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.918 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.918 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.918 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:612 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:06.918 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:09:06.919 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.987825920999995, 2024-05-08T18:09:06.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025904750000000001, 2024-05-08T18:09:06.919 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.919 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.919 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.919 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.919 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.919 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.919 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 612 2024-05-08T18:09:06.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.919 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904617+0000", 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904619+0000", 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8479999999999999e-06 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904628+0000", 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8829999999999995e-06 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904650+0000", 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2467999999999999e-05 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904669+0000", 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9303000000000001e-05 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904766+0000", 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6917999999999996e-05 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.904935+0000", 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000168441 2024-05-08T18:09:06.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:06.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.905288+0000", 2024-05-08T18:09:06.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035312199999999998 2024-05-08T18:09:06.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.906520+0000", 2024-05-08T18:09:06.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001232005 2024-05-08T18:09:06.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907086+0000", 2024-05-08T18:09:06.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056658900000000005 2024-05-08T18:09:06.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907154+0000", 2024-05-08T18:09:06.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7197000000000001e-05 2024-05-08T18:09:06.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.907207+0000", 2024-05-08T18:09:06.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3701e-05 2024-05-08T18:09:06.924 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.925 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.925 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.925 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:06.925 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:09:06.925 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.819808327999993, 2024-05-08T18:09:06.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032464490000000002, 2024-05-08T18:09:06.925 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.925 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.925 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.925 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.925 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 742 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072634+0000", 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072637+0000", 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9059999999999998e-06 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072651+0000", 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3477e-05 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072683+0000", 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2116000000000002e-05 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072698+0000", 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5454000000000001e-05 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.072845+0000", 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000146532 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073241+0000", 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039580699999999997 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.073812+0000", 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057164900000000003 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075063+0000", 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001250131 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075723+0000", 2024-05-08T18:09:06.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00066039199999999999 2024-05-08T18:09:06.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075808+0000", 2024-05-08T18:09:06.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5458999999999996e-05 2024-05-08T18:09:06.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.075881+0000", 2024-05-08T18:09:06.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2526000000000003e-05 2024-05-08T18:09:06.930 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.931 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.931 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.931 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:06.931 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:09:06.931 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.777399962999993, 2024-05-08T18:09:06.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029270590000000001, 2024-05-08T18:09:06.931 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.931 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.931 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.931 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.931 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.932 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.932 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 760 2024-05-08T18:09:06.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.932 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:09:06.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115043+0000", 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115045+0000", 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0729999999999999e-06 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115057+0000", 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1617000000000001e-05 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115088+0000", 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1155999999999998e-05 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115103+0000", 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5067e-05 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115289+0000", 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186582 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115506+0000", 2024-05-08T18:09:06.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021690500000000001 2024-05-08T18:09:06.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:06.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.115832+0000", 2024-05-08T18:09:06.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032556799999999998 2024-05-08T18:09:06.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.116892+0000", 2024-05-08T18:09:06.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010597989999999999 2024-05-08T18:09:06.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117807+0000", 2024-05-08T18:09:06.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091502599999999999 2024-05-08T18:09:06.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117895+0000", 2024-05-08T18:09:06.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7977000000000001e-05 2024-05-08T18:09:06.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.117970+0000", 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5289000000000004e-05 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.646402476999995, 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028290730000000001, 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 817 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246040+0000", 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246043+0000", 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.807e-06 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246056+0000", 2024-05-08T18:09:06.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2383e-05 2024-05-08T18:09:06.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246087+0000", 2024-05-08T18:09:06.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1937000000000003e-05 2024-05-08T18:09:06.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246104+0000", 2024-05-08T18:09:06.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6643e-05 2024-05-08T18:09:06.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246225+0000", 2024-05-08T18:09:06.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012061900000000001 2024-05-08T18:09:06.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246510+0000", 2024-05-08T18:09:06.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028507100000000002 2024-05-08T18:09:06.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:06.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.246881+0000", 2024-05-08T18:09:06.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037163799999999998 2024-05-08T18:09:06.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248078+0000", 2024-05-08T18:09:06.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011968969999999999 2024-05-08T18:09:06.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248715+0000", 2024-05-08T18:09:06.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063698599999999998 2024-05-08T18:09:06.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248801+0000", 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5772999999999993e-05 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.248869+0000", 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8318999999999994e-05 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.592658993000001, 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003281693, 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 841 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299784+0000", 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299786+0000", 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4770000000000002e-06 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299798+0000", 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1493e-05 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299827+0000", 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9363e-05 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.299842+0000", 2024-05-08T18:09:06.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.448e-05 2024-05-08T18:09:06.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300001+0000", 2024-05-08T18:09:06.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015909600000000001 2024-05-08T18:09:06.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300384+0000", 2024-05-08T18:09:06.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038306000000000001 2024-05-08T18:09:06.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.300929+0000", 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054551299999999997 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302151+0000", 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012218540000000001 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.302918+0000", 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076719099999999997 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303000+0000", 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1662999999999994e-05 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303065+0000", 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5502999999999999e-05 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.950 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:06.950 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:09:06.950 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.588463536999996, 2024-05-08T18:09:06.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026179150000000002, 2024-05-08T18:09:06.950 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.950 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.950 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.950 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.950 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.950 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.950 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 843 2024-05-08T18:09:06.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303979+0000", 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303981+0000", 2024-05-08T18:09:06.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9740000000000001e-06 2024-05-08T18:09:06.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.303990+0000", 2024-05-08T18:09:06.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9889999999999998e-06 2024-05-08T18:09:06.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304012+0000", 2024-05-08T18:09:06.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1537000000000001e-05 2024-05-08T18:09:06.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304023+0000", 2024-05-08T18:09:06.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:09:06.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304101+0000", 2024-05-08T18:09:06.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7732999999999996e-05 2024-05-08T18:09:06.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304210+0000", 2024-05-08T18:09:06.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010985299999999999 2024-05-08T18:09:06.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.304490+0000", 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000279564 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.305542+0000", 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051976 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306451+0000", 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00090901999999999997 2024-05-08T18:09:06.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306533+0000", 2024-05-08T18:09:06.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1790000000000001e-05 2024-05-08T18:09:06.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.306597+0000", 2024-05-08T18:09:06.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4332999999999995e-05 2024-05-08T18:09:06.955 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.955 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.955 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.956 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:06.956 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:09:06.956 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.578767326999994, 2024-05-08T18:09:06.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00275537, 2024-05-08T18:09:06.956 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.956 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.956 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.956 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.956 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.956 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.956 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 847 2024-05-08T18:09:06.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.956 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:09:06.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313675+0000", 2024-05-08T18:09:06.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313678+0000", 2024-05-08T18:09:06.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:09:06.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313689+0000", 2024-05-08T18:09:06.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1273e-05 2024-05-08T18:09:06.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313719+0000", 2024-05-08T18:09:06.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9726e-05 2024-05-08T18:09:06.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313733+0000", 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4487e-05 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.313858+0000", 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125172 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314072+0000", 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021314200000000001 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:06.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.314378+0000", 2024-05-08T18:09:06.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030653100000000002 2024-05-08T18:09:06.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.315524+0000", 2024-05-08T18:09:06.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011458950000000001 2024-05-08T18:09:06.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316213+0000", 2024-05-08T18:09:06.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00068942199999999997 2024-05-08T18:09:06.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316314+0000", 2024-05-08T18:09:06.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100723 2024-05-08T18:09:06.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.316431+0000", 2024-05-08T18:09:06.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116759 2024-05-08T18:09:06.961 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.961 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.961 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.962 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:06.962 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:09:06.962 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.575115389999993, 2024-05-08T18:09:06.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025522510000000002, 2024-05-08T18:09:06.962 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.962 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.962 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.962 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.962 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.962 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.962 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 849 2024-05-08T18:09:06.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317327+0000", 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317329+0000", 2024-05-08T18:09:06.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9530000000000002e-06 2024-05-08T18:09:06.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317340+0000", 2024-05-08T18:09:06.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.08e-05 2024-05-08T18:09:06.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317364+0000", 2024-05-08T18:09:06.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4142999999999999e-05 2024-05-08T18:09:06.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317377+0000", 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2764e-05 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317471+0000", 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4289000000000005e-05 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317600+0000", 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012910499999999999 2024-05-08T18:09:06.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:06.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.317868+0000", 2024-05-08T18:09:06.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000267562 2024-05-08T18:09:06.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319081+0000", 2024-05-08T18:09:06.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001213387 2024-05-08T18:09:06.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319723+0000", 2024-05-08T18:09:06.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00064134200000000004 2024-05-08T18:09:06.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319808+0000", 2024-05-08T18:09:06.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5480000000000002e-05 2024-05-08T18:09:06.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.319880+0000", 2024-05-08T18:09:06.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1426000000000004e-05 2024-05-08T18:09:06.968 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.968 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.968 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.968 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:06.968 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:09:06.968 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.531682908999997, 2024-05-08T18:09:06.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002815157, 2024-05-08T18:09:06.968 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 868 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360760+0000", 2024-05-08T18:09:06.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360762+0000", 2024-05-08T18:09:06.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3599999999999999e-06 2024-05-08T18:09:06.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360775+0000", 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2840000000000001e-05 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360805+0000", 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9686e-05 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360819+0000", 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.434e-05 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.360948+0000", 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000129033 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361166+0000", 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021747800000000001 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.361481+0000", 2024-05-08T18:09:06.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031515800000000001 2024-05-08T18:09:06.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.362546+0000", 2024-05-08T18:09:06.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010653889999999999 2024-05-08T18:09:06.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363365+0000", 2024-05-08T18:09:06.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081906100000000005 2024-05-08T18:09:06.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363450+0000", 2024-05-08T18:09:06.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5202000000000002e-05 2024-05-08T18:09:06.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.363575+0000", 2024-05-08T18:09:06.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012460999999999999 2024-05-08T18:09:06.974 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.974 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.974 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.974 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:06.974 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:09:06.975 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.527990736000007, 2024-05-08T18:09:06.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024676260000000001, 2024-05-08T18:09:06.975 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.975 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.975 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.975 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.975 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.975 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.975 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 870 2024-05-08T18:09:06.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.975 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:09:06.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364452+0000", 2024-05-08T18:09:06.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364454+0000", 2024-05-08T18:09:06.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7770000000000001e-06 2024-05-08T18:09:06.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364463+0000", 2024-05-08T18:09:06.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4800000000000007e-06 2024-05-08T18:09:06.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364487+0000", 2024-05-08T18:09:06.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3589999999999999e-05 2024-05-08T18:09:06.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364499+0000", 2024-05-08T18:09:06.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.241e-05 2024-05-08T18:09:06.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364607+0000", 2024-05-08T18:09:06.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010760900000000001 2024-05-08T18:09:06.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.364750+0000", 2024-05-08T18:09:06.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014265600000000001 2024-05-08T18:09:06.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:06.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.365021+0000", 2024-05-08T18:09:06.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027115100000000002 2024-05-08T18:09:06.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366163+0000", 2024-05-08T18:09:06.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011419189999999999 2024-05-08T18:09:06.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366727+0000", 2024-05-08T18:09:06.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056400199999999997 2024-05-08T18:09:06.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366810+0000", 2024-05-08T18:09:06.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3133000000000005e-05 2024-05-08T18:09:06.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.366920+0000", 2024-05-08T18:09:06.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109899 2024-05-08T18:09:06.981 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.981 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.981 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.981 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:06.981 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:09:06.981 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.438076558000006, 2024-05-08T18:09:06.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027893459999999998, 2024-05-08T18:09:06.981 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.981 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.981 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.981 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.981 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.982 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.982 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 907 2024-05-08T18:09:06.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.982 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:09:06.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454366+0000", 2024-05-08T18:09:06.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454369+0000", 2024-05-08T18:09:06.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5730000000000002e-06 2024-05-08T18:09:06.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454381+0000", 2024-05-08T18:09:06.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.208e-05 2024-05-08T18:09:06.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454413+0000", 2024-05-08T18:09:06.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2493000000000002e-05 2024-05-08T18:09:06.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454432+0000", 2024-05-08T18:09:06.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8862999999999999e-05 2024-05-08T18:09:06.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454577+0000", 2024-05-08T18:09:06.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014477899999999999 2024-05-08T18:09:06.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.454800+0000", 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223425 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.455168+0000", 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036712799999999999 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456282+0000", 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011141580000000001 2024-05-08T18:09:06.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.456953+0000", 2024-05-08T18:09:06.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000670956 2024-05-08T18:09:06.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457038+0000", 2024-05-08T18:09:06.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4828999999999997e-05 2024-05-08T18:09:06.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.457156+0000", 2024-05-08T18:09:06.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118062 2024-05-08T18:09:06.987 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.987 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.987 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.987 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:06.987 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:09:06.987 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.434384195000007, 2024-05-08T18:09:06.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026891609999999998, 2024-05-08T18:09:06.988 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.988 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.988 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.988 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 909 2024-05-08T18:09:06.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.988 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458059+0000", 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458060+0000", 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7099999999999999e-06 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458069+0000", 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6440000000000006e-06 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458090+0000", 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1089000000000001e-05 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458102+0000", 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2306999999999999e-05 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458191+0000", 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8213000000000004e-05 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458313+0000", 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012231500000000001 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.458581+0000", 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026762500000000001 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.459773+0000", 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001192991 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460590+0000", 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081618100000000002 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460681+0000", 2024-05-08T18:09:06.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0946000000000006e-05 2024-05-08T18:09:06.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.460748+0000", 2024-05-08T18:09:06.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7139999999999998e-05 2024-05-08T18:09:06.993 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.993 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.993 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.993 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:06.993 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:09:06.994 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.340741176999998, 2024-05-08T18:09:06.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030359179999999999, 2024-05-08T18:09:06.994 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:06.994 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:06.994 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:06.994 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:06.994 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:06.994 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:06.994 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 949 2024-05-08T18:09:06.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.994 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:06.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:06.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:09:06.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:06.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551702+0000", 2024-05-08T18:09:06.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:06.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:06.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551705+0000", 2024-05-08T18:09:06.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2770000000000001e-06 2024-05-08T18:09:06.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:06.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551717+0000", 2024-05-08T18:09:06.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.206e-05 2024-05-08T18:09:06.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:06.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551747+0000", 2024-05-08T18:09:06.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0168999999999999e-05 2024-05-08T18:09:06.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:06.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551763+0000", 2024-05-08T18:09:06.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:09:06.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:06.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.551880+0000", 2024-05-08T18:09:06.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116976 2024-05-08T18:09:06.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:06.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552099+0000", 2024-05-08T18:09:06.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021910199999999999 2024-05-08T18:09:06.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:06.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.552476+0000", 2024-05-08T18:09:06.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000376697 2024-05-08T18:09:06.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:06.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.553551+0000", 2024-05-08T18:09:06.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001074925 2024-05-08T18:09:06.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:06.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554588+0000", 2024-05-08T18:09:06.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010374099999999999 2024-05-08T18:09:06.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:06.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554671+0000", 2024-05-08T18:09:06.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3368999999999994e-05 2024-05-08T18:09:06.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:06.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:06.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.554738+0000", 2024-05-08T18:09:06.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6043000000000004e-05 2024-05-08T18:09:06.999 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.999 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:06.999 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:06.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:06.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.000 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:07.000 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:09:07.000 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.327127739000005, 2024-05-08T18:09:07.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028304160000000001, 2024-05-08T18:09:07.000 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.000 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.000 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.000 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:07.000 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:07.000 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:07.000 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 955 2024-05-08T18:09:07.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.000 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:09:07.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565315+0000", 2024-05-08T18:09:07.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565318+0000", 2024-05-08T18:09:07.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7030000000000002e-06 2024-05-08T18:09:07.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565330+0000", 2024-05-08T18:09:07.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.204e-05 2024-05-08T18:09:07.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565363+0000", 2024-05-08T18:09:07.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2722999999999998e-05 2024-05-08T18:09:07.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565389+0000", 2024-05-08T18:09:07.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6412999999999999e-05 2024-05-08T18:09:07.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565510+0000", 2024-05-08T18:09:07.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120932 2024-05-08T18:09:07.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.565722+0000", 2024-05-08T18:09:07.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212139 2024-05-08T18:09:07.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:07.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.566034+0000", 2024-05-08T18:09:07.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000312038 2024-05-08T18:09:07.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:07.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567340+0000", 2024-05-08T18:09:07.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00130547 2024-05-08T18:09:07.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:07.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.567998+0000", 2024-05-08T18:09:07.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000658382 2024-05-08T18:09:07.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568081+0000", 2024-05-08T18:09:07.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3269999999999994e-05 2024-05-08T18:09:07.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.568145+0000", 2024-05-08T18:09:07.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4306000000000004e-05 2024-05-08T18:09:07.005 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.005 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.005 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.006 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:07.006 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:09:07.006 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.323408216000004, 2024-05-08T18:09:07.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027506660000000001, 2024-05-08T18:09:07.006 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.006 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.006 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.006 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:07.006 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:07.006 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:07.006 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 957 2024-05-08T18:09:07.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.007 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:09:07.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569035+0000", 2024-05-08T18:09:07.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569036+0000", 2024-05-08T18:09:07.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.776e-06 2024-05-08T18:09:07.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569061+0000", 2024-05-08T18:09:07.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5097e-05 2024-05-08T18:09:07.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569084+0000", 2024-05-08T18:09:07.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.23e-05 2024-05-08T18:09:07.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569096+0000", 2024-05-08T18:09:07.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.22e-05 2024-05-08T18:09:07.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569180+0000", 2024-05-08T18:09:07.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4369000000000005e-05 2024-05-08T18:09:07.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569296+0000", 2024-05-08T18:09:07.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115999 2024-05-08T18:09:07.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:07.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.569550+0000", 2024-05-08T18:09:07.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025397499999999998 2024-05-08T18:09:07.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:07.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.570963+0000", 2024-05-08T18:09:07.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001413023 2024-05-08T18:09:07.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:07.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571614+0000", 2024-05-08T18:09:07.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065041199999999995 2024-05-08T18:09:07.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571701+0000", 2024-05-08T18:09:07.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7569000000000001e-05 2024-05-08T18:09:07.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.571785+0000", 2024-05-08T18:09:07.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3945999999999999e-05 2024-05-08T18:09:07.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.011 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.012 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.012 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:07.014 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:09:07.015 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:07.015 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:07.015 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:07.016 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:07.016 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:07.016 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:07.016 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:07.017 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:07.018 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:07.012+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:07.114 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:07.113+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:07.198 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:07.199 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:07.199 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:07.199 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:07.215 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:07.213+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:07.216 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:09:07.240 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_06: 100Mb.1 2024-05-08T18:09:07.241 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:07.241 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 2 2024-05-08T18:09:07.309 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records in 2024-05-08T18:09:07.309 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records out 2024-05-08T18:09:07.309 INFO:tasks.workunit.client.0.smithi080.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0668001 s, 1.6 GB/s 2024-05-08T18:09:07.315 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:07.316+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:07.333 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:07.333 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:07.333 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:07.333 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:07.334 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:07.346 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:09:07.416 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:07.417+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:07.502 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:07.503 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:07.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:07.503 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:07.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.503 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:09:07.503 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:09:07.503 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 105.953236158, 2024-05-08T18:09:07.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049710090000000002, 2024-05-08T18:09:07.503 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.503 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 44 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552772+0000", 2024-05-08T18:09:07.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552775+0000", 2024-05-08T18:09:07.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4450000000000001e-06 2024-05-08T18:09:07.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552790+0000", 2024-05-08T18:09:07.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4363e-05 2024-05-08T18:09:07.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552820+0000", 2024-05-08T18:09:07.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0485999999999999e-05 2024-05-08T18:09:07.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.552843+0000", 2024-05-08T18:09:07.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2985000000000001e-05 2024-05-08T18:09:07.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554350+0000", 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015065149999999999 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.554374+0000", 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4097e-05 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557531+0000", 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031567169999999999 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:21.557743+0000", 2024-05-08T18:09:07.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212401 2024-05-08T18:09:07.508 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.508 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.508 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.508 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:09:07.508 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:09:07.508 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 103.917884281, 2024-05-08T18:09:07.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050241879999999997, 2024-05-08T18:09:07.508 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 58 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588124+0000", 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588125+0000", 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1399999999999995e-07 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588129+0000", 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6779999999999999e-06 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588142+0000", 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3047999999999999e-05 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588174+0000", 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1270999999999999e-05 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588307+0000", 2024-05-08T18:09:07.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013307600000000001 2024-05-08T18:09:07.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588477+0000", 2024-05-08T18:09:07.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000170213 2024-05-08T18:09:07.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:07.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.588669+0000", 2024-05-08T18:09:07.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019211599999999999 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.590228+0000", 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015590059999999999 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593029+0000", 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028006400000000001 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593099+0000", 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0300000000000001e-05 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:23.593148+0000", 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8925999999999999e-05 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.515 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-05-08T18:09:07.515 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:09:07.515 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 100.921346121, 2024-05-08T18:09:07.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00385587, 2024-05-08T18:09:07.515 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.515 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.515 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.515 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:07.515 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:07.515 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:07.515 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 207 2024-05-08T18:09:07.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.515 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:09:07.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584662+0000", 2024-05-08T18:09:07.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584665+0000", 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0570000000000001e-06 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584679+0000", 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3713000000000001e-05 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584712+0000", 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3213999999999997e-05 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584728+0000", 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5936000000000001e-05 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.584951+0000", 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000222955 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585196+0000", 2024-05-08T18:09:07.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024550800000000002 2024-05-08T18:09:07.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:07.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.585643+0000", 2024-05-08T18:09:07.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00044644699999999999 2024-05-08T18:09:07.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:07.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.587110+0000", 2024-05-08T18:09:07.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001467323 2024-05-08T18:09:07.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:07.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588371+0000", 2024-05-08T18:09:07.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012607180000000001 2024-05-08T18:09:07.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588452+0000", 2024-05-08T18:09:07.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1216000000000003e-05 2024-05-08T18:09:07.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.588518+0000", 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5783000000000004e-05 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:394 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 100.762228597, 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034384960000000001, 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 394 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743780+0000", 2024-05-08T18:09:07.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743781+0000", 2024-05-08T18:09:07.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3e-06 2024-05-08T18:09:07.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743788+0000", 2024-05-08T18:09:07.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7399999999999998e-06 2024-05-08T18:09:07.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743801+0000", 2024-05-08T18:09:07.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3757000000000001e-05 2024-05-08T18:09:07.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743808+0000", 2024-05-08T18:09:07.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6579999999999996e-06 2024-05-08T18:09:07.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743875+0000", 2024-05-08T18:09:07.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6740000000000001e-05 2024-05-08T18:09:07.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.743971+0000", 2024-05-08T18:09:07.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6175000000000007e-05 2024-05-08T18:09:07.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:07.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744100+0000", 2024-05-08T18:09:07.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012954899999999999 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.744863+0000", 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076300100000000002 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747089+0000", 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022258540000000002 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747162+0000", 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2632000000000005e-05 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.747218+0000", 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.609e-05 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:535 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 100.66451551999999, 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055640899999999998, 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 535 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841493+0000", 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841494+0000", 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0899999999999999e-06 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841500+0000", 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0249999999999999e-06 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841513+0000", 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3658e-05 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841522+0000", 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3410000000000003e-06 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841574+0000", 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2794000000000003e-05 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841633+0000", 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8595999999999999e-05 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.841755+0000", 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012227399999999999 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.842349+0000", 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00059377699999999998 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.846949+0000", 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004599723 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847008+0000", 2024-05-08T18:09:07.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8854999999999998e-05 2024-05-08T18:09:07.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.847057+0000", 2024-05-08T18:09:07.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8956999999999999e-05 2024-05-08T18:09:07.533 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.533 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.533 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.533 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:541 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:07.534 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:09:07.534 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 100.65748599, 2024-05-08T18:09:07.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037829790000000001, 2024-05-08T18:09:07.534 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.534 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.534 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.534 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:07.534 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:07.534 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:07.534 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 541 2024-05-08T18:09:07.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.534 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:09:07.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848522+0000", 2024-05-08T18:09:07.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848523+0000", 2024-05-08T18:09:07.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8599999999999997e-07 2024-05-08T18:09:07.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848526+0000", 2024-05-08T18:09:07.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4690000000000002e-06 2024-05-08T18:09:07.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848536+0000", 2024-05-08T18:09:07.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2029999999999998e-06 2024-05-08T18:09:07.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848540+0000", 2024-05-08T18:09:07.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9169999999999997e-06 2024-05-08T18:09:07.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848591+0000", 2024-05-08T18:09:07.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0328000000000003e-05 2024-05-08T18:09:07.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848646+0000", 2024-05-08T18:09:07.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5281999999999997e-05 2024-05-08T18:09:07.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:07.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.848759+0000", 2024-05-08T18:09:07.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011278899999999999 2024-05-08T18:09:07.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:07.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.849323+0000", 2024-05-08T18:09:07.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056433999999999998 2024-05-08T18:09:07.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:07.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852225+0000", 2024-05-08T18:09:07.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029017320000000002 2024-05-08T18:09:07.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852277+0000", 2024-05-08T18:09:07.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2460999999999998e-05 2024-05-08T18:09:07.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:26.852305+0000", 2024-05-08T18:09:07.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7671999999999999e-05 2024-05-08T18:09:07.539 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.539 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.540 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.540 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:789 6.0 e32/26 6:0216b5b6:::obj_delete_at_hint.0000000070:head v 32'14, mlcod=32'12)", 2024-05-08T18:09:07.540 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:09:07.540 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 100.32491214, 2024-05-08T18:09:07.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034621420000000001, 2024-05-08T18:09:07.540 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.540 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.540 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.540 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:09:07.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181096+0000", 2024-05-08T18:09:07.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181098+0000", 2024-05-08T18:09:07.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8029999999999999e-06 2024-05-08T18:09:07.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181109+0000", 2024-05-08T18:09:07.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1219999999999999e-05 2024-05-08T18:09:07.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181138+0000", 2024-05-08T18:09:07.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.898e-05 2024-05-08T18:09:07.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181151+0000", 2024-05-08T18:09:07.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.308e-05 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181268+0000", 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116629 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.181321+0000", 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3325999999999997e-05 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184477+0000", 2024-05-08T18:09:07.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003156458 2024-05-08T18:09:07.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.184558+0000", 2024-05-08T18:09:07.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0646e-05 2024-05-08T18:09:07.544 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.544 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.544 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.544 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:07.544 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:09:07.545 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 100.138937196, 2024-05-08T18:09:07.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004954511, 2024-05-08T18:09:07.545 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.545 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.545 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.545 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:07.545 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:07.545 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:07.545 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 871 2024-05-08T18:09:07.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.545 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:09:07.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367071+0000", 2024-05-08T18:09:07.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367073+0000", 2024-05-08T18:09:07.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2340000000000001e-06 2024-05-08T18:09:07.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367085+0000", 2024-05-08T18:09:07.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1483e-05 2024-05-08T18:09:07.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367111+0000", 2024-05-08T18:09:07.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5890000000000001e-05 2024-05-08T18:09:07.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367130+0000", 2024-05-08T18:09:07.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9700000000000001e-05 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367284+0000", 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015411799999999999 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367516+0000", 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000231272 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.367837+0000", 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032173400000000001 2024-05-08T18:09:07.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:07.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371395+0000", 2024-05-08T18:09:07.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035574719999999999 2024-05-08T18:09:07.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:07.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371882+0000", 2024-05-08T18:09:07.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048693899999999998 2024-05-08T18:09:07.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.371962+0000", 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.975e-05 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372025+0000", 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3918999999999996e-05 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:07.551 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:09:07.551 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 100.133049492, 2024-05-08T18:09:07.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045233640000000002, 2024-05-08T18:09:07.551 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.551 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.551 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.551 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:07.551 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:07.551 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:07.551 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 873 2024-05-08T18:09:07.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.551 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:09:07.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372959+0000", 2024-05-08T18:09:07.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372961+0000", 2024-05-08T18:09:07.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:09:07.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372969+0000", 2024-05-08T18:09:07.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2940000000000006e-06 2024-05-08T18:09:07.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.372991+0000", 2024-05-08T18:09:07.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1829000000000001e-05 2024-05-08T18:09:07.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373009+0000", 2024-05-08T18:09:07.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8607e-05 2024-05-08T18:09:07.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373127+0000", 2024-05-08T18:09:07.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011728899999999999 2024-05-08T18:09:07.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373260+0000", 2024-05-08T18:09:07.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013301200000000001 2024-05-08T18:09:07.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.373526+0000", 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026613500000000003 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.374558+0000", 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001032156 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377333+0000", 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027749329999999998 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377421+0000", 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8679999999999998e-05 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.377482+0000", 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0538999999999998e-05 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.557 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:07.557 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:09:07.557 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 100.073440338, 2024-05-08T18:09:07.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035261009999999998, 2024-05-08T18:09:07.557 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.557 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.557 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:07.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:07.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:07.557 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 898 2024-05-08T18:09:07.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.557 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:09:07.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432568+0000", 2024-05-08T18:09:07.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432570+0000", 2024-05-08T18:09:07.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.26e-06 2024-05-08T18:09:07.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432580+0000", 2024-05-08T18:09:07.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8570000000000007e-06 2024-05-08T18:09:07.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432605+0000", 2024-05-08T18:09:07.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5273e-05 2024-05-08T18:09:07.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432618+0000", 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2999999999999999e-05 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.432742+0000", 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012369200000000001 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433109+0000", 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036760500000000002 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.433645+0000", 2024-05-08T18:09:07.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053599599999999996 2024-05-08T18:09:07.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:07.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435050+0000", 2024-05-08T18:09:07.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001404696 2024-05-08T18:09:07.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:07.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435834+0000", 2024-05-08T18:09:07.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00078381100000000003 2024-05-08T18:09:07.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.435984+0000", 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015006899999999999 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.436094+0000", 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109842 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:09:07.563 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 99.982451483999995, 2024-05-08T18:09:07.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003477894, 2024-05-08T18:09:07.563 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.563 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.563 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:07.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:07.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:07.563 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 937 2024-05-08T18:09:07.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.563 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523557+0000", 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523559+0000", 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.95e-06 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523567+0000", 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6799999999999999e-06 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523591+0000", 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3269e-05 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523611+0000", 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0100000000000001e-05 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523767+0000", 2024-05-08T18:09:07.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015604900000000001 2024-05-08T18:09:07.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.523994+0000", 2024-05-08T18:09:07.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022764199999999999 2024-05-08T18:09:07.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:07.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.524338+0000", 2024-05-08T18:09:07.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034388700000000002 2024-05-08T18:09:07.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:07.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.525707+0000", 2024-05-08T18:09:07.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001368544 2024-05-08T18:09:07.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:07.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526843+0000", 2024-05-08T18:09:07.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001136501 2024-05-08T18:09:07.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.526957+0000", 2024-05-08T18:09:07.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011359 2024-05-08T18:09:07.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:07:27.527035+0000", 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7682000000000006e-05 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1193 3.c e85/20 3:315b87e8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_5:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.013463+0000", 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.492544696, 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013299406, 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.569 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.569 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.013463+0000", 2024-05-08T18:09:07.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.013463+0000", 2024-05-08T18:09:07.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.013469+0000", 2024-05-08T18:09:07.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.152e-06 2024-05-08T18:09:07.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.018728+0000", 2024-05-08T18:09:07.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052598510000000003 2024-05-08T18:09:07.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.018750+0000", 2024-05-08T18:09:07.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1350999999999999e-05 2024-05-08T18:09:07.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.018759+0000", 2024-05-08T18:09:07.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6209999999999999e-06 2024-05-08T18:09:07.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.018841+0000", 2024-05-08T18:09:07.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1416999999999997e-05 2024-05-08T18:09:07.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.018873+0000", 2024-05-08T18:09:07.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2672999999999997e-05 2024-05-08T18:09:07.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.026691+0000", 2024-05-08T18:09:07.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0078175870000000008 2024-05-08T18:09:07.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.026763+0000", 2024-05-08T18:09:07.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1754000000000005e-05 2024-05-08T18:09:07.572 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.572 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1195 3.28 e85/20 3:155acd84:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_7:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.034940+0000", 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.47106827000000001, 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012746477000000001, 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.034940+0000", 2024-05-08T18:09:07.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.034940+0000", 2024-05-08T18:09:07.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.034945+0000", 2024-05-08T18:09:07.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6570000000000002e-06 2024-05-08T18:09:07.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.038759+0000", 2024-05-08T18:09:07.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038136799999999998 2024-05-08T18:09:07.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.038790+0000", 2024-05-08T18:09:07.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0577000000000002e-05 2024-05-08T18:09:07.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.038818+0000", 2024-05-08T18:09:07.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8382e-05 2024-05-08T18:09:07.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.038894+0000", 2024-05-08T18:09:07.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6341000000000007e-05 2024-05-08T18:09:07.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.038913+0000", 2024-05-08T18:09:07.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8099000000000001e-05 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.047622+0000", 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087098720000000004 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.047686+0000", 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3868999999999994e-05 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1198 3.28 e85/20 3:168609a2:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_10:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.067734+0000", 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.43827446599999997, 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010673555, 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.067734+0000", 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.067734+0000", 2024-05-08T18:09:07.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.067736+0000", 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3309999999999998e-06 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.071735+0000", 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039992949999999999 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.071766+0000", 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0966000000000001e-05 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.071781+0000", 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4843e-05 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.071862+0000", 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0927000000000006e-05 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.071890+0000", 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7928000000000001e-05 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.078357+0000", 2024-05-08T18:09:07.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0064674980000000003 2024-05-08T18:09:07.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.078407+0000", 2024-05-08T18:09:07.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9767e-05 2024-05-08T18:09:07.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.584 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.585 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1200 3.38 3:1e9fdc78:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:07.585 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.083611+0000", 2024-05-08T18:09:07.585 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.42239683700000002, 2024-05-08T18:09:07.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018355481, 2024-05-08T18:09:07.585 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.585 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.585 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.585 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:07.585 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:07.585 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:07.585 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1200 2024-05-08T18:09:07.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.586 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.083611+0000", 2024-05-08T18:09:07.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.083611+0000", 2024-05-08T18:09:07.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.083614+0000", 2024-05-08T18:09:07.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7989999999999998e-06 2024-05-08T18:09:07.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085152+0000", 2024-05-08T18:09:07.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001538097 2024-05-08T18:09:07.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085182+0000", 2024-05-08T18:09:07.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0066999999999999e-05 2024-05-08T18:09:07.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085197+0000", 2024-05-08T18:09:07.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4911e-05 2024-05-08T18:09:07.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085262+0000", 2024-05-08T18:09:07.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4703999999999996e-05 2024-05-08T18:09:07.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085395+0000", 2024-05-08T18:09:07.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133549 2024-05-08T18:09:07.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:07.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085490+0000", 2024-05-08T18:09:07.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5076999999999998e-05 2024-05-08T18:09:07.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:07.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.095404+0000", 2024-05-08T18:09:07.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0099138290000000007 2024-05-08T18:09:07.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:07.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.101881+0000", 2024-05-08T18:09:07.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0064767269999999998 2024-05-08T18:09:07.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.101930+0000", 2024-05-08T18:09:07.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8578000000000001e-05 2024-05-08T18:09:07.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.101967+0000", 2024-05-08T18:09:07.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7143e-05 2024-05-08T18:09:07.590 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.590 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.591 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.591 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1205 3.3c e85/20 3:3d699601:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_17:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:07.591 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.140014+0000", 2024-05-08T18:09:07.591 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.36599430399999999, 2024-05-08T18:09:07.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011060598, 2024-05-08T18:09:07.591 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.591 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.591 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.591 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.140014+0000", 2024-05-08T18:09:07.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.140014+0000", 2024-05-08T18:09:07.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.140016+0000", 2024-05-08T18:09:07.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.917e-06 2024-05-08T18:09:07.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.143858+0000", 2024-05-08T18:09:07.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038425030000000002 2024-05-08T18:09:07.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.143877+0000", 2024-05-08T18:09:07.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9102000000000001e-05 2024-05-08T18:09:07.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.143888+0000", 2024-05-08T18:09:07.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0873000000000001e-05 2024-05-08T18:09:07.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.143957+0000", 2024-05-08T18:09:07.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9224e-05 2024-05-08T18:09:07.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.143980+0000", 2024-05-08T18:09:07.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3051e-05 2024-05-08T18:09:07.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.151012+0000", 2024-05-08T18:09:07.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0070313659999999998 2024-05-08T18:09:07.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.151074+0000", 2024-05-08T18:09:07.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2562000000000002e-05 2024-05-08T18:09:07.595 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.595 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.595 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.595 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1206 3.8 3:11c650fd:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:07.595 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.145496+0000", 2024-05-08T18:09:07.595 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.360511835, 2024-05-08T18:09:07.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014861228000000001, 2024-05-08T18:09:07.596 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.596 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.596 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.596 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:07.596 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:07.596 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:07.596 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1206 2024-05-08T18:09:07.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.596 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.145496+0000", 2024-05-08T18:09:07.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.145496+0000", 2024-05-08T18:09:07.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.145499+0000", 2024-05-08T18:09:07.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6110000000000001e-06 2024-05-08T18:09:07.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.147293+0000", 2024-05-08T18:09:07.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001793715 2024-05-08T18:09:07.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.147315+0000", 2024-05-08T18:09:07.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2425999999999998e-05 2024-05-08T18:09:07.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.147326+0000", 2024-05-08T18:09:07.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0491e-05 2024-05-08T18:09:07.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.147413+0000", 2024-05-08T18:09:07.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7175999999999993e-05 2024-05-08T18:09:07.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.147553+0000", 2024-05-08T18:09:07.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014023700000000001 2024-05-08T18:09:07.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:07.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.147696+0000", 2024-05-08T18:09:07.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014265 2024-05-08T18:09:07.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:07.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.159531+0000", 2024-05-08T18:09:07.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011835836000000001 2024-05-08T18:09:07.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:07.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.160285+0000", 2024-05-08T18:09:07.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00075360800000000001 2024-05-08T18:09:07.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.160323+0000", 2024-05-08T18:09:07.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8285999999999999e-05 2024-05-08T18:09:07.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.160357+0000", 2024-05-08T18:09:07.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4192000000000001e-05 2024-05-08T18:09:07.601 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.601 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.601 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.601 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1207 3.15 e85/20 3:a96d965c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_19:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:07.601 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.162095+0000", 2024-05-08T18:09:07.601 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.34391306799999999, 2024-05-08T18:09:07.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022218617999999999, 2024-05-08T18:09:07.602 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.602 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.602 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.602 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.162095+0000", 2024-05-08T18:09:07.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.162095+0000", 2024-05-08T18:09:07.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.162096+0000", 2024-05-08T18:09:07.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8899999999999998e-07 2024-05-08T18:09:07.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167032+0000", 2024-05-08T18:09:07.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004936429 2024-05-08T18:09:07.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167062+0000", 2024-05-08T18:09:07.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9422000000000001e-05 2024-05-08T18:09:07.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167075+0000", 2024-05-08T18:09:07.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3436e-05 2024-05-08T18:09:07.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167157+0000", 2024-05-08T18:09:07.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1337999999999999e-05 2024-05-08T18:09:07.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167180+0000", 2024-05-08T18:09:07.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3816e-05 2024-05-08T18:09:07.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.184267+0000", 2024-05-08T18:09:07.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017086796000000001 2024-05-08T18:09:07.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.184314+0000", 2024-05-08T18:09:07.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6391999999999999e-05 2024-05-08T18:09:07.605 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.605 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.605 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.606 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1208 3.19 e85/20 3:980d0160:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_20:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:07.606 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.168920+0000", 2024-05-08T18:09:07.606 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.33708815399999997, 2024-05-08T18:09:07.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013239547000000001, 2024-05-08T18:09:07.606 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.606 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.606 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.606 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.168920+0000", 2024-05-08T18:09:07.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.168920+0000", 2024-05-08T18:09:07.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.168922+0000", 2024-05-08T18:09:07.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9039999999999999e-06 2024-05-08T18:09:07.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.170638+0000", 2024-05-08T18:09:07.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00171568 2024-05-08T18:09:07.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.170657+0000", 2024-05-08T18:09:07.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9380000000000001e-05 2024-05-08T18:09:07.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.170669+0000", 2024-05-08T18:09:07.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1793999999999999e-05 2024-05-08T18:09:07.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.170739+0000", 2024-05-08T18:09:07.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0038999999999998e-05 2024-05-08T18:09:07.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.170761+0000", 2024-05-08T18:09:07.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2730000000000001e-05 2024-05-08T18:09:07.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.182101+0000", 2024-05-08T18:09:07.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011339195 2024-05-08T18:09:07.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.182159+0000", 2024-05-08T18:09:07.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8825e-05 2024-05-08T18:09:07.610 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.610 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.610 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.610 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1212 3.3c e85/20 3:3ece4424:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_24:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:07.610 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.212884+0000", 2024-05-08T18:09:07.610 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.29312434399999998, 2024-05-08T18:09:07.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010318628999999999, 2024-05-08T18:09:07.610 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:07.610 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:07.610 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:07.611 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:07.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:07.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.212884+0000", 2024-05-08T18:09:07.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:07.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.212884+0000", 2024-05-08T18:09:07.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:07.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:07.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.212886+0000", 2024-05-08T18:09:07.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3700000000000002e-06 2024-05-08T18:09:07.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:07.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.216775+0000", 2024-05-08T18:09:07.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038891049999999999 2024-05-08T18:09:07.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:07.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.216798+0000", 2024-05-08T18:09:07.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3085999999999999e-05 2024-05-08T18:09:07.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:07.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.216811+0000", 2024-05-08T18:09:07.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2813000000000001e-05 2024-05-08T18:09:07.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:07.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.216880+0000", 2024-05-08T18:09:07.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8868999999999994e-05 2024-05-08T18:09:07.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:07.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.216902+0000", 2024-05-08T18:09:07.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2214000000000001e-05 2024-05-08T18:09:07.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:07.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.223161+0000", 2024-05-08T18:09:07.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006258408 2024-05-08T18:09:07.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:07.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:07.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:07.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.223202+0000", 2024-05-08T18:09:07.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1764000000000002e-05 2024-05-08T18:09:07.615 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.615 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.615 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.615 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:07.615 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:07.615 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:07.617 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:09:07.617 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:07.617+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:07.717 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:07.717+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:07.753 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:07.753 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:07.753 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:07.753 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:07.770 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:09:07.819 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:07.820+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:07.920 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:07.921+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:07.943 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:07.943 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:07.943 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:07.943 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:07.943 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:07.959 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:09:07.996 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_06: 100Mb.2 2024-05-08T18:09:07.996 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:07.996 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 3 2024-05-08T18:09:08.021 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:08.020+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:08.079 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records in 2024-05-08T18:09:08.079 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records out 2024-05-08T18:09:08.079 INFO:tasks.workunit.client.0.smithi080.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0800078 s, 1.3 GB/s 2024-05-08T18:09:08.122 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:08.124+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:08.131 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:09:08.132 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:08.133 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:08.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:08.133 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:08.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.133 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:09:08.133 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:09:08.133 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.602190623, 2024-05-08T18:09:08.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018560765, 2024-05-08T18:09:08.133 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.133 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.133 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:09:08.133 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.134 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.134 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.134 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 43 2024-05-08T18:09:08.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.134 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:09:08.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:09:08.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530217+0000", 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530253+0000", 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5621999999999999e-05 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530288+0000", 2024-05-08T18:09:08.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5846999999999997e-05 2024-05-08T18:09:08.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530314+0000", 2024-05-08T18:09:08.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5732e-05 2024-05-08T18:09:08.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530952+0000", 2024-05-08T18:09:08.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00063739999999999999 2024-05-08T18:09:08.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:08.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530977+0000", 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5375e-05 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548506+0000", 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017528781 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548774+0000", 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026821199999999999 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.138 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:495 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:08.138 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:09:08.138 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.328556898, 2024-05-08T18:09:08.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005951001, 2024-05-08T18:09:08.138 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.138 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.138 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.138 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.138 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.138 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.138 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 495 2024-05-08T18:09:08.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.138 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:09:08.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803847+0000", 2024-05-08T18:09:08.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803849+0000", 2024-05-08T18:09:08.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3580000000000001e-06 2024-05-08T18:09:08.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803864+0000", 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4742999999999999e-05 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803895+0000", 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0970000000000003e-05 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.803908+0000", 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2588999999999999e-05 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804005+0000", 2024-05-08T18:09:08.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7107000000000004e-05 2024-05-08T18:09:08.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804291+0000", 2024-05-08T18:09:08.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028626900000000002 2024-05-08T18:09:08.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:08.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.804648+0000", 2024-05-08T18:09:08.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000356955 2024-05-08T18:09:08.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.805740+0000", 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001091905 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809636+0000", 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00389661 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809722+0000", 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.809798+0000", 2024-05-08T18:09:08.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5462000000000004e-05 2024-05-08T18:09:08.143 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.143 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.143 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.143 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:08.143 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:09:08.143 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.32194558, 2024-05-08T18:09:08.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051396380000000002, 2024-05-08T18:09:08.143 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.143 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.144 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.144 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.144 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.144 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.144 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 504 2024-05-08T18:09:08.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.144 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:09:08.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810458+0000", 2024-05-08T18:09:08.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810460+0000", 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9769999999999999e-06 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810470+0000", 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0222e-05 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810495+0000", 2024-05-08T18:09:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4508999999999999e-05 2024-05-08T18:09:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810515+0000", 2024-05-08T18:09:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9998999999999999e-05 2024-05-08T18:09:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810653+0000", 2024-05-08T18:09:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013851099999999999 2024-05-08T18:09:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.810782+0000", 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128152 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.811043+0000", 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026172400000000002 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.812164+0000", 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001121024 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815415+0000", 2024-05-08T18:09:08.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032510270000000001 2024-05-08T18:09:08.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815538+0000", 2024-05-08T18:09:08.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012256999999999999 2024-05-08T18:09:08.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.815598+0000", 2024-05-08T18:09:08.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9923000000000002e-05 2024-05-08T18:09:08.148 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.148 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.148 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:681 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.173320092, 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044793259999999996, 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 681 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959084+0000", 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959085+0000", 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.353e-06 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959092+0000", 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999999e-06 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959113+0000", 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0744e-05 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959130+0000", 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7679000000000001e-05 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959217+0000", 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6487000000000001e-05 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959335+0000", 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118476 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:08.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.959598+0000", 2024-05-08T18:09:08.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000263045 2024-05-08T18:09:08.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.960551+0000", 2024-05-08T18:09:08.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095251500000000002 2024-05-08T18:09:08.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963412+0000", 2024-05-08T18:09:08.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028611800000000001 2024-05-08T18:09:08.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963498+0000", 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6145999999999998e-05 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:26.963563+0000", 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4701000000000003e-05 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.155 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.155 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.155 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1190 3.31 e85/20 3:8c795880:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_2:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:08.155 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.973668+0000", 2024-05-08T18:09:08.155 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.158735724, 2024-05-08T18:09:08.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021568941000000001, 2024-05-08T18:09:08.155 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.155 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.155 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.155 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.973668+0000", 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.973668+0000", 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.973671+0000", 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2100000000000002e-06 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.980815+0000", 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071441860000000003 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.980858+0000", 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2852000000000002e-05 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.980879+0000", 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.107e-05 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981093+0000", 2024-05-08T18:09:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000213857 2024-05-08T18:09:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981135+0000", 2024-05-08T18:09:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2249999999999997e-05 2024-05-08T18:09:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.995097+0000", 2024-05-08T18:09:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013961295 2024-05-08T18:09:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.995237+0000", 2024-05-08T18:09:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140221 2024-05-08T18:09:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1191 3.1d e85/20 3:b81eb771:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_3:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.989442+0000", 2024-05-08T18:09:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.142961307, 2024-05-08T18:09:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020798275000000001, 2024-05-08T18:09:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.159 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989442+0000", 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989442+0000", 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989443+0000", 2024-05-08T18:09:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-05-08T18:09:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994630+0000", 2024-05-08T18:09:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051867930000000003 2024-05-08T18:09:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994663+0000", 2024-05-08T18:09:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3272000000000003e-05 2024-05-08T18:09:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994680+0000", 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7266999999999999e-05 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994795+0000", 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011437799999999999 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994836+0000", 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0686000000000003e-05 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010110+0000", 2024-05-08T18:09:08.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015274081 2024-05-08T18:09:08.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010241+0000", 2024-05-08T18:09:08.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013107099999999999 2024-05-08T18:09:08.163 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.163 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.163 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.163 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1196 3.9 3:91f0c251:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.164 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.036686+0000", 2024-05-08T18:09:08.164 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.0957175020000001, 2024-05-08T18:09:08.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019572662000000001, 2024-05-08T18:09:08.164 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.164 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.164 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.164 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.164 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.164 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.164 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1196 2024-05-08T18:09:08.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.164 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.036686+0000", 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.036686+0000", 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.036691+0000", 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8099999999999997e-06 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041369+0000", 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046777590000000001 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041413+0000", 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4297e-05 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041443+0000", 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9635999999999999e-05 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041588+0000", 2024-05-08T18:09:08.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014564100000000001 2024-05-08T18:09:08.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041833+0000", 2024-05-08T18:09:08.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000244777 2024-05-08T18:09:08.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:08.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.042054+0000", 2024-05-08T18:09:08.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022125399999999999 2024-05-08T18:09:08.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.051316+0000", 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092614059999999998 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056067+0000", 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047512639999999998 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056171+0000", 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010425900000000001 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056259+0000", 2024-05-08T18:09:08.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7559000000000007e-05 2024-05-08T18:09:08.169 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.169 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.169 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.169 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1199 3.14 3:29bdf593:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.169 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.067940+0000", 2024-05-08T18:09:08.169 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.064463977, 2024-05-08T18:09:08.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018983427000000001, 2024-05-08T18:09:08.169 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.169 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.170 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.170 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.170 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.170 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.170 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1199 2024-05-08T18:09:08.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.170 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.067940+0000", 2024-05-08T18:09:08.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.067940+0000", 2024-05-08T18:09:08.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.067943+0000", 2024-05-08T18:09:08.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6370000000000001e-06 2024-05-08T18:09:08.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.071968+0000", 2024-05-08T18:09:08.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040243120000000004 2024-05-08T18:09:08.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072006+0000", 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8628999999999999e-05 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072029+0000", 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2972999999999998e-05 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072160+0000", 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013025100000000001 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072398+0000", 2024-05-08T18:09:08.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023832399999999999 2024-05-08T18:09:08.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:08.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072617+0000", 2024-05-08T18:09:08.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021892999999999999 2024-05-08T18:09:08.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.081906+0000", 2024-05-08T18:09:08.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092895919999999993 2024-05-08T18:09:08.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.086685+0000", 2024-05-08T18:09:08.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047783019999999999 2024-05-08T18:09:08.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.086794+0000", 2024-05-08T18:09:08.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010940100000000001 2024-05-08T18:09:08.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.086923+0000", 2024-05-08T18:09:08.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000129076 2024-05-08T18:09:08.174 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.174 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.175 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.175 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1201 3.f e85/47 3:f0c9f301:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_13:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:08.175 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.091970+0000", 2024-05-08T18:09:08.175 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.04043375, 2024-05-08T18:09:08.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016538746, 2024-05-08T18:09:08.175 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.175 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.175 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.175 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.091970+0000", 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.091970+0000", 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.091973+0000", 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7130000000000001e-06 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.097554+0000", 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005581384 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.097594+0000", 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9805999999999998e-05 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.097631+0000", 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7492e-05 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.097783+0000", 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152032 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.097852+0000", 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8591999999999997e-05 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.108311+0000", 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010458617 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.108509+0000", 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019811000000000001 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1202 3.14 3:2a8c8569:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.100310+0000", 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.0320938909999999, 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030670528999999998, 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.180 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.180 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1202 2024-05-08T18:09:08.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.180 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.100310+0000", 2024-05-08T18:09:08.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.100310+0000", 2024-05-08T18:09:08.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.100352+0000", 2024-05-08T18:09:08.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2315999999999999e-05 2024-05-08T18:09:08.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.105824+0000", 2024-05-08T18:09:08.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054720649999999999 2024-05-08T18:09:08.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.105863+0000", 2024-05-08T18:09:08.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8649000000000002e-05 2024-05-08T18:09:08.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.105883+0000", 2024-05-08T18:09:08.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0383000000000001e-05 2024-05-08T18:09:08.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106019+0000", 2024-05-08T18:09:08.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013552200000000001 2024-05-08T18:09:08.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106318+0000", 2024-05-08T18:09:08.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029913900000000002 2024-05-08T18:09:08.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:08.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106586+0000", 2024-05-08T18:09:08.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026771299999999999 2024-05-08T18:09:08.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.128110+0000", 2024-05-08T18:09:08.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021524155 2024-05-08T18:09:08.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130655+0000", 2024-05-08T18:09:08.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025453960000000001 2024-05-08T18:09:08.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130831+0000", 2024-05-08T18:09:08.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017583400000000001 2024-05-08T18:09:08.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130980+0000", 2024-05-08T18:09:08.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149357 2024-05-08T18:09:08.184 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.184 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.184 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.184 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1203 3.1a 3:592e440d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.184 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.110063+0000", 2024-05-08T18:09:08.184 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.022340281, 2024-05-08T18:09:08.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023166567999999998, 2024-05-08T18:09:08.185 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.185 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.185 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.185 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.185 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.185 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.185 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1203 2024-05-08T18:09:08.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.185 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110063+0000", 2024-05-08T18:09:08.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110063+0000", 2024-05-08T18:09:08.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110067+0000", 2024-05-08T18:09:08.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3629999999999998e-06 2024-05-08T18:09:08.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114611+0000", 2024-05-08T18:09:08.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00454375 2024-05-08T18:09:08.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114653+0000", 2024-05-08T18:09:08.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2549999999999997e-05 2024-05-08T18:09:08.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114681+0000", 2024-05-08T18:09:08.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7878999999999999e-05 2024-05-08T18:09:08.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114872+0000", 2024-05-08T18:09:08.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019109500000000001 2024-05-08T18:09:08.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.115275+0000", 2024-05-08T18:09:08.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040327700000000001 2024-05-08T18:09:08.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:08.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.115636+0000", 2024-05-08T18:09:08.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036014899999999998 2024-05-08T18:09:08.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.129938+0000", 2024-05-08T18:09:08.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014302848 2024-05-08T18:09:08.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.133055+0000", 2024-05-08T18:09:08.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00311699 2024-05-08T18:09:08.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.133159+0000", 2024-05-08T18:09:08.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103138 2024-05-08T18:09:08.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.133230+0000", 2024-05-08T18:09:08.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1528999999999999e-05 2024-05-08T18:09:08.189 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.190 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.190 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.190 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1210 3.f e85/47 3:f280ad56:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_22:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:08.190 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.186132+0000", 2024-05-08T18:09:08.190 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.94627124799999995, 2024-05-08T18:09:08.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015049673, 2024-05-08T18:09:08.190 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.190 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.190 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.190 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.186132+0000", 2024-05-08T18:09:08.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.186132+0000", 2024-05-08T18:09:08.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.186136+0000", 2024-05-08T18:09:08.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2459999999999999e-06 2024-05-08T18:09:08.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.190445+0000", 2024-05-08T18:09:08.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043091539999999999 2024-05-08T18:09:08.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.190493+0000", 2024-05-08T18:09:08.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8056000000000002e-05 2024-05-08T18:09:08.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.190519+0000", 2024-05-08T18:09:08.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5999999999999998e-05 2024-05-08T18:09:08.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.190675+0000", 2024-05-08T18:09:08.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015568799999999999 2024-05-08T18:09:08.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.190721+0000", 2024-05-08T18:09:08.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5892e-05 2024-05-08T18:09:08.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.201099+0000", 2024-05-08T18:09:08.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010378178 2024-05-08T18:09:08.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.201182+0000", 2024-05-08T18:09:08.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3459000000000002e-05 2024-05-08T18:09:08.194 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.194 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.194 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.194 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1211 3.3 3:c13935f4:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.194 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.195183+0000", 2024-05-08T18:09:08.194 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.93722028300000004, 2024-05-08T18:09:08.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.026007971000000001, 2024-05-08T18:09:08.194 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.194 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.195 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.195 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.195 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.195 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.195 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1211 2024-05-08T18:09:08.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.195 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.195183+0000", 2024-05-08T18:09:08.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.195183+0000", 2024-05-08T18:09:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.195187+0000", 2024-05-08T18:09:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6540000000000001e-06 2024-05-08T18:09:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199150+0000", 2024-05-08T18:09:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039627719999999998 2024-05-08T18:09:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199188+0000", 2024-05-08T18:09:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195999999999998e-05 2024-05-08T18:09:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199210+0000", 2024-05-08T18:09:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2027000000000001e-05 2024-05-08T18:09:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199356+0000", 2024-05-08T18:09:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014612800000000001 2024-05-08T18:09:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199622+0000", 2024-05-08T18:09:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026600199999999999 2024-05-08T18:09:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199846+0000", 2024-05-08T18:09:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022389099999999999 2024-05-08T18:09:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.213755+0000", 2024-05-08T18:09:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013908536000000001 2024-05-08T18:09:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.221024+0000", 2024-05-08T18:09:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0072690439999999997 2024-05-08T18:09:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.221110+0000", 2024-05-08T18:09:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6008999999999996e-05 2024-05-08T18:09:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.221191+0000", 2024-05-08T18:09:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1712000000000006e-05 2024-05-08T18:09:08.199 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1214 3.9 3:92ca5236:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.1:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.223783+0000", 2024-05-08T18:09:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.90862081800000005, 2024-05-08T18:09:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018427163999999999, 2024-05-08T18:09:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.200 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.201 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1214 2024-05-08T18:09:08.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.201 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.223783+0000", 2024-05-08T18:09:08.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.223783+0000", 2024-05-08T18:09:08.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.223786+0000", 2024-05-08T18:09:08.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8030000000000001e-06 2024-05-08T18:09:08.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.227730+0000", 2024-05-08T18:09:08.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039442430000000001 2024-05-08T18:09:08.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.227766+0000", 2024-05-08T18:09:08.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5571999999999998e-05 2024-05-08T18:09:08.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.227785+0000", 2024-05-08T18:09:08.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9170000000000001e-05 2024-05-08T18:09:08.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.227954+0000", 2024-05-08T18:09:08.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016892200000000001 2024-05-08T18:09:08.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.228373+0000", 2024-05-08T18:09:08.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000419417 2024-05-08T18:09:08.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:08.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.229595+0000", 2024-05-08T18:09:08.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012215730000000001 2024-05-08T18:09:08.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.239966+0000", 2024-05-08T18:09:08.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010371225 2024-05-08T18:09:08.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.241761+0000", 2024-05-08T18:09:08.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001795458 2024-05-08T18:09:08.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.242067+0000", 2024-05-08T18:09:08.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030554600000000002 2024-05-08T18:09:08.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.242210+0000", 2024-05-08T18:09:08.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014323499999999999 2024-05-08T18:09:08.205 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.205 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.205 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.205 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1224 3.13 e85/20 3:c82cef46:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_8:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:08.205 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.644014+0000", 2024-05-08T18:09:08.206 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.488389876, 2024-05-08T18:09:08.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019705998999999998, 2024-05-08T18:09:08.206 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.206 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.206 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.206 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.644014+0000", 2024-05-08T18:09:08.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.644014+0000", 2024-05-08T18:09:08.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.644018+0000", 2024-05-08T18:09:08.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6500000000000002e-06 2024-05-08T18:09:08.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651361+0000", 2024-05-08T18:09:08.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073436789999999997 2024-05-08T18:09:08.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651411+0000", 2024-05-08T18:09:08.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9613000000000001e-05 2024-05-08T18:09:08.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651438+0000", 2024-05-08T18:09:08.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6699e-05 2024-05-08T18:09:08.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651567+0000", 2024-05-08T18:09:08.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012993299999999999 2024-05-08T18:09:08.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651601+0000", 2024-05-08T18:09:08.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3268000000000001e-05 2024-05-08T18:09:08.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663646+0000", 2024-05-08T18:09:08.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012045451 2024-05-08T18:09:08.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663720+0000", 2024-05-08T18:09:08.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3706000000000002e-05 2024-05-08T18:09:08.209 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.209 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.209 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.210 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1226 3.3 3:c18beed9:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.210 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.668709+0000", 2024-05-08T18:09:08.210 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.46369442100000002, 2024-05-08T18:09:08.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020071530000000001, 2024-05-08T18:09:08.210 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.210 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.210 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.210 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.210 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.210 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.210 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1226 2024-05-08T18:09:08.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.210 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.668709+0000", 2024-05-08T18:09:08.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.668709+0000", 2024-05-08T18:09:08.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.668717+0000", 2024-05-08T18:09:08.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7100000000000007e-06 2024-05-08T18:09:08.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672764+0000", 2024-05-08T18:09:08.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040465630000000004 2024-05-08T18:09:08.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672791+0000", 2024-05-08T18:09:08.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7636000000000001e-05 2024-05-08T18:09:08.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672804+0000", 2024-05-08T18:09:08.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3009e-05 2024-05-08T18:09:08.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672905+0000", 2024-05-08T18:09:08.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010105100000000001 2024-05-08T18:09:08.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.673113+0000", 2024-05-08T18:09:08.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000207405 2024-05-08T18:09:08.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:08.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.673300+0000", 2024-05-08T18:09:08.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000186875 2024-05-08T18:09:08.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.682552+0000", 2024-05-08T18:09:08.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092519690000000005 2024-05-08T18:09:08.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.688655+0000", 2024-05-08T18:09:08.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061032300000000003 2024-05-08T18:09:08.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.688723+0000", 2024-05-08T18:09:08.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8263999999999996e-05 2024-05-08T18:09:08.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.688781+0000", 2024-05-08T18:09:08.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7818000000000001e-05 2024-05-08T18:09:08.215 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.215 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.215 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.215 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1234 3.31 e85/20 3:8faf631b:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_18:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:08.215 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.819956+0000", 2024-05-08T18:09:08.215 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.31244725699999998, 2024-05-08T18:09:08.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011816152, 2024-05-08T18:09:08.216 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.216 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.216 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.216 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.819956+0000", 2024-05-08T18:09:08.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.819956+0000", 2024-05-08T18:09:08.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.819958+0000", 2024-05-08T18:09:08.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5820000000000001e-06 2024-05-08T18:09:08.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.824703+0000", 2024-05-08T18:09:08.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047451079999999996 2024-05-08T18:09:08.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.824727+0000", 2024-05-08T18:09:08.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3827000000000001e-05 2024-05-08T18:09:08.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.824737+0000", 2024-05-08T18:09:08.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0365e-05 2024-05-08T18:09:08.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.824840+0000", 2024-05-08T18:09:08.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000102317 2024-05-08T18:09:08.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.824865+0000", 2024-05-08T18:09:08.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5131999999999999e-05 2024-05-08T18:09:08.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.831650+0000", 2024-05-08T18:09:08.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006784783 2024-05-08T18:09:08.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.831773+0000", 2024-05-08T18:09:08.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012303800000000001 2024-05-08T18:09:08.219 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.219 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.219 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.219 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1237 3.24 e85/20 3:2546570d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_21:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:08.219 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.889383+0000", 2024-05-08T18:09:08.220 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.243020663, 2024-05-08T18:09:08.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011930061, 2024-05-08T18:09:08.220 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.220 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.220 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.220 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.889383+0000", 2024-05-08T18:09:08.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.889383+0000", 2024-05-08T18:09:08.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.889393+0000", 2024-05-08T18:09:08.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8430000000000005e-06 2024-05-08T18:09:08.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.893982+0000", 2024-05-08T18:09:08.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045891049999999996 2024-05-08T18:09:08.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.894005+0000", 2024-05-08T18:09:08.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2971000000000001e-05 2024-05-08T18:09:08.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.894017+0000", 2024-05-08T18:09:08.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1515000000000001e-05 2024-05-08T18:09:08.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.894086+0000", 2024-05-08T18:09:08.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9361000000000002e-05 2024-05-08T18:09:08.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.894113+0000", 2024-05-08T18:09:08.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6800000000000001e-05 2024-05-08T18:09:08.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.901249+0000", 2024-05-08T18:09:08.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071364369999999998 2024-05-08T18:09:08.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.901313+0000", 2024-05-08T18:09:08.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4029000000000006e-05 2024-05-08T18:09:08.223 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.223 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.223 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.224 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1239 3.1 e85/20 3:823b0205:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_23:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:08.224 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.938704+0000", 2024-05-08T18:09:08.224 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.193700069, 2024-05-08T18:09:08.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012998015, 2024-05-08T18:09:08.224 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.224 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.224 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.224 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.938704+0000", 2024-05-08T18:09:08.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.938704+0000", 2024-05-08T18:09:08.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.938706+0000", 2024-05-08T18:09:08.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2299999999999998e-06 2024-05-08T18:09:08.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.943909+0000", 2024-05-08T18:09:08.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052026249999999998 2024-05-08T18:09:08.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.943945+0000", 2024-05-08T18:09:08.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6647000000000003e-05 2024-05-08T18:09:08.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.943962+0000", 2024-05-08T18:09:08.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6779999999999999e-05 2024-05-08T18:09:08.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.944073+0000", 2024-05-08T18:09:08.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000110548 2024-05-08T18:09:08.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.944101+0000", 2024-05-08T18:09:08.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8385999999999999e-05 2024-05-08T18:09:08.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.951599+0000", 2024-05-08T18:09:08.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074979790000000001 2024-05-08T18:09:08.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.951702+0000", 2024-05-08T18:09:08.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010281999999999999 2024-05-08T18:09:08.228 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.228 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.228 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.228 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1240 3.2c e85/20 3:3640ae6b:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_24:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:08.228 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.961821+0000", 2024-05-08T18:09:08.228 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.17058269100000001, 2024-05-08T18:09:08.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010275434999999999, 2024-05-08T18:09:08.228 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.228 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.228 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.228 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.961821+0000", 2024-05-08T18:09:08.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.961821+0000", 2024-05-08T18:09:08.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.961823+0000", 2024-05-08T18:09:08.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6980000000000001e-06 2024-05-08T18:09:08.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.963471+0000", 2024-05-08T18:09:08.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001648662 2024-05-08T18:09:08.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.963498+0000", 2024-05-08T18:09:08.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6682e-05 2024-05-08T18:09:08.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.963512+0000", 2024-05-08T18:09:08.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3811999999999999e-05 2024-05-08T18:09:08.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.963591+0000", 2024-05-08T18:09:08.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8752999999999996e-05 2024-05-08T18:09:08.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.963620+0000", 2024-05-08T18:09:08.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9064000000000002e-05 2024-05-08T18:09:08.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.972047+0000", 2024-05-08T18:09:08.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084267839999999997 2024-05-08T18:09:08.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.972096+0000", 2024-05-08T18:09:08.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9979999999999999e-05 2024-05-08T18:09:08.232 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.232 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.232 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.232 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.232 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.232 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:08.234 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:09:08.235 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:08.236+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:08.334 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:08.336+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:08.364 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:08.364 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:08.364 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:08.364 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:08.380 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:09:08.435 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:08.433+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:08.508 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:08.508 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:08.508 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:08.508 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:08.508 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:08.527 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:09:08.536 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:08.536+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:08.637 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:08.636+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:08.669 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_06: 100Mb.3 2024-05-08T18:09:08.669 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:08.669 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 4 2024-05-08T18:09:08.703 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:08.703 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:08.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:08.703 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:08.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.704 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1191 3.1d 3:b81eb771:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.704 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:08.704 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.7226600840000001, 2024-05-08T18:09:08.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.029646883999999998, 2024-05-08T18:09:08.704 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.704 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.704 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.704 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.704 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.704 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.704 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1191 2024-05-08T18:09:08.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.704 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981334+0000", 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1540000000000004e-06 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988180+0000", 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068463619999999999 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988216+0000", 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6293e-05 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988236+0000", 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9403e-05 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988410+0000", 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017415400000000001 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988803+0000", 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000393271 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989175+0000", 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037178899999999997 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.006397+0000", 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017221744000000001 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010666+0000", 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042692880000000004 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010836+0000", 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000169498 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010976+0000", 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014092799999999999 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1193 3.c 3:315b87e8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.004223+0000", 2024-05-08T18:09:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.6997661910000001, 2024-05-08T18:09:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019590908000000001, 2024-05-08T18:09:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1193 2024-05-08T18:09:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.004223+0000", 2024-05-08T18:09:08.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.004223+0000", 2024-05-08T18:09:08.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.004227+0000", 2024-05-08T18:09:08.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5130000000000001e-06 2024-05-08T18:09:08.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008665+0000", 2024-05-08T18:09:08.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044376629999999997 2024-05-08T18:09:08.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008697+0000", 2024-05-08T18:09:08.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2783000000000001e-05 2024-05-08T18:09:08.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008715+0000", 2024-05-08T18:09:08.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7713000000000001e-05 2024-05-08T18:09:08.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008840+0000", 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000124578 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.009091+0000", 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000251146 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.009323+0000", 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000232127 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023324+0000", 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014000574999999999 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023459+0000", 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013494099999999999 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023644+0000", 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018532100000000001 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023814+0000", 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017054799999999999 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1194 3.16 3:6b2325a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.688514166, 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030556241000000001, 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1194 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:08.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015492+0000", 2024-05-08T18:09:08.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6863000000000001e-05 2024-05-08T18:09:08.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019937+0000", 2024-05-08T18:09:08.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044450399999999999 2024-05-08T18:09:08.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019975+0000", 2024-05-08T18:09:08.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7676000000000003e-05 2024-05-08T18:09:08.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019995+0000", 2024-05-08T18:09:08.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.969e-05 2024-05-08T18:09:08.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020165+0000", 2024-05-08T18:09:08.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017003400000000001 2024-05-08T18:09:08.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020437+0000", 2024-05-08T18:09:08.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027198599999999999 2024-05-08T18:09:08.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:08.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020668+0000", 2024-05-08T18:09:08.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023154 2024-05-08T18:09:08.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.032879+0000", 2024-05-08T18:09:08.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012210883000000001 2024-05-08T18:09:08.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045595+0000", 2024-05-08T18:09:08.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012716005000000001 2024-05-08T18:09:08.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045811+0000", 2024-05-08T18:09:08.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021556400000000001 2024-05-08T18:09:08.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.046032+0000", 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022096 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1195 3.28 3:155acd84:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.678366845, 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020411840000000001, 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1195 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025626+0000", 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4699999999999998e-06 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030167+0000", 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045406709999999996 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030204+0000", 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6736000000000002e-05 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030222+0000", 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.823e-05 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030337+0000", 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114695 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030565+0000", 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000228173 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030770+0000", 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020505400000000001 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044362+0000", 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013591814000000001 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045754+0000", 2024-05-08T18:09:08.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013923710000000001 2024-05-08T18:09:08.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045903+0000", 2024-05-08T18:09:08.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014878800000000001 2024-05-08T18:09:08.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.046035+0000", 2024-05-08T18:09:08.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013183800000000001 2024-05-08T18:09:08.726 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.726 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1198 3.28 3:168609a2:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.058486+0000", 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.6455040319999998, 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016565142000000001, 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1198 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.058486+0000", 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.058486+0000", 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.058489+0000", 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5200000000000002e-06 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.062822+0000", 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043326600000000003 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.062865+0000", 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3569999999999998e-05 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.062888+0000", 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2313000000000001e-05 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.063058+0000", 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000170228 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.063306+0000", 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024823299999999999 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:08.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.063545+0000", 2024-05-08T18:09:08.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023860999999999999 2024-05-08T18:09:08.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072976+0000", 2024-05-08T18:09:08.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.009431544 2024-05-08T18:09:08.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.074845+0000", 2024-05-08T18:09:08.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0018682740000000001 2024-05-08T18:09:08.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.074948+0000", 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103459 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.075051+0000", 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000102731 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1200 3.38 e85/20 3:1e9fdc78:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_12:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.081875+0000", 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.6221151229999999, 2024-05-08T18:09:08.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015849736, 2024-05-08T18:09:08.733 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.733 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.733 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.733 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.081875+0000", 2024-05-08T18:09:08.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.081875+0000", 2024-05-08T18:09:08.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.081878+0000", 2024-05-08T18:09:08.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.67e-06 2024-05-08T18:09:08.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.087487+0000", 2024-05-08T18:09:08.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056089599999999996 2024-05-08T18:09:08.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.087520+0000", 2024-05-08T18:09:08.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3229000000000003e-05 2024-05-08T18:09:08.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.087542+0000", 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1702999999999999e-05 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.087657+0000", 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115152 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.087695+0000", 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7410000000000003e-05 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.097559+0000", 2024-05-08T18:09:08.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0098645899999999995 2024-05-08T18:09:08.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.097724+0000", 2024-05-08T18:09:08.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016502199999999999 2024-05-08T18:09:08.736 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.736 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.736 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.736 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1205 3.3c 3:3d699601:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.131246+0000", 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.5727436699999999, 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016408168000000001, 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1205 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.131246+0000", 2024-05-08T18:09:08.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.131246+0000", 2024-05-08T18:09:08.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.131251+0000", 2024-05-08T18:09:08.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0830000000000003e-06 2024-05-08T18:09:08.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.135228+0000", 2024-05-08T18:09:08.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039768620000000003 2024-05-08T18:09:08.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.135264+0000", 2024-05-08T18:09:08.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5873e-05 2024-05-08T18:09:08.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.135282+0000", 2024-05-08T18:09:08.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7960000000000001e-05 2024-05-08T18:09:08.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.135410+0000", 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012835400000000001 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.135659+0000", 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024895100000000002 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.135895+0000", 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000236023 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.145040+0000", 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0091443979999999998 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.147496+0000", 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00245627 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.147581+0000", 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5722000000000004e-05 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.147654+0000", 2024-05-08T18:09:08.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2671999999999998e-05 2024-05-08T18:09:08.742 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.742 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.742 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.742 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1209 3.35 e85/20 3:af4c6abe:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_21:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:08.742 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:08.742 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.5235385560000001, 2024-05-08T18:09:08.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021767585999999998, 2024-05-08T18:09:08.742 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.743 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.743 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.743 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:08.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:08.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180452+0000", 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4000000000000002e-07 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183165+0000", 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027135269999999999 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183208+0000", 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2599000000000003e-05 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183239+0000", 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999997e-05 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183369+0000", 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000130338 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183407+0000", 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8213000000000002e-05 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202127+0000", 2024-05-08T18:09:08.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018719906000000001 2024-05-08T18:09:08.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202219+0000", 2024-05-08T18:09:08.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1533000000000006e-05 2024-05-08T18:09:08.746 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.746 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.746 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.746 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1212 3.3c 3:3ece4424:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.203498+0000", 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.500491542, 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016972991, 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1212 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.203498+0000", 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.203498+0000", 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.203501+0000", 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7599999999999998e-06 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.208049+0000", 2024-05-08T18:09:08.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045485380000000004 2024-05-08T18:09:08.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.208086+0000", 2024-05-08T18:09:08.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6226000000000002e-05 2024-05-08T18:09:08.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.208105+0000", 2024-05-08T18:09:08.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8957000000000002e-05 2024-05-08T18:09:08.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.208244+0000", 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000139238 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.208497+0000", 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025342000000000002 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.208729+0000", 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023182699999999999 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.219593+0000", 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010863467 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.220106+0000", 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00051380000000000002 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.220327+0000", 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022072300000000001 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.220471+0000", 2024-05-08T18:09:08.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014403500000000001 2024-05-08T18:09:08.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.752 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.752 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1218 3.c 3:33b8068a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.752 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:08.752 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.141710663, 2024-05-08T18:09:08.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024735007, 2024-05-08T18:09:08.752 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.752 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.752 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1218 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562282+0000", 2024-05-08T18:09:08.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7769999999999998e-06 2024-05-08T18:09:08.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568816+0000", 2024-05-08T18:09:08.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065338169999999999 2024-05-08T18:09:08.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568851+0000", 2024-05-08T18:09:08.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5892999999999997e-05 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568871+0000", 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9306000000000001e-05 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568992+0000", 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120925 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.569258+0000", 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026655299999999999 2024-05-08T18:09:08.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:08.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.569522+0000", 2024-05-08T18:09:08.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026331999999999999 2024-05-08T18:09:08.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584269+0000", 2024-05-08T18:09:08.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014747454 2024-05-08T18:09:08.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.586687+0000", 2024-05-08T18:09:08.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024181770000000001 2024-05-08T18:09:08.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.586888+0000", 2024-05-08T18:09:08.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000201137 2024-05-08T18:09:08.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.587014+0000", 2024-05-08T18:09:08.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012564799999999999 2024-05-08T18:09:08.757 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.757 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.757 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.758 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1219 3.2 e85/20 3:4068b298:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_3:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:08.758 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.576946+0000", 2024-05-08T18:09:08.758 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.127043448, 2024-05-08T18:09:08.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017678080999999998, 2024-05-08T18:09:08.758 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.758 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.758 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.758 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.576946+0000", 2024-05-08T18:09:08.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.576946+0000", 2024-05-08T18:09:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.576948+0000", 2024-05-08T18:09:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9240000000000001e-06 2024-05-08T18:09:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.582069+0000", 2024-05-08T18:09:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005120566 2024-05-08T18:09:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.582104+0000", 2024-05-08T18:09:08.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5496e-05 2024-05-08T18:09:08.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.582122+0000", 2024-05-08T18:09:08.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7626e-05 2024-05-08T18:09:08.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.582225+0000", 2024-05-08T18:09:08.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000102853 2024-05-08T18:09:08.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.582263+0000", 2024-05-08T18:09:08.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8714999999999998e-05 2024-05-08T18:09:08.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594521+0000", 2024-05-08T18:09:08.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012257099 2024-05-08T18:09:08.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594624+0000", 2024-05-08T18:09:08.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010380200000000001 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1220 3.c 3:319326d6:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.1190230880000001, 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022305417000000001, 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1220 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584971+0000", 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0729999999999998e-06 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591515+0000", 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065448340000000002 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591549+0000", 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3633000000000001e-05 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591574+0000", 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4482999999999999e-05 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591714+0000", 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014048500000000001 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591956+0000", 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000241616 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:08.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.592181+0000", 2024-05-08T18:09:08.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022565000000000001 2024-05-08T18:09:08.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.606237+0000", 2024-05-08T18:09:08.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014055646999999999 2024-05-08T18:09:08.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607095+0000", 2024-05-08T18:09:08.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085838199999999998 2024-05-08T18:09:08.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607189+0000", 2024-05-08T18:09:08.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3962000000000006e-05 2024-05-08T18:09:08.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607272+0000", 2024-05-08T18:09:08.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2651999999999994e-05 2024-05-08T18:09:08.767 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.767 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.767 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.767 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1222 3.38 e85/20 3:1f451ee1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_6:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:08.768 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.607187+0000", 2024-05-08T18:09:08.768 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.096802606, 2024-05-08T18:09:08.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018422048, 2024-05-08T18:09:08.768 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.768 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.768 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.768 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607187+0000", 2024-05-08T18:09:08.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607187+0000", 2024-05-08T18:09:08.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607188+0000", 2024-05-08T18:09:08.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2860000000000001e-06 2024-05-08T18:09:08.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.611823+0000", 2024-05-08T18:09:08.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046346010000000003 2024-05-08T18:09:08.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.611855+0000", 2024-05-08T18:09:08.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1572999999999997e-05 2024-05-08T18:09:08.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.611870+0000", 2024-05-08T18:09:08.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5129e-05 2024-05-08T18:09:08.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.612015+0000", 2024-05-08T18:09:08.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000145618 2024-05-08T18:09:08.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.612075+0000", 2024-05-08T18:09:08.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9692999999999999e-05 2024-05-08T18:09:08.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625482+0000", 2024-05-08T18:09:08.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013406998999999999 2024-05-08T18:09:08.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625609+0000", 2024-05-08T18:09:08.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012714900000000001 2024-05-08T18:09:08.771 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.771 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.772 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.772 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1229 3.16 3:6ad6b699:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.772 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.724599+0000", 2024-05-08T18:09:08.772 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.97939103299999997, 2024-05-08T18:09:08.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018735992999999999, 2024-05-08T18:09:08.772 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.772 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.772 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.772 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.772 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.772 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.772 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1229 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.724599+0000", 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.724599+0000", 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.724602+0000", 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999999e-06 2024-05-08T18:09:08.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728621+0000", 2024-05-08T18:09:08.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040188649999999999 2024-05-08T18:09:08.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728658+0000", 2024-05-08T18:09:08.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7722999999999998e-05 2024-05-08T18:09:08.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728677+0000", 2024-05-08T18:09:08.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9000000000000001e-05 2024-05-08T18:09:08.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728876+0000", 2024-05-08T18:09:08.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019832300000000001 2024-05-08T18:09:08.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.729122+0000", 2024-05-08T18:09:08.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024644700000000001 2024-05-08T18:09:08.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:08.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.729371+0000", 2024-05-08T18:09:08.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000249087 2024-05-08T18:09:08.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.738186+0000", 2024-05-08T18:09:08.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0088147859999999998 2024-05-08T18:09:08.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.743162+0000", 2024-05-08T18:09:08.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049762909999999999 2024-05-08T18:09:08.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.743263+0000", 2024-05-08T18:09:08.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010037199999999999 2024-05-08T18:09:08.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.743335+0000", 2024-05-08T18:09:08.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2006000000000001e-05 2024-05-08T18:09:08.777 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.777 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.777 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.777 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1235 3.16 3:6999c92c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.777 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.840049+0000", 2024-05-08T18:09:08.777 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.86394023399999997, 2024-05-08T18:09:08.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017385405999999999, 2024-05-08T18:09:08.777 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.777 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.777 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.777 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.777 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1235 2024-05-08T18:09:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.840049+0000", 2024-05-08T18:09:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.840049+0000", 2024-05-08T18:09:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.840052+0000", 2024-05-08T18:09:08.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.683e-06 2024-05-08T18:09:08.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.843805+0000", 2024-05-08T18:09:08.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037527789999999999 2024-05-08T18:09:08.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.843833+0000", 2024-05-08T18:09:08.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7722e-05 2024-05-08T18:09:08.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.843845+0000", 2024-05-08T18:09:08.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2439000000000001e-05 2024-05-08T18:09:08.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.843921+0000", 2024-05-08T18:09:08.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5859999999999995e-05 2024-05-08T18:09:08.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.844062+0000", 2024-05-08T18:09:08.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140975 2024-05-08T18:09:08.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:08.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.844171+0000", 2024-05-08T18:09:08.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010931500000000001 2024-05-08T18:09:08.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.856919+0000", 2024-05-08T18:09:08.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012747688 2024-05-08T18:09:08.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.857349+0000", 2024-05-08T18:09:08.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042999200000000003 2024-05-08T18:09:08.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.857391+0000", 2024-05-08T18:09:08.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2110999999999997e-05 2024-05-08T18:09:08.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.857435+0000", 2024-05-08T18:09:08.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3841999999999998e-05 2024-05-08T18:09:08.782 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.782 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.782 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.782 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1242 3.28 3:16e2765f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.2:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.782 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:08.782 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.72737731999999999, 2024-05-08T18:09:08.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020212443, 2024-05-08T18:09:08.783 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.783 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.783 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.783 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.783 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.783 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.783 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1242 2024-05-08T18:09:08.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.783 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:08.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:08.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976615+0000", 2024-05-08T18:09:08.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6170000000000001e-06 2024-05-08T18:09:08.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980655+0000", 2024-05-08T18:09:08.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040399240000000003 2024-05-08T18:09:08.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980693+0000", 2024-05-08T18:09:08.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7996e-05 2024-05-08T18:09:08.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980717+0000", 2024-05-08T18:09:08.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.459e-05 2024-05-08T18:09:08.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980811+0000", 2024-05-08T18:09:08.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3931000000000006e-05 2024-05-08T18:09:08.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980965+0000", 2024-05-08T18:09:08.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015315500000000001 2024-05-08T18:09:08.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:08.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.981450+0000", 2024-05-08T18:09:08.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000485632 2024-05-08T18:09:08.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.991160+0000", 2024-05-08T18:09:08.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.009709858 2024-05-08T18:09:08.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996726+0000", 2024-05-08T18:09:08.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055655039999999998 2024-05-08T18:09:08.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996786+0000", 2024-05-08T18:09:08.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0511999999999999e-05 2024-05-08T18:09:08.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996825+0000", 2024-05-08T18:09:08.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8723999999999997e-05 2024-05-08T18:09:08.787 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.787 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.787 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.788 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1247 3.c 3:32aac358:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.788 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.370612+0000", 2024-05-08T18:09:08.788 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.33337772199999999, 2024-05-08T18:09:08.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019632920000000002, 2024-05-08T18:09:08.788 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.788 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.788 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.788 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.788 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.788 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.788 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1247 2024-05-08T18:09:08.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.788 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.370612+0000", 2024-05-08T18:09:08.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.370612+0000", 2024-05-08T18:09:08.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.370615+0000", 2024-05-08T18:09:08.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.559e-06 2024-05-08T18:09:08.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374436+0000", 2024-05-08T18:09:08.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038219460000000001 2024-05-08T18:09:08.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374465+0000", 2024-05-08T18:09:08.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8347000000000002e-05 2024-05-08T18:09:08.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374476+0000", 2024-05-08T18:09:08.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1334e-05 2024-05-08T18:09:08.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374553+0000", 2024-05-08T18:09:08.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6555000000000001e-05 2024-05-08T18:09:08.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374667+0000", 2024-05-08T18:09:08.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114732 2024-05-08T18:09:08.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:08.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374764+0000", 2024-05-08T18:09:08.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6527000000000006e-05 2024-05-08T18:09:08.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.382209+0000", 2024-05-08T18:09:08.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074447309999999996 2024-05-08T18:09:08.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.390135+0000", 2024-05-08T18:09:08.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079259099999999996 2024-05-08T18:09:08.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.390185+0000", 2024-05-08T18:09:08.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0834999999999997e-05 2024-05-08T18:09:08.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.390245+0000", 2024-05-08T18:09:08.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9444000000000002e-05 2024-05-08T18:09:08.793 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.793 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.793 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.793 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1250 3.5 3:a2e5fd48:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.793 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.419994+0000", 2024-05-08T18:09:08.793 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.28399614099999998, 2024-05-08T18:09:08.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016052853999999998, 2024-05-08T18:09:08.793 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.793 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.793 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.794 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.794 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.794 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.794 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1250 2024-05-08T18:09:08.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.794 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.419994+0000", 2024-05-08T18:09:08.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.419994+0000", 2024-05-08T18:09:08.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.420012+0000", 2024-05-08T18:09:08.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8851e-05 2024-05-08T18:09:08.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.423871+0000", 2024-05-08T18:09:08.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038584769999999999 2024-05-08T18:09:08.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.423891+0000", 2024-05-08T18:09:08.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0307000000000001e-05 2024-05-08T18:09:08.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.423904+0000", 2024-05-08T18:09:08.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2347999999999999e-05 2024-05-08T18:09:08.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.423965+0000", 2024-05-08T18:09:08.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1320000000000002e-05 2024-05-08T18:09:08.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.424075+0000", 2024-05-08T18:09:08.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109724 2024-05-08T18:09:08.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:08.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.424166+0000", 2024-05-08T18:09:08.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1087000000000004e-05 2024-05-08T18:09:08.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.430491+0000", 2024-05-08T18:09:08.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006325771 2024-05-08T18:09:08.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.435975+0000", 2024-05-08T18:09:08.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054837339999999997 2024-05-08T18:09:08.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.436012+0000", 2024-05-08T18:09:08.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6365000000000002e-05 2024-05-08T18:09:08.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.436046+0000", 2024-05-08T18:09:08.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4870000000000003e-05 2024-05-08T18:09:08.798 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.798 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.798 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.798 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1256 3.30 3:0f8eeada:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.799 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.488964+0000", 2024-05-08T18:09:08.799 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.21502532599999999, 2024-05-08T18:09:08.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015843097, 2024-05-08T18:09:08.799 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.799 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.799 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.799 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.799 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.799 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.799 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1256 2024-05-08T18:09:08.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.799 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.488964+0000", 2024-05-08T18:09:08.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.488964+0000", 2024-05-08T18:09:08.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.488967+0000", 2024-05-08T18:09:08.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5969999999999999e-06 2024-05-08T18:09:08.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.492770+0000", 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038028599999999999 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.492793+0000", 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3512000000000001e-05 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.492806+0000", 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2371000000000001e-05 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.492883+0000", 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6824999999999997e-05 2024-05-08T18:09:08.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.493016+0000", 2024-05-08T18:09:08.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013380400000000001 2024-05-08T18:09:08.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:08.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.493126+0000", 2024-05-08T18:09:08.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109786 2024-05-08T18:09:08.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.497974+0000", 2024-05-08T18:09:08.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048478970000000003 2024-05-08T18:09:08.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.504662+0000", 2024-05-08T18:09:08.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0066878809999999997 2024-05-08T18:09:08.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.504742+0000", 2024-05-08T18:09:08.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0061999999999993e-05 2024-05-08T18:09:08.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.504807+0000", 2024-05-08T18:09:08.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5501999999999997e-05 2024-05-08T18:09:08.804 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.804 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.804 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.804 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1258 3.3c 3:3f4312ea:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:08.804 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.514782+0000", 2024-05-08T18:09:08.804 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.18920764600000001, 2024-05-08T18:09:08.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017104635, 2024-05-08T18:09:08.804 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:08.804 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:08.804 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:08.804 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:08.805 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:08.805 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:08.805 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1258 2024-05-08T18:09:08.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.805 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:08.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:08.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.514782+0000", 2024-05-08T18:09:08.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:08.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.514782+0000", 2024-05-08T18:09:08.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:08.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:08.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.514786+0000", 2024-05-08T18:09:08.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4800000000000001e-06 2024-05-08T18:09:08.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:08.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.518731+0000", 2024-05-08T18:09:08.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039452089999999999 2024-05-08T18:09:08.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:08.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.518770+0000", 2024-05-08T18:09:08.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9572e-05 2024-05-08T18:09:08.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:08.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.518789+0000", 2024-05-08T18:09:08.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8774e-05 2024-05-08T18:09:08.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:08.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.518904+0000", 2024-05-08T18:09:08.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115229 2024-05-08T18:09:08.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.519072+0000", 2024-05-08T18:09:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016742699999999999 2024-05-08T18:09:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.519265+0000", 2024-05-08T18:09:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019326900000000001 2024-05-08T18:09:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.528402+0000", 2024-05-08T18:09:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0091371760000000003 2024-05-08T18:09:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:08.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.531700+0000", 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0032978149999999999 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.531803+0000", 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000102699 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.531887+0000", 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3985000000000003e-05 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:08.809 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:08.810 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records in 2024-05-08T18:09:08.810 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records out 2024-05-08T18:09:08.810 INFO:tasks.workunit.client.0.smithi080.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0795643 s, 1.3 GB/s 2024-05-08T18:09:08.811 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:09:08.812 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:08.812+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:08.911 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:08.912+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:08.936 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:08.937 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:08.937 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:08.937 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:08.951 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:09:09.012 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:09.013+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:09.018 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:09:09.076 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:09.077 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:09.077 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:09.077 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:09.077 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:09.094 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:09:09.132 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-05-08T18:09:09.136 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:09.137+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:09.198 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:09.199 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:09.214 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:09.216+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:09.222 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:09.222 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:09.243 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:09.244 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:09.265 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:09.265 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.741341146, 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.032012946, 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.278 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:09.278 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:09.278 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:09.278 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:09:09.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.278 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:09.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535484+0000", 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7929999999999999e-06 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535500+0000", 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5226e-05 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535535+0000", 2024-05-08T18:09:09.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5213000000000003e-05 2024-05-08T18:09:09.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535564+0000", 2024-05-08T18:09:09.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9360999999999999e-05 2024-05-08T18:09:09.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535757+0000", 2024-05-08T18:09:09.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000193229 2024-05-08T18:09:09.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:09.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535775+0000", 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7098000000000001e-05 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556004+0000", 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020229068999999999 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556036+0000", 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1943000000000002e-05 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.564721+0000", 2024-05-08T18:09:09.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086853320000000005 2024-05-08T18:09:09.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565032+0000", 2024-05-08T18:09:09.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031121799999999999 2024-05-08T18:09:09.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:09.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565365+0000", 2024-05-08T18:09:09.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000332744 2024-05-08T18:09:09.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567305+0000", 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00194016 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567368+0000", 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3342000000000004e-05 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567433+0000", 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4726000000000003e-05 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567494+0000", 2024-05-08T18:09:09.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0492000000000003e-05 2024-05-08T18:09:09.284 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.284 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.284 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.284 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1189 3.20 3:054e8a9f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:09.284 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:09.284 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 2.3166517400000002, 2024-05-08T18:09:09.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025093629999999999, 2024-05-08T18:09:09.284 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.284 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1189 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:09.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960173+0000", 2024-05-08T18:09:09.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.65e-06 2024-05-08T18:09:09.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965720+0000", 2024-05-08T18:09:09.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055476340000000001 2024-05-08T18:09:09.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965757+0000", 2024-05-08T18:09:09.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6223000000000002e-05 2024-05-08T18:09:09.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965774+0000", 2024-05-08T18:09:09.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6952999999999998e-05 2024-05-08T18:09:09.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965930+0000", 2024-05-08T18:09:09.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015611800000000001 2024-05-08T18:09:09.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966190+0000", 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025999399999999999 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966440+0000", 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025007600000000001 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981042+0000", 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01460257 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.984969+0000", 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039265159999999997 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985135+0000", 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016630400000000001 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985264+0000", 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012859199999999999 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1192 3.1e e85/47 3:7833f47f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_4:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.994441+0000", 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 2.2823806260000001, 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016369932, 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994441+0000", 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994441+0000", 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994445+0000", 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4199999999999999e-06 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.000972+0000", 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065271340000000004 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.001010+0000", 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8451999999999997e-05 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.001035+0000", 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4867000000000001e-05 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.001166+0000", 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013134799999999999 2024-05-08T18:09:09.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.001205+0000", 2024-05-08T18:09:09.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8445999999999997e-05 2024-05-08T18:09:09.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010722+0000", 2024-05-08T18:09:09.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0095169460000000001 2024-05-08T18:09:09.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010811+0000", 2024-05-08T18:09:09.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9319000000000003e-05 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1197 3.2e e85/20 3:760a6639:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_9:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.051204+0000", 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 2.2256172919999999, 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017286416999999998, 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.051204+0000", 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.051204+0000", 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.051207+0000", 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6929999999999999e-06 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056151+0000", 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049433360000000004 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056183+0000", 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2826e-05 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056198+0000", 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5074e-05 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056349+0000", 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015056100000000001 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056387+0000", 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7756000000000002e-05 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.068354+0000", 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011967099 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.068491+0000", 2024-05-08T18:09:09.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013707199999999999 2024-05-08T18:09:09.298 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.298 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.298 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.298 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1204 3.2e e85/20 3:748aabc2:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_16:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:09.298 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.122101+0000", 2024-05-08T18:09:09.298 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 2.1547212249999999, 2024-05-08T18:09:09.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015632494, 2024-05-08T18:09:09.298 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.298 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.298 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.298 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.122101+0000", 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.122101+0000", 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.122104+0000", 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6669999999999998e-06 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.126651+0000", 2024-05-08T18:09:09.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045468710000000001 2024-05-08T18:09:09.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.126690+0000", 2024-05-08T18:09:09.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9162999999999998e-05 2024-05-08T18:09:09.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.126708+0000", 2024-05-08T18:09:09.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7694e-05 2024-05-08T18:09:09.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.126852+0000", 2024-05-08T18:09:09.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000143788 2024-05-08T18:09:09.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.126903+0000", 2024-05-08T18:09:09.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1354999999999999e-05 2024-05-08T18:09:09.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.137501+0000", 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010598095 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.137733+0000", 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023186100000000001 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1209 3.35 3:af4c6abe:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 2.101390093, 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027313356, 2024-05-08T18:09:09.303 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.303 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.303 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.303 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:09.303 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:09.303 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:09.303 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1209 2024-05-08T18:09:09.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.303 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:09.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175436+0000", 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3800000000000004e-06 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179472+0000", 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040357020000000004 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179515+0000", 2024-05-08T18:09:09.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2988999999999998e-05 2024-05-08T18:09:09.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179534+0000", 2024-05-08T18:09:09.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8743e-05 2024-05-08T18:09:09.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179673+0000", 2024-05-08T18:09:09.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013983800000000001 2024-05-08T18:09:09.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179933+0000", 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025967999999999998 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180161+0000", 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022826300000000001 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.200613+0000", 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020451766999999999 2024-05-08T18:09:09.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:09.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202567+0000", 2024-05-08T18:09:09.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019541160000000001 2024-05-08T18:09:09.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202665+0000", 2024-05-08T18:09:09.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8055999999999998e-05 2024-05-08T18:09:09.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202745+0000", 2024-05-08T18:09:09.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9821999999999996e-05 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1221 3.20 3:071d1257:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.682075218, 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02822473, 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1221 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594751+0000", 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3769999999999998e-06 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600627+0000", 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058764389999999998 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600672+0000", 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4805999999999998e-05 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600704+0000", 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2026000000000001e-05 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600884+0000", 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000179385 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601296+0000", 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041257400000000002 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601742+0000", 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044585399999999998 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.617360+0000", 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015617982000000001 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622618+0000", 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052577420000000001 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622835+0000", 2024-05-08T18:09:09.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021674699999999999 2024-05-08T18:09:09.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622971+0000", 2024-05-08T18:09:09.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679799999999999 2024-05-08T18:09:09.313 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.313 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.313 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.313 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1223 3.2e e85/20 3:74a5b043:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_7:head v 85'3, mlcod=85'1)", 2024-05-08T18:09:09.313 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.619798+0000", 2024-05-08T18:09:09.314 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.657023388, 2024-05-08T18:09:09.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018211183999999998, 2024-05-08T18:09:09.314 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.314 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.314 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.314 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.619798+0000", 2024-05-08T18:09:09.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.619798+0000", 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.619801+0000", 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7e-06 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625096+0000", 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052944369999999999 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625126+0000", 2024-05-08T18:09:09.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0960000000000002e-05 2024-05-08T18:09:09.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625165+0000", 2024-05-08T18:09:09.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8136000000000002e-05 2024-05-08T18:09:09.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625291+0000", 2024-05-08T18:09:09.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012613500000000001 2024-05-08T18:09:09.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625349+0000", 2024-05-08T18:09:09.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8495999999999997e-05 2024-05-08T18:09:09.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.637877+0000", 2024-05-08T18:09:09.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012527652 2024-05-08T18:09:09.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638010+0000", 2024-05-08T18:09:09.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013266800000000001 2024-05-08T18:09:09.317 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.317 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1228 3.36 3:6c2a27dc:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.704533+0000", 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.5722892040000001, 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014917489000000001, 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1228 2024-05-08T18:09:09.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.319 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.704533+0000", 2024-05-08T18:09:09.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.704533+0000", 2024-05-08T18:09:09.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.704536+0000", 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.19e-06 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.708680+0000", 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041446959999999998 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.708721+0000", 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0800000000000002e-05 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.708739+0000", 2024-05-08T18:09:09.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8125999999999999e-05 2024-05-08T18:09:09.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.708846+0000", 2024-05-08T18:09:09.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010638599999999999 2024-05-08T18:09:09.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.708984+0000", 2024-05-08T18:09:09.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013804 2024-05-08T18:09:09.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:09.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.709100+0000", 2024-05-08T18:09:09.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011580499999999999 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.719101+0000", 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010001863999999999 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.719364+0000", 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026204599999999999 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.719410+0000", 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6072999999999997e-05 2024-05-08T18:09:09.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.719450+0000", 2024-05-08T18:09:09.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0463000000000002e-05 2024-05-08T18:09:09.323 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.323 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.323 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.323 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1238 3.33 e85/20 3:cec32d89:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_22:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:09.323 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.912847+0000", 2024-05-08T18:09:09.323 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.3639750509999999, 2024-05-08T18:09:09.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0097957280000000001, 2024-05-08T18:09:09.323 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.323 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.912847+0000", 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.912847+0000", 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.912848+0000", 2024-05-08T18:09:09.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5549999999999999e-06 2024-05-08T18:09:09.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.918308+0000", 2024-05-08T18:09:09.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054595099999999999 2024-05-08T18:09:09.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.918340+0000", 2024-05-08T18:09:09.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2135000000000003e-05 2024-05-08T18:09:09.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.918354+0000", 2024-05-08T18:09:09.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3927999999999999e-05 2024-05-08T18:09:09.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.918445+0000", 2024-05-08T18:09:09.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1440999999999994e-05 2024-05-08T18:09:09.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.918463+0000", 2024-05-08T18:09:09.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7251000000000001e-05 2024-05-08T18:09:09.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.922598+0000", 2024-05-08T18:09:09.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041357210000000002 2024-05-08T18:09:09.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.922642+0000", 2024-05-08T18:09:09.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4187000000000002e-05 2024-05-08T18:09:09.327 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.327 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.327 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.327 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1240 3.2c 3:3640ae6b:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:09.327 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.957482+0000", 2024-05-08T18:09:09.327 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.319340116, 2024-05-08T18:09:09.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014997720000000001, 2024-05-08T18:09:09.328 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.328 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.328 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.328 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:09.328 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:09.328 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:09.328 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1240 2024-05-08T18:09:09.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.328 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.957482+0000", 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.957482+0000", 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.957485+0000", 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8890000000000002e-06 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.961199+0000", 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037141700000000001 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.961224+0000", 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5636e-05 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.961235+0000", 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0747999999999999e-05 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.961328+0000", 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3150000000000001e-05 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.961532+0000", 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020382700000000001 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.961692+0000", 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015986099999999999 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.969970+0000", 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082783119999999995 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.972327+0000", 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023569089999999999 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.972407+0000", 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0026999999999998e-05 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.972479+0000", 2024-05-08T18:09:09.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2191000000000001e-05 2024-05-08T18:09:09.333 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.333 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.333 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.333 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1245 3.34 e85/20 3:2ea747e7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_1:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:09.333 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.350123+0000", 2024-05-08T18:09:09.333 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.926698523, 2024-05-08T18:09:09.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010675163, 2024-05-08T18:09:09.333 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.333 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.334 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.334 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.350123+0000", 2024-05-08T18:09:09.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.350123+0000", 2024-05-08T18:09:09.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.350126+0000", 2024-05-08T18:09:09.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:09:09.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.352825+0000", 2024-05-08T18:09:09.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026997200000000001 2024-05-08T18:09:09.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.352866+0000", 2024-05-08T18:09:09.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0818999999999997e-05 2024-05-08T18:09:09.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.352884+0000", 2024-05-08T18:09:09.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7853e-05 2024-05-08T18:09:09.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.353013+0000", 2024-05-08T18:09:09.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012852800000000001 2024-05-08T18:09:09.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.353064+0000", 2024-05-08T18:09:09.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1853e-05 2024-05-08T18:09:09.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.360733+0000", 2024-05-08T18:09:09.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0076687140000000001 2024-05-08T18:09:09.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.360798+0000", 2024-05-08T18:09:09.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5259999999999995e-05 2024-05-08T18:09:09.337 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.337 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.337 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.337 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1252 3.2c 3:37bfa689:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:09.337 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.445436+0000", 2024-05-08T18:09:09.337 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.83138608700000005, 2024-05-08T18:09:09.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016825887000000001, 2024-05-08T18:09:09.338 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.338 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.338 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.338 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:09.338 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:09.338 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:09.338 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1252 2024-05-08T18:09:09.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.338 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.445436+0000", 2024-05-08T18:09:09.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.445436+0000", 2024-05-08T18:09:09.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.445438+0000", 2024-05-08T18:09:09.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7530000000000002e-06 2024-05-08T18:09:09.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.449484+0000", 2024-05-08T18:09:09.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040451510000000003 2024-05-08T18:09:09.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.449511+0000", 2024-05-08T18:09:09.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7188000000000001e-05 2024-05-08T18:09:09.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.449523+0000", 2024-05-08T18:09:09.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1762e-05 2024-05-08T18:09:09.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.449602+0000", 2024-05-08T18:09:09.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9849000000000001e-05 2024-05-08T18:09:09.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.449731+0000", 2024-05-08T18:09:09.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012886899999999999 2024-05-08T18:09:09.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:09.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.449835+0000", 2024-05-08T18:09:09.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103739 2024-05-08T18:09:09.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:09.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.455838+0000", 2024-05-08T18:09:09.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006002767 2024-05-08T18:09:09.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:09.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.462140+0000", 2024-05-08T18:09:09.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0063020890000000003 2024-05-08T18:09:09.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.462207+0000", 2024-05-08T18:09:09.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7624000000000002e-05 2024-05-08T18:09:09.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.462262+0000", 2024-05-08T18:09:09.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4095999999999998e-05 2024-05-08T18:09:09.343 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.343 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.343 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.343 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1263 3.36 3:6eb7bd8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:09.343 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.571418+0000", 2024-05-08T18:09:09.343 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.70540388899999995, 2024-05-08T18:09:09.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018084347000000001, 2024-05-08T18:09:09.343 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.343 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.343 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.343 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:09.343 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:09.343 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:09.343 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1263 2024-05-08T18:09:09.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.344 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.571418+0000", 2024-05-08T18:09:09.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.571418+0000", 2024-05-08T18:09:09.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.571420+0000", 2024-05-08T18:09:09.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3860000000000001e-06 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575201+0000", 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037802589999999998 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575225+0000", 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4134999999999998e-05 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575237+0000", 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2425999999999999e-05 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575315+0000", 2024-05-08T18:09:09.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7621999999999996e-05 2024-05-08T18:09:09.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575474+0000", 2024-05-08T18:09:09.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015942699999999999 2024-05-08T18:09:09.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:09.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575606+0000", 2024-05-08T18:09:09.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013143200000000001 2024-05-08T18:09:09.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:09.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.589176+0000", 2024-05-08T18:09:09.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013570863000000001 2024-05-08T18:09:09.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:09.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.589303+0000", 2024-05-08T18:09:09.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126067 2024-05-08T18:09:09.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.589421+0000", 2024-05-08T18:09:09.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118311 2024-05-08T18:09:09.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.589502+0000", 2024-05-08T18:09:09.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1419000000000001e-05 2024-05-08T18:09:09.348 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.348 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.348 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.348 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1268 3.36 3:6efaad9c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:09.348 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.629292+0000", 2024-05-08T18:09:09.348 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.64752973999999996, 2024-05-08T18:09:09.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018691711, 2024-05-08T18:09:09.348 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.348 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.348 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.348 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:09.348 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:09.349 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:09.349 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1268 2024-05-08T18:09:09.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.349 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.629292+0000", 2024-05-08T18:09:09.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.629292+0000", 2024-05-08T18:09:09.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.629295+0000", 2024-05-08T18:09:09.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5799999999999999e-06 2024-05-08T18:09:09.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633104+0000", 2024-05-08T18:09:09.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038088869999999999 2024-05-08T18:09:09.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633130+0000", 2024-05-08T18:09:09.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6016e-05 2024-05-08T18:09:09.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633144+0000", 2024-05-08T18:09:09.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3971999999999999e-05 2024-05-08T18:09:09.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633229+0000", 2024-05-08T18:09:09.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5749999999999997e-05 2024-05-08T18:09:09.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633349+0000", 2024-05-08T18:09:09.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011934000000000001 2024-05-08T18:09:09.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633507+0000", 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015834700000000001 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.639941+0000", 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064341449999999996 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.647803+0000", 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078617889999999992 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.647907+0000", 2024-05-08T18:09:09.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010413599999999999 2024-05-08T18:09:09.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.647984+0000", 2024-05-08T18:09:09.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6749000000000007e-05 2024-05-08T18:09:09.353 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.353 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.353 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.353 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1275 3.33 e85/20 3:ccdf9558:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_3:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:09.353 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:09.353 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.223232182, 2024-05-08T18:09:09.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020251129, 2024-05-08T18:09:09.353 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.353 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.354 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.354 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:09.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:09.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053592+0000", 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5189999999999999e-06 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059662+0000", 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060699289999999999 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059680+0000", 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7558999999999999e-05 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059689+0000", 2024-05-08T18:09:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2320000000000007e-06 2024-05-08T18:09:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059826+0000", 2024-05-08T18:09:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136792 2024-05-08T18:09:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059867+0000", 2024-05-08T18:09:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1689e-05 2024-05-08T18:09:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073728+0000", 2024-05-08T18:09:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01386104 2024-05-08T18:09:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073841+0000", 2024-05-08T18:09:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011236899999999999 2024-05-08T18:09:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1277 3.3f e85/20 3:ffe0c8dc:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_5:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.090490+0000", 2024-05-08T18:09:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.18633138199999999, 2024-05-08T18:09:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014866682000000001, 2024-05-08T18:09:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.090490+0000", 2024-05-08T18:09:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.090490+0000", 2024-05-08T18:09:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.090493+0000", 2024-05-08T18:09:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.367e-06 2024-05-08T18:09:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.093164+0000", 2024-05-08T18:09:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026714529999999998 2024-05-08T18:09:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.093204+0000", 2024-05-08T18:09:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9959000000000001e-05 2024-05-08T18:09:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.093223+0000", 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.891e-05 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.093312+0000", 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8530999999999997e-05 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.093336+0000", 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4362000000000002e-05 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.105165+0000", 2024-05-08T18:09:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011829165000000001 2024-05-08T18:09:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.105357+0000", 2024-05-08T18:09:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019193500000000001 2024-05-08T18:09:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1280 3.2e e85/20 3:75e8bee5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_8:head v 85'4, mlcod=85'2)", 2024-05-08T18:09:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.136697+0000", 2024-05-08T18:09:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.14012508600000001, 2024-05-08T18:09:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011691181, 2024-05-08T18:09:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.136697+0000", 2024-05-08T18:09:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.136697+0000", 2024-05-08T18:09:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.136699+0000", 2024-05-08T18:09:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2670000000000001e-06 2024-05-08T18:09:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.141477+0000", 2024-05-08T18:09:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047778459999999997 2024-05-08T18:09:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.141500+0000", 2024-05-08T18:09:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3028e-05 2024-05-08T18:09:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.141511+0000", 2024-05-08T18:09:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1083999999999999e-05 2024-05-08T18:09:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.141678+0000", 2024-05-08T18:09:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000166933 2024-05-08T18:09:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.141741+0000", 2024-05-08T18:09:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3164999999999996e-05 2024-05-08T18:09:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.148178+0000", 2024-05-08T18:09:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064372509999999997 2024-05-08T18:09:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.148388+0000", 2024-05-08T18:09:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000209607 2024-05-08T18:09:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1284 3.1e e86/47 3:7ad9fe5d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_12:head v 86'2, mlcod=0'0)", 2024-05-08T18:09:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.195113+0000", 2024-05-08T18:09:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.081708403999999998, 2024-05-08T18:09:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015461363000000001, 2024-05-08T18:09:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.195113+0000", 2024-05-08T18:09:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.195113+0000", 2024-05-08T18:09:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.195114+0000", 2024-05-08T18:09:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0499999999999999e-07 2024-05-08T18:09:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.200644+0000", 2024-05-08T18:09:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055300840000000002 2024-05-08T18:09:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.200669+0000", 2024-05-08T18:09:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5262e-05 2024-05-08T18:09:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.200680+0000", 2024-05-08T18:09:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.079e-05 2024-05-08T18:09:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.200754+0000", 2024-05-08T18:09:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4536999999999995e-05 2024-05-08T18:09:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.200776+0000", 2024-05-08T18:09:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1682999999999999e-05 2024-05-08T18:09:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.210484+0000", 2024-05-08T18:09:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0097082880000000007 2024-05-08T18:09:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.210575+0000", 2024-05-08T18:09:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0414000000000005e-05 2024-05-08T18:09:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1286 3.20 3:07ccb256:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.072537567999999997, 2024-05-08T18:09:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022546805999999999, 2024-05-08T18:09:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1286 2024-05-08T18:09:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204287+0000", 2024-05-08T18:09:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8880000000000001e-06 2024-05-08T18:09:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208135+0000", 2024-05-08T18:09:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038480960000000001 2024-05-08T18:09:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208158+0000", 2024-05-08T18:09:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-05 2024-05-08T18:09:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208172+0000", 2024-05-08T18:09:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:09:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208251+0000", 2024-05-08T18:09:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8863999999999996e-05 2024-05-08T18:09:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208387+0000", 2024-05-08T18:09:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013615099999999999 2024-05-08T18:09:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208488+0000", 2024-05-08T18:09:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101366 2024-05-08T18:09:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.214533+0000", 2024-05-08T18:09:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060444829999999998 2024-05-08T18:09:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226742+0000", 2024-05-08T18:09:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012208798 2024-05-08T18:09:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226792+0000", 2024-05-08T18:09:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0565999999999997e-05 2024-05-08T18:09:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226831+0000", 2024-05-08T18:09:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8816999999999998e-05 2024-05-08T18:09:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:09.375 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:09.376 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:09.376 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:09.377 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:09.377 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:09.378 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:09:09.378 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:09.377+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:09.378 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:09.378 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:09.379 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:09.379 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:09.390 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_06: 100Mb.4 2024-05-08T18:09:09.390 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:09.390 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 5 2024-05-08T18:09:09.465 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records in 2024-05-08T18:09:09.465 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records out 2024-05-08T18:09:09.465 INFO:tasks.workunit.client.0.smithi080.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0730716 s, 1.4 GB/s 2024-05-08T18:09:09.477 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:09.477+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:09.551 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:09.551 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:09.566 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:09:09.608 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:09.609+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:09.680 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:09.681+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:09.729 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:09.729 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:09.745 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:09:09.792 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:09.793+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:09.881 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:09.880+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:09.915 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:09.915 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:09.933 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:09:09.982 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:09.984+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:10.082 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:10.084+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:10.097 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:10.097 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:10.113 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:09:10.135 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_06: 100Mb.5 2024-05-08T18:09:10.135 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:10.135 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 6 2024-05-08T18:09:10.183 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:10.184+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:10.214 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records in 2024-05-08T18:09:10.214 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records out 2024-05-08T18:09:10.214 INFO:tasks.workunit.client.0.smithi080.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0772254 s, 1.4 GB/s 2024-05-08T18:09:10.257 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:10.258 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:10.271 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:09:10.314 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:10.316+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:10.384 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:10.385+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:10.436 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:10.436 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:10.453 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:09:10.485 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:10.485+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:10.586 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:10.585+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:10.607 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:10.607 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:10.630 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:09:10.688 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:10.688+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:10.768 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:10.768 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:10.785 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:09:10.788 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:10.789+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:10.813 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_06: 100Mb.6 2024-05-08T18:09:10.813 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:10.813 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 7 2024-05-08T18:09:10.888 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records in 2024-05-08T18:09:10.888 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records out 2024-05-08T18:09:10.889 INFO:tasks.workunit.client.0.smithi080.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0738246 s, 1.4 GB/s 2024-05-08T18:09:10.889 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:10.888+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:10.933 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:10.934 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:10.947 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:09:10.990 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:10.992+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:11.091 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:11.092+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:11.117 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:11.117 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:11.133 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:09:11.172 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:09:11.192 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:11.193+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:11.293 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:11.293+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:11.344 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:11.344 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:11.370 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:09:11.380 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:09:11.394 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:11.393+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:11.453 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_06: 100Mb.7 2024-05-08T18:09:11.453 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:11.453 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 8 2024-05-08T18:09:11.495 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:11.493+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:11.501 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:11.501 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:11.518 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:09:11.526 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records in 2024-05-08T18:09:11.526 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records out 2024-05-08T18:09:11.526 INFO:tasks.workunit.client.0.smithi080.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0707994 s, 1.5 GB/s 2024-05-08T18:09:11.558 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:11.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:11.576 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:11.576 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:11.594 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:11.594 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:11.595 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:11.596+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:11.607 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-05-08T18:09:11.614 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:11.614 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:11.634 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:11.635 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:11.646 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:11.646 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:11.647 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:11.647 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:11.655 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:11.655 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:11.659 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:09:11.674 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:11.675 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:11.694 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:11.695 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:11.696 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:11.697+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:11.797 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:11.796+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:11.800 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:11.800 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:11.800 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:11.800 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:11.800 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:11.816 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:09:11.902 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:11.904+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:11.999 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:12.000+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:12.005 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:12.005 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:12.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:12.005 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:12.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.005 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1200 3.38 3:1e9fdc78:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.005 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.083611+0000", 2024-05-08T18:09:12.005 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.9249270190000001, 2024-05-08T18:09:12.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018355481, 2024-05-08T18:09:12.006 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.006 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.006 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.006 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:12.006 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:12.006 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.006 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1200 2024-05-08T18:09:12.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.006 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.083611+0000", 2024-05-08T18:09:12.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.083611+0000", 2024-05-08T18:09:12.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.083614+0000", 2024-05-08T18:09:12.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7989999999999998e-06 2024-05-08T18:09:12.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085152+0000", 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001538097 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085182+0000", 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0066999999999999e-05 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085197+0000", 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4911e-05 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085262+0000", 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4703999999999996e-05 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085395+0000", 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133549 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085490+0000", 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5076999999999998e-05 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.095404+0000", 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0099138290000000007 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.101881+0000", 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0064767269999999998 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.101930+0000", 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8578000000000001e-05 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.101967+0000", 2024-05-08T18:09:12.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7143e-05 2024-05-08T18:09:12.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.011 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.011 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1206 3.8 3:11c650fd:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.011 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.145496+0000", 2024-05-08T18:09:12.011 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.8630420169999997, 2024-05-08T18:09:12.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014861228000000001, 2024-05-08T18:09:12.011 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.012 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.012 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.012 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:12.012 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:12.012 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.012 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1206 2024-05-08T18:09:12.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.012 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.145496+0000", 2024-05-08T18:09:12.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.145496+0000", 2024-05-08T18:09:12.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.145499+0000", 2024-05-08T18:09:12.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6110000000000001e-06 2024-05-08T18:09:12.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.147293+0000", 2024-05-08T18:09:12.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001793715 2024-05-08T18:09:12.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.147315+0000", 2024-05-08T18:09:12.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2425999999999998e-05 2024-05-08T18:09:12.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.147326+0000", 2024-05-08T18:09:12.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0491e-05 2024-05-08T18:09:12.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.147413+0000", 2024-05-08T18:09:12.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7175999999999993e-05 2024-05-08T18:09:12.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.147553+0000", 2024-05-08T18:09:12.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014023700000000001 2024-05-08T18:09:12.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:12.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.147696+0000", 2024-05-08T18:09:12.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014265 2024-05-08T18:09:12.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:12.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.159531+0000", 2024-05-08T18:09:12.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011835836000000001 2024-05-08T18:09:12.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.160285+0000", 2024-05-08T18:09:12.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00075360800000000001 2024-05-08T18:09:12.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.160323+0000", 2024-05-08T18:09:12.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8285999999999999e-05 2024-05-08T18:09:12.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.160357+0000", 2024-05-08T18:09:12.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4192000000000001e-05 2024-05-08T18:09:12.017 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.017 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.017 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.017 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1207 3.15 e85/20 3:a96d965c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_19:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:12.017 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.162095+0000", 2024-05-08T18:09:12.017 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.8464432500000001, 2024-05-08T18:09:12.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022218617999999999, 2024-05-08T18:09:12.017 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.017 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.017 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.018 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.162095+0000", 2024-05-08T18:09:12.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.162095+0000", 2024-05-08T18:09:12.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.162096+0000", 2024-05-08T18:09:12.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8899999999999998e-07 2024-05-08T18:09:12.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167032+0000", 2024-05-08T18:09:12.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004936429 2024-05-08T18:09:12.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167062+0000", 2024-05-08T18:09:12.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9422000000000001e-05 2024-05-08T18:09:12.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167075+0000", 2024-05-08T18:09:12.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3436e-05 2024-05-08T18:09:12.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167157+0000", 2024-05-08T18:09:12.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1337999999999999e-05 2024-05-08T18:09:12.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167180+0000", 2024-05-08T18:09:12.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3816e-05 2024-05-08T18:09:12.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.184267+0000", 2024-05-08T18:09:12.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017086796000000001 2024-05-08T18:09:12.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.184314+0000", 2024-05-08T18:09:12.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6391999999999999e-05 2024-05-08T18:09:12.021 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.021 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.021 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.021 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1217 3.8 3:111c684a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.021 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.543781+0000", 2024-05-08T18:09:12.022 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.4647574719999996, 2024-05-08T18:09:12.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013958142999999999, 2024-05-08T18:09:12.022 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.022 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.022 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.022 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:12.022 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:12.022 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.022 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1217 2024-05-08T18:09:12.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.022 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.543781+0000", 2024-05-08T18:09:12.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.543781+0000", 2024-05-08T18:09:12.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.543784+0000", 2024-05-08T18:09:12.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7690000000000001e-06 2024-05-08T18:09:12.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.545644+0000", 2024-05-08T18:09:12.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001860193 2024-05-08T18:09:12.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.545695+0000", 2024-05-08T18:09:12.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1106999999999997e-05 2024-05-08T18:09:12.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.545721+0000", 2024-05-08T18:09:12.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6605999999999999e-05 2024-05-08T18:09:12.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.545810+0000", 2024-05-08T18:09:12.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8944999999999996e-05 2024-05-08T18:09:12.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.545932+0000", 2024-05-08T18:09:12.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121403 2024-05-08T18:09:12.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:12.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.546039+0000", 2024-05-08T18:09:12.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106745 2024-05-08T18:09:12.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:12.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.551003+0000", 2024-05-08T18:09:12.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004964212 2024-05-08T18:09:12.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.557668+0000", 2024-05-08T18:09:12.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066653839999999999 2024-05-08T18:09:12.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.557707+0000", 2024-05-08T18:09:12.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8628999999999999e-05 2024-05-08T18:09:12.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.557739+0000", 2024-05-08T18:09:12.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2150000000000002e-05 2024-05-08T18:09:12.027 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.027 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.027 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.027 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1218 3.c e85/20 3:33b8068a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_2:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:12.027 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.573654+0000", 2024-05-08T18:09:12.028 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.4348838600000002, 2024-05-08T18:09:12.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016484525, 2024-05-08T18:09:12.028 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.028 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.028 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.028 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.573654+0000", 2024-05-08T18:09:12.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.573654+0000", 2024-05-08T18:09:12.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.573656+0000", 2024-05-08T18:09:12.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6360000000000001e-06 2024-05-08T18:09:12.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.577812+0000", 2024-05-08T18:09:12.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041564339999999996 2024-05-08T18:09:12.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.577840+0000", 2024-05-08T18:09:12.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7790999999999999e-05 2024-05-08T18:09:12.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.577855+0000", 2024-05-08T18:09:12.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4575e-05 2024-05-08T18:09:12.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.577938+0000", 2024-05-08T18:09:12.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2792000000000003e-05 2024-05-08T18:09:12.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.577964+0000", 2024-05-08T18:09:12.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6239000000000001e-05 2024-05-08T18:09:12.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.590093+0000", 2024-05-08T18:09:12.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012129548 2024-05-08T18:09:12.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.590139+0000", 2024-05-08T18:09:12.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5510000000000003e-05 2024-05-08T18:09:12.031 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.031 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.031 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.032 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1219 3.2 3:4068b298:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.032 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.575413+0000", 2024-05-08T18:09:12.032 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.4331257019999999, 2024-05-08T18:09:12.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.027002252000000001, 2024-05-08T18:09:12.032 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.032 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.032 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.032 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:12.032 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:12.032 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.032 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1219 2024-05-08T18:09:12.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.032 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.575413+0000", 2024-05-08T18:09:12.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.575413+0000", 2024-05-08T18:09:12.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.575416+0000", 2024-05-08T18:09:12.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2969999999999999e-06 2024-05-08T18:09:12.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.578847+0000", 2024-05-08T18:09:12.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003431052 2024-05-08T18:09:12.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.580255+0000", 2024-05-08T18:09:12.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014079310000000001 2024-05-08T18:09:12.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.580271+0000", 2024-05-08T18:09:12.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5637999999999998e-05 2024-05-08T18:09:12.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.580333+0000", 2024-05-08T18:09:12.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2213999999999998e-05 2024-05-08T18:09:12.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.580466+0000", 2024-05-08T18:09:12.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013334800000000001 2024-05-08T18:09:12.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:12.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.580556+0000", 2024-05-08T18:09:12.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0252000000000003e-05 2024-05-08T18:09:12.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:12.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.590619+0000", 2024-05-08T18:09:12.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010062448 2024-05-08T18:09:12.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.602227+0000", 2024-05-08T18:09:12.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011608108000000001 2024-05-08T18:09:12.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.602305+0000", 2024-05-08T18:09:12.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8468999999999997e-05 2024-05-08T18:09:12.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.602415+0000", 2024-05-08T18:09:12.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010949499999999999 2024-05-08T18:09:12.037 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.037 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.037 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.037 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1220 3.c e85/20 3:319326d6:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_4:head v 85'3, mlcod=85'1)", 2024-05-08T18:09:12.037 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.596343+0000", 2024-05-08T18:09:12.037 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.4121952679999996, 2024-05-08T18:09:12.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014124800999999999, 2024-05-08T18:09:12.037 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.037 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.037 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.037 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.596343+0000", 2024-05-08T18:09:12.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.596343+0000", 2024-05-08T18:09:12.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.596345+0000", 2024-05-08T18:09:12.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1239999999999999e-06 2024-05-08T18:09:12.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.601999+0000", 2024-05-08T18:09:12.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005653394 2024-05-08T18:09:12.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.602037+0000", 2024-05-08T18:09:12.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7996e-05 2024-05-08T18:09:12.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.602055+0000", 2024-05-08T18:09:12.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8277000000000001e-05 2024-05-08T18:09:12.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.602139+0000", 2024-05-08T18:09:12.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3712000000000001e-05 2024-05-08T18:09:12.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.602166+0000", 2024-05-08T18:09:12.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.703e-05 2024-05-08T18:09:12.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.609229+0000", 2024-05-08T18:09:12.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0070633700000000002 2024-05-08T18:09:12.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610468+0000", 2024-05-08T18:09:12.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001238898 2024-05-08T18:09:12.041 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.041 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.041 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.041 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1222 3.38 3:1f451ee1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.041 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.608041+0000", 2024-05-08T18:09:12.041 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.400496789, 2024-05-08T18:09:12.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021806477000000001, 2024-05-08T18:09:12.041 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.041 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.042 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:12.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:12.042 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.042 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1222 2024-05-08T18:09:12.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.042 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.608041+0000", 2024-05-08T18:09:12.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.608041+0000", 2024-05-08T18:09:12.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.608046+0000", 2024-05-08T18:09:12.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2030000000000002e-06 2024-05-08T18:09:12.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610351+0000", 2024-05-08T18:09:12.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023056790000000001 2024-05-08T18:09:12.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610383+0000", 2024-05-08T18:09:12.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1677000000000002e-05 2024-05-08T18:09:12.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610403+0000", 2024-05-08T18:09:12.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0429999999999999e-05 2024-05-08T18:09:12.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610499+0000", 2024-05-08T18:09:12.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5328999999999995e-05 2024-05-08T18:09:12.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610642+0000", 2024-05-08T18:09:12.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000143373 2024-05-08T18:09:12.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:12.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610746+0000", 2024-05-08T18:09:12.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010428 2024-05-08T18:09:12.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:12.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.617351+0000", 2024-05-08T18:09:12.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066048000000000001 2024-05-08T18:09:12.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.629762+0000", 2024-05-08T18:09:12.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012410796 2024-05-08T18:09:12.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.629802+0000", 2024-05-08T18:09:12.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9650999999999997e-05 2024-05-08T18:09:12.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.629848+0000", 2024-05-08T18:09:12.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6258999999999999e-05 2024-05-08T18:09:12.046 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.046 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.047 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.047 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1231 3.2 3:424ecddf:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.047 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.765983+0000", 2024-05-08T18:09:12.047 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.2425549609999997, 2024-05-08T18:09:12.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015801810999999999, 2024-05-08T18:09:12.047 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.047 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.047 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.047 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:12.047 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:12.047 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.047 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1231 2024-05-08T18:09:12.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.765983+0000", 2024-05-08T18:09:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.765983+0000", 2024-05-08T18:09:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.765987+0000", 2024-05-08T18:09:12.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8829999999999999e-06 2024-05-08T18:09:12.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.768719+0000", 2024-05-08T18:09:12.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027315389999999998 2024-05-08T18:09:12.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.768762+0000", 2024-05-08T18:09:12.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3590000000000001e-05 2024-05-08T18:09:12.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.768785+0000", 2024-05-08T18:09:12.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3153999999999999e-05 2024-05-08T18:09:12.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.768928+0000", 2024-05-08T18:09:12.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014249400000000001 2024-05-08T18:09:12.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.769275+0000", 2024-05-08T18:09:12.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034713799999999998 2024-05-08T18:09:12.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:12.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.769696+0000", 2024-05-08T18:09:12.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042129999999999999 2024-05-08T18:09:12.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:12.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.780739+0000", 2024-05-08T18:09:12.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011042201 2024-05-08T18:09:12.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.781599+0000", 2024-05-08T18:09:12.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00086013599999999995 2024-05-08T18:09:12.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.781705+0000", 2024-05-08T18:09:12.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105963 2024-05-08T18:09:12.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.781785+0000", 2024-05-08T18:09:12.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0413000000000004e-05 2024-05-08T18:09:12.052 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.052 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.052 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.052 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1232 3.b 3:d0ea1d30:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.052 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.783991+0000", 2024-05-08T18:09:12.053 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.2245472959999999, 2024-05-08T18:09:12.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016878918, 2024-05-08T18:09:12.053 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.053 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.053 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.053 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:12.053 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:12.053 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.053 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1232 2024-05-08T18:09:12.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.053 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.783991+0000", 2024-05-08T18:09:12.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.783991+0000", 2024-05-08T18:09:12.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.783993+0000", 2024-05-08T18:09:12.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0449999999999999e-06 2024-05-08T18:09:12.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.785899+0000", 2024-05-08T18:09:12.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019058230000000001 2024-05-08T18:09:12.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.785938+0000", 2024-05-08T18:09:12.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8810000000000003e-05 2024-05-08T18:09:12.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.785960+0000", 2024-05-08T18:09:12.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1849e-05 2024-05-08T18:09:12.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.786103+0000", 2024-05-08T18:09:12.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000143666 2024-05-08T18:09:12.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.786356+0000", 2024-05-08T18:09:12.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000252334 2024-05-08T18:09:12.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:12.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.786620+0000", 2024-05-08T18:09:12.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026423799999999997 2024-05-08T18:09:12.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:12.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.794453+0000", 2024-05-08T18:09:12.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0078336489999999998 2024-05-08T18:09:12.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.800709+0000", 2024-05-08T18:09:12.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062555429999999997 2024-05-08T18:09:12.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.800799+0000", 2024-05-08T18:09:12.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9648999999999995e-05 2024-05-08T18:09:12.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.800870+0000", 2024-05-08T18:09:12.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1311999999999998e-05 2024-05-08T18:09:12.058 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.058 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.058 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.058 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1237 3.24 3:2546570d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.058 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.888914+0000", 2024-05-08T18:09:12.058 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.1196240910000004, 2024-05-08T18:09:12.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016803458, 2024-05-08T18:09:12.058 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.058 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.059 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.059 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:12.059 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:12.059 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.059 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1237 2024-05-08T18:09:12.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.059 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.888914+0000", 2024-05-08T18:09:12.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.888914+0000", 2024-05-08T18:09:12.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.888918+0000", 2024-05-08T18:09:12.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7440000000000001e-06 2024-05-08T18:09:12.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.892308+0000", 2024-05-08T18:09:12.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033900850000000001 2024-05-08T18:09:12.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.892352+0000", 2024-05-08T18:09:12.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3655999999999997e-05 2024-05-08T18:09:12.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.892372+0000", 2024-05-08T18:09:12.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0806999999999999e-05 2024-05-08T18:09:12.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.892513+0000", 2024-05-08T18:09:12.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014047199999999999 2024-05-08T18:09:12.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.892747+0000", 2024-05-08T18:09:12.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023400800000000001 2024-05-08T18:09:12.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:12.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.893034+0000", 2024-05-08T18:09:12.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000287235 2024-05-08T18:09:12.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:12.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.902149+0000", 2024-05-08T18:09:12.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0091146479999999995 2024-05-08T18:09:12.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.905505+0000", 2024-05-08T18:09:12.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003356267 2024-05-08T18:09:12.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.905593+0000", 2024-05-08T18:09:12.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7536999999999999e-05 2024-05-08T18:09:12.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.905718+0000", 2024-05-08T18:09:12.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012499899999999999 2024-05-08T18:09:12.064 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.064 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.064 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.064 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1238 3.33 3:cec32d89:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.064 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.912757+0000", 2024-05-08T18:09:12.064 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.0957810500000003, 2024-05-08T18:09:12.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014412820999999999, 2024-05-08T18:09:12.064 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.064 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.064 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.065 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:12.065 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:12.065 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.065 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1238 2024-05-08T18:09:12.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.065 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.912757+0000", 2024-05-08T18:09:12.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.912757+0000", 2024-05-08T18:09:12.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.912760+0000", 2024-05-08T18:09:12.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1970000000000001e-06 2024-05-08T18:09:12.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.915727+0000", 2024-05-08T18:09:12.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029668709999999998 2024-05-08T18:09:12.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.915773+0000", 2024-05-08T18:09:12.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6026999999999998e-05 2024-05-08T18:09:12.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.915802+0000", 2024-05-08T18:09:12.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8342000000000001e-05 2024-05-08T18:09:12.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.915933+0000", 2024-05-08T18:09:12.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000131476 2024-05-08T18:09:12.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.916208+0000", 2024-05-08T18:09:12.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027449100000000003 2024-05-08T18:09:12.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:12.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.916472+0000", 2024-05-08T18:09:12.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000264295 2024-05-08T18:09:12.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:12.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.925068+0000", 2024-05-08T18:09:12.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085965580000000007 2024-05-08T18:09:12.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.926889+0000", 2024-05-08T18:09:12.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018203570000000001 2024-05-08T18:09:12.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.927038+0000", 2024-05-08T18:09:12.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014942800000000001 2024-05-08T18:09:12.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.927170+0000", 2024-05-08T18:09:12.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000131779 2024-05-08T18:09:12.070 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.070 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.070 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.070 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1242 3.28 e85/20 3:16e2765f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.2:head v 85'3, mlcod=85'1)", 2024-05-08T18:09:12.070 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.985612+0000", 2024-05-08T18:09:12.070 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.022926011, 2024-05-08T18:09:12.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014768928000000001, 2024-05-08T18:09:12.070 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.070 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.070 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.070 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.985612+0000", 2024-05-08T18:09:12.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.985612+0000", 2024-05-08T18:09:12.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.985615+0000", 2024-05-08T18:09:12.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3800000000000001e-06 2024-05-08T18:09:12.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.990770+0000", 2024-05-08T18:09:12.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051557479999999999 2024-05-08T18:09:12.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.990813+0000", 2024-05-08T18:09:12.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2799999999999997e-05 2024-05-08T18:09:12.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.990837+0000", 2024-05-08T18:09:12.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3683e-05 2024-05-08T18:09:12.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.990979+0000", 2024-05-08T18:09:12.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000142285 2024-05-08T18:09:12.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.991024+0000", 2024-05-08T18:09:12.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4709999999999997e-05 2024-05-08T18:09:12.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.000283+0000", 2024-05-08T18:09:12.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0092592230000000005 2024-05-08T18:09:12.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.000381+0000", 2024-05-08T18:09:12.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8098999999999997e-05 2024-05-08T18:09:12.074 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.074 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.074 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.074 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1247 3.c e85/20 3:32aac358:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_3:head v 85'4, mlcod=85'2)", 2024-05-08T18:09:12.075 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.379080+0000", 2024-05-08T18:09:12.075 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.6294587150000002, 2024-05-08T18:09:12.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014709731, 2024-05-08T18:09:12.075 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.075 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.075 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.075 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.379080+0000", 2024-05-08T18:09:12.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.379080+0000", 2024-05-08T18:09:12.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.379082+0000", 2024-05-08T18:09:12.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4990000000000001e-06 2024-05-08T18:09:12.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.384261+0000", 2024-05-08T18:09:12.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051786250000000001 2024-05-08T18:09:12.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.384287+0000", 2024-05-08T18:09:12.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6414000000000002e-05 2024-05-08T18:09:12.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.384301+0000", 2024-05-08T18:09:12.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3501e-05 2024-05-08T18:09:12.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.384396+0000", 2024-05-08T18:09:12.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4955000000000001e-05 2024-05-08T18:09:12.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.384423+0000", 2024-05-08T18:09:12.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7929999999999999e-05 2024-05-08T18:09:12.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.393708+0000", 2024-05-08T18:09:12.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0092845689999999995 2024-05-08T18:09:12.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.393789+0000", 2024-05-08T18:09:12.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1237999999999997e-05 2024-05-08T18:09:12.078 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.078 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.079 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.079 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1251 3.24 3:26ab10c7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.079 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.438484+0000", 2024-05-08T18:09:12.079 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.5700538760000002, 2024-05-08T18:09:12.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017151849, 2024-05-08T18:09:12.079 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.079 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.079 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.079 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:12.079 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:12.079 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.079 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1251 2024-05-08T18:09:12.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.080 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.438484+0000", 2024-05-08T18:09:12.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.438484+0000", 2024-05-08T18:09:12.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.438488+0000", 2024-05-08T18:09:12.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8800000000000001e-06 2024-05-08T18:09:12.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.442993+0000", 2024-05-08T18:09:12.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045048939999999997 2024-05-08T18:09:12.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.443028+0000", 2024-05-08T18:09:12.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5157000000000002e-05 2024-05-08T18:09:12.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.443054+0000", 2024-05-08T18:09:12.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5542999999999999e-05 2024-05-08T18:09:12.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.443174+0000", 2024-05-08T18:09:12.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011989000000000001 2024-05-08T18:09:12.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.443390+0000", 2024-05-08T18:09:12.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000216102 2024-05-08T18:09:12.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:12.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.443602+0000", 2024-05-08T18:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000211821 2024-05-08T18:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.450484+0000", 2024-05-08T18:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0068825700000000002 2024-05-08T18:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.455508+0000", 2024-05-08T18:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050239250000000003 2024-05-08T18:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.455580+0000", 2024-05-08T18:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1711999999999994e-05 2024-05-08T18:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.455636+0000", 2024-05-08T18:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6354999999999998e-05 2024-05-08T18:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1259 3.8 3:11e26aed:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.528466+0000", 2024-05-08T18:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.4800721819999998, 2024-05-08T18:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016085551999999999, 2024-05-08T18:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1259 2024-05-08T18:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.528466+0000", 2024-05-08T18:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.528466+0000", 2024-05-08T18:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.528469+0000", 2024-05-08T18:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.27e-06 2024-05-08T18:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.530693+0000", 2024-05-08T18:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022239299999999998 2024-05-08T18:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.530725+0000", 2024-05-08T18:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1272000000000001e-05 2024-05-08T18:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.530746+0000", 2024-05-08T18:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1047e-05 2024-05-08T18:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.530842+0000", 2024-05-08T18:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6551000000000004e-05 2024-05-08T18:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.531017+0000", 2024-05-08T18:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017477000000000001 2024-05-08T18:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.531190+0000", 2024-05-08T18:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172645 2024-05-08T18:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.544076+0000", 2024-05-08T18:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012886612 2024-05-08T18:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.544362+0000", 2024-05-08T18:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0002853 2024-05-08T18:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.544459+0000", 2024-05-08T18:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7311000000000004e-05 2024-05-08T18:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.544552+0000", 2024-05-08T18:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2843999999999994e-05 2024-05-08T18:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1275 3.33 3:ccdf9558:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:09.054484+0000", 2024-05-08T18:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.9540546650000001, 2024-05-08T18:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023576865999999998, 2024-05-08T18:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1275 2024-05-08T18:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.054484+0000", 2024-05-08T18:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.054484+0000", 2024-05-08T18:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.054488+0000", 2024-05-08T18:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6700000000000002e-06 2024-05-08T18:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.056730+0000", 2024-05-08T18:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022419359999999999 2024-05-08T18:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.056770+0000", 2024-05-08T18:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9632999999999998e-05 2024-05-08T18:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.056797+0000", 2024-05-08T18:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6999999999999999e-05 2024-05-08T18:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.056906+0000", 2024-05-08T18:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108767 2024-05-08T18:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.057107+0000", 2024-05-08T18:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020165299999999999 2024-05-08T18:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.057290+0000", 2024-05-08T18:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018288700000000001 2024-05-08T18:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.064104+0000", 2024-05-08T18:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006814095 2024-05-08T18:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.077966+0000", 2024-05-08T18:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013862129000000001 2024-05-08T18:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.078007+0000", 2024-05-08T18:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1072999999999998e-05 2024-05-08T18:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.078060+0000", 2024-05-08T18:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3022999999999997e-05 2024-05-08T18:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1279 3.8 3:10eb2ec6:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:09.121086+0000", 2024-05-08T18:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.887452363, 2024-05-08T18:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016445715, 2024-05-08T18:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1279 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.121086+0000", 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.121086+0000", 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.121089+0000", 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3830000000000001e-06 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.123884+0000", 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027943669999999999 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.123913+0000", 2024-05-08T18:09:12.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9802e-05 2024-05-08T18:09:12.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.123932+0000", 2024-05-08T18:09:12.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9006000000000001e-05 2024-05-08T18:09:12.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.124017+0000", 2024-05-08T18:09:12.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4485000000000002e-05 2024-05-08T18:09:12.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.124190+0000", 2024-05-08T18:09:12.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017257700000000001 2024-05-08T18:09:12.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:12.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.124357+0000", 2024-05-08T18:09:12.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016776700000000001 2024-05-08T18:09:12.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.137379+0000", 2024-05-08T18:09:12.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013021326 2024-05-08T18:09:12.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.137406+0000", 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7178999999999998e-05 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.137465+0000", 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8768999999999999e-05 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.137532+0000", 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7053999999999999e-05 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.102 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.102 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.102 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1289 3.b 3:d0a0cd68:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:12.102 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:09.240139+0000", 2024-05-08T18:09:12.102 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.768399638, 2024-05-08T18:09:12.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013837123999999999, 2024-05-08T18:09:12.102 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.102 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.102 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.102 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:12.102 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:12.103 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.103 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1289 2024-05-08T18:09:12.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.103 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.240139+0000", 2024-05-08T18:09:12.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.240139+0000", 2024-05-08T18:09:12.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.240142+0000", 2024-05-08T18:09:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2890000000000002e-06 2024-05-08T18:09:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.242018+0000", 2024-05-08T18:09:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001875996 2024-05-08T18:09:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.242040+0000", 2024-05-08T18:09:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1767999999999999e-05 2024-05-08T18:09:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.242051+0000", 2024-05-08T18:09:12.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1e-05 2024-05-08T18:09:12.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.242146+0000", 2024-05-08T18:09:12.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5620999999999998e-05 2024-05-08T18:09:12.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.242354+0000", 2024-05-08T18:09:12.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020752499999999999 2024-05-08T18:09:12.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:12.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.242544+0000", 2024-05-08T18:09:12.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018997900000000001 2024-05-08T18:09:12.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:12.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.251305+0000", 2024-05-08T18:09:12.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087615460000000003 2024-05-08T18:09:12.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.253860+0000", 2024-05-08T18:09:12.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025542659999999999 2024-05-08T18:09:12.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.253922+0000", 2024-05-08T18:09:12.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1931e-05 2024-05-08T18:09:12.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.253976+0000", 2024-05-08T18:09:12.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4203000000000003e-05 2024-05-08T18:09:12.107 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.107 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.107 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.107 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1407 3.7 3:e339c0c4:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:12.107 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.904306+0000", 2024-05-08T18:09:12.107 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.104232743, 2024-05-08T18:09:12.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021916637999999999, 2024-05-08T18:09:12.108 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:12.108 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:12.108 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.108 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:12.108 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:12.108 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.108 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1407 2024-05-08T18:09:12.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.108 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:12.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:12.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.904306+0000", 2024-05-08T18:09:12.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:12.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.904306+0000", 2024-05-08T18:09:12.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:12.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:12.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.904309+0000", 2024-05-08T18:09:12.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9660000000000001e-06 2024-05-08T18:09:12.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:12.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905531+0000", 2024-05-08T18:09:12.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012226750000000001 2024-05-08T18:09:12.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:12.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905553+0000", 2024-05-08T18:09:12.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2272e-05 2024-05-08T18:09:12.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905568+0000", 2024-05-08T18:09:12.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4328000000000001e-05 2024-05-08T18:09:12.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:12.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905654+0000", 2024-05-08T18:09:12.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6296000000000002e-05 2024-05-08T18:09:12.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:12.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905798+0000", 2024-05-08T18:09:12.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014352000000000001 2024-05-08T18:09:12.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:12.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905949+0000", 2024-05-08T18:09:12.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015134799999999999 2024-05-08T18:09:12.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:12.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.916810+0000", 2024-05-08T18:09:12.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010861243 2024-05-08T18:09:12.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.926149+0000", 2024-05-08T18:09:12.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0093391259999999997 2024-05-08T18:09:12.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:12.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.926190+0000", 2024-05-08T18:09:12.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0519000000000003e-05 2024-05-08T18:09:12.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:12.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:12.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:12.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.926222+0000", 2024-05-08T18:09:12.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2345000000000003e-05 2024-05-08T18:09:12.113 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.113 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.113 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.113 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:12.113 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:12.113 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:12.115 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:09:12.115 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_06: 100Mb.8 2024-05-08T18:09:12.115 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:12.115 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 9 2024-05-08T18:09:12.115 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:12.116+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:12.128 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records in 2024-05-08T18:09:12.128 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records out 2024-05-08T18:09:12.128 INFO:tasks.workunit.client.0.smithi080.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0662591 s, 1.6 GB/s 2024-05-08T18:09:12.216 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:12.217+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:12.245 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:12.245 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:12.245 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:12.245 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:12.259 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:09:12.316 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:12.316+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:12.417 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:12.416+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:12.437 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:12.437 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:12.437 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:12.437 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:12.437 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:12.455 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:09:12.518 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:12.520+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:12.586 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:12.587 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:12.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:12.587 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:12.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.587 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:09:12.587 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:09:12.587 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 111.056434749, 2024-05-08T18:09:12.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018560765, 2024-05-08T18:09:12.587 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.587 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.587 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:09:12.587 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:12.587 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:12.587 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.588 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 43 2024-05-08T18:09:12.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.588 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:09:12.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:09:12.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530217+0000", 2024-05-08T18:09:12.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:09:12.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530253+0000", 2024-05-08T18:09:12.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5621999999999999e-05 2024-05-08T18:09:12.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530288+0000", 2024-05-08T18:09:12.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5846999999999997e-05 2024-05-08T18:09:12.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530314+0000", 2024-05-08T18:09:12.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5732e-05 2024-05-08T18:09:12.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530952+0000", 2024-05-08T18:09:12.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00063739999999999999 2024-05-08T18:09:12.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:12.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530977+0000", 2024-05-08T18:09:12.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5375e-05 2024-05-08T18:09:12.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548506+0000", 2024-05-08T18:09:12.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017528781 2024-05-08T18:09:12.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548774+0000", 2024-05-08T18:09:12.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026821199999999999 2024-05-08T18:09:12.591 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.591 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.591 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.591 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1190 3.31 e85/20 3:8c795880:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_2:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:12.591 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.973668+0000", 2024-05-08T18:09:12.592 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.6129798500000003, 2024-05-08T18:09:12.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021568941000000001, 2024-05-08T18:09:12.592 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.592 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.592 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.592 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.973668+0000", 2024-05-08T18:09:12.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.973668+0000", 2024-05-08T18:09:12.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.973671+0000", 2024-05-08T18:09:12.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2100000000000002e-06 2024-05-08T18:09:12.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.980815+0000", 2024-05-08T18:09:12.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071441860000000003 2024-05-08T18:09:12.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.980858+0000", 2024-05-08T18:09:12.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2852000000000002e-05 2024-05-08T18:09:12.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.980879+0000", 2024-05-08T18:09:12.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.107e-05 2024-05-08T18:09:12.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981093+0000", 2024-05-08T18:09:12.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000213857 2024-05-08T18:09:12.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981135+0000", 2024-05-08T18:09:12.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2249999999999997e-05 2024-05-08T18:09:12.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.995097+0000", 2024-05-08T18:09:12.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013961295 2024-05-08T18:09:12.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.995237+0000", 2024-05-08T18:09:12.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140221 2024-05-08T18:09:12.595 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.595 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.595 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.596 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1191 3.1d e85/20 3:b81eb771:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_3:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:12.596 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.989442+0000", 2024-05-08T18:09:12.596 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.5972054330000001, 2024-05-08T18:09:12.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020798275000000001, 2024-05-08T18:09:12.596 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.596 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.596 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.596 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989442+0000", 2024-05-08T18:09:12.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989442+0000", 2024-05-08T18:09:12.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989443+0000", 2024-05-08T18:09:12.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-05-08T18:09:12.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994630+0000", 2024-05-08T18:09:12.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051867930000000003 2024-05-08T18:09:12.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994663+0000", 2024-05-08T18:09:12.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3272000000000003e-05 2024-05-08T18:09:12.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994680+0000", 2024-05-08T18:09:12.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7266999999999999e-05 2024-05-08T18:09:12.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994795+0000", 2024-05-08T18:09:12.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011437799999999999 2024-05-08T18:09:12.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994836+0000", 2024-05-08T18:09:12.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0686000000000003e-05 2024-05-08T18:09:12.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010110+0000", 2024-05-08T18:09:12.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015274081 2024-05-08T18:09:12.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010241+0000", 2024-05-08T18:09:12.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013107099999999999 2024-05-08T18:09:12.600 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.600 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.600 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.600 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1196 3.9 3:91f0c251:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.600 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.036686+0000", 2024-05-08T18:09:12.600 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.5499616280000001, 2024-05-08T18:09:12.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019572662000000001, 2024-05-08T18:09:12.600 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.600 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.600 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.600 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:12.600 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:12.600 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.600 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1196 2024-05-08T18:09:12.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.601 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.036686+0000", 2024-05-08T18:09:12.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.036686+0000", 2024-05-08T18:09:12.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.036691+0000", 2024-05-08T18:09:12.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8099999999999997e-06 2024-05-08T18:09:12.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041369+0000", 2024-05-08T18:09:12.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046777590000000001 2024-05-08T18:09:12.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041413+0000", 2024-05-08T18:09:12.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4297e-05 2024-05-08T18:09:12.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041443+0000", 2024-05-08T18:09:12.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9635999999999999e-05 2024-05-08T18:09:12.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041588+0000", 2024-05-08T18:09:12.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014564100000000001 2024-05-08T18:09:12.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041833+0000", 2024-05-08T18:09:12.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000244777 2024-05-08T18:09:12.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.042054+0000", 2024-05-08T18:09:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022125399999999999 2024-05-08T18:09:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.051316+0000", 2024-05-08T18:09:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092614059999999998 2024-05-08T18:09:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056067+0000", 2024-05-08T18:09:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047512639999999998 2024-05-08T18:09:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056171+0000", 2024-05-08T18:09:12.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010425900000000001 2024-05-08T18:09:12.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056259+0000", 2024-05-08T18:09:12.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7559000000000007e-05 2024-05-08T18:09:12.605 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.605 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.605 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.605 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1199 3.14 3:29bdf593:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.605 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.067940+0000", 2024-05-08T18:09:12.605 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.5187081029999998, 2024-05-08T18:09:12.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018983427000000001, 2024-05-08T18:09:12.606 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.606 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.606 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.606 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:12.606 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:12.606 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.606 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1199 2024-05-08T18:09:12.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.606 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.067940+0000", 2024-05-08T18:09:12.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.067940+0000", 2024-05-08T18:09:12.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.067943+0000", 2024-05-08T18:09:12.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6370000000000001e-06 2024-05-08T18:09:12.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.071968+0000", 2024-05-08T18:09:12.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040243120000000004 2024-05-08T18:09:12.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072006+0000", 2024-05-08T18:09:12.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8628999999999999e-05 2024-05-08T18:09:12.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072029+0000", 2024-05-08T18:09:12.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2972999999999998e-05 2024-05-08T18:09:12.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072160+0000", 2024-05-08T18:09:12.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013025100000000001 2024-05-08T18:09:12.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072398+0000", 2024-05-08T18:09:12.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023832399999999999 2024-05-08T18:09:12.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:12.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072617+0000", 2024-05-08T18:09:12.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021892999999999999 2024-05-08T18:09:12.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:12.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.081906+0000", 2024-05-08T18:09:12.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092895919999999993 2024-05-08T18:09:12.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.086685+0000", 2024-05-08T18:09:12.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047783019999999999 2024-05-08T18:09:12.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.086794+0000", 2024-05-08T18:09:12.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010940100000000001 2024-05-08T18:09:12.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.086923+0000", 2024-05-08T18:09:12.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000129076 2024-05-08T18:09:12.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.610 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.611 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1202 3.14 3:2a8c8569:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.611 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.100310+0000", 2024-05-08T18:09:12.611 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.4863380169999996, 2024-05-08T18:09:12.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030670528999999998, 2024-05-08T18:09:12.611 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.611 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.611 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.611 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:12.611 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:12.611 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.611 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1202 2024-05-08T18:09:12.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.611 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.100310+0000", 2024-05-08T18:09:12.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.100310+0000", 2024-05-08T18:09:12.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.100352+0000", 2024-05-08T18:09:12.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2315999999999999e-05 2024-05-08T18:09:12.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.105824+0000", 2024-05-08T18:09:12.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054720649999999999 2024-05-08T18:09:12.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.105863+0000", 2024-05-08T18:09:12.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8649000000000002e-05 2024-05-08T18:09:12.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.105883+0000", 2024-05-08T18:09:12.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0383000000000001e-05 2024-05-08T18:09:12.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106019+0000", 2024-05-08T18:09:12.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013552200000000001 2024-05-08T18:09:12.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106318+0000", 2024-05-08T18:09:12.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029913900000000002 2024-05-08T18:09:12.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:12.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106586+0000", 2024-05-08T18:09:12.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026771299999999999 2024-05-08T18:09:12.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:12.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.128110+0000", 2024-05-08T18:09:12.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021524155 2024-05-08T18:09:12.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130655+0000", 2024-05-08T18:09:12.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025453960000000001 2024-05-08T18:09:12.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130831+0000", 2024-05-08T18:09:12.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017583400000000001 2024-05-08T18:09:12.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130980+0000", 2024-05-08T18:09:12.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149357 2024-05-08T18:09:12.616 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.616 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.616 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.616 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1203 3.1a 3:592e440d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.616 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.110063+0000", 2024-05-08T18:09:12.616 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.4765844069999998, 2024-05-08T18:09:12.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023166567999999998, 2024-05-08T18:09:12.616 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.616 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.616 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.616 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:12.617 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:12.617 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.617 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1203 2024-05-08T18:09:12.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.617 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110063+0000", 2024-05-08T18:09:12.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110063+0000", 2024-05-08T18:09:12.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110067+0000", 2024-05-08T18:09:12.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3629999999999998e-06 2024-05-08T18:09:12.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114611+0000", 2024-05-08T18:09:12.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00454375 2024-05-08T18:09:12.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114653+0000", 2024-05-08T18:09:12.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2549999999999997e-05 2024-05-08T18:09:12.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114681+0000", 2024-05-08T18:09:12.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7878999999999999e-05 2024-05-08T18:09:12.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114872+0000", 2024-05-08T18:09:12.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019109500000000001 2024-05-08T18:09:12.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.115275+0000", 2024-05-08T18:09:12.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040327700000000001 2024-05-08T18:09:12.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:12.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.115636+0000", 2024-05-08T18:09:12.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036014899999999998 2024-05-08T18:09:12.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:12.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.129938+0000", 2024-05-08T18:09:12.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014302848 2024-05-08T18:09:12.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.133055+0000", 2024-05-08T18:09:12.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00311699 2024-05-08T18:09:12.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.133159+0000", 2024-05-08T18:09:12.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103138 2024-05-08T18:09:12.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.133230+0000", 2024-05-08T18:09:12.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1528999999999999e-05 2024-05-08T18:09:12.621 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.621 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.621 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.621 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1211 3.3 3:c13935f4:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.621 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.195183+0000", 2024-05-08T18:09:12.622 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.3914644090000001, 2024-05-08T18:09:12.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.026007971000000001, 2024-05-08T18:09:12.622 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.622 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.622 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.622 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:12.622 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:12.622 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.622 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1211 2024-05-08T18:09:12.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.622 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.195183+0000", 2024-05-08T18:09:12.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.195183+0000", 2024-05-08T18:09:12.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.195187+0000", 2024-05-08T18:09:12.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6540000000000001e-06 2024-05-08T18:09:12.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199150+0000", 2024-05-08T18:09:12.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039627719999999998 2024-05-08T18:09:12.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199188+0000", 2024-05-08T18:09:12.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195999999999998e-05 2024-05-08T18:09:12.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199210+0000", 2024-05-08T18:09:12.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2027000000000001e-05 2024-05-08T18:09:12.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199356+0000", 2024-05-08T18:09:12.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014612800000000001 2024-05-08T18:09:12.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199622+0000", 2024-05-08T18:09:12.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026600199999999999 2024-05-08T18:09:12.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:12.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199846+0000", 2024-05-08T18:09:12.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022389099999999999 2024-05-08T18:09:12.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.213755+0000", 2024-05-08T18:09:12.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013908536000000001 2024-05-08T18:09:12.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:12.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.221024+0000", 2024-05-08T18:09:12.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0072690439999999997 2024-05-08T18:09:12.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.221110+0000", 2024-05-08T18:09:12.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6008999999999996e-05 2024-05-08T18:09:12.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.221191+0000", 2024-05-08T18:09:12.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1712000000000006e-05 2024-05-08T18:09:12.627 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.627 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.627 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.627 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1214 3.9 3:92ca5236:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.1:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.627 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.223783+0000", 2024-05-08T18:09:12.627 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.362864944, 2024-05-08T18:09:12.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018427163999999999, 2024-05-08T18:09:12.628 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.628 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.628 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.628 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:12.628 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:12.628 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.628 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1214 2024-05-08T18:09:12.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.628 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.223783+0000", 2024-05-08T18:09:12.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.223783+0000", 2024-05-08T18:09:12.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.223786+0000", 2024-05-08T18:09:12.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8030000000000001e-06 2024-05-08T18:09:12.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.227730+0000", 2024-05-08T18:09:12.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039442430000000001 2024-05-08T18:09:12.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.227766+0000", 2024-05-08T18:09:12.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5571999999999998e-05 2024-05-08T18:09:12.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.227785+0000", 2024-05-08T18:09:12.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9170000000000001e-05 2024-05-08T18:09:12.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.227954+0000", 2024-05-08T18:09:12.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016892200000000001 2024-05-08T18:09:12.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.228373+0000", 2024-05-08T18:09:12.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000419417 2024-05-08T18:09:12.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:12.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.229595+0000", 2024-05-08T18:09:12.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012215730000000001 2024-05-08T18:09:12.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.239966+0000", 2024-05-08T18:09:12.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010371225 2024-05-08T18:09:12.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:12.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.241761+0000", 2024-05-08T18:09:12.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001795458 2024-05-08T18:09:12.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.242067+0000", 2024-05-08T18:09:12.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030554600000000002 2024-05-08T18:09:12.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.242210+0000", 2024-05-08T18:09:12.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014323499999999999 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1224 3.13 e85/20 3:c82cef46:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_8:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.644014+0000", 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.9426340020000001, 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019705998999999998, 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.644014+0000", 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.644014+0000", 2024-05-08T18:09:12.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.644018+0000", 2024-05-08T18:09:12.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6500000000000002e-06 2024-05-08T18:09:12.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651361+0000", 2024-05-08T18:09:12.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073436789999999997 2024-05-08T18:09:12.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651411+0000", 2024-05-08T18:09:12.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9613000000000001e-05 2024-05-08T18:09:12.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651438+0000", 2024-05-08T18:09:12.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6699e-05 2024-05-08T18:09:12.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651567+0000", 2024-05-08T18:09:12.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012993299999999999 2024-05-08T18:09:12.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651601+0000", 2024-05-08T18:09:12.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3268000000000001e-05 2024-05-08T18:09:12.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663646+0000", 2024-05-08T18:09:12.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012045451 2024-05-08T18:09:12.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663720+0000", 2024-05-08T18:09:12.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3706000000000002e-05 2024-05-08T18:09:12.636 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.636 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.636 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.637 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1226 3.3 3:c18beed9:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.637 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.668709+0000", 2024-05-08T18:09:12.637 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.9179385470000003, 2024-05-08T18:09:12.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020071530000000001, 2024-05-08T18:09:12.637 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.637 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.637 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.637 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:12.637 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:12.637 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.637 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1226 2024-05-08T18:09:12.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.637 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.668709+0000", 2024-05-08T18:09:12.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.668709+0000", 2024-05-08T18:09:12.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.668717+0000", 2024-05-08T18:09:12.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7100000000000007e-06 2024-05-08T18:09:12.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672764+0000", 2024-05-08T18:09:12.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040465630000000004 2024-05-08T18:09:12.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672791+0000", 2024-05-08T18:09:12.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7636000000000001e-05 2024-05-08T18:09:12.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672804+0000", 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3009e-05 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672905+0000", 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010105100000000001 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.673113+0000", 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000207405 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.673300+0000", 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000186875 2024-05-08T18:09:12.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:12.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.682552+0000", 2024-05-08T18:09:12.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092519690000000005 2024-05-08T18:09:12.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.688655+0000", 2024-05-08T18:09:12.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061032300000000003 2024-05-08T18:09:12.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.688723+0000", 2024-05-08T18:09:12.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8263999999999996e-05 2024-05-08T18:09:12.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.688781+0000", 2024-05-08T18:09:12.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7818000000000001e-05 2024-05-08T18:09:12.642 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.642 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.642 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.642 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1274 3.9 3:9079d23e:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:12.642 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.038506+0000", 2024-05-08T18:09:12.642 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 3.5481422089999999, 2024-05-08T18:09:12.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018129218999999999, 2024-05-08T18:09:12.643 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.643 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.643 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.643 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:12.643 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:12.643 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.643 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1274 2024-05-08T18:09:12.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.643 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.038506+0000", 2024-05-08T18:09:12.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.038506+0000", 2024-05-08T18:09:12.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.038517+0000", 2024-05-08T18:09:12.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1457000000000001e-05 2024-05-08T18:09:12.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.042699+0000", 2024-05-08T18:09:12.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041823440000000002 2024-05-08T18:09:12.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.042728+0000", 2024-05-08T18:09:12.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.902e-05 2024-05-08T18:09:12.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.042741+0000", 2024-05-08T18:09:12.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2235000000000001e-05 2024-05-08T18:09:12.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.042840+0000", 2024-05-08T18:09:12.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8795999999999994e-05 2024-05-08T18:09:12.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.042996+0000", 2024-05-08T18:09:12.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015656599999999999 2024-05-08T18:09:12.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:12.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.043136+0000", 2024-05-08T18:09:12.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140178 2024-05-08T18:09:12.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:12.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.051217+0000", 2024-05-08T18:09:12.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0080810959999999994 2024-05-08T18:09:12.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.056481+0000", 2024-05-08T18:09:12.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005263986 2024-05-08T18:09:12.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.056562+0000", 2024-05-08T18:09:12.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1142000000000003e-05 2024-05-08T18:09:12.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.056635+0000", 2024-05-08T18:09:12.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2398999999999996e-05 2024-05-08T18:09:12.647 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.647 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.647 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.648 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1397 3.34 3:2c6418f0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:12.648 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.790046+0000", 2024-05-08T18:09:12.648 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.79660157600000003, 2024-05-08T18:09:12.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035561055000000001, 2024-05-08T18:09:12.648 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.648 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.648 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.648 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:12.648 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:12.648 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.648 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1397 2024-05-08T18:09:12.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.648 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.790046+0000", 2024-05-08T18:09:12.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.790046+0000", 2024-05-08T18:09:12.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.790051+0000", 2024-05-08T18:09:12.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.51e-06 2024-05-08T18:09:12.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795411+0000", 2024-05-08T18:09:12.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0053598880000000002 2024-05-08T18:09:12.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795450+0000", 2024-05-08T18:09:12.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9555999999999999e-05 2024-05-08T18:09:12.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795470+0000", 2024-05-08T18:09:12.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9644e-05 2024-05-08T18:09:12.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795648+0000", 2024-05-08T18:09:12.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017859000000000001 2024-05-08T18:09:12.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:12.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795661+0000", 2024-05-08T18:09:12.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2116999999999999e-05 2024-05-08T18:09:12.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.801909+0000", 2024-05-08T18:09:12.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0062485969999999998 2024-05-08T18:09:12.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802123+0000", 2024-05-08T18:09:12.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021390100000000001 2024-05-08T18:09:12.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:12.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802378+0000", 2024-05-08T18:09:12.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025494999999999999 2024-05-08T18:09:12.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:12.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822891+0000", 2024-05-08T18:09:12.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020513432000000002 2024-05-08T18:09:12.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825434+0000", 2024-05-08T18:09:12.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025423279999999999 2024-05-08T18:09:12.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825533+0000", 2024-05-08T18:09:12.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9302999999999994e-05 2024-05-08T18:09:12.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825607+0000", 2024-05-08T18:09:12.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4239000000000005e-05 2024-05-08T18:09:12.653 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.654 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.654 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.654 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1399 3.2c e87/20 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head v 87'3, mlcod=85'1)", 2024-05-08T18:09:12.654 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.825958+0000", 2024-05-08T18:09:12.654 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.76069028299999997, 2024-05-08T18:09:12.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023463491, 2024-05-08T18:09:12.654 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.654 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.654 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.654 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825958+0000", 2024-05-08T18:09:12.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825958+0000", 2024-05-08T18:09:12.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825959+0000", 2024-05-08T18:09:12.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.68e-06 2024-05-08T18:09:12.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829465+0000", 2024-05-08T18:09:12.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003505949 2024-05-08T18:09:12.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829510+0000", 2024-05-08T18:09:12.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4446000000000001e-05 2024-05-08T18:09:12.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829529+0000", 2024-05-08T18:09:12.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9242999999999999e-05 2024-05-08T18:09:12.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829699+0000", 2024-05-08T18:09:12.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017010500000000001 2024-05-08T18:09:12.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829767+0000", 2024-05-08T18:09:12.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8422000000000003e-05 2024-05-08T18:09:12.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849237+0000", 2024-05-08T18:09:12.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019469113999999999 2024-05-08T18:09:12.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849421+0000", 2024-05-08T18:09:12.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000184532 2024-05-08T18:09:12.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.658 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.658 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1400 3.1c e87/20 3:3bb95565:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_6:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:12.658 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.837343+0000", 2024-05-08T18:09:12.658 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.74930491399999999, 2024-05-08T18:09:12.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017380382999999999, 2024-05-08T18:09:12.658 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.658 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.658 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.658 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.837343+0000", 2024-05-08T18:09:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.837343+0000", 2024-05-08T18:09:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.837344+0000", 2024-05-08T18:09:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7000000000000003e-07 2024-05-08T18:09:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.842240+0000", 2024-05-08T18:09:12.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048958639999999998 2024-05-08T18:09:12.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.842271+0000", 2024-05-08T18:09:12.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1266999999999997e-05 2024-05-08T18:09:12.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.842290+0000", 2024-05-08T18:09:12.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9079000000000001e-05 2024-05-08T18:09:12.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.842485+0000", 2024-05-08T18:09:12.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019482399999999999 2024-05-08T18:09:12.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.842528+0000", 2024-05-08T18:09:12.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2960000000000002e-05 2024-05-08T18:09:12.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.854640+0000", 2024-05-08T18:09:12.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012112120000000001 2024-05-08T18:09:12.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.854723+0000", 2024-05-08T18:09:12.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399000000000006e-05 2024-05-08T18:09:12.662 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.662 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.662 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.662 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1413 3.9 3:915363b3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:12.662 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.966164+0000", 2024-05-08T18:09:12.662 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.62048386300000002, 2024-05-08T18:09:12.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024879884000000001, 2024-05-08T18:09:12.662 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.662 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.662 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.663 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:12.663 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:12.663 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.663 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1413 2024-05-08T18:09:12.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.663 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.966164+0000", 2024-05-08T18:09:12.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.966164+0000", 2024-05-08T18:09:12.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.966168+0000", 2024-05-08T18:09:12.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0570000000000003e-06 2024-05-08T18:09:12.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.974319+0000", 2024-05-08T18:09:12.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0081509930000000005 2024-05-08T18:09:12.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.974388+0000", 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9326000000000007e-05 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.974418+0000", 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9519e-05 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.974598+0000", 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017978199999999999 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.975002+0000", 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000404268 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.975430+0000", 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042801100000000001 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.988165+0000", 2024-05-08T18:09:12.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012734568 2024-05-08T18:09:12.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.990873+0000", 2024-05-08T18:09:12.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027083559999999999 2024-05-08T18:09:12.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.990975+0000", 2024-05-08T18:09:12.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101751 2024-05-08T18:09:12.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.991044+0000", 2024-05-08T18:09:12.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9252999999999996e-05 2024-05-08T18:09:12.668 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.668 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.668 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.668 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1416 3.2c e87/20 3:345ebd70:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_22:head v 87'4, mlcod=85'2)", 2024-05-08T18:09:12.668 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.001257+0000", 2024-05-08T18:09:12.668 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.58539085199999996, 2024-05-08T18:09:12.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022070702000000001, 2024-05-08T18:09:12.668 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.001257+0000", 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.001257+0000", 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.001259+0000", 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1859999999999999e-06 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004209+0000", 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029502690000000002 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004244+0000", 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999998e-05 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004261+0000", 2024-05-08T18:09:12.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6969999999999998e-05 2024-05-08T18:09:12.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004412+0000", 2024-05-08T18:09:12.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015088800000000001 2024-05-08T18:09:12.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004454+0000", 2024-05-08T18:09:12.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2076000000000002e-05 2024-05-08T18:09:12.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023211+0000", 2024-05-08T18:09:12.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018757424000000002 2024-05-08T18:09:12.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023328+0000", 2024-05-08T18:09:12.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116519 2024-05-08T18:09:12.672 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.672 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.672 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.672 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1420 3.e e87/20 3:72accb8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.8:head v 87'1, mlcod=0'0)", 2024-05-08T18:09:12.672 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.041386+0000", 2024-05-08T18:09:12.672 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.54526214299999998, 2024-05-08T18:09:12.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019066611000000001, 2024-05-08T18:09:12.673 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.673 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.673 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.673 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.041386+0000", 2024-05-08T18:09:12.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.041386+0000", 2024-05-08T18:09:12.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.041387+0000", 2024-05-08T18:09:12.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8700000000000005e-07 2024-05-08T18:09:12.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.045795+0000", 2024-05-08T18:09:12.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044083300000000002 2024-05-08T18:09:12.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.045834+0000", 2024-05-08T18:09:12.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8763000000000001e-05 2024-05-08T18:09:12.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.045853+0000", 2024-05-08T18:09:12.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9453000000000002e-05 2024-05-08T18:09:12.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.046025+0000", 2024-05-08T18:09:12.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017146800000000001 2024-05-08T18:09:12.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.046085+0000", 2024-05-08T18:09:12.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0556000000000001e-05 2024-05-08T18:09:12.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.676 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060332+0000", 2024-05-08T18:09:12.676 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014246801999999999 2024-05-08T18:09:12.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.676 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.676 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060452+0000", 2024-05-08T18:09:12.676 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120452 2024-05-08T18:09:12.676 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.676 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.676 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.676 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1426 3.3 3:c1fceb03:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:12.676 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.418434+0000", 2024-05-08T18:09:12.676 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.16821372100000001, 2024-05-08T18:09:12.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.026406447, 2024-05-08T18:09:12.677 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.677 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.677 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.677 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:12.677 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:12.677 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.677 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1426 2024-05-08T18:09:12.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.677 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.418434+0000", 2024-05-08T18:09:12.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.418434+0000", 2024-05-08T18:09:12.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.418437+0000", 2024-05-08T18:09:12.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.751e-06 2024-05-08T18:09:12.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.422567+0000", 2024-05-08T18:09:12.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041297199999999999 2024-05-08T18:09:12.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.422602+0000", 2024-05-08T18:09:12.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4898999999999999e-05 2024-05-08T18:09:12.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.422623+0000", 2024-05-08T18:09:12.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1203e-05 2024-05-08T18:09:12.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.422783+0000", 2024-05-08T18:09:12.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016033200000000001 2024-05-08T18:09:12.680 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.680 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.680 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.423045+0000", 2024-05-08T18:09:12.680 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026236199999999998 2024-05-08T18:09:12.680 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.680 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:12.680 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.423283+0000", 2024-05-08T18:09:12.680 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023804100000000001 2024-05-08T18:09:12.680 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.680 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:12.680 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.432169+0000", 2024-05-08T18:09:12.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0088858730000000007 2024-05-08T18:09:12.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.444662+0000", 2024-05-08T18:09:12.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012492411 2024-05-08T18:09:12.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.444765+0000", 2024-05-08T18:09:12.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103183 2024-05-08T18:09:12.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.444841+0000", 2024-05-08T18:09:12.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5672000000000003e-05 2024-05-08T18:09:12.682 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.682 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.682 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.682 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1431 3.3 3:c36c40c5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:12.682 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.506262+0000", 2024-05-08T18:09:12.682 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.080386206000000002, 2024-05-08T18:09:12.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022453905, 2024-05-08T18:09:12.682 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:12.682 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:12.682 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:12.682 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:12.682 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:12.683 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:12.683 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1431 2024-05-08T18:09:12.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.683 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:12.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:12.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.506262+0000", 2024-05-08T18:09:12.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:12.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.506262+0000", 2024-05-08T18:09:12.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:12.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:12.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.506263+0000", 2024-05-08T18:09:12.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.748e-06 2024-05-08T18:09:12.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:12.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.509983+0000", 2024-05-08T18:09:12.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037198740000000002 2024-05-08T18:09:12.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:12.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510006+0000", 2024-05-08T18:09:12.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2269999999999999e-05 2024-05-08T18:09:12.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510015+0000", 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6579999999999997e-06 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510105+0000", 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9435e-05 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510321+0000", 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021608700000000001 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510566+0000", 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024504600000000001 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.518436+0000", 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078703409999999994 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:12.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.528584+0000", 2024-05-08T18:09:12.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01014817 2024-05-08T18:09:12.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:12.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.528659+0000", 2024-05-08T18:09:12.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4328999999999999e-05 2024-05-08T18:09:12.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:12.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:12.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:12.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.528716+0000", 2024-05-08T18:09:12.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6947000000000002e-05 2024-05-08T18:09:12.687 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.687 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.688 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.688 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:12.688 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:12.688 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:12.689 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:09:12.690 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:12.688+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:12.791 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:12.789+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:12.829 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:12.829 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:12.829 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:12.829 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:12.843 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:09:12.891 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:12.892+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:12.925 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_06: 100Mb.9 2024-05-08T18:09:12.925 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:12.925 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 10 2024-05-08T18:09:12.993 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:12.992+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:13.008 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records in 2024-05-08T18:09:13.008 INFO:tasks.workunit.client.0.smithi080.stderr:10+0 records out 2024-05-08T18:09:13.009 INFO:tasks.workunit.client.0.smithi080.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0807545 s, 1.3 GB/s 2024-05-08T18:09:13.009 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:13.009 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:13.009 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:13.009 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:13.009 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:13.023 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:09:13.093 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:13.093+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:13.146 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:13.146 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:13.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:13.146 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:13.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.146 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1191 3.1d 3:b81eb771:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.146 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:13.146 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.1653840889999998, 2024-05-08T18:09:13.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.029646883999999998, 2024-05-08T18:09:13.147 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.147 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.147 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.147 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.147 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.147 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.147 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1191 2024-05-08T18:09:13.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.147 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:13.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:13.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981334+0000", 2024-05-08T18:09:13.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1540000000000004e-06 2024-05-08T18:09:13.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988180+0000", 2024-05-08T18:09:13.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068463619999999999 2024-05-08T18:09:13.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988216+0000", 2024-05-08T18:09:13.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6293e-05 2024-05-08T18:09:13.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988236+0000", 2024-05-08T18:09:13.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9403e-05 2024-05-08T18:09:13.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988410+0000", 2024-05-08T18:09:13.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017415400000000001 2024-05-08T18:09:13.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988803+0000", 2024-05-08T18:09:13.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000393271 2024-05-08T18:09:13.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:13.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989175+0000", 2024-05-08T18:09:13.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037178899999999997 2024-05-08T18:09:13.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.006397+0000", 2024-05-08T18:09:13.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017221744000000001 2024-05-08T18:09:13.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010666+0000", 2024-05-08T18:09:13.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042692880000000004 2024-05-08T18:09:13.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010836+0000", 2024-05-08T18:09:13.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000169498 2024-05-08T18:09:13.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010976+0000", 2024-05-08T18:09:13.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014092799999999999 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1193 3.c 3:315b87e8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.004223+0000", 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.1424901959999998, 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019590908000000001, 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1193 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.004223+0000", 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.004223+0000", 2024-05-08T18:09:13.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.004227+0000", 2024-05-08T18:09:13.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5130000000000001e-06 2024-05-08T18:09:13.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008665+0000", 2024-05-08T18:09:13.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044376629999999997 2024-05-08T18:09:13.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008697+0000", 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2783000000000001e-05 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008715+0000", 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7713000000000001e-05 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008840+0000", 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000124578 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.009091+0000", 2024-05-08T18:09:13.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000251146 2024-05-08T18:09:13.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:13.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.009323+0000", 2024-05-08T18:09:13.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000232127 2024-05-08T18:09:13.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023324+0000", 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014000574999999999 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023459+0000", 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013494099999999999 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023644+0000", 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018532100000000001 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023814+0000", 2024-05-08T18:09:13.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017054799999999999 2024-05-08T18:09:13.158 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.158 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.158 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.158 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1194 3.16 3:6b2325a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.158 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:13.158 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.1312381709999997, 2024-05-08T18:09:13.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030556241000000001, 2024-05-08T18:09:13.158 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.158 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.158 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1194 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:13.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015492+0000", 2024-05-08T18:09:13.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6863000000000001e-05 2024-05-08T18:09:13.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019937+0000", 2024-05-08T18:09:13.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044450399999999999 2024-05-08T18:09:13.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019975+0000", 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7676000000000003e-05 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019995+0000", 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.969e-05 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020165+0000", 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017003400000000001 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020437+0000", 2024-05-08T18:09:13.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027198599999999999 2024-05-08T18:09:13.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:13.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020668+0000", 2024-05-08T18:09:13.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023154 2024-05-08T18:09:13.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.032879+0000", 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012210883000000001 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045595+0000", 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012716005000000001 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045811+0000", 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021556400000000001 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.046032+0000", 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022096 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1195 3.28 3:155acd84:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.1210908499999999, 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020411840000000001, 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.165 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.165 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.165 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.165 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.165 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1195 2024-05-08T18:09:13.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.165 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025626+0000", 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4699999999999998e-06 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030167+0000", 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045406709999999996 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030204+0000", 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6736000000000002e-05 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030222+0000", 2024-05-08T18:09:13.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.823e-05 2024-05-08T18:09:13.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030337+0000", 2024-05-08T18:09:13.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114695 2024-05-08T18:09:13.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030565+0000", 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000228173 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030770+0000", 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020505400000000001 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044362+0000", 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013591814000000001 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045754+0000", 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013923710000000001 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045903+0000", 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014878800000000001 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.046035+0000", 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013183800000000001 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1209 3.35 e85/20 3:af4c6abe:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_21:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.9662625609999997, 2024-05-08T18:09:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021767585999999998, 2024-05-08T18:09:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180452+0000", 2024-05-08T18:09:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4000000000000002e-07 2024-05-08T18:09:13.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183165+0000", 2024-05-08T18:09:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027135269999999999 2024-05-08T18:09:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183208+0000", 2024-05-08T18:09:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2599000000000003e-05 2024-05-08T18:09:13.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183239+0000", 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999997e-05 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183369+0000", 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000130338 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183407+0000", 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8213000000000002e-05 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202127+0000", 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018719906000000001 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202219+0000", 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1533000000000006e-05 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1218 3.c 3:33b8068a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.5844346680000001, 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024735007, 2024-05-08T18:09:13.178 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.178 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.178 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.178 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.178 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.178 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.178 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1218 2024-05-08T18:09:13.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.178 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:13.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:13.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562282+0000", 2024-05-08T18:09:13.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7769999999999998e-06 2024-05-08T18:09:13.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568816+0000", 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065338169999999999 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568851+0000", 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5892999999999997e-05 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568871+0000", 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9306000000000001e-05 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568992+0000", 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120925 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.569258+0000", 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026655299999999999 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.569522+0000", 2024-05-08T18:09:13.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026331999999999999 2024-05-08T18:09:13.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584269+0000", 2024-05-08T18:09:13.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014747454 2024-05-08T18:09:13.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.586687+0000", 2024-05-08T18:09:13.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024181770000000001 2024-05-08T18:09:13.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.586888+0000", 2024-05-08T18:09:13.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000201137 2024-05-08T18:09:13.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.587014+0000", 2024-05-08T18:09:13.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012564799999999999 2024-05-08T18:09:13.183 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.183 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.183 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1219 3.2 e85/20 3:4068b298:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_3:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.576946+0000", 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.5697674529999999, 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017678080999999998, 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.576946+0000", 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.576946+0000", 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.576948+0000", 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9240000000000001e-06 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.582069+0000", 2024-05-08T18:09:13.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005120566 2024-05-08T18:09:13.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.582104+0000", 2024-05-08T18:09:13.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5496e-05 2024-05-08T18:09:13.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.582122+0000", 2024-05-08T18:09:13.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7626e-05 2024-05-08T18:09:13.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.582225+0000", 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000102853 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.582263+0000", 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8714999999999998e-05 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594521+0000", 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012257099 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594624+0000", 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010380200000000001 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1220 3.c 3:319326d6:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.5617470930000001, 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022305417000000001, 2024-05-08T18:09:13.189 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.189 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.189 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.189 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.189 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.189 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.189 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1220 2024-05-08T18:09:13.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.189 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:13.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:13.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584971+0000", 2024-05-08T18:09:13.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0729999999999998e-06 2024-05-08T18:09:13.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591515+0000", 2024-05-08T18:09:13.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065448340000000002 2024-05-08T18:09:13.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591549+0000", 2024-05-08T18:09:13.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3633000000000001e-05 2024-05-08T18:09:13.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591574+0000", 2024-05-08T18:09:13.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4482999999999999e-05 2024-05-08T18:09:13.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591714+0000", 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014048500000000001 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591956+0000", 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000241616 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.592181+0000", 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022565000000000001 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.606237+0000", 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014055646999999999 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607095+0000", 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085838199999999998 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607189+0000", 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3962000000000006e-05 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607272+0000", 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2651999999999994e-05 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1222 3.38 e85/20 3:1f451ee1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_6:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.607187+0000", 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.5395266110000003, 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018422048, 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607187+0000", 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607187+0000", 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607188+0000", 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2860000000000001e-06 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.611823+0000", 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046346010000000003 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.611855+0000", 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1572999999999997e-05 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.611870+0000", 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5129e-05 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.612015+0000", 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000145618 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.612075+0000", 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9692999999999999e-05 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625482+0000", 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013406998999999999 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625609+0000", 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012714900000000001 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.199 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.199 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1229 3.16 3:6ad6b699:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.199 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.724599+0000", 2024-05-08T18:09:13.199 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.4221150380000003, 2024-05-08T18:09:13.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018735992999999999, 2024-05-08T18:09:13.199 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.199 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.200 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.200 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.200 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.200 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.200 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1229 2024-05-08T18:09:13.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.200 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.724599+0000", 2024-05-08T18:09:13.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.724599+0000", 2024-05-08T18:09:13.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.724602+0000", 2024-05-08T18:09:13.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999999e-06 2024-05-08T18:09:13.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728621+0000", 2024-05-08T18:09:13.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040188649999999999 2024-05-08T18:09:13.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728658+0000", 2024-05-08T18:09:13.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7722999999999998e-05 2024-05-08T18:09:13.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728677+0000", 2024-05-08T18:09:13.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9000000000000001e-05 2024-05-08T18:09:13.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728876+0000", 2024-05-08T18:09:13.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019832300000000001 2024-05-08T18:09:13.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.729122+0000", 2024-05-08T18:09:13.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024644700000000001 2024-05-08T18:09:13.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:13.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.729371+0000", 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000249087 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.738186+0000", 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0088147859999999998 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.743162+0000", 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049762909999999999 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.743263+0000", 2024-05-08T18:09:13.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010037199999999999 2024-05-08T18:09:13.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.743335+0000", 2024-05-08T18:09:13.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2006000000000001e-05 2024-05-08T18:09:13.205 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.205 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.205 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.205 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1235 3.16 3:6999c92c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.205 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.840049+0000", 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.3066642389999998, 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017385405999999999, 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1235 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.840049+0000", 2024-05-08T18:09:13.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.840049+0000", 2024-05-08T18:09:13.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.840052+0000", 2024-05-08T18:09:13.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.683e-06 2024-05-08T18:09:13.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.843805+0000", 2024-05-08T18:09:13.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037527789999999999 2024-05-08T18:09:13.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.843833+0000", 2024-05-08T18:09:13.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7722e-05 2024-05-08T18:09:13.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.843845+0000", 2024-05-08T18:09:13.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2439000000000001e-05 2024-05-08T18:09:13.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.843921+0000", 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5859999999999995e-05 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.844062+0000", 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140975 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.844171+0000", 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010931500000000001 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.856919+0000", 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012747688 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.857349+0000", 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042999200000000003 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.857391+0000", 2024-05-08T18:09:13.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2110999999999997e-05 2024-05-08T18:09:13.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.857435+0000", 2024-05-08T18:09:13.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3841999999999998e-05 2024-05-08T18:09:13.211 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.211 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.211 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.211 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1242 3.28 3:16e2765f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.2:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.211 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:13.211 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1701013250000001, 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020212443, 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1242 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976615+0000", 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6170000000000001e-06 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980655+0000", 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040399240000000003 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980693+0000", 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7996e-05 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980717+0000", 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.459e-05 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980811+0000", 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3931000000000006e-05 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980965+0000", 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015315500000000001 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.981450+0000", 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000485632 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.991160+0000", 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.009709858 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996726+0000", 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055655039999999998 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996786+0000", 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0511999999999999e-05 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996825+0000", 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8723999999999997e-05 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1247 3.c 3:32aac358:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.370612+0000", 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.7761017270000004, 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019632920000000002, 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.218 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.218 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.218 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.218 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.218 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.218 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1247 2024-05-08T18:09:13.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.218 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.370612+0000", 2024-05-08T18:09:13.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.370612+0000", 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.370615+0000", 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.559e-06 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374436+0000", 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038219460000000001 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374465+0000", 2024-05-08T18:09:13.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8347000000000002e-05 2024-05-08T18:09:13.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374476+0000", 2024-05-08T18:09:13.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1334e-05 2024-05-08T18:09:13.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374553+0000", 2024-05-08T18:09:13.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6555000000000001e-05 2024-05-08T18:09:13.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374667+0000", 2024-05-08T18:09:13.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114732 2024-05-08T18:09:13.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:13.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374764+0000", 2024-05-08T18:09:13.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6527000000000006e-05 2024-05-08T18:09:13.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.382209+0000", 2024-05-08T18:09:13.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074447309999999996 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.390135+0000", 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079259099999999996 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.390185+0000", 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0834999999999997e-05 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.390245+0000", 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9444000000000002e-05 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1281 3.c 3:30308c7a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.141519+0000", 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.0051945629999999, 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018327742000000001, 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1281 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.141519+0000", 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.141519+0000", 2024-05-08T18:09:13.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.141522+0000", 2024-05-08T18:09:13.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1839999999999999e-06 2024-05-08T18:09:13.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.145451+0000", 2024-05-08T18:09:13.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039283859999999999 2024-05-08T18:09:13.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.145479+0000", 2024-05-08T18:09:13.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8367000000000001e-05 2024-05-08T18:09:13.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.145496+0000", 2024-05-08T18:09:13.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6738000000000001e-05 2024-05-08T18:09:13.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.145700+0000", 2024-05-08T18:09:13.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020385600000000001 2024-05-08T18:09:13.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.146014+0000", 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000313942 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.146166+0000", 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152535 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.155416+0000", 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092500450000000001 2024-05-08T18:09:13.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.159699+0000", 2024-05-08T18:09:13.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042826390000000004 2024-05-08T18:09:13.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.159787+0000", 2024-05-08T18:09:13.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7820999999999998e-05 2024-05-08T18:09:13.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.159847+0000", 2024-05-08T18:09:13.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0229000000000002e-05 2024-05-08T18:09:13.229 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.229 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.229 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.229 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1395 3.17 e87/20 3:eb9c68a5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_1:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:13.229 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.771843+0000", 2024-05-08T18:09:13.229 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.3748704489999999, 2024-05-08T18:09:13.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021322812, 2024-05-08T18:09:13.229 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.229 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.229 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.229 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.771843+0000", 2024-05-08T18:09:13.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.771843+0000", 2024-05-08T18:09:13.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.771844+0000", 2024-05-08T18:09:13.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0999999999999999e-07 2024-05-08T18:09:13.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.778254+0000", 2024-05-08T18:09:13.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064103859999999997 2024-05-08T18:09:13.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.778286+0000", 2024-05-08T18:09:13.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2113000000000002e-05 2024-05-08T18:09:13.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.778307+0000", 2024-05-08T18:09:13.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1158999999999999e-05 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.779027+0000", 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00071950400000000004 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.779083+0000", 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6512999999999999e-05 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.793025+0000", 2024-05-08T18:09:13.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013941782999999999 2024-05-08T18:09:13.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.793166+0000", 2024-05-08T18:09:13.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140844 2024-05-08T18:09:13.233 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.233 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.233 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.233 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1400 3.1c 3:3bb95565:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:13.233 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:13.234 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.317964479, 2024-05-08T18:09:13.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02650396, 2024-05-08T18:09:13.234 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.234 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.234 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.234 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.234 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.234 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.234 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1400 2024-05-08T18:09:13.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.234 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828753+0000", 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4400000000000001e-06 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836255+0000", 2024-05-08T18:09:13.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0075026379999999998 2024-05-08T18:09:13.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836312+0000", 2024-05-08T18:09:13.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6459000000000003e-05 2024-05-08T18:09:13.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836340+0000", 2024-05-08T18:09:13.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8183000000000001e-05 2024-05-08T18:09:13.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836510+0000", 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000169805 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836763+0000", 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025333700000000002 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836995+0000", 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023236700000000001 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849771+0000", 2024-05-08T18:09:13.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012775760000000001 2024-05-08T18:09:13.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855089+0000", 2024-05-08T18:09:13.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0053173889999999996 2024-05-08T18:09:13.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855183+0000", 2024-05-08T18:09:13.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4276000000000003e-05 2024-05-08T18:09:13.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855253+0000", 2024-05-08T18:09:13.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0306000000000001e-05 2024-05-08T18:09:13.239 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.239 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.239 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.239 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1403 3.3c 3:3d3d8ab9:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:13.239 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.859030+0000", 2024-05-08T18:09:13.239 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.2876832409999999, 2024-05-08T18:09:13.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018096253, 2024-05-08T18:09:13.240 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.240 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.240 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.240 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.240 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.240 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.240 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1403 2024-05-08T18:09:13.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.240 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.859030+0000", 2024-05-08T18:09:13.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.859030+0000", 2024-05-08T18:09:13.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.859032+0000", 2024-05-08T18:09:13.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0530000000000001e-06 2024-05-08T18:09:13.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.863007+0000", 2024-05-08T18:09:13.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039740499999999998 2024-05-08T18:09:13.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.863037+0000", 2024-05-08T18:09:13.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9963000000000001e-05 2024-05-08T18:09:13.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.863052+0000", 2024-05-08T18:09:13.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5982999999999999e-05 2024-05-08T18:09:13.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.863214+0000", 2024-05-08T18:09:13.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016188500000000001 2024-05-08T18:09:13.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.863476+0000", 2024-05-08T18:09:13.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026194 2024-05-08T18:09:13.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:13.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.863712+0000", 2024-05-08T18:09:13.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023535299999999999 2024-05-08T18:09:13.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.872894+0000", 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0091821030000000005 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.876805+0000", 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039108739999999999 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.876994+0000", 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000188894 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.877127+0000", 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013315500000000001 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1405 3.c 3:3166280d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.2653980439999999, 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023065800000000001, 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1405 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881320+0000", 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887255+0000", 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059351509999999996 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887305+0000", 2024-05-08T18:09:13.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9579000000000001e-05 2024-05-08T18:09:13.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887332+0000", 2024-05-08T18:09:13.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7276000000000001e-05 2024-05-08T18:09:13.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887489+0000", 2024-05-08T18:09:13.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000156465 2024-05-08T18:09:13.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887745+0000", 2024-05-08T18:09:13.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025626700000000002 2024-05-08T18:09:13.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:13.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887980+0000", 2024-05-08T18:09:13.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000235107 2024-05-08T18:09:13.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.896366+0000", 2024-05-08T18:09:13.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083860870000000004 2024-05-08T18:09:13.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904214+0000", 2024-05-08T18:09:13.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078482840000000005 2024-05-08T18:09:13.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904312+0000", 2024-05-08T18:09:13.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7901999999999999e-05 2024-05-08T18:09:13.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904381+0000", 2024-05-08T18:09:13.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9258999999999995e-05 2024-05-08T18:09:13.250 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.251 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.251 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.251 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1410 3.30 3:0e0f1cce:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:13.251 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:13.251 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.212173068, 2024-05-08T18:09:13.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.026130820999999999, 2024-05-08T18:09:13.251 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.251 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.251 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.251 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.251 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.251 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.252 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1410 2024-05-08T18:09:13.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.252 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:13.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:13.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934544+0000", 2024-05-08T18:09:13.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2600000000000001e-06 2024-05-08T18:09:13.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939363+0000", 2024-05-08T18:09:13.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048190020000000002 2024-05-08T18:09:13.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939407+0000", 2024-05-08T18:09:13.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3999999999999999e-05 2024-05-08T18:09:13.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939428+0000", 2024-05-08T18:09:13.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0746000000000001e-05 2024-05-08T18:09:13.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939637+0000", 2024-05-08T18:09:13.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000209397 2024-05-08T18:09:13.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939894+0000", 2024-05-08T18:09:13.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025690700000000001 2024-05-08T18:09:13.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:13.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.940133+0000", 2024-05-08T18:09:13.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023939400000000001 2024-05-08T18:09:13.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.949842+0000", 2024-05-08T18:09:13.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0097087570000000002 2024-05-08T18:09:13.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960494+0000", 2024-05-08T18:09:13.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01065148 2024-05-08T18:09:13.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960597+0000", 2024-05-08T18:09:13.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103529 2024-05-08T18:09:13.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960671+0000", 2024-05-08T18:09:13.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4349000000000003e-05 2024-05-08T18:09:13.256 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.256 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.256 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.256 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1446 3.22 3:44011652:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:13.257 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:13.257 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.27179143500000003, 2024-05-08T18:09:13.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024780153999999999, 2024-05-08T18:09:13.257 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.257 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.257 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.257 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.257 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.257 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.257 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1446 2024-05-08T18:09:13.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.257 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:13.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:13.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874926+0000", 2024-05-08T18:09:13.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2739999999999999e-06 2024-05-08T18:09:13.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879812+0000", 2024-05-08T18:09:13.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048860040000000002 2024-05-08T18:09:13.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879849+0000", 2024-05-08T18:09:13.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7919000000000001e-05 2024-05-08T18:09:13.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879868+0000", 2024-05-08T18:09:13.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8836999999999999e-05 2024-05-08T18:09:13.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880042+0000", 2024-05-08T18:09:13.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173981 2024-05-08T18:09:13.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880452+0000", 2024-05-08T18:09:13.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040949200000000002 2024-05-08T18:09:13.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:13.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880849+0000", 2024-05-08T18:09:13.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039710499999999997 2024-05-08T18:09:13.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.892821+0000", 2024-05-08T18:09:13.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011972287 2024-05-08T18:09:13.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899596+0000", 2024-05-08T18:09:13.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067744720000000001 2024-05-08T18:09:13.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899655+0000", 2024-05-08T18:09:13.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9119000000000001e-05 2024-05-08T18:09:13.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899702+0000", 2024-05-08T18:09:13.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7664000000000003e-05 2024-05-08T18:09:13.262 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.262 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.262 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.262 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.262 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.262 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:13.263 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:09:13.264 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:13.264+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:13.365 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:13.364+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:13.445 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:13.446 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:13.446 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:13.446 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:13.464 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:09:13.465 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:13.465+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:13.566 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:13.565+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:13.592 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:13.592 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:13.592 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:13.593 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:13.593 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:13.608 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:09:13.628 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:09:13.674 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:13.676+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:13.711 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:09:13.768 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:13.769+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:13.790 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:13.790 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:13.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:13.790 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:13.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.790 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:09:13.790 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:13.790 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 110.252542848, 2024-05-08T18:09:13.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.032012946, 2024-05-08T18:09:13.790 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.791 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.791 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.791 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.791 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.791 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.791 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:09:13.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.791 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:13.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:13.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535484+0000", 2024-05-08T18:09:13.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7929999999999999e-06 2024-05-08T18:09:13.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535500+0000", 2024-05-08T18:09:13.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5226e-05 2024-05-08T18:09:13.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535535+0000", 2024-05-08T18:09:13.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5213000000000003e-05 2024-05-08T18:09:13.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535564+0000", 2024-05-08T18:09:13.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9360999999999999e-05 2024-05-08T18:09:13.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535757+0000", 2024-05-08T18:09:13.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000193229 2024-05-08T18:09:13.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:13.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535775+0000", 2024-05-08T18:09:13.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7098000000000001e-05 2024-05-08T18:09:13.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556004+0000", 2024-05-08T18:09:13.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020229068999999999 2024-05-08T18:09:13.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:13.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556036+0000", 2024-05-08T18:09:13.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1943000000000002e-05 2024-05-08T18:09:13.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.564721+0000", 2024-05-08T18:09:13.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086853320000000005 2024-05-08T18:09:13.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565032+0000", 2024-05-08T18:09:13.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031121799999999999 2024-05-08T18:09:13.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:13.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565365+0000", 2024-05-08T18:09:13.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000332744 2024-05-08T18:09:13.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567305+0000", 2024-05-08T18:09:13.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00194016 2024-05-08T18:09:13.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567368+0000", 2024-05-08T18:09:13.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3342000000000004e-05 2024-05-08T18:09:13.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567433+0000", 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4726000000000003e-05 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567494+0000", 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0492000000000003e-05 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1189 3.20 3:054e8a9f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.8278534420000003, 2024-05-08T18:09:13.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025093629999999999, 2024-05-08T18:09:13.798 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.798 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.798 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.798 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.798 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.798 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.798 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1189 2024-05-08T18:09:13.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.798 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960173+0000", 2024-05-08T18:09:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.65e-06 2024-05-08T18:09:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965720+0000", 2024-05-08T18:09:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055476340000000001 2024-05-08T18:09:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965757+0000", 2024-05-08T18:09:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6223000000000002e-05 2024-05-08T18:09:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965774+0000", 2024-05-08T18:09:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6952999999999998e-05 2024-05-08T18:09:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965930+0000", 2024-05-08T18:09:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015611800000000001 2024-05-08T18:09:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966190+0000", 2024-05-08T18:09:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025999399999999999 2024-05-08T18:09:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966440+0000", 2024-05-08T18:09:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025007600000000001 2024-05-08T18:09:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981042+0000", 2024-05-08T18:09:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01460257 2024-05-08T18:09:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.984969+0000", 2024-05-08T18:09:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039265159999999997 2024-05-08T18:09:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985135+0000", 2024-05-08T18:09:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016630400000000001 2024-05-08T18:09:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985264+0000", 2024-05-08T18:09:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012859199999999999 2024-05-08T18:09:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1192 3.1e e85/47 3:7833f47f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_4:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.994441+0000", 2024-05-08T18:09:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.7935823280000003, 2024-05-08T18:09:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016369932, 2024-05-08T18:09:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994441+0000", 2024-05-08T18:09:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994441+0000", 2024-05-08T18:09:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994445+0000", 2024-05-08T18:09:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4199999999999999e-06 2024-05-08T18:09:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.000972+0000", 2024-05-08T18:09:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065271340000000004 2024-05-08T18:09:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.001010+0000", 2024-05-08T18:09:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8451999999999997e-05 2024-05-08T18:09:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.001035+0000", 2024-05-08T18:09:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4867000000000001e-05 2024-05-08T18:09:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.001166+0000", 2024-05-08T18:09:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013134799999999999 2024-05-08T18:09:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.001205+0000", 2024-05-08T18:09:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8445999999999997e-05 2024-05-08T18:09:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010722+0000", 2024-05-08T18:09:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0095169460000000001 2024-05-08T18:09:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010811+0000", 2024-05-08T18:09:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9319000000000003e-05 2024-05-08T18:09:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1197 3.2e e85/20 3:760a6639:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_9:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.051204+0000", 2024-05-08T18:09:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.7368189940000001, 2024-05-08T18:09:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017286416999999998, 2024-05-08T18:09:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.051204+0000", 2024-05-08T18:09:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.051204+0000", 2024-05-08T18:09:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.051207+0000", 2024-05-08T18:09:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6929999999999999e-06 2024-05-08T18:09:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056151+0000", 2024-05-08T18:09:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049433360000000004 2024-05-08T18:09:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056183+0000", 2024-05-08T18:09:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2826e-05 2024-05-08T18:09:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056198+0000", 2024-05-08T18:09:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5074e-05 2024-05-08T18:09:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056349+0000", 2024-05-08T18:09:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015056100000000001 2024-05-08T18:09:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056387+0000", 2024-05-08T18:09:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7756000000000002e-05 2024-05-08T18:09:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.068354+0000", 2024-05-08T18:09:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011967099 2024-05-08T18:09:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.068491+0000", 2024-05-08T18:09:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013707199999999999 2024-05-08T18:09:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1209 3.35 3:af4c6abe:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.6125917950000002, 2024-05-08T18:09:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027313356, 2024-05-08T18:09:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1209 2024-05-08T18:09:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175436+0000", 2024-05-08T18:09:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3800000000000004e-06 2024-05-08T18:09:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179472+0000", 2024-05-08T18:09:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040357020000000004 2024-05-08T18:09:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179515+0000", 2024-05-08T18:09:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2988999999999998e-05 2024-05-08T18:09:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179534+0000", 2024-05-08T18:09:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8743e-05 2024-05-08T18:09:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179673+0000", 2024-05-08T18:09:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013983800000000001 2024-05-08T18:09:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179933+0000", 2024-05-08T18:09:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025967999999999998 2024-05-08T18:09:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180161+0000", 2024-05-08T18:09:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022826300000000001 2024-05-08T18:09:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.200613+0000", 2024-05-08T18:09:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020451766999999999 2024-05-08T18:09:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202567+0000", 2024-05-08T18:09:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019541160000000001 2024-05-08T18:09:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202665+0000", 2024-05-08T18:09:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8055999999999998e-05 2024-05-08T18:09:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202745+0000", 2024-05-08T18:09:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9821999999999996e-05 2024-05-08T18:09:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1221 3.20 3:071d1257:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.1932769199999997, 2024-05-08T18:09:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02822473, 2024-05-08T18:09:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1221 2024-05-08T18:09:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594751+0000", 2024-05-08T18:09:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3769999999999998e-06 2024-05-08T18:09:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600627+0000", 2024-05-08T18:09:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058764389999999998 2024-05-08T18:09:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600672+0000", 2024-05-08T18:09:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4805999999999998e-05 2024-05-08T18:09:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600704+0000", 2024-05-08T18:09:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2026000000000001e-05 2024-05-08T18:09:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600884+0000", 2024-05-08T18:09:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000179385 2024-05-08T18:09:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601296+0000", 2024-05-08T18:09:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041257400000000002 2024-05-08T18:09:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601742+0000", 2024-05-08T18:09:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044585399999999998 2024-05-08T18:09:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.617360+0000", 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015617982000000001 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622618+0000", 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052577420000000001 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622835+0000", 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021674699999999999 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622971+0000", 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679799999999999 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1223 3.2e e85/20 3:74a5b043:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_7:head v 85'3, mlcod=85'1)", 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.619798+0000", 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.16822509, 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018211183999999998, 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.619798+0000", 2024-05-08T18:09:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.619798+0000", 2024-05-08T18:09:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.619801+0000", 2024-05-08T18:09:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7e-06 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625096+0000", 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052944369999999999 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625126+0000", 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0960000000000002e-05 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625165+0000", 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8136000000000002e-05 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625291+0000", 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012613500000000001 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625349+0000", 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8495999999999997e-05 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.637877+0000", 2024-05-08T18:09:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012527652 2024-05-08T18:09:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638010+0000", 2024-05-08T18:09:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013266800000000001 2024-05-08T18:09:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1252 3.2c 3:37bfa689:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.445436+0000", 2024-05-08T18:09:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.3425877889999995, 2024-05-08T18:09:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016825887000000001, 2024-05-08T18:09:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1252 2024-05-08T18:09:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.445436+0000", 2024-05-08T18:09:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.445436+0000", 2024-05-08T18:09:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.445438+0000", 2024-05-08T18:09:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7530000000000002e-06 2024-05-08T18:09:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.449484+0000", 2024-05-08T18:09:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040451510000000003 2024-05-08T18:09:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.449511+0000", 2024-05-08T18:09:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7188000000000001e-05 2024-05-08T18:09:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.449523+0000", 2024-05-08T18:09:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1762e-05 2024-05-08T18:09:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.449602+0000", 2024-05-08T18:09:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9849000000000001e-05 2024-05-08T18:09:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.449731+0000", 2024-05-08T18:09:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012886899999999999 2024-05-08T18:09:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.449835+0000", 2024-05-08T18:09:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103739 2024-05-08T18:09:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.455838+0000", 2024-05-08T18:09:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006002767 2024-05-08T18:09:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.462140+0000", 2024-05-08T18:09:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0063020890000000003 2024-05-08T18:09:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.462207+0000", 2024-05-08T18:09:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7624000000000002e-05 2024-05-08T18:09:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.462262+0000", 2024-05-08T18:09:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4095999999999998e-05 2024-05-08T18:09:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1263 3.36 3:6eb7bd8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.571418+0000", 2024-05-08T18:09:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.2166055910000004, 2024-05-08T18:09:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018084347000000001, 2024-05-08T18:09:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1263 2024-05-08T18:09:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.571418+0000", 2024-05-08T18:09:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.571418+0000", 2024-05-08T18:09:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.571420+0000", 2024-05-08T18:09:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3860000000000001e-06 2024-05-08T18:09:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575201+0000", 2024-05-08T18:09:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037802589999999998 2024-05-08T18:09:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575225+0000", 2024-05-08T18:09:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4134999999999998e-05 2024-05-08T18:09:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575237+0000", 2024-05-08T18:09:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2425999999999999e-05 2024-05-08T18:09:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575315+0000", 2024-05-08T18:09:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7621999999999996e-05 2024-05-08T18:09:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575474+0000", 2024-05-08T18:09:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015942699999999999 2024-05-08T18:09:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575606+0000", 2024-05-08T18:09:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013143200000000001 2024-05-08T18:09:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.589176+0000", 2024-05-08T18:09:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013570863000000001 2024-05-08T18:09:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.589303+0000", 2024-05-08T18:09:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126067 2024-05-08T18:09:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.589421+0000", 2024-05-08T18:09:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118311 2024-05-08T18:09:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.589502+0000", 2024-05-08T18:09:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1419000000000001e-05 2024-05-08T18:09:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1268 3.36 3:6efaad9c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.629292+0000", 2024-05-08T18:09:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1587314419999997, 2024-05-08T18:09:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018691711, 2024-05-08T18:09:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1268 2024-05-08T18:09:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.629292+0000", 2024-05-08T18:09:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.629292+0000", 2024-05-08T18:09:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.629295+0000", 2024-05-08T18:09:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5799999999999999e-06 2024-05-08T18:09:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633104+0000", 2024-05-08T18:09:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038088869999999999 2024-05-08T18:09:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633130+0000", 2024-05-08T18:09:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6016e-05 2024-05-08T18:09:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633144+0000", 2024-05-08T18:09:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3971999999999999e-05 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633229+0000", 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5749999999999997e-05 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633349+0000", 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011934000000000001 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633507+0000", 2024-05-08T18:09:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015834700000000001 2024-05-08T18:09:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.639941+0000", 2024-05-08T18:09:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064341449999999996 2024-05-08T18:09:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.647803+0000", 2024-05-08T18:09:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078617889999999992 2024-05-08T18:09:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.647907+0000", 2024-05-08T18:09:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010413599999999999 2024-05-08T18:09:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.647984+0000", 2024-05-08T18:09:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6749000000000007e-05 2024-05-08T18:09:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1275 3.33 e85/20 3:ccdf9558:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_3:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.7344338839999995, 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020251129, 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053592+0000", 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5189999999999999e-06 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059662+0000", 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060699289999999999 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059680+0000", 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7558999999999999e-05 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059689+0000", 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2320000000000007e-06 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059826+0000", 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136792 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059867+0000", 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1689e-05 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073728+0000", 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01386104 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073841+0000", 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011236899999999999 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1286 3.20 3:07ccb256:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.5837392699999997, 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022546805999999999, 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1286 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204287+0000", 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8880000000000001e-06 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208135+0000", 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038480960000000001 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208158+0000", 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-05 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208172+0000", 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208251+0000", 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8863999999999996e-05 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208387+0000", 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013615099999999999 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208488+0000", 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101366 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.214533+0000", 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060444829999999998 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226742+0000", 2024-05-08T18:09:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012208798 2024-05-08T18:09:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226792+0000", 2024-05-08T18:09:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0565999999999997e-05 2024-05-08T18:09:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226831+0000", 2024-05-08T18:09:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8816999999999998e-05 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1397 3.34 e87/20 3:2c6418f0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_3:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.9853072809999999, 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019946450000000001, 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802717+0000", 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0400000000000005e-07 2024-05-08T18:09:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807936+0000", 2024-05-08T18:09:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052192489999999996 2024-05-08T18:09:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807971+0000", 2024-05-08T18:09:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4517000000000002e-05 2024-05-08T18:09:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807993+0000", 2024-05-08T18:09:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2463000000000002e-05 2024-05-08T18:09:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.808151+0000", 2024-05-08T18:09:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015751400000000001 2024-05-08T18:09:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.808197+0000", 2024-05-08T18:09:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6637000000000001e-05 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822537+0000", 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014339607000000001 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822663+0000", 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125659 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1399 3.2c 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.96859575, 2024-05-08T18:09:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030683200000000001, 2024-05-08T18:09:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1399 2024-05-08T18:09:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819432+0000", 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7759999999999999e-06 2024-05-08T18:09:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825021+0000", 2024-05-08T18:09:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055895859999999997 2024-05-08T18:09:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825052+0000", 2024-05-08T18:09:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1047000000000003e-05 2024-05-08T18:09:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825068+0000", 2024-05-08T18:09:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6138999999999999e-05 2024-05-08T18:09:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825218+0000", 2024-05-08T18:09:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014997200000000001 2024-05-08T18:09:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825490+0000", 2024-05-08T18:09:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000271446 2024-05-08T18:09:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825710+0000", 2024-05-08T18:09:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220354 2024-05-08T18:09:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.839642+0000", 2024-05-08T18:09:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013932363 2024-05-08T18:09:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849813+0000", 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010170461 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849981+0000", 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016776399999999999 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.850111+0000", 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013029200000000001 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1406 3.20 3:05e3d3c1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.8990246389999998, 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022642778999999998, 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1406 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.889003+0000", 2024-05-08T18:09:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8670000000000004e-06 2024-05-08T18:09:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893237+0000", 2024-05-08T18:09:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042339999999999999 2024-05-08T18:09:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893279+0000", 2024-05-08T18:09:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2225999999999999e-05 2024-05-08T18:09:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893305+0000", 2024-05-08T18:09:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.618e-05 2024-05-08T18:09:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893479+0000", 2024-05-08T18:09:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017357700000000001 2024-05-08T18:09:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893736+0000", 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025701700000000001 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893993+0000", 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025750700000000003 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904227+0000", 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010234073 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911471+0000", 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0072441909999999997 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911567+0000", 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5685000000000003e-05 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911642+0000", 2024-05-08T18:09:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4456000000000007e-05 2024-05-08T18:09:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1412 3.3f e87/20 3:fe02d1ba:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_18:head v 87'3, mlcod=85'1)", 2024-05-08T18:09:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.964215+0000", 2024-05-08T18:09:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.8238084880000001, 2024-05-08T18:09:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015849505, 2024-05-08T18:09:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.964215+0000", 2024-05-08T18:09:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.964215+0000", 2024-05-08T18:09:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.964216+0000", 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5000000000000001e-07 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.967038+0000", 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0028224639999999998 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.967088+0000", 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9858999999999998e-05 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.967114+0000", 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6287000000000001e-05 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.967300+0000", 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018562 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.967368+0000", 2024-05-08T18:09:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8330000000000005e-05 2024-05-08T18:09:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.979886+0000", 2024-05-08T18:09:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01251727 2024-05-08T18:09:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980065+0000", 2024-05-08T18:09:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000178825 2024-05-08T18:09:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1416 3.2c 3:345ebd70:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.7916534340000001, 2024-05-08T18:09:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027523229999999999, 2024-05-08T18:09:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1416 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996374+0000", 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.506e-06 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000305+0000", 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003931197 2024-05-08T18:09:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000346+0000", 2024-05-08T18:09:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1396000000000001e-05 2024-05-08T18:09:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000364+0000", 2024-05-08T18:09:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.806e-05 2024-05-08T18:09:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000490+0000", 2024-05-08T18:09:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012581800000000001 2024-05-08T18:09:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000755+0000", 2024-05-08T18:09:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026484700000000002 2024-05-08T18:09:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000992+0000", 2024-05-08T18:09:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023701700000000001 2024-05-08T18:09:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010465+0000", 2024-05-08T18:09:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094726429999999993 2024-05-08T18:09:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023679+0000", 2024-05-08T18:09:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013214105 2024-05-08T18:09:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023776+0000", 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7258999999999998e-05 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023893+0000", 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117382 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1424 3.36 3:6c7a05ce:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.375800+0000", 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.4122234410000001, 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019293312999999999, 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1424 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.375800+0000", 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.375800+0000", 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.375802+0000", 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3879999999999998e-06 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.379572+0000", 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037692820000000001 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.379602+0000", 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0114999999999999e-05 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.379614+0000", 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1725999999999999e-05 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.379759+0000", 2024-05-08T18:09:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014588000000000001 2024-05-08T18:09:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.380200+0000", 2024-05-08T18:09:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044040399999999998 2024-05-08T18:09:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.380676+0000", 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047648100000000001 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.387146+0000", 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064695050000000004 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.394934+0000", 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007787988 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.395022+0000", 2024-05-08T18:09:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8090000000000005e-05 2024-05-08T18:09:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.395093+0000", 2024-05-08T18:09:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1453999999999997e-05 2024-05-08T18:09:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1444 3.2c 3:3746b84a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.785023+0000", 2024-05-08T18:09:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.0030007439999999, 2024-05-08T18:09:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018464464999999999, 2024-05-08T18:09:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1444 2024-05-08T18:09:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.785023+0000", 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.785023+0000", 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.785046+0000", 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3603000000000001e-05 2024-05-08T18:09:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789230+0000", 2024-05-08T18:09:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041834300000000001 2024-05-08T18:09:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789272+0000", 2024-05-08T18:09:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2531999999999999e-05 2024-05-08T18:09:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789292+0000", 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9360000000000001e-05 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789395+0000", 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103597 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789572+0000", 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017642999999999999 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789746+0000", 2024-05-08T18:09:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017421799999999999 2024-05-08T18:09:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.802556+0000", 2024-05-08T18:09:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012810013 2024-05-08T18:09:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.803301+0000", 2024-05-08T18:09:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00074479400000000001 2024-05-08T18:09:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.803400+0000", 2024-05-08T18:09:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9038999999999998e-05 2024-05-08T18:09:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.803487+0000", 2024-05-08T18:09:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7448999999999996e-05 2024-05-08T18:09:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1451 3.36 3:6da4b5f8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.49098080100000002, 2024-05-08T18:09:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022119236, 2024-05-08T18:09:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1451 2024-05-08T18:09:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297046+0000", 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6030000000000001e-06 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301125+0000", 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004079058 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301163+0000", 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7286000000000002e-05 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301181+0000", 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.844e-05 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301325+0000", 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144284 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301602+0000", 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027665399999999998 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301835+0000", 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023292699999999999 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.318166+0000", 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016331061000000001 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.318991+0000", 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000825427 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:13.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.319082+0000", 2024-05-08T18:09:13.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0743999999999997e-05 2024-05-08T18:09:13.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:13.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:13.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:13.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.319162+0000", 2024-05-08T18:09:13.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9752000000000005e-05 2024-05-08T18:09:13.902 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.902 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.902 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.902 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:13.902 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:13.902 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:13.903 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:13.904 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:13.904 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:13.905 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:13.905 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:09:13.905 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:13.905+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:13.906 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:13.906 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:13.917 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:13.917 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:13.937 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:13.937 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:13.958 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:13.958 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:13.979 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:13.979 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:13.999 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:13.999 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:14.004 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:14.005+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:14.082 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:14.083 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:14.096 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:09:14.105 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:14.104+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:14.206 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:14.205+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:14.264 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:14.264 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:14.277 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:09:14.307 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:14.308+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:14.409 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:14.409+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:14.443 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:14.443 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:14.460 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:09:14.509 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:14.512+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:14.591 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:14.591 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:14.605 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:09:14.611 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:14.609+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:14.712 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:14.712+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:14.747 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-05-08T18:09:14.778 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:14.778 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:14.791 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:09:14.814 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:14.813+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:14.914 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:14.916+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:14.944 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:14.945 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:14.957 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:09:15.014 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:15.013+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:15.116 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:15.117+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:15.122 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:15.122 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:15.137 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:09:15.216 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:15.216+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:15.256 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:15.256 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:15.273 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:09:15.358 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:15.360+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:15.418 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:15.420+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:15.421 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:15.421 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:15.433 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:09:15.521 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:15.524+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:15.599 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:15.600 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:15.614 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:09:15.621 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:15.621+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:15.722 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:15.724+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:15.774 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:15.774 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:15.789 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:09:15.823 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:15.821+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:15.924 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:15.925+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:15.943 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:15.943 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:15.956 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:09:16.019 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:09:16.024 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:16.025+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:16.083 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:16.083 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:16.097 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:09:16.145 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:16.148+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:16.175 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:16.176 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:16.192 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:16.192 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:16.209 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:16.209 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:16.215 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:16.216 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:16.226 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:16.228+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:16.228 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:16.228 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:16.237 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:09:16.250 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:16.251 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:16.271 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:16.271 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:16.292 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:16.292 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:16.316 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:16.316 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:16.328 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:16.325+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:16.370 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:16.370 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:16.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1200 3.38 3:1e9fdc78:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.083611+0000", 2024-05-08T18:09:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.2913620239999997, 2024-05-08T18:09:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018355481, 2024-05-08T18:09:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1200 2024-05-08T18:09:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.371 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.083611+0000", 2024-05-08T18:09:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.083611+0000", 2024-05-08T18:09:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.083614+0000", 2024-05-08T18:09:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7989999999999998e-06 2024-05-08T18:09:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085152+0000", 2024-05-08T18:09:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001538097 2024-05-08T18:09:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085182+0000", 2024-05-08T18:09:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0066999999999999e-05 2024-05-08T18:09:16.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085197+0000", 2024-05-08T18:09:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4911e-05 2024-05-08T18:09:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085262+0000", 2024-05-08T18:09:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4703999999999996e-05 2024-05-08T18:09:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085395+0000", 2024-05-08T18:09:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133549 2024-05-08T18:09:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.085490+0000", 2024-05-08T18:09:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5076999999999998e-05 2024-05-08T18:09:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.095404+0000", 2024-05-08T18:09:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0099138290000000007 2024-05-08T18:09:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.101881+0000", 2024-05-08T18:09:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0064767269999999998 2024-05-08T18:09:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.101930+0000", 2024-05-08T18:09:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8578000000000001e-05 2024-05-08T18:09:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.101967+0000", 2024-05-08T18:09:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7143e-05 2024-05-08T18:09:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1207 3.15 e85/20 3:a96d965c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_19:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.162095+0000", 2024-05-08T18:09:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.2128782549999997, 2024-05-08T18:09:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022218617999999999, 2024-05-08T18:09:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.162095+0000", 2024-05-08T18:09:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.162095+0000", 2024-05-08T18:09:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.162096+0000", 2024-05-08T18:09:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8899999999999998e-07 2024-05-08T18:09:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167032+0000", 2024-05-08T18:09:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004936429 2024-05-08T18:09:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167062+0000", 2024-05-08T18:09:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9422000000000001e-05 2024-05-08T18:09:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167075+0000", 2024-05-08T18:09:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3436e-05 2024-05-08T18:09:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167157+0000", 2024-05-08T18:09:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1337999999999999e-05 2024-05-08T18:09:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167180+0000", 2024-05-08T18:09:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3816e-05 2024-05-08T18:09:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.184267+0000", 2024-05-08T18:09:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017086796000000001 2024-05-08T18:09:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.184314+0000", 2024-05-08T18:09:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6391999999999999e-05 2024-05-08T18:09:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1218 3.c e85/20 3:33b8068a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_2:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.573654+0000", 2024-05-08T18:09:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.8013188650000007, 2024-05-08T18:09:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016484525, 2024-05-08T18:09:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.381 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.573654+0000", 2024-05-08T18:09:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.573654+0000", 2024-05-08T18:09:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.573656+0000", 2024-05-08T18:09:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6360000000000001e-06 2024-05-08T18:09:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.577812+0000", 2024-05-08T18:09:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041564339999999996 2024-05-08T18:09:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.577840+0000", 2024-05-08T18:09:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7790999999999999e-05 2024-05-08T18:09:16.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.577855+0000", 2024-05-08T18:09:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4575e-05 2024-05-08T18:09:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.577938+0000", 2024-05-08T18:09:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2792000000000003e-05 2024-05-08T18:09:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.577964+0000", 2024-05-08T18:09:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6239000000000001e-05 2024-05-08T18:09:16.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.590093+0000", 2024-05-08T18:09:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012129548 2024-05-08T18:09:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.590139+0000", 2024-05-08T18:09:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5510000000000003e-05 2024-05-08T18:09:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.385 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1219 3.2 3:4068b298:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.575413+0000", 2024-05-08T18:09:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.7995607069999995, 2024-05-08T18:09:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.027002252000000001, 2024-05-08T18:09:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1219 2024-05-08T18:09:16.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.575413+0000", 2024-05-08T18:09:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.575413+0000", 2024-05-08T18:09:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.575416+0000", 2024-05-08T18:09:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2969999999999999e-06 2024-05-08T18:09:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.578847+0000", 2024-05-08T18:09:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003431052 2024-05-08T18:09:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.580255+0000", 2024-05-08T18:09:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014079310000000001 2024-05-08T18:09:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.580271+0000", 2024-05-08T18:09:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5637999999999998e-05 2024-05-08T18:09:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.580333+0000", 2024-05-08T18:09:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2213999999999998e-05 2024-05-08T18:09:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.580466+0000", 2024-05-08T18:09:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013334800000000001 2024-05-08T18:09:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.580556+0000", 2024-05-08T18:09:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0252000000000003e-05 2024-05-08T18:09:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.590619+0000", 2024-05-08T18:09:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010062448 2024-05-08T18:09:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:16.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.602227+0000", 2024-05-08T18:09:16.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011608108000000001 2024-05-08T18:09:16.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.602305+0000", 2024-05-08T18:09:16.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8468999999999997e-05 2024-05-08T18:09:16.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.602415+0000", 2024-05-08T18:09:16.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010949499999999999 2024-05-08T18:09:16.391 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.391 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1222 3.38 3:1f451ee1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.608041+0000", 2024-05-08T18:09:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.7669317939999996, 2024-05-08T18:09:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021806477000000001, 2024-05-08T18:09:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1222 2024-05-08T18:09:16.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.608041+0000", 2024-05-08T18:09:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.608041+0000", 2024-05-08T18:09:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.608046+0000", 2024-05-08T18:09:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2030000000000002e-06 2024-05-08T18:09:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610351+0000", 2024-05-08T18:09:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023056790000000001 2024-05-08T18:09:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610383+0000", 2024-05-08T18:09:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1677000000000002e-05 2024-05-08T18:09:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610403+0000", 2024-05-08T18:09:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0429999999999999e-05 2024-05-08T18:09:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610499+0000", 2024-05-08T18:09:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5328999999999995e-05 2024-05-08T18:09:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610642+0000", 2024-05-08T18:09:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000143373 2024-05-08T18:09:16.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610746+0000", 2024-05-08T18:09:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010428 2024-05-08T18:09:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.617351+0000", 2024-05-08T18:09:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066048000000000001 2024-05-08T18:09:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.629762+0000", 2024-05-08T18:09:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012410796 2024-05-08T18:09:16.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.629802+0000", 2024-05-08T18:09:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9650999999999997e-05 2024-05-08T18:09:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.629848+0000", 2024-05-08T18:09:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6258999999999999e-05 2024-05-08T18:09:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1232 3.b 3:d0ea1d30:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.783991+0000", 2024-05-08T18:09:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.5909823010000004, 2024-05-08T18:09:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016878918, 2024-05-08T18:09:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1232 2024-05-08T18:09:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.398 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.783991+0000", 2024-05-08T18:09:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.783991+0000", 2024-05-08T18:09:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.783993+0000", 2024-05-08T18:09:16.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0449999999999999e-06 2024-05-08T18:09:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.785899+0000", 2024-05-08T18:09:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019058230000000001 2024-05-08T18:09:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.785938+0000", 2024-05-08T18:09:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8810000000000003e-05 2024-05-08T18:09:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.785960+0000", 2024-05-08T18:09:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1849e-05 2024-05-08T18:09:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.786103+0000", 2024-05-08T18:09:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000143666 2024-05-08T18:09:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.786356+0000", 2024-05-08T18:09:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000252334 2024-05-08T18:09:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:16.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.786620+0000", 2024-05-08T18:09:16.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026423799999999997 2024-05-08T18:09:16.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:16.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.794453+0000", 2024-05-08T18:09:16.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0078336489999999998 2024-05-08T18:09:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.800709+0000", 2024-05-08T18:09:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062555429999999997 2024-05-08T18:09:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.800799+0000", 2024-05-08T18:09:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9648999999999995e-05 2024-05-08T18:09:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.800870+0000", 2024-05-08T18:09:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1311999999999998e-05 2024-05-08T18:09:16.403 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1237 3.24 3:2546570d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.888914+0000", 2024-05-08T18:09:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.486059096, 2024-05-08T18:09:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016803458, 2024-05-08T18:09:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.404 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1237 2024-05-08T18:09:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.888914+0000", 2024-05-08T18:09:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.888914+0000", 2024-05-08T18:09:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.888918+0000", 2024-05-08T18:09:16.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7440000000000001e-06 2024-05-08T18:09:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.892308+0000", 2024-05-08T18:09:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033900850000000001 2024-05-08T18:09:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.892352+0000", 2024-05-08T18:09:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3655999999999997e-05 2024-05-08T18:09:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.892372+0000", 2024-05-08T18:09:16.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0806999999999999e-05 2024-05-08T18:09:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.892513+0000", 2024-05-08T18:09:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014047199999999999 2024-05-08T18:09:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.892747+0000", 2024-05-08T18:09:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023400800000000001 2024-05-08T18:09:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:16.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.893034+0000", 2024-05-08T18:09:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000287235 2024-05-08T18:09:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.902149+0000", 2024-05-08T18:09:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0091146479999999995 2024-05-08T18:09:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.905505+0000", 2024-05-08T18:09:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003356267 2024-05-08T18:09:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.905593+0000", 2024-05-08T18:09:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7536999999999999e-05 2024-05-08T18:09:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.905718+0000", 2024-05-08T18:09:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012499899999999999 2024-05-08T18:09:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1251 3.24 3:26ab10c7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.438484+0000", 2024-05-08T18:09:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 7.9364888809999998, 2024-05-08T18:09:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017151849, 2024-05-08T18:09:16.409 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1251 2024-05-08T18:09:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.438484+0000", 2024-05-08T18:09:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.438484+0000", 2024-05-08T18:09:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.438488+0000", 2024-05-08T18:09:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8800000000000001e-06 2024-05-08T18:09:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.442993+0000", 2024-05-08T18:09:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045048939999999997 2024-05-08T18:09:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.443028+0000", 2024-05-08T18:09:16.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5157000000000002e-05 2024-05-08T18:09:16.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.443054+0000", 2024-05-08T18:09:16.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5542999999999999e-05 2024-05-08T18:09:16.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.443174+0000", 2024-05-08T18:09:16.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011989000000000001 2024-05-08T18:09:16.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.443390+0000", 2024-05-08T18:09:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000216102 2024-05-08T18:09:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.443602+0000", 2024-05-08T18:09:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000211821 2024-05-08T18:09:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.450484+0000", 2024-05-08T18:09:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0068825700000000002 2024-05-08T18:09:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:16.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.455508+0000", 2024-05-08T18:09:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050239250000000003 2024-05-08T18:09:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.455580+0000", 2024-05-08T18:09:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1711999999999994e-05 2024-05-08T18:09:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.455636+0000", 2024-05-08T18:09:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6354999999999998e-05 2024-05-08T18:09:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.414 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1275 3.33 3:ccdf9558:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:09.054484+0000", 2024-05-08T18:09:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 7.3204896699999997, 2024-05-08T18:09:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023576865999999998, 2024-05-08T18:09:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1275 2024-05-08T18:09:16.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.054484+0000", 2024-05-08T18:09:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.054484+0000", 2024-05-08T18:09:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.054488+0000", 2024-05-08T18:09:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6700000000000002e-06 2024-05-08T18:09:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.056730+0000", 2024-05-08T18:09:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022419359999999999 2024-05-08T18:09:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.056770+0000", 2024-05-08T18:09:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9632999999999998e-05 2024-05-08T18:09:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.056797+0000", 2024-05-08T18:09:16.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6999999999999999e-05 2024-05-08T18:09:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.056906+0000", 2024-05-08T18:09:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108767 2024-05-08T18:09:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.057107+0000", 2024-05-08T18:09:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020165299999999999 2024-05-08T18:09:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.057290+0000", 2024-05-08T18:09:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018288700000000001 2024-05-08T18:09:16.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.064104+0000", 2024-05-08T18:09:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006814095 2024-05-08T18:09:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.077966+0000", 2024-05-08T18:09:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013862129000000001 2024-05-08T18:09:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.078007+0000", 2024-05-08T18:09:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1072999999999998e-05 2024-05-08T18:09:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.078060+0000", 2024-05-08T18:09:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3022999999999997e-05 2024-05-08T18:09:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1279 3.8 3:10eb2ec6:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:09.121086+0000", 2024-05-08T18:09:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 7.253887368, 2024-05-08T18:09:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016445715, 2024-05-08T18:09:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.420 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1279 2024-05-08T18:09:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.121086+0000", 2024-05-08T18:09:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.121086+0000", 2024-05-08T18:09:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.121089+0000", 2024-05-08T18:09:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3830000000000001e-06 2024-05-08T18:09:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.123884+0000", 2024-05-08T18:09:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027943669999999999 2024-05-08T18:09:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.123913+0000", 2024-05-08T18:09:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9802e-05 2024-05-08T18:09:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.123932+0000", 2024-05-08T18:09:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9006000000000001e-05 2024-05-08T18:09:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.124017+0000", 2024-05-08T18:09:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4485000000000002e-05 2024-05-08T18:09:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.124190+0000", 2024-05-08T18:09:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017257700000000001 2024-05-08T18:09:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.124357+0000", 2024-05-08T18:09:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016776700000000001 2024-05-08T18:09:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.137379+0000", 2024-05-08T18:09:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013021326 2024-05-08T18:09:16.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.137406+0000", 2024-05-08T18:09:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7178999999999998e-05 2024-05-08T18:09:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.137465+0000", 2024-05-08T18:09:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8768999999999999e-05 2024-05-08T18:09:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.137532+0000", 2024-05-08T18:09:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7053999999999999e-05 2024-05-08T18:09:16.425 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1407 3.7 3:e339c0c4:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.904306+0000", 2024-05-08T18:09:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.4706677480000003, 2024-05-08T18:09:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021916637999999999, 2024-05-08T18:09:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:16.426 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1407 2024-05-08T18:09:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.904306+0000", 2024-05-08T18:09:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.904306+0000", 2024-05-08T18:09:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.904309+0000", 2024-05-08T18:09:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9660000000000001e-06 2024-05-08T18:09:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905531+0000", 2024-05-08T18:09:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012226750000000001 2024-05-08T18:09:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905553+0000", 2024-05-08T18:09:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2272e-05 2024-05-08T18:09:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905568+0000", 2024-05-08T18:09:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4328000000000001e-05 2024-05-08T18:09:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905654+0000", 2024-05-08T18:09:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6296000000000002e-05 2024-05-08T18:09:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905798+0000", 2024-05-08T18:09:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014352000000000001 2024-05-08T18:09:16.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:16.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905949+0000", 2024-05-08T18:09:16.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015134799999999999 2024-05-08T18:09:16.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:16.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.916810+0000", 2024-05-08T18:09:16.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010861243 2024-05-08T18:09:16.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:16.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.926149+0000", 2024-05-08T18:09:16.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0093391259999999997 2024-05-08T18:09:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.926190+0000", 2024-05-08T18:09:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0519000000000003e-05 2024-05-08T18:09:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.926222+0000", 2024-05-08T18:09:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2345000000000003e-05 2024-05-08T18:09:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1411 3.8 3:10d418f1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.949114+0000", 2024-05-08T18:09:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.4258596460000001, 2024-05-08T18:09:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017010580000000001, 2024-05-08T18:09:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1411 2024-05-08T18:09:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.949114+0000", 2024-05-08T18:09:16.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.949114+0000", 2024-05-08T18:09:16.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.949117+0000", 2024-05-08T18:09:16.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.095e-06 2024-05-08T18:09:16.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.950815+0000", 2024-05-08T18:09:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016983160000000001 2024-05-08T18:09:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.950842+0000", 2024-05-08T18:09:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6780000000000001e-05 2024-05-08T18:09:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.950856+0000", 2024-05-08T18:09:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4083999999999999e-05 2024-05-08T18:09:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.950941+0000", 2024-05-08T18:09:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5489999999999996e-05 2024-05-08T18:09:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.951114+0000", 2024-05-08T18:09:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172776 2024-05-08T18:09:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.951281+0000", 2024-05-08T18:09:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016665500000000001 2024-05-08T18:09:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:16.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.963884+0000", 2024-05-08T18:09:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012602868 2024-05-08T18:09:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.966047+0000", 2024-05-08T18:09:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021633469999999999 2024-05-08T18:09:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.966090+0000", 2024-05-08T18:09:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3344999999999999e-05 2024-05-08T18:09:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.966124+0000", 2024-05-08T18:09:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3824e-05 2024-05-08T18:09:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1427 3.7 3:e0863aef:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.433817+0000", 2024-05-08T18:09:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.9411559249999999, 2024-05-08T18:09:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022409645999999998, 2024-05-08T18:09:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:16.437 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1427 2024-05-08T18:09:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433817+0000", 2024-05-08T18:09:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433817+0000", 2024-05-08T18:09:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433820+0000", 2024-05-08T18:09:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5849999999999998e-06 2024-05-08T18:09:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.438932+0000", 2024-05-08T18:09:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051120439999999996 2024-05-08T18:09:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.438984+0000", 2024-05-08T18:09:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1972999999999999e-05 2024-05-08T18:09:16.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.439011+0000", 2024-05-08T18:09:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7453e-05 2024-05-08T18:09:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.439195+0000", 2024-05-08T18:09:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018336200000000001 2024-05-08T18:09:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.439613+0000", 2024-05-08T18:09:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041870399999999999 2024-05-08T18:09:16.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.440009+0000", 2024-05-08T18:09:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039599699999999998 2024-05-08T18:09:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.452565+0000", 2024-05-08T18:09:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012555199 2024-05-08T18:09:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.455999+0000", 2024-05-08T18:09:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034340299999999998 2024-05-08T18:09:16.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.456104+0000", 2024-05-08T18:09:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105586 2024-05-08T18:09:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.456227+0000", 2024-05-08T18:09:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012271299999999999 2024-05-08T18:09:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1433 3.29 3:97d7b3d1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.543266+0000", 2024-05-08T18:09:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.8317075219999999, 2024-05-08T18:09:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019647787999999999, 2024-05-08T18:09:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1433 2024-05-08T18:09:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.543266+0000", 2024-05-08T18:09:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.543266+0000", 2024-05-08T18:09:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.543269+0000", 2024-05-08T18:09:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4429999999999999e-06 2024-05-08T18:09:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.546262+0000", 2024-05-08T18:09:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029928540000000001 2024-05-08T18:09:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.546301+0000", 2024-05-08T18:09:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9005999999999999e-05 2024-05-08T18:09:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.546326+0000", 2024-05-08T18:09:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5014000000000001e-05 2024-05-08T18:09:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.546440+0000", 2024-05-08T18:09:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011402 2024-05-08T18:09:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.546646+0000", 2024-05-08T18:09:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206064 2024-05-08T18:09:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.546852+0000", 2024-05-08T18:09:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206207 2024-05-08T18:09:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:16.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.554604+0000", 2024-05-08T18:09:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0077520419999999998 2024-05-08T18:09:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.562703+0000", 2024-05-08T18:09:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0080987999999999997 2024-05-08T18:09:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.562796+0000", 2024-05-08T18:09:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2968999999999997e-05 2024-05-08T18:09:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.562914+0000", 2024-05-08T18:09:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011736899999999999 2024-05-08T18:09:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1445 3.2 3:42324995:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.811460+0000", 2024-05-08T18:09:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.5635132810000001, 2024-05-08T18:09:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01999664, 2024-05-08T18:09:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:16.448 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1445 2024-05-08T18:09:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.811460+0000", 2024-05-08T18:09:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.811460+0000", 2024-05-08T18:09:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.811465+0000", 2024-05-08T18:09:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4569999999999996e-06 2024-05-08T18:09:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.814389+0000", 2024-05-08T18:09:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002923471 2024-05-08T18:09:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.814434+0000", 2024-05-08T18:09:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4687000000000001e-05 2024-05-08T18:09:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.814462+0000", 2024-05-08T18:09:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8252999999999999e-05 2024-05-08T18:09:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.814599+0000", 2024-05-08T18:09:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013708899999999999 2024-05-08T18:09:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.814862+0000", 2024-05-08T18:09:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000263186 2024-05-08T18:09:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.815111+0000", 2024-05-08T18:09:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024844999999999999 2024-05-08T18:09:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.822832+0000", 2024-05-08T18:09:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007721182 2024-05-08T18:09:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.831286+0000", 2024-05-08T18:09:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008454006 2024-05-08T18:09:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.831385+0000", 2024-05-08T18:09:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9155999999999997e-05 2024-05-08T18:09:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.831457+0000", 2024-05-08T18:09:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1703000000000001e-05 2024-05-08T18:09:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1446 3.22 e87/20 3:44011652:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_24:head v 87'3, mlcod=86'1)", 2024-05-08T18:09:16.453 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.885194+0000", 2024-05-08T18:09:16.454 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.4897795829999998, 2024-05-08T18:09:16.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018072358, 2024-05-08T18:09:16.454 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.454 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.454 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.454 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.885194+0000", 2024-05-08T18:09:16.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.885194+0000", 2024-05-08T18:09:16.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.885197+0000", 2024-05-08T18:09:16.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2370000000000001e-06 2024-05-08T18:09:16.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.890529+0000", 2024-05-08T18:09:16.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053323160000000001 2024-05-08T18:09:16.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.890573+0000", 2024-05-08T18:09:16.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4122999999999998e-05 2024-05-08T18:09:16.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.890592+0000", 2024-05-08T18:09:16.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8793000000000001e-05 2024-05-08T18:09:16.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.890748+0000", 2024-05-08T18:09:16.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015541900000000001 2024-05-08T18:09:16.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.890795+0000", 2024-05-08T18:09:16.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7655999999999999e-05 2024-05-08T18:09:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.903141+0000", 2024-05-08T18:09:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012345431 2024-05-08T18:09:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.903266+0000", 2024-05-08T18:09:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012538299999999999 2024-05-08T18:09:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1448 3.15 e87/20 3:a83ea02a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.9:head v 87'5, mlcod=86'3)", 2024-05-08T18:09:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.912785+0000", 2024-05-08T18:09:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.4621878779999999, 2024-05-08T18:09:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016470657, 2024-05-08T18:09:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.912785+0000", 2024-05-08T18:09:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.912785+0000", 2024-05-08T18:09:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.912788+0000", 2024-05-08T18:09:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4899999999999999e-06 2024-05-08T18:09:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.917727+0000", 2024-05-08T18:09:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049389259999999997 2024-05-08T18:09:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.917767+0000", 2024-05-08T18:09:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0092999999999997e-05 2024-05-08T18:09:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.917785+0000", 2024-05-08T18:09:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7880000000000002e-05 2024-05-08T18:09:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.917949+0000", 2024-05-08T18:09:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016377899999999999 2024-05-08T18:09:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.918018+0000", 2024-05-08T18:09:16.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9453000000000001e-05 2024-05-08T18:09:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.929132+0000", 2024-05-08T18:09:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01111353 2024-05-08T18:09:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.929256+0000", 2024-05-08T18:09:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000124506 2024-05-08T18:09:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1452 3.18 3:1a3be52d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.322360+0000", 2024-05-08T18:09:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.0526135449999998, 2024-05-08T18:09:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026904399999999998, 2024-05-08T18:09:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1452 2024-05-08T18:09:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.462 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.322360+0000", 2024-05-08T18:09:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.322360+0000", 2024-05-08T18:09:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.322365+0000", 2024-05-08T18:09:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9830000000000004e-06 2024-05-08T18:09:16.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.326727+0000", 2024-05-08T18:09:16.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043627140000000002 2024-05-08T18:09:16.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.326769+0000", 2024-05-08T18:09:16.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1221999999999999e-05 2024-05-08T18:09:16.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.326788+0000", 2024-05-08T18:09:16.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9332999999999999e-05 2024-05-08T18:09:16.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.326963+0000", 2024-05-08T18:09:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017518899999999999 2024-05-08T18:09:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.327368+0000", 2024-05-08T18:09:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040489699999999998 2024-05-08T18:09:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.327794+0000", 2024-05-08T18:09:16.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042616699999999997 2024-05-08T18:09:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.346272+0000", 2024-05-08T18:09:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018477413000000002 2024-05-08T18:09:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.349007+0000", 2024-05-08T18:09:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027350370000000001 2024-05-08T18:09:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.349131+0000", 2024-05-08T18:09:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012433299999999999 2024-05-08T18:09:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.349264+0000", 2024-05-08T18:09:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013311200000000001 2024-05-08T18:09:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1456 3.24 3:24a554b4:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.405374+0000", 2024-05-08T18:09:16.467 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.9695992580000001, 2024-05-08T18:09:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018770948999999999, 2024-05-08T18:09:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1456 2024-05-08T18:09:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.405374+0000", 2024-05-08T18:09:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.405374+0000", 2024-05-08T18:09:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.405379+0000", 2024-05-08T18:09:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7199999999999997e-06 2024-05-08T18:09:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.408654+0000", 2024-05-08T18:09:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032756220000000002 2024-05-08T18:09:16.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.408698+0000", 2024-05-08T18:09:16.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3479999999999997e-05 2024-05-08T18:09:16.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.408725+0000", 2024-05-08T18:09:16.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7489000000000001e-05 2024-05-08T18:09:16.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.408852+0000", 2024-05-08T18:09:16.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000126952 2024-05-08T18:09:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.409094+0000", 2024-05-08T18:09:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024205799999999999 2024-05-08T18:09:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.409307+0000", 2024-05-08T18:09:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021304000000000001 2024-05-08T18:09:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:16.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.417662+0000", 2024-05-08T18:09:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083550470000000009 2024-05-08T18:09:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.423926+0000", 2024-05-08T18:09:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062631220000000003 2024-05-08T18:09:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.424020+0000", 2024-05-08T18:09:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4016000000000002e-05 2024-05-08T18:09:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.424145+0000", 2024-05-08T18:09:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012540300000000001 2024-05-08T18:09:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1459 3.25 e87/20 3:a5b1b07d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_9:head v 87'3, mlcod=85'1)", 2024-05-08T18:09:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.481986+0000", 2024-05-08T18:09:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 2.8929875369999998, 2024-05-08T18:09:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019426586999999999, 2024-05-08T18:09:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:16.473 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481986+0000", 2024-05-08T18:09:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481986+0000", 2024-05-08T18:09:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481988+0000", 2024-05-08T18:09:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6469999999999998e-06 2024-05-08T18:09:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.484892+0000", 2024-05-08T18:09:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029039489999999999 2024-05-08T18:09:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.484942+0000", 2024-05-08T18:09:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9515999999999998e-05 2024-05-08T18:09:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.484968+0000", 2024-05-08T18:09:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5724e-05 2024-05-08T18:09:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.485136+0000", 2024-05-08T18:09:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016837800000000001 2024-05-08T18:09:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.485204+0000", 2024-05-08T18:09:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8182999999999994e-05 2024-05-08T18:09:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.501300+0000", 2024-05-08T18:09:16.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016095841 2024-05-08T18:09:16.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:16.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:16.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:16.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.501412+0000", 2024-05-08T18:09:16.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112349 2024-05-08T18:09:16.477 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.477 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.477 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.477 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:16.477 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:16.477 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:16.479 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:09:16.479 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:16.477+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:16.579 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:16.577+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:16.611 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:16.611 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:16.611 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:16.611 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:16.626 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:09:16.712 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:16.713+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:16.772 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:09:16.790 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:16.790 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:16.790 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:16.790 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:16.790 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:16.804 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:09:16.818 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:16.820+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:16.881 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:16.880+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:16.976 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:09:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:09:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 115.443218622, 2024-05-08T18:09:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018560765, 2024-05-08T18:09:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:09:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 43 2024-05-08T18:09:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:09:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:09:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530217+0000", 2024-05-08T18:09:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:09:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530253+0000", 2024-05-08T18:09:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5621999999999999e-05 2024-05-08T18:09:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530288+0000", 2024-05-08T18:09:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5846999999999997e-05 2024-05-08T18:09:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530314+0000", 2024-05-08T18:09:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5732e-05 2024-05-08T18:09:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530952+0000", 2024-05-08T18:09:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00063739999999999999 2024-05-08T18:09:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530977+0000", 2024-05-08T18:09:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5375e-05 2024-05-08T18:09:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548506+0000", 2024-05-08T18:09:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017528781 2024-05-08T18:09:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548774+0000", 2024-05-08T18:09:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026821199999999999 2024-05-08T18:09:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1190 3.31 e85/20 3:8c795880:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_2:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.973668+0000", 2024-05-08T18:09:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.9997637230000009, 2024-05-08T18:09:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021568941000000001, 2024-05-08T18:09:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.973668+0000", 2024-05-08T18:09:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.973668+0000", 2024-05-08T18:09:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.973671+0000", 2024-05-08T18:09:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2100000000000002e-06 2024-05-08T18:09:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.980815+0000", 2024-05-08T18:09:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071441860000000003 2024-05-08T18:09:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.980858+0000", 2024-05-08T18:09:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2852000000000002e-05 2024-05-08T18:09:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.980879+0000", 2024-05-08T18:09:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.107e-05 2024-05-08T18:09:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981093+0000", 2024-05-08T18:09:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000213857 2024-05-08T18:09:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981135+0000", 2024-05-08T18:09:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2249999999999997e-05 2024-05-08T18:09:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.995097+0000", 2024-05-08T18:09:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013961295 2024-05-08T18:09:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.995237+0000", 2024-05-08T18:09:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140221 2024-05-08T18:09:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1191 3.1d e85/20 3:b81eb771:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_3:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.989442+0000", 2024-05-08T18:09:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.9839893059999998, 2024-05-08T18:09:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020798275000000001, 2024-05-08T18:09:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989442+0000", 2024-05-08T18:09:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989442+0000", 2024-05-08T18:09:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989443+0000", 2024-05-08T18:09:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-05-08T18:09:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994630+0000", 2024-05-08T18:09:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051867930000000003 2024-05-08T18:09:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994663+0000", 2024-05-08T18:09:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3272000000000003e-05 2024-05-08T18:09:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994680+0000", 2024-05-08T18:09:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7266999999999999e-05 2024-05-08T18:09:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994795+0000", 2024-05-08T18:09:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011437799999999999 2024-05-08T18:09:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994836+0000", 2024-05-08T18:09:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0686000000000003e-05 2024-05-08T18:09:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010110+0000", 2024-05-08T18:09:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015274081 2024-05-08T18:09:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010241+0000", 2024-05-08T18:09:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013107099999999999 2024-05-08T18:09:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1196 3.9 3:91f0c251:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.036686+0000", 2024-05-08T18:09:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.9367455010000008, 2024-05-08T18:09:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019572662000000001, 2024-05-08T18:09:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1196 2024-05-08T18:09:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.036686+0000", 2024-05-08T18:09:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.036686+0000", 2024-05-08T18:09:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.036691+0000", 2024-05-08T18:09:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8099999999999997e-06 2024-05-08T18:09:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041369+0000", 2024-05-08T18:09:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046777590000000001 2024-05-08T18:09:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041413+0000", 2024-05-08T18:09:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4297e-05 2024-05-08T18:09:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041443+0000", 2024-05-08T18:09:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9635999999999999e-05 2024-05-08T18:09:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041588+0000", 2024-05-08T18:09:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014564100000000001 2024-05-08T18:09:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041833+0000", 2024-05-08T18:09:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000244777 2024-05-08T18:09:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.042054+0000", 2024-05-08T18:09:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022125399999999999 2024-05-08T18:09:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.051316+0000", 2024-05-08T18:09:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092614059999999998 2024-05-08T18:09:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056067+0000", 2024-05-08T18:09:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047512639999999998 2024-05-08T18:09:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056171+0000", 2024-05-08T18:09:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010425900000000001 2024-05-08T18:09:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056259+0000", 2024-05-08T18:09:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7559000000000007e-05 2024-05-08T18:09:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1199 3.14 3:29bdf593:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.067940+0000", 2024-05-08T18:09:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.9054919760000004, 2024-05-08T18:09:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018983427000000001, 2024-05-08T18:09:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1199 2024-05-08T18:09:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.067940+0000", 2024-05-08T18:09:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.067940+0000", 2024-05-08T18:09:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.067943+0000", 2024-05-08T18:09:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6370000000000001e-06 2024-05-08T18:09:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.071968+0000", 2024-05-08T18:09:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040243120000000004 2024-05-08T18:09:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072006+0000", 2024-05-08T18:09:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8628999999999999e-05 2024-05-08T18:09:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072029+0000", 2024-05-08T18:09:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2972999999999998e-05 2024-05-08T18:09:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072160+0000", 2024-05-08T18:09:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013025100000000001 2024-05-08T18:09:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072398+0000", 2024-05-08T18:09:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023832399999999999 2024-05-08T18:09:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072617+0000", 2024-05-08T18:09:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021892999999999999 2024-05-08T18:09:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.081906+0000", 2024-05-08T18:09:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092895919999999993 2024-05-08T18:09:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.086685+0000", 2024-05-08T18:09:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047783019999999999 2024-05-08T18:09:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.086794+0000", 2024-05-08T18:09:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010940100000000001 2024-05-08T18:09:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.086923+0000", 2024-05-08T18:09:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000129076 2024-05-08T18:09:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1202 3.14 3:2a8c8569:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.100310+0000", 2024-05-08T18:09:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8731218900000002, 2024-05-08T18:09:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030670528999999998, 2024-05-08T18:09:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1202 2024-05-08T18:09:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.100310+0000", 2024-05-08T18:09:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.100310+0000", 2024-05-08T18:09:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.100352+0000", 2024-05-08T18:09:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2315999999999999e-05 2024-05-08T18:09:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.105824+0000", 2024-05-08T18:09:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054720649999999999 2024-05-08T18:09:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.105863+0000", 2024-05-08T18:09:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8649000000000002e-05 2024-05-08T18:09:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.105883+0000", 2024-05-08T18:09:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0383000000000001e-05 2024-05-08T18:09:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106019+0000", 2024-05-08T18:09:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013552200000000001 2024-05-08T18:09:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106318+0000", 2024-05-08T18:09:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029913900000000002 2024-05-08T18:09:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106586+0000", 2024-05-08T18:09:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026771299999999999 2024-05-08T18:09:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.128110+0000", 2024-05-08T18:09:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021524155 2024-05-08T18:09:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130655+0000", 2024-05-08T18:09:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025453960000000001 2024-05-08T18:09:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130831+0000", 2024-05-08T18:09:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017583400000000001 2024-05-08T18:09:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130980+0000", 2024-05-08T18:09:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149357 2024-05-08T18:09:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1203 3.1a 3:592e440d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.110063+0000", 2024-05-08T18:09:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8633682799999995, 2024-05-08T18:09:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023166567999999998, 2024-05-08T18:09:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1203 2024-05-08T18:09:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110063+0000", 2024-05-08T18:09:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110063+0000", 2024-05-08T18:09:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110067+0000", 2024-05-08T18:09:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3629999999999998e-06 2024-05-08T18:09:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114611+0000", 2024-05-08T18:09:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00454375 2024-05-08T18:09:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114653+0000", 2024-05-08T18:09:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2549999999999997e-05 2024-05-08T18:09:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114681+0000", 2024-05-08T18:09:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7878999999999999e-05 2024-05-08T18:09:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114872+0000", 2024-05-08T18:09:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019109500000000001 2024-05-08T18:09:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.115275+0000", 2024-05-08T18:09:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040327700000000001 2024-05-08T18:09:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.115636+0000", 2024-05-08T18:09:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036014899999999998 2024-05-08T18:09:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.129938+0000", 2024-05-08T18:09:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014302848 2024-05-08T18:09:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.133055+0000", 2024-05-08T18:09:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00311699 2024-05-08T18:09:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.133159+0000", 2024-05-08T18:09:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103138 2024-05-08T18:09:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.133230+0000", 2024-05-08T18:09:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1528999999999999e-05 2024-05-08T18:09:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1211 3.3 3:c13935f4:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.195183+0000", 2024-05-08T18:09:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.7782482819999998, 2024-05-08T18:09:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.026007971000000001, 2024-05-08T18:09:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1211 2024-05-08T18:09:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.195183+0000", 2024-05-08T18:09:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.195183+0000", 2024-05-08T18:09:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.195187+0000", 2024-05-08T18:09:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6540000000000001e-06 2024-05-08T18:09:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199150+0000", 2024-05-08T18:09:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039627719999999998 2024-05-08T18:09:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199188+0000", 2024-05-08T18:09:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195999999999998e-05 2024-05-08T18:09:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199210+0000", 2024-05-08T18:09:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2027000000000001e-05 2024-05-08T18:09:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199356+0000", 2024-05-08T18:09:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014612800000000001 2024-05-08T18:09:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199622+0000", 2024-05-08T18:09:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026600199999999999 2024-05-08T18:09:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199846+0000", 2024-05-08T18:09:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022389099999999999 2024-05-08T18:09:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.213755+0000", 2024-05-08T18:09:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013908536000000001 2024-05-08T18:09:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.221024+0000", 2024-05-08T18:09:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0072690439999999997 2024-05-08T18:09:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.221110+0000", 2024-05-08T18:09:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6008999999999996e-05 2024-05-08T18:09:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.221191+0000", 2024-05-08T18:09:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1712000000000006e-05 2024-05-08T18:09:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1214 3.9 3:92ca5236:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.1:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.223783+0000", 2024-05-08T18:09:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.7496488170000006, 2024-05-08T18:09:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018427163999999999, 2024-05-08T18:09:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1214 2024-05-08T18:09:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.223783+0000", 2024-05-08T18:09:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.223783+0000", 2024-05-08T18:09:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.223786+0000", 2024-05-08T18:09:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8030000000000001e-06 2024-05-08T18:09:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.227730+0000", 2024-05-08T18:09:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039442430000000001 2024-05-08T18:09:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.227766+0000", 2024-05-08T18:09:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5571999999999998e-05 2024-05-08T18:09:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.227785+0000", 2024-05-08T18:09:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9170000000000001e-05 2024-05-08T18:09:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.227954+0000", 2024-05-08T18:09:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016892200000000001 2024-05-08T18:09:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.228373+0000", 2024-05-08T18:09:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000419417 2024-05-08T18:09:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.229595+0000", 2024-05-08T18:09:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012215730000000001 2024-05-08T18:09:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.239966+0000", 2024-05-08T18:09:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010371225 2024-05-08T18:09:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.241761+0000", 2024-05-08T18:09:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001795458 2024-05-08T18:09:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.242067+0000", 2024-05-08T18:09:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030554600000000002 2024-05-08T18:09:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.242210+0000", 2024-05-08T18:09:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014323499999999999 2024-05-08T18:09:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1224 3.13 e85/20 3:c82cef46:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_8:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.644014+0000", 2024-05-08T18:09:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.3294178750000007, 2024-05-08T18:09:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019705998999999998, 2024-05-08T18:09:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.644014+0000", 2024-05-08T18:09:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.644014+0000", 2024-05-08T18:09:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.644018+0000", 2024-05-08T18:09:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6500000000000002e-06 2024-05-08T18:09:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651361+0000", 2024-05-08T18:09:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073436789999999997 2024-05-08T18:09:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651411+0000", 2024-05-08T18:09:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9613000000000001e-05 2024-05-08T18:09:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651438+0000", 2024-05-08T18:09:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6699e-05 2024-05-08T18:09:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651567+0000", 2024-05-08T18:09:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012993299999999999 2024-05-08T18:09:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651601+0000", 2024-05-08T18:09:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3268000000000001e-05 2024-05-08T18:09:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663646+0000", 2024-05-08T18:09:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012045451 2024-05-08T18:09:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663720+0000", 2024-05-08T18:09:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3706000000000002e-05 2024-05-08T18:09:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1226 3.3 3:c18beed9:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.668709+0000", 2024-05-08T18:09:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.3047224199999992, 2024-05-08T18:09:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020071530000000001, 2024-05-08T18:09:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1226 2024-05-08T18:09:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.668709+0000", 2024-05-08T18:09:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.668709+0000", 2024-05-08T18:09:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.668717+0000", 2024-05-08T18:09:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7100000000000007e-06 2024-05-08T18:09:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672764+0000", 2024-05-08T18:09:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040465630000000004 2024-05-08T18:09:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672791+0000", 2024-05-08T18:09:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7636000000000001e-05 2024-05-08T18:09:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672804+0000", 2024-05-08T18:09:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3009e-05 2024-05-08T18:09:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672905+0000", 2024-05-08T18:09:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010105100000000001 2024-05-08T18:09:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.673113+0000", 2024-05-08T18:09:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000207405 2024-05-08T18:09:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.673300+0000", 2024-05-08T18:09:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000186875 2024-05-08T18:09:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.682552+0000", 2024-05-08T18:09:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092519690000000005 2024-05-08T18:09:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.688655+0000", 2024-05-08T18:09:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061032300000000003 2024-05-08T18:09:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.688723+0000", 2024-05-08T18:09:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8263999999999996e-05 2024-05-08T18:09:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.688781+0000", 2024-05-08T18:09:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7818000000000001e-05 2024-05-08T18:09:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1397 3.34 3:2c6418f0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.790046+0000", 2024-05-08T18:09:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1833854490000002, 2024-05-08T18:09:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035561055000000001, 2024-05-08T18:09:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1397 2024-05-08T18:09:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.790046+0000", 2024-05-08T18:09:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.790046+0000", 2024-05-08T18:09:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.790051+0000", 2024-05-08T18:09:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.51e-06 2024-05-08T18:09:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795411+0000", 2024-05-08T18:09:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0053598880000000002 2024-05-08T18:09:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795450+0000", 2024-05-08T18:09:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9555999999999999e-05 2024-05-08T18:09:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795470+0000", 2024-05-08T18:09:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9644e-05 2024-05-08T18:09:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795648+0000", 2024-05-08T18:09:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017859000000000001 2024-05-08T18:09:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795661+0000", 2024-05-08T18:09:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2116999999999999e-05 2024-05-08T18:09:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.801909+0000", 2024-05-08T18:09:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0062485969999999998 2024-05-08T18:09:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802123+0000", 2024-05-08T18:09:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021390100000000001 2024-05-08T18:09:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802378+0000", 2024-05-08T18:09:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025494999999999999 2024-05-08T18:09:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822891+0000", 2024-05-08T18:09:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020513432000000002 2024-05-08T18:09:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825434+0000", 2024-05-08T18:09:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025423279999999999 2024-05-08T18:09:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825533+0000", 2024-05-08T18:09:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9302999999999994e-05 2024-05-08T18:09:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825607+0000", 2024-05-08T18:09:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4239000000000005e-05 2024-05-08T18:09:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1399 3.2c e87/20 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head v 87'3, mlcod=85'1)", 2024-05-08T18:09:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.825958+0000", 2024-05-08T18:09:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1474741560000004, 2024-05-08T18:09:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023463491, 2024-05-08T18:09:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825958+0000", 2024-05-08T18:09:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825958+0000", 2024-05-08T18:09:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825959+0000", 2024-05-08T18:09:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.68e-06 2024-05-08T18:09:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829465+0000", 2024-05-08T18:09:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003505949 2024-05-08T18:09:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829510+0000", 2024-05-08T18:09:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4446000000000001e-05 2024-05-08T18:09:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829529+0000", 2024-05-08T18:09:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9242999999999999e-05 2024-05-08T18:09:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829699+0000", 2024-05-08T18:09:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017010500000000001 2024-05-08T18:09:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829767+0000", 2024-05-08T18:09:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8422000000000003e-05 2024-05-08T18:09:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849237+0000", 2024-05-08T18:09:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019469113999999999 2024-05-08T18:09:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849421+0000", 2024-05-08T18:09:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000184532 2024-05-08T18:09:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1413 3.9 3:915363b3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.966164+0000", 2024-05-08T18:09:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.0072677360000002, 2024-05-08T18:09:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024879884000000001, 2024-05-08T18:09:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1413 2024-05-08T18:09:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.966164+0000", 2024-05-08T18:09:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.966164+0000", 2024-05-08T18:09:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.966168+0000", 2024-05-08T18:09:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0570000000000003e-06 2024-05-08T18:09:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.974319+0000", 2024-05-08T18:09:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0081509930000000005 2024-05-08T18:09:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.974388+0000", 2024-05-08T18:09:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9326000000000007e-05 2024-05-08T18:09:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.974418+0000", 2024-05-08T18:09:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9519e-05 2024-05-08T18:09:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.974598+0000", 2024-05-08T18:09:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017978199999999999 2024-05-08T18:09:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.975002+0000", 2024-05-08T18:09:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000404268 2024-05-08T18:09:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.975430+0000", 2024-05-08T18:09:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042801100000000001 2024-05-08T18:09:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.988165+0000", 2024-05-08T18:09:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012734568 2024-05-08T18:09:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.990873+0000", 2024-05-08T18:09:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027083559999999999 2024-05-08T18:09:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.990975+0000", 2024-05-08T18:09:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101751 2024-05-08T18:09:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.991044+0000", 2024-05-08T18:09:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9252999999999996e-05 2024-05-08T18:09:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1416 3.2c e87/20 3:345ebd70:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_22:head v 87'4, mlcod=85'2)", 2024-05-08T18:09:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.001257+0000", 2024-05-08T18:09:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.9721747250000004, 2024-05-08T18:09:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022070702000000001, 2024-05-08T18:09:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.001257+0000", 2024-05-08T18:09:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.001257+0000", 2024-05-08T18:09:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.001259+0000", 2024-05-08T18:09:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1859999999999999e-06 2024-05-08T18:09:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004209+0000", 2024-05-08T18:09:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029502690000000002 2024-05-08T18:09:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004244+0000", 2024-05-08T18:09:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999998e-05 2024-05-08T18:09:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004261+0000", 2024-05-08T18:09:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6969999999999998e-05 2024-05-08T18:09:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004412+0000", 2024-05-08T18:09:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015088800000000001 2024-05-08T18:09:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004454+0000", 2024-05-08T18:09:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2076000000000002e-05 2024-05-08T18:09:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023211+0000", 2024-05-08T18:09:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018757424000000002 2024-05-08T18:09:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023328+0000", 2024-05-08T18:09:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116519 2024-05-08T18:09:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1420 3.e e87/20 3:72accb8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.8:head v 87'1, mlcod=0'0)", 2024-05-08T18:09:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.041386+0000", 2024-05-08T18:09:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.9320460160000001, 2024-05-08T18:09:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019066611000000001, 2024-05-08T18:09:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.041386+0000", 2024-05-08T18:09:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.041386+0000", 2024-05-08T18:09:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.041387+0000", 2024-05-08T18:09:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8700000000000005e-07 2024-05-08T18:09:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.045795+0000", 2024-05-08T18:09:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044083300000000002 2024-05-08T18:09:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.045834+0000", 2024-05-08T18:09:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8763000000000001e-05 2024-05-08T18:09:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.045853+0000", 2024-05-08T18:09:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9453000000000002e-05 2024-05-08T18:09:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.046025+0000", 2024-05-08T18:09:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017146800000000001 2024-05-08T18:09:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.046085+0000", 2024-05-08T18:09:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0556000000000001e-05 2024-05-08T18:09:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060332+0000", 2024-05-08T18:09:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014246801999999999 2024-05-08T18:09:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060452+0000", 2024-05-08T18:09:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120452 2024-05-08T18:09:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1426 3.3 3:c1fceb03:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.418434+0000", 2024-05-08T18:09:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.5549975939999996, 2024-05-08T18:09:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.026406447, 2024-05-08T18:09:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1426 2024-05-08T18:09:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.418434+0000", 2024-05-08T18:09:17.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.418434+0000", 2024-05-08T18:09:17.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.418437+0000", 2024-05-08T18:09:17.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.751e-06 2024-05-08T18:09:17.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.422567+0000", 2024-05-08T18:09:17.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041297199999999999 2024-05-08T18:09:17.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.422602+0000", 2024-05-08T18:09:17.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4898999999999999e-05 2024-05-08T18:09:17.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.422623+0000", 2024-05-08T18:09:17.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1203e-05 2024-05-08T18:09:17.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.422783+0000", 2024-05-08T18:09:17.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016033200000000001 2024-05-08T18:09:17.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.423045+0000", 2024-05-08T18:09:17.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026236199999999998 2024-05-08T18:09:17.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:17.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.423283+0000", 2024-05-08T18:09:17.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023804100000000001 2024-05-08T18:09:17.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.432169+0000", 2024-05-08T18:09:17.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0088858730000000007 2024-05-08T18:09:17.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.444662+0000", 2024-05-08T18:09:17.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012492411 2024-05-08T18:09:17.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.444765+0000", 2024-05-08T18:09:17.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103183 2024-05-08T18:09:17.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.444841+0000", 2024-05-08T18:09:17.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5672000000000003e-05 2024-05-08T18:09:17.067 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.067 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.067 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.067 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1431 3.3 3:c36c40c5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:17.067 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.506262+0000", 2024-05-08T18:09:17.067 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.4671700789999997, 2024-05-08T18:09:17.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022453905, 2024-05-08T18:09:17.068 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.068 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.068 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.068 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.068 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.068 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.068 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1431 2024-05-08T18:09:17.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.068 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.506262+0000", 2024-05-08T18:09:17.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.506262+0000", 2024-05-08T18:09:17.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.506263+0000", 2024-05-08T18:09:17.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.748e-06 2024-05-08T18:09:17.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.509983+0000", 2024-05-08T18:09:17.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037198740000000002 2024-05-08T18:09:17.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510006+0000", 2024-05-08T18:09:17.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2269999999999999e-05 2024-05-08T18:09:17.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510015+0000", 2024-05-08T18:09:17.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6579999999999997e-06 2024-05-08T18:09:17.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510105+0000", 2024-05-08T18:09:17.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9435e-05 2024-05-08T18:09:17.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510321+0000", 2024-05-08T18:09:17.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021608700000000001 2024-05-08T18:09:17.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:17.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510566+0000", 2024-05-08T18:09:17.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024504600000000001 2024-05-08T18:09:17.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.518436+0000", 2024-05-08T18:09:17.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078703409999999994 2024-05-08T18:09:17.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.528584+0000", 2024-05-08T18:09:17.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01014817 2024-05-08T18:09:17.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.528659+0000", 2024-05-08T18:09:17.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4328999999999999e-05 2024-05-08T18:09:17.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.528716+0000", 2024-05-08T18:09:17.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6947000000000002e-05 2024-05-08T18:09:17.073 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.073 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.073 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.073 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1454 3.1a 3:5820ba98:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:17.073 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.364586+0000", 2024-05-08T18:09:17.073 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 3.6088456849999999, 2024-05-08T18:09:17.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030504185999999999, 2024-05-08T18:09:17.073 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.073 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.073 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.074 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.074 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.074 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.074 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1454 2024-05-08T18:09:17.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.074 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.364586+0000", 2024-05-08T18:09:17.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.364586+0000", 2024-05-08T18:09:17.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.364589+0000", 2024-05-08T18:09:17.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.74e-06 2024-05-08T18:09:17.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369474+0000", 2024-05-08T18:09:17.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004885375 2024-05-08T18:09:17.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369507+0000", 2024-05-08T18:09:17.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2591e-05 2024-05-08T18:09:17.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369522+0000", 2024-05-08T18:09:17.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4997000000000001e-05 2024-05-08T18:09:17.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369610+0000", 2024-05-08T18:09:17.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8478000000000002e-05 2024-05-08T18:09:17.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369759+0000", 2024-05-08T18:09:17.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014915100000000001 2024-05-08T18:09:17.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:17.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369895+0000", 2024-05-08T18:09:17.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013564299999999999 2024-05-08T18:09:17.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.376823+0000", 2024-05-08T18:09:17.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069279820000000001 2024-05-08T18:09:17.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.394937+0000", 2024-05-08T18:09:17.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018114213000000001 2024-05-08T18:09:17.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.395021+0000", 2024-05-08T18:09:17.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3502000000000001e-05 2024-05-08T18:09:17.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.395090+0000", 2024-05-08T18:09:17.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9513999999999999e-05 2024-05-08T18:09:17.078 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.078 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.078 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.079 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1457 3.3 3:c3a85ed6:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:17.079 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.425710+0000", 2024-05-08T18:09:17.079 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 3.5477215989999999, 2024-05-08T18:09:17.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019518522, 2024-05-08T18:09:17.079 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.079 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.079 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.079 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.079 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.079 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.079 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1457 2024-05-08T18:09:17.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.079 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.425710+0000", 2024-05-08T18:09:17.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.425710+0000", 2024-05-08T18:09:17.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.425713+0000", 2024-05-08T18:09:17.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0900000000000001e-06 2024-05-08T18:09:17.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.429635+0000", 2024-05-08T18:09:17.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003921707 2024-05-08T18:09:17.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.429672+0000", 2024-05-08T18:09:17.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7552999999999998e-05 2024-05-08T18:09:17.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.429691+0000", 2024-05-08T18:09:17.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8936999999999998e-05 2024-05-08T18:09:17.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.429812+0000", 2024-05-08T18:09:17.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120865 2024-05-08T18:09:17.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.430073+0000", 2024-05-08T18:09:17.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000260573 2024-05-08T18:09:17.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:17.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.430309+0000", 2024-05-08T18:09:17.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023625100000000001 2024-05-08T18:09:17.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.439295+0000", 2024-05-08T18:09:17.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0089855349999999994 2024-05-08T18:09:17.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.445049+0000", 2024-05-08T18:09:17.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0057544299999999996 2024-05-08T18:09:17.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.445151+0000", 2024-05-08T18:09:17.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010235599999999999 2024-05-08T18:09:17.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.445229+0000", 2024-05-08T18:09:17.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7224999999999993e-05 2024-05-08T18:09:17.084 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.084 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.084 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.084 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.084 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.084 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:17.086 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:09:17.086 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:17.088+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:17.187 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:17.185+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:17.212 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:17.212 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:17.212 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:17.212 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:17.228 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:09:17.288 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:17.288+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:17.389 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:17.388+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:17.393 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:17.393 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:17.394 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:17.394 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:17.394 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:17.410 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:09:17.490 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:17.492+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:17.549 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:17.549 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:17.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:17.549 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:17.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.549 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1191 3.1d 3:b81eb771:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:17.549 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:17.549 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.565781230000001, 2024-05-08T18:09:17.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.029646883999999998, 2024-05-08T18:09:17.549 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.549 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.549 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.550 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.550 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.550 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.550 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1191 2024-05-08T18:09:17.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.550 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:17.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:17.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981334+0000", 2024-05-08T18:09:17.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1540000000000004e-06 2024-05-08T18:09:17.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988180+0000", 2024-05-08T18:09:17.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068463619999999999 2024-05-08T18:09:17.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988216+0000", 2024-05-08T18:09:17.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6293e-05 2024-05-08T18:09:17.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988236+0000", 2024-05-08T18:09:17.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9403e-05 2024-05-08T18:09:17.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988410+0000", 2024-05-08T18:09:17.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017415400000000001 2024-05-08T18:09:17.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988803+0000", 2024-05-08T18:09:17.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000393271 2024-05-08T18:09:17.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:17.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989175+0000", 2024-05-08T18:09:17.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037178899999999997 2024-05-08T18:09:17.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.006397+0000", 2024-05-08T18:09:17.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017221744000000001 2024-05-08T18:09:17.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010666+0000", 2024-05-08T18:09:17.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042692880000000004 2024-05-08T18:09:17.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010836+0000", 2024-05-08T18:09:17.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000169498 2024-05-08T18:09:17.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010976+0000", 2024-05-08T18:09:17.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014092799999999999 2024-05-08T18:09:17.554 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.555 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.555 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.555 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1193 3.c 3:315b87e8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:17.555 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.004223+0000", 2024-05-08T18:09:17.555 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.542887337, 2024-05-08T18:09:17.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019590908000000001, 2024-05-08T18:09:17.555 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.555 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.555 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.555 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.555 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.555 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.555 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1193 2024-05-08T18:09:17.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.556 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.004223+0000", 2024-05-08T18:09:17.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.004223+0000", 2024-05-08T18:09:17.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.004227+0000", 2024-05-08T18:09:17.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5130000000000001e-06 2024-05-08T18:09:17.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008665+0000", 2024-05-08T18:09:17.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044376629999999997 2024-05-08T18:09:17.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008697+0000", 2024-05-08T18:09:17.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2783000000000001e-05 2024-05-08T18:09:17.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008715+0000", 2024-05-08T18:09:17.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7713000000000001e-05 2024-05-08T18:09:17.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008840+0000", 2024-05-08T18:09:17.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000124578 2024-05-08T18:09:17.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.009091+0000", 2024-05-08T18:09:17.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000251146 2024-05-08T18:09:17.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:17.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.009323+0000", 2024-05-08T18:09:17.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000232127 2024-05-08T18:09:17.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023324+0000", 2024-05-08T18:09:17.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014000574999999999 2024-05-08T18:09:17.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023459+0000", 2024-05-08T18:09:17.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013494099999999999 2024-05-08T18:09:17.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023644+0000", 2024-05-08T18:09:17.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018532100000000001 2024-05-08T18:09:17.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023814+0000", 2024-05-08T18:09:17.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017054799999999999 2024-05-08T18:09:17.560 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.560 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.560 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.560 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1194 3.16 3:6b2325a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:17.561 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:17.561 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.531635312000001, 2024-05-08T18:09:17.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030556241000000001, 2024-05-08T18:09:17.561 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.561 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.561 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.561 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.561 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.561 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.561 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1194 2024-05-08T18:09:17.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.561 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:17.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:17.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015492+0000", 2024-05-08T18:09:17.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6863000000000001e-05 2024-05-08T18:09:17.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019937+0000", 2024-05-08T18:09:17.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044450399999999999 2024-05-08T18:09:17.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019975+0000", 2024-05-08T18:09:17.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7676000000000003e-05 2024-05-08T18:09:17.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019995+0000", 2024-05-08T18:09:17.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.969e-05 2024-05-08T18:09:17.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020165+0000", 2024-05-08T18:09:17.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017003400000000001 2024-05-08T18:09:17.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020437+0000", 2024-05-08T18:09:17.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027198599999999999 2024-05-08T18:09:17.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:17.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020668+0000", 2024-05-08T18:09:17.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023154 2024-05-08T18:09:17.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.032879+0000", 2024-05-08T18:09:17.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012210883000000001 2024-05-08T18:09:17.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045595+0000", 2024-05-08T18:09:17.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012716005000000001 2024-05-08T18:09:17.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045811+0000", 2024-05-08T18:09:17.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021556400000000001 2024-05-08T18:09:17.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.046032+0000", 2024-05-08T18:09:17.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022096 2024-05-08T18:09:17.566 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.566 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.566 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.566 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1195 3.28 3:155acd84:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:17.566 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:17.566 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.521487991000001, 2024-05-08T18:09:17.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020411840000000001, 2024-05-08T18:09:17.566 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.567 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.567 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.567 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.567 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.567 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.567 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1195 2024-05-08T18:09:17.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.567 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:17.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:17.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025626+0000", 2024-05-08T18:09:17.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4699999999999998e-06 2024-05-08T18:09:17.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030167+0000", 2024-05-08T18:09:17.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045406709999999996 2024-05-08T18:09:17.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030204+0000", 2024-05-08T18:09:17.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6736000000000002e-05 2024-05-08T18:09:17.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030222+0000", 2024-05-08T18:09:17.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.823e-05 2024-05-08T18:09:17.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030337+0000", 2024-05-08T18:09:17.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114695 2024-05-08T18:09:17.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030565+0000", 2024-05-08T18:09:17.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000228173 2024-05-08T18:09:17.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:17.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030770+0000", 2024-05-08T18:09:17.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020505400000000001 2024-05-08T18:09:17.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044362+0000", 2024-05-08T18:09:17.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013591814000000001 2024-05-08T18:09:17.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045754+0000", 2024-05-08T18:09:17.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013923710000000001 2024-05-08T18:09:17.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045903+0000", 2024-05-08T18:09:17.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014878800000000001 2024-05-08T18:09:17.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.046035+0000", 2024-05-08T18:09:17.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013183800000000001 2024-05-08T18:09:17.571 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.572 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.572 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.572 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1209 3.35 e85/20 3:af4c6abe:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_21:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:17.572 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:17.572 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.366659702, 2024-05-08T18:09:17.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021767585999999998, 2024-05-08T18:09:17.572 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.572 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.572 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.572 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:17.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:17.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180452+0000", 2024-05-08T18:09:17.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4000000000000002e-07 2024-05-08T18:09:17.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183165+0000", 2024-05-08T18:09:17.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027135269999999999 2024-05-08T18:09:17.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183208+0000", 2024-05-08T18:09:17.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2599000000000003e-05 2024-05-08T18:09:17.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183239+0000", 2024-05-08T18:09:17.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999997e-05 2024-05-08T18:09:17.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183369+0000", 2024-05-08T18:09:17.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000130338 2024-05-08T18:09:17.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183407+0000", 2024-05-08T18:09:17.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8213000000000002e-05 2024-05-08T18:09:17.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202127+0000", 2024-05-08T18:09:17.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018719906000000001 2024-05-08T18:09:17.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202219+0000", 2024-05-08T18:09:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1533000000000006e-05 2024-05-08T18:09:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1218 3.c 3:33b8068a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.9848318089999992, 2024-05-08T18:09:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024735007, 2024-05-08T18:09:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.576 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1218 2024-05-08T18:09:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562282+0000", 2024-05-08T18:09:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7769999999999998e-06 2024-05-08T18:09:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568816+0000", 2024-05-08T18:09:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065338169999999999 2024-05-08T18:09:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568851+0000", 2024-05-08T18:09:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5892999999999997e-05 2024-05-08T18:09:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568871+0000", 2024-05-08T18:09:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9306000000000001e-05 2024-05-08T18:09:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568992+0000", 2024-05-08T18:09:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120925 2024-05-08T18:09:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.569258+0000", 2024-05-08T18:09:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026655299999999999 2024-05-08T18:09:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.569522+0000", 2024-05-08T18:09:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026331999999999999 2024-05-08T18:09:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584269+0000", 2024-05-08T18:09:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014747454 2024-05-08T18:09:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.586687+0000", 2024-05-08T18:09:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024181770000000001 2024-05-08T18:09:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.586888+0000", 2024-05-08T18:09:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000201137 2024-05-08T18:09:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.587014+0000", 2024-05-08T18:09:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012564799999999999 2024-05-08T18:09:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.581 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1220 3.c 3:319326d6:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.9621442340000002, 2024-05-08T18:09:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022305417000000001, 2024-05-08T18:09:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.582 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1220 2024-05-08T18:09:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584971+0000", 2024-05-08T18:09:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0729999999999998e-06 2024-05-08T18:09:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591515+0000", 2024-05-08T18:09:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065448340000000002 2024-05-08T18:09:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591549+0000", 2024-05-08T18:09:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3633000000000001e-05 2024-05-08T18:09:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591574+0000", 2024-05-08T18:09:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4482999999999999e-05 2024-05-08T18:09:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591714+0000", 2024-05-08T18:09:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014048500000000001 2024-05-08T18:09:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591956+0000", 2024-05-08T18:09:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000241616 2024-05-08T18:09:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.592181+0000", 2024-05-08T18:09:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022565000000000001 2024-05-08T18:09:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.606237+0000", 2024-05-08T18:09:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014055646999999999 2024-05-08T18:09:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607095+0000", 2024-05-08T18:09:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085838199999999998 2024-05-08T18:09:17.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607189+0000", 2024-05-08T18:09:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3962000000000006e-05 2024-05-08T18:09:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607272+0000", 2024-05-08T18:09:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2651999999999994e-05 2024-05-08T18:09:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.587 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1222 3.38 e85/20 3:1f451ee1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_6:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.607187+0000", 2024-05-08T18:09:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.9399237520000003, 2024-05-08T18:09:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018422048, 2024-05-08T18:09:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607187+0000", 2024-05-08T18:09:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607187+0000", 2024-05-08T18:09:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607188+0000", 2024-05-08T18:09:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2860000000000001e-06 2024-05-08T18:09:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.611823+0000", 2024-05-08T18:09:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046346010000000003 2024-05-08T18:09:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.611855+0000", 2024-05-08T18:09:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1572999999999997e-05 2024-05-08T18:09:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.611870+0000", 2024-05-08T18:09:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5129e-05 2024-05-08T18:09:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.612015+0000", 2024-05-08T18:09:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000145618 2024-05-08T18:09:17.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.612075+0000", 2024-05-08T18:09:17.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9692999999999999e-05 2024-05-08T18:09:17.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625482+0000", 2024-05-08T18:09:17.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013406998999999999 2024-05-08T18:09:17.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625609+0000", 2024-05-08T18:09:17.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012714900000000001 2024-05-08T18:09:17.592 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.592 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.592 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.592 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1229 3.16 3:6ad6b699:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:17.592 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.724599+0000", 2024-05-08T18:09:17.592 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8225121790000003, 2024-05-08T18:09:17.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018735992999999999, 2024-05-08T18:09:17.592 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.592 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.592 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.592 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.592 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.592 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.593 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1229 2024-05-08T18:09:17.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.593 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.724599+0000", 2024-05-08T18:09:17.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.724599+0000", 2024-05-08T18:09:17.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.724602+0000", 2024-05-08T18:09:17.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999999e-06 2024-05-08T18:09:17.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728621+0000", 2024-05-08T18:09:17.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040188649999999999 2024-05-08T18:09:17.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728658+0000", 2024-05-08T18:09:17.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7722999999999998e-05 2024-05-08T18:09:17.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728677+0000", 2024-05-08T18:09:17.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9000000000000001e-05 2024-05-08T18:09:17.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728876+0000", 2024-05-08T18:09:17.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019832300000000001 2024-05-08T18:09:17.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.729122+0000", 2024-05-08T18:09:17.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024644700000000001 2024-05-08T18:09:17.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:17.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.729371+0000", 2024-05-08T18:09:17.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000249087 2024-05-08T18:09:17.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.738186+0000", 2024-05-08T18:09:17.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0088147859999999998 2024-05-08T18:09:17.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.743162+0000", 2024-05-08T18:09:17.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049762909999999999 2024-05-08T18:09:17.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.743263+0000", 2024-05-08T18:09:17.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010037199999999999 2024-05-08T18:09:17.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.743335+0000", 2024-05-08T18:09:17.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2006000000000001e-05 2024-05-08T18:09:17.597 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.597 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.597 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.598 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1242 3.28 3:16e2765f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.2:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:17.598 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:17.598 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.5704984660000001, 2024-05-08T18:09:17.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020212443, 2024-05-08T18:09:17.598 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.598 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.598 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.598 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.598 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.598 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.598 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1242 2024-05-08T18:09:17.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.598 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:17.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:17.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976615+0000", 2024-05-08T18:09:17.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6170000000000001e-06 2024-05-08T18:09:17.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980655+0000", 2024-05-08T18:09:17.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040399240000000003 2024-05-08T18:09:17.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980693+0000", 2024-05-08T18:09:17.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7996e-05 2024-05-08T18:09:17.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980717+0000", 2024-05-08T18:09:17.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.459e-05 2024-05-08T18:09:17.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980811+0000", 2024-05-08T18:09:17.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3931000000000006e-05 2024-05-08T18:09:17.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980965+0000", 2024-05-08T18:09:17.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015315500000000001 2024-05-08T18:09:17.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:17.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.981450+0000", 2024-05-08T18:09:17.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000485632 2024-05-08T18:09:17.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.991160+0000", 2024-05-08T18:09:17.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.009709858 2024-05-08T18:09:17.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996726+0000", 2024-05-08T18:09:17.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055655039999999998 2024-05-08T18:09:17.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996786+0000", 2024-05-08T18:09:17.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0511999999999999e-05 2024-05-08T18:09:17.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996825+0000", 2024-05-08T18:09:17.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8723999999999997e-05 2024-05-08T18:09:17.603 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.603 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.603 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.603 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1247 3.c 3:32aac358:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:17.603 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.370612+0000", 2024-05-08T18:09:17.603 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.1764988679999995, 2024-05-08T18:09:17.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019632920000000002, 2024-05-08T18:09:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1247 2024-05-08T18:09:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.370612+0000", 2024-05-08T18:09:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.370612+0000", 2024-05-08T18:09:17.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.370615+0000", 2024-05-08T18:09:17.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.559e-06 2024-05-08T18:09:17.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374436+0000", 2024-05-08T18:09:17.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038219460000000001 2024-05-08T18:09:17.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374465+0000", 2024-05-08T18:09:17.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8347000000000002e-05 2024-05-08T18:09:17.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374476+0000", 2024-05-08T18:09:17.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1334e-05 2024-05-08T18:09:17.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374553+0000", 2024-05-08T18:09:17.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6555000000000001e-05 2024-05-08T18:09:17.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374667+0000", 2024-05-08T18:09:17.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114732 2024-05-08T18:09:17.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:17.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374764+0000", 2024-05-08T18:09:17.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6527000000000006e-05 2024-05-08T18:09:17.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.382209+0000", 2024-05-08T18:09:17.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074447309999999996 2024-05-08T18:09:17.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.390135+0000", 2024-05-08T18:09:17.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079259099999999996 2024-05-08T18:09:17.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.390185+0000", 2024-05-08T18:09:17.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0834999999999997e-05 2024-05-08T18:09:17.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.390245+0000", 2024-05-08T18:09:17.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9444000000000002e-05 2024-05-08T18:09:17.609 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.609 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.609 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.609 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1281 3.c 3:30308c7a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:17.609 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.141519+0000", 2024-05-08T18:09:17.609 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.4055917040000008, 2024-05-08T18:09:17.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018327742000000001, 2024-05-08T18:09:17.609 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.609 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.609 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.609 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.609 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.609 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.610 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1281 2024-05-08T18:09:17.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.610 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.141519+0000", 2024-05-08T18:09:17.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.141519+0000", 2024-05-08T18:09:17.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.141522+0000", 2024-05-08T18:09:17.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1839999999999999e-06 2024-05-08T18:09:17.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.145451+0000", 2024-05-08T18:09:17.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039283859999999999 2024-05-08T18:09:17.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.145479+0000", 2024-05-08T18:09:17.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8367000000000001e-05 2024-05-08T18:09:17.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.145496+0000", 2024-05-08T18:09:17.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6738000000000001e-05 2024-05-08T18:09:17.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.145700+0000", 2024-05-08T18:09:17.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020385600000000001 2024-05-08T18:09:17.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.146014+0000", 2024-05-08T18:09:17.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000313942 2024-05-08T18:09:17.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:17.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.146166+0000", 2024-05-08T18:09:17.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152535 2024-05-08T18:09:17.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.155416+0000", 2024-05-08T18:09:17.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092500450000000001 2024-05-08T18:09:17.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.159699+0000", 2024-05-08T18:09:17.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042826390000000004 2024-05-08T18:09:17.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.159787+0000", 2024-05-08T18:09:17.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7820999999999998e-05 2024-05-08T18:09:17.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.159847+0000", 2024-05-08T18:09:17.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0229000000000002e-05 2024-05-08T18:09:17.616 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.616 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.616 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.616 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1395 3.17 e87/20 3:eb9c68a5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_1:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:17.616 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.771843+0000", 2024-05-08T18:09:17.616 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.7752675900000003, 2024-05-08T18:09:17.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021322812, 2024-05-08T18:09:17.616 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.616 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.616 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.616 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.771843+0000", 2024-05-08T18:09:17.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.771843+0000", 2024-05-08T18:09:17.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.771844+0000", 2024-05-08T18:09:17.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0999999999999999e-07 2024-05-08T18:09:17.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.778254+0000", 2024-05-08T18:09:17.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064103859999999997 2024-05-08T18:09:17.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.778286+0000", 2024-05-08T18:09:17.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2113000000000002e-05 2024-05-08T18:09:17.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.778307+0000", 2024-05-08T18:09:17.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1158999999999999e-05 2024-05-08T18:09:17.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.779027+0000", 2024-05-08T18:09:17.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00071950400000000004 2024-05-08T18:09:17.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.779083+0000", 2024-05-08T18:09:17.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6512999999999999e-05 2024-05-08T18:09:17.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.793025+0000", 2024-05-08T18:09:17.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013941782999999999 2024-05-08T18:09:17.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.793166+0000", 2024-05-08T18:09:17.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140844 2024-05-08T18:09:17.620 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.620 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.620 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.620 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1400 3.1c 3:3bb95565:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:17.620 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:17.620 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.7183616199999996, 2024-05-08T18:09:17.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02650396, 2024-05-08T18:09:17.621 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.621 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.621 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.621 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.621 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.621 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.621 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1400 2024-05-08T18:09:17.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.621 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:17.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:17.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828753+0000", 2024-05-08T18:09:17.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4400000000000001e-06 2024-05-08T18:09:17.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836255+0000", 2024-05-08T18:09:17.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0075026379999999998 2024-05-08T18:09:17.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836312+0000", 2024-05-08T18:09:17.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6459000000000003e-05 2024-05-08T18:09:17.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836340+0000", 2024-05-08T18:09:17.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8183000000000001e-05 2024-05-08T18:09:17.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836510+0000", 2024-05-08T18:09:17.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000169805 2024-05-08T18:09:17.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836763+0000", 2024-05-08T18:09:17.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025333700000000002 2024-05-08T18:09:17.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:17.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836995+0000", 2024-05-08T18:09:17.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023236700000000001 2024-05-08T18:09:17.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849771+0000", 2024-05-08T18:09:17.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012775760000000001 2024-05-08T18:09:17.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855089+0000", 2024-05-08T18:09:17.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0053173889999999996 2024-05-08T18:09:17.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855183+0000", 2024-05-08T18:09:17.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4276000000000003e-05 2024-05-08T18:09:17.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855253+0000", 2024-05-08T18:09:17.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0306000000000001e-05 2024-05-08T18:09:17.626 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.626 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.626 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.626 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1405 3.c 3:3166280d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:17.626 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:17.626 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.6657951850000003, 2024-05-08T18:09:17.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023065800000000001, 2024-05-08T18:09:17.626 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.626 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.626 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.626 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1405 2024-05-08T18:09:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881320+0000", 2024-05-08T18:09:17.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-05-08T18:09:17.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887255+0000", 2024-05-08T18:09:17.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059351509999999996 2024-05-08T18:09:17.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887305+0000", 2024-05-08T18:09:17.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9579000000000001e-05 2024-05-08T18:09:17.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887332+0000", 2024-05-08T18:09:17.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7276000000000001e-05 2024-05-08T18:09:17.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887489+0000", 2024-05-08T18:09:17.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000156465 2024-05-08T18:09:17.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887745+0000", 2024-05-08T18:09:17.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025626700000000002 2024-05-08T18:09:17.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:17.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887980+0000", 2024-05-08T18:09:17.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000235107 2024-05-08T18:09:17.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.896366+0000", 2024-05-08T18:09:17.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083860870000000004 2024-05-08T18:09:17.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904214+0000", 2024-05-08T18:09:17.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078482840000000005 2024-05-08T18:09:17.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904312+0000", 2024-05-08T18:09:17.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7901999999999999e-05 2024-05-08T18:09:17.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904381+0000", 2024-05-08T18:09:17.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9258999999999995e-05 2024-05-08T18:09:17.631 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.631 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.632 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.632 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1410 3.30 3:0e0f1cce:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:17.632 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:17.632 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.6125702090000003, 2024-05-08T18:09:17.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.026130820999999999, 2024-05-08T18:09:17.632 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.632 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.632 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.632 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.632 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.632 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.632 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1410 2024-05-08T18:09:17.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.633 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:17.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:17.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934544+0000", 2024-05-08T18:09:17.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2600000000000001e-06 2024-05-08T18:09:17.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939363+0000", 2024-05-08T18:09:17.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048190020000000002 2024-05-08T18:09:17.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939407+0000", 2024-05-08T18:09:17.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3999999999999999e-05 2024-05-08T18:09:17.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939428+0000", 2024-05-08T18:09:17.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0746000000000001e-05 2024-05-08T18:09:17.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939637+0000", 2024-05-08T18:09:17.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000209397 2024-05-08T18:09:17.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939894+0000", 2024-05-08T18:09:17.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025690700000000001 2024-05-08T18:09:17.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:17.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.940133+0000", 2024-05-08T18:09:17.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023939400000000001 2024-05-08T18:09:17.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.949842+0000", 2024-05-08T18:09:17.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0097087570000000002 2024-05-08T18:09:17.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960494+0000", 2024-05-08T18:09:17.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01065148 2024-05-08T18:09:17.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960597+0000", 2024-05-08T18:09:17.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103529 2024-05-08T18:09:17.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960671+0000", 2024-05-08T18:09:17.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4349000000000003e-05 2024-05-08T18:09:17.637 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.637 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.637 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.637 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1446 3.22 3:44011652:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:17.637 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:17.638 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.6721885759999999, 2024-05-08T18:09:17.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024780153999999999, 2024-05-08T18:09:17.638 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.638 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.638 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.638 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.638 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.638 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.638 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1446 2024-05-08T18:09:17.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.638 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:17.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:17.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874926+0000", 2024-05-08T18:09:17.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2739999999999999e-06 2024-05-08T18:09:17.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879812+0000", 2024-05-08T18:09:17.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048860040000000002 2024-05-08T18:09:17.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879849+0000", 2024-05-08T18:09:17.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7919000000000001e-05 2024-05-08T18:09:17.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879868+0000", 2024-05-08T18:09:17.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8836999999999999e-05 2024-05-08T18:09:17.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880042+0000", 2024-05-08T18:09:17.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173981 2024-05-08T18:09:17.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880452+0000", 2024-05-08T18:09:17.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040949200000000002 2024-05-08T18:09:17.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:17.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880849+0000", 2024-05-08T18:09:17.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039710499999999997 2024-05-08T18:09:17.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.892821+0000", 2024-05-08T18:09:17.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011972287 2024-05-08T18:09:17.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899596+0000", 2024-05-08T18:09:17.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067744720000000001 2024-05-08T18:09:17.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899655+0000", 2024-05-08T18:09:17.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9119000000000001e-05 2024-05-08T18:09:17.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899702+0000", 2024-05-08T18:09:17.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7664000000000003e-05 2024-05-08T18:09:17.643 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.643 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.643 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.643 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1458 3.30 3:0e1bd441:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:17.643 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.449355+0000", 2024-05-08T18:09:17.643 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.097755458, 2024-05-08T18:09:17.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019757651000000001, 2024-05-08T18:09:17.643 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.643 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.644 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.644 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.644 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.644 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.644 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1458 2024-05-08T18:09:17.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.644 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.449355+0000", 2024-05-08T18:09:17.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.449355+0000", 2024-05-08T18:09:17.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.449359+0000", 2024-05-08T18:09:17.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2739999999999999e-06 2024-05-08T18:09:17.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.453851+0000", 2024-05-08T18:09:17.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004492495 2024-05-08T18:09:17.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.453897+0000", 2024-05-08T18:09:17.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6026999999999998e-05 2024-05-08T18:09:17.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.453917+0000", 2024-05-08T18:09:17.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0132999999999998e-05 2024-05-08T18:09:17.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.454019+0000", 2024-05-08T18:09:17.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101545 2024-05-08T18:09:17.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.454187+0000", 2024-05-08T18:09:17.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016848199999999999 2024-05-08T18:09:17.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:17.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.454341+0000", 2024-05-08T18:09:17.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015391999999999999 2024-05-08T18:09:17.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.463479+0000", 2024-05-08T18:09:17.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0091377230000000004 2024-05-08T18:09:17.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.469032+0000", 2024-05-08T18:09:17.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055529619999999998 2024-05-08T18:09:17.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.469075+0000", 2024-05-08T18:09:17.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3417999999999997e-05 2024-05-08T18:09:17.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.469113+0000", 2024-05-08T18:09:17.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7672000000000001e-05 2024-05-08T18:09:17.649 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.649 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.649 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.650 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1463 3.17 e87/20 3:ebd3133d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_13:head v 87'3, mlcod=85'1)", 2024-05-08T18:09:17.650 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.573059+0000", 2024-05-08T18:09:17.650 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 3.9740516010000002, 2024-05-08T18:09:17.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019808240000000001, 2024-05-08T18:09:17.650 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.650 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.650 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.650 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.573059+0000", 2024-05-08T18:09:17.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.573059+0000", 2024-05-08T18:09:17.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.573062+0000", 2024-05-08T18:09:17.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3760000000000002e-06 2024-05-08T18:09:17.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579565+0000", 2024-05-08T18:09:17.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065034109999999997 2024-05-08T18:09:17.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579601+0000", 2024-05-08T18:09:17.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6329999999999999e-05 2024-05-08T18:09:17.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579619+0000", 2024-05-08T18:09:17.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7980000000000001e-05 2024-05-08T18:09:17.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579718+0000", 2024-05-08T18:09:17.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8887000000000004e-05 2024-05-08T18:09:17.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579753+0000", 2024-05-08T18:09:17.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5006000000000003e-05 2024-05-08T18:09:17.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.592778+0000", 2024-05-08T18:09:17.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013024803999999999 2024-05-08T18:09:17.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.592867+0000", 2024-05-08T18:09:17.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9445999999999997e-05 2024-05-08T18:09:17.655 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.655 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.655 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.655 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1464 3.2f 3:f7dca4bf:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:17.655 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.583146+0000", 2024-05-08T18:09:17.655 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 3.9639643410000001, 2024-05-08T18:09:17.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022519284000000001, 2024-05-08T18:09:17.655 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.656 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.656 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:17.656 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.656 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.656 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.656 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1464 2024-05-08T18:09:17.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.656 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.583146+0000", 2024-05-08T18:09:17.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.583146+0000", 2024-05-08T18:09:17.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.583149+0000", 2024-05-08T18:09:17.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5600000000000001e-06 2024-05-08T18:09:17.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.586965+0000", 2024-05-08T18:09:17.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003816131 2024-05-08T18:09:17.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.586991+0000", 2024-05-08T18:09:17.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5508e-05 2024-05-08T18:09:17.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587005+0000", 2024-05-08T18:09:17.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4029000000000001e-05 2024-05-08T18:09:17.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587087+0000", 2024-05-08T18:09:17.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2056000000000002e-05 2024-05-08T18:09:17.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587293+0000", 2024-05-08T18:09:17.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020639000000000001 2024-05-08T18:09:17.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:17.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587503+0000", 2024-05-08T18:09:17.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020987299999999999 2024-05-08T18:09:17.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:17.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.598739+0000", 2024-05-08T18:09:17.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011236237 2024-05-08T18:09:17.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:17.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.605521+0000", 2024-05-08T18:09:17.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067817049999999999 2024-05-08T18:09:17.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:17.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.605602+0000", 2024-05-08T18:09:17.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1225999999999998e-05 2024-05-08T18:09:17.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:17.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.605666+0000", 2024-05-08T18:09:17.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3569000000000001e-05 2024-05-08T18:09:17.663 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.663 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.663 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.663 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.663 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.664 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:17.666 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:09:17.666 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:17.664+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:17.766 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:17.765+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:17.790 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-05-08T18:09:17.805 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:17.805 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:17.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.805 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1669 3.2c 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-05-08T18:09:17.805 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:17.805 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0066411120000000002, 2024-05-08T18:09:17.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067223980000000001, 2024-05-08T18:09:17.805 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:17.805 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:17.805 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-05-08T18:09:17.805 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:17.805 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:17.805 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:17.806 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1669 2024-05-08T18:09:17.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.806 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:17.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:17.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:17.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:17.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:17.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:17.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:17.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799916+0000", 2024-05-08T18:09:17.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7730000000000001e-06 2024-05-08T18:09:17.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:17.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799931+0000", 2024-05-08T18:09:17.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5227e-05 2024-05-08T18:09:17.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:17.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799969+0000", 2024-05-08T18:09:17.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7883000000000003e-05 2024-05-08T18:09:17.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:17.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799986+0000", 2024-05-08T18:09:17.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6728999999999999e-05 2024-05-08T18:09:17.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.800123+0000", 2024-05-08T18:09:17.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013784600000000001 2024-05-08T18:09:17.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:17.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.800135+0000", 2024-05-08T18:09:17.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1336e-05 2024-05-08T18:09:17.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:17.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.805653+0000", 2024-05-08T18:09:17.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055179890000000001 2024-05-08T18:09:17.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:17.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:17.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:17.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.805876+0000", 2024-05-08T18:09:17.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022279 2024-05-08T18:09:17.809 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.810 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:17.810 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.810 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:17.810 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-05-08T18:09:17.810 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 1 2024-05-08T18:09:17.810 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:17.823 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:09:17.867 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:17.868+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:17.968 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:17.968+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:17.994 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:17.994 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:17.994 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:17.994 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:17.994 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:18.008 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:09:18.069 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:18.069+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:18.137 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:09:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 114.600407434, 2024-05-08T18:09:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.032012946, 2024-05-08T18:09:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:09:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535484+0000", 2024-05-08T18:09:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7929999999999999e-06 2024-05-08T18:09:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535500+0000", 2024-05-08T18:09:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5226e-05 2024-05-08T18:09:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535535+0000", 2024-05-08T18:09:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5213000000000003e-05 2024-05-08T18:09:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535564+0000", 2024-05-08T18:09:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9360999999999999e-05 2024-05-08T18:09:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535757+0000", 2024-05-08T18:09:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000193229 2024-05-08T18:09:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535775+0000", 2024-05-08T18:09:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7098000000000001e-05 2024-05-08T18:09:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556004+0000", 2024-05-08T18:09:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020229068999999999 2024-05-08T18:09:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556036+0000", 2024-05-08T18:09:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1943000000000002e-05 2024-05-08T18:09:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.564721+0000", 2024-05-08T18:09:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086853320000000005 2024-05-08T18:09:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565032+0000", 2024-05-08T18:09:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031121799999999999 2024-05-08T18:09:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565365+0000", 2024-05-08T18:09:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000332744 2024-05-08T18:09:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567305+0000", 2024-05-08T18:09:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00194016 2024-05-08T18:09:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567368+0000", 2024-05-08T18:09:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3342000000000004e-05 2024-05-08T18:09:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567433+0000", 2024-05-08T18:09:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4726000000000003e-05 2024-05-08T18:09:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567494+0000", 2024-05-08T18:09:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0492000000000003e-05 2024-05-08T18:09:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1189 3.20 3:054e8a9f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.175718028, 2024-05-08T18:09:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025093629999999999, 2024-05-08T18:09:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1189 2024-05-08T18:09:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960173+0000", 2024-05-08T18:09:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.65e-06 2024-05-08T18:09:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965720+0000", 2024-05-08T18:09:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055476340000000001 2024-05-08T18:09:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965757+0000", 2024-05-08T18:09:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6223000000000002e-05 2024-05-08T18:09:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965774+0000", 2024-05-08T18:09:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6952999999999998e-05 2024-05-08T18:09:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965930+0000", 2024-05-08T18:09:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015611800000000001 2024-05-08T18:09:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966190+0000", 2024-05-08T18:09:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025999399999999999 2024-05-08T18:09:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966440+0000", 2024-05-08T18:09:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025007600000000001 2024-05-08T18:09:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981042+0000", 2024-05-08T18:09:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01460257 2024-05-08T18:09:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.984969+0000", 2024-05-08T18:09:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039265159999999997 2024-05-08T18:09:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985135+0000", 2024-05-08T18:09:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016630400000000001 2024-05-08T18:09:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985264+0000", 2024-05-08T18:09:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012859199999999999 2024-05-08T18:09:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1209 3.35 3:af4c6abe:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.960456381, 2024-05-08T18:09:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027313356, 2024-05-08T18:09:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1209 2024-05-08T18:09:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175436+0000", 2024-05-08T18:09:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3800000000000004e-06 2024-05-08T18:09:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179472+0000", 2024-05-08T18:09:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040357020000000004 2024-05-08T18:09:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179515+0000", 2024-05-08T18:09:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2988999999999998e-05 2024-05-08T18:09:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179534+0000", 2024-05-08T18:09:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8743e-05 2024-05-08T18:09:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179673+0000", 2024-05-08T18:09:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013983800000000001 2024-05-08T18:09:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179933+0000", 2024-05-08T18:09:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025967999999999998 2024-05-08T18:09:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180161+0000", 2024-05-08T18:09:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022826300000000001 2024-05-08T18:09:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.200613+0000", 2024-05-08T18:09:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020451766999999999 2024-05-08T18:09:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202567+0000", 2024-05-08T18:09:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019541160000000001 2024-05-08T18:09:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202665+0000", 2024-05-08T18:09:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8055999999999998e-05 2024-05-08T18:09:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202745+0000", 2024-05-08T18:09:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9821999999999996e-05 2024-05-08T18:09:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1221 3.20 3:071d1257:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.541141506000001, 2024-05-08T18:09:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02822473, 2024-05-08T18:09:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1221 2024-05-08T18:09:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594751+0000", 2024-05-08T18:09:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3769999999999998e-06 2024-05-08T18:09:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600627+0000", 2024-05-08T18:09:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058764389999999998 2024-05-08T18:09:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600672+0000", 2024-05-08T18:09:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4805999999999998e-05 2024-05-08T18:09:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600704+0000", 2024-05-08T18:09:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2026000000000001e-05 2024-05-08T18:09:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600884+0000", 2024-05-08T18:09:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000179385 2024-05-08T18:09:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601296+0000", 2024-05-08T18:09:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041257400000000002 2024-05-08T18:09:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601742+0000", 2024-05-08T18:09:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044585399999999998 2024-05-08T18:09:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.617360+0000", 2024-05-08T18:09:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015617982000000001 2024-05-08T18:09:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622618+0000", 2024-05-08T18:09:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052577420000000001 2024-05-08T18:09:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622835+0000", 2024-05-08T18:09:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021674699999999999 2024-05-08T18:09:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622971+0000", 2024-05-08T18:09:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679799999999999 2024-05-08T18:09:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1223 3.2e e85/20 3:74a5b043:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_7:head v 85'3, mlcod=85'1)", 2024-05-08T18:09:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.619798+0000", 2024-05-08T18:09:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.516089676, 2024-05-08T18:09:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018211183999999998, 2024-05-08T18:09:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.619798+0000", 2024-05-08T18:09:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.619798+0000", 2024-05-08T18:09:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.619801+0000", 2024-05-08T18:09:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7e-06 2024-05-08T18:09:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625096+0000", 2024-05-08T18:09:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052944369999999999 2024-05-08T18:09:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625126+0000", 2024-05-08T18:09:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0960000000000002e-05 2024-05-08T18:09:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625165+0000", 2024-05-08T18:09:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8136000000000002e-05 2024-05-08T18:09:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625291+0000", 2024-05-08T18:09:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012613500000000001 2024-05-08T18:09:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625349+0000", 2024-05-08T18:09:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8495999999999997e-05 2024-05-08T18:09:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.637877+0000", 2024-05-08T18:09:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012527652 2024-05-08T18:09:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638010+0000", 2024-05-08T18:09:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013266800000000001 2024-05-08T18:09:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1263 3.36 3:6eb7bd8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.571418+0000", 2024-05-08T18:09:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.5644701770000005, 2024-05-08T18:09:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018084347000000001, 2024-05-08T18:09:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1263 2024-05-08T18:09:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.571418+0000", 2024-05-08T18:09:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.571418+0000", 2024-05-08T18:09:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.571420+0000", 2024-05-08T18:09:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3860000000000001e-06 2024-05-08T18:09:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575201+0000", 2024-05-08T18:09:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037802589999999998 2024-05-08T18:09:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575225+0000", 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4134999999999998e-05 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575237+0000", 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2425999999999999e-05 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575315+0000", 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7621999999999996e-05 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575474+0000", 2024-05-08T18:09:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015942699999999999 2024-05-08T18:09:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575606+0000", 2024-05-08T18:09:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013143200000000001 2024-05-08T18:09:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.589176+0000", 2024-05-08T18:09:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013570863000000001 2024-05-08T18:09:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.589303+0000", 2024-05-08T18:09:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126067 2024-05-08T18:09:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.589421+0000", 2024-05-08T18:09:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118311 2024-05-08T18:09:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.589502+0000", 2024-05-08T18:09:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1419000000000001e-05 2024-05-08T18:09:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1268 3.36 3:6efaad9c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.629292+0000", 2024-05-08T18:09:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.5065960280000006, 2024-05-08T18:09:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018691711, 2024-05-08T18:09:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1268 2024-05-08T18:09:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.629292+0000", 2024-05-08T18:09:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.629292+0000", 2024-05-08T18:09:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.629295+0000", 2024-05-08T18:09:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5799999999999999e-06 2024-05-08T18:09:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633104+0000", 2024-05-08T18:09:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038088869999999999 2024-05-08T18:09:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633130+0000", 2024-05-08T18:09:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6016e-05 2024-05-08T18:09:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633144+0000", 2024-05-08T18:09:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3971999999999999e-05 2024-05-08T18:09:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633229+0000", 2024-05-08T18:09:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5749999999999997e-05 2024-05-08T18:09:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633349+0000", 2024-05-08T18:09:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011934000000000001 2024-05-08T18:09:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633507+0000", 2024-05-08T18:09:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015834700000000001 2024-05-08T18:09:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.639941+0000", 2024-05-08T18:09:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064341449999999996 2024-05-08T18:09:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.647803+0000", 2024-05-08T18:09:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078617889999999992 2024-05-08T18:09:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.647907+0000", 2024-05-08T18:09:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010413599999999999 2024-05-08T18:09:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.647984+0000", 2024-05-08T18:09:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6749000000000007e-05 2024-05-08T18:09:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1275 3.33 e85/20 3:ccdf9558:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_3:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.0822984699999996, 2024-05-08T18:09:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020251129, 2024-05-08T18:09:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053592+0000", 2024-05-08T18:09:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5189999999999999e-06 2024-05-08T18:09:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059662+0000", 2024-05-08T18:09:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060699289999999999 2024-05-08T18:09:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059680+0000", 2024-05-08T18:09:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7558999999999999e-05 2024-05-08T18:09:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059689+0000", 2024-05-08T18:09:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2320000000000007e-06 2024-05-08T18:09:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059826+0000", 2024-05-08T18:09:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136792 2024-05-08T18:09:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059867+0000", 2024-05-08T18:09:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1689e-05 2024-05-08T18:09:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073728+0000", 2024-05-08T18:09:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01386104 2024-05-08T18:09:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073841+0000", 2024-05-08T18:09:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011236899999999999 2024-05-08T18:09:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1286 3.20 3:07ccb256:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.9316038560000006, 2024-05-08T18:09:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022546805999999999, 2024-05-08T18:09:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1286 2024-05-08T18:09:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204287+0000", 2024-05-08T18:09:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8880000000000001e-06 2024-05-08T18:09:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208135+0000", 2024-05-08T18:09:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038480960000000001 2024-05-08T18:09:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208158+0000", 2024-05-08T18:09:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-05 2024-05-08T18:09:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208172+0000", 2024-05-08T18:09:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:09:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208251+0000", 2024-05-08T18:09:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8863999999999996e-05 2024-05-08T18:09:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208387+0000", 2024-05-08T18:09:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013615099999999999 2024-05-08T18:09:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208488+0000", 2024-05-08T18:09:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101366 2024-05-08T18:09:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.214533+0000", 2024-05-08T18:09:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060444829999999998 2024-05-08T18:09:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226742+0000", 2024-05-08T18:09:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012208798 2024-05-08T18:09:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226792+0000", 2024-05-08T18:09:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0565999999999997e-05 2024-05-08T18:09:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226831+0000", 2024-05-08T18:09:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8816999999999998e-05 2024-05-08T18:09:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1397 3.34 e87/20 3:2c6418f0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_3:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.3331718669999999, 2024-05-08T18:09:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019946450000000001, 2024-05-08T18:09:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802717+0000", 2024-05-08T18:09:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0400000000000005e-07 2024-05-08T18:09:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807936+0000", 2024-05-08T18:09:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052192489999999996 2024-05-08T18:09:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807971+0000", 2024-05-08T18:09:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4517000000000002e-05 2024-05-08T18:09:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807993+0000", 2024-05-08T18:09:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2463000000000002e-05 2024-05-08T18:09:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.808151+0000", 2024-05-08T18:09:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015751400000000001 2024-05-08T18:09:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.808197+0000", 2024-05-08T18:09:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6637000000000001e-05 2024-05-08T18:09:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822537+0000", 2024-05-08T18:09:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014339607000000001 2024-05-08T18:09:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822663+0000", 2024-05-08T18:09:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125659 2024-05-08T18:09:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1399 3.2c 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.3164603360000005, 2024-05-08T18:09:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030683200000000001, 2024-05-08T18:09:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1399 2024-05-08T18:09:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819432+0000", 2024-05-08T18:09:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7759999999999999e-06 2024-05-08T18:09:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825021+0000", 2024-05-08T18:09:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055895859999999997 2024-05-08T18:09:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825052+0000", 2024-05-08T18:09:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1047000000000003e-05 2024-05-08T18:09:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825068+0000", 2024-05-08T18:09:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6138999999999999e-05 2024-05-08T18:09:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825218+0000", 2024-05-08T18:09:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014997200000000001 2024-05-08T18:09:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825490+0000", 2024-05-08T18:09:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000271446 2024-05-08T18:09:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825710+0000", 2024-05-08T18:09:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220354 2024-05-08T18:09:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.839642+0000", 2024-05-08T18:09:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013932363 2024-05-08T18:09:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849813+0000", 2024-05-08T18:09:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010170461 2024-05-08T18:09:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849981+0000", 2024-05-08T18:09:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016776399999999999 2024-05-08T18:09:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.850111+0000", 2024-05-08T18:09:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013029200000000001 2024-05-08T18:09:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1406 3.20 3:05e3d3c1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.2468892250000003, 2024-05-08T18:09:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022642778999999998, 2024-05-08T18:09:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1406 2024-05-08T18:09:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.889003+0000", 2024-05-08T18:09:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8670000000000004e-06 2024-05-08T18:09:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893237+0000", 2024-05-08T18:09:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042339999999999999 2024-05-08T18:09:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893279+0000", 2024-05-08T18:09:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2225999999999999e-05 2024-05-08T18:09:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893305+0000", 2024-05-08T18:09:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.618e-05 2024-05-08T18:09:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893479+0000", 2024-05-08T18:09:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017357700000000001 2024-05-08T18:09:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893736+0000", 2024-05-08T18:09:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025701700000000001 2024-05-08T18:09:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893993+0000", 2024-05-08T18:09:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025750700000000003 2024-05-08T18:09:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904227+0000", 2024-05-08T18:09:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010234073 2024-05-08T18:09:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911471+0000", 2024-05-08T18:09:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0072441909999999997 2024-05-08T18:09:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911567+0000", 2024-05-08T18:09:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5685000000000003e-05 2024-05-08T18:09:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911642+0000", 2024-05-08T18:09:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4456000000000007e-05 2024-05-08T18:09:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1416 3.2c 3:345ebd70:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.1395180199999997, 2024-05-08T18:09:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027523229999999999, 2024-05-08T18:09:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1416 2024-05-08T18:09:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996374+0000", 2024-05-08T18:09:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.506e-06 2024-05-08T18:09:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000305+0000", 2024-05-08T18:09:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003931197 2024-05-08T18:09:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000346+0000", 2024-05-08T18:09:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1396000000000001e-05 2024-05-08T18:09:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000364+0000", 2024-05-08T18:09:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.806e-05 2024-05-08T18:09:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000490+0000", 2024-05-08T18:09:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012581800000000001 2024-05-08T18:09:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000755+0000", 2024-05-08T18:09:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026484700000000002 2024-05-08T18:09:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000992+0000", 2024-05-08T18:09:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023701700000000001 2024-05-08T18:09:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010465+0000", 2024-05-08T18:09:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094726429999999993 2024-05-08T18:09:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023679+0000", 2024-05-08T18:09:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013214105 2024-05-08T18:09:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023776+0000", 2024-05-08T18:09:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7258999999999998e-05 2024-05-08T18:09:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023893+0000", 2024-05-08T18:09:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117382 2024-05-08T18:09:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1424 3.36 3:6c7a05ce:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.375800+0000", 2024-05-08T18:09:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.7600880270000001, 2024-05-08T18:09:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019293312999999999, 2024-05-08T18:09:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1424 2024-05-08T18:09:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.375800+0000", 2024-05-08T18:09:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.375800+0000", 2024-05-08T18:09:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.375802+0000", 2024-05-08T18:09:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3879999999999998e-06 2024-05-08T18:09:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.379572+0000", 2024-05-08T18:09:18.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037692820000000001 2024-05-08T18:09:18.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.379602+0000", 2024-05-08T18:09:18.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0114999999999999e-05 2024-05-08T18:09:18.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.379614+0000", 2024-05-08T18:09:18.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1725999999999999e-05 2024-05-08T18:09:18.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.379759+0000", 2024-05-08T18:09:18.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014588000000000001 2024-05-08T18:09:18.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.380200+0000", 2024-05-08T18:09:18.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044040399999999998 2024-05-08T18:09:18.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:18.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.380676+0000", 2024-05-08T18:09:18.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047648100000000001 2024-05-08T18:09:18.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:18.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.387146+0000", 2024-05-08T18:09:18.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064695050000000004 2024-05-08T18:09:18.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:18.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.394934+0000", 2024-05-08T18:09:18.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007787988 2024-05-08T18:09:18.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.395022+0000", 2024-05-08T18:09:18.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8090000000000005e-05 2024-05-08T18:09:18.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.395093+0000", 2024-05-08T18:09:18.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1453999999999997e-05 2024-05-08T18:09:18.212 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.212 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.212 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.212 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1444 3.2c 3:3746b84a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:18.212 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.785023+0000", 2024-05-08T18:09:18.212 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.3508653299999995, 2024-05-08T18:09:18.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018464464999999999, 2024-05-08T18:09:18.212 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.212 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.212 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.213 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.213 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.213 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.213 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1444 2024-05-08T18:09:18.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.213 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.785023+0000", 2024-05-08T18:09:18.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.785023+0000", 2024-05-08T18:09:18.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.785046+0000", 2024-05-08T18:09:18.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3603000000000001e-05 2024-05-08T18:09:18.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789230+0000", 2024-05-08T18:09:18.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041834300000000001 2024-05-08T18:09:18.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789272+0000", 2024-05-08T18:09:18.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2531999999999999e-05 2024-05-08T18:09:18.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789292+0000", 2024-05-08T18:09:18.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9360000000000001e-05 2024-05-08T18:09:18.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789395+0000", 2024-05-08T18:09:18.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103597 2024-05-08T18:09:18.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789572+0000", 2024-05-08T18:09:18.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017642999999999999 2024-05-08T18:09:18.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:18.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789746+0000", 2024-05-08T18:09:18.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017421799999999999 2024-05-08T18:09:18.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:18.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.802556+0000", 2024-05-08T18:09:18.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012810013 2024-05-08T18:09:18.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:18.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.803301+0000", 2024-05-08T18:09:18.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00074479400000000001 2024-05-08T18:09:18.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.803400+0000", 2024-05-08T18:09:18.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9038999999999998e-05 2024-05-08T18:09:18.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.803487+0000", 2024-05-08T18:09:18.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7448999999999996e-05 2024-05-08T18:09:18.217 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.217 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.217 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.217 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1451 3.36 3:6da4b5f8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:18.218 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:18.218 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.8388453870000001, 2024-05-08T18:09:18.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022119236, 2024-05-08T18:09:18.218 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.218 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.218 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.218 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.218 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.218 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.218 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1451 2024-05-08T18:09:18.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.218 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:18.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:18.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297046+0000", 2024-05-08T18:09:18.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6030000000000001e-06 2024-05-08T18:09:18.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301125+0000", 2024-05-08T18:09:18.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004079058 2024-05-08T18:09:18.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301163+0000", 2024-05-08T18:09:18.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7286000000000002e-05 2024-05-08T18:09:18.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301181+0000", 2024-05-08T18:09:18.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.844e-05 2024-05-08T18:09:18.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301325+0000", 2024-05-08T18:09:18.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144284 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301602+0000", 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027665399999999998 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301835+0000", 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023292699999999999 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.318166+0000", 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016331061000000001 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:18.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.318991+0000", 2024-05-08T18:09:18.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000825427 2024-05-08T18:09:18.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.319082+0000", 2024-05-08T18:09:18.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0743999999999997e-05 2024-05-08T18:09:18.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.319162+0000", 2024-05-08T18:09:18.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9752000000000005e-05 2024-05-08T18:09:18.222 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.222 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.223 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.223 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1465 3.26 3:66c1b1e1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:18.223 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.606487+0000", 2024-05-08T18:09:18.223 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.5294011340000004, 2024-05-08T18:09:18.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019185464999999999, 2024-05-08T18:09:18.223 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.223 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.223 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.223 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.223 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.223 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.223 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1465 2024-05-08T18:09:18.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.223 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.606487+0000", 2024-05-08T18:09:18.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.606487+0000", 2024-05-08T18:09:18.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.606491+0000", 2024-05-08T18:09:18.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8229999999999997e-06 2024-05-08T18:09:18.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.610808+0000", 2024-05-08T18:09:18.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043176359999999997 2024-05-08T18:09:18.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.610839+0000", 2024-05-08T18:09:18.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0216e-05 2024-05-08T18:09:18.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.610860+0000", 2024-05-08T18:09:18.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1277999999999999e-05 2024-05-08T18:09:18.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.611027+0000", 2024-05-08T18:09:18.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016708900000000001 2024-05-08T18:09:18.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.611279+0000", 2024-05-08T18:09:18.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025154000000000002 2024-05-08T18:09:18.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:18.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.611522+0000", 2024-05-08T18:09:18.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024351 2024-05-08T18:09:18.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:18.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.620744+0000", 2024-05-08T18:09:18.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092216190000000003 2024-05-08T18:09:18.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:18.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.625549+0000", 2024-05-08T18:09:18.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048049900000000003 2024-05-08T18:09:18.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.625627+0000", 2024-05-08T18:09:18.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7860000000000003e-05 2024-05-08T18:09:18.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.625672+0000", 2024-05-08T18:09:18.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5904e-05 2024-05-08T18:09:18.231 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.231 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.231 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.231 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1471 3.26 3:6495ae89:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:18.231 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:18.231 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.4392411660000004, 2024-05-08T18:09:18.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022361453, 2024-05-08T18:09:18.232 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.232 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.232 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.232 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.232 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.232 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.232 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1471 2024-05-08T18:09:18.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.232 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:18.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:18.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696650+0000", 2024-05-08T18:09:18.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8839999999999998e-06 2024-05-08T18:09:18.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700528+0000", 2024-05-08T18:09:18.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038783390000000002 2024-05-08T18:09:18.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700554+0000", 2024-05-08T18:09:18.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6106e-05 2024-05-08T18:09:18.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700566+0000", 2024-05-08T18:09:18.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2021000000000001e-05 2024-05-08T18:09:18.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700682+0000", 2024-05-08T18:09:18.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115457 2024-05-08T18:09:18.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700951+0000", 2024-05-08T18:09:18.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026891699999999997 2024-05-08T18:09:18.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:18.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.701210+0000", 2024-05-08T18:09:18.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000259017 2024-05-08T18:09:18.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:18.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718848+0000", 2024-05-08T18:09:18.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017638132000000001 2024-05-08T18:09:18.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:18.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718917+0000", 2024-05-08T18:09:18.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9564e-05 2024-05-08T18:09:18.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718968+0000", 2024-05-08T18:09:18.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1028e-05 2024-05-08T18:09:18.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.719008+0000", 2024-05-08T18:09:18.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9987999999999997e-05 2024-05-08T18:09:18.236 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.237 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.237 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.237 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1472 3.26 3:6656fbbd:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:18.237 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.707521+0000", 2024-05-08T18:09:18.237 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.4283670720000003, 2024-05-08T18:09:18.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018269342000000001, 2024-05-08T18:09:18.237 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.237 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.237 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:18.237 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.237 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.237 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.237 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1472 2024-05-08T18:09:18.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.238 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.707521+0000", 2024-05-08T18:09:18.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.707521+0000", 2024-05-08T18:09:18.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.707524+0000", 2024-05-08T18:09:18.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5050000000000002e-06 2024-05-08T18:09:18.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712193+0000", 2024-05-08T18:09:18.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046691450000000004 2024-05-08T18:09:18.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712228+0000", 2024-05-08T18:09:18.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.523e-05 2024-05-08T18:09:18.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712253+0000", 2024-05-08T18:09:18.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5242999999999999e-05 2024-05-08T18:09:18.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712348+0000", 2024-05-08T18:09:18.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4387000000000003e-05 2024-05-08T18:09:18.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712462+0000", 2024-05-08T18:09:18.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114839 2024-05-08T18:09:18.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:18.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712560+0000", 2024-05-08T18:09:18.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7554999999999997e-05 2024-05-08T18:09:18.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:18.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.725401+0000", 2024-05-08T18:09:18.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012841175999999999 2024-05-08T18:09:18.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:18.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.725690+0000", 2024-05-08T18:09:18.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028845800000000001 2024-05-08T18:09:18.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:18.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.725731+0000", 2024-05-08T18:09:18.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1672999999999999e-05 2024-05-08T18:09:18.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.725790+0000", 2024-05-08T18:09:18.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9131e-05 2024-05-08T18:09:18.242 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.242 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.242 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.242 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1669 3.2c 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-05-08T18:09:18.242 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:18.242 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.33597606299999999, 2024-05-08T18:09:18.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020235185999999999, 2024-05-08T18:09:18.243 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:18.243 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:18.243 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-05-08T18:09:18.243 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:18.243 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:18.243 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:18.243 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1669 2024-05-08T18:09:18.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.243 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:18.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:18.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:18.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:18.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:18.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:18.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:18.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799916+0000", 2024-05-08T18:09:18.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7730000000000001e-06 2024-05-08T18:09:18.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:18.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799931+0000", 2024-05-08T18:09:18.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5227e-05 2024-05-08T18:09:18.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799969+0000", 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7883000000000003e-05 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799986+0000", 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6728999999999999e-05 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.800123+0000", 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013784600000000001 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:18.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.800135+0000", 2024-05-08T18:09:18.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1336e-05 2024-05-08T18:09:18.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:18.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.805653+0000", 2024-05-08T18:09:18.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055179890000000001 2024-05-08T18:09:18.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:18.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.805876+0000", 2024-05-08T18:09:18.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022279 2024-05-08T18:09:18.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:18.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:18.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:18.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.820147+0000", 2024-05-08T18:09:18.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014271613000000001 2024-05-08T18:09:18.247 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.247 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.247 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.247 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:18.247 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:18.247 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:18.248 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:09:18.249 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:18.249+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:18.338 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:09:18.385 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:18.388+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:18.429 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:18.429 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:18.429 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:18.429 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:18.443 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:09:18.489 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:18.489 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:18.492 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:18.493+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:18.507 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:18.507 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:18.538 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:18.538 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:18.551 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:18.549+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:18.564 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:18.564 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:18.565 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:18.565 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:18.565 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:18.575 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:18.575 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:18.578 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:09:18.596 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:18.596 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:18.629 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:18.629 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:18.647 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:18.647 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:18.666 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:18.666 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:18.668 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:18.669+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:18.745 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:18.746 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:18.752 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:18.752+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:18.759 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:09:18.853 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:18.853+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:18.876 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:18.876 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:18.888 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:09:18.954 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:18.953+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:19.023 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:19.023 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:19.038 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:09:19.082 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:19.084+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:19.157 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:19.157+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:19.164 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:19.164 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:19.178 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:09:19.257 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:19.257+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:19.349 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:19.349 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:19.358 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:19.360+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:19.362 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:09:19.459 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:19.457+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:19.522 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:19.522 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:19.536 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:09:19.560 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:19.561+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:19.654 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:19.654 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:19.661 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:19.660+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:19.667 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:09:19.761 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:19.764+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:19.821 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:09:19.824 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:19.824 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:19.838 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:09:19.882 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:19.884+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:19.963 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:19.964+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:20.004 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:20.004 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:20.016 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:09:20.102 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:20.104+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:20.166 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:20.165+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:20.168 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:20.168 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:20.181 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:09:20.270 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:20.272+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:20.338 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:20.338 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:20.351 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:09:20.394 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:20.396+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:20.468 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:20.468+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:20.518 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:20.519 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:20.531 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:09:20.570 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:20.569+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:20.671 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:20.672+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:20.685 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:09:20.693 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:20.693 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:20.708 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:09:20.772 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:20.772+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:20.783 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-05-08T18:09:20.827 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:20.827 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:20.840 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:20.841 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:20.843 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:20.843 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:20.854 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:09:20.859 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:20.859 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:20.872 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:20.872+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:20.875 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:20.875 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:20.892 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:20.893 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:20.909 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:20.909 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:20.927 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:20.927 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:20.945 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:20.946 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:20.980 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:20.980 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:20.980 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:20.980 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:20.980 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:20.994 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:09:21.001 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:21.004+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:21.074 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:21.073+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:21.114 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-05-08T18:09:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:09:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 119.582122297, 2024-05-08T18:09:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018560765, 2024-05-08T18:09:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "reached pg", 2024-05-08T18:09:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 43 2024-05-08T18:09:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:09:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530213+0000", 2024-05-08T18:09:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530217+0000", 2024-05-08T18:09:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:09:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530253+0000", 2024-05-08T18:09:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5621999999999999e-05 2024-05-08T18:09:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530288+0000", 2024-05-08T18:09:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5846999999999997e-05 2024-05-08T18:09:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530314+0000", 2024-05-08T18:09:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5732e-05 2024-05-08T18:09:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530952+0000", 2024-05-08T18:09:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00063739999999999999 2024-05-08T18:09:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.530977+0000", 2024-05-08T18:09:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5375e-05 2024-05-08T18:09:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548506+0000", 2024-05-08T18:09:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017528781 2024-05-08T18:09:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:21.548774+0000", 2024-05-08T18:09:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026821199999999999 2024-05-08T18:09:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1190 3.31 e85/20 3:8c795880:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_2:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.973668+0000", 2024-05-08T18:09:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.138667398000001, 2024-05-08T18:09:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021568941000000001, 2024-05-08T18:09:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.973668+0000", 2024-05-08T18:09:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.973668+0000", 2024-05-08T18:09:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.973671+0000", 2024-05-08T18:09:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2100000000000002e-06 2024-05-08T18:09:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.980815+0000", 2024-05-08T18:09:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071441860000000003 2024-05-08T18:09:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.980858+0000", 2024-05-08T18:09:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2852000000000002e-05 2024-05-08T18:09:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.980879+0000", 2024-05-08T18:09:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.107e-05 2024-05-08T18:09:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981093+0000", 2024-05-08T18:09:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000213857 2024-05-08T18:09:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981135+0000", 2024-05-08T18:09:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2249999999999997e-05 2024-05-08T18:09:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.995097+0000", 2024-05-08T18:09:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013961295 2024-05-08T18:09:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.995237+0000", 2024-05-08T18:09:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140221 2024-05-08T18:09:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1191 3.1d e85/20 3:b81eb771:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_3:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.989442+0000", 2024-05-08T18:09:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.122892981, 2024-05-08T18:09:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020798275000000001, 2024-05-08T18:09:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989442+0000", 2024-05-08T18:09:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989442+0000", 2024-05-08T18:09:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989443+0000", 2024-05-08T18:09:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-05-08T18:09:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994630+0000", 2024-05-08T18:09:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051867930000000003 2024-05-08T18:09:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994663+0000", 2024-05-08T18:09:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3272000000000003e-05 2024-05-08T18:09:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994680+0000", 2024-05-08T18:09:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7266999999999999e-05 2024-05-08T18:09:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994795+0000", 2024-05-08T18:09:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011437799999999999 2024-05-08T18:09:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994836+0000", 2024-05-08T18:09:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0686000000000003e-05 2024-05-08T18:09:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010110+0000", 2024-05-08T18:09:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015274081 2024-05-08T18:09:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010241+0000", 2024-05-08T18:09:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013107099999999999 2024-05-08T18:09:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1196 3.9 3:91f0c251:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.036686+0000", 2024-05-08T18:09:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.075649176000001, 2024-05-08T18:09:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019572662000000001, 2024-05-08T18:09:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1196 2024-05-08T18:09:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.036686+0000", 2024-05-08T18:09:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.036686+0000", 2024-05-08T18:09:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.036691+0000", 2024-05-08T18:09:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8099999999999997e-06 2024-05-08T18:09:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041369+0000", 2024-05-08T18:09:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046777590000000001 2024-05-08T18:09:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041413+0000", 2024-05-08T18:09:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4297e-05 2024-05-08T18:09:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041443+0000", 2024-05-08T18:09:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9635999999999999e-05 2024-05-08T18:09:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041588+0000", 2024-05-08T18:09:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014564100000000001 2024-05-08T18:09:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041833+0000", 2024-05-08T18:09:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000244777 2024-05-08T18:09:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.042054+0000", 2024-05-08T18:09:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022125399999999999 2024-05-08T18:09:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.051316+0000", 2024-05-08T18:09:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092614059999999998 2024-05-08T18:09:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056067+0000", 2024-05-08T18:09:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047512639999999998 2024-05-08T18:09:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056171+0000", 2024-05-08T18:09:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010425900000000001 2024-05-08T18:09:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056259+0000", 2024-05-08T18:09:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7559000000000007e-05 2024-05-08T18:09:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1199 3.14 3:29bdf593:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.067940+0000", 2024-05-08T18:09:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.044395651, 2024-05-08T18:09:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018983427000000001, 2024-05-08T18:09:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1199 2024-05-08T18:09:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.067940+0000", 2024-05-08T18:09:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.067940+0000", 2024-05-08T18:09:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.067943+0000", 2024-05-08T18:09:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6370000000000001e-06 2024-05-08T18:09:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.071968+0000", 2024-05-08T18:09:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040243120000000004 2024-05-08T18:09:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072006+0000", 2024-05-08T18:09:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8628999999999999e-05 2024-05-08T18:09:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072029+0000", 2024-05-08T18:09:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2972999999999998e-05 2024-05-08T18:09:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072160+0000", 2024-05-08T18:09:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013025100000000001 2024-05-08T18:09:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072398+0000", 2024-05-08T18:09:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023832399999999999 2024-05-08T18:09:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.072617+0000", 2024-05-08T18:09:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021892999999999999 2024-05-08T18:09:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.081906+0000", 2024-05-08T18:09:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092895919999999993 2024-05-08T18:09:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.086685+0000", 2024-05-08T18:09:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047783019999999999 2024-05-08T18:09:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.086794+0000", 2024-05-08T18:09:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010940100000000001 2024-05-08T18:09:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.086923+0000", 2024-05-08T18:09:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000129076 2024-05-08T18:09:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1202 3.14 3:2a8c8569:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.100310+0000", 2024-05-08T18:09:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.012025565, 2024-05-08T18:09:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030670528999999998, 2024-05-08T18:09:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1202 2024-05-08T18:09:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.100310+0000", 2024-05-08T18:09:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.100310+0000", 2024-05-08T18:09:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.100352+0000", 2024-05-08T18:09:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2315999999999999e-05 2024-05-08T18:09:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.105824+0000", 2024-05-08T18:09:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054720649999999999 2024-05-08T18:09:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.105863+0000", 2024-05-08T18:09:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8649000000000002e-05 2024-05-08T18:09:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.105883+0000", 2024-05-08T18:09:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0383000000000001e-05 2024-05-08T18:09:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106019+0000", 2024-05-08T18:09:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013552200000000001 2024-05-08T18:09:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106318+0000", 2024-05-08T18:09:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029913900000000002 2024-05-08T18:09:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106586+0000", 2024-05-08T18:09:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026771299999999999 2024-05-08T18:09:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.128110+0000", 2024-05-08T18:09:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021524155 2024-05-08T18:09:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130655+0000", 2024-05-08T18:09:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025453960000000001 2024-05-08T18:09:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130831+0000", 2024-05-08T18:09:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017583400000000001 2024-05-08T18:09:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130980+0000", 2024-05-08T18:09:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149357 2024-05-08T18:09:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1203 3.1a 3:592e440d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.110063+0000", 2024-05-08T18:09:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.002271954999999, 2024-05-08T18:09:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023166567999999998, 2024-05-08T18:09:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1203 2024-05-08T18:09:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110063+0000", 2024-05-08T18:09:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110063+0000", 2024-05-08T18:09:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110067+0000", 2024-05-08T18:09:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3629999999999998e-06 2024-05-08T18:09:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114611+0000", 2024-05-08T18:09:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00454375 2024-05-08T18:09:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114653+0000", 2024-05-08T18:09:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2549999999999997e-05 2024-05-08T18:09:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114681+0000", 2024-05-08T18:09:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7878999999999999e-05 2024-05-08T18:09:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114872+0000", 2024-05-08T18:09:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019109500000000001 2024-05-08T18:09:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.115275+0000", 2024-05-08T18:09:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040327700000000001 2024-05-08T18:09:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.115636+0000", 2024-05-08T18:09:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036014899999999998 2024-05-08T18:09:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.129938+0000", 2024-05-08T18:09:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014302848 2024-05-08T18:09:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.133055+0000", 2024-05-08T18:09:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00311699 2024-05-08T18:09:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.133159+0000", 2024-05-08T18:09:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103138 2024-05-08T18:09:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.133230+0000", 2024-05-08T18:09:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1528999999999999e-05 2024-05-08T18:09:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1211 3.3 3:c13935f4:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.195183+0000", 2024-05-08T18:09:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.917151957, 2024-05-08T18:09:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.026007971000000001, 2024-05-08T18:09:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1211 2024-05-08T18:09:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.195183+0000", 2024-05-08T18:09:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.195183+0000", 2024-05-08T18:09:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.195187+0000", 2024-05-08T18:09:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6540000000000001e-06 2024-05-08T18:09:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199150+0000", 2024-05-08T18:09:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039627719999999998 2024-05-08T18:09:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199188+0000", 2024-05-08T18:09:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195999999999998e-05 2024-05-08T18:09:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199210+0000", 2024-05-08T18:09:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2027000000000001e-05 2024-05-08T18:09:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199356+0000", 2024-05-08T18:09:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014612800000000001 2024-05-08T18:09:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199622+0000", 2024-05-08T18:09:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026600199999999999 2024-05-08T18:09:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199846+0000", 2024-05-08T18:09:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022389099999999999 2024-05-08T18:09:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.213755+0000", 2024-05-08T18:09:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013908536000000001 2024-05-08T18:09:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.221024+0000", 2024-05-08T18:09:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0072690439999999997 2024-05-08T18:09:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.221110+0000", 2024-05-08T18:09:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6008999999999996e-05 2024-05-08T18:09:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.221191+0000", 2024-05-08T18:09:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1712000000000006e-05 2024-05-08T18:09:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1214 3.9 3:92ca5236:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.1:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.223783+0000", 2024-05-08T18:09:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.888552492000001, 2024-05-08T18:09:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018427163999999999, 2024-05-08T18:09:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1214 2024-05-08T18:09:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.223783+0000", 2024-05-08T18:09:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.223783+0000", 2024-05-08T18:09:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.223786+0000", 2024-05-08T18:09:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8030000000000001e-06 2024-05-08T18:09:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.227730+0000", 2024-05-08T18:09:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039442430000000001 2024-05-08T18:09:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.227766+0000", 2024-05-08T18:09:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5571999999999998e-05 2024-05-08T18:09:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.227785+0000", 2024-05-08T18:09:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9170000000000001e-05 2024-05-08T18:09:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.227954+0000", 2024-05-08T18:09:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016892200000000001 2024-05-08T18:09:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.228373+0000", 2024-05-08T18:09:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000419417 2024-05-08T18:09:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.229595+0000", 2024-05-08T18:09:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012215730000000001 2024-05-08T18:09:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.239966+0000", 2024-05-08T18:09:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010371225 2024-05-08T18:09:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.241761+0000", 2024-05-08T18:09:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001795458 2024-05-08T18:09:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.242067+0000", 2024-05-08T18:09:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030554600000000002 2024-05-08T18:09:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.242210+0000", 2024-05-08T18:09:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014323499999999999 2024-05-08T18:09:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1224 3.13 e85/20 3:c82cef46:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_8:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.644014+0000", 2024-05-08T18:09:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.468321550000001, 2024-05-08T18:09:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019705998999999998, 2024-05-08T18:09:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.644014+0000", 2024-05-08T18:09:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.644014+0000", 2024-05-08T18:09:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.644018+0000", 2024-05-08T18:09:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6500000000000002e-06 2024-05-08T18:09:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651361+0000", 2024-05-08T18:09:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073436789999999997 2024-05-08T18:09:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651411+0000", 2024-05-08T18:09:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9613000000000001e-05 2024-05-08T18:09:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651438+0000", 2024-05-08T18:09:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6699e-05 2024-05-08T18:09:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651567+0000", 2024-05-08T18:09:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012993299999999999 2024-05-08T18:09:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651601+0000", 2024-05-08T18:09:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3268000000000001e-05 2024-05-08T18:09:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663646+0000", 2024-05-08T18:09:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012045451 2024-05-08T18:09:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663720+0000", 2024-05-08T18:09:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3706000000000002e-05 2024-05-08T18:09:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1226 3.3 3:c18beed9:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.668709+0000", 2024-05-08T18:09:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.443626095000001, 2024-05-08T18:09:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020071530000000001, 2024-05-08T18:09:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1226 2024-05-08T18:09:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.668709+0000", 2024-05-08T18:09:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.668709+0000", 2024-05-08T18:09:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.668717+0000", 2024-05-08T18:09:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7100000000000007e-06 2024-05-08T18:09:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672764+0000", 2024-05-08T18:09:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040465630000000004 2024-05-08T18:09:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672791+0000", 2024-05-08T18:09:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7636000000000001e-05 2024-05-08T18:09:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672804+0000", 2024-05-08T18:09:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3009e-05 2024-05-08T18:09:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672905+0000", 2024-05-08T18:09:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010105100000000001 2024-05-08T18:09:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.673113+0000", 2024-05-08T18:09:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000207405 2024-05-08T18:09:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.673300+0000", 2024-05-08T18:09:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000186875 2024-05-08T18:09:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.682552+0000", 2024-05-08T18:09:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092519690000000005 2024-05-08T18:09:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.688655+0000", 2024-05-08T18:09:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061032300000000003 2024-05-08T18:09:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.688723+0000", 2024-05-08T18:09:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8263999999999996e-05 2024-05-08T18:09:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.688781+0000", 2024-05-08T18:09:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7818000000000001e-05 2024-05-08T18:09:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1397 3.34 3:2c6418f0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.790046+0000", 2024-05-08T18:09:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.3222891239999992, 2024-05-08T18:09:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035561055000000001, 2024-05-08T18:09:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1397 2024-05-08T18:09:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.790046+0000", 2024-05-08T18:09:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.790046+0000", 2024-05-08T18:09:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.790051+0000", 2024-05-08T18:09:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.51e-06 2024-05-08T18:09:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795411+0000", 2024-05-08T18:09:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0053598880000000002 2024-05-08T18:09:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795450+0000", 2024-05-08T18:09:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9555999999999999e-05 2024-05-08T18:09:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795470+0000", 2024-05-08T18:09:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9644e-05 2024-05-08T18:09:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795648+0000", 2024-05-08T18:09:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017859000000000001 2024-05-08T18:09:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795661+0000", 2024-05-08T18:09:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2116999999999999e-05 2024-05-08T18:09:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.801909+0000", 2024-05-08T18:09:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0062485969999999998 2024-05-08T18:09:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802123+0000", 2024-05-08T18:09:21.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021390100000000001 2024-05-08T18:09:21.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:21.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802378+0000", 2024-05-08T18:09:21.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025494999999999999 2024-05-08T18:09:21.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822891+0000", 2024-05-08T18:09:21.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020513432000000002 2024-05-08T18:09:21.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825434+0000", 2024-05-08T18:09:21.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025423279999999999 2024-05-08T18:09:21.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825533+0000", 2024-05-08T18:09:21.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9302999999999994e-05 2024-05-08T18:09:21.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825607+0000", 2024-05-08T18:09:21.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4239000000000005e-05 2024-05-08T18:09:21.176 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.176 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.176 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.176 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1399 3.2c e87/20 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head v 87'3, mlcod=85'1)", 2024-05-08T18:09:21.177 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.825958+0000", 2024-05-08T18:09:21.177 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.2863778309999994, 2024-05-08T18:09:21.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023463491, 2024-05-08T18:09:21.177 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.177 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.177 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.177 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825958+0000", 2024-05-08T18:09:21.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825958+0000", 2024-05-08T18:09:21.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825959+0000", 2024-05-08T18:09:21.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.68e-06 2024-05-08T18:09:21.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829465+0000", 2024-05-08T18:09:21.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003505949 2024-05-08T18:09:21.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829510+0000", 2024-05-08T18:09:21.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4446000000000001e-05 2024-05-08T18:09:21.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829529+0000", 2024-05-08T18:09:21.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9242999999999999e-05 2024-05-08T18:09:21.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829699+0000", 2024-05-08T18:09:21.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017010500000000001 2024-05-08T18:09:21.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829767+0000", 2024-05-08T18:09:21.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8422000000000003e-05 2024-05-08T18:09:21.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849237+0000", 2024-05-08T18:09:21.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019469113999999999 2024-05-08T18:09:21.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849421+0000", 2024-05-08T18:09:21.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000184532 2024-05-08T18:09:21.180 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.180 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.180 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.181 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1413 3.9 3:915363b3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:21.181 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.966164+0000", 2024-05-08T18:09:21.181 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.1461714109999992, 2024-05-08T18:09:21.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024879884000000001, 2024-05-08T18:09:21.181 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.181 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.181 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.181 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.181 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.181 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.181 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1413 2024-05-08T18:09:21.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.181 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.966164+0000", 2024-05-08T18:09:21.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.966164+0000", 2024-05-08T18:09:21.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.966168+0000", 2024-05-08T18:09:21.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0570000000000003e-06 2024-05-08T18:09:21.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.974319+0000", 2024-05-08T18:09:21.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0081509930000000005 2024-05-08T18:09:21.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.974388+0000", 2024-05-08T18:09:21.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9326000000000007e-05 2024-05-08T18:09:21.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.974418+0000", 2024-05-08T18:09:21.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9519e-05 2024-05-08T18:09:21.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.974598+0000", 2024-05-08T18:09:21.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017978199999999999 2024-05-08T18:09:21.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.975002+0000", 2024-05-08T18:09:21.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000404268 2024-05-08T18:09:21.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:21.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.975430+0000", 2024-05-08T18:09:21.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042801100000000001 2024-05-08T18:09:21.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.988165+0000", 2024-05-08T18:09:21.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012734568 2024-05-08T18:09:21.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.990873+0000", 2024-05-08T18:09:21.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027083559999999999 2024-05-08T18:09:21.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.990975+0000", 2024-05-08T18:09:21.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101751 2024-05-08T18:09:21.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.991044+0000", 2024-05-08T18:09:21.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9252999999999996e-05 2024-05-08T18:09:21.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.186 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.186 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1416 3.2c e87/20 3:345ebd70:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_22:head v 87'4, mlcod=85'2)", 2024-05-08T18:09:21.186 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.001257+0000", 2024-05-08T18:09:21.186 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.1110784000000002, 2024-05-08T18:09:21.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022070702000000001, 2024-05-08T18:09:21.186 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.186 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.186 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.187 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.001257+0000", 2024-05-08T18:09:21.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.001257+0000", 2024-05-08T18:09:21.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.001259+0000", 2024-05-08T18:09:21.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1859999999999999e-06 2024-05-08T18:09:21.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004209+0000", 2024-05-08T18:09:21.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029502690000000002 2024-05-08T18:09:21.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004244+0000", 2024-05-08T18:09:21.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999998e-05 2024-05-08T18:09:21.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004261+0000", 2024-05-08T18:09:21.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6969999999999998e-05 2024-05-08T18:09:21.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004412+0000", 2024-05-08T18:09:21.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015088800000000001 2024-05-08T18:09:21.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004454+0000", 2024-05-08T18:09:21.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2076000000000002e-05 2024-05-08T18:09:21.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023211+0000", 2024-05-08T18:09:21.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018757424000000002 2024-05-08T18:09:21.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023328+0000", 2024-05-08T18:09:21.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116519 2024-05-08T18:09:21.191 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.191 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.191 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.191 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1420 3.e e87/20 3:72accb8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.8:head v 87'1, mlcod=0'0)", 2024-05-08T18:09:21.191 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.041386+0000", 2024-05-08T18:09:21.191 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.0709496909999991, 2024-05-08T18:09:21.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019066611000000001, 2024-05-08T18:09:21.191 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.191 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.192 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.192 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.041386+0000", 2024-05-08T18:09:21.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.041386+0000", 2024-05-08T18:09:21.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.041387+0000", 2024-05-08T18:09:21.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8700000000000005e-07 2024-05-08T18:09:21.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.045795+0000", 2024-05-08T18:09:21.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044083300000000002 2024-05-08T18:09:21.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.045834+0000", 2024-05-08T18:09:21.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8763000000000001e-05 2024-05-08T18:09:21.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.045853+0000", 2024-05-08T18:09:21.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9453000000000002e-05 2024-05-08T18:09:21.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.046025+0000", 2024-05-08T18:09:21.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017146800000000001 2024-05-08T18:09:21.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.046085+0000", 2024-05-08T18:09:21.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0556000000000001e-05 2024-05-08T18:09:21.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060332+0000", 2024-05-08T18:09:21.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014246801999999999 2024-05-08T18:09:21.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060452+0000", 2024-05-08T18:09:21.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120452 2024-05-08T18:09:21.196 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.196 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.196 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.196 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1426 3.3 3:c1fceb03:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:21.196 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.418434+0000", 2024-05-08T18:09:21.196 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.6939012689999995, 2024-05-08T18:09:21.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.026406447, 2024-05-08T18:09:21.196 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.196 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.196 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.197 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.197 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.197 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.197 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1426 2024-05-08T18:09:21.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.197 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.418434+0000", 2024-05-08T18:09:21.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.418434+0000", 2024-05-08T18:09:21.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.418437+0000", 2024-05-08T18:09:21.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.751e-06 2024-05-08T18:09:21.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.422567+0000", 2024-05-08T18:09:21.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041297199999999999 2024-05-08T18:09:21.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.422602+0000", 2024-05-08T18:09:21.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4898999999999999e-05 2024-05-08T18:09:21.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.422623+0000", 2024-05-08T18:09:21.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1203e-05 2024-05-08T18:09:21.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.422783+0000", 2024-05-08T18:09:21.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016033200000000001 2024-05-08T18:09:21.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.423045+0000", 2024-05-08T18:09:21.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026236199999999998 2024-05-08T18:09:21.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:21.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.423283+0000", 2024-05-08T18:09:21.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023804100000000001 2024-05-08T18:09:21.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.432169+0000", 2024-05-08T18:09:21.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0088858730000000007 2024-05-08T18:09:21.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.444662+0000", 2024-05-08T18:09:21.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012492411 2024-05-08T18:09:21.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.444765+0000", 2024-05-08T18:09:21.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103183 2024-05-08T18:09:21.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.444841+0000", 2024-05-08T18:09:21.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5672000000000003e-05 2024-05-08T18:09:21.202 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.202 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.202 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.202 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1431 3.3 3:c36c40c5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:21.203 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.506262+0000", 2024-05-08T18:09:21.203 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.6060737540000005, 2024-05-08T18:09:21.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022453905, 2024-05-08T18:09:21.203 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.203 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.203 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.203 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.203 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.203 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.203 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1431 2024-05-08T18:09:21.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.203 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.506262+0000", 2024-05-08T18:09:21.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.506262+0000", 2024-05-08T18:09:21.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.506263+0000", 2024-05-08T18:09:21.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.748e-06 2024-05-08T18:09:21.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.509983+0000", 2024-05-08T18:09:21.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037198740000000002 2024-05-08T18:09:21.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510006+0000", 2024-05-08T18:09:21.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2269999999999999e-05 2024-05-08T18:09:21.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510015+0000", 2024-05-08T18:09:21.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6579999999999997e-06 2024-05-08T18:09:21.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510105+0000", 2024-05-08T18:09:21.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9435e-05 2024-05-08T18:09:21.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510321+0000", 2024-05-08T18:09:21.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021608700000000001 2024-05-08T18:09:21.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:21.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510566+0000", 2024-05-08T18:09:21.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024504600000000001 2024-05-08T18:09:21.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.518436+0000", 2024-05-08T18:09:21.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078703409999999994 2024-05-08T18:09:21.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.528584+0000", 2024-05-08T18:09:21.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01014817 2024-05-08T18:09:21.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.528659+0000", 2024-05-08T18:09:21.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4328999999999999e-05 2024-05-08T18:09:21.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.528716+0000", 2024-05-08T18:09:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6947000000000002e-05 2024-05-08T18:09:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1454 3.1a 3:5820ba98:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.364586+0000", 2024-05-08T18:09:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 7.7477493600000003, 2024-05-08T18:09:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030504185999999999, 2024-05-08T18:09:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.209 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.210 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.210 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.210 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.210 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1454 2024-05-08T18:09:21.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.210 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.364586+0000", 2024-05-08T18:09:21.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.364586+0000", 2024-05-08T18:09:21.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.364589+0000", 2024-05-08T18:09:21.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.74e-06 2024-05-08T18:09:21.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369474+0000", 2024-05-08T18:09:21.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004885375 2024-05-08T18:09:21.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369507+0000", 2024-05-08T18:09:21.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2591e-05 2024-05-08T18:09:21.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369522+0000", 2024-05-08T18:09:21.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4997000000000001e-05 2024-05-08T18:09:21.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369610+0000", 2024-05-08T18:09:21.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8478000000000002e-05 2024-05-08T18:09:21.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369759+0000", 2024-05-08T18:09:21.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014915100000000001 2024-05-08T18:09:21.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:21.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369895+0000", 2024-05-08T18:09:21.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013564299999999999 2024-05-08T18:09:21.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.376823+0000", 2024-05-08T18:09:21.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069279820000000001 2024-05-08T18:09:21.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.394937+0000", 2024-05-08T18:09:21.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018114213000000001 2024-05-08T18:09:21.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.395021+0000", 2024-05-08T18:09:21.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3502000000000001e-05 2024-05-08T18:09:21.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.395090+0000", 2024-05-08T18:09:21.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9513999999999999e-05 2024-05-08T18:09:21.215 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.215 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.216 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.216 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1457 3.3 3:c3a85ed6:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:21.216 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.425710+0000", 2024-05-08T18:09:21.216 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 7.6866252739999998, 2024-05-08T18:09:21.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019518522, 2024-05-08T18:09:21.216 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.216 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.216 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.216 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.216 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.217 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.217 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1457 2024-05-08T18:09:21.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.217 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.425710+0000", 2024-05-08T18:09:21.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.425710+0000", 2024-05-08T18:09:21.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.425713+0000", 2024-05-08T18:09:21.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0900000000000001e-06 2024-05-08T18:09:21.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.429635+0000", 2024-05-08T18:09:21.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003921707 2024-05-08T18:09:21.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.429672+0000", 2024-05-08T18:09:21.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7552999999999998e-05 2024-05-08T18:09:21.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.429691+0000", 2024-05-08T18:09:21.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8936999999999998e-05 2024-05-08T18:09:21.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.429812+0000", 2024-05-08T18:09:21.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120865 2024-05-08T18:09:21.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.430073+0000", 2024-05-08T18:09:21.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000260573 2024-05-08T18:09:21.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:21.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.430309+0000", 2024-05-08T18:09:21.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023625100000000001 2024-05-08T18:09:21.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.439295+0000", 2024-05-08T18:09:21.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0089855349999999994 2024-05-08T18:09:21.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.445049+0000", 2024-05-08T18:09:21.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0057544299999999996 2024-05-08T18:09:21.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.445151+0000", 2024-05-08T18:09:21.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010235599999999999 2024-05-08T18:09:21.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.445229+0000", 2024-05-08T18:09:21.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7224999999999993e-05 2024-05-08T18:09:21.222 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.222 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.222 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.222 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.222 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.222 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:21.224 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:09:21.224 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:21.225+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:21.325 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:21.324+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:21.393 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:21.394 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:21.394 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:21.394 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:21.408 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:09:21.452 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:21.453+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:21.526 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:21.526 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:21.526 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:21.526 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:21.526 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:21.526 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:21.528+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:21.540 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:09:21.627 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:21.628+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:21.710 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:21.710 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:21.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:21.710 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:21.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.710 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1191 3.1d 3:b81eb771:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.710 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:21.710 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.727043354999999, 2024-05-08T18:09:21.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.029646883999999998, 2024-05-08T18:09:21.710 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.711 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.711 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.711 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.711 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.711 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.711 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1191 2024-05-08T18:09:21.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.711 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:21.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:21.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981334+0000", 2024-05-08T18:09:21.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1540000000000004e-06 2024-05-08T18:09:21.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988180+0000", 2024-05-08T18:09:21.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068463619999999999 2024-05-08T18:09:21.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988216+0000", 2024-05-08T18:09:21.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6293e-05 2024-05-08T18:09:21.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988236+0000", 2024-05-08T18:09:21.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9403e-05 2024-05-08T18:09:21.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988410+0000", 2024-05-08T18:09:21.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017415400000000001 2024-05-08T18:09:21.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988803+0000", 2024-05-08T18:09:21.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000393271 2024-05-08T18:09:21.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:21.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989175+0000", 2024-05-08T18:09:21.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037178899999999997 2024-05-08T18:09:21.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.006397+0000", 2024-05-08T18:09:21.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017221744000000001 2024-05-08T18:09:21.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010666+0000", 2024-05-08T18:09:21.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042692880000000004 2024-05-08T18:09:21.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010836+0000", 2024-05-08T18:09:21.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000169498 2024-05-08T18:09:21.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010976+0000", 2024-05-08T18:09:21.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014092799999999999 2024-05-08T18:09:21.715 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.716 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.716 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.716 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1193 3.c 3:315b87e8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.716 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.004223+0000", 2024-05-08T18:09:21.716 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.704149462, 2024-05-08T18:09:21.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019590908000000001, 2024-05-08T18:09:21.716 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.716 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.716 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.716 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.716 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.716 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.716 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1193 2024-05-08T18:09:21.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.717 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.004223+0000", 2024-05-08T18:09:21.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.004223+0000", 2024-05-08T18:09:21.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.004227+0000", 2024-05-08T18:09:21.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5130000000000001e-06 2024-05-08T18:09:21.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008665+0000", 2024-05-08T18:09:21.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044376629999999997 2024-05-08T18:09:21.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008697+0000", 2024-05-08T18:09:21.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2783000000000001e-05 2024-05-08T18:09:21.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008715+0000", 2024-05-08T18:09:21.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7713000000000001e-05 2024-05-08T18:09:21.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008840+0000", 2024-05-08T18:09:21.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000124578 2024-05-08T18:09:21.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.009091+0000", 2024-05-08T18:09:21.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000251146 2024-05-08T18:09:21.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:21.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.009323+0000", 2024-05-08T18:09:21.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000232127 2024-05-08T18:09:21.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023324+0000", 2024-05-08T18:09:21.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014000574999999999 2024-05-08T18:09:21.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023459+0000", 2024-05-08T18:09:21.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013494099999999999 2024-05-08T18:09:21.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023644+0000", 2024-05-08T18:09:21.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018532100000000001 2024-05-08T18:09:21.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023814+0000", 2024-05-08T18:09:21.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017054799999999999 2024-05-08T18:09:21.721 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.721 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.721 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.721 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1194 3.16 3:6b2325a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.721 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:21.722 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.692897436999999, 2024-05-08T18:09:21.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030556241000000001, 2024-05-08T18:09:21.722 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.722 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.722 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.722 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.722 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.722 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.722 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1194 2024-05-08T18:09:21.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.722 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:21.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:21.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015492+0000", 2024-05-08T18:09:21.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6863000000000001e-05 2024-05-08T18:09:21.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019937+0000", 2024-05-08T18:09:21.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044450399999999999 2024-05-08T18:09:21.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019975+0000", 2024-05-08T18:09:21.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7676000000000003e-05 2024-05-08T18:09:21.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019995+0000", 2024-05-08T18:09:21.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.969e-05 2024-05-08T18:09:21.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020165+0000", 2024-05-08T18:09:21.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017003400000000001 2024-05-08T18:09:21.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020437+0000", 2024-05-08T18:09:21.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027198599999999999 2024-05-08T18:09:21.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:21.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020668+0000", 2024-05-08T18:09:21.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023154 2024-05-08T18:09:21.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.032879+0000", 2024-05-08T18:09:21.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012210883000000001 2024-05-08T18:09:21.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045595+0000", 2024-05-08T18:09:21.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012716005000000001 2024-05-08T18:09:21.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045811+0000", 2024-05-08T18:09:21.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021556400000000001 2024-05-08T18:09:21.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.046032+0000", 2024-05-08T18:09:21.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022096 2024-05-08T18:09:21.727 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.727 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.727 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.727 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1195 3.28 3:155acd84:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.727 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:21.727 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.682750115999999, 2024-05-08T18:09:21.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020411840000000001, 2024-05-08T18:09:21.727 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.727 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.727 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.728 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.728 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.728 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.728 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1195 2024-05-08T18:09:21.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.728 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:21.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:21.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025626+0000", 2024-05-08T18:09:21.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4699999999999998e-06 2024-05-08T18:09:21.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030167+0000", 2024-05-08T18:09:21.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045406709999999996 2024-05-08T18:09:21.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030204+0000", 2024-05-08T18:09:21.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6736000000000002e-05 2024-05-08T18:09:21.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030222+0000", 2024-05-08T18:09:21.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.823e-05 2024-05-08T18:09:21.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030337+0000", 2024-05-08T18:09:21.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114695 2024-05-08T18:09:21.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030565+0000", 2024-05-08T18:09:21.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000228173 2024-05-08T18:09:21.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:21.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030770+0000", 2024-05-08T18:09:21.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020505400000000001 2024-05-08T18:09:21.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044362+0000", 2024-05-08T18:09:21.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013591814000000001 2024-05-08T18:09:21.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045754+0000", 2024-05-08T18:09:21.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013923710000000001 2024-05-08T18:09:21.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045903+0000", 2024-05-08T18:09:21.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014878800000000001 2024-05-08T18:09:21.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.046035+0000", 2024-05-08T18:09:21.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013183800000000001 2024-05-08T18:09:21.732 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.732 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.732 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.733 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1209 3.35 e85/20 3:af4c6abe:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_21:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:21.733 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:21.733 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.527921827, 2024-05-08T18:09:21.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021767585999999998, 2024-05-08T18:09:21.733 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.733 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.733 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.733 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:21.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:21.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180452+0000", 2024-05-08T18:09:21.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4000000000000002e-07 2024-05-08T18:09:21.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183165+0000", 2024-05-08T18:09:21.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027135269999999999 2024-05-08T18:09:21.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183208+0000", 2024-05-08T18:09:21.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2599000000000003e-05 2024-05-08T18:09:21.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183239+0000", 2024-05-08T18:09:21.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999997e-05 2024-05-08T18:09:21.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183369+0000", 2024-05-08T18:09:21.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000130338 2024-05-08T18:09:21.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183407+0000", 2024-05-08T18:09:21.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8213000000000002e-05 2024-05-08T18:09:21.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202127+0000", 2024-05-08T18:09:21.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018719906000000001 2024-05-08T18:09:21.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202219+0000", 2024-05-08T18:09:21.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1533000000000006e-05 2024-05-08T18:09:21.736 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.736 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.736 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.737 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1218 3.c 3:33b8068a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.737 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:21.737 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.146093934, 2024-05-08T18:09:21.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024735007, 2024-05-08T18:09:21.737 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.737 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.737 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.737 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.737 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.737 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.737 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1218 2024-05-08T18:09:21.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.737 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:21.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:21.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562282+0000", 2024-05-08T18:09:21.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7769999999999998e-06 2024-05-08T18:09:21.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568816+0000", 2024-05-08T18:09:21.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065338169999999999 2024-05-08T18:09:21.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568851+0000", 2024-05-08T18:09:21.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5892999999999997e-05 2024-05-08T18:09:21.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568871+0000", 2024-05-08T18:09:21.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9306000000000001e-05 2024-05-08T18:09:21.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568992+0000", 2024-05-08T18:09:21.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120925 2024-05-08T18:09:21.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.569258+0000", 2024-05-08T18:09:21.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026655299999999999 2024-05-08T18:09:21.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:21.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.569522+0000", 2024-05-08T18:09:21.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026331999999999999 2024-05-08T18:09:21.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584269+0000", 2024-05-08T18:09:21.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014747454 2024-05-08T18:09:21.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.586687+0000", 2024-05-08T18:09:21.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024181770000000001 2024-05-08T18:09:21.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.586888+0000", 2024-05-08T18:09:21.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000201137 2024-05-08T18:09:21.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.587014+0000", 2024-05-08T18:09:21.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012564799999999999 2024-05-08T18:09:21.742 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.742 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.742 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.742 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1220 3.c 3:319326d6:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.742 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:21.742 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.123406359000001, 2024-05-08T18:09:21.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022305417000000001, 2024-05-08T18:09:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1220 2024-05-08T18:09:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:21.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584971+0000", 2024-05-08T18:09:21.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0729999999999998e-06 2024-05-08T18:09:21.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591515+0000", 2024-05-08T18:09:21.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065448340000000002 2024-05-08T18:09:21.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591549+0000", 2024-05-08T18:09:21.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3633000000000001e-05 2024-05-08T18:09:21.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591574+0000", 2024-05-08T18:09:21.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4482999999999999e-05 2024-05-08T18:09:21.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591714+0000", 2024-05-08T18:09:21.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014048500000000001 2024-05-08T18:09:21.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591956+0000", 2024-05-08T18:09:21.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000241616 2024-05-08T18:09:21.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:21.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.592181+0000", 2024-05-08T18:09:21.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022565000000000001 2024-05-08T18:09:21.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.606237+0000", 2024-05-08T18:09:21.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014055646999999999 2024-05-08T18:09:21.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607095+0000", 2024-05-08T18:09:21.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085838199999999998 2024-05-08T18:09:21.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607189+0000", 2024-05-08T18:09:21.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3962000000000006e-05 2024-05-08T18:09:21.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607272+0000", 2024-05-08T18:09:21.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2651999999999994e-05 2024-05-08T18:09:21.748 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.748 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.748 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.748 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1222 3.38 e85/20 3:1f451ee1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_6:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:21.748 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.607187+0000", 2024-05-08T18:09:21.748 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.101185877000001, 2024-05-08T18:09:21.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018422048, 2024-05-08T18:09:21.748 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.748 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.748 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.748 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607187+0000", 2024-05-08T18:09:21.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607187+0000", 2024-05-08T18:09:21.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607188+0000", 2024-05-08T18:09:21.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2860000000000001e-06 2024-05-08T18:09:21.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.611823+0000", 2024-05-08T18:09:21.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046346010000000003 2024-05-08T18:09:21.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.611855+0000", 2024-05-08T18:09:21.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1572999999999997e-05 2024-05-08T18:09:21.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.611870+0000", 2024-05-08T18:09:21.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5129e-05 2024-05-08T18:09:21.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.612015+0000", 2024-05-08T18:09:21.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000145618 2024-05-08T18:09:21.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.612075+0000", 2024-05-08T18:09:21.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9692999999999999e-05 2024-05-08T18:09:21.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625482+0000", 2024-05-08T18:09:21.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013406998999999999 2024-05-08T18:09:21.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625609+0000", 2024-05-08T18:09:21.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012714900000000001 2024-05-08T18:09:21.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.752 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.752 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1229 3.16 3:6ad6b699:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.752 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.724599+0000", 2024-05-08T18:09:21.752 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.983774304000001, 2024-05-08T18:09:21.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018735992999999999, 2024-05-08T18:09:21.752 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.753 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.753 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.753 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.753 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.753 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.753 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1229 2024-05-08T18:09:21.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.753 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.724599+0000", 2024-05-08T18:09:21.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.724599+0000", 2024-05-08T18:09:21.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.724602+0000", 2024-05-08T18:09:21.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999999e-06 2024-05-08T18:09:21.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728621+0000", 2024-05-08T18:09:21.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040188649999999999 2024-05-08T18:09:21.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728658+0000", 2024-05-08T18:09:21.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7722999999999998e-05 2024-05-08T18:09:21.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728677+0000", 2024-05-08T18:09:21.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9000000000000001e-05 2024-05-08T18:09:21.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728876+0000", 2024-05-08T18:09:21.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019832300000000001 2024-05-08T18:09:21.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.729122+0000", 2024-05-08T18:09:21.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024644700000000001 2024-05-08T18:09:21.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:21.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.729371+0000", 2024-05-08T18:09:21.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000249087 2024-05-08T18:09:21.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.738186+0000", 2024-05-08T18:09:21.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0088147859999999998 2024-05-08T18:09:21.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.743162+0000", 2024-05-08T18:09:21.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049762909999999999 2024-05-08T18:09:21.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.743263+0000", 2024-05-08T18:09:21.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010037199999999999 2024-05-08T18:09:21.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.743335+0000", 2024-05-08T18:09:21.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2006000000000001e-05 2024-05-08T18:09:21.757 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.757 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.758 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.758 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1242 3.28 3:16e2765f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.2:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.758 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:21.758 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.731760591, 2024-05-08T18:09:21.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020212443, 2024-05-08T18:09:21.758 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.758 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.758 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.758 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.758 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.758 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.758 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1242 2024-05-08T18:09:21.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.759 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:21.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:21.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976615+0000", 2024-05-08T18:09:21.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6170000000000001e-06 2024-05-08T18:09:21.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980655+0000", 2024-05-08T18:09:21.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040399240000000003 2024-05-08T18:09:21.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980693+0000", 2024-05-08T18:09:21.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7996e-05 2024-05-08T18:09:21.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980717+0000", 2024-05-08T18:09:21.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.459e-05 2024-05-08T18:09:21.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980811+0000", 2024-05-08T18:09:21.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3931000000000006e-05 2024-05-08T18:09:21.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980965+0000", 2024-05-08T18:09:21.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015315500000000001 2024-05-08T18:09:21.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:21.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.981450+0000", 2024-05-08T18:09:21.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000485632 2024-05-08T18:09:21.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.991160+0000", 2024-05-08T18:09:21.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.009709858 2024-05-08T18:09:21.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996726+0000", 2024-05-08T18:09:21.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055655039999999998 2024-05-08T18:09:21.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996786+0000", 2024-05-08T18:09:21.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0511999999999999e-05 2024-05-08T18:09:21.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996825+0000", 2024-05-08T18:09:21.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8723999999999997e-05 2024-05-08T18:09:21.763 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.763 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.763 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.763 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1247 3.c 3:32aac358:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.763 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.370612+0000", 2024-05-08T18:09:21.764 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.337760993, 2024-05-08T18:09:21.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019632920000000002, 2024-05-08T18:09:21.764 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.764 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.764 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.764 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.764 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.764 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.764 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1247 2024-05-08T18:09:21.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.764 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.370612+0000", 2024-05-08T18:09:21.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.370612+0000", 2024-05-08T18:09:21.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.370615+0000", 2024-05-08T18:09:21.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.559e-06 2024-05-08T18:09:21.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374436+0000", 2024-05-08T18:09:21.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038219460000000001 2024-05-08T18:09:21.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374465+0000", 2024-05-08T18:09:21.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8347000000000002e-05 2024-05-08T18:09:21.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374476+0000", 2024-05-08T18:09:21.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1334e-05 2024-05-08T18:09:21.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374553+0000", 2024-05-08T18:09:21.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6555000000000001e-05 2024-05-08T18:09:21.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374667+0000", 2024-05-08T18:09:21.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114732 2024-05-08T18:09:21.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:21.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374764+0000", 2024-05-08T18:09:21.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6527000000000006e-05 2024-05-08T18:09:21.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.382209+0000", 2024-05-08T18:09:21.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074447309999999996 2024-05-08T18:09:21.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.390135+0000", 2024-05-08T18:09:21.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079259099999999996 2024-05-08T18:09:21.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.390185+0000", 2024-05-08T18:09:21.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0834999999999997e-05 2024-05-08T18:09:21.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.390245+0000", 2024-05-08T18:09:21.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9444000000000002e-05 2024-05-08T18:09:21.768 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.768 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.769 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.769 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1281 3.c 3:30308c7a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:21.769 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.141519+0000", 2024-05-08T18:09:21.769 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.566853828999999, 2024-05-08T18:09:21.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018327742000000001, 2024-05-08T18:09:21.769 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.769 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.769 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.769 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.769 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.769 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.769 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1281 2024-05-08T18:09:21.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.770 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.141519+0000", 2024-05-08T18:09:21.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.141519+0000", 2024-05-08T18:09:21.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.141522+0000", 2024-05-08T18:09:21.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1839999999999999e-06 2024-05-08T18:09:21.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.145451+0000", 2024-05-08T18:09:21.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039283859999999999 2024-05-08T18:09:21.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.145479+0000", 2024-05-08T18:09:21.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8367000000000001e-05 2024-05-08T18:09:21.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.145496+0000", 2024-05-08T18:09:21.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6738000000000001e-05 2024-05-08T18:09:21.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.145700+0000", 2024-05-08T18:09:21.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020385600000000001 2024-05-08T18:09:21.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.146014+0000", 2024-05-08T18:09:21.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000313942 2024-05-08T18:09:21.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:21.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.146166+0000", 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152535 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.155416+0000", 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092500450000000001 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.159699+0000", 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042826390000000004 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.159787+0000", 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7820999999999998e-05 2024-05-08T18:09:21.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.159847+0000", 2024-05-08T18:09:21.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0229000000000002e-05 2024-05-08T18:09:21.774 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.774 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.774 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.774 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1395 3.17 e87/20 3:eb9c68a5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_1:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:21.774 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.771843+0000", 2024-05-08T18:09:21.774 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.9365297150000007, 2024-05-08T18:09:21.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021322812, 2024-05-08T18:09:21.774 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.774 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.774 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.775 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.771843+0000", 2024-05-08T18:09:21.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.771843+0000", 2024-05-08T18:09:21.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.771844+0000", 2024-05-08T18:09:21.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0999999999999999e-07 2024-05-08T18:09:21.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.778254+0000", 2024-05-08T18:09:21.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064103859999999997 2024-05-08T18:09:21.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.778286+0000", 2024-05-08T18:09:21.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2113000000000002e-05 2024-05-08T18:09:21.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.778307+0000", 2024-05-08T18:09:21.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1158999999999999e-05 2024-05-08T18:09:21.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.779027+0000", 2024-05-08T18:09:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00071950400000000004 2024-05-08T18:09:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.779083+0000", 2024-05-08T18:09:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6512999999999999e-05 2024-05-08T18:09:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.793025+0000", 2024-05-08T18:09:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013941782999999999 2024-05-08T18:09:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.793166+0000", 2024-05-08T18:09:21.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140844 2024-05-08T18:09:21.778 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.778 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.778 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.778 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1400 3.1c 3:3bb95565:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:21.778 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:21.778 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.879623745, 2024-05-08T18:09:21.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02650396, 2024-05-08T18:09:21.778 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.778 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.778 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.779 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.779 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.779 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.779 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1400 2024-05-08T18:09:21.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.779 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:21.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:21.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828753+0000", 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4400000000000001e-06 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836255+0000", 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0075026379999999998 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836312+0000", 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6459000000000003e-05 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836340+0000", 2024-05-08T18:09:21.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8183000000000001e-05 2024-05-08T18:09:21.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836510+0000", 2024-05-08T18:09:21.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000169805 2024-05-08T18:09:21.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836763+0000", 2024-05-08T18:09:21.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025333700000000002 2024-05-08T18:09:21.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:21.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836995+0000", 2024-05-08T18:09:21.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023236700000000001 2024-05-08T18:09:21.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849771+0000", 2024-05-08T18:09:21.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012775760000000001 2024-05-08T18:09:21.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855089+0000", 2024-05-08T18:09:21.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0053173889999999996 2024-05-08T18:09:21.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855183+0000", 2024-05-08T18:09:21.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4276000000000003e-05 2024-05-08T18:09:21.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855253+0000", 2024-05-08T18:09:21.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0306000000000001e-05 2024-05-08T18:09:21.783 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.783 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.783 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.783 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1405 3.c 3:3166280d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:21.783 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:21.784 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8270573100000007, 2024-05-08T18:09:21.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023065800000000001, 2024-05-08T18:09:21.784 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.784 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.784 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.784 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.784 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.784 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.784 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1405 2024-05-08T18:09:21.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.784 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:21.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:21.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881320+0000", 2024-05-08T18:09:21.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-05-08T18:09:21.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887255+0000", 2024-05-08T18:09:21.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059351509999999996 2024-05-08T18:09:21.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887305+0000", 2024-05-08T18:09:21.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9579000000000001e-05 2024-05-08T18:09:21.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887332+0000", 2024-05-08T18:09:21.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7276000000000001e-05 2024-05-08T18:09:21.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887489+0000", 2024-05-08T18:09:21.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000156465 2024-05-08T18:09:21.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887745+0000", 2024-05-08T18:09:21.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025626700000000002 2024-05-08T18:09:21.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:21.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887980+0000", 2024-05-08T18:09:21.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000235107 2024-05-08T18:09:21.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.896366+0000", 2024-05-08T18:09:21.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083860870000000004 2024-05-08T18:09:21.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904214+0000", 2024-05-08T18:09:21.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078482840000000005 2024-05-08T18:09:21.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904312+0000", 2024-05-08T18:09:21.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7901999999999999e-05 2024-05-08T18:09:21.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904381+0000", 2024-05-08T18:09:21.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9258999999999995e-05 2024-05-08T18:09:21.789 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.789 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.789 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.789 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1410 3.30 3:0e0f1cce:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:21.789 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:21.789 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.7738323339999997, 2024-05-08T18:09:21.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.026130820999999999, 2024-05-08T18:09:21.789 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.789 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.789 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.789 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.789 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.789 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.790 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1410 2024-05-08T18:09:21.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.790 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:21.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:21.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934544+0000", 2024-05-08T18:09:21.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2600000000000001e-06 2024-05-08T18:09:21.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939363+0000", 2024-05-08T18:09:21.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048190020000000002 2024-05-08T18:09:21.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939407+0000", 2024-05-08T18:09:21.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3999999999999999e-05 2024-05-08T18:09:21.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939428+0000", 2024-05-08T18:09:21.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0746000000000001e-05 2024-05-08T18:09:21.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939637+0000", 2024-05-08T18:09:21.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000209397 2024-05-08T18:09:21.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939894+0000", 2024-05-08T18:09:21.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025690700000000001 2024-05-08T18:09:21.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:21.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.940133+0000", 2024-05-08T18:09:21.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023939400000000001 2024-05-08T18:09:21.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.949842+0000", 2024-05-08T18:09:21.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0097087570000000002 2024-05-08T18:09:21.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960494+0000", 2024-05-08T18:09:21.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01065148 2024-05-08T18:09:21.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960597+0000", 2024-05-08T18:09:21.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103529 2024-05-08T18:09:21.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960671+0000", 2024-05-08T18:09:21.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4349000000000003e-05 2024-05-08T18:09:21.794 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.794 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.794 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.794 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1446 3.22 3:44011652:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:21.794 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:21.794 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.8334507010000003, 2024-05-08T18:09:21.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024780153999999999, 2024-05-08T18:09:21.795 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.795 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.795 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.795 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.795 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.795 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.795 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1446 2024-05-08T18:09:21.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.795 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:21.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:21.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874926+0000", 2024-05-08T18:09:21.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2739999999999999e-06 2024-05-08T18:09:21.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879812+0000", 2024-05-08T18:09:21.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048860040000000002 2024-05-08T18:09:21.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879849+0000", 2024-05-08T18:09:21.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7919000000000001e-05 2024-05-08T18:09:21.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879868+0000", 2024-05-08T18:09:21.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8836999999999999e-05 2024-05-08T18:09:21.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880042+0000", 2024-05-08T18:09:21.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173981 2024-05-08T18:09:21.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880452+0000", 2024-05-08T18:09:21.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040949200000000002 2024-05-08T18:09:21.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:21.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880849+0000", 2024-05-08T18:09:21.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039710499999999997 2024-05-08T18:09:21.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.892821+0000", 2024-05-08T18:09:21.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011972287 2024-05-08T18:09:21.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899596+0000", 2024-05-08T18:09:21.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067744720000000001 2024-05-08T18:09:21.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899655+0000", 2024-05-08T18:09:21.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9119000000000001e-05 2024-05-08T18:09:21.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899702+0000", 2024-05-08T18:09:21.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7664000000000003e-05 2024-05-08T18:09:21.799 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.800 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.800 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.800 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1458 3.30 3:0e1bd441:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:21.800 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.449355+0000", 2024-05-08T18:09:21.800 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.2590175830000003, 2024-05-08T18:09:21.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019757651000000001, 2024-05-08T18:09:21.800 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.800 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.800 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.800 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.800 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.800 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.801 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1458 2024-05-08T18:09:21.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.801 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.449355+0000", 2024-05-08T18:09:21.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.449355+0000", 2024-05-08T18:09:21.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.449359+0000", 2024-05-08T18:09:21.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2739999999999999e-06 2024-05-08T18:09:21.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.453851+0000", 2024-05-08T18:09:21.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004492495 2024-05-08T18:09:21.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.453897+0000", 2024-05-08T18:09:21.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6026999999999998e-05 2024-05-08T18:09:21.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.453917+0000", 2024-05-08T18:09:21.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0132999999999998e-05 2024-05-08T18:09:21.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.454019+0000", 2024-05-08T18:09:21.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101545 2024-05-08T18:09:21.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.454187+0000", 2024-05-08T18:09:21.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016848199999999999 2024-05-08T18:09:21.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:21.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.454341+0000", 2024-05-08T18:09:21.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015391999999999999 2024-05-08T18:09:21.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.463479+0000", 2024-05-08T18:09:21.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0091377230000000004 2024-05-08T18:09:21.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.469032+0000", 2024-05-08T18:09:21.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055529619999999998 2024-05-08T18:09:21.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.469075+0000", 2024-05-08T18:09:21.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3417999999999997e-05 2024-05-08T18:09:21.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.469113+0000", 2024-05-08T18:09:21.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7672000000000001e-05 2024-05-08T18:09:21.806 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.806 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.806 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.806 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1463 3.17 e87/20 3:ebd3133d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_13:head v 87'3, mlcod=85'1)", 2024-05-08T18:09:21.806 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.573059+0000", 2024-05-08T18:09:21.806 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.1353137259999997, 2024-05-08T18:09:21.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019808240000000001, 2024-05-08T18:09:21.806 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.806 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.806 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.806 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.573059+0000", 2024-05-08T18:09:21.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.573059+0000", 2024-05-08T18:09:21.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.573062+0000", 2024-05-08T18:09:21.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3760000000000002e-06 2024-05-08T18:09:21.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579565+0000", 2024-05-08T18:09:21.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065034109999999997 2024-05-08T18:09:21.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579601+0000", 2024-05-08T18:09:21.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6329999999999999e-05 2024-05-08T18:09:21.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579619+0000", 2024-05-08T18:09:21.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7980000000000001e-05 2024-05-08T18:09:21.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579718+0000", 2024-05-08T18:09:21.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8887000000000004e-05 2024-05-08T18:09:21.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579753+0000", 2024-05-08T18:09:21.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5006000000000003e-05 2024-05-08T18:09:21.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.592778+0000", 2024-05-08T18:09:21.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013024803999999999 2024-05-08T18:09:21.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.592867+0000", 2024-05-08T18:09:21.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9445999999999997e-05 2024-05-08T18:09:21.810 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.810 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.810 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.810 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1464 3.2f 3:f7dca4bf:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:21.810 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.583146+0000", 2024-05-08T18:09:21.811 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.1252264660000009, 2024-05-08T18:09:21.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022519284000000001, 2024-05-08T18:09:21.811 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:21.811 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:21.811 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:21.811 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:21.811 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:21.811 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:21.811 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1464 2024-05-08T18:09:21.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.811 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:21.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:21.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.583146+0000", 2024-05-08T18:09:21.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:21.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.583146+0000", 2024-05-08T18:09:21.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:21.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:21.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.583149+0000", 2024-05-08T18:09:21.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5600000000000001e-06 2024-05-08T18:09:21.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:21.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.586965+0000", 2024-05-08T18:09:21.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003816131 2024-05-08T18:09:21.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:21.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.586991+0000", 2024-05-08T18:09:21.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5508e-05 2024-05-08T18:09:21.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:21.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587005+0000", 2024-05-08T18:09:21.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4029000000000001e-05 2024-05-08T18:09:21.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:21.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587087+0000", 2024-05-08T18:09:21.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2056000000000002e-05 2024-05-08T18:09:21.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:21.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587293+0000", 2024-05-08T18:09:21.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020639000000000001 2024-05-08T18:09:21.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:21.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587503+0000", 2024-05-08T18:09:21.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020987299999999999 2024-05-08T18:09:21.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:21.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.598739+0000", 2024-05-08T18:09:21.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011236237 2024-05-08T18:09:21.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:21.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.605521+0000", 2024-05-08T18:09:21.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067817049999999999 2024-05-08T18:09:21.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:21.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.605602+0000", 2024-05-08T18:09:21.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1225999999999998e-05 2024-05-08T18:09:21.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:21.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:21.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:21.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.605666+0000", 2024-05-08T18:09:21.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3569000000000001e-05 2024-05-08T18:09:21.816 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.816 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.816 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.816 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:21.816 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:21.816 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:21.818 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:09:21.818 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:21.817+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:21.918 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:21.917+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:21.988 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:21.989 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:21.989 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:21.989 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:22.003 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:09:22.044 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:22.045+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:22.120 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:22.120+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:22.167 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:22.167 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:22.167 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:22.167 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:22.168 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:22.182 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:09:22.220 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:22.220+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:22.308 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:22.309 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:22.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:22.309 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:22.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.309 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:09:22.309 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:22.309 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 118.771357091, 2024-05-08T18:09:22.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.032012946, 2024-05-08T18:09:22.309 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.309 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.309 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.309 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.310 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.310 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.310 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:09:22.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.310 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:22.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:22.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535484+0000", 2024-05-08T18:09:22.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7929999999999999e-06 2024-05-08T18:09:22.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535500+0000", 2024-05-08T18:09:22.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5226e-05 2024-05-08T18:09:22.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535535+0000", 2024-05-08T18:09:22.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5213000000000003e-05 2024-05-08T18:09:22.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535564+0000", 2024-05-08T18:09:22.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9360999999999999e-05 2024-05-08T18:09:22.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535757+0000", 2024-05-08T18:09:22.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000193229 2024-05-08T18:09:22.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:22.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535775+0000", 2024-05-08T18:09:22.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7098000000000001e-05 2024-05-08T18:09:22.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556004+0000", 2024-05-08T18:09:22.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020229068999999999 2024-05-08T18:09:22.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:22.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556036+0000", 2024-05-08T18:09:22.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1943000000000002e-05 2024-05-08T18:09:22.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.564721+0000", 2024-05-08T18:09:22.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086853320000000005 2024-05-08T18:09:22.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565032+0000", 2024-05-08T18:09:22.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031121799999999999 2024-05-08T18:09:22.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:22.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565365+0000", 2024-05-08T18:09:22.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000332744 2024-05-08T18:09:22.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567305+0000", 2024-05-08T18:09:22.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00194016 2024-05-08T18:09:22.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567368+0000", 2024-05-08T18:09:22.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3342000000000004e-05 2024-05-08T18:09:22.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567433+0000", 2024-05-08T18:09:22.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4726000000000003e-05 2024-05-08T18:09:22.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567494+0000", 2024-05-08T18:09:22.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0492000000000003e-05 2024-05-08T18:09:22.320 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.320 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.320 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.321 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1189 3.20 3:054e8a9f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:22.321 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:22.321 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.346667685, 2024-05-08T18:09:22.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025093629999999999, 2024-05-08T18:09:22.321 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.321 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.321 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.321 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.321 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.321 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.321 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1189 2024-05-08T18:09:22.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.321 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:22.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:22.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960173+0000", 2024-05-08T18:09:22.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.65e-06 2024-05-08T18:09:22.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965720+0000", 2024-05-08T18:09:22.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055476340000000001 2024-05-08T18:09:22.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965757+0000", 2024-05-08T18:09:22.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6223000000000002e-05 2024-05-08T18:09:22.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965774+0000", 2024-05-08T18:09:22.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6952999999999998e-05 2024-05-08T18:09:22.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965930+0000", 2024-05-08T18:09:22.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015611800000000001 2024-05-08T18:09:22.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966190+0000", 2024-05-08T18:09:22.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025999399999999999 2024-05-08T18:09:22.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:22.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966440+0000", 2024-05-08T18:09:22.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025007600000000001 2024-05-08T18:09:22.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981042+0000", 2024-05-08T18:09:22.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01460257 2024-05-08T18:09:22.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.984969+0000", 2024-05-08T18:09:22.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039265159999999997 2024-05-08T18:09:22.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985135+0000", 2024-05-08T18:09:22.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016630400000000001 2024-05-08T18:09:22.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985264+0000", 2024-05-08T18:09:22.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012859199999999999 2024-05-08T18:09:22.327 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.327 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.327 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.327 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1209 3.35 3:af4c6abe:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:22.327 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:22.327 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.131406038, 2024-05-08T18:09:22.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027313356, 2024-05-08T18:09:22.328 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.328 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.328 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.328 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.328 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.328 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.328 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1209 2024-05-08T18:09:22.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.328 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:22.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:22.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175436+0000", 2024-05-08T18:09:22.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3800000000000004e-06 2024-05-08T18:09:22.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179472+0000", 2024-05-08T18:09:22.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040357020000000004 2024-05-08T18:09:22.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179515+0000", 2024-05-08T18:09:22.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2988999999999998e-05 2024-05-08T18:09:22.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179534+0000", 2024-05-08T18:09:22.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8743e-05 2024-05-08T18:09:22.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179673+0000", 2024-05-08T18:09:22.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013983800000000001 2024-05-08T18:09:22.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179933+0000", 2024-05-08T18:09:22.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025967999999999998 2024-05-08T18:09:22.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:22.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180161+0000", 2024-05-08T18:09:22.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022826300000000001 2024-05-08T18:09:22.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.200613+0000", 2024-05-08T18:09:22.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020451766999999999 2024-05-08T18:09:22.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202567+0000", 2024-05-08T18:09:22.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019541160000000001 2024-05-08T18:09:22.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202665+0000", 2024-05-08T18:09:22.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8055999999999998e-05 2024-05-08T18:09:22.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202745+0000", 2024-05-08T18:09:22.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9821999999999996e-05 2024-05-08T18:09:22.333 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.333 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1221 3.20 3:071d1257:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.712091163, 2024-05-08T18:09:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02822473, 2024-05-08T18:09:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.335 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.335 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1221 2024-05-08T18:09:22.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.335 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:22.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:22.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594751+0000", 2024-05-08T18:09:22.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3769999999999998e-06 2024-05-08T18:09:22.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600627+0000", 2024-05-08T18:09:22.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058764389999999998 2024-05-08T18:09:22.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600672+0000", 2024-05-08T18:09:22.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4805999999999998e-05 2024-05-08T18:09:22.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600704+0000", 2024-05-08T18:09:22.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2026000000000001e-05 2024-05-08T18:09:22.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600884+0000", 2024-05-08T18:09:22.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000179385 2024-05-08T18:09:22.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601296+0000", 2024-05-08T18:09:22.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041257400000000002 2024-05-08T18:09:22.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:22.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601742+0000", 2024-05-08T18:09:22.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044585399999999998 2024-05-08T18:09:22.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.617360+0000", 2024-05-08T18:09:22.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015617982000000001 2024-05-08T18:09:22.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622618+0000", 2024-05-08T18:09:22.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052577420000000001 2024-05-08T18:09:22.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622835+0000", 2024-05-08T18:09:22.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021674699999999999 2024-05-08T18:09:22.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622971+0000", 2024-05-08T18:09:22.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679799999999999 2024-05-08T18:09:22.340 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.340 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.340 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.341 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1223 3.2e e85/20 3:74a5b043:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_7:head v 85'3, mlcod=85'1)", 2024-05-08T18:09:22.341 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.619798+0000", 2024-05-08T18:09:22.341 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.687039333, 2024-05-08T18:09:22.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018211183999999998, 2024-05-08T18:09:22.341 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.341 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.341 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.341 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.619798+0000", 2024-05-08T18:09:22.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.619798+0000", 2024-05-08T18:09:22.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.619801+0000", 2024-05-08T18:09:22.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7e-06 2024-05-08T18:09:22.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625096+0000", 2024-05-08T18:09:22.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052944369999999999 2024-05-08T18:09:22.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625126+0000", 2024-05-08T18:09:22.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0960000000000002e-05 2024-05-08T18:09:22.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625165+0000", 2024-05-08T18:09:22.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8136000000000002e-05 2024-05-08T18:09:22.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625291+0000", 2024-05-08T18:09:22.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012613500000000001 2024-05-08T18:09:22.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625349+0000", 2024-05-08T18:09:22.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8495999999999997e-05 2024-05-08T18:09:22.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.637877+0000", 2024-05-08T18:09:22.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012527652 2024-05-08T18:09:22.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638010+0000", 2024-05-08T18:09:22.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013266800000000001 2024-05-08T18:09:22.345 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.345 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.345 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.345 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1263 3.36 3:6eb7bd8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:22.346 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.571418+0000", 2024-05-08T18:09:22.346 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.735419834, 2024-05-08T18:09:22.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018084347000000001, 2024-05-08T18:09:22.346 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.346 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.346 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.346 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.346 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.346 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.346 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1263 2024-05-08T18:09:22.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.347 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.571418+0000", 2024-05-08T18:09:22.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.571418+0000", 2024-05-08T18:09:22.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.571420+0000", 2024-05-08T18:09:22.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3860000000000001e-06 2024-05-08T18:09:22.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575201+0000", 2024-05-08T18:09:22.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037802589999999998 2024-05-08T18:09:22.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575225+0000", 2024-05-08T18:09:22.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4134999999999998e-05 2024-05-08T18:09:22.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575237+0000", 2024-05-08T18:09:22.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2425999999999999e-05 2024-05-08T18:09:22.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575315+0000", 2024-05-08T18:09:22.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7621999999999996e-05 2024-05-08T18:09:22.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575474+0000", 2024-05-08T18:09:22.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015942699999999999 2024-05-08T18:09:22.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:22.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.575606+0000", 2024-05-08T18:09:22.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013143200000000001 2024-05-08T18:09:22.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.589176+0000", 2024-05-08T18:09:22.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013570863000000001 2024-05-08T18:09:22.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.589303+0000", 2024-05-08T18:09:22.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126067 2024-05-08T18:09:22.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.589421+0000", 2024-05-08T18:09:22.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118311 2024-05-08T18:09:22.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.589502+0000", 2024-05-08T18:09:22.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1419000000000001e-05 2024-05-08T18:09:22.352 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.352 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.352 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.352 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1268 3.36 3:6efaad9c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:22.352 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.629292+0000", 2024-05-08T18:09:22.352 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.677545685, 2024-05-08T18:09:22.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018691711, 2024-05-08T18:09:22.352 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.352 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.353 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.353 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.353 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.353 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.353 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1268 2024-05-08T18:09:22.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.353 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.629292+0000", 2024-05-08T18:09:22.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.629292+0000", 2024-05-08T18:09:22.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.629295+0000", 2024-05-08T18:09:22.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5799999999999999e-06 2024-05-08T18:09:22.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633104+0000", 2024-05-08T18:09:22.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038088869999999999 2024-05-08T18:09:22.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633130+0000", 2024-05-08T18:09:22.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6016e-05 2024-05-08T18:09:22.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633144+0000", 2024-05-08T18:09:22.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3971999999999999e-05 2024-05-08T18:09:22.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633229+0000", 2024-05-08T18:09:22.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5749999999999997e-05 2024-05-08T18:09:22.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633349+0000", 2024-05-08T18:09:22.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011934000000000001 2024-05-08T18:09:22.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:22.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633507+0000", 2024-05-08T18:09:22.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015834700000000001 2024-05-08T18:09:22.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.639941+0000", 2024-05-08T18:09:22.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064341449999999996 2024-05-08T18:09:22.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.647803+0000", 2024-05-08T18:09:22.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078617889999999992 2024-05-08T18:09:22.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.647907+0000", 2024-05-08T18:09:22.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010413599999999999 2024-05-08T18:09:22.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.647984+0000", 2024-05-08T18:09:22.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6749000000000007e-05 2024-05-08T18:09:22.358 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.358 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.358 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.359 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1275 3.33 e85/20 3:ccdf9558:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_3:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:22.359 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:22.359 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.253248126999999, 2024-05-08T18:09:22.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020251129, 2024-05-08T18:09:22.359 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.359 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.359 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.359 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:22.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:22.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053592+0000", 2024-05-08T18:09:22.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5189999999999999e-06 2024-05-08T18:09:22.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059662+0000", 2024-05-08T18:09:22.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060699289999999999 2024-05-08T18:09:22.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059680+0000", 2024-05-08T18:09:22.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7558999999999999e-05 2024-05-08T18:09:22.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059689+0000", 2024-05-08T18:09:22.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2320000000000007e-06 2024-05-08T18:09:22.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059826+0000", 2024-05-08T18:09:22.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136792 2024-05-08T18:09:22.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059867+0000", 2024-05-08T18:09:22.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1689e-05 2024-05-08T18:09:22.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073728+0000", 2024-05-08T18:09:22.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01386104 2024-05-08T18:09:22.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073841+0000", 2024-05-08T18:09:22.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011236899999999999 2024-05-08T18:09:22.363 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.363 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.363 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.364 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1286 3.20 3:07ccb256:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:22.364 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:22.364 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.102553513, 2024-05-08T18:09:22.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022546805999999999, 2024-05-08T18:09:22.364 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.364 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.364 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.364 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.364 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.364 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.364 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1286 2024-05-08T18:09:22.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.365 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:22.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:22.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204287+0000", 2024-05-08T18:09:22.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8880000000000001e-06 2024-05-08T18:09:22.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208135+0000", 2024-05-08T18:09:22.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038480960000000001 2024-05-08T18:09:22.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208158+0000", 2024-05-08T18:09:22.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-05 2024-05-08T18:09:22.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208172+0000", 2024-05-08T18:09:22.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:09:22.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208251+0000", 2024-05-08T18:09:22.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8863999999999996e-05 2024-05-08T18:09:22.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208387+0000", 2024-05-08T18:09:22.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013615099999999999 2024-05-08T18:09:22.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:22.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208488+0000", 2024-05-08T18:09:22.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101366 2024-05-08T18:09:22.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.214533+0000", 2024-05-08T18:09:22.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060444829999999998 2024-05-08T18:09:22.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226742+0000", 2024-05-08T18:09:22.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012208798 2024-05-08T18:09:22.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226792+0000", 2024-05-08T18:09:22.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0565999999999997e-05 2024-05-08T18:09:22.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226831+0000", 2024-05-08T18:09:22.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8816999999999998e-05 2024-05-08T18:09:22.370 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.370 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.370 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.370 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1397 3.34 e87/20 3:2c6418f0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_3:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:22.370 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:22.370 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.504121524, 2024-05-08T18:09:22.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019946450000000001, 2024-05-08T18:09:22.371 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.371 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.371 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.371 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:22.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:22.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802717+0000", 2024-05-08T18:09:22.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0400000000000005e-07 2024-05-08T18:09:22.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807936+0000", 2024-05-08T18:09:22.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052192489999999996 2024-05-08T18:09:22.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807971+0000", 2024-05-08T18:09:22.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4517000000000002e-05 2024-05-08T18:09:22.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807993+0000", 2024-05-08T18:09:22.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2463000000000002e-05 2024-05-08T18:09:22.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.808151+0000", 2024-05-08T18:09:22.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015751400000000001 2024-05-08T18:09:22.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.808197+0000", 2024-05-08T18:09:22.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6637000000000001e-05 2024-05-08T18:09:22.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822537+0000", 2024-05-08T18:09:22.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014339607000000001 2024-05-08T18:09:22.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822663+0000", 2024-05-08T18:09:22.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125659 2024-05-08T18:09:22.375 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.375 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.375 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.375 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1399 3.2c 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:22.375 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:22.375 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.487409993, 2024-05-08T18:09:22.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030683200000000001, 2024-05-08T18:09:22.376 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.376 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.376 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.376 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.376 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.376 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.376 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1399 2024-05-08T18:09:22.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.376 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:22.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:22.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819432+0000", 2024-05-08T18:09:22.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7759999999999999e-06 2024-05-08T18:09:22.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825021+0000", 2024-05-08T18:09:22.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055895859999999997 2024-05-08T18:09:22.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825052+0000", 2024-05-08T18:09:22.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1047000000000003e-05 2024-05-08T18:09:22.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825068+0000", 2024-05-08T18:09:22.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6138999999999999e-05 2024-05-08T18:09:22.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825218+0000", 2024-05-08T18:09:22.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014997200000000001 2024-05-08T18:09:22.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825490+0000", 2024-05-08T18:09:22.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000271446 2024-05-08T18:09:22.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:22.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825710+0000", 2024-05-08T18:09:22.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220354 2024-05-08T18:09:22.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.839642+0000", 2024-05-08T18:09:22.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013932363 2024-05-08T18:09:22.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849813+0000", 2024-05-08T18:09:22.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010170461 2024-05-08T18:09:22.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849981+0000", 2024-05-08T18:09:22.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016776399999999999 2024-05-08T18:09:22.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.850111+0000", 2024-05-08T18:09:22.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013029200000000001 2024-05-08T18:09:22.381 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.381 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.381 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.382 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1406 3.20 3:05e3d3c1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:22.382 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:22.382 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.417838882, 2024-05-08T18:09:22.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022642778999999998, 2024-05-08T18:09:22.382 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.382 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.382 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.382 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.382 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.382 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.382 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1406 2024-05-08T18:09:22.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.383 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:22.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:22.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.889003+0000", 2024-05-08T18:09:22.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8670000000000004e-06 2024-05-08T18:09:22.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893237+0000", 2024-05-08T18:09:22.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042339999999999999 2024-05-08T18:09:22.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893279+0000", 2024-05-08T18:09:22.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2225999999999999e-05 2024-05-08T18:09:22.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893305+0000", 2024-05-08T18:09:22.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.618e-05 2024-05-08T18:09:22.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893479+0000", 2024-05-08T18:09:22.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017357700000000001 2024-05-08T18:09:22.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893736+0000", 2024-05-08T18:09:22.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025701700000000001 2024-05-08T18:09:22.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:22.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893993+0000", 2024-05-08T18:09:22.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025750700000000003 2024-05-08T18:09:22.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904227+0000", 2024-05-08T18:09:22.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010234073 2024-05-08T18:09:22.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911471+0000", 2024-05-08T18:09:22.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0072441909999999997 2024-05-08T18:09:22.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911567+0000", 2024-05-08T18:09:22.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5685000000000003e-05 2024-05-08T18:09:22.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911642+0000", 2024-05-08T18:09:22.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4456000000000007e-05 2024-05-08T18:09:22.388 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.388 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.388 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.389 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1416 3.2c 3:345ebd70:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:22.389 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:22.389 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.310467677, 2024-05-08T18:09:22.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027523229999999999, 2024-05-08T18:09:22.389 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.389 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.389 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.389 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.389 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.389 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.389 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1416 2024-05-08T18:09:22.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.390 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:22.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:22.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996374+0000", 2024-05-08T18:09:22.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.506e-06 2024-05-08T18:09:22.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000305+0000", 2024-05-08T18:09:22.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003931197 2024-05-08T18:09:22.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000346+0000", 2024-05-08T18:09:22.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1396000000000001e-05 2024-05-08T18:09:22.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000364+0000", 2024-05-08T18:09:22.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.806e-05 2024-05-08T18:09:22.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000490+0000", 2024-05-08T18:09:22.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012581800000000001 2024-05-08T18:09:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000755+0000", 2024-05-08T18:09:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026484700000000002 2024-05-08T18:09:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000992+0000", 2024-05-08T18:09:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023701700000000001 2024-05-08T18:09:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010465+0000", 2024-05-08T18:09:22.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094726429999999993 2024-05-08T18:09:22.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023679+0000", 2024-05-08T18:09:22.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013214105 2024-05-08T18:09:22.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023776+0000", 2024-05-08T18:09:22.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7258999999999998e-05 2024-05-08T18:09:22.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023893+0000", 2024-05-08T18:09:22.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117382 2024-05-08T18:09:22.395 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.395 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.395 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.395 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1424 3.36 3:6c7a05ce:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:22.396 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.375800+0000", 2024-05-08T18:09:22.396 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.9310376839999996, 2024-05-08T18:09:22.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019293312999999999, 2024-05-08T18:09:22.396 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.396 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.396 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.396 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.396 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.396 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.396 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1424 2024-05-08T18:09:22.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.396 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.375800+0000", 2024-05-08T18:09:22.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.375800+0000", 2024-05-08T18:09:22.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.375802+0000", 2024-05-08T18:09:22.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3879999999999998e-06 2024-05-08T18:09:22.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.379572+0000", 2024-05-08T18:09:22.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037692820000000001 2024-05-08T18:09:22.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.379602+0000", 2024-05-08T18:09:22.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0114999999999999e-05 2024-05-08T18:09:22.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.379614+0000", 2024-05-08T18:09:22.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1725999999999999e-05 2024-05-08T18:09:22.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.379759+0000", 2024-05-08T18:09:22.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014588000000000001 2024-05-08T18:09:22.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.380200+0000", 2024-05-08T18:09:22.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044040399999999998 2024-05-08T18:09:22.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:22.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.380676+0000", 2024-05-08T18:09:22.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047648100000000001 2024-05-08T18:09:22.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.387146+0000", 2024-05-08T18:09:22.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064695050000000004 2024-05-08T18:09:22.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.394934+0000", 2024-05-08T18:09:22.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007787988 2024-05-08T18:09:22.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.395022+0000", 2024-05-08T18:09:22.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8090000000000005e-05 2024-05-08T18:09:22.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.395093+0000", 2024-05-08T18:09:22.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1453999999999997e-05 2024-05-08T18:09:22.402 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.402 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.402 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.402 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1444 3.2c 3:3746b84a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:22.402 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.785023+0000", 2024-05-08T18:09:22.402 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.5218149869999991, 2024-05-08T18:09:22.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018464464999999999, 2024-05-08T18:09:22.402 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.403 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.403 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.403 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.403 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.403 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.403 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1444 2024-05-08T18:09:22.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.403 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.785023+0000", 2024-05-08T18:09:22.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.785023+0000", 2024-05-08T18:09:22.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.785046+0000", 2024-05-08T18:09:22.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3603000000000001e-05 2024-05-08T18:09:22.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789230+0000", 2024-05-08T18:09:22.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041834300000000001 2024-05-08T18:09:22.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789272+0000", 2024-05-08T18:09:22.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2531999999999999e-05 2024-05-08T18:09:22.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789292+0000", 2024-05-08T18:09:22.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9360000000000001e-05 2024-05-08T18:09:22.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789395+0000", 2024-05-08T18:09:22.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103597 2024-05-08T18:09:22.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789572+0000", 2024-05-08T18:09:22.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017642999999999999 2024-05-08T18:09:22.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:22.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789746+0000", 2024-05-08T18:09:22.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017421799999999999 2024-05-08T18:09:22.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.802556+0000", 2024-05-08T18:09:22.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012810013 2024-05-08T18:09:22.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.803301+0000", 2024-05-08T18:09:22.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00074479400000000001 2024-05-08T18:09:22.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.803400+0000", 2024-05-08T18:09:22.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9038999999999998e-05 2024-05-08T18:09:22.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.803487+0000", 2024-05-08T18:09:22.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7448999999999996e-05 2024-05-08T18:09:22.408 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.408 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.408 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.408 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1451 3.36 3:6da4b5f8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:22.408 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:22.409 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.0097950440000005, 2024-05-08T18:09:22.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022119236, 2024-05-08T18:09:22.409 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.409 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.409 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.409 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.409 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.409 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.409 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1451 2024-05-08T18:09:22.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.409 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:22.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:22.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297046+0000", 2024-05-08T18:09:22.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6030000000000001e-06 2024-05-08T18:09:22.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301125+0000", 2024-05-08T18:09:22.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004079058 2024-05-08T18:09:22.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301163+0000", 2024-05-08T18:09:22.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7286000000000002e-05 2024-05-08T18:09:22.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301181+0000", 2024-05-08T18:09:22.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.844e-05 2024-05-08T18:09:22.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301325+0000", 2024-05-08T18:09:22.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144284 2024-05-08T18:09:22.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301602+0000", 2024-05-08T18:09:22.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027665399999999998 2024-05-08T18:09:22.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:22.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301835+0000", 2024-05-08T18:09:22.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023292699999999999 2024-05-08T18:09:22.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.318166+0000", 2024-05-08T18:09:22.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016331061000000001 2024-05-08T18:09:22.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.318991+0000", 2024-05-08T18:09:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000825427 2024-05-08T18:09:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.319082+0000", 2024-05-08T18:09:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0743999999999997e-05 2024-05-08T18:09:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.319162+0000", 2024-05-08T18:09:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9752000000000005e-05 2024-05-08T18:09:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1465 3.26 3:66c1b1e1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.606487+0000", 2024-05-08T18:09:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.700350791, 2024-05-08T18:09:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019185464999999999, 2024-05-08T18:09:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.416 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.416 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.416 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.416 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.416 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1465 2024-05-08T18:09:22.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.416 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.606487+0000", 2024-05-08T18:09:22.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.606487+0000", 2024-05-08T18:09:22.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.606491+0000", 2024-05-08T18:09:22.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8229999999999997e-06 2024-05-08T18:09:22.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.610808+0000", 2024-05-08T18:09:22.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043176359999999997 2024-05-08T18:09:22.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.610839+0000", 2024-05-08T18:09:22.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0216e-05 2024-05-08T18:09:22.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.610860+0000", 2024-05-08T18:09:22.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1277999999999999e-05 2024-05-08T18:09:22.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.611027+0000", 2024-05-08T18:09:22.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016708900000000001 2024-05-08T18:09:22.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.611279+0000", 2024-05-08T18:09:22.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025154000000000002 2024-05-08T18:09:22.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:22.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.611522+0000", 2024-05-08T18:09:22.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024351 2024-05-08T18:09:22.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.620744+0000", 2024-05-08T18:09:22.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092216190000000003 2024-05-08T18:09:22.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.625549+0000", 2024-05-08T18:09:22.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048049900000000003 2024-05-08T18:09:22.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.625627+0000", 2024-05-08T18:09:22.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7860000000000003e-05 2024-05-08T18:09:22.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.625672+0000", 2024-05-08T18:09:22.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5904e-05 2024-05-08T18:09:22.421 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.421 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.421 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.422 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1471 3.26 3:6495ae89:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:22.422 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:22.422 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.6101908229999999, 2024-05-08T18:09:22.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022361453, 2024-05-08T18:09:22.422 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.422 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.422 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.422 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.422 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.422 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.423 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1471 2024-05-08T18:09:22.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.423 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:22.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:22.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696650+0000", 2024-05-08T18:09:22.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8839999999999998e-06 2024-05-08T18:09:22.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700528+0000", 2024-05-08T18:09:22.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038783390000000002 2024-05-08T18:09:22.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700554+0000", 2024-05-08T18:09:22.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6106e-05 2024-05-08T18:09:22.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700566+0000", 2024-05-08T18:09:22.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2021000000000001e-05 2024-05-08T18:09:22.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700682+0000", 2024-05-08T18:09:22.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115457 2024-05-08T18:09:22.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700951+0000", 2024-05-08T18:09:22.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026891699999999997 2024-05-08T18:09:22.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:22.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.701210+0000", 2024-05-08T18:09:22.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000259017 2024-05-08T18:09:22.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718848+0000", 2024-05-08T18:09:22.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017638132000000001 2024-05-08T18:09:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718917+0000", 2024-05-08T18:09:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9564e-05 2024-05-08T18:09:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718968+0000", 2024-05-08T18:09:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1028e-05 2024-05-08T18:09:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.719008+0000", 2024-05-08T18:09:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9987999999999997e-05 2024-05-08T18:09:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1472 3.26 3:6656fbbd:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.707521+0000", 2024-05-08T18:09:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.5993167289999999, 2024-05-08T18:09:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018269342000000001, 2024-05-08T18:09:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1472 2024-05-08T18:09:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.707521+0000", 2024-05-08T18:09:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.707521+0000", 2024-05-08T18:09:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.707524+0000", 2024-05-08T18:09:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5050000000000002e-06 2024-05-08T18:09:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712193+0000", 2024-05-08T18:09:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046691450000000004 2024-05-08T18:09:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712228+0000", 2024-05-08T18:09:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.523e-05 2024-05-08T18:09:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712253+0000", 2024-05-08T18:09:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5242999999999999e-05 2024-05-08T18:09:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712348+0000", 2024-05-08T18:09:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4387000000000003e-05 2024-05-08T18:09:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712462+0000", 2024-05-08T18:09:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114839 2024-05-08T18:09:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712560+0000", 2024-05-08T18:09:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7554999999999997e-05 2024-05-08T18:09:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.725401+0000", 2024-05-08T18:09:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012841175999999999 2024-05-08T18:09:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.725690+0000", 2024-05-08T18:09:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028845800000000001 2024-05-08T18:09:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.725731+0000", 2024-05-08T18:09:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1672999999999999e-05 2024-05-08T18:09:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.725790+0000", 2024-05-08T18:09:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9131e-05 2024-05-08T18:09:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1669 3.2c 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-05-08T18:09:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.5069257199999999, 2024-05-08T18:09:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020235185999999999, 2024-05-08T18:09:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-05-08T18:09:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1669 2024-05-08T18:09:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799916+0000", 2024-05-08T18:09:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7730000000000001e-06 2024-05-08T18:09:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799931+0000", 2024-05-08T18:09:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5227e-05 2024-05-08T18:09:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799969+0000", 2024-05-08T18:09:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7883000000000003e-05 2024-05-08T18:09:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799986+0000", 2024-05-08T18:09:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6728999999999999e-05 2024-05-08T18:09:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.800123+0000", 2024-05-08T18:09:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013784600000000001 2024-05-08T18:09:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.800135+0000", 2024-05-08T18:09:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1336e-05 2024-05-08T18:09:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.805653+0000", 2024-05-08T18:09:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055179890000000001 2024-05-08T18:09:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.805876+0000", 2024-05-08T18:09:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022279 2024-05-08T18:09:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.820147+0000", 2024-05-08T18:09:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014271613000000001 2024-05-08T18:09:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.440 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:22.442 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:09:22.443 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:22.444+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:22.542 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:22.541+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:22.569 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:22.569 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:22.569 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:22.569 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:22.583 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:09:22.672 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:22.673+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:22.744 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:22.744+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:22.749 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:22.749 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:22.749 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:22.749 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:22.749 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:22.763 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:09:22.805 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:09:22.852 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:22.853+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:22.865 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_06: 100Mb.10 2024-05-08T18:09:22.865 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:22.865 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 100Mb.1 from bucket to /tmp/downloadfile.1 2024-05-08T18:09:22.865 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 100Mb.2 from bucket to /tmp/downloadfile.2 2024-05-08T18:09:22.865 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 100Mb.3 from bucket to /tmp/downloadfile.3 2024-05-08T18:09:22.865 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 100Mb.4 from bucket to /tmp/downloadfile.4 2024-05-08T18:09:22.865 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 100Mb.5 from bucket to /tmp/downloadfile.5 2024-05-08T18:09:22.865 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 100Mb.6 from bucket to /tmp/downloadfile.6 2024-05-08T18:09:22.865 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 100Mb.7 from bucket to /tmp/downloadfile.7 2024-05-08T18:09:22.865 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 100Mb.8 from bucket to /tmp/downloadfile.8 2024-05-08T18:09:22.866 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 100Mb.9 from bucket to /tmp/downloadfile.9 2024-05-08T18:09:22.866 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 100Mb.10 from bucket to /tmp/downloadfile.10 2024-05-08T18:09:22.866 INFO:tasks.workunit.client.0.smithi080.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T18:09:22.866 INFO:tasks.workunit.client.0.smithi080.stdout:Test case: PASSED - checksum verification for multipart upload passed 2024-05-08T18:09:22.866 INFO:tasks.workunit.client.0.smithi080.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T18:09:22.930 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:22.930 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:22.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:22.930 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:22.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.930 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:09:22.930 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:22.930 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 140.11345433899999, 2024-05-08T18:09:22.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.16213206199999999, 2024-05-08T18:09:22.930 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.930 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.931 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.931 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.931 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:09:22.931 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:09:22.931 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1 2024-05-08T18:09:22.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.931 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:22.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:22.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814494+0000", 2024-05-08T18:09:22.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:09:22.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814520+0000", 2024-05-08T18:09:22.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-05 2024-05-08T18:09:22.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814543+0000", 2024-05-08T18:09:22.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2353000000000001e-05 2024-05-08T18:09:22.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814563+0000", 2024-05-08T18:09:22.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.048e-05 2024-05-08T18:09:22.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814677+0000", 2024-05-08T18:09:22.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113632 2024-05-08T18:09:22.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:22.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814705+0000", 2024-05-08T18:09:22.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8626999999999999e-05 2024-05-08T18:09:22.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971115+0000", 2024-05-08T18:09:22.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.156409825 2024-05-08T18:09:22.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971438+0000", 2024-05-08T18:09:22.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00032289200000000002 2024-05-08T18:09:22.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:22.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971849+0000", 2024-05-08T18:09:22.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041139300000000002 2024-05-08T18:09:22.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.975364+0000", 2024-05-08T18:09:22.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035148390000000001 2024-05-08T18:09:22.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976474+0000", 2024-05-08T18:09:22.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001110099 2024-05-08T18:09:22.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976564+0000", 2024-05-08T18:09:22.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9522000000000001e-05 2024-05-08T18:09:22.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976624+0000", 2024-05-08T18:09:22.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9616e-05 2024-05-08T18:09:22.936 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.936 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.936 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.936 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:09:22.936 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:09:22.936 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 139.81809760499999, 2024-05-08T18:09:22.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021440811000000001, 2024-05-08T18:09:22.936 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.936 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:09:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:09:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 52 2024-05-08T18:09:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:09:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:09:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109849+0000", 2024-05-08T18:09:22.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1370000000000001e-06 2024-05-08T18:09:22.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109861+0000", 2024-05-08T18:09:22.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1559999999999999e-05 2024-05-08T18:09:22.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109878+0000", 2024-05-08T18:09:22.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7105999999999999e-05 2024-05-08T18:09:22.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109892+0000", 2024-05-08T18:09:22.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3577000000000001e-05 2024-05-08T18:09:22.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126161+0000", 2024-05-08T18:09:22.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016269458000000001 2024-05-08T18:09:22.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126299+0000", 2024-05-08T18:09:22.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138405 2024-05-08T18:09:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126534+0000", 2024-05-08T18:09:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000234875 2024-05-08T18:09:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127543+0000", 2024-05-08T18:09:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001008852 2024-05-08T18:09:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131128+0000", 2024-05-08T18:09:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035844359999999999 2024-05-08T18:09:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131222+0000", 2024-05-08T18:09:22.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3905000000000003e-05 2024-05-08T18:09:22.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131289+0000", 2024-05-08T18:09:22.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7500000000000001e-05 2024-05-08T18:09:22.941 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.941 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.941 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.941 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1194 3.16 e85/20 3:6b2325a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_6:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:22.941 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:22.942 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.907052129, 2024-05-08T18:09:22.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024064767000000001, 2024-05-08T18:09:22.942 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.942 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.942 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.942 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:22.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:22.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020897+0000", 2024-05-08T18:09:22.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9699999999999999e-06 2024-05-08T18:09:22.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027491+0000", 2024-05-08T18:09:22.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065945229999999997 2024-05-08T18:09:22.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027543+0000", 2024-05-08T18:09:22.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1319000000000001e-05 2024-05-08T18:09:22.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027573+0000", 2024-05-08T18:09:22.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0380000000000001e-05 2024-05-08T18:09:22.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027737+0000", 2024-05-08T18:09:22.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000163871 2024-05-08T18:09:22.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027782+0000", 2024-05-08T18:09:22.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5519999999999998e-05 2024-05-08T18:09:22.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044819+0000", 2024-05-08T18:09:22.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017036481999999999 2024-05-08T18:09:22.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044958+0000", 2024-05-08T18:09:22.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013970200000000001 2024-05-08T18:09:22.945 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.945 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.945 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.946 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1202 3.14 e85/20 3:2a8c8569:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_14:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:22.946 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:22.946 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.821102060999999, 2024-05-08T18:09:22.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023371860000000001, 2024-05-08T18:09:22.946 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.946 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.946 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.946 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:22.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:22.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106846+0000", 2024-05-08T18:09:22.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:09:22.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110841+0000", 2024-05-08T18:09:22.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039945479999999997 2024-05-08T18:09:22.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110888+0000", 2024-05-08T18:09:22.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7349999999999999e-05 2024-05-08T18:09:22.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110913+0000", 2024-05-08T18:09:22.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5055999999999999e-05 2024-05-08T18:09:22.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.111067+0000", 2024-05-08T18:09:22.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015329800000000001 2024-05-08T18:09:22.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.111110+0000", 2024-05-08T18:09:22.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3649000000000002e-05 2024-05-08T18:09:22.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130087+0000", 2024-05-08T18:09:22.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018976186999999999 2024-05-08T18:09:22.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130216+0000", 2024-05-08T18:09:22.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012911199999999999 2024-05-08T18:09:22.949 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.949 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.949 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.950 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1207 3.15 3:a96d965c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:22.950 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:22.950 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.775519786, 2024-05-08T18:09:22.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02864527, 2024-05-08T18:09:22.950 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.950 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.950 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.950 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.950 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.950 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.950 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1207 2024-05-08T18:09:22.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.950 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:22.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:22.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152430+0000", 2024-05-08T18:09:22.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1230000000000002e-06 2024-05-08T18:09:22.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157227+0000", 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047968769999999997 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157268+0000", 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0673000000000002e-05 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157293+0000", 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5469999999999998e-05 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157483+0000", 2024-05-08T18:09:22.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018973300000000001 2024-05-08T18:09:22.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157750+0000", 2024-05-08T18:09:22.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026736400000000002 2024-05-08T18:09:22.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:22.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157982+0000", 2024-05-08T18:09:22.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023154299999999999 2024-05-08T18:09:22.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.171224+0000", 2024-05-08T18:09:22.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013242115 2024-05-08T18:09:22.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180801+0000", 2024-05-08T18:09:22.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0095766749999999998 2024-05-08T18:09:22.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180919+0000", 2024-05-08T18:09:22.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118546 2024-05-08T18:09:22.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.181071+0000", 2024-05-08T18:09:22.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152151 2024-05-08T18:09:22.955 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.955 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.955 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.955 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1224 3.13 3:c82cef46:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:22.955 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:22.955 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.28946614, 2024-05-08T18:09:22.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025580821, 2024-05-08T18:09:22.955 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.955 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.955 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.955 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.955 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.955 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.956 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1224 2024-05-08T18:09:22.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.956 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:22.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:22.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638484+0000", 2024-05-08T18:09:22.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1989999999999999e-06 2024-05-08T18:09:22.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643068+0000", 2024-05-08T18:09:22.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045841859999999996 2024-05-08T18:09:22.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643099+0000", 2024-05-08T18:09:22.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1331999999999997e-05 2024-05-08T18:09:22.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643117+0000", 2024-05-08T18:09:22.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7176999999999998e-05 2024-05-08T18:09:22.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643262+0000", 2024-05-08T18:09:22.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014521299999999999 2024-05-08T18:09:22.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643523+0000", 2024-05-08T18:09:22.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000260783 2024-05-08T18:09:22.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:22.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643768+0000", 2024-05-08T18:09:22.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024567399999999998 2024-05-08T18:09:22.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.662501+0000", 2024-05-08T18:09:22.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018732988999999999 2024-05-08T18:09:22.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663964+0000", 2024-05-08T18:09:22.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001463074 2024-05-08T18:09:22.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.664015+0000", 2024-05-08T18:09:22.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0549e-05 2024-05-08T18:09:22.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.664061+0000", 2024-05-08T18:09:22.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5645000000000001e-05 2024-05-08T18:09:22.960 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.960 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.960 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.960 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1236 3.37 3:ed82f067:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:22.960 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.862196+0000", 2024-05-08T18:09:22.960 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.065750132, 2024-05-08T18:09:22.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020336864999999999, 2024-05-08T18:09:22.960 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1236 2024-05-08T18:09:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.862196+0000", 2024-05-08T18:09:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.862196+0000", 2024-05-08T18:09:22.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.862198+0000", 2024-05-08T18:09:22.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1050000000000002e-06 2024-05-08T18:09:22.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.866292+0000", 2024-05-08T18:09:22.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040943899999999998 2024-05-08T18:09:22.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.866319+0000", 2024-05-08T18:09:22.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6424e-05 2024-05-08T18:09:22.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.866330+0000", 2024-05-08T18:09:22.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1695999999999999e-05 2024-05-08T18:09:22.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.866492+0000", 2024-05-08T18:09:22.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000161562 2024-05-08T18:09:22.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.866757+0000", 2024-05-08T18:09:22.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026477599999999999 2024-05-08T18:09:22.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:22.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.867014+0000", 2024-05-08T18:09:22.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025779299999999998 2024-05-08T18:09:22.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.882342+0000", 2024-05-08T18:09:22.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015327172 2024-05-08T18:09:22.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.882444+0000", 2024-05-08T18:09:22.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010221300000000001 2024-05-08T18:09:22.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.882487+0000", 2024-05-08T18:09:22.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3158999999999998e-05 2024-05-08T18:09:22.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.882533+0000", 2024-05-08T18:09:22.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5575000000000003e-05 2024-05-08T18:09:22.965 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.966 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.966 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.966 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1249 3.39 3:9d9659c4:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:22.966 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.404107+0000", 2024-05-08T18:09:22.966 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.523838763000001, 2024-05-08T18:09:22.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019803141999999999, 2024-05-08T18:09:22.966 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.966 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.966 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.966 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.966 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.966 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.967 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1249 2024-05-08T18:09:22.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.967 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.404107+0000", 2024-05-08T18:09:22.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.404107+0000", 2024-05-08T18:09:22.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.404109+0000", 2024-05-08T18:09:22.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3769999999999999e-06 2024-05-08T18:09:22.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.408166+0000", 2024-05-08T18:09:22.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040569059999999999 2024-05-08T18:09:22.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.408192+0000", 2024-05-08T18:09:22.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5222999999999999e-05 2024-05-08T18:09:22.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.408202+0000", 2024-05-08T18:09:22.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0730000000000001e-05 2024-05-08T18:09:22.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.408298+0000", 2024-05-08T18:09:22.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5326000000000002e-05 2024-05-08T18:09:22.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.408517+0000", 2024-05-08T18:09:22.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021936699999999999 2024-05-08T18:09:22.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:22.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.408717+0000", 2024-05-08T18:09:22.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019954200000000001 2024-05-08T18:09:22.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.414652+0000", 2024-05-08T18:09:22.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059357669999999998 2024-05-08T18:09:22.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.423743+0000", 2024-05-08T18:09:22.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0090907109999999996 2024-05-08T18:09:22.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.423839+0000", 2024-05-08T18:09:22.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5867999999999998e-05 2024-05-08T18:09:22.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.423910+0000", 2024-05-08T18:09:22.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1324999999999999e-05 2024-05-08T18:09:22.971 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.971 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.971 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.972 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1255 3.12 e85/20 3:48af9d8c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_11:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:22.972 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:22.972 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.446468188000001, 2024-05-08T18:09:22.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021924084999999999, 2024-05-08T18:09:22.972 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.972 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.972 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.972 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:22.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:22.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481479+0000", 2024-05-08T18:09:22.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999999999999999e-06 2024-05-08T18:09:22.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.485998+0000", 2024-05-08T18:09:22.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045194600000000003 2024-05-08T18:09:22.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486023+0000", 2024-05-08T18:09:22.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4516999999999999e-05 2024-05-08T18:09:22.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486033+0000", 2024-05-08T18:09:22.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0529e-05 2024-05-08T18:09:22.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486172+0000", 2024-05-08T18:09:22.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013829599999999999 2024-05-08T18:09:22.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486234+0000", 2024-05-08T18:09:22.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2156000000000006e-05 2024-05-08T18:09:22.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.503338+0000", 2024-05-08T18:09:22.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017104346999999999 2024-05-08T18:09:22.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.503402+0000", 2024-05-08T18:09:22.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3579999999999998e-05 2024-05-08T18:09:22.976 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.976 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.976 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.976 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1277 3.3f 3:ffe0c8dc:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:22.976 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:22.976 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.842819156000001, 2024-05-08T18:09:22.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025789262, 2024-05-08T18:09:22.976 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.976 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.976 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.976 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.976 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.976 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.976 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1277 2024-05-08T18:09:22.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.977 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:22.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:22.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085130+0000", 2024-05-08T18:09:22.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4659999999999999e-06 2024-05-08T18:09:22.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089237+0000", 2024-05-08T18:09:22.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004106424 2024-05-08T18:09:22.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089281+0000", 2024-05-08T18:09:22.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4053e-05 2024-05-08T18:09:22.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089300+0000", 2024-05-08T18:09:22.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9057000000000001e-05 2024-05-08T18:09:22.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089467+0000", 2024-05-08T18:09:22.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000167734 2024-05-08T18:09:22.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089839+0000", 2024-05-08T18:09:22.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037171900000000001 2024-05-08T18:09:22.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:22.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.090206+0000", 2024-05-08T18:09:22.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036716500000000003 2024-05-08T18:09:22.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.105682+0000", 2024-05-08T18:09:22.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015475495000000001 2024-05-08T18:09:22.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110695+0000", 2024-05-08T18:09:22.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050135420000000002 2024-05-08T18:09:22.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110779+0000", 2024-05-08T18:09:22.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3914999999999999e-05 2024-05-08T18:09:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110916+0000", 2024-05-08T18:09:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136692 2024-05-08T18:09:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1278 3.15 3:a900b53d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.095348+0000", 2024-05-08T18:09:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.832597440000001, 2024-05-08T18:09:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018853574000000001, 2024-05-08T18:09:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.981 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.982 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.982 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.982 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.982 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.982 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1278 2024-05-08T18:09:22.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.982 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.095348+0000", 2024-05-08T18:09:22.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.095348+0000", 2024-05-08T18:09:22.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.095352+0000", 2024-05-08T18:09:22.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.41e-06 2024-05-08T18:09:22.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.099824+0000", 2024-05-08T18:09:22.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004471933 2024-05-08T18:09:22.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.099868+0000", 2024-05-08T18:09:22.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4428999999999998e-05 2024-05-08T18:09:22.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.099895+0000", 2024-05-08T18:09:22.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7186999999999999e-05 2024-05-08T18:09:22.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.099995+0000", 2024-05-08T18:09:22.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9519999999999996e-05 2024-05-08T18:09:22.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.100127+0000", 2024-05-08T18:09:22.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013222 2024-05-08T18:09:22.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:22.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.100243+0000", 2024-05-08T18:09:22.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011632 2024-05-08T18:09:22.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.111126+0000", 2024-05-08T18:09:22.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01088268 2024-05-08T18:09:22.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.114126+0000", 2024-05-08T18:09:22.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002999565 2024-05-08T18:09:22.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.114170+0000", 2024-05-08T18:09:22.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4104000000000003e-05 2024-05-08T18:09:22.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.114202+0000", 2024-05-08T18:09:22.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2206000000000003e-05 2024-05-08T18:09:22.986 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.986 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.986 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.987 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1283 3.39 3:9ca6d3f9:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:22.987 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:22.987 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.758733572000001, 2024-05-08T18:09:22.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022844218999999999, 2024-05-08T18:09:22.987 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.987 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.987 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.987 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.987 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.987 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.987 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1283 2024-05-08T18:09:22.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.987 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:22.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:22.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169215+0000", 2024-05-08T18:09:22.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9529999999999999e-06 2024-05-08T18:09:22.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173086+0000", 2024-05-08T18:09:22.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003870582 2024-05-08T18:09:22.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173107+0000", 2024-05-08T18:09:22.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1608999999999999e-05 2024-05-08T18:09:22.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173117+0000", 2024-05-08T18:09:22.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8090000000000004e-06 2024-05-08T18:09:22.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173192+0000", 2024-05-08T18:09:22.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4676000000000001e-05 2024-05-08T18:09:22.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:22.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173197+0000", 2024-05-08T18:09:22.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0710000000000002e-06 2024-05-08T18:09:22.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.175963+0000", 2024-05-08T18:09:22.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027662810000000002 2024-05-08T18:09:22.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.176138+0000", 2024-05-08T18:09:22.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017430500000000001 2024-05-08T18:09:22.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:22.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.176332+0000", 2024-05-08T18:09:22.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019477000000000001 2024-05-08T18:09:22.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.184230+0000", 2024-05-08T18:09:22.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078977630000000004 2024-05-08T18:09:22.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.191962+0000", 2024-05-08T18:09:22.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077315830000000002 2024-05-08T18:09:22.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.192015+0000", 2024-05-08T18:09:22.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2992999999999999e-05 2024-05-08T18:09:22.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.192056+0000", 2024-05-08T18:09:22.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1823999999999998e-05 2024-05-08T18:09:22.992 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.992 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.992 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.993 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1285 3.15 3:a90023cb:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:22.993 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.193336+0000", 2024-05-08T18:09:22.993 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.734609516000001, 2024-05-08T18:09:22.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019317931, 2024-05-08T18:09:22.993 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.993 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.993 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.993 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:22.993 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:22.993 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:22.993 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1285 2024-05-08T18:09:22.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.993 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.193336+0000", 2024-05-08T18:09:22.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.193336+0000", 2024-05-08T18:09:22.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.193338+0000", 2024-05-08T18:09:22.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.31e-06 2024-05-08T18:09:22.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:22.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.197844+0000", 2024-05-08T18:09:22.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045067220000000003 2024-05-08T18:09:22.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:22.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.197870+0000", 2024-05-08T18:09:22.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5406999999999999e-05 2024-05-08T18:09:22.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:22.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.197879+0000", 2024-05-08T18:09:22.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5789999999999993e-06 2024-05-08T18:09:22.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:22.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.197960+0000", 2024-05-08T18:09:22.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0426999999999994e-05 2024-05-08T18:09:22.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:22.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.198094+0000", 2024-05-08T18:09:22.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013411900000000001 2024-05-08T18:09:22.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:22.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.198211+0000", 2024-05-08T18:09:22.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011710900000000001 2024-05-08T18:09:22.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204365+0000", 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061540409999999999 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.212548+0000", 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0081827930000000007 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.212597+0000", 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9339000000000003e-05 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:22.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.212654+0000", 2024-05-08T18:09:22.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7085e-05 2024-05-08T18:09:22.998 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.998 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:22.998 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:22.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.998 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1407 3.7 e87/20 3:e339c0c4:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_13:head v 87'1, mlcod=0'0)", 2024-05-08T18:09:22.998 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.902217+0000", 2024-05-08T18:09:22.998 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.025729201000001, 2024-05-08T18:09:22.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019771094999999999, 2024-05-08T18:09:22.998 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:22.998 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:22.998 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:22.998 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:22.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:22.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.902217+0000", 2024-05-08T18:09:22.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:22.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.902217+0000", 2024-05-08T18:09:22.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:22.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:22.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.902217+0000", 2024-05-08T18:09:22.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3399999999999998e-07 2024-05-08T18:09:22.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:22.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:22.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:23.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.908177+0000", 2024-05-08T18:09:23.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005959303 2024-05-08T18:09:23.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:23.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.908222+0000", 2024-05-08T18:09:23.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4839999999999998e-05 2024-05-08T18:09:23.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:23.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.908245+0000", 2024-05-08T18:09:23.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3918999999999999e-05 2024-05-08T18:09:23.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:23.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.908405+0000", 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000159448 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.908447+0000", 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1616999999999998e-05 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.921804+0000", 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013357677 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.921988+0000", 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018355699999999999 2024-05-08T18:09:23.001 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:23.002 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:23.002 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:23.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.002 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1412 3.3f 3:fe02d1ba:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:23.002 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:23.002 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.970281546000001, 2024-05-08T18:09:23.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023048524000000001, 2024-05-08T18:09:23.002 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:23.002 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:23.002 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:23.002 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:23.002 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:23.002 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:23.003 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1412 2024-05-08T18:09:23.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.003 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:23.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:23.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:23.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:23.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:23.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:23.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:23.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:23.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957668+0000", 2024-05-08T18:09:23.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8999999999999999e-06 2024-05-08T18:09:23.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:23.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963142+0000", 2024-05-08T18:09:23.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005473627 2024-05-08T18:09:23.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:23.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963181+0000", 2024-05-08T18:09:23.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.93e-05 2024-05-08T18:09:23.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:23.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963199+0000", 2024-05-08T18:09:23.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7866000000000001e-05 2024-05-08T18:09:23.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:23.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963347+0000", 2024-05-08T18:09:23.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014816800000000001 2024-05-08T18:09:23.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:23.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963603+0000", 2024-05-08T18:09:23.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025623099999999999 2024-05-08T18:09:23.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:23.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963843+0000", 2024-05-08T18:09:23.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023961699999999999 2024-05-08T18:09:23.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:23.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.975743+0000", 2024-05-08T18:09:23.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011899998 2024-05-08T18:09:23.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:23.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980533+0000", 2024-05-08T18:09:23.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047898749999999999 2024-05-08T18:09:23.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:23.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980638+0000", 2024-05-08T18:09:23.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010527300000000001 2024-05-08T18:09:23.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:23.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980713+0000", 2024-05-08T18:09:23.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4668999999999999e-05 2024-05-08T18:09:23.007 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:23.007 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:23.007 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:23.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.007 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1417 3.15 3:a8711592:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:23.007 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.005810+0000", 2024-05-08T18:09:23.007 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.922136245000001, 2024-05-08T18:09:23.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021479357000000001, 2024-05-08T18:09:23.008 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:23.008 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:23.008 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:23.008 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:23.008 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:23.008 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:23.008 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1417 2024-05-08T18:09:23.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.008 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:23.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:23.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.005810+0000", 2024-05-08T18:09:23.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:23.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:23.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.005810+0000", 2024-05-08T18:09:23.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:23.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:23.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.005813+0000", 2024-05-08T18:09:23.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6899999999999998e-06 2024-05-08T18:09:23.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:23.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.009925+0000", 2024-05-08T18:09:23.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041117039999999999 2024-05-08T18:09:23.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:23.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.009975+0000", 2024-05-08T18:09:23.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9759000000000003e-05 2024-05-08T18:09:23.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:23.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010001+0000", 2024-05-08T18:09:23.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6267000000000001e-05 2024-05-08T18:09:23.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:23.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010128+0000", 2024-05-08T18:09:23.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012743100000000001 2024-05-08T18:09:23.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:23.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010403+0000", 2024-05-08T18:09:23.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027485699999999999 2024-05-08T18:09:23.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:23.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010633+0000", 2024-05-08T18:09:23.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000229254 2024-05-08T18:09:23.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:23.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023537+0000", 2024-05-08T18:09:23.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012904456 2024-05-08T18:09:23.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:23.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.027115+0000", 2024-05-08T18:09:23.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003577818 2024-05-08T18:09:23.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:23.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.027222+0000", 2024-05-08T18:09:23.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000106879 2024-05-08T18:09:23.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:23.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.027289+0000", 2024-05-08T18:09:23.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7242000000000004e-05 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1420 3.e 3:72accb8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.8:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.892212676, 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025387064000000001, 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1420 2024-05-08T18:09:23.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.014 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:23.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:23.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:23.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:23.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:23.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:23.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:23.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:23.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035736+0000", 2024-05-08T18:09:23.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0240000000000002e-06 2024-05-08T18:09:23.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:23.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039738+0000", 2024-05-08T18:09:23.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004001419 2024-05-08T18:09:23.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:23.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039775+0000", 2024-05-08T18:09:23.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7696e-05 2024-05-08T18:09:23.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:23.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039792+0000", 2024-05-08T18:09:23.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7183000000000001e-05 2024-05-08T18:09:23.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:23.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039909+0000", 2024-05-08T18:09:23.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116915 2024-05-08T18:09:23.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:23.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.040173+0000", 2024-05-08T18:09:23.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026373100000000001 2024-05-08T18:09:23.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:23.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.041106+0000", 2024-05-08T18:09:23.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093293100000000002 2024-05-08T18:09:23.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:23.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060858+0000", 2024-05-08T18:09:23.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019752232000000002 2024-05-08T18:09:23.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:23.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060894+0000", 2024-05-08T18:09:23.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6056000000000002e-05 2024-05-08T18:09:23.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:23.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.061023+0000", 2024-05-08T18:09:23.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128849 2024-05-08T18:09:23.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:23.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.061120+0000", 2024-05-08T18:09:23.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7027999999999993e-05 2024-05-08T18:09:23.018 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:23.018 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:23.018 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:23.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.018 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1429 3.3b 3:dcac3b7e:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:23.018 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.473560+0000", 2024-05-08T18:09:23.018 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.454385361, 2024-05-08T18:09:23.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021091181000000001, 2024-05-08T18:09:23.018 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:23.018 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:23.018 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:23.018 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:23.019 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:23.019 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:23.019 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1429 2024-05-08T18:09:23.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.019 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:23.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:23.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.473560+0000", 2024-05-08T18:09:23.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:23.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:23.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.473560+0000", 2024-05-08T18:09:23.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:23.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:23.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.473563+0000", 2024-05-08T18:09:23.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.103e-06 2024-05-08T18:09:23.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:23.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477321+0000", 2024-05-08T18:09:23.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037581120000000001 2024-05-08T18:09:23.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:23.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477342+0000", 2024-05-08T18:09:23.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1607000000000002e-05 2024-05-08T18:09:23.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:23.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477352+0000", 2024-05-08T18:09:23.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0138e-05 2024-05-08T18:09:23.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:23.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477440+0000", 2024-05-08T18:09:23.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7557000000000002e-05 2024-05-08T18:09:23.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:23.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477582+0000", 2024-05-08T18:09:23.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014232700000000001 2024-05-08T18:09:23.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:23.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477723+0000", 2024-05-08T18:09:23.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140564 2024-05-08T18:09:23.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:23.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.483995+0000", 2024-05-08T18:09:23.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006272082 2024-05-08T18:09:23.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:23.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.494563+0000", 2024-05-08T18:09:23.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01056786 2024-05-08T18:09:23.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:23.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.494611+0000", 2024-05-08T18:09:23.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8062000000000002e-05 2024-05-08T18:09:23.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:23.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.494652+0000", 2024-05-08T18:09:23.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0769000000000002e-05 2024-05-08T18:09:23.023 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:23.023 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:23.023 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:23.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.023 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1448 3.15 3:a83ea02a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.9:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:23.023 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:23.024 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.024024858000001, 2024-05-08T18:09:23.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021945044, 2024-05-08T18:09:23.024 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:23.024 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:23.024 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:23.024 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:23.024 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:23.024 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:23.024 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1448 2024-05-08T18:09:23.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.024 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:23.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:23.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:23.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:23.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:23.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:23.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:23.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:23.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903924+0000", 2024-05-08T18:09:23.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5790000000000002e-06 2024-05-08T18:09:23.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:23.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907773+0000", 2024-05-08T18:09:23.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038495740000000001 2024-05-08T18:09:23.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:23.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907796+0000", 2024-05-08T18:09:23.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3011e-05 2024-05-08T18:09:23.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:23.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907806+0000", 2024-05-08T18:09:23.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9729999999999992e-06 2024-05-08T18:09:23.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:23.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907885+0000", 2024-05-08T18:09:23.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8799000000000002e-05 2024-05-08T18:09:23.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:23.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.908059+0000", 2024-05-08T18:09:23.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017370100000000001 2024-05-08T18:09:23.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:23.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.908581+0000", 2024-05-08T18:09:23.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052234099999999995 2024-05-08T18:09:23.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:23.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.918050+0000", 2024-05-08T18:09:23.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00946871 2024-05-08T18:09:23.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:23.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925682+0000", 2024-05-08T18:09:23.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0076326689999999999 2024-05-08T18:09:23.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:23.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925817+0000", 2024-05-08T18:09:23.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013451000000000001 2024-05-08T18:09:23.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:23.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925866+0000", 2024-05-08T18:09:23.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9177e-05 2024-05-08T18:09:23.028 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:23.028 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:23.029 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:23.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.029 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1453 3.39 3:9c43a7c4:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:23.029 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.342425+0000", 2024-05-08T18:09:23.029 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.5855203620000005, 2024-05-08T18:09:23.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020079920000000001, 2024-05-08T18:09:23.029 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:23.029 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:23.029 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:23.029 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:23.029 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:23.029 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:23.029 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1453 2024-05-08T18:09:23.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.030 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:23.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:23.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.342425+0000", 2024-05-08T18:09:23.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:23.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:23.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.342425+0000", 2024-05-08T18:09:23.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:23.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:23.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.342429+0000", 2024-05-08T18:09:23.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.658e-06 2024-05-08T18:09:23.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:23.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.346770+0000", 2024-05-08T18:09:23.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043407039999999999 2024-05-08T18:09:23.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:23.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.346799+0000", 2024-05-08T18:09:23.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9217000000000002e-05 2024-05-08T18:09:23.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:23.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.346812+0000", 2024-05-08T18:09:23.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2673e-05 2024-05-08T18:09:23.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:23.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.346900+0000", 2024-05-08T18:09:23.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7820999999999998e-05 2024-05-08T18:09:23.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:23.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.347059+0000", 2024-05-08T18:09:23.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015982600000000001 2024-05-08T18:09:23.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:23.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.347193+0000", 2024-05-08T18:09:23.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013342599999999999 2024-05-08T18:09:23.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:23.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.354005+0000", 2024-05-08T18:09:23.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068120170000000001 2024-05-08T18:09:23.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:23.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.362384+0000", 2024-05-08T18:09:23.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083795829999999995 2024-05-08T18:09:23.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:23.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.362447+0000", 2024-05-08T18:09:23.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2545000000000005e-05 2024-05-08T18:09:23.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:23.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:23.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:23.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.362505+0000", 2024-05-08T18:09:23.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8449999999999998e-05 2024-05-08T18:09:23.034 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:23.034 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:23.034 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:23.034 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:23.034 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:23.034 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:23.035 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:09:23.036 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:23.036+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:23.037 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:09:23.137 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:23.136+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:23.162 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:23.162 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:23.162 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:23.162 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:23.181 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:09:23.188 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:23.188 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:23.207 INFO:tasks.workunit.client.0.smithi080.stdout:user 0.293962807701067 deleted 2024-05-08T18:09:23.207 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:23.208 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:23.224 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:23.224 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:23.237 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:23.240+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:23.242 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:23.243 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:23.264 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:23.264 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:23.286 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:23.286 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:23.306 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:23.306 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:23.308 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:23.308 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:23.320 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:09:23.335 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:23.336 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:23.338 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:23.337+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:23.392 INFO:tasks.workunit.client.0.smithi080.stdout:Bucket Created: buck_2024_04_8_18_09_23 2024-05-08T18:09:23.392 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 1 2024-05-08T18:09:23.401 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:23.402 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:23.402 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00856281 s, 1.2 GB/s 2024-05-08T18:09:23.439 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:23.440+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:23.457 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:23.457 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:23.472 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:09:23.495 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.1 2024-05-08T18:09:23.495 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:23.495 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 2 2024-05-08T18:09:23.504 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:23.504 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:23.505 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00850134 s, 1.2 GB/s 2024-05-08T18:09:23.541 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:23.540+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:23.612 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:23.612 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:23.625 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:09:23.626 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.2 2024-05-08T18:09:23.626 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:23.626 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 3 2024-05-08T18:09:23.636 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:23.636 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:23.636 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00854184 s, 1.2 GB/s 2024-05-08T18:09:23.642 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:23.641+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:23.738 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:23.738 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:23.743 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:23.744+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:23.744 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.3 2024-05-08T18:09:23.744 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:23.744 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 4 2024-05-08T18:09:23.753 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:09:23.755 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:23.755 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:23.755 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00891395 s, 1.2 GB/s 2024-05-08T18:09:23.811 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-05-08T18:09:23.844 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:23.844+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:23.861 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.4 2024-05-08T18:09:23.861 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:23.861 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 5 2024-05-08T18:09:23.871 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:23.871 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:23.871 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00845169 s, 1.2 GB/s 2024-05-08T18:09:23.893 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:23.893 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:23.907 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:09:23.954 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:23.956+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:23.974 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.5 2024-05-08T18:09:23.974 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:23.974 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 6 2024-05-08T18:09:23.985 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:23.985 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:23.985 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101724 s, 1.0 GB/s 2024-05-08T18:09:24.046 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:24.045+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:24.070 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:24.071 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:24.085 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:09:24.097 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.6 2024-05-08T18:09:24.097 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:24.097 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 7 2024-05-08T18:09:24.109 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:24.110 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:24.110 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0107115 s, 979 MB/s 2024-05-08T18:09:24.147 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:24.148+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:24.213 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.7 2024-05-08T18:09:24.213 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:24.213 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 8 2024-05-08T18:09:24.214 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:24.214 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:24.227 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:24.227 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:24.228 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0117932 s, 889 MB/s 2024-05-08T18:09:24.229 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:09:24.248 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:24.249+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:24.336 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.8 2024-05-08T18:09:24.337 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:24.337 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 9 2024-05-08T18:09:24.348 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:24.348+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:24.349 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:24.349 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:24.349 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105046 s, 998 MB/s 2024-05-08T18:09:24.390 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:24.390 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:24.404 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:09:24.449 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:24.449+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:24.464 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.9 2024-05-08T18:09:24.464 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:24.464 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 10 2024-05-08T18:09:24.475 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:24.476 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:24.476 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00997074 s, 1.1 GB/s 2024-05-08T18:09:24.550 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:24.549+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:24.583 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:24.583 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:24.595 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.10 2024-05-08T18:09:24.595 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:24.595 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 11 2024-05-08T18:09:24.598 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:09:24.609 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:24.609 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:24.609 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.010887 s, 963 MB/s 2024-05-08T18:09:24.658 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:24.660+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:24.735 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:24.735 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:24.738 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.11 2024-05-08T18:09:24.738 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:24.738 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 12 2024-05-08T18:09:24.750 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:09:24.751 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:24.749+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:24.752 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:24.752 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:24.752 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112621 s, 931 MB/s 2024-05-08T18:09:24.852 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:24.852+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:24.874 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.12 2024-05-08T18:09:24.874 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:24.875 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 13 2024-05-08T18:09:24.883 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:24.883 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:24.888 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:24.888 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:24.888 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113923 s, 920 MB/s 2024-05-08T18:09:24.899 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:09:24.953 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:24.953+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:25.000 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.13 2024-05-08T18:09:25.001 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:25.001 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 14 2024-05-08T18:09:25.016 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:25.016 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:25.016 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127566 s, 822 MB/s 2024-05-08T18:09:25.034 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:25.035 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:25.049 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:09:25.092 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:25.093+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:25.146 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.14 2024-05-08T18:09:25.146 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:25.146 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 15 2024-05-08T18:09:25.154 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:25.153+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:25.162 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:25.162 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:25.162 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0126787 s, 827 MB/s 2024-05-08T18:09:25.216 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:25.216 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:25.231 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:09:25.254 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:25.256+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:25.301 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.15 2024-05-08T18:09:25.301 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:25.301 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 16 2024-05-08T18:09:25.317 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:25.317 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:25.317 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0131329 s, 798 MB/s 2024-05-08T18:09:25.349 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:09:25.355 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:25.353+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:25.401 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:25.402 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:25.418 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:09:25.433 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.16 2024-05-08T18:09:25.434 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:25.434 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 17 2024-05-08T18:09:25.446 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:25.446 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:25.446 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0107406 s, 976 MB/s 2024-05-08T18:09:25.460 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:25.461+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:25.517 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:25.518 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:25.540 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:25.540 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:25.552 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.17 2024-05-08T18:09:25.552 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:25.552 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 18 2024-05-08T18:09:25.557 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:25.556+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:25.559 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:25.559 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:25.563 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:25.563 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:25.563 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00929119 s, 1.1 GB/s 2024-05-08T18:09:25.577 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:25.577 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:25.591 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:25.591 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:25.598 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:25.598 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:25.605 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:09:25.618 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:25.618 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:25.641 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:25.641 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:25.657 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:25.657+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:25.658 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.18 2024-05-08T18:09:25.658 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:25.658 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 19 2024-05-08T18:09:25.662 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:25.662 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:25.669 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:25.670 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:25.670 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0102318 s, 1.0 GB/s 2024-05-08T18:09:25.736 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:25.736 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:25.736 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:25.736 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:25.736 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:25.755 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:09:25.771 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.19 2024-05-08T18:09:25.771 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:25.772 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 20 2024-05-08T18:09:25.784 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:25.784 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:25.784 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0107705 s, 974 MB/s 2024-05-08T18:09:25.796 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:25.797+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:25.835 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:09:25.860 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:25.861+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:25.893 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.20 2024-05-08T18:09:25.894 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:25.894 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 21 2024-05-08T18:09:25.908 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:25.908 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:25.908 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119576 s, 877 MB/s 2024-05-08T18:09:25.931 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:25.931 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:25.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:25.931 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:25.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.931 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1191 3.1d 3:b81eb771:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:25.931 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:25.931 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.947782934999999, 2024-05-08T18:09:25.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.029646883999999998, 2024-05-08T18:09:25.931 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:25.932 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:25.932 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:25.932 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:25.932 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:25.932 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:25.932 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1191 2024-05-08T18:09:25.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.932 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:25.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:25.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:25.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:25.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:25.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:25.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981334+0000", 2024-05-08T18:09:25.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1540000000000004e-06 2024-05-08T18:09:25.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:25.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988180+0000", 2024-05-08T18:09:25.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068463619999999999 2024-05-08T18:09:25.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:25.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988216+0000", 2024-05-08T18:09:25.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6293e-05 2024-05-08T18:09:25.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:25.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988236+0000", 2024-05-08T18:09:25.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9403e-05 2024-05-08T18:09:25.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:25.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988410+0000", 2024-05-08T18:09:25.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017415400000000001 2024-05-08T18:09:25.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:25.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988803+0000", 2024-05-08T18:09:25.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000393271 2024-05-08T18:09:25.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:25.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989175+0000", 2024-05-08T18:09:25.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037178899999999997 2024-05-08T18:09:25.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:25.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.006397+0000", 2024-05-08T18:09:25.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017221744000000001 2024-05-08T18:09:25.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:25.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010666+0000", 2024-05-08T18:09:25.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042692880000000004 2024-05-08T18:09:25.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:25.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010836+0000", 2024-05-08T18:09:25.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000169498 2024-05-08T18:09:25.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:25.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010976+0000", 2024-05-08T18:09:25.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014092799999999999 2024-05-08T18:09:25.937 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.937 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:25.937 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.937 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1193 3.c 3:315b87e8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:25.937 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.004223+0000", 2024-05-08T18:09:25.937 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.924889042, 2024-05-08T18:09:25.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019590908000000001, 2024-05-08T18:09:25.937 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:25.937 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:25.937 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:25.937 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:25.937 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:25.938 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:25.938 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1193 2024-05-08T18:09:25.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.938 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:25.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:25.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.004223+0000", 2024-05-08T18:09:25.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:25.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.004223+0000", 2024-05-08T18:09:25.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:25.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.004227+0000", 2024-05-08T18:09:25.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5130000000000001e-06 2024-05-08T18:09:25.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:25.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008665+0000", 2024-05-08T18:09:25.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044376629999999997 2024-05-08T18:09:25.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:25.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008697+0000", 2024-05-08T18:09:25.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2783000000000001e-05 2024-05-08T18:09:25.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:25.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008715+0000", 2024-05-08T18:09:25.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7713000000000001e-05 2024-05-08T18:09:25.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:25.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.008840+0000", 2024-05-08T18:09:25.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000124578 2024-05-08T18:09:25.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:25.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.009091+0000", 2024-05-08T18:09:25.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000251146 2024-05-08T18:09:25.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:25.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.009323+0000", 2024-05-08T18:09:25.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000232127 2024-05-08T18:09:25.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:25.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023324+0000", 2024-05-08T18:09:25.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014000574999999999 2024-05-08T18:09:25.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:25.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023459+0000", 2024-05-08T18:09:25.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013494099999999999 2024-05-08T18:09:25.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:25.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023644+0000", 2024-05-08T18:09:25.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018532100000000001 2024-05-08T18:09:25.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:25.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.023814+0000", 2024-05-08T18:09:25.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017054799999999999 2024-05-08T18:09:25.942 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.942 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:25.942 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.942 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1194 3.16 3:6b2325a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:25.942 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:25.943 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.913637016999999, 2024-05-08T18:09:25.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030556241000000001, 2024-05-08T18:09:25.943 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:25.943 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:25.943 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:25.943 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:25.943 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:25.943 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:25.943 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1194 2024-05-08T18:09:25.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.943 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:25.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:25.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:25.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:25.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:25.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:25.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015492+0000", 2024-05-08T18:09:25.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6863000000000001e-05 2024-05-08T18:09:25.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:25.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019937+0000", 2024-05-08T18:09:25.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044450399999999999 2024-05-08T18:09:25.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:25.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019975+0000", 2024-05-08T18:09:25.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7676000000000003e-05 2024-05-08T18:09:25.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:25.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019995+0000", 2024-05-08T18:09:25.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.969e-05 2024-05-08T18:09:25.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:25.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020165+0000", 2024-05-08T18:09:25.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017003400000000001 2024-05-08T18:09:25.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:25.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020437+0000", 2024-05-08T18:09:25.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027198599999999999 2024-05-08T18:09:25.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:25.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020668+0000", 2024-05-08T18:09:25.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023154 2024-05-08T18:09:25.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:25.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.032879+0000", 2024-05-08T18:09:25.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012210883000000001 2024-05-08T18:09:25.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:25.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045595+0000", 2024-05-08T18:09:25.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012716005000000001 2024-05-08T18:09:25.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:25.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045811+0000", 2024-05-08T18:09:25.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021556400000000001 2024-05-08T18:09:25.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:25.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.046032+0000", 2024-05-08T18:09:25.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022096 2024-05-08T18:09:25.948 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.948 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:25.948 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.948 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1195 3.28 3:155acd84:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:25.948 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:25.948 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.903489696000001, 2024-05-08T18:09:25.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020411840000000001, 2024-05-08T18:09:25.948 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:25.948 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:25.948 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:25.948 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:25.948 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:25.948 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:25.948 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1195 2024-05-08T18:09:25.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.949 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:25.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:25.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:25.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:25.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:25.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:25.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025626+0000", 2024-05-08T18:09:25.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4699999999999998e-06 2024-05-08T18:09:25.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:25.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030167+0000", 2024-05-08T18:09:25.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045406709999999996 2024-05-08T18:09:25.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:25.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030204+0000", 2024-05-08T18:09:25.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6736000000000002e-05 2024-05-08T18:09:25.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:25.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030222+0000", 2024-05-08T18:09:25.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.823e-05 2024-05-08T18:09:25.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:25.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030337+0000", 2024-05-08T18:09:25.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114695 2024-05-08T18:09:25.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:25.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030565+0000", 2024-05-08T18:09:25.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000228173 2024-05-08T18:09:25.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:25.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030770+0000", 2024-05-08T18:09:25.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020505400000000001 2024-05-08T18:09:25.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:25.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044362+0000", 2024-05-08T18:09:25.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013591814000000001 2024-05-08T18:09:25.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:25.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045754+0000", 2024-05-08T18:09:25.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013923710000000001 2024-05-08T18:09:25.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:25.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045903+0000", 2024-05-08T18:09:25.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014878800000000001 2024-05-08T18:09:25.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:25.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.046035+0000", 2024-05-08T18:09:25.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013183800000000001 2024-05-08T18:09:25.953 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.953 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:25.953 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.953 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1209 3.35 e85/20 3:af4c6abe:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_21:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:25.953 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:25.954 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.748661407, 2024-05-08T18:09:25.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021767585999999998, 2024-05-08T18:09:25.954 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:25.954 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:25.954 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:25.954 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:25.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:25.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:25.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:25.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:25.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:25.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180452+0000", 2024-05-08T18:09:25.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4000000000000002e-07 2024-05-08T18:09:25.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:25.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183165+0000", 2024-05-08T18:09:25.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027135269999999999 2024-05-08T18:09:25.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:25.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183208+0000", 2024-05-08T18:09:25.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2599000000000003e-05 2024-05-08T18:09:25.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:25.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183239+0000", 2024-05-08T18:09:25.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999997e-05 2024-05-08T18:09:25.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:25.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183369+0000", 2024-05-08T18:09:25.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000130338 2024-05-08T18:09:25.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:25.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183407+0000", 2024-05-08T18:09:25.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8213000000000002e-05 2024-05-08T18:09:25.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:25.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202127+0000", 2024-05-08T18:09:25.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018719906000000001 2024-05-08T18:09:25.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:25.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202219+0000", 2024-05-08T18:09:25.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1533000000000006e-05 2024-05-08T18:09:25.957 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.957 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:25.957 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.958 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1218 3.c 3:33b8068a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:25.958 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:25.958 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.366833514, 2024-05-08T18:09:25.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024735007, 2024-05-08T18:09:25.958 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:25.958 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:25.958 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:25.958 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:25.958 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:25.958 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:25.958 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1218 2024-05-08T18:09:25.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.959 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:25.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:25.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:25.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:25.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:25.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:25.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562282+0000", 2024-05-08T18:09:25.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7769999999999998e-06 2024-05-08T18:09:25.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:25.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568816+0000", 2024-05-08T18:09:25.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065338169999999999 2024-05-08T18:09:25.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:25.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568851+0000", 2024-05-08T18:09:25.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5892999999999997e-05 2024-05-08T18:09:25.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:25.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568871+0000", 2024-05-08T18:09:25.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9306000000000001e-05 2024-05-08T18:09:25.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:25.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568992+0000", 2024-05-08T18:09:25.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120925 2024-05-08T18:09:25.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:25.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.569258+0000", 2024-05-08T18:09:25.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026655299999999999 2024-05-08T18:09:25.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:25.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.569522+0000", 2024-05-08T18:09:25.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026331999999999999 2024-05-08T18:09:25.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:25.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584269+0000", 2024-05-08T18:09:25.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014747454 2024-05-08T18:09:25.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:25.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.586687+0000", 2024-05-08T18:09:25.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024181770000000001 2024-05-08T18:09:25.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:25.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.586888+0000", 2024-05-08T18:09:25.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000201137 2024-05-08T18:09:25.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:25.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.587014+0000", 2024-05-08T18:09:25.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012564799999999999 2024-05-08T18:09:25.963 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.963 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:25.963 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.964 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1220 3.c 3:319326d6:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:25.964 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:25.964 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.344145939000001, 2024-05-08T18:09:25.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022305417000000001, 2024-05-08T18:09:25.964 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:25.964 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:25.964 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:25.964 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:25.964 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:25.964 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:25.964 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1220 2024-05-08T18:09:25.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.964 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584971+0000", 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0729999999999998e-06 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:25.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591515+0000", 2024-05-08T18:09:25.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065448340000000002 2024-05-08T18:09:25.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:25.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591549+0000", 2024-05-08T18:09:25.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3633000000000001e-05 2024-05-08T18:09:25.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:25.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591574+0000", 2024-05-08T18:09:25.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4482999999999999e-05 2024-05-08T18:09:25.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591714+0000", 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014048500000000001 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591956+0000", 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000241616 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.592181+0000", 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022565000000000001 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.606237+0000", 2024-05-08T18:09:25.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014055646999999999 2024-05-08T18:09:25.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:25.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607095+0000", 2024-05-08T18:09:25.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085838199999999998 2024-05-08T18:09:25.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:25.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607189+0000", 2024-05-08T18:09:25.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3962000000000006e-05 2024-05-08T18:09:25.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:25.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607272+0000", 2024-05-08T18:09:25.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2651999999999994e-05 2024-05-08T18:09:25.969 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.969 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:25.969 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.969 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1222 3.38 e85/20 3:1f451ee1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_6:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:25.969 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.607187+0000", 2024-05-08T18:09:25.969 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.321925456999999, 2024-05-08T18:09:25.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018422048, 2024-05-08T18:09:25.969 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:25.969 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:25.969 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:25.969 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:25.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:25.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607187+0000", 2024-05-08T18:09:25.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:25.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607187+0000", 2024-05-08T18:09:25.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:25.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607188+0000", 2024-05-08T18:09:25.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2860000000000001e-06 2024-05-08T18:09:25.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:25.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.611823+0000", 2024-05-08T18:09:25.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046346010000000003 2024-05-08T18:09:25.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:25.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.611855+0000", 2024-05-08T18:09:25.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1572999999999997e-05 2024-05-08T18:09:25.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:25.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.611870+0000", 2024-05-08T18:09:25.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5129e-05 2024-05-08T18:09:25.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:25.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.612015+0000", 2024-05-08T18:09:25.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000145618 2024-05-08T18:09:25.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:25.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.612075+0000", 2024-05-08T18:09:25.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9692999999999999e-05 2024-05-08T18:09:25.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:25.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625482+0000", 2024-05-08T18:09:25.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013406998999999999 2024-05-08T18:09:25.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:25.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625609+0000", 2024-05-08T18:09:25.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012714900000000001 2024-05-08T18:09:25.973 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.973 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:25.973 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.973 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1229 3.16 3:6ad6b699:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:25.973 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.724599+0000", 2024-05-08T18:09:25.973 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.204513884000001, 2024-05-08T18:09:25.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018735992999999999, 2024-05-08T18:09:25.973 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:25.973 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:25.973 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:25.974 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:25.974 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:25.974 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:25.974 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1229 2024-05-08T18:09:25.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.974 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:25.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:25.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.724599+0000", 2024-05-08T18:09:25.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:25.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.724599+0000", 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.724602+0000", 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999999e-06 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728621+0000", 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040188649999999999 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728658+0000", 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7722999999999998e-05 2024-05-08T18:09:25.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:25.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728677+0000", 2024-05-08T18:09:25.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9000000000000001e-05 2024-05-08T18:09:25.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:25.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.728876+0000", 2024-05-08T18:09:25.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019832300000000001 2024-05-08T18:09:25.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:25.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.729122+0000", 2024-05-08T18:09:25.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024644700000000001 2024-05-08T18:09:25.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.729371+0000", 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000249087 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.738186+0000", 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0088147859999999998 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.743162+0000", 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049762909999999999 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:25.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.743263+0000", 2024-05-08T18:09:25.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010037199999999999 2024-05-08T18:09:25.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:25.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.743335+0000", 2024-05-08T18:09:25.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2006000000000001e-05 2024-05-08T18:09:25.978 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.978 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:25.978 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.978 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1242 3.28 3:16e2765f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.2:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:25.978 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:25.978 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 17.952500171000001, 2024-05-08T18:09:25.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020212443, 2024-05-08T18:09:25.979 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:25.979 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:25.979 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:25.979 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:25.979 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:25.979 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:25.979 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1242 2024-05-08T18:09:25.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.979 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:25.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:25.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:25.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:25.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:25.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:25.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976615+0000", 2024-05-08T18:09:25.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6170000000000001e-06 2024-05-08T18:09:25.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:25.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980655+0000", 2024-05-08T18:09:25.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040399240000000003 2024-05-08T18:09:25.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980693+0000", 2024-05-08T18:09:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7996e-05 2024-05-08T18:09:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980717+0000", 2024-05-08T18:09:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.459e-05 2024-05-08T18:09:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980811+0000", 2024-05-08T18:09:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3931000000000006e-05 2024-05-08T18:09:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:25.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980965+0000", 2024-05-08T18:09:25.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015315500000000001 2024-05-08T18:09:25.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:25.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.981450+0000", 2024-05-08T18:09:25.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000485632 2024-05-08T18:09:25.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:25.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.991160+0000", 2024-05-08T18:09:25.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.009709858 2024-05-08T18:09:25.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996726+0000", 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055655039999999998 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996786+0000", 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0511999999999999e-05 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996825+0000", 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8723999999999997e-05 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.984 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1247 3.c 3:32aac358:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:25.984 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.370612+0000", 2024-05-08T18:09:25.984 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 17.558500573, 2024-05-08T18:09:25.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019632920000000002, 2024-05-08T18:09:25.984 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:25.984 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:25.984 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:25.984 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:25.984 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:25.984 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:25.984 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1247 2024-05-08T18:09:25.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.984 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:25.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.370612+0000", 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.370612+0000", 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.370615+0000", 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.559e-06 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374436+0000", 2024-05-08T18:09:25.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038219460000000001 2024-05-08T18:09:25.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:25.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374465+0000", 2024-05-08T18:09:25.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8347000000000002e-05 2024-05-08T18:09:25.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:25.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374476+0000", 2024-05-08T18:09:25.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1334e-05 2024-05-08T18:09:25.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:25.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374553+0000", 2024-05-08T18:09:25.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6555000000000001e-05 2024-05-08T18:09:25.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:25.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374667+0000", 2024-05-08T18:09:25.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114732 2024-05-08T18:09:25.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:25.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.374764+0000", 2024-05-08T18:09:25.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6527000000000006e-05 2024-05-08T18:09:25.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:25.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.382209+0000", 2024-05-08T18:09:25.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074447309999999996 2024-05-08T18:09:25.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:25.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.390135+0000", 2024-05-08T18:09:25.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079259099999999996 2024-05-08T18:09:25.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:25.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.390185+0000", 2024-05-08T18:09:25.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0834999999999997e-05 2024-05-08T18:09:25.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:25.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.390245+0000", 2024-05-08T18:09:25.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9444000000000002e-05 2024-05-08T18:09:25.989 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.989 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:25.989 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.989 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1395 3.17 e87/20 3:eb9c68a5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_1:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:25.989 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.771843+0000", 2024-05-08T18:09:25.989 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.157269295000001, 2024-05-08T18:09:25.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021322812, 2024-05-08T18:09:25.989 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:25.989 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:25.989 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:25.989 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:25.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:25.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.771843+0000", 2024-05-08T18:09:25.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:25.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.771843+0000", 2024-05-08T18:09:25.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:25.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.771844+0000", 2024-05-08T18:09:25.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0999999999999999e-07 2024-05-08T18:09:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.778254+0000", 2024-05-08T18:09:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064103859999999997 2024-05-08T18:09:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.778286+0000", 2024-05-08T18:09:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2113000000000002e-05 2024-05-08T18:09:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.778307+0000", 2024-05-08T18:09:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1158999999999999e-05 2024-05-08T18:09:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:25.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.779027+0000", 2024-05-08T18:09:25.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00071950400000000004 2024-05-08T18:09:25.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:25.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.779083+0000", 2024-05-08T18:09:25.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6512999999999999e-05 2024-05-08T18:09:25.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:25.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.793025+0000", 2024-05-08T18:09:25.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013941782999999999 2024-05-08T18:09:25.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:25.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.793166+0000", 2024-05-08T18:09:25.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140844 2024-05-08T18:09:25.993 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.993 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:25.993 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.993 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1400 3.1c 3:3bb95565:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:25.993 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:25.993 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.100363325, 2024-05-08T18:09:25.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02650396, 2024-05-08T18:09:25.993 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:25.993 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:25.994 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:25.994 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:25.994 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:25.994 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:25.994 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1400 2024-05-08T18:09:25.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.994 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:25.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:25.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:25.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:25.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:25.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:25.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:25.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828753+0000", 2024-05-08T18:09:25.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4400000000000001e-06 2024-05-08T18:09:25.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:25.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836255+0000", 2024-05-08T18:09:25.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0075026379999999998 2024-05-08T18:09:25.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:25.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836312+0000", 2024-05-08T18:09:25.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6459000000000003e-05 2024-05-08T18:09:25.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:25.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836340+0000", 2024-05-08T18:09:25.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8183000000000001e-05 2024-05-08T18:09:25.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:25.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836510+0000", 2024-05-08T18:09:25.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000169805 2024-05-08T18:09:25.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:25.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836763+0000", 2024-05-08T18:09:25.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025333700000000002 2024-05-08T18:09:25.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:25.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836995+0000", 2024-05-08T18:09:25.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023236700000000001 2024-05-08T18:09:25.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:25.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849771+0000", 2024-05-08T18:09:25.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012775760000000001 2024-05-08T18:09:25.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:25.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855089+0000", 2024-05-08T18:09:25.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0053173889999999996 2024-05-08T18:09:25.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:25.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855183+0000", 2024-05-08T18:09:25.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4276000000000003e-05 2024-05-08T18:09:25.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:25.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855253+0000", 2024-05-08T18:09:25.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0306000000000001e-05 2024-05-08T18:09:25.998 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.998 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:25.998 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:25.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.998 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1405 3.c 3:3166280d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:25.999 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:25.999 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.047796890000001, 2024-05-08T18:09:25.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023065800000000001, 2024-05-08T18:09:25.999 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:25.999 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:25.999 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:25.999 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:25.999 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:25.999 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:25.999 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1405 2024-05-08T18:09:25.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:25.999 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:25.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:25.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:25.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:26.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:26.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881320+0000", 2024-05-08T18:09:26.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-05-08T18:09:26.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887255+0000", 2024-05-08T18:09:26.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059351509999999996 2024-05-08T18:09:26.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887305+0000", 2024-05-08T18:09:26.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9579000000000001e-05 2024-05-08T18:09:26.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887332+0000", 2024-05-08T18:09:26.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7276000000000001e-05 2024-05-08T18:09:26.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887489+0000", 2024-05-08T18:09:26.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000156465 2024-05-08T18:09:26.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887745+0000", 2024-05-08T18:09:26.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025626700000000002 2024-05-08T18:09:26.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:26.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887980+0000", 2024-05-08T18:09:26.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000235107 2024-05-08T18:09:26.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.896366+0000", 2024-05-08T18:09:26.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083860870000000004 2024-05-08T18:09:26.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904214+0000", 2024-05-08T18:09:26.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078482840000000005 2024-05-08T18:09:26.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904312+0000", 2024-05-08T18:09:26.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7901999999999999e-05 2024-05-08T18:09:26.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904381+0000", 2024-05-08T18:09:26.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9258999999999995e-05 2024-05-08T18:09:26.004 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.004 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.004 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.004 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1410 3.30 3:0e0f1cce:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:26.004 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:26.004 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.994571914, 2024-05-08T18:09:26.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.026130820999999999, 2024-05-08T18:09:26.004 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.004 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.004 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.004 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.004 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.004 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.005 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1410 2024-05-08T18:09:26.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.005 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:26.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:26.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934544+0000", 2024-05-08T18:09:26.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2600000000000001e-06 2024-05-08T18:09:26.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939363+0000", 2024-05-08T18:09:26.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048190020000000002 2024-05-08T18:09:26.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939407+0000", 2024-05-08T18:09:26.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3999999999999999e-05 2024-05-08T18:09:26.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939428+0000", 2024-05-08T18:09:26.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0746000000000001e-05 2024-05-08T18:09:26.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939637+0000", 2024-05-08T18:09:26.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000209397 2024-05-08T18:09:26.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939894+0000", 2024-05-08T18:09:26.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025690700000000001 2024-05-08T18:09:26.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:26.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.940133+0000", 2024-05-08T18:09:26.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023939400000000001 2024-05-08T18:09:26.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.949842+0000", 2024-05-08T18:09:26.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0097087570000000002 2024-05-08T18:09:26.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960494+0000", 2024-05-08T18:09:26.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01065148 2024-05-08T18:09:26.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960597+0000", 2024-05-08T18:09:26.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103529 2024-05-08T18:09:26.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960671+0000", 2024-05-08T18:09:26.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4349000000000003e-05 2024-05-08T18:09:26.009 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.009 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.010 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.010 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1446 3.22 3:44011652:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:26.010 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:26.010 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.054190281, 2024-05-08T18:09:26.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024780153999999999, 2024-05-08T18:09:26.010 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.010 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.010 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.010 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.010 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.010 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.010 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1446 2024-05-08T18:09:26.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.011 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:26.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:26.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874926+0000", 2024-05-08T18:09:26.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2739999999999999e-06 2024-05-08T18:09:26.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879812+0000", 2024-05-08T18:09:26.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048860040000000002 2024-05-08T18:09:26.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879849+0000", 2024-05-08T18:09:26.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7919000000000001e-05 2024-05-08T18:09:26.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879868+0000", 2024-05-08T18:09:26.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8836999999999999e-05 2024-05-08T18:09:26.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880042+0000", 2024-05-08T18:09:26.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173981 2024-05-08T18:09:26.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880452+0000", 2024-05-08T18:09:26.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040949200000000002 2024-05-08T18:09:26.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:26.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880849+0000", 2024-05-08T18:09:26.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039710499999999997 2024-05-08T18:09:26.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.892821+0000", 2024-05-08T18:09:26.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011972287 2024-05-08T18:09:26.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899596+0000", 2024-05-08T18:09:26.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067744720000000001 2024-05-08T18:09:26.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899655+0000", 2024-05-08T18:09:26.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9119000000000001e-05 2024-05-08T18:09:26.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899702+0000", 2024-05-08T18:09:26.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7664000000000003e-05 2024-05-08T18:09:26.015 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.015 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.015 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.015 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1458 3.30 3:0e1bd441:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:26.016 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.449355+0000", 2024-05-08T18:09:26.016 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.479757163, 2024-05-08T18:09:26.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019757651000000001, 2024-05-08T18:09:26.016 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.016 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.016 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.016 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.016 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.016 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.016 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1458 2024-05-08T18:09:26.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.016 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.449355+0000", 2024-05-08T18:09:26.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.449355+0000", 2024-05-08T18:09:26.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.449359+0000", 2024-05-08T18:09:26.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2739999999999999e-06 2024-05-08T18:09:26.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.453851+0000", 2024-05-08T18:09:26.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004492495 2024-05-08T18:09:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.453897+0000", 2024-05-08T18:09:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6026999999999998e-05 2024-05-08T18:09:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.453917+0000", 2024-05-08T18:09:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0132999999999998e-05 2024-05-08T18:09:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.454019+0000", 2024-05-08T18:09:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101545 2024-05-08T18:09:26.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.454187+0000", 2024-05-08T18:09:26.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016848199999999999 2024-05-08T18:09:26.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:26.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.454341+0000", 2024-05-08T18:09:26.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015391999999999999 2024-05-08T18:09:26.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.463479+0000", 2024-05-08T18:09:26.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0091377230000000004 2024-05-08T18:09:26.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.469032+0000", 2024-05-08T18:09:26.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055529619999999998 2024-05-08T18:09:26.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.469075+0000", 2024-05-08T18:09:26.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3417999999999997e-05 2024-05-08T18:09:26.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.469113+0000", 2024-05-08T18:09:26.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7672000000000001e-05 2024-05-08T18:09:26.021 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.021 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.021 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.021 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1463 3.17 e87/20 3:ebd3133d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_13:head v 87'3, mlcod=85'1)", 2024-05-08T18:09:26.021 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.573059+0000", 2024-05-08T18:09:26.021 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.356053306, 2024-05-08T18:09:26.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019808240000000001, 2024-05-08T18:09:26.021 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.021 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.022 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.022 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.573059+0000", 2024-05-08T18:09:26.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.573059+0000", 2024-05-08T18:09:26.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.573062+0000", 2024-05-08T18:09:26.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3760000000000002e-06 2024-05-08T18:09:26.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579565+0000", 2024-05-08T18:09:26.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065034109999999997 2024-05-08T18:09:26.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579601+0000", 2024-05-08T18:09:26.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6329999999999999e-05 2024-05-08T18:09:26.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579619+0000", 2024-05-08T18:09:26.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7980000000000001e-05 2024-05-08T18:09:26.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579718+0000", 2024-05-08T18:09:26.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8887000000000004e-05 2024-05-08T18:09:26.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579753+0000", 2024-05-08T18:09:26.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5006000000000003e-05 2024-05-08T18:09:26.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.592778+0000", 2024-05-08T18:09:26.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013024803999999999 2024-05-08T18:09:26.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.592867+0000", 2024-05-08T18:09:26.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9445999999999997e-05 2024-05-08T18:09:26.025 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.025 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.025 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.025 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1464 3.2f 3:f7dca4bf:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:26.025 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.583146+0000", 2024-05-08T18:09:26.026 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.345966046000001, 2024-05-08T18:09:26.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022519284000000001, 2024-05-08T18:09:26.026 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.026 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.026 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.026 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.026 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.026 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.026 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1464 2024-05-08T18:09:26.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.026 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.583146+0000", 2024-05-08T18:09:26.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.583146+0000", 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.583149+0000", 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5600000000000001e-06 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.586965+0000", 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003816131 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.586991+0000", 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5508e-05 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587005+0000", 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4029000000000001e-05 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587087+0000", 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2056000000000002e-05 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587293+0000", 2024-05-08T18:09:26.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020639000000000001 2024-05-08T18:09:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587503+0000", 2024-05-08T18:09:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020987299999999999 2024-05-08T18:09:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.598739+0000", 2024-05-08T18:09:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011236237 2024-05-08T18:09:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.605521+0000", 2024-05-08T18:09:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067817049999999999 2024-05-08T18:09:26.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.605602+0000", 2024-05-08T18:09:26.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1225999999999998e-05 2024-05-08T18:09:26.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.605666+0000", 2024-05-08T18:09:26.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3569000000000001e-05 2024-05-08T18:09:26.030 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.030 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.030 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.030 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1898 3.22 3:462b78d0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.19:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:26.030 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:25.750111+0000", 2024-05-08T18:09:26.031 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.17900195499999999, 2024-05-08T18:09:26.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022823415, 2024-05-08T18:09:26.031 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.031 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.031 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.031 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.031 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.031 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.031 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1898 2024-05-08T18:09:26.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.031 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.750111+0000", 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.750111+0000", 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.750112+0000", 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.781e-06 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.753962+0000", 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003849917 2024-05-08T18:09:26.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.753992+0000", 2024-05-08T18:09:26.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0219999999999999e-05 2024-05-08T18:09:26.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.754006+0000", 2024-05-08T18:09:26.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3212e-05 2024-05-08T18:09:26.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.754119+0000", 2024-05-08T18:09:26.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113304 2024-05-08T18:09:26.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.754420+0000", 2024-05-08T18:09:26.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030074300000000002 2024-05-08T18:09:26.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:26.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.755298+0000", 2024-05-08T18:09:26.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00087796700000000001 2024-05-08T18:09:26.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.769345+0000", 2024-05-08T18:09:26.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014047217000000001 2024-05-08T18:09:26.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.772660+0000", 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033153969999999999 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.772807+0000", 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014637600000000001 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.772934+0000", 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127281 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.035 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.036 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.036 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.036 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:26.036 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.21 2024-05-08T18:09:26.037 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:26.037 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 22 2024-05-08T18:09:26.037 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:26.037 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:26.037 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00901646 s, 1.2 GB/s 2024-05-08T18:09:26.038 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:09:26.038 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:26.037+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:26.127 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.22 2024-05-08T18:09:26.127 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:26.127 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 23 2024-05-08T18:09:26.138 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:26.137+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:26.141 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:26.141 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:26.141 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110273 s, 951 MB/s 2024-05-08T18:09:26.210 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:26.210 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:26.210 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:26.210 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:26.224 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:09:26.239 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:26.240+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:26.275 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.23 2024-05-08T18:09:26.275 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:26.275 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 24 2024-05-08T18:09:26.290 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:26.290 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:26.290 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0121191 s, 865 MB/s 2024-05-08T18:09:26.340 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:26.340+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:26.386 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:26.386 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:26.386 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:26.386 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:26.386 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:26.401 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:09:26.429 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.24 2024-05-08T18:09:26.429 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:26.429 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 25 2024-05-08T18:09:26.445 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:26.445 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:26.445 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012818 s, 818 MB/s 2024-05-08T18:09:26.448 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:26.449+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:26.528 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:26.528 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:26.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:26.528 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:26.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.528 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:09:26.528 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:26.528 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 122.990773608, 2024-05-08T18:09:26.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.032012946, 2024-05-08T18:09:26.528 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.528 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.529 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.529 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.529 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.529 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.529 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:09:26.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.529 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:26.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:26.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535484+0000", 2024-05-08T18:09:26.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7929999999999999e-06 2024-05-08T18:09:26.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535500+0000", 2024-05-08T18:09:26.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5226e-05 2024-05-08T18:09:26.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535535+0000", 2024-05-08T18:09:26.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5213000000000003e-05 2024-05-08T18:09:26.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535564+0000", 2024-05-08T18:09:26.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9360999999999999e-05 2024-05-08T18:09:26.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535757+0000", 2024-05-08T18:09:26.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000193229 2024-05-08T18:09:26.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:26.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535775+0000", 2024-05-08T18:09:26.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7098000000000001e-05 2024-05-08T18:09:26.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556004+0000", 2024-05-08T18:09:26.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020229068999999999 2024-05-08T18:09:26.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:26.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556036+0000", 2024-05-08T18:09:26.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1943000000000002e-05 2024-05-08T18:09:26.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.564721+0000", 2024-05-08T18:09:26.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086853320000000005 2024-05-08T18:09:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565032+0000", 2024-05-08T18:09:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031121799999999999 2024-05-08T18:09:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565365+0000", 2024-05-08T18:09:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000332744 2024-05-08T18:09:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567305+0000", 2024-05-08T18:09:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00194016 2024-05-08T18:09:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567368+0000", 2024-05-08T18:09:26.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3342000000000004e-05 2024-05-08T18:09:26.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567433+0000", 2024-05-08T18:09:26.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4726000000000003e-05 2024-05-08T18:09:26.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567494+0000", 2024-05-08T18:09:26.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0492000000000003e-05 2024-05-08T18:09:26.534 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.535 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.535 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.535 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1189 3.20 3:054e8a9f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:26.535 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:26.535 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.566084201999999, 2024-05-08T18:09:26.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025093629999999999, 2024-05-08T18:09:26.535 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.535 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.535 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.535 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.535 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.535 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.535 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1189 2024-05-08T18:09:26.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.536 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:26.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:26.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960173+0000", 2024-05-08T18:09:26.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.65e-06 2024-05-08T18:09:26.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965720+0000", 2024-05-08T18:09:26.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055476340000000001 2024-05-08T18:09:26.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965757+0000", 2024-05-08T18:09:26.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6223000000000002e-05 2024-05-08T18:09:26.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965774+0000", 2024-05-08T18:09:26.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6952999999999998e-05 2024-05-08T18:09:26.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965930+0000", 2024-05-08T18:09:26.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015611800000000001 2024-05-08T18:09:26.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966190+0000", 2024-05-08T18:09:26.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025999399999999999 2024-05-08T18:09:26.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:26.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966440+0000", 2024-05-08T18:09:26.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025007600000000001 2024-05-08T18:09:26.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981042+0000", 2024-05-08T18:09:26.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01460257 2024-05-08T18:09:26.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.984969+0000", 2024-05-08T18:09:26.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039265159999999997 2024-05-08T18:09:26.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985135+0000", 2024-05-08T18:09:26.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016630400000000001 2024-05-08T18:09:26.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985264+0000", 2024-05-08T18:09:26.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012859199999999999 2024-05-08T18:09:26.540 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.540 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.540 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.540 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1209 3.35 3:af4c6abe:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:26.540 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:26.540 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.350822555000001, 2024-05-08T18:09:26.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027313356, 2024-05-08T18:09:26.540 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.540 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.540 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.540 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.540 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.541 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.541 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1209 2024-05-08T18:09:26.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.541 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:26.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:26.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175436+0000", 2024-05-08T18:09:26.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3800000000000004e-06 2024-05-08T18:09:26.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179472+0000", 2024-05-08T18:09:26.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040357020000000004 2024-05-08T18:09:26.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179515+0000", 2024-05-08T18:09:26.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2988999999999998e-05 2024-05-08T18:09:26.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179534+0000", 2024-05-08T18:09:26.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8743e-05 2024-05-08T18:09:26.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179673+0000", 2024-05-08T18:09:26.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013983800000000001 2024-05-08T18:09:26.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179933+0000", 2024-05-08T18:09:26.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025967999999999998 2024-05-08T18:09:26.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:26.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180161+0000", 2024-05-08T18:09:26.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022826300000000001 2024-05-08T18:09:26.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.200613+0000", 2024-05-08T18:09:26.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020451766999999999 2024-05-08T18:09:26.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202567+0000", 2024-05-08T18:09:26.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019541160000000001 2024-05-08T18:09:26.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202665+0000", 2024-05-08T18:09:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8055999999999998e-05 2024-05-08T18:09:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202745+0000", 2024-05-08T18:09:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9821999999999996e-05 2024-05-08T18:09:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1221 3.20 3:071d1257:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.931507679999999, 2024-05-08T18:09:26.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02822473, 2024-05-08T18:09:26.546 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.546 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.546 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.546 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.546 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.546 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.546 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1221 2024-05-08T18:09:26.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.546 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:26.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:26.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594751+0000", 2024-05-08T18:09:26.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3769999999999998e-06 2024-05-08T18:09:26.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600627+0000", 2024-05-08T18:09:26.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058764389999999998 2024-05-08T18:09:26.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600672+0000", 2024-05-08T18:09:26.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4805999999999998e-05 2024-05-08T18:09:26.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600704+0000", 2024-05-08T18:09:26.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2026000000000001e-05 2024-05-08T18:09:26.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600884+0000", 2024-05-08T18:09:26.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000179385 2024-05-08T18:09:26.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601296+0000", 2024-05-08T18:09:26.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041257400000000002 2024-05-08T18:09:26.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:26.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601742+0000", 2024-05-08T18:09:26.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044585399999999998 2024-05-08T18:09:26.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.617360+0000", 2024-05-08T18:09:26.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015617982000000001 2024-05-08T18:09:26.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622618+0000", 2024-05-08T18:09:26.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052577420000000001 2024-05-08T18:09:26.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622835+0000", 2024-05-08T18:09:26.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021674699999999999 2024-05-08T18:09:26.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622971+0000", 2024-05-08T18:09:26.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679799999999999 2024-05-08T18:09:26.550 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.550 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.550 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.551 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1223 3.2e e85/20 3:74a5b043:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_7:head v 85'3, mlcod=85'1)", 2024-05-08T18:09:26.551 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.619798+0000", 2024-05-08T18:09:26.551 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.90645585, 2024-05-08T18:09:26.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018211183999999998, 2024-05-08T18:09:26.551 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.551 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.551 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.551 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.619798+0000", 2024-05-08T18:09:26.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.619798+0000", 2024-05-08T18:09:26.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.619801+0000", 2024-05-08T18:09:26.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7e-06 2024-05-08T18:09:26.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625096+0000", 2024-05-08T18:09:26.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052944369999999999 2024-05-08T18:09:26.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625126+0000", 2024-05-08T18:09:26.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0960000000000002e-05 2024-05-08T18:09:26.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625165+0000", 2024-05-08T18:09:26.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8136000000000002e-05 2024-05-08T18:09:26.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625291+0000", 2024-05-08T18:09:26.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012613500000000001 2024-05-08T18:09:26.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.625349+0000", 2024-05-08T18:09:26.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8495999999999997e-05 2024-05-08T18:09:26.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.637877+0000", 2024-05-08T18:09:26.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012527652 2024-05-08T18:09:26.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638010+0000", 2024-05-08T18:09:26.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013266800000000001 2024-05-08T18:09:26.554 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.554 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.554 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.555 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1268 3.36 3:6efaad9c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:26.555 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.629292+0000", 2024-05-08T18:09:26.555 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 17.896962202000001, 2024-05-08T18:09:26.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018691711, 2024-05-08T18:09:26.555 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.555 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.555 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.555 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.555 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.555 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.555 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1268 2024-05-08T18:09:26.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.555 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.629292+0000", 2024-05-08T18:09:26.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.629292+0000", 2024-05-08T18:09:26.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.629295+0000", 2024-05-08T18:09:26.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5799999999999999e-06 2024-05-08T18:09:26.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633104+0000", 2024-05-08T18:09:26.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038088869999999999 2024-05-08T18:09:26.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633130+0000", 2024-05-08T18:09:26.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6016e-05 2024-05-08T18:09:26.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633144+0000", 2024-05-08T18:09:26.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3971999999999999e-05 2024-05-08T18:09:26.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633229+0000", 2024-05-08T18:09:26.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5749999999999997e-05 2024-05-08T18:09:26.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633349+0000", 2024-05-08T18:09:26.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011934000000000001 2024-05-08T18:09:26.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:26.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.633507+0000", 2024-05-08T18:09:26.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015834700000000001 2024-05-08T18:09:26.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.639941+0000", 2024-05-08T18:09:26.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064341449999999996 2024-05-08T18:09:26.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.647803+0000", 2024-05-08T18:09:26.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078617889999999992 2024-05-08T18:09:26.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.647907+0000", 2024-05-08T18:09:26.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010413599999999999 2024-05-08T18:09:26.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.647984+0000", 2024-05-08T18:09:26.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6749000000000007e-05 2024-05-08T18:09:26.560 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.560 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.560 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.560 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1275 3.33 e85/20 3:ccdf9558:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_3:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:26.560 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:26.560 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 17.472664644000002, 2024-05-08T18:09:26.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020251129, 2024-05-08T18:09:26.560 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.560 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.560 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.561 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:26.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:26.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053592+0000", 2024-05-08T18:09:26.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5189999999999999e-06 2024-05-08T18:09:26.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059662+0000", 2024-05-08T18:09:26.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060699289999999999 2024-05-08T18:09:26.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059680+0000", 2024-05-08T18:09:26.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7558999999999999e-05 2024-05-08T18:09:26.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059689+0000", 2024-05-08T18:09:26.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2320000000000007e-06 2024-05-08T18:09:26.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059826+0000", 2024-05-08T18:09:26.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136792 2024-05-08T18:09:26.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059867+0000", 2024-05-08T18:09:26.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1689e-05 2024-05-08T18:09:26.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073728+0000", 2024-05-08T18:09:26.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01386104 2024-05-08T18:09:26.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073841+0000", 2024-05-08T18:09:26.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011236899999999999 2024-05-08T18:09:26.564 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.564 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.564 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.564 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1286 3.20 3:07ccb256:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:26.564 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:26.564 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 17.321970029999999, 2024-05-08T18:09:26.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022546805999999999, 2024-05-08T18:09:26.565 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.565 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.565 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.565 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.565 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.565 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.565 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1286 2024-05-08T18:09:26.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.565 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:26.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:26.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204287+0000", 2024-05-08T18:09:26.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8880000000000001e-06 2024-05-08T18:09:26.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208135+0000", 2024-05-08T18:09:26.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038480960000000001 2024-05-08T18:09:26.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208158+0000", 2024-05-08T18:09:26.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-05 2024-05-08T18:09:26.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208172+0000", 2024-05-08T18:09:26.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:09:26.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208251+0000", 2024-05-08T18:09:26.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8863999999999996e-05 2024-05-08T18:09:26.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208387+0000", 2024-05-08T18:09:26.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013615099999999999 2024-05-08T18:09:26.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:26.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208488+0000", 2024-05-08T18:09:26.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101366 2024-05-08T18:09:26.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.214533+0000", 2024-05-08T18:09:26.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060444829999999998 2024-05-08T18:09:26.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226742+0000", 2024-05-08T18:09:26.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012208798 2024-05-08T18:09:26.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226792+0000", 2024-05-08T18:09:26.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0565999999999997e-05 2024-05-08T18:09:26.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226831+0000", 2024-05-08T18:09:26.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8816999999999998e-05 2024-05-08T18:09:26.569 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.569 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.569 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.570 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1397 3.34 e87/20 3:2c6418f0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_3:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:26.570 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:26.570 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.723538040999999, 2024-05-08T18:09:26.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019946450000000001, 2024-05-08T18:09:26.570 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.570 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.570 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.570 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:26.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:26.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802717+0000", 2024-05-08T18:09:26.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0400000000000005e-07 2024-05-08T18:09:26.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807936+0000", 2024-05-08T18:09:26.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052192489999999996 2024-05-08T18:09:26.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807971+0000", 2024-05-08T18:09:26.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4517000000000002e-05 2024-05-08T18:09:26.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807993+0000", 2024-05-08T18:09:26.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2463000000000002e-05 2024-05-08T18:09:26.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.808151+0000", 2024-05-08T18:09:26.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015751400000000001 2024-05-08T18:09:26.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.808197+0000", 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6637000000000001e-05 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822537+0000", 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014339607000000001 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822663+0000", 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125659 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.574 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1399 3.2c 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:26.574 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:26.574 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.706826509999999, 2024-05-08T18:09:26.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030683200000000001, 2024-05-08T18:09:26.574 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.574 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.574 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.574 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.574 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.574 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.574 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1399 2024-05-08T18:09:26.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.574 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:26.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:26.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819432+0000", 2024-05-08T18:09:26.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7759999999999999e-06 2024-05-08T18:09:26.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825021+0000", 2024-05-08T18:09:26.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055895859999999997 2024-05-08T18:09:26.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825052+0000", 2024-05-08T18:09:26.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1047000000000003e-05 2024-05-08T18:09:26.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825068+0000", 2024-05-08T18:09:26.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6138999999999999e-05 2024-05-08T18:09:26.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825218+0000", 2024-05-08T18:09:26.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014997200000000001 2024-05-08T18:09:26.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825490+0000", 2024-05-08T18:09:26.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000271446 2024-05-08T18:09:26.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:26.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825710+0000", 2024-05-08T18:09:26.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220354 2024-05-08T18:09:26.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.839642+0000", 2024-05-08T18:09:26.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013932363 2024-05-08T18:09:26.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849813+0000", 2024-05-08T18:09:26.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010170461 2024-05-08T18:09:26.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849981+0000", 2024-05-08T18:09:26.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016776399999999999 2024-05-08T18:09:26.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.850111+0000", 2024-05-08T18:09:26.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013029200000000001 2024-05-08T18:09:26.579 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.579 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.579 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.579 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1406 3.20 3:05e3d3c1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:26.579 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:26.579 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.637255399000001, 2024-05-08T18:09:26.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022642778999999998, 2024-05-08T18:09:26.579 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.579 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.579 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.579 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.579 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.580 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.580 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1406 2024-05-08T18:09:26.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.580 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:26.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:26.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.889003+0000", 2024-05-08T18:09:26.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8670000000000004e-06 2024-05-08T18:09:26.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893237+0000", 2024-05-08T18:09:26.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042339999999999999 2024-05-08T18:09:26.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893279+0000", 2024-05-08T18:09:26.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2225999999999999e-05 2024-05-08T18:09:26.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893305+0000", 2024-05-08T18:09:26.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.618e-05 2024-05-08T18:09:26.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893479+0000", 2024-05-08T18:09:26.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017357700000000001 2024-05-08T18:09:26.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893736+0000", 2024-05-08T18:09:26.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025701700000000001 2024-05-08T18:09:26.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:26.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893993+0000", 2024-05-08T18:09:26.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025750700000000003 2024-05-08T18:09:26.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904227+0000", 2024-05-08T18:09:26.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010234073 2024-05-08T18:09:26.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911471+0000", 2024-05-08T18:09:26.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0072441909999999997 2024-05-08T18:09:26.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911567+0000", 2024-05-08T18:09:26.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5685000000000003e-05 2024-05-08T18:09:26.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911642+0000", 2024-05-08T18:09:26.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4456000000000007e-05 2024-05-08T18:09:26.584 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.584 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.585 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.585 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1416 3.2c 3:345ebd70:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:26.585 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:26.585 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.529884193999999, 2024-05-08T18:09:26.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027523229999999999, 2024-05-08T18:09:26.585 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.585 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.585 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.585 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.585 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.585 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.585 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1416 2024-05-08T18:09:26.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.586 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:26.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:26.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996374+0000", 2024-05-08T18:09:26.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.506e-06 2024-05-08T18:09:26.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000305+0000", 2024-05-08T18:09:26.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003931197 2024-05-08T18:09:26.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000346+0000", 2024-05-08T18:09:26.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1396000000000001e-05 2024-05-08T18:09:26.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000364+0000", 2024-05-08T18:09:26.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.806e-05 2024-05-08T18:09:26.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000490+0000", 2024-05-08T18:09:26.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012581800000000001 2024-05-08T18:09:26.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000755+0000", 2024-05-08T18:09:26.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026484700000000002 2024-05-08T18:09:26.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:26.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000992+0000", 2024-05-08T18:09:26.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023701700000000001 2024-05-08T18:09:26.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010465+0000", 2024-05-08T18:09:26.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094726429999999993 2024-05-08T18:09:26.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023679+0000", 2024-05-08T18:09:26.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013214105 2024-05-08T18:09:26.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023776+0000", 2024-05-08T18:09:26.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7258999999999998e-05 2024-05-08T18:09:26.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023893+0000", 2024-05-08T18:09:26.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117382 2024-05-08T18:09:26.590 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.590 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.590 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.590 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1424 3.36 3:6c7a05ce:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:26.591 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.375800+0000", 2024-05-08T18:09:26.591 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.150454201000001, 2024-05-08T18:09:26.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019293312999999999, 2024-05-08T18:09:26.591 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.591 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.591 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.591 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.591 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.591 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.591 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1424 2024-05-08T18:09:26.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.591 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.375800+0000", 2024-05-08T18:09:26.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.375800+0000", 2024-05-08T18:09:26.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.375802+0000", 2024-05-08T18:09:26.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3879999999999998e-06 2024-05-08T18:09:26.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.379572+0000", 2024-05-08T18:09:26.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037692820000000001 2024-05-08T18:09:26.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.379602+0000", 2024-05-08T18:09:26.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0114999999999999e-05 2024-05-08T18:09:26.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.379614+0000", 2024-05-08T18:09:26.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1725999999999999e-05 2024-05-08T18:09:26.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.379759+0000", 2024-05-08T18:09:26.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014588000000000001 2024-05-08T18:09:26.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.380200+0000", 2024-05-08T18:09:26.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044040399999999998 2024-05-08T18:09:26.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:26.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.380676+0000", 2024-05-08T18:09:26.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047648100000000001 2024-05-08T18:09:26.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.387146+0000", 2024-05-08T18:09:26.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064695050000000004 2024-05-08T18:09:26.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.394934+0000", 2024-05-08T18:09:26.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007787988 2024-05-08T18:09:26.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.395022+0000", 2024-05-08T18:09:26.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8090000000000005e-05 2024-05-08T18:09:26.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.395093+0000", 2024-05-08T18:09:26.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1453999999999997e-05 2024-05-08T18:09:26.596 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.596 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.596 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.596 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1444 3.2c 3:3746b84a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:26.596 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.785023+0000", 2024-05-08T18:09:26.596 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.741231504, 2024-05-08T18:09:26.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018464464999999999, 2024-05-08T18:09:26.597 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.597 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.597 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.597 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.597 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.597 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.597 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1444 2024-05-08T18:09:26.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.597 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.785023+0000", 2024-05-08T18:09:26.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.785023+0000", 2024-05-08T18:09:26.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.785046+0000", 2024-05-08T18:09:26.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3603000000000001e-05 2024-05-08T18:09:26.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789230+0000", 2024-05-08T18:09:26.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041834300000000001 2024-05-08T18:09:26.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789272+0000", 2024-05-08T18:09:26.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2531999999999999e-05 2024-05-08T18:09:26.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789292+0000", 2024-05-08T18:09:26.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9360000000000001e-05 2024-05-08T18:09:26.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789395+0000", 2024-05-08T18:09:26.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103597 2024-05-08T18:09:26.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789572+0000", 2024-05-08T18:09:26.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017642999999999999 2024-05-08T18:09:26.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:26.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.789746+0000", 2024-05-08T18:09:26.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017421799999999999 2024-05-08T18:09:26.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.802556+0000", 2024-05-08T18:09:26.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012810013 2024-05-08T18:09:26.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.803301+0000", 2024-05-08T18:09:26.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00074479400000000001 2024-05-08T18:09:26.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.803400+0000", 2024-05-08T18:09:26.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9038999999999998e-05 2024-05-08T18:09:26.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.803487+0000", 2024-05-08T18:09:26.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7448999999999996e-05 2024-05-08T18:09:26.602 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.602 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.602 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.602 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1451 3.36 3:6da4b5f8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:26.602 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:26.602 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.229211561, 2024-05-08T18:09:26.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022119236, 2024-05-08T18:09:26.603 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.603 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.603 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.603 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.603 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.603 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.603 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1451 2024-05-08T18:09:26.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.603 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:26.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:26.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297046+0000", 2024-05-08T18:09:26.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6030000000000001e-06 2024-05-08T18:09:26.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301125+0000", 2024-05-08T18:09:26.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004079058 2024-05-08T18:09:26.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301163+0000", 2024-05-08T18:09:26.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7286000000000002e-05 2024-05-08T18:09:26.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301181+0000", 2024-05-08T18:09:26.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.844e-05 2024-05-08T18:09:26.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301325+0000", 2024-05-08T18:09:26.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144284 2024-05-08T18:09:26.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301602+0000", 2024-05-08T18:09:26.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027665399999999998 2024-05-08T18:09:26.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:26.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301835+0000", 2024-05-08T18:09:26.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023292699999999999 2024-05-08T18:09:26.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.318166+0000", 2024-05-08T18:09:26.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016331061000000001 2024-05-08T18:09:26.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.318991+0000", 2024-05-08T18:09:26.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000825427 2024-05-08T18:09:26.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.319082+0000", 2024-05-08T18:09:26.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0743999999999997e-05 2024-05-08T18:09:26.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.319162+0000", 2024-05-08T18:09:26.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9752000000000005e-05 2024-05-08T18:09:26.608 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.608 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.608 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.608 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1465 3.26 3:66c1b1e1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:26.608 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.606487+0000", 2024-05-08T18:09:26.608 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.919767308000001, 2024-05-08T18:09:26.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019185464999999999, 2024-05-08T18:09:26.608 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.608 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.609 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.609 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.609 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.609 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.609 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1465 2024-05-08T18:09:26.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.609 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.606487+0000", 2024-05-08T18:09:26.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.606487+0000", 2024-05-08T18:09:26.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.606491+0000", 2024-05-08T18:09:26.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8229999999999997e-06 2024-05-08T18:09:26.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.610808+0000", 2024-05-08T18:09:26.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043176359999999997 2024-05-08T18:09:26.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.610839+0000", 2024-05-08T18:09:26.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0216e-05 2024-05-08T18:09:26.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.610860+0000", 2024-05-08T18:09:26.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1277999999999999e-05 2024-05-08T18:09:26.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.611027+0000", 2024-05-08T18:09:26.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016708900000000001 2024-05-08T18:09:26.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.611279+0000", 2024-05-08T18:09:26.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025154000000000002 2024-05-08T18:09:26.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:26.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.611522+0000", 2024-05-08T18:09:26.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024351 2024-05-08T18:09:26.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.620744+0000", 2024-05-08T18:09:26.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092216190000000003 2024-05-08T18:09:26.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.625549+0000", 2024-05-08T18:09:26.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048049900000000003 2024-05-08T18:09:26.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.625627+0000", 2024-05-08T18:09:26.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7860000000000003e-05 2024-05-08T18:09:26.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.625672+0000", 2024-05-08T18:09:26.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5904e-05 2024-05-08T18:09:26.614 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.614 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.614 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.614 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1471 3.26 3:6495ae89:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:26.614 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:26.614 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.829607340000001, 2024-05-08T18:09:26.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022361453, 2024-05-08T18:09:26.614 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.614 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.614 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.615 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.615 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.615 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.615 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1471 2024-05-08T18:09:26.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.615 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:26.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:26.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696650+0000", 2024-05-08T18:09:26.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8839999999999998e-06 2024-05-08T18:09:26.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700528+0000", 2024-05-08T18:09:26.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038783390000000002 2024-05-08T18:09:26.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700554+0000", 2024-05-08T18:09:26.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6106e-05 2024-05-08T18:09:26.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700566+0000", 2024-05-08T18:09:26.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2021000000000001e-05 2024-05-08T18:09:26.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700682+0000", 2024-05-08T18:09:26.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115457 2024-05-08T18:09:26.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700951+0000", 2024-05-08T18:09:26.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026891699999999997 2024-05-08T18:09:26.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:26.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.701210+0000", 2024-05-08T18:09:26.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000259017 2024-05-08T18:09:26.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718848+0000", 2024-05-08T18:09:26.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017638132000000001 2024-05-08T18:09:26.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718917+0000", 2024-05-08T18:09:26.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9564e-05 2024-05-08T18:09:26.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718968+0000", 2024-05-08T18:09:26.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1028e-05 2024-05-08T18:09:26.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.719008+0000", 2024-05-08T18:09:26.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9987999999999997e-05 2024-05-08T18:09:26.619 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.619 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.620 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.620 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1472 3.26 3:6656fbbd:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:26.620 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.707521+0000", 2024-05-08T18:09:26.620 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.818733246000001, 2024-05-08T18:09:26.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018269342000000001, 2024-05-08T18:09:26.620 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.620 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.620 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.620 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.620 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.620 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.620 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1472 2024-05-08T18:09:26.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.620 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.707521+0000", 2024-05-08T18:09:26.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.707521+0000", 2024-05-08T18:09:26.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.707524+0000", 2024-05-08T18:09:26.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5050000000000002e-06 2024-05-08T18:09:26.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712193+0000", 2024-05-08T18:09:26.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046691450000000004 2024-05-08T18:09:26.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712228+0000", 2024-05-08T18:09:26.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.523e-05 2024-05-08T18:09:26.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712253+0000", 2024-05-08T18:09:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5242999999999999e-05 2024-05-08T18:09:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712348+0000", 2024-05-08T18:09:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4387000000000003e-05 2024-05-08T18:09:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712462+0000", 2024-05-08T18:09:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114839 2024-05-08T18:09:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.712560+0000", 2024-05-08T18:09:26.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7554999999999997e-05 2024-05-08T18:09:26.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.725401+0000", 2024-05-08T18:09:26.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012841175999999999 2024-05-08T18:09:26.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.725690+0000", 2024-05-08T18:09:26.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028845800000000001 2024-05-08T18:09:26.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.725731+0000", 2024-05-08T18:09:26.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1672999999999999e-05 2024-05-08T18:09:26.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.725790+0000", 2024-05-08T18:09:26.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9131e-05 2024-05-08T18:09:26.625 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.625 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.625 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.625 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1669 3.2c 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-05-08T18:09:26.625 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:26.625 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.7263422370000008, 2024-05-08T18:09:26.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020235185999999999, 2024-05-08T18:09:26.626 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.626 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.626 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-05-08T18:09:26.626 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.626 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.626 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.626 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1669 2024-05-08T18:09:26.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.626 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:26.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:26.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799916+0000", 2024-05-08T18:09:26.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7730000000000001e-06 2024-05-08T18:09:26.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799931+0000", 2024-05-08T18:09:26.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5227e-05 2024-05-08T18:09:26.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799969+0000", 2024-05-08T18:09:26.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7883000000000003e-05 2024-05-08T18:09:26.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799986+0000", 2024-05-08T18:09:26.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6728999999999999e-05 2024-05-08T18:09:26.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.800123+0000", 2024-05-08T18:09:26.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013784600000000001 2024-05-08T18:09:26.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:26.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.800135+0000", 2024-05-08T18:09:26.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1336e-05 2024-05-08T18:09:26.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.805653+0000", 2024-05-08T18:09:26.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055179890000000001 2024-05-08T18:09:26.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.805876+0000", 2024-05-08T18:09:26.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022279 2024-05-08T18:09:26.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.820147+0000", 2024-05-08T18:09:26.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014271613000000001 2024-05-08T18:09:26.630 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.630 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.630 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.630 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1910 3.a 3:537830e8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.21:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:26.630 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:25.987700+0000", 2024-05-08T18:09:26.630 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.53855441500000001, 2024-05-08T18:09:26.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020512796999999999, 2024-05-08T18:09:26.630 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.631 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.631 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:26.631 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:26.631 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:26.631 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:26.631 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1910 2024-05-08T18:09:26.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.631 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.987700+0000", 2024-05-08T18:09:26.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.987700+0000", 2024-05-08T18:09:26.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.987703+0000", 2024-05-08T18:09:26.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1130000000000001e-06 2024-05-08T18:09:26.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991635+0000", 2024-05-08T18:09:26.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039315579999999999 2024-05-08T18:09:26.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991673+0000", 2024-05-08T18:09:26.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8550000000000002e-05 2024-05-08T18:09:26.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991691+0000", 2024-05-08T18:09:26.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.768e-05 2024-05-08T18:09:26.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991796+0000", 2024-05-08T18:09:26.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105474 2024-05-08T18:09:26.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.992021+0000", 2024-05-08T18:09:26.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022432999999999999 2024-05-08T18:09:26.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:26.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.992664+0000", 2024-05-08T18:09:26.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064343099999999997 2024-05-08T18:09:26.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:26.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.004478+0000", 2024-05-08T18:09:26.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011814069 2024-05-08T18:09:26.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:26.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.008061+0000", 2024-05-08T18:09:26.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035826289999999999 2024-05-08T18:09:26.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:26.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.008129+0000", 2024-05-08T18:09:26.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8734999999999998e-05 2024-05-08T18:09:26.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:26.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.008213+0000", 2024-05-08T18:09:26.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3227999999999997e-05 2024-05-08T18:09:26.636 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.636 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.636 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.636 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.636 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.636 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:26.637 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.25 2024-05-08T18:09:26.637 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:26.637 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 26 2024-05-08T18:09:26.638 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:26.638 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:26.638 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.013244 s, 792 MB/s 2024-05-08T18:09:26.638 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:26.640+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:26.639 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:09:26.704 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.26 2024-05-08T18:09:26.705 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:26.705 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 27 2024-05-08T18:09:26.721 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:26.721 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:26.721 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0131526 s, 797 MB/s 2024-05-08T18:09:26.738 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:26.740+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:26.807 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:26.808 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:26.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.808 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1945 3.2b e91/20 3:d4556bc7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.vh7S0QfOsPQyJLx7ey_lJISzPG1L1dO_1:head v 91'4, mlcod=85'2)", 2024-05-08T18:09:26.809 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:26.798409+0000", 2024-05-08T18:09:26.809 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.011370600999999999, 2024-05-08T18:09:26.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01142839, 2024-05-08T18:09:26.809 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:26.809 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:26.809 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-05-08T18:09:26.809 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:26.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:26.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.798409+0000", 2024-05-08T18:09:26.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:26.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.798409+0000", 2024-05-08T18:09:26.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:26.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:26.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.798412+0000", 2024-05-08T18:09:26.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.253e-06 2024-05-08T18:09:26.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:26.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.804359+0000", 2024-05-08T18:09:26.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059465840000000004 2024-05-08T18:09:26.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:26.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.804396+0000", 2024-05-08T18:09:26.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7474000000000001e-05 2024-05-08T18:09:26.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:26.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.804419+0000", 2024-05-08T18:09:26.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2586e-05 2024-05-08T18:09:26.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:26.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.804591+0000", 2024-05-08T18:09:26.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017234100000000001 2024-05-08T18:09:26.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:26.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:26.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:26.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.804634+0000", 2024-05-08T18:09:26.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3072999999999999e-05 2024-05-08T18:09:26.812 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.812 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:26.812 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.812 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:26.812 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-05-08T18:09:26.812 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 1 2024-05-08T18:09:26.812 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:26.826 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:09:26.833 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-05-08T18:09:26.839 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:26.840+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:26.843 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.27 2024-05-08T18:09:26.843 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:26.843 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 28 2024-05-08T18:09:26.855 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:26.855 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:26.855 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101568 s, 1.0 GB/s 2024-05-08T18:09:26.940 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:26.940+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:26.955 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:26.956 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:26.956 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:26.956 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:26.956 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:26.976 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:09:26.977 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.28 2024-05-08T18:09:26.977 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:26.978 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 29 2024-05-08T18:09:26.991 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:26.992 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:26.992 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120773 s, 868 MB/s 2024-05-08T18:09:27.041 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:27.040+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:27.099 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:09:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 144.28329030500001, 2024-05-08T18:09:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.16213206199999999, 2024-05-08T18:09:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:09:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:09:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1 2024-05-08T18:09:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814494+0000", 2024-05-08T18:09:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:09:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814520+0000", 2024-05-08T18:09:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-05 2024-05-08T18:09:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814543+0000", 2024-05-08T18:09:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2353000000000001e-05 2024-05-08T18:09:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814563+0000", 2024-05-08T18:09:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.048e-05 2024-05-08T18:09:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814677+0000", 2024-05-08T18:09:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113632 2024-05-08T18:09:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814705+0000", 2024-05-08T18:09:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8626999999999999e-05 2024-05-08T18:09:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971115+0000", 2024-05-08T18:09:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.156409825 2024-05-08T18:09:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971438+0000", 2024-05-08T18:09:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00032289200000000002 2024-05-08T18:09:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971849+0000", 2024-05-08T18:09:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041139300000000002 2024-05-08T18:09:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.975364+0000", 2024-05-08T18:09:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035148390000000001 2024-05-08T18:09:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976474+0000", 2024-05-08T18:09:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001110099 2024-05-08T18:09:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976564+0000", 2024-05-08T18:09:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9522000000000001e-05 2024-05-08T18:09:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976624+0000", 2024-05-08T18:09:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9616e-05 2024-05-08T18:09:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:09:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:09:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 143.98793357100001, 2024-05-08T18:09:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021440811000000001, 2024-05-08T18:09:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:09:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:09:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 52 2024-05-08T18:09:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:09:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:09:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109849+0000", 2024-05-08T18:09:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1370000000000001e-06 2024-05-08T18:09:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109861+0000", 2024-05-08T18:09:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1559999999999999e-05 2024-05-08T18:09:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109878+0000", 2024-05-08T18:09:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7105999999999999e-05 2024-05-08T18:09:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109892+0000", 2024-05-08T18:09:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3577000000000001e-05 2024-05-08T18:09:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126161+0000", 2024-05-08T18:09:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016269458000000001 2024-05-08T18:09:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126299+0000", 2024-05-08T18:09:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138405 2024-05-08T18:09:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126534+0000", 2024-05-08T18:09:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000234875 2024-05-08T18:09:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127543+0000", 2024-05-08T18:09:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001008852 2024-05-08T18:09:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131128+0000", 2024-05-08T18:09:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035844359999999999 2024-05-08T18:09:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131222+0000", 2024-05-08T18:09:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3905000000000003e-05 2024-05-08T18:09:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131289+0000", 2024-05-08T18:09:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7500000000000001e-05 2024-05-08T18:09:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1194 3.16 e85/20 3:6b2325a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_6:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 20.076888095000001, 2024-05-08T18:09:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024064767000000001, 2024-05-08T18:09:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020897+0000", 2024-05-08T18:09:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9699999999999999e-06 2024-05-08T18:09:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027491+0000", 2024-05-08T18:09:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065945229999999997 2024-05-08T18:09:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027543+0000", 2024-05-08T18:09:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1319000000000001e-05 2024-05-08T18:09:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027573+0000", 2024-05-08T18:09:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0380000000000001e-05 2024-05-08T18:09:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027737+0000", 2024-05-08T18:09:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000163871 2024-05-08T18:09:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027782+0000", 2024-05-08T18:09:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5519999999999998e-05 2024-05-08T18:09:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044819+0000", 2024-05-08T18:09:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017036481999999999 2024-05-08T18:09:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044958+0000", 2024-05-08T18:09:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013970200000000001 2024-05-08T18:09:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1202 3.14 e85/20 3:2a8c8569:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_14:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.990938026999999, 2024-05-08T18:09:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023371860000000001, 2024-05-08T18:09:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106846+0000", 2024-05-08T18:09:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:09:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110841+0000", 2024-05-08T18:09:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039945479999999997 2024-05-08T18:09:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110888+0000", 2024-05-08T18:09:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7349999999999999e-05 2024-05-08T18:09:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110913+0000", 2024-05-08T18:09:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5055999999999999e-05 2024-05-08T18:09:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.111067+0000", 2024-05-08T18:09:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015329800000000001 2024-05-08T18:09:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.111110+0000", 2024-05-08T18:09:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3649000000000002e-05 2024-05-08T18:09:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130087+0000", 2024-05-08T18:09:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018976186999999999 2024-05-08T18:09:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130216+0000", 2024-05-08T18:09:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012911199999999999 2024-05-08T18:09:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1207 3.15 3:a96d965c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.945355752000001, 2024-05-08T18:09:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02864527, 2024-05-08T18:09:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1207 2024-05-08T18:09:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152430+0000", 2024-05-08T18:09:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1230000000000002e-06 2024-05-08T18:09:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157227+0000", 2024-05-08T18:09:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047968769999999997 2024-05-08T18:09:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157268+0000", 2024-05-08T18:09:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0673000000000002e-05 2024-05-08T18:09:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157293+0000", 2024-05-08T18:09:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5469999999999998e-05 2024-05-08T18:09:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157483+0000", 2024-05-08T18:09:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018973300000000001 2024-05-08T18:09:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157750+0000", 2024-05-08T18:09:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026736400000000002 2024-05-08T18:09:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157982+0000", 2024-05-08T18:09:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023154299999999999 2024-05-08T18:09:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.171224+0000", 2024-05-08T18:09:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013242115 2024-05-08T18:09:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180801+0000", 2024-05-08T18:09:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0095766749999999998 2024-05-08T18:09:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180919+0000", 2024-05-08T18:09:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118546 2024-05-08T18:09:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.181071+0000", 2024-05-08T18:09:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152151 2024-05-08T18:09:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.127 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1224 3.13 3:c82cef46:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:27.127 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:27.127 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.459302105999999, 2024-05-08T18:09:27.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025580821, 2024-05-08T18:09:27.127 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.127 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.127 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.127 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:27.127 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:27.127 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.127 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1224 2024-05-08T18:09:27.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.127 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:27.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:27.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638484+0000", 2024-05-08T18:09:27.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1989999999999999e-06 2024-05-08T18:09:27.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643068+0000", 2024-05-08T18:09:27.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045841859999999996 2024-05-08T18:09:27.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643099+0000", 2024-05-08T18:09:27.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1331999999999997e-05 2024-05-08T18:09:27.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643117+0000", 2024-05-08T18:09:27.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7176999999999998e-05 2024-05-08T18:09:27.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643262+0000", 2024-05-08T18:09:27.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014521299999999999 2024-05-08T18:09:27.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643523+0000", 2024-05-08T18:09:27.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000260783 2024-05-08T18:09:27.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:27.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643768+0000", 2024-05-08T18:09:27.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024567399999999998 2024-05-08T18:09:27.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:27.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.662501+0000", 2024-05-08T18:09:27.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018732988999999999 2024-05-08T18:09:27.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663964+0000", 2024-05-08T18:09:27.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001463074 2024-05-08T18:09:27.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.664015+0000", 2024-05-08T18:09:27.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0549e-05 2024-05-08T18:09:27.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.664061+0000", 2024-05-08T18:09:27.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5645000000000001e-05 2024-05-08T18:09:27.132 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.132 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.132 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.132 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1236 3.37 3:ed82f067:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:27.132 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.862196+0000", 2024-05-08T18:09:27.132 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.235586097999999, 2024-05-08T18:09:27.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020336864999999999, 2024-05-08T18:09:27.132 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1236 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.862196+0000", 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.862196+0000", 2024-05-08T18:09:27.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.862198+0000", 2024-05-08T18:09:27.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1050000000000002e-06 2024-05-08T18:09:27.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.866292+0000", 2024-05-08T18:09:27.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040943899999999998 2024-05-08T18:09:27.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.866319+0000", 2024-05-08T18:09:27.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6424e-05 2024-05-08T18:09:27.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.866330+0000", 2024-05-08T18:09:27.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1695999999999999e-05 2024-05-08T18:09:27.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.866492+0000", 2024-05-08T18:09:27.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000161562 2024-05-08T18:09:27.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.866757+0000", 2024-05-08T18:09:27.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026477599999999999 2024-05-08T18:09:27.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:27.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.867014+0000", 2024-05-08T18:09:27.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025779299999999998 2024-05-08T18:09:27.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:27.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.882342+0000", 2024-05-08T18:09:27.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015327172 2024-05-08T18:09:27.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.882444+0000", 2024-05-08T18:09:27.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010221300000000001 2024-05-08T18:09:27.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.882487+0000", 2024-05-08T18:09:27.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3158999999999998e-05 2024-05-08T18:09:27.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.882533+0000", 2024-05-08T18:09:27.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5575000000000003e-05 2024-05-08T18:09:27.137 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.137 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.137 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.138 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1249 3.39 3:9d9659c4:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:27.138 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.404107+0000", 2024-05-08T18:09:27.138 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.693674729000001, 2024-05-08T18:09:27.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019803141999999999, 2024-05-08T18:09:27.138 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.138 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.138 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.138 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:27.138 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:27.138 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.138 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1249 2024-05-08T18:09:27.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.138 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.404107+0000", 2024-05-08T18:09:27.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.404107+0000", 2024-05-08T18:09:27.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.404109+0000", 2024-05-08T18:09:27.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3769999999999999e-06 2024-05-08T18:09:27.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.408166+0000", 2024-05-08T18:09:27.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040569059999999999 2024-05-08T18:09:27.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.408192+0000", 2024-05-08T18:09:27.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5222999999999999e-05 2024-05-08T18:09:27.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.408202+0000", 2024-05-08T18:09:27.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0730000000000001e-05 2024-05-08T18:09:27.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.408298+0000", 2024-05-08T18:09:27.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5326000000000002e-05 2024-05-08T18:09:27.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.408517+0000", 2024-05-08T18:09:27.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021936699999999999 2024-05-08T18:09:27.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:27.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.408717+0000", 2024-05-08T18:09:27.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019954200000000001 2024-05-08T18:09:27.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:27.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.414652+0000", 2024-05-08T18:09:27.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059357669999999998 2024-05-08T18:09:27.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.423743+0000", 2024-05-08T18:09:27.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0090907109999999996 2024-05-08T18:09:27.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.423839+0000", 2024-05-08T18:09:27.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5867999999999998e-05 2024-05-08T18:09:27.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.423910+0000", 2024-05-08T18:09:27.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1324999999999999e-05 2024-05-08T18:09:27.143 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.143 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.143 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.143 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1255 3.12 e85/20 3:48af9d8c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_11:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:27.143 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:27.143 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.616304154000002, 2024-05-08T18:09:27.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021924084999999999, 2024-05-08T18:09:27.143 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.143 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.144 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.144 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:27.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:27.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481479+0000", 2024-05-08T18:09:27.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999999999999999e-06 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.485998+0000", 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045194600000000003 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486023+0000", 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4516999999999999e-05 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486033+0000", 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0529e-05 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486172+0000", 2024-05-08T18:09:27.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013829599999999999 2024-05-08T18:09:27.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486234+0000", 2024-05-08T18:09:27.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2156000000000006e-05 2024-05-08T18:09:27.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.503338+0000", 2024-05-08T18:09:27.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017104346999999999 2024-05-08T18:09:27.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.503402+0000", 2024-05-08T18:09:27.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3579999999999998e-05 2024-05-08T18:09:27.147 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.147 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.147 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.147 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1277 3.3f 3:ffe0c8dc:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:27.147 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:27.147 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.012655122000002, 2024-05-08T18:09:27.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025789262, 2024-05-08T18:09:27.147 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.147 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.147 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.148 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:27.148 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:27.148 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.148 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1277 2024-05-08T18:09:27.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.148 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:27.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:27.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085130+0000", 2024-05-08T18:09:27.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4659999999999999e-06 2024-05-08T18:09:27.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089237+0000", 2024-05-08T18:09:27.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004106424 2024-05-08T18:09:27.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089281+0000", 2024-05-08T18:09:27.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4053e-05 2024-05-08T18:09:27.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089300+0000", 2024-05-08T18:09:27.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9057000000000001e-05 2024-05-08T18:09:27.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089467+0000", 2024-05-08T18:09:27.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000167734 2024-05-08T18:09:27.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089839+0000", 2024-05-08T18:09:27.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037171900000000001 2024-05-08T18:09:27.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:27.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.090206+0000", 2024-05-08T18:09:27.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036716500000000003 2024-05-08T18:09:27.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.105682+0000", 2024-05-08T18:09:27.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015475495000000001 2024-05-08T18:09:27.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:27.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110695+0000", 2024-05-08T18:09:27.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050135420000000002 2024-05-08T18:09:27.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110779+0000", 2024-05-08T18:09:27.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3914999999999999e-05 2024-05-08T18:09:27.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110916+0000", 2024-05-08T18:09:27.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136692 2024-05-08T18:09:27.152 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.152 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.152 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.153 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1283 3.39 3:9ca6d3f9:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:27.153 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:27.153 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 17.928569538000001, 2024-05-08T18:09:27.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022844218999999999, 2024-05-08T18:09:27.153 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.153 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.153 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.153 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:27.153 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:27.153 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.153 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1283 2024-05-08T18:09:27.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.153 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:27.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:27.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169215+0000", 2024-05-08T18:09:27.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9529999999999999e-06 2024-05-08T18:09:27.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173086+0000", 2024-05-08T18:09:27.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003870582 2024-05-08T18:09:27.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173107+0000", 2024-05-08T18:09:27.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1608999999999999e-05 2024-05-08T18:09:27.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173117+0000", 2024-05-08T18:09:27.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8090000000000004e-06 2024-05-08T18:09:27.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173192+0000", 2024-05-08T18:09:27.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4676000000000001e-05 2024-05-08T18:09:27.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:27.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173197+0000", 2024-05-08T18:09:27.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0710000000000002e-06 2024-05-08T18:09:27.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.175963+0000", 2024-05-08T18:09:27.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027662810000000002 2024-05-08T18:09:27.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.176138+0000", 2024-05-08T18:09:27.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017430500000000001 2024-05-08T18:09:27.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:27.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.176332+0000", 2024-05-08T18:09:27.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019477000000000001 2024-05-08T18:09:27.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:27.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.184230+0000", 2024-05-08T18:09:27.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078977630000000004 2024-05-08T18:09:27.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.191962+0000", 2024-05-08T18:09:27.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077315830000000002 2024-05-08T18:09:27.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.192015+0000", 2024-05-08T18:09:27.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2992999999999999e-05 2024-05-08T18:09:27.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.192056+0000", 2024-05-08T18:09:27.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1823999999999998e-05 2024-05-08T18:09:27.159 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.159 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.159 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.159 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1407 3.7 e87/20 3:e339c0c4:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_13:head v 87'1, mlcod=0'0)", 2024-05-08T18:09:27.159 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.902217+0000", 2024-05-08T18:09:27.159 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.195565167, 2024-05-08T18:09:27.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019771094999999999, 2024-05-08T18:09:27.159 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.160 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.160 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.160 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.902217+0000", 2024-05-08T18:09:27.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.902217+0000", 2024-05-08T18:09:27.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.902217+0000", 2024-05-08T18:09:27.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3399999999999998e-07 2024-05-08T18:09:27.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.908177+0000", 2024-05-08T18:09:27.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005959303 2024-05-08T18:09:27.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.908222+0000", 2024-05-08T18:09:27.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4839999999999998e-05 2024-05-08T18:09:27.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.908245+0000", 2024-05-08T18:09:27.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3918999999999999e-05 2024-05-08T18:09:27.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.908405+0000", 2024-05-08T18:09:27.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000159448 2024-05-08T18:09:27.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.908447+0000", 2024-05-08T18:09:27.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1616999999999998e-05 2024-05-08T18:09:27.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.921804+0000", 2024-05-08T18:09:27.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013357677 2024-05-08T18:09:27.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.921988+0000", 2024-05-08T18:09:27.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018355699999999999 2024-05-08T18:09:27.163 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.163 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.163 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.164 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1412 3.3f 3:fe02d1ba:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:27.164 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:27.164 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.140117512, 2024-05-08T18:09:27.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023048524000000001, 2024-05-08T18:09:27.164 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.164 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.164 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.164 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:27.164 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:27.164 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.164 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1412 2024-05-08T18:09:27.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.164 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:27.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:27.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957668+0000", 2024-05-08T18:09:27.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8999999999999999e-06 2024-05-08T18:09:27.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963142+0000", 2024-05-08T18:09:27.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005473627 2024-05-08T18:09:27.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963181+0000", 2024-05-08T18:09:27.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.93e-05 2024-05-08T18:09:27.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963199+0000", 2024-05-08T18:09:27.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7866000000000001e-05 2024-05-08T18:09:27.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963347+0000", 2024-05-08T18:09:27.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014816800000000001 2024-05-08T18:09:27.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963603+0000", 2024-05-08T18:09:27.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025623099999999999 2024-05-08T18:09:27.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:27.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963843+0000", 2024-05-08T18:09:27.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023961699999999999 2024-05-08T18:09:27.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:27.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.975743+0000", 2024-05-08T18:09:27.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011899998 2024-05-08T18:09:27.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980533+0000", 2024-05-08T18:09:27.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047898749999999999 2024-05-08T18:09:27.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980638+0000", 2024-05-08T18:09:27.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010527300000000001 2024-05-08T18:09:27.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980713+0000", 2024-05-08T18:09:27.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4668999999999999e-05 2024-05-08T18:09:27.169 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.169 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.169 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.169 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1417 3.15 3:a8711592:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:27.169 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.005810+0000", 2024-05-08T18:09:27.169 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.091972211, 2024-05-08T18:09:27.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021479357000000001, 2024-05-08T18:09:27.170 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.170 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.170 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.170 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:27.170 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:27.170 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.170 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1417 2024-05-08T18:09:27.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.170 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.005810+0000", 2024-05-08T18:09:27.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.005810+0000", 2024-05-08T18:09:27.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.005813+0000", 2024-05-08T18:09:27.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6899999999999998e-06 2024-05-08T18:09:27.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.009925+0000", 2024-05-08T18:09:27.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041117039999999999 2024-05-08T18:09:27.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.009975+0000", 2024-05-08T18:09:27.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9759000000000003e-05 2024-05-08T18:09:27.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010001+0000", 2024-05-08T18:09:27.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6267000000000001e-05 2024-05-08T18:09:27.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010128+0000", 2024-05-08T18:09:27.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012743100000000001 2024-05-08T18:09:27.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010403+0000", 2024-05-08T18:09:27.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027485699999999999 2024-05-08T18:09:27.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:27.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010633+0000", 2024-05-08T18:09:27.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000229254 2024-05-08T18:09:27.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:27.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023537+0000", 2024-05-08T18:09:27.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012904456 2024-05-08T18:09:27.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.027115+0000", 2024-05-08T18:09:27.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003577818 2024-05-08T18:09:27.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.027222+0000", 2024-05-08T18:09:27.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000106879 2024-05-08T18:09:27.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.027289+0000", 2024-05-08T18:09:27.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7242000000000004e-05 2024-05-08T18:09:27.175 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.175 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.175 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.175 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1420 3.e 3:72accb8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.8:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:27.175 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:27.175 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.062048642000001, 2024-05-08T18:09:27.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025387064000000001, 2024-05-08T18:09:27.175 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.175 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.175 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.175 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:27.175 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:27.176 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.176 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1420 2024-05-08T18:09:27.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.176 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:27.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:27.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035736+0000", 2024-05-08T18:09:27.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0240000000000002e-06 2024-05-08T18:09:27.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039738+0000", 2024-05-08T18:09:27.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004001419 2024-05-08T18:09:27.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039775+0000", 2024-05-08T18:09:27.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7696e-05 2024-05-08T18:09:27.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039792+0000", 2024-05-08T18:09:27.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7183000000000001e-05 2024-05-08T18:09:27.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039909+0000", 2024-05-08T18:09:27.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116915 2024-05-08T18:09:27.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.040173+0000", 2024-05-08T18:09:27.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026373100000000001 2024-05-08T18:09:27.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:27.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.041106+0000", 2024-05-08T18:09:27.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093293100000000002 2024-05-08T18:09:27.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060858+0000", 2024-05-08T18:09:27.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019752232000000002 2024-05-08T18:09:27.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:27.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060894+0000", 2024-05-08T18:09:27.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6056000000000002e-05 2024-05-08T18:09:27.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.061023+0000", 2024-05-08T18:09:27.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128849 2024-05-08T18:09:27.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.061120+0000", 2024-05-08T18:09:27.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7027999999999993e-05 2024-05-08T18:09:27.180 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.180 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.180 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.181 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1429 3.3b 3:dcac3b7e:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:27.181 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.473560+0000", 2024-05-08T18:09:27.181 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.624221327000001, 2024-05-08T18:09:27.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021091181000000001, 2024-05-08T18:09:27.181 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.181 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.181 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.181 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:27.181 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:27.181 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.181 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1429 2024-05-08T18:09:27.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.181 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.473560+0000", 2024-05-08T18:09:27.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.473560+0000", 2024-05-08T18:09:27.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.473563+0000", 2024-05-08T18:09:27.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.103e-06 2024-05-08T18:09:27.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477321+0000", 2024-05-08T18:09:27.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037581120000000001 2024-05-08T18:09:27.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477342+0000", 2024-05-08T18:09:27.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1607000000000002e-05 2024-05-08T18:09:27.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477352+0000", 2024-05-08T18:09:27.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0138e-05 2024-05-08T18:09:27.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477440+0000", 2024-05-08T18:09:27.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7557000000000002e-05 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477582+0000", 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014232700000000001 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477723+0000", 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140564 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.483995+0000", 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006272082 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.494563+0000", 2024-05-08T18:09:27.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01056786 2024-05-08T18:09:27.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.494611+0000", 2024-05-08T18:09:27.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8062000000000002e-05 2024-05-08T18:09:27.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.494652+0000", 2024-05-08T18:09:27.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0769000000000002e-05 2024-05-08T18:09:27.185 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.185 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.185 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.186 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1448 3.15 3:a83ea02a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.9:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:27.186 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:27.186 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.193860824, 2024-05-08T18:09:27.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021945044, 2024-05-08T18:09:27.186 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.186 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.186 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.186 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:27.186 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:27.186 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.186 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1448 2024-05-08T18:09:27.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.186 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:27.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:27.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903924+0000", 2024-05-08T18:09:27.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5790000000000002e-06 2024-05-08T18:09:27.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907773+0000", 2024-05-08T18:09:27.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038495740000000001 2024-05-08T18:09:27.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907796+0000", 2024-05-08T18:09:27.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3011e-05 2024-05-08T18:09:27.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907806+0000", 2024-05-08T18:09:27.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9729999999999992e-06 2024-05-08T18:09:27.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907885+0000", 2024-05-08T18:09:27.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8799000000000002e-05 2024-05-08T18:09:27.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.908059+0000", 2024-05-08T18:09:27.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017370100000000001 2024-05-08T18:09:27.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:27.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.908581+0000", 2024-05-08T18:09:27.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052234099999999995 2024-05-08T18:09:27.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:27.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.918050+0000", 2024-05-08T18:09:27.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00946871 2024-05-08T18:09:27.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925682+0000", 2024-05-08T18:09:27.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0076326689999999999 2024-05-08T18:09:27.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925817+0000", 2024-05-08T18:09:27.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013451000000000001 2024-05-08T18:09:27.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925866+0000", 2024-05-08T18:09:27.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9177e-05 2024-05-08T18:09:27.191 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.191 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.191 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.191 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1453 3.39 3:9c43a7c4:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:27.191 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.342425+0000", 2024-05-08T18:09:27.191 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.755356328, 2024-05-08T18:09:27.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020079920000000001, 2024-05-08T18:09:27.191 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.191 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.191 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.191 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:27.191 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:27.192 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.192 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1453 2024-05-08T18:09:27.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.192 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.342425+0000", 2024-05-08T18:09:27.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.342425+0000", 2024-05-08T18:09:27.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.342429+0000", 2024-05-08T18:09:27.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.658e-06 2024-05-08T18:09:27.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.346770+0000", 2024-05-08T18:09:27.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043407039999999999 2024-05-08T18:09:27.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.346799+0000", 2024-05-08T18:09:27.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9217000000000002e-05 2024-05-08T18:09:27.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.346812+0000", 2024-05-08T18:09:27.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2673e-05 2024-05-08T18:09:27.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.346900+0000", 2024-05-08T18:09:27.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7820999999999998e-05 2024-05-08T18:09:27.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.347059+0000", 2024-05-08T18:09:27.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015982600000000001 2024-05-08T18:09:27.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:27.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.347193+0000", 2024-05-08T18:09:27.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013342599999999999 2024-05-08T18:09:27.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:27.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.354005+0000", 2024-05-08T18:09:27.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068120170000000001 2024-05-08T18:09:27.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.362384+0000", 2024-05-08T18:09:27.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083795829999999995 2024-05-08T18:09:27.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.362447+0000", 2024-05-08T18:09:27.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2545000000000005e-05 2024-05-08T18:09:27.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.362505+0000", 2024-05-08T18:09:27.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8449999999999998e-05 2024-05-08T18:09:27.196 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.196 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.196 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.196 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1904 3.3b 3:dd91eaf5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.20:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:27.196 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:25.873222+0000", 2024-05-08T18:09:27.196 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.22455939, 2024-05-08T18:09:27.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021920749999999999, 2024-05-08T18:09:27.197 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.197 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.197 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.197 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:27.197 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:27.197 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.197 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1904 2024-05-08T18:09:27.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.197 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.873222+0000", 2024-05-08T18:09:27.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.873222+0000", 2024-05-08T18:09:27.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.873224+0000", 2024-05-08T18:09:27.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.007e-06 2024-05-08T18:09:27.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.876973+0000", 2024-05-08T18:09:27.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003748735 2024-05-08T18:09:27.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.877002+0000", 2024-05-08T18:09:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8792000000000001e-05 2024-05-08T18:09:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.877017+0000", 2024-05-08T18:09:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5017e-05 2024-05-08T18:09:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.877186+0000", 2024-05-08T18:09:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016915800000000001 2024-05-08T18:09:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.877618+0000", 2024-05-08T18:09:27.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043144899999999998 2024-05-08T18:09:27.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:27.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.878816+0000", 2024-05-08T18:09:27.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011984700000000001 2024-05-08T18:09:27.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:27.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.894131+0000", 2024-05-08T18:09:27.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015314876 2024-05-08T18:09:27.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.894825+0000", 2024-05-08T18:09:27.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00069365599999999996 2024-05-08T18:09:27.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.895019+0000", 2024-05-08T18:09:27.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000194441 2024-05-08T18:09:27.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.895143+0000", 2024-05-08T18:09:27.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012414899999999999 2024-05-08T18:09:27.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.202 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.202 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.202 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1931 3.15 3:a838452a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.rt8jcH7t-Si0Elu5GsS4JhWyuPnbJ5v_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:27.202 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:27.202 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.57787018000000001, 2024-05-08T18:09:27.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022148926999999999, 2024-05-08T18:09:27.202 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:27.202 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:27.202 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.202 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:27.202 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:27.202 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.202 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1931 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519915+0000", 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4070000000000002e-06 2024-05-08T18:09:27.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:27.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523840+0000", 2024-05-08T18:09:27.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00392494 2024-05-08T18:09:27.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:27.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523881+0000", 2024-05-08T18:09:27.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0729999999999998e-05 2024-05-08T18:09:27.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523901+0000", 2024-05-08T18:09:27.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9816000000000001e-05 2024-05-08T18:09:27.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:27.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524034+0000", 2024-05-08T18:09:27.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013357199999999999 2024-05-08T18:09:27.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:27.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524297+0000", 2024-05-08T18:09:27.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000262697 2024-05-08T18:09:27.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:27.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524555+0000", 2024-05-08T18:09:27.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025802099999999999 2024-05-08T18:09:27.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:27.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.535170+0000", 2024-05-08T18:09:27.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010615528000000001 2024-05-08T18:09:27.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.541876+0000", 2024-05-08T18:09:27.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006705562 2024-05-08T18:09:27.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:27.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.541984+0000", 2024-05-08T18:09:27.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108585 2024-05-08T18:09:27.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:27.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:27.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:27.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.542061+0000", 2024-05-08T18:09:27.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6069000000000006e-05 2024-05-08T18:09:27.207 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.207 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.207 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.207 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:27.207 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:27.207 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:27.208 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.29 2024-05-08T18:09:27.208 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:27.208 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 30 2024-05-08T18:09:27.208 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:27.208 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:27.209 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0129783 s, 808 MB/s 2024-05-08T18:09:27.209 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:27.208+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:27.209 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:09:27.262 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.30 2024-05-08T18:09:27.262 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:27.262 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 31 2024-05-08T18:09:27.274 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:27.274 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:27.274 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101392 s, 1.0 GB/s 2024-05-08T18:09:27.309 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:27.312+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:27.347 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:27.347 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:27.347 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:27.347 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:27.364 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:09:27.390 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.31 2024-05-08T18:09:27.390 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:27.390 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 32 2024-05-08T18:09:27.402 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:27.402 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:27.402 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00960363 s, 1.1 GB/s 2024-05-08T18:09:27.410 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:27.412+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:27.511 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.32 2024-05-08T18:09:27.512 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:27.512 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 33 2024-05-08T18:09:27.512 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:27.513+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:27.523 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:27.524 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:27.525 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:27.525 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:27.525 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111201 s, 943 MB/s 2024-05-08T18:09:27.539 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:09:27.626 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:27.628+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:27.652 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.33 2024-05-08T18:09:27.652 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:27.652 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 34 2024-05-08T18:09:27.663 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:27.663 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:27.663 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00910022 s, 1.2 GB/s 2024-05-08T18:09:27.681 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:09:27.707 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:27.707 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:27.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:27.707 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:27.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.707 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1189 3.20 e85/20 3:054e8a9f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_1:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:27.707 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:06.970576+0000", 2024-05-08T18:09:27.707 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.740662064999999, 2024-05-08T18:09:27.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017796966000000001, 2024-05-08T18:09:27.708 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.708 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.708 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.708 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.970576+0000", 2024-05-08T18:09:27.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.970576+0000", 2024-05-08T18:09:27.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.970580+0000", 2024-05-08T18:09:27.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9210000000000002e-06 2024-05-08T18:09:27.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.976457+0000", 2024-05-08T18:09:27.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0058767660000000003 2024-05-08T18:09:27.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.976484+0000", 2024-05-08T18:09:27.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7577e-05 2024-05-08T18:09:27.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.976499+0000", 2024-05-08T18:09:27.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4158000000000001e-05 2024-05-08T18:09:27.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.976587+0000", 2024-05-08T18:09:27.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8477e-05 2024-05-08T18:09:27.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.976609+0000", 2024-05-08T18:09:27.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2402e-05 2024-05-08T18:09:27.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.988317+0000", 2024-05-08T18:09:27.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011707669 2024-05-08T18:09:27.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.988373+0000", 2024-05-08T18:09:27.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5995999999999997e-05 2024-05-08T18:09:27.712 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.712 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.712 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.712 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1221 3.20 e85/20 3:071d1257:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_5:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:27.712 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:27.712 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.105295804000001, 2024-05-08T18:09:27.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019872899999999999, 2024-05-08T18:09:27.712 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.712 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.712 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.712 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:27.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:27.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605944+0000", 2024-05-08T18:09:27.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.77e-06 2024-05-08T18:09:27.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612548+0000", 2024-05-08T18:09:27.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066036519999999998 2024-05-08T18:09:27.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612580+0000", 2024-05-08T18:09:27.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1945e-05 2024-05-08T18:09:27.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612593+0000", 2024-05-08T18:09:27.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3665999999999999e-05 2024-05-08T18:09:27.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612758+0000", 2024-05-08T18:09:27.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016427600000000001 2024-05-08T18:09:27.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612832+0000", 2024-05-08T18:09:27.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4493000000000007e-05 2024-05-08T18:09:27.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.625728+0000", 2024-05-08T18:09:27.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012895471 2024-05-08T18:09:27.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.625815+0000", 2024-05-08T18:09:27.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7627000000000007e-05 2024-05-08T18:09:27.716 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.716 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.716 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.716 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1227 3.6 3:6359f987:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:27.716 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:27.716 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.027122246000001, 2024-05-08T18:09:27.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022831489999999999, 2024-05-08T18:09:27.716 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.717 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.717 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.717 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:27.717 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:27.717 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.717 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1227 2024-05-08T18:09:27.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.717 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:27.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:27.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684119+0000", 2024-05-08T18:09:27.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.678e-06 2024-05-08T18:09:27.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687247+0000", 2024-05-08T18:09:27.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031279820000000001 2024-05-08T18:09:27.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687274+0000", 2024-05-08T18:09:27.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7174000000000001e-05 2024-05-08T18:09:27.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687289+0000", 2024-05-08T18:09:27.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5364999999999999e-05 2024-05-08T18:09:27.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687421+0000", 2024-05-08T18:09:27.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013197999999999999 2024-05-08T18:09:27.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687681+0000", 2024-05-08T18:09:27.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025951099999999998 2024-05-08T18:09:27.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:27.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687981+0000", 2024-05-08T18:09:27.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030021799999999999 2024-05-08T18:09:27.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:27.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706004+0000", 2024-05-08T18:09:27.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018023441000000001 2024-05-08T18:09:27.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706867+0000", 2024-05-08T18:09:27.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00086241200000000001 2024-05-08T18:09:27.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706901+0000", 2024-05-08T18:09:27.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4325000000000001e-05 2024-05-08T18:09:27.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706948+0000", 2024-05-08T18:09:27.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6403999999999998e-05 2024-05-08T18:09:27.722 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.722 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.722 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.722 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1239 3.1 3:823b0205:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:27.722 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.938256+0000", 2024-05-08T18:09:27.722 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.772981991999998, 2024-05-08T18:09:27.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017897086, 2024-05-08T18:09:27.722 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.723 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.723 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.723 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:27.723 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:27.723 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.723 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1239 2024-05-08T18:09:27.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.723 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.938256+0000", 2024-05-08T18:09:27.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.938256+0000", 2024-05-08T18:09:27.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.938260+0000", 2024-05-08T18:09:27.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2370000000000001e-06 2024-05-08T18:09:27.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.941545+0000", 2024-05-08T18:09:27.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032850150000000001 2024-05-08T18:09:27.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.941591+0000", 2024-05-08T18:09:27.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6097000000000003e-05 2024-05-08T18:09:27.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.941613+0000", 2024-05-08T18:09:27.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2719999999999999e-05 2024-05-08T18:09:27.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.941779+0000", 2024-05-08T18:09:27.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016610099999999999 2024-05-08T18:09:27.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.942103+0000", 2024-05-08T18:09:27.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000323438 2024-05-08T18:09:27.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:27.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.942321+0000", 2024-05-08T18:09:27.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021802799999999999 2024-05-08T18:09:27.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:27.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.951603+0000", 2024-05-08T18:09:27.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0092818880000000003 2024-05-08T18:09:27.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.955969+0000", 2024-05-08T18:09:27.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00436645 2024-05-08T18:09:27.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.956067+0000", 2024-05-08T18:09:27.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7275999999999995e-05 2024-05-08T18:09:27.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.956153+0000", 2024-05-08T18:09:27.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6835999999999993e-05 2024-05-08T18:09:27.728 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.728 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.728 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.728 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1246 3.6 3:6220dfe7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:27.728 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:27.728 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.350442765, 2024-05-08T18:09:27.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020211156000000001, 2024-05-08T18:09:27.728 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.728 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.729 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.729 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:27.729 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:27.729 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.729 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1246 2024-05-08T18:09:27.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.729 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:27.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:27.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360799+0000", 2024-05-08T18:09:27.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4939999999999999e-06 2024-05-08T18:09:27.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363474+0000", 2024-05-08T18:09:27.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026745190000000002 2024-05-08T18:09:27.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363511+0000", 2024-05-08T18:09:27.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7722000000000002e-05 2024-05-08T18:09:27.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363528+0000", 2024-05-08T18:09:27.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6600999999999999e-05 2024-05-08T18:09:27.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363637+0000", 2024-05-08T18:09:27.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108855 2024-05-08T18:09:27.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363792+0000", 2024-05-08T18:09:27.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000155561 2024-05-08T18:09:27.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:27.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363921+0000", 2024-05-08T18:09:27.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128501 2024-05-08T18:09:27.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:27.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.378377+0000", 2024-05-08T18:09:27.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014456577999999999 2024-05-08T18:09:27.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380848+0000", 2024-05-08T18:09:27.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024703329999999999 2024-05-08T18:09:27.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380940+0000", 2024-05-08T18:09:27.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2264999999999998e-05 2024-05-08T18:09:27.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.381007+0000", 2024-05-08T18:09:27.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6727e-05 2024-05-08T18:09:27.734 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.734 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.734 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.734 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1254 3.32 3:4e133ae2:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:27.734 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.471375+0000", 2024-05-08T18:09:27.734 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.239863179, 2024-05-08T18:09:27.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019094796000000001, 2024-05-08T18:09:27.734 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.734 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.735 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.735 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:27.735 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:27.735 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.735 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1254 2024-05-08T18:09:27.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.735 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.471375+0000", 2024-05-08T18:09:27.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.471375+0000", 2024-05-08T18:09:27.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.471378+0000", 2024-05-08T18:09:27.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4739999999999999e-06 2024-05-08T18:09:27.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.475068+0000", 2024-05-08T18:09:27.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036907260000000001 2024-05-08T18:09:27.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.475103+0000", 2024-05-08T18:09:27.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4962000000000002e-05 2024-05-08T18:09:27.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.475127+0000", 2024-05-08T18:09:27.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3669e-05 2024-05-08T18:09:27.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.475226+0000", 2024-05-08T18:09:27.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9529000000000002e-05 2024-05-08T18:09:27.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.475399+0000", 2024-05-08T18:09:27.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172397 2024-05-08T18:09:27.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:27.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.475564+0000", 2024-05-08T18:09:27.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016564499999999999 2024-05-08T18:09:27.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.489014+0000", 2024-05-08T18:09:27.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013449416 2024-05-08T18:09:27.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:27.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.490200+0000", 2024-05-08T18:09:27.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011856659999999999 2024-05-08T18:09:27.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.490351+0000", 2024-05-08T18:09:27.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015105300000000001 2024-05-08T18:09:27.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.490470+0000", 2024-05-08T18:09:27.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119259 2024-05-08T18:09:27.739 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.739 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.739 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.740 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1255 3.12 3:48af9d8c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:27.740 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:27.740 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.229424898000001, 2024-05-08T18:09:27.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025868088000000001, 2024-05-08T18:09:27.740 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.740 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.740 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.740 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:27.740 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:27.740 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.740 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1255 2024-05-08T18:09:27.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.740 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:27.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:27.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481816+0000", 2024-05-08T18:09:27.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6390000000000001e-06 2024-05-08T18:09:27.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484725+0000", 2024-05-08T18:09:27.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00290865 2024-05-08T18:09:27.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484750+0000", 2024-05-08T18:09:27.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5009999999999999e-05 2024-05-08T18:09:27.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484763+0000", 2024-05-08T18:09:27.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2976000000000001e-05 2024-05-08T18:09:27.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484848+0000", 2024-05-08T18:09:27.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5232e-05 2024-05-08T18:09:27.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.485026+0000", 2024-05-08T18:09:27.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000177706 2024-05-08T18:09:27.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:27.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.485186+0000", 2024-05-08T18:09:27.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016076900000000001 2024-05-08T18:09:27.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:27.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.491881+0000", 2024-05-08T18:09:27.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066950539999999998 2024-05-08T18:09:27.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507591+0000", 2024-05-08T18:09:27.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015709724000000001 2024-05-08T18:09:27.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507638+0000", 2024-05-08T18:09:27.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6684999999999998e-05 2024-05-08T18:09:27.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507681+0000", 2024-05-08T18:09:27.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3643000000000002e-05 2024-05-08T18:09:27.745 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.745 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.745 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.745 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1270 3.2b 3:d722d73a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:27.746 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.655453+0000", 2024-05-08T18:09:27.746 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.055785459999999, 2024-05-08T18:09:27.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01876301, 2024-05-08T18:09:27.746 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.746 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.746 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.746 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:27.746 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:27.746 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.746 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1270 2024-05-08T18:09:27.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.746 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.655453+0000", 2024-05-08T18:09:27.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.655453+0000", 2024-05-08T18:09:27.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.655456+0000", 2024-05-08T18:09:27.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1599999999999998e-06 2024-05-08T18:09:27.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.657362+0000", 2024-05-08T18:09:27.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019059140000000001 2024-05-08T18:09:27.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.657396+0000", 2024-05-08T18:09:27.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3776999999999999e-05 2024-05-08T18:09:27.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.657415+0000", 2024-05-08T18:09:27.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9687999999999999e-05 2024-05-08T18:09:27.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.657541+0000", 2024-05-08T18:09:27.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012539699999999999 2024-05-08T18:09:27.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.657791+0000", 2024-05-08T18:09:27.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025027200000000001 2024-05-08T18:09:27.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:27.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.658651+0000", 2024-05-08T18:09:27.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00086032999999999997 2024-05-08T18:09:27.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.672730+0000", 2024-05-08T18:09:27.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014078986999999999 2024-05-08T18:09:27.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:27.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.674075+0000", 2024-05-08T18:09:27.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013442459999999999 2024-05-08T18:09:27.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.674159+0000", 2024-05-08T18:09:27.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3943999999999995e-05 2024-05-08T18:09:27.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.674216+0000", 2024-05-08T18:09:27.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7294999999999999e-05 2024-05-08T18:09:27.751 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.751 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.751 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.751 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1395 3.17 3:eb9c68a5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:27.751 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:27.751 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.938796157000001, 2024-05-08T18:09:27.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026590425000000001, 2024-05-08T18:09:27.751 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.752 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.752 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.752 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:27.752 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:27.752 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.752 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1395 2024-05-08T18:09:27.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.752 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:27.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:27.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772445+0000", 2024-05-08T18:09:27.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0970000000000002e-06 2024-05-08T18:09:27.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775066+0000", 2024-05-08T18:09:27.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026205730000000002 2024-05-08T18:09:27.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775101+0000", 2024-05-08T18:09:27.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4876000000000003e-05 2024-05-08T18:09:27.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775116+0000", 2024-05-08T18:09:27.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5566999999999999e-05 2024-05-08T18:09:27.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775200+0000", 2024-05-08T18:09:27.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3808999999999997e-05 2024-05-08T18:09:27.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775307+0000", 2024-05-08T18:09:27.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000107366 2024-05-08T18:09:27.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:27.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775430+0000", 2024-05-08T18:09:27.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012280599999999999 2024-05-08T18:09:27.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:27.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.779395+0000", 2024-05-08T18:09:27.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003964357 2024-05-08T18:09:27.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.798911+0000", 2024-05-08T18:09:27.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019516386 2024-05-08T18:09:27.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.798982+0000", 2024-05-08T18:09:27.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0759000000000005e-05 2024-05-08T18:09:27.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.799033+0000", 2024-05-08T18:09:27.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0828999999999997e-05 2024-05-08T18:09:27.757 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.757 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.757 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.757 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1404 3.1b 3:d97dd5be:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:27.757 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:27.757 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.837965970999999, 2024-05-08T18:09:27.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020100535999999999, 2024-05-08T18:09:27.757 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.757 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.757 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.757 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:27.757 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:27.758 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.758 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1404 2024-05-08T18:09:27.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.758 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:27.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:27.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873276+0000", 2024-05-08T18:09:27.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.45e-06 2024-05-08T18:09:27.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875542+0000", 2024-05-08T18:09:27.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002266746 2024-05-08T18:09:27.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875570+0000", 2024-05-08T18:09:27.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7826000000000001e-05 2024-05-08T18:09:27.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875585+0000", 2024-05-08T18:09:27.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4681999999999999e-05 2024-05-08T18:09:27.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875667+0000", 2024-05-08T18:09:27.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2429000000000006e-05 2024-05-08T18:09:27.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875833+0000", 2024-05-08T18:09:27.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165959 2024-05-08T18:09:27.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:27.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875991+0000", 2024-05-08T18:09:27.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015766099999999999 2024-05-08T18:09:27.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:27.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.884154+0000", 2024-05-08T18:09:27.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081625329999999996 2024-05-08T18:09:27.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.892970+0000", 2024-05-08T18:09:27.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0088168540000000007 2024-05-08T18:09:27.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.893166+0000", 2024-05-08T18:09:27.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019573 2024-05-08T18:09:27.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.893373+0000", 2024-05-08T18:09:27.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020666599999999999 2024-05-08T18:09:27.762 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.762 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.762 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.763 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1410 3.30 e87/20 3:0e0f1cce:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_16:head v 87'5, mlcod=86'3)", 2024-05-08T18:09:27.763 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.944309+0000", 2024-05-08T18:09:27.763 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.766929130999999, 2024-05-08T18:09:27.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019500263, 2024-05-08T18:09:27.763 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.763 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.763 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.763 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.944309+0000", 2024-05-08T18:09:27.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.944309+0000", 2024-05-08T18:09:27.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.944312+0000", 2024-05-08T18:09:27.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.36e-06 2024-05-08T18:09:27.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.949766+0000", 2024-05-08T18:09:27.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005453042 2024-05-08T18:09:27.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.949791+0000", 2024-05-08T18:09:27.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5114999999999999e-05 2024-05-08T18:09:27.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.949805+0000", 2024-05-08T18:09:27.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4511e-05 2024-05-08T18:09:27.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.949884+0000", 2024-05-08T18:09:27.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8571000000000004e-05 2024-05-08T18:09:27.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.949910+0000", 2024-05-08T18:09:27.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6239999999999999e-05 2024-05-08T18:09:27.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.963680+0000", 2024-05-08T18:09:27.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01377025 2024-05-08T18:09:27.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.963809+0000", 2024-05-08T18:09:27.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012917399999999999 2024-05-08T18:09:27.766 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.766 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.766 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.767 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1415 3.1f 3:faab37b1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:27.767 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.990268+0000", 2024-05-08T18:09:27.767 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.720969802999999, 2024-05-08T18:09:27.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017774788999999999, 2024-05-08T18:09:27.767 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.767 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.767 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.767 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:27.767 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:27.767 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.767 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1415 2024-05-08T18:09:27.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.767 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.990268+0000", 2024-05-08T18:09:27.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.990268+0000", 2024-05-08T18:09:27.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.990271+0000", 2024-05-08T18:09:27.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8289999999999999e-06 2024-05-08T18:09:27.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.992034+0000", 2024-05-08T18:09:27.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0017623929999999999 2024-05-08T18:09:27.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.992054+0000", 2024-05-08T18:09:27.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0219000000000001e-05 2024-05-08T18:09:27.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.992063+0000", 2024-05-08T18:09:27.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.003e-06 2024-05-08T18:09:27.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.992130+0000", 2024-05-08T18:09:27.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7119000000000006e-05 2024-05-08T18:09:27.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.992283+0000", 2024-05-08T18:09:27.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015300700000000001 2024-05-08T18:09:27.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:27.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.992389+0000", 2024-05-08T18:09:27.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010610100000000001 2024-05-08T18:09:27.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:27.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.000568+0000", 2024-05-08T18:09:27.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081793219999999993 2024-05-08T18:09:27.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.007966+0000", 2024-05-08T18:09:27.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073976729999999996 2024-05-08T18:09:27.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.008009+0000", 2024-05-08T18:09:27.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2645000000000003e-05 2024-05-08T18:09:27.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.008043+0000", 2024-05-08T18:09:27.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4477999999999998e-05 2024-05-08T18:09:27.772 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.772 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.772 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.773 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1426 3.3 e87/20 3:c1fceb03:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_4:head v 87'7, mlcod=86'5)", 2024-05-08T18:09:27.773 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:27.773 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.283779868, 2024-05-08T18:09:27.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020804152999999999, 2024-05-08T18:09:27.773 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.773 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.773 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.773 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:27.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:27.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427461+0000", 2024-05-08T18:09:27.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.57e-06 2024-05-08T18:09:27.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433712+0000", 2024-05-08T18:09:27.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062511729999999996 2024-05-08T18:09:27.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433759+0000", 2024-05-08T18:09:27.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6397000000000003e-05 2024-05-08T18:09:27.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433779+0000", 2024-05-08T18:09:27.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0196000000000001e-05 2024-05-08T18:09:27.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433922+0000", 2024-05-08T18:09:27.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014305599999999999 2024-05-08T18:09:27.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433970+0000", 2024-05-08T18:09:27.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7933000000000003e-05 2024-05-08T18:09:27.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.448060+0000", 2024-05-08T18:09:27.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01409064 2024-05-08T18:09:27.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.448263+0000", 2024-05-08T18:09:27.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020218800000000001 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1452 3.18 e87/20 3:1a3be52d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_2:head v 87'4, mlcod=86'2)", 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.383232737, 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020634468, 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:27.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:27.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328008+0000", 2024-05-08T18:09:27.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2589999999999999e-06 2024-05-08T18:09:27.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330832+0000", 2024-05-08T18:09:27.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028243719999999999 2024-05-08T18:09:27.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330867+0000", 2024-05-08T18:09:27.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4776e-05 2024-05-08T18:09:27.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330883+0000", 2024-05-08T18:09:27.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6121999999999999e-05 2024-05-08T18:09:27.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.331031+0000", 2024-05-08T18:09:27.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148412 2024-05-08T18:09:27.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.331075+0000", 2024-05-08T18:09:27.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3126e-05 2024-05-08T18:09:27.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.348521+0000", 2024-05-08T18:09:27.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017446351999999998 2024-05-08T18:09:27.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.348640+0000", 2024-05-08T18:09:27.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119049 2024-05-08T18:09:27.781 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.781 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.781 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.781 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1461 3.32 3:4ca91a7f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:27.781 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.523055+0000", 2024-05-08T18:09:27.781 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.188183137999999, 2024-05-08T18:09:27.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019351531000000002, 2024-05-08T18:09:27.781 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.781 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.781 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.782 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:27.782 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:27.782 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.782 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1461 2024-05-08T18:09:27.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.782 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.523055+0000", 2024-05-08T18:09:27.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.523055+0000", 2024-05-08T18:09:27.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.523059+0000", 2024-05-08T18:09:27.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1679999999999997e-06 2024-05-08T18:09:27.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.527171+0000", 2024-05-08T18:09:27.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041119930000000004 2024-05-08T18:09:27.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.527219+0000", 2024-05-08T18:09:27.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7682000000000002e-05 2024-05-08T18:09:27.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.527240+0000", 2024-05-08T18:09:27.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1013999999999999e-05 2024-05-08T18:09:27.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.527409+0000", 2024-05-08T18:09:27.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016853699999999999 2024-05-08T18:09:27.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.527737+0000", 2024-05-08T18:09:27.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032809799999999997 2024-05-08T18:09:27.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:27.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.528015+0000", 2024-05-08T18:09:27.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027825099999999998 2024-05-08T18:09:27.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:27.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.538178+0000", 2024-05-08T18:09:27.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010163434000000001 2024-05-08T18:09:27.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.542251+0000", 2024-05-08T18:09:27.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040725659999999997 2024-05-08T18:09:27.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.542335+0000", 2024-05-08T18:09:27.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4225000000000001e-05 2024-05-08T18:09:27.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.542407+0000", 2024-05-08T18:09:27.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1563000000000006e-05 2024-05-08T18:09:27.786 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.787 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.787 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.787 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1463 3.17 3:ebd3133d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:27.787 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:27.787 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.137742318000001, 2024-05-08T18:09:27.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023934057000000002, 2024-05-08T18:09:27.787 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.787 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.787 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.787 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:27.787 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:27.787 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.788 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1463 2024-05-08T18:09:27.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.788 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:27.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:27.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573500+0000", 2024-05-08T18:09:27.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7670000000000001e-06 2024-05-08T18:09:27.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575722+0000", 2024-05-08T18:09:27.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022226559999999999 2024-05-08T18:09:27.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575781+0000", 2024-05-08T18:09:27.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8746999999999998e-05 2024-05-08T18:09:27.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575810+0000", 2024-05-08T18:09:27.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8407000000000001e-05 2024-05-08T18:09:27.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575981+0000", 2024-05-08T18:09:27.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017151499999999999 2024-05-08T18:09:27.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.576369+0000", 2024-05-08T18:09:27.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038807000000000002 2024-05-08T18:09:27.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:27.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.576675+0000", 2024-05-08T18:09:27.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030572800000000001 2024-05-08T18:09:27.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:27.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.585475+0000", 2024-05-08T18:09:27.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087997630000000004 2024-05-08T18:09:27.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597202+0000", 2024-05-08T18:09:27.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011727849 2024-05-08T18:09:27.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597316+0000", 2024-05-08T18:09:27.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113546 2024-05-08T18:09:27.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597430+0000", 2024-05-08T18:09:27.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114009 2024-05-08T18:09:27.792 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.792 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.792 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.792 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1913 3.17 3:ea65dc81:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.vOI1jtaftCZSAcjtRhSYPcY8omHGfbO_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:27.793 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:27.793 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.6191378400000001, 2024-05-08T18:09:27.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020076618000000001, 2024-05-08T18:09:27.793 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.793 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.793 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:27.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:27.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.793 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1913 2024-05-08T18:09:27.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.793 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:27.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:27.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092104+0000", 2024-05-08T18:09:27.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2279999999999998e-06 2024-05-08T18:09:27.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094163+0000", 2024-05-08T18:09:27.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020592710000000001 2024-05-08T18:09:27.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094206+0000", 2024-05-08T18:09:27.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3072999999999999e-05 2024-05-08T18:09:27.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094231+0000", 2024-05-08T18:09:27.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4819000000000001e-05 2024-05-08T18:09:27.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094325+0000", 2024-05-08T18:09:27.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4029000000000004e-05 2024-05-08T18:09:27.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094439+0000", 2024-05-08T18:09:27.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113878 2024-05-08T18:09:27.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:27.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094533+0000", 2024-05-08T18:09:27.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4733000000000003e-05 2024-05-08T18:09:27.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:27.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.099901+0000", 2024-05-08T18:09:27.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053678789999999999 2024-05-08T18:09:27.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.111944+0000", 2024-05-08T18:09:27.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012042855999999999 2024-05-08T18:09:27.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.112051+0000", 2024-05-08T18:09:27.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010673100000000001 2024-05-08T18:09:27.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.112177+0000", 2024-05-08T18:09:27.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012612100000000001 2024-05-08T18:09:27.798 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.798 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.798 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.798 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1928 3.23 3:c76f4655:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.24:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:27.799 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:27.799 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.3032988140000001, 2024-05-08T18:09:27.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026452139, 2024-05-08T18:09:27.799 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.799 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.799 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.799 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:27.799 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:27.799 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.799 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1928 2024-05-08T18:09:27.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.799 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:27.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:27.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407943+0000", 2024-05-08T18:09:27.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4170000000000001e-06 2024-05-08T18:09:27.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412466+0000", 2024-05-08T18:09:27.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045230720000000004 2024-05-08T18:09:27.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412503+0000", 2024-05-08T18:09:27.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7287999999999999e-05 2024-05-08T18:09:27.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412520+0000", 2024-05-08T18:09:27.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7206000000000001e-05 2024-05-08T18:09:27.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412719+0000", 2024-05-08T18:09:27.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000198975 2024-05-08T18:09:27.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412989+0000", 2024-05-08T18:09:27.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000269256 2024-05-08T18:09:27.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:27.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.413870+0000", 2024-05-08T18:09:27.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00088159999999999996 2024-05-08T18:09:27.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.433846+0000", 2024-05-08T18:09:27.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019975822000000001 2024-05-08T18:09:27.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:27.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434198+0000", 2024-05-08T18:09:27.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035164000000000001 2024-05-08T18:09:27.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434318+0000", 2024-05-08T18:09:27.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120604 2024-05-08T18:09:27.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434392+0000", 2024-05-08T18:09:27.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3258999999999998e-05 2024-05-08T18:09:27.804 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.804 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.804 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.804 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1940 3.1f 3:fb7497ee:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.26:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:27.804 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.690326+0000", 2024-05-08T18:09:27.804 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.020911989, 2024-05-08T18:09:27.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018971935999999998, 2024-05-08T18:09:27.804 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.804 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.804 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.804 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:27.804 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:27.805 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.805 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1940 2024-05-08T18:09:27.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.805 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.690326+0000", 2024-05-08T18:09:27.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.690326+0000", 2024-05-08T18:09:27.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.690329+0000", 2024-05-08T18:09:27.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2260000000000001e-06 2024-05-08T18:09:27.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.692635+0000", 2024-05-08T18:09:27.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023053990000000001 2024-05-08T18:09:27.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.692674+0000", 2024-05-08T18:09:27.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9162999999999998e-05 2024-05-08T18:09:27.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.692693+0000", 2024-05-08T18:09:27.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8510000000000001e-05 2024-05-08T18:09:27.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.692871+0000", 2024-05-08T18:09:27.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017809299999999999 2024-05-08T18:09:27.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.693172+0000", 2024-05-08T18:09:27.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030159499999999999 2024-05-08T18:09:27.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:27.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.694059+0000", 2024-05-08T18:09:27.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00088701100000000005 2024-05-08T18:09:27.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:27.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.703784+0000", 2024-05-08T18:09:27.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0097242969999999998 2024-05-08T18:09:27.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.709098+0000", 2024-05-08T18:09:27.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053147589999999996 2024-05-08T18:09:27.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.709220+0000", 2024-05-08T18:09:27.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000122027 2024-05-08T18:09:27.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.709298+0000", 2024-05-08T18:09:27.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7855999999999995e-05 2024-05-08T18:09:27.809 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.809 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.809 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.810 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1945 3.2b 3:d4556bc7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.vh7S0QfOsPQyJLx7ey_lJISzPG1L1dO_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:27.810 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.799667+0000", 2024-05-08T18:09:27.810 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.91157117099999996, 2024-05-08T18:09:27.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018816870999999999, 2024-05-08T18:09:27.810 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:27.810 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:27.810 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:27.810 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:27.810 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:27.810 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:27.810 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1945 2024-05-08T18:09:27.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.810 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:27.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:27.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.799667+0000", 2024-05-08T18:09:27.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:27.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.799667+0000", 2024-05-08T18:09:27.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:27.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:27.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.799671+0000", 2024-05-08T18:09:27.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5130000000000001e-06 2024-05-08T18:09:27.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:27.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.801514+0000", 2024-05-08T18:09:27.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018436500000000001 2024-05-08T18:09:27.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:27.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.801558+0000", 2024-05-08T18:09:27.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3676e-05 2024-05-08T18:09:27.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:27.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.801578+0000", 2024-05-08T18:09:27.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.016e-05 2024-05-08T18:09:27.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:27.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.801709+0000", 2024-05-08T18:09:27.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013113099999999999 2024-05-08T18:09:27.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:27.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.801946+0000", 2024-05-08T18:09:27.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023671900000000001 2024-05-08T18:09:27.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:27.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.802168+0000", 2024-05-08T18:09:27.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022221 2024-05-08T18:09:27.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:27.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.812200+0000", 2024-05-08T18:09:27.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010032011 2024-05-08T18:09:27.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:27.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.818162+0000", 2024-05-08T18:09:27.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059620710000000002 2024-05-08T18:09:27.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:27.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.818352+0000", 2024-05-08T18:09:27.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000190263 2024-05-08T18:09:27.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:27.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:27.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:27.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.818484+0000", 2024-05-08T18:09:27.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013146699999999999 2024-05-08T18:09:27.815 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.815 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.815 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.815 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:27.815 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:27.815 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:27.817 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:09:27.817 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.34 2024-05-08T18:09:27.817 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:27.818 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 35 2024-05-08T18:09:27.818 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:27.818 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:27.818 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00915648 s, 1.1 GB/s 2024-05-08T18:09:27.818 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:27.816+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:27.846 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:27.846 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:27.864 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:27.865 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:27.877 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.35 2024-05-08T18:09:27.877 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:27.877 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 36 2024-05-08T18:09:27.883 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:27.883 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:27.887 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:27.887 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:27.888 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.009219 s, 1.1 GB/s 2024-05-08T18:09:27.901 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:27.901 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:27.918 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:27.917+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:27.928 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:27.928 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:27.949 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:27.950 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:27.972 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:27.972 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:27.995 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:27.995 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:28.003 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.36 2024-05-08T18:09:28.003 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:28.004 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 37 2024-05-08T18:09:28.008 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:28.008 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:28.014 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:09:28.015 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:28.015 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:28.015 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00951291 s, 1.1 GB/s 2024-05-08T18:09:28.019 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:28.017+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:28.111 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.37 2024-05-08T18:09:28.111 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:28.112 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 38 2024-05-08T18:09:28.119 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:28.120+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:28.124 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:28.124 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:28.124 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105003 s, 999 MB/s 2024-05-08T18:09:28.138 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:28.138 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:28.153 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:09:28.237 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.38 2024-05-08T18:09:28.237 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:28.237 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 39 2024-05-08T18:09:28.237 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:28.240+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:28.248 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:28.248 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:28.248 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0094411 s, 1.1 GB/s 2024-05-08T18:09:28.320 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:28.320+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:28.325 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:28.325 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:28.339 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:09:28.358 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.39 2024-05-08T18:09:28.358 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:28.358 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 40 2024-05-08T18:09:28.368 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:28.368 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:28.368 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00928271 s, 1.1 GB/s 2024-05-08T18:09:28.422 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:28.424+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:28.476 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.40 2024-05-08T18:09:28.477 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:28.477 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 41 2024-05-08T18:09:28.478 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:28.478 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:28.490 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:28.490 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:28.490 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011207 s, 936 MB/s 2024-05-08T18:09:28.495 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:09:28.523 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:28.521+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:28.608 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.41 2024-05-08T18:09:28.608 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:28.608 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 42 2024-05-08T18:09:28.622 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:28.622 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:28.622 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113558 s, 923 MB/s 2024-05-08T18:09:28.623 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:28.621+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:28.664 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:28.664 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:28.681 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:09:28.728 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.42 2024-05-08T18:09:28.728 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:28.728 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 43 2024-05-08T18:09:28.729 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:28.728+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:28.739 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:28.739 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:28.739 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00918702 s, 1.1 GB/s 2024-05-08T18:09:28.804 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:28.804 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:28.822 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:09:28.824 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:28.825+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:28.862 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:09:28.865 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.43 2024-05-08T18:09:28.865 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:28.865 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 44 2024-05-08T18:09:28.880 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:28.880 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:28.881 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124602 s, 842 MB/s 2024-05-08T18:09:28.926 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:28.928+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:28.991 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.44 2024-05-08T18:09:28.992 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:28.992 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 45 2024-05-08T18:09:29.002 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:29.002 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:29.003 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:29.003 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:29.003 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0102348 s, 1.0 GB/s 2024-05-08T18:09:29.017 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:09:29.062 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:29.064+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:29.108 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.45 2024-05-08T18:09:29.109 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:29.109 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 46 2024-05-08T18:09:29.119 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:29.119 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:29.119 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00913012 s, 1.1 GB/s 2024-05-08T18:09:29.127 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:29.125+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:29.209 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:29.210 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:29.227 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:09:29.228 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:29.228+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:29.230 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.46 2024-05-08T18:09:29.231 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:29.231 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 47 2024-05-08T18:09:29.242 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:29.242 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:29.242 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0102845 s, 1.0 GB/s 2024-05-08T18:09:29.328 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:29.329+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:29.347 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.47 2024-05-08T18:09:29.347 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:29.348 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 48 2024-05-08T18:09:29.358 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:29.358 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:29.358 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00915671 s, 1.1 GB/s 2024-05-08T18:09:29.363 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:29.363 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:29.381 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:09:29.428 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:29.428+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:29.490 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.48 2024-05-08T18:09:29.490 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:29.490 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 49 2024-05-08T18:09:29.505 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:29.505 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:29.505 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122069 s, 859 MB/s 2024-05-08T18:09:29.516 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:29.516 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:29.529 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:29.532+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:29.530 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:09:29.628 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.49 2024-05-08T18:09:29.628 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:29.628 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 50 2024-05-08T18:09:29.630 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:29.629+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:29.642 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:29.642 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:29.643 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0121478 s, 863 MB/s 2024-05-08T18:09:29.660 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:29.660 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:29.674 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:09:29.731 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:29.732+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:29.759 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.50 2024-05-08T18:09:29.759 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:29.759 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 51 2024-05-08T18:09:29.774 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:29.774 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:29.774 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119416 s, 878 MB/s 2024-05-08T18:09:29.832 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:29.833+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:29.842 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:29.843 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:29.858 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:09:29.863 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-05-08T18:09:29.903 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.51 2024-05-08T18:09:29.903 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:29.903 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 52 2024-05-08T18:09:29.914 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:29.914 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:29.914 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00937628 s, 1.1 GB/s 2024-05-08T18:09:29.944 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:29.945+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:30.018 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.52 2024-05-08T18:09:30.018 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:30.018 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 53 2024-05-08T18:09:30.029 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:09:30.029 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:30.029 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:30.033 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:30.033 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:30.033 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119782 s, 875 MB/s 2024-05-08T18:09:30.033 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:30.036+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:30.043 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:09:30.133 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.53 2024-05-08T18:09:30.133 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:30.133 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 54 2024-05-08T18:09:30.134 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:30.136+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:30.145 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:30.145 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:30.145 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105081 s, 998 MB/s 2024-05-08T18:09:30.184 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:30.184 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:30.207 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:30.207 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:30.219 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:30.219 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:30.225 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:30.225 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:30.234 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:09:30.235 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:30.236+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:30.244 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:30.244 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:30.245 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.54 2024-05-08T18:09:30.245 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:30.245 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 55 2024-05-08T18:09:30.256 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:30.256 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:30.256 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00965718 s, 1.1 GB/s 2024-05-08T18:09:30.265 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:30.265 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:30.282 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:30.283 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:30.305 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:30.305 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:30.327 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:30.327 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:30.337 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:30.337+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:30.348 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.55 2024-05-08T18:09:30.349 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:30.349 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 56 2024-05-08T18:09:30.360 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:30.360 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:30.360 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00974154 s, 1.1 GB/s 2024-05-08T18:09:30.367 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:30.367 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:30.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:30.367 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:30.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.367 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1191 3.1d 3:b81eb771:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:30.367 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:30.368 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.385932371999999, 2024-05-08T18:09:30.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.029646883999999998, 2024-05-08T18:09:30.368 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.368 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.368 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.368 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.368 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.368 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.368 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1191 2024-05-08T18:09:30.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.368 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:30.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:30.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981334+0000", 2024-05-08T18:09:30.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1540000000000004e-06 2024-05-08T18:09:30.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988180+0000", 2024-05-08T18:09:30.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068463619999999999 2024-05-08T18:09:30.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988216+0000", 2024-05-08T18:09:30.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6293e-05 2024-05-08T18:09:30.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988236+0000", 2024-05-08T18:09:30.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9403e-05 2024-05-08T18:09:30.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988410+0000", 2024-05-08T18:09:30.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017415400000000001 2024-05-08T18:09:30.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988803+0000", 2024-05-08T18:09:30.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000393271 2024-05-08T18:09:30.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:30.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989175+0000", 2024-05-08T18:09:30.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037178899999999997 2024-05-08T18:09:30.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.006397+0000", 2024-05-08T18:09:30.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017221744000000001 2024-05-08T18:09:30.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010666+0000", 2024-05-08T18:09:30.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042692880000000004 2024-05-08T18:09:30.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010836+0000", 2024-05-08T18:09:30.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000169498 2024-05-08T18:09:30.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010976+0000", 2024-05-08T18:09:30.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014092799999999999 2024-05-08T18:09:30.373 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.373 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.373 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.373 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1194 3.16 3:6b2325a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:30.373 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:30.373 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.351786453999999, 2024-05-08T18:09:30.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030556241000000001, 2024-05-08T18:09:30.373 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.373 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.373 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.374 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.374 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.374 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.374 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1194 2024-05-08T18:09:30.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.374 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:30.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:30.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015492+0000", 2024-05-08T18:09:30.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6863000000000001e-05 2024-05-08T18:09:30.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019937+0000", 2024-05-08T18:09:30.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044450399999999999 2024-05-08T18:09:30.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019975+0000", 2024-05-08T18:09:30.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7676000000000003e-05 2024-05-08T18:09:30.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019995+0000", 2024-05-08T18:09:30.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.969e-05 2024-05-08T18:09:30.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020165+0000", 2024-05-08T18:09:30.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017003400000000001 2024-05-08T18:09:30.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020437+0000", 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027198599999999999 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020668+0000", 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023154 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.032879+0000", 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012210883000000001 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045595+0000", 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012716005000000001 2024-05-08T18:09:30.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045811+0000", 2024-05-08T18:09:30.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021556400000000001 2024-05-08T18:09:30.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.046032+0000", 2024-05-08T18:09:30.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022096 2024-05-08T18:09:30.378 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.378 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.378 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.378 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1195 3.28 3:155acd84:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:30.379 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:30.379 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.341639133000001, 2024-05-08T18:09:30.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020411840000000001, 2024-05-08T18:09:30.379 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.379 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.379 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.379 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.379 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.379 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.379 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1195 2024-05-08T18:09:30.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.379 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:30.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025623+0000", 2024-05-08T18:09:30.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.025626+0000", 2024-05-08T18:09:30.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4699999999999998e-06 2024-05-08T18:09:30.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030167+0000", 2024-05-08T18:09:30.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045406709999999996 2024-05-08T18:09:30.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030204+0000", 2024-05-08T18:09:30.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6736000000000002e-05 2024-05-08T18:09:30.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030222+0000", 2024-05-08T18:09:30.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.823e-05 2024-05-08T18:09:30.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030337+0000", 2024-05-08T18:09:30.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114695 2024-05-08T18:09:30.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030565+0000", 2024-05-08T18:09:30.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000228173 2024-05-08T18:09:30.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:30.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.030770+0000", 2024-05-08T18:09:30.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020505400000000001 2024-05-08T18:09:30.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044362+0000", 2024-05-08T18:09:30.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013591814000000001 2024-05-08T18:09:30.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045754+0000", 2024-05-08T18:09:30.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013923710000000001 2024-05-08T18:09:30.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045903+0000", 2024-05-08T18:09:30.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014878800000000001 2024-05-08T18:09:30.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.046035+0000", 2024-05-08T18:09:30.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013183800000000001 2024-05-08T18:09:30.384 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.384 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.384 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.384 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1209 3.35 e85/20 3:af4c6abe:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_21:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:30.385 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:30.385 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.186810844, 2024-05-08T18:09:30.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021767585999999998, 2024-05-08T18:09:30.385 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.385 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.385 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.385 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:30.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180451+0000", 2024-05-08T18:09:30.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180452+0000", 2024-05-08T18:09:30.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4000000000000002e-07 2024-05-08T18:09:30.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183165+0000", 2024-05-08T18:09:30.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027135269999999999 2024-05-08T18:09:30.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183208+0000", 2024-05-08T18:09:30.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2599000000000003e-05 2024-05-08T18:09:30.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183239+0000", 2024-05-08T18:09:30.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999997e-05 2024-05-08T18:09:30.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183369+0000", 2024-05-08T18:09:30.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000130338 2024-05-08T18:09:30.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.183407+0000", 2024-05-08T18:09:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8213000000000002e-05 2024-05-08T18:09:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202127+0000", 2024-05-08T18:09:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018719906000000001 2024-05-08T18:09:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202219+0000", 2024-05-08T18:09:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1533000000000006e-05 2024-05-08T18:09:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.389 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1218 3.c 3:33b8068a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:30.389 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:30.389 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.804982951, 2024-05-08T18:09:30.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024735007, 2024-05-08T18:09:30.389 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.389 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.389 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.389 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.389 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.389 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.389 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1218 2024-05-08T18:09:30.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.389 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:30.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:30.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562282+0000", 2024-05-08T18:09:30.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7769999999999998e-06 2024-05-08T18:09:30.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568816+0000", 2024-05-08T18:09:30.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065338169999999999 2024-05-08T18:09:30.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568851+0000", 2024-05-08T18:09:30.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5892999999999997e-05 2024-05-08T18:09:30.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568871+0000", 2024-05-08T18:09:30.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9306000000000001e-05 2024-05-08T18:09:30.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568992+0000", 2024-05-08T18:09:30.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120925 2024-05-08T18:09:30.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.569258+0000", 2024-05-08T18:09:30.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026655299999999999 2024-05-08T18:09:30.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:30.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.569522+0000", 2024-05-08T18:09:30.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026331999999999999 2024-05-08T18:09:30.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584269+0000", 2024-05-08T18:09:30.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014747454 2024-05-08T18:09:30.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.586687+0000", 2024-05-08T18:09:30.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024181770000000001 2024-05-08T18:09:30.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.586888+0000", 2024-05-08T18:09:30.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000201137 2024-05-08T18:09:30.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.587014+0000", 2024-05-08T18:09:30.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012564799999999999 2024-05-08T18:09:30.394 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.394 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.394 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.395 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1220 3.c 3:319326d6:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:30.395 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:30.395 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.782295376, 2024-05-08T18:09:30.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022305417000000001, 2024-05-08T18:09:30.395 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.395 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.395 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.395 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.395 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.395 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.395 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1220 2024-05-08T18:09:30.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.396 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:30.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:30.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584971+0000", 2024-05-08T18:09:30.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0729999999999998e-06 2024-05-08T18:09:30.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591515+0000", 2024-05-08T18:09:30.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065448340000000002 2024-05-08T18:09:30.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591549+0000", 2024-05-08T18:09:30.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3633000000000001e-05 2024-05-08T18:09:30.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591574+0000", 2024-05-08T18:09:30.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4482999999999999e-05 2024-05-08T18:09:30.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591714+0000", 2024-05-08T18:09:30.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014048500000000001 2024-05-08T18:09:30.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591956+0000", 2024-05-08T18:09:30.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000241616 2024-05-08T18:09:30.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:30.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.592181+0000", 2024-05-08T18:09:30.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022565000000000001 2024-05-08T18:09:30.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.606237+0000", 2024-05-08T18:09:30.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014055646999999999 2024-05-08T18:09:30.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607095+0000", 2024-05-08T18:09:30.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085838199999999998 2024-05-08T18:09:30.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607189+0000", 2024-05-08T18:09:30.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3962000000000006e-05 2024-05-08T18:09:30.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607272+0000", 2024-05-08T18:09:30.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2651999999999994e-05 2024-05-08T18:09:30.400 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.400 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.400 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.401 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1242 3.28 3:16e2765f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.2:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:30.401 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:30.401 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.390649608, 2024-05-08T18:09:30.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020212443, 2024-05-08T18:09:30.401 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.401 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.401 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.401 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.401 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.401 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.401 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1242 2024-05-08T18:09:30.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.402 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:30.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976612+0000", 2024-05-08T18:09:30.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.976615+0000", 2024-05-08T18:09:30.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6170000000000001e-06 2024-05-08T18:09:30.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980655+0000", 2024-05-08T18:09:30.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040399240000000003 2024-05-08T18:09:30.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980693+0000", 2024-05-08T18:09:30.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7996e-05 2024-05-08T18:09:30.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980717+0000", 2024-05-08T18:09:30.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.459e-05 2024-05-08T18:09:30.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980811+0000", 2024-05-08T18:09:30.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3931000000000006e-05 2024-05-08T18:09:30.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.980965+0000", 2024-05-08T18:09:30.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015315500000000001 2024-05-08T18:09:30.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:30.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.981450+0000", 2024-05-08T18:09:30.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000485632 2024-05-08T18:09:30.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.991160+0000", 2024-05-08T18:09:30.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.009709858 2024-05-08T18:09:30.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996726+0000", 2024-05-08T18:09:30.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055655039999999998 2024-05-08T18:09:30.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996786+0000", 2024-05-08T18:09:30.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0511999999999999e-05 2024-05-08T18:09:30.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.996825+0000", 2024-05-08T18:09:30.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8723999999999997e-05 2024-05-08T18:09:30.406 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.406 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.406 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.407 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1395 3.17 e87/20 3:eb9c68a5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_1:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:30.407 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.771843+0000", 2024-05-08T18:09:30.407 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.595418731999999, 2024-05-08T18:09:30.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021322812, 2024-05-08T18:09:30.407 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.407 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.407 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.407 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.771843+0000", 2024-05-08T18:09:30.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.771843+0000", 2024-05-08T18:09:30.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.771844+0000", 2024-05-08T18:09:30.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0999999999999999e-07 2024-05-08T18:09:30.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.778254+0000", 2024-05-08T18:09:30.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064103859999999997 2024-05-08T18:09:30.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.778286+0000", 2024-05-08T18:09:30.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2113000000000002e-05 2024-05-08T18:09:30.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.778307+0000", 2024-05-08T18:09:30.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1158999999999999e-05 2024-05-08T18:09:30.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.779027+0000", 2024-05-08T18:09:30.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00071950400000000004 2024-05-08T18:09:30.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.779083+0000", 2024-05-08T18:09:30.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6512999999999999e-05 2024-05-08T18:09:30.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.793025+0000", 2024-05-08T18:09:30.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013941782999999999 2024-05-08T18:09:30.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.793166+0000", 2024-05-08T18:09:30.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140844 2024-05-08T18:09:30.411 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.411 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.411 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.411 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1400 3.1c 3:3bb95565:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:30.411 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:30.411 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.538512762, 2024-05-08T18:09:30.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02650396, 2024-05-08T18:09:30.411 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.411 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.411 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.411 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.411 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.411 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.412 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1400 2024-05-08T18:09:30.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.412 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:30.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:30.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828753+0000", 2024-05-08T18:09:30.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4400000000000001e-06 2024-05-08T18:09:30.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836255+0000", 2024-05-08T18:09:30.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0075026379999999998 2024-05-08T18:09:30.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836312+0000", 2024-05-08T18:09:30.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6459000000000003e-05 2024-05-08T18:09:30.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836340+0000", 2024-05-08T18:09:30.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8183000000000001e-05 2024-05-08T18:09:30.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836510+0000", 2024-05-08T18:09:30.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000169805 2024-05-08T18:09:30.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836763+0000", 2024-05-08T18:09:30.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025333700000000002 2024-05-08T18:09:30.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:30.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836995+0000", 2024-05-08T18:09:30.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023236700000000001 2024-05-08T18:09:30.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849771+0000", 2024-05-08T18:09:30.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012775760000000001 2024-05-08T18:09:30.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855089+0000", 2024-05-08T18:09:30.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0053173889999999996 2024-05-08T18:09:30.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855183+0000", 2024-05-08T18:09:30.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4276000000000003e-05 2024-05-08T18:09:30.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855253+0000", 2024-05-08T18:09:30.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0306000000000001e-05 2024-05-08T18:09:30.416 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.416 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.416 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.416 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1405 3.c 3:3166280d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:30.417 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:30.417 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.485946327000001, 2024-05-08T18:09:30.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023065800000000001, 2024-05-08T18:09:30.417 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.417 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.417 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.417 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.417 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.417 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.417 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1405 2024-05-08T18:09:30.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.417 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:30.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:30.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881320+0000", 2024-05-08T18:09:30.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-05-08T18:09:30.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887255+0000", 2024-05-08T18:09:30.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059351509999999996 2024-05-08T18:09:30.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887305+0000", 2024-05-08T18:09:30.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9579000000000001e-05 2024-05-08T18:09:30.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887332+0000", 2024-05-08T18:09:30.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7276000000000001e-05 2024-05-08T18:09:30.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887489+0000", 2024-05-08T18:09:30.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000156465 2024-05-08T18:09:30.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887745+0000", 2024-05-08T18:09:30.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025626700000000002 2024-05-08T18:09:30.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:30.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887980+0000", 2024-05-08T18:09:30.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000235107 2024-05-08T18:09:30.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.896366+0000", 2024-05-08T18:09:30.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083860870000000004 2024-05-08T18:09:30.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904214+0000", 2024-05-08T18:09:30.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078482840000000005 2024-05-08T18:09:30.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904312+0000", 2024-05-08T18:09:30.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7901999999999999e-05 2024-05-08T18:09:30.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904381+0000", 2024-05-08T18:09:30.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9258999999999995e-05 2024-05-08T18:09:30.422 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.422 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.422 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.422 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1410 3.30 3:0e0f1cce:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:30.422 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:30.423 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.432721351000001, 2024-05-08T18:09:30.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.026130820999999999, 2024-05-08T18:09:30.423 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.423 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.423 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.423 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.423 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.423 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.423 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1410 2024-05-08T18:09:30.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.423 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:30.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:30.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934544+0000", 2024-05-08T18:09:30.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2600000000000001e-06 2024-05-08T18:09:30.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939363+0000", 2024-05-08T18:09:30.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048190020000000002 2024-05-08T18:09:30.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939407+0000", 2024-05-08T18:09:30.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3999999999999999e-05 2024-05-08T18:09:30.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939428+0000", 2024-05-08T18:09:30.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0746000000000001e-05 2024-05-08T18:09:30.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939637+0000", 2024-05-08T18:09:30.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000209397 2024-05-08T18:09:30.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939894+0000", 2024-05-08T18:09:30.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025690700000000001 2024-05-08T18:09:30.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:30.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.940133+0000", 2024-05-08T18:09:30.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023939400000000001 2024-05-08T18:09:30.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.949842+0000", 2024-05-08T18:09:30.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0097087570000000002 2024-05-08T18:09:30.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960494+0000", 2024-05-08T18:09:30.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01065148 2024-05-08T18:09:30.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960597+0000", 2024-05-08T18:09:30.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103529 2024-05-08T18:09:30.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960671+0000", 2024-05-08T18:09:30.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4349000000000003e-05 2024-05-08T18:09:30.428 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.428 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.428 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.428 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1446 3.22 3:44011652:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:30.428 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:30.428 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 17.492339718, 2024-05-08T18:09:30.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024780153999999999, 2024-05-08T18:09:30.429 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.429 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.429 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.429 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.429 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.429 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.429 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1446 2024-05-08T18:09:30.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.429 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:30.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:30.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874926+0000", 2024-05-08T18:09:30.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2739999999999999e-06 2024-05-08T18:09:30.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879812+0000", 2024-05-08T18:09:30.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048860040000000002 2024-05-08T18:09:30.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879849+0000", 2024-05-08T18:09:30.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7919000000000001e-05 2024-05-08T18:09:30.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879868+0000", 2024-05-08T18:09:30.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8836999999999999e-05 2024-05-08T18:09:30.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880042+0000", 2024-05-08T18:09:30.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173981 2024-05-08T18:09:30.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880452+0000", 2024-05-08T18:09:30.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040949200000000002 2024-05-08T18:09:30.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:30.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880849+0000", 2024-05-08T18:09:30.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039710499999999997 2024-05-08T18:09:30.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.892821+0000", 2024-05-08T18:09:30.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011972287 2024-05-08T18:09:30.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899596+0000", 2024-05-08T18:09:30.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067744720000000001 2024-05-08T18:09:30.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899655+0000", 2024-05-08T18:09:30.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9119000000000001e-05 2024-05-08T18:09:30.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899702+0000", 2024-05-08T18:09:30.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7664000000000003e-05 2024-05-08T18:09:30.434 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.434 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.434 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.434 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1458 3.30 3:0e1bd441:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:30.434 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.449355+0000", 2024-05-08T18:09:30.434 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 16.917906599999998, 2024-05-08T18:09:30.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019757651000000001, 2024-05-08T18:09:30.435 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.435 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.435 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.435 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.435 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.435 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.435 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1458 2024-05-08T18:09:30.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.435 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.449355+0000", 2024-05-08T18:09:30.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.449355+0000", 2024-05-08T18:09:30.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.449359+0000", 2024-05-08T18:09:30.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2739999999999999e-06 2024-05-08T18:09:30.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.453851+0000", 2024-05-08T18:09:30.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004492495 2024-05-08T18:09:30.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.453897+0000", 2024-05-08T18:09:30.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6026999999999998e-05 2024-05-08T18:09:30.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.453917+0000", 2024-05-08T18:09:30.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0132999999999998e-05 2024-05-08T18:09:30.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.454019+0000", 2024-05-08T18:09:30.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101545 2024-05-08T18:09:30.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.454187+0000", 2024-05-08T18:09:30.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016848199999999999 2024-05-08T18:09:30.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:30.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.454341+0000", 2024-05-08T18:09:30.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015391999999999999 2024-05-08T18:09:30.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.463479+0000", 2024-05-08T18:09:30.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0091377230000000004 2024-05-08T18:09:30.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.469032+0000", 2024-05-08T18:09:30.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055529619999999998 2024-05-08T18:09:30.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.469075+0000", 2024-05-08T18:09:30.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3417999999999997e-05 2024-05-08T18:09:30.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.469113+0000", 2024-05-08T18:09:30.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7672000000000001e-05 2024-05-08T18:09:30.440 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.440 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.440 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.440 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1463 3.17 e87/20 3:ebd3133d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_13:head v 87'3, mlcod=85'1)", 2024-05-08T18:09:30.440 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.573059+0000", 2024-05-08T18:09:30.440 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 16.794202743, 2024-05-08T18:09:30.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019808240000000001, 2024-05-08T18:09:30.440 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.441 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.441 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.441 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.573059+0000", 2024-05-08T18:09:30.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.573059+0000", 2024-05-08T18:09:30.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.573062+0000", 2024-05-08T18:09:30.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3760000000000002e-06 2024-05-08T18:09:30.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579565+0000", 2024-05-08T18:09:30.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065034109999999997 2024-05-08T18:09:30.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579601+0000", 2024-05-08T18:09:30.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6329999999999999e-05 2024-05-08T18:09:30.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579619+0000", 2024-05-08T18:09:30.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7980000000000001e-05 2024-05-08T18:09:30.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579718+0000", 2024-05-08T18:09:30.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8887000000000004e-05 2024-05-08T18:09:30.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.579753+0000", 2024-05-08T18:09:30.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5006000000000003e-05 2024-05-08T18:09:30.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.592778+0000", 2024-05-08T18:09:30.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013024803999999999 2024-05-08T18:09:30.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.592867+0000", 2024-05-08T18:09:30.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9445999999999997e-05 2024-05-08T18:09:30.444 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.445 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.445 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.445 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1464 3.2f 3:f7dca4bf:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:30.445 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.583146+0000", 2024-05-08T18:09:30.445 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 16.784115483000001, 2024-05-08T18:09:30.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022519284000000001, 2024-05-08T18:09:30.445 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.445 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.445 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.445 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.445 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.445 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.446 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1464 2024-05-08T18:09:30.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.446 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.583146+0000", 2024-05-08T18:09:30.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.583146+0000", 2024-05-08T18:09:30.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.583149+0000", 2024-05-08T18:09:30.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5600000000000001e-06 2024-05-08T18:09:30.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.586965+0000", 2024-05-08T18:09:30.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003816131 2024-05-08T18:09:30.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.586991+0000", 2024-05-08T18:09:30.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5508e-05 2024-05-08T18:09:30.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587005+0000", 2024-05-08T18:09:30.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4029000000000001e-05 2024-05-08T18:09:30.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587087+0000", 2024-05-08T18:09:30.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2056000000000002e-05 2024-05-08T18:09:30.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587293+0000", 2024-05-08T18:09:30.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020639000000000001 2024-05-08T18:09:30.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:30.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587503+0000", 2024-05-08T18:09:30.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020987299999999999 2024-05-08T18:09:30.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.598739+0000", 2024-05-08T18:09:30.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011236237 2024-05-08T18:09:30.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.605521+0000", 2024-05-08T18:09:30.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067817049999999999 2024-05-08T18:09:30.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.605602+0000", 2024-05-08T18:09:30.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1225999999999998e-05 2024-05-08T18:09:30.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.605666+0000", 2024-05-08T18:09:30.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3569000000000001e-05 2024-05-08T18:09:30.450 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.450 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.451 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.451 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1898 3.22 3:462b78d0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.19:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:30.451 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:25.750111+0000", 2024-05-08T18:09:30.451 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.6171513920000002, 2024-05-08T18:09:30.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022823415, 2024-05-08T18:09:30.451 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.451 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.451 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.451 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.451 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.451 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.451 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1898 2024-05-08T18:09:30.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.452 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.750111+0000", 2024-05-08T18:09:30.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.750111+0000", 2024-05-08T18:09:30.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.750112+0000", 2024-05-08T18:09:30.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.781e-06 2024-05-08T18:09:30.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.753962+0000", 2024-05-08T18:09:30.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003849917 2024-05-08T18:09:30.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.753992+0000", 2024-05-08T18:09:30.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0219999999999999e-05 2024-05-08T18:09:30.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.754006+0000", 2024-05-08T18:09:30.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3212e-05 2024-05-08T18:09:30.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.754119+0000", 2024-05-08T18:09:30.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113304 2024-05-08T18:09:30.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.754420+0000", 2024-05-08T18:09:30.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030074300000000002 2024-05-08T18:09:30.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:30.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.755298+0000", 2024-05-08T18:09:30.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00087796700000000001 2024-05-08T18:09:30.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.769345+0000", 2024-05-08T18:09:30.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014047217000000001 2024-05-08T18:09:30.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.772660+0000", 2024-05-08T18:09:30.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033153969999999999 2024-05-08T18:09:30.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.772807+0000", 2024-05-08T18:09:30.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014637600000000001 2024-05-08T18:09:30.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.772934+0000", 2024-05-08T18:09:30.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127281 2024-05-08T18:09:30.456 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.456 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.456 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.456 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1948 3.22 3:46cc96d3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.27:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:30.457 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:26.823933+0000", 2024-05-08T18:09:30.457 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 3.5433294580000001, 2024-05-08T18:09:30.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020279233000000001, 2024-05-08T18:09:30.457 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.457 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.457 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.457 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.457 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.457 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.457 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1948 2024-05-08T18:09:30.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.457 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.823933+0000", 2024-05-08T18:09:30.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.823933+0000", 2024-05-08T18:09:30.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.823935+0000", 2024-05-08T18:09:30.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1720000000000001e-06 2024-05-08T18:09:30.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.827842+0000", 2024-05-08T18:09:30.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039075580000000002 2024-05-08T18:09:30.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.827868+0000", 2024-05-08T18:09:30.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.546e-05 2024-05-08T18:09:30.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.827879+0000", 2024-05-08T18:09:30.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1608e-05 2024-05-08T18:09:30.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.827964+0000", 2024-05-08T18:09:30.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.4384999999999999e-05 2024-05-08T18:09:30.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.828077+0000", 2024-05-08T18:09:30.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113016 2024-05-08T18:09:30.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:30.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.828428+0000", 2024-05-08T18:09:30.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00035162099999999999 2024-05-08T18:09:30.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.837630+0000", 2024-05-08T18:09:30.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092016349999999997 2024-05-08T18:09:30.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.844119+0000", 2024-05-08T18:09:30.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064886659999999997 2024-05-08T18:09:30.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.844178+0000", 2024-05-08T18:09:30.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9586000000000002e-05 2024-05-08T18:09:30.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.844212+0000", 2024-05-08T18:09:30.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3525999999999997e-05 2024-05-08T18:09:30.462 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.462 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.462 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.462 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1957 3.28 3:14c28b66:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.OKfjo1mWJEYeQqBUAVLHoyHtuJyb66D_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:30.462 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.065856+0000", 2024-05-08T18:09:30.463 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 3.3014064009999999, 2024-05-08T18:09:30.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020070422000000001, 2024-05-08T18:09:30.463 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.463 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.463 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.463 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.463 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.463 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.463 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1957 2024-05-08T18:09:30.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.463 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.065856+0000", 2024-05-08T18:09:30.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.065856+0000", 2024-05-08T18:09:30.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.065859+0000", 2024-05-08T18:09:30.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1099999999999999e-06 2024-05-08T18:09:30.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.070582+0000", 2024-05-08T18:09:30.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047236229999999997 2024-05-08T18:09:30.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.070622+0000", 2024-05-08T18:09:30.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9576000000000002e-05 2024-05-08T18:09:30.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.070648+0000", 2024-05-08T18:09:30.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.616e-05 2024-05-08T18:09:30.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.070757+0000", 2024-05-08T18:09:30.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109362 2024-05-08T18:09:30.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.070898+0000", 2024-05-08T18:09:30.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141087 2024-05-08T18:09:30.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:30.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.071016+0000", 2024-05-08T18:09:30.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117458 2024-05-08T18:09:30.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.078224+0000", 2024-05-08T18:09:30.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0072082520000000001 2024-05-08T18:09:30.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.085767+0000", 2024-05-08T18:09:30.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0075429590000000001 2024-05-08T18:09:30.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.085858+0000", 2024-05-08T18:09:30.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0976000000000004e-05 2024-05-08T18:09:30.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.085926+0000", 2024-05-08T18:09:30.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7859000000000002e-05 2024-05-08T18:09:30.468 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.468 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.468 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.468 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1969 3.28 3:15258d02:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.BXBsdMhvuUI98ehPeo4Z5Oq1UW9BGOc_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:30.468 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.345635+0000", 2024-05-08T18:09:30.468 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 3.0216265959999999, 2024-05-08T18:09:30.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023778058000000001, 2024-05-08T18:09:30.469 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.469 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.469 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.469 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.469 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.469 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.469 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1969 2024-05-08T18:09:30.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.469 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.345635+0000", 2024-05-08T18:09:30.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.345635+0000", 2024-05-08T18:09:30.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.345639+0000", 2024-05-08T18:09:30.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3900000000000002e-06 2024-05-08T18:09:30.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.350203+0000", 2024-05-08T18:09:30.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045640780000000001 2024-05-08T18:09:30.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.350241+0000", 2024-05-08T18:09:30.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8463000000000001e-05 2024-05-08T18:09:30.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.350260+0000", 2024-05-08T18:09:30.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8859e-05 2024-05-08T18:09:30.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.350434+0000", 2024-05-08T18:09:30.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017434500000000001 2024-05-08T18:09:30.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.350866+0000", 2024-05-08T18:09:30.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043187899999999998 2024-05-08T18:09:30.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:30.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.351296+0000", 2024-05-08T18:09:30.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042929900000000001 2024-05-08T18:09:30.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.367788+0000", 2024-05-08T18:09:30.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016492619 2024-05-08T18:09:30.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.369126+0000", 2024-05-08T18:09:30.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013372429999999999 2024-05-08T18:09:30.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.369301+0000", 2024-05-08T18:09:30.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000175818 2024-05-08T18:09:30.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.369413+0000", 2024-05-08T18:09:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011206500000000001 2024-05-08T18:09:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1984 3.21 e92/20 3:8684244f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.33:head v 92'6, mlcod=87'4)", 2024-05-08T18:09:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.630079+0000", 2024-05-08T18:09:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 2.7371829650000001, 2024-05-08T18:09:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023425675999999999, 2024-05-08T18:09:30.474 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.630079+0000", 2024-05-08T18:09:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.630079+0000", 2024-05-08T18:09:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.630080+0000", 2024-05-08T18:09:30.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:09:30.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.638640+0000", 2024-05-08T18:09:30.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0085603220000000004 2024-05-08T18:09:30.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.638677+0000", 2024-05-08T18:09:30.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6813000000000001e-05 2024-05-08T18:09:30.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.638694+0000", 2024-05-08T18:09:30.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7122999999999999e-05 2024-05-08T18:09:30.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.638830+0000", 2024-05-08T18:09:30.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013660500000000001 2024-05-08T18:09:30.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.638870+0000", 2024-05-08T18:09:30.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:09:30.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.653419+0000", 2024-05-08T18:09:30.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014548574 2024-05-08T18:09:30.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.653505+0000", 2024-05-08T18:09:30.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6026000000000006e-05 2024-05-08T18:09:30.478 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.478 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.478 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.478 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.478 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.479 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:30.479 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.56 2024-05-08T18:09:30.480 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:30.480 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 57 2024-05-08T18:09:30.480 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:30.480 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:30.480 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110639 s, 948 MB/s 2024-05-08T18:09:30.481 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:09:30.481 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:30.481+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:30.581 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:30.580+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:30.614 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.57 2024-05-08T18:09:30.614 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:30.614 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 58 2024-05-08T18:09:30.629 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:30.629 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:30.629 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119682 s, 876 MB/s 2024-05-08T18:09:30.657 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:30.657 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:30.671 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:09:30.682 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:30.684+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:30.764 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.58 2024-05-08T18:09:30.764 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:30.765 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 59 2024-05-08T18:09:30.780 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:30.780 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:30.780 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012884 s, 814 MB/s 2024-05-08T18:09:30.783 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:30.781+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:30.796 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:30.797 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:30.797 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:30.797 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:30.797 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:30.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:09:30.884 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:30.884+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:30.912 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.59 2024-05-08T18:09:30.912 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:30.912 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 60 2024-05-08T18:09:30.927 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:30.927 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:30.927 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122187 s, 858 MB/s 2024-05-08T18:09:30.978 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:30.978 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:30.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:30.978 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:30.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.978 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:09:30.979 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:30.979 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 127.441259196, 2024-05-08T18:09:30.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.032012946, 2024-05-08T18:09:30.979 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.979 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.979 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.979 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.979 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.979 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.979 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:09:30.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.979 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:30.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:30.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535484+0000", 2024-05-08T18:09:30.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7929999999999999e-06 2024-05-08T18:09:30.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535500+0000", 2024-05-08T18:09:30.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5226e-05 2024-05-08T18:09:30.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535535+0000", 2024-05-08T18:09:30.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5213000000000003e-05 2024-05-08T18:09:30.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535564+0000", 2024-05-08T18:09:30.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9360999999999999e-05 2024-05-08T18:09:30.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535757+0000", 2024-05-08T18:09:30.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000193229 2024-05-08T18:09:30.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:30.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535775+0000", 2024-05-08T18:09:30.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7098000000000001e-05 2024-05-08T18:09:30.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556004+0000", 2024-05-08T18:09:30.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020229068999999999 2024-05-08T18:09:30.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:30.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556036+0000", 2024-05-08T18:09:30.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1943000000000002e-05 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.564721+0000", 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086853320000000005 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565032+0000", 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031121799999999999 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565365+0000", 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000332744 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567305+0000", 2024-05-08T18:09:30.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00194016 2024-05-08T18:09:30.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567368+0000", 2024-05-08T18:09:30.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3342000000000004e-05 2024-05-08T18:09:30.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567433+0000", 2024-05-08T18:09:30.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4726000000000003e-05 2024-05-08T18:09:30.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567494+0000", 2024-05-08T18:09:30.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0492000000000003e-05 2024-05-08T18:09:30.985 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.985 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.985 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.985 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1189 3.20 3:054e8a9f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:30.985 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:30.985 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 24.016569789999998, 2024-05-08T18:09:30.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025093629999999999, 2024-05-08T18:09:30.985 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.985 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.985 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.986 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.986 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.986 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.986 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1189 2024-05-08T18:09:30.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.986 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:30.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:30.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960173+0000", 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.65e-06 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965720+0000", 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055476340000000001 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965757+0000", 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6223000000000002e-05 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965774+0000", 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6952999999999998e-05 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965930+0000", 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015611800000000001 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966190+0000", 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025999399999999999 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:30.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966440+0000", 2024-05-08T18:09:30.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025007600000000001 2024-05-08T18:09:30.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981042+0000", 2024-05-08T18:09:30.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01460257 2024-05-08T18:09:30.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.984969+0000", 2024-05-08T18:09:30.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039265159999999997 2024-05-08T18:09:30.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985135+0000", 2024-05-08T18:09:30.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016630400000000001 2024-05-08T18:09:30.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985264+0000", 2024-05-08T18:09:30.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012859199999999999 2024-05-08T18:09:30.990 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.990 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.990 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.990 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1209 3.35 3:af4c6abe:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:30.990 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:30.990 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.801308143, 2024-05-08T18:09:30.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027313356, 2024-05-08T18:09:30.990 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.991 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.991 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.991 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.991 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.991 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.991 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1209 2024-05-08T18:09:30.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.991 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:30.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:30.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175436+0000", 2024-05-08T18:09:30.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3800000000000004e-06 2024-05-08T18:09:30.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179472+0000", 2024-05-08T18:09:30.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040357020000000004 2024-05-08T18:09:30.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179515+0000", 2024-05-08T18:09:30.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2988999999999998e-05 2024-05-08T18:09:30.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179534+0000", 2024-05-08T18:09:30.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8743e-05 2024-05-08T18:09:30.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179673+0000", 2024-05-08T18:09:30.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013983800000000001 2024-05-08T18:09:30.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179933+0000", 2024-05-08T18:09:30.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025967999999999998 2024-05-08T18:09:30.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:30.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180161+0000", 2024-05-08T18:09:30.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022826300000000001 2024-05-08T18:09:30.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:30.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.200613+0000", 2024-05-08T18:09:30.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020451766999999999 2024-05-08T18:09:30.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:30.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202567+0000", 2024-05-08T18:09:30.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019541160000000001 2024-05-08T18:09:30.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:30.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202665+0000", 2024-05-08T18:09:30.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8055999999999998e-05 2024-05-08T18:09:30.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:30.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202745+0000", 2024-05-08T18:09:30.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9821999999999996e-05 2024-05-08T18:09:30.995 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.995 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:30.995 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:30.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.996 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1221 3.20 3:071d1257:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:30.996 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:30.996 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.381993267999999, 2024-05-08T18:09:30.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02822473, 2024-05-08T18:09:30.996 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:30.996 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:30.996 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:30.996 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:30.996 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:30.996 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:30.996 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1221 2024-05-08T18:09:30.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.996 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:30.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594751+0000", 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3769999999999998e-06 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:30.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600627+0000", 2024-05-08T18:09:30.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058764389999999998 2024-05-08T18:09:30.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:30.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600672+0000", 2024-05-08T18:09:30.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4805999999999998e-05 2024-05-08T18:09:30.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:30.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600704+0000", 2024-05-08T18:09:30.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2026000000000001e-05 2024-05-08T18:09:30.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:30.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600884+0000", 2024-05-08T18:09:30.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000179385 2024-05-08T18:09:30.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:30.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601296+0000", 2024-05-08T18:09:30.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041257400000000002 2024-05-08T18:09:30.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:30.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:30.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601742+0000", 2024-05-08T18:09:30.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044585399999999998 2024-05-08T18:09:30.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:30.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.617360+0000", 2024-05-08T18:09:31.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015617982000000001 2024-05-08T18:09:31.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622618+0000", 2024-05-08T18:09:31.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052577420000000001 2024-05-08T18:09:31.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622835+0000", 2024-05-08T18:09:31.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021674699999999999 2024-05-08T18:09:31.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622971+0000", 2024-05-08T18:09:31.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679799999999999 2024-05-08T18:09:31.001 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.001 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.001 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.001 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1275 3.33 e85/20 3:ccdf9558:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_3:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:31.001 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:31.001 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.923150232000001, 2024-05-08T18:09:31.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020251129, 2024-05-08T18:09:31.001 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.001 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.001 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.002 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:31.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:31.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053592+0000", 2024-05-08T18:09:31.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5189999999999999e-06 2024-05-08T18:09:31.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059662+0000", 2024-05-08T18:09:31.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060699289999999999 2024-05-08T18:09:31.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059680+0000", 2024-05-08T18:09:31.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7558999999999999e-05 2024-05-08T18:09:31.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059689+0000", 2024-05-08T18:09:31.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2320000000000007e-06 2024-05-08T18:09:31.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059826+0000", 2024-05-08T18:09:31.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136792 2024-05-08T18:09:31.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059867+0000", 2024-05-08T18:09:31.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1689e-05 2024-05-08T18:09:31.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073728+0000", 2024-05-08T18:09:31.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01386104 2024-05-08T18:09:31.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073841+0000", 2024-05-08T18:09:31.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011236899999999999 2024-05-08T18:09:31.005 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.005 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.005 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.005 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1286 3.20 3:07ccb256:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:31.005 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:31.005 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.772455617999999, 2024-05-08T18:09:31.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022546805999999999, 2024-05-08T18:09:31.005 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.006 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.006 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.006 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.006 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.006 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.006 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1286 2024-05-08T18:09:31.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.006 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:31.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:31.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204287+0000", 2024-05-08T18:09:31.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8880000000000001e-06 2024-05-08T18:09:31.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208135+0000", 2024-05-08T18:09:31.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038480960000000001 2024-05-08T18:09:31.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208158+0000", 2024-05-08T18:09:31.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-05 2024-05-08T18:09:31.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208172+0000", 2024-05-08T18:09:31.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:09:31.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208251+0000", 2024-05-08T18:09:31.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8863999999999996e-05 2024-05-08T18:09:31.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208387+0000", 2024-05-08T18:09:31.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013615099999999999 2024-05-08T18:09:31.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:31.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208488+0000", 2024-05-08T18:09:31.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101366 2024-05-08T18:09:31.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.214533+0000", 2024-05-08T18:09:31.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060444829999999998 2024-05-08T18:09:31.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226742+0000", 2024-05-08T18:09:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012208798 2024-05-08T18:09:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226792+0000", 2024-05-08T18:09:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0565999999999997e-05 2024-05-08T18:09:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226831+0000", 2024-05-08T18:09:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8816999999999998e-05 2024-05-08T18:09:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.010 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1397 3.34 e87/20 3:2c6418f0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_3:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.174023629000001, 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019946450000000001, 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:31.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802717+0000", 2024-05-08T18:09:31.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0400000000000005e-07 2024-05-08T18:09:31.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807936+0000", 2024-05-08T18:09:31.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052192489999999996 2024-05-08T18:09:31.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807971+0000", 2024-05-08T18:09:31.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4517000000000002e-05 2024-05-08T18:09:31.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807993+0000", 2024-05-08T18:09:31.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2463000000000002e-05 2024-05-08T18:09:31.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.808151+0000", 2024-05-08T18:09:31.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015751400000000001 2024-05-08T18:09:31.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.808197+0000", 2024-05-08T18:09:31.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6637000000000001e-05 2024-05-08T18:09:31.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822537+0000", 2024-05-08T18:09:31.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014339607000000001 2024-05-08T18:09:31.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822663+0000", 2024-05-08T18:09:31.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125659 2024-05-08T18:09:31.014 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.014 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.014 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.015 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1399 3.2c 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:31.015 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:31.015 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.157312097999998, 2024-05-08T18:09:31.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030683200000000001, 2024-05-08T18:09:31.015 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.015 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.015 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.015 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.015 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.015 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.015 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1399 2024-05-08T18:09:31.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.015 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:31.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:31.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819432+0000", 2024-05-08T18:09:31.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7759999999999999e-06 2024-05-08T18:09:31.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825021+0000", 2024-05-08T18:09:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055895859999999997 2024-05-08T18:09:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825052+0000", 2024-05-08T18:09:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1047000000000003e-05 2024-05-08T18:09:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825068+0000", 2024-05-08T18:09:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6138999999999999e-05 2024-05-08T18:09:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825218+0000", 2024-05-08T18:09:31.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014997200000000001 2024-05-08T18:09:31.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825490+0000", 2024-05-08T18:09:31.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000271446 2024-05-08T18:09:31.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:31.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825710+0000", 2024-05-08T18:09:31.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220354 2024-05-08T18:09:31.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.839642+0000", 2024-05-08T18:09:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013932363 2024-05-08T18:09:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849813+0000", 2024-05-08T18:09:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010170461 2024-05-08T18:09:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849981+0000", 2024-05-08T18:09:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016776399999999999 2024-05-08T18:09:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.850111+0000", 2024-05-08T18:09:31.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013029200000000001 2024-05-08T18:09:31.020 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.020 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.020 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.020 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1406 3.20 3:05e3d3c1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:31.020 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:31.020 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.087740987, 2024-05-08T18:09:31.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022642778999999998, 2024-05-08T18:09:31.020 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.021 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.021 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.021 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.021 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.021 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.021 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1406 2024-05-08T18:09:31.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.021 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:31.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:31.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.889003+0000", 2024-05-08T18:09:31.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8670000000000004e-06 2024-05-08T18:09:31.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893237+0000", 2024-05-08T18:09:31.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042339999999999999 2024-05-08T18:09:31.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893279+0000", 2024-05-08T18:09:31.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2225999999999999e-05 2024-05-08T18:09:31.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893305+0000", 2024-05-08T18:09:31.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.618e-05 2024-05-08T18:09:31.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893479+0000", 2024-05-08T18:09:31.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017357700000000001 2024-05-08T18:09:31.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893736+0000", 2024-05-08T18:09:31.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025701700000000001 2024-05-08T18:09:31.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:31.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893993+0000", 2024-05-08T18:09:31.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025750700000000003 2024-05-08T18:09:31.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904227+0000", 2024-05-08T18:09:31.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010234073 2024-05-08T18:09:31.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911471+0000", 2024-05-08T18:09:31.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0072441909999999997 2024-05-08T18:09:31.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911567+0000", 2024-05-08T18:09:31.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5685000000000003e-05 2024-05-08T18:09:31.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911642+0000", 2024-05-08T18:09:31.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4456000000000007e-05 2024-05-08T18:09:31.026 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.026 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.026 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.026 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1416 3.2c 3:345ebd70:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:31.026 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:31.026 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.980369782, 2024-05-08T18:09:31.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027523229999999999, 2024-05-08T18:09:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1416 2024-05-08T18:09:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:31.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996374+0000", 2024-05-08T18:09:31.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.506e-06 2024-05-08T18:09:31.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000305+0000", 2024-05-08T18:09:31.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003931197 2024-05-08T18:09:31.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000346+0000", 2024-05-08T18:09:31.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1396000000000001e-05 2024-05-08T18:09:31.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000364+0000", 2024-05-08T18:09:31.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.806e-05 2024-05-08T18:09:31.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000490+0000", 2024-05-08T18:09:31.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012581800000000001 2024-05-08T18:09:31.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000755+0000", 2024-05-08T18:09:31.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026484700000000002 2024-05-08T18:09:31.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:31.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000992+0000", 2024-05-08T18:09:31.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023701700000000001 2024-05-08T18:09:31.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010465+0000", 2024-05-08T18:09:31.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094726429999999993 2024-05-08T18:09:31.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023679+0000", 2024-05-08T18:09:31.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013214105 2024-05-08T18:09:31.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023776+0000", 2024-05-08T18:09:31.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7258999999999998e-05 2024-05-08T18:09:31.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023893+0000", 2024-05-08T18:09:31.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117382 2024-05-08T18:09:31.031 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.032 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.032 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.032 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1451 3.36 3:6da4b5f8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:31.032 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:31.032 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 17.679697148999999, 2024-05-08T18:09:31.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022119236, 2024-05-08T18:09:31.032 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.032 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.032 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.032 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.032 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.032 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.032 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1451 2024-05-08T18:09:31.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.033 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:31.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:31.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297046+0000", 2024-05-08T18:09:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6030000000000001e-06 2024-05-08T18:09:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301125+0000", 2024-05-08T18:09:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004079058 2024-05-08T18:09:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301163+0000", 2024-05-08T18:09:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7286000000000002e-05 2024-05-08T18:09:31.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301181+0000", 2024-05-08T18:09:31.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.844e-05 2024-05-08T18:09:31.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301325+0000", 2024-05-08T18:09:31.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144284 2024-05-08T18:09:31.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301602+0000", 2024-05-08T18:09:31.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027665399999999998 2024-05-08T18:09:31.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:31.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301835+0000", 2024-05-08T18:09:31.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023292699999999999 2024-05-08T18:09:31.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.318166+0000", 2024-05-08T18:09:31.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016331061000000001 2024-05-08T18:09:31.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.318991+0000", 2024-05-08T18:09:31.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000825427 2024-05-08T18:09:31.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.319082+0000", 2024-05-08T18:09:31.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0743999999999997e-05 2024-05-08T18:09:31.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.319162+0000", 2024-05-08T18:09:31.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9752000000000005e-05 2024-05-08T18:09:31.037 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.037 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.037 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.037 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1471 3.26 3:6495ae89:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:31.037 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:31.037 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 17.280092927999998, 2024-05-08T18:09:31.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022361453, 2024-05-08T18:09:31.038 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.038 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.038 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.038 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.038 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.038 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.038 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1471 2024-05-08T18:09:31.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.038 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:31.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:31.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696650+0000", 2024-05-08T18:09:31.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8839999999999998e-06 2024-05-08T18:09:31.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700528+0000", 2024-05-08T18:09:31.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038783390000000002 2024-05-08T18:09:31.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700554+0000", 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6106e-05 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700566+0000", 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2021000000000001e-05 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700682+0000", 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115457 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700951+0000", 2024-05-08T18:09:31.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026891699999999997 2024-05-08T18:09:31.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:31.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.701210+0000", 2024-05-08T18:09:31.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000259017 2024-05-08T18:09:31.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718848+0000", 2024-05-08T18:09:31.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017638132000000001 2024-05-08T18:09:31.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718917+0000", 2024-05-08T18:09:31.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9564e-05 2024-05-08T18:09:31.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718968+0000", 2024-05-08T18:09:31.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1028e-05 2024-05-08T18:09:31.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.719008+0000", 2024-05-08T18:09:31.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9987999999999997e-05 2024-05-08T18:09:31.042 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.042 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.042 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1669 3.2c 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.176827825, 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020235185999999999, 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1669 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:31.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:31.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799916+0000", 2024-05-08T18:09:31.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7730000000000001e-06 2024-05-08T18:09:31.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799931+0000", 2024-05-08T18:09:31.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5227e-05 2024-05-08T18:09:31.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799969+0000", 2024-05-08T18:09:31.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7883000000000003e-05 2024-05-08T18:09:31.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799986+0000", 2024-05-08T18:09:31.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6728999999999999e-05 2024-05-08T18:09:31.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.800123+0000", 2024-05-08T18:09:31.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013784600000000001 2024-05-08T18:09:31.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:31.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.800135+0000", 2024-05-08T18:09:31.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1336e-05 2024-05-08T18:09:31.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.805653+0000", 2024-05-08T18:09:31.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055179890000000001 2024-05-08T18:09:31.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.805876+0000", 2024-05-08T18:09:31.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022279 2024-05-08T18:09:31.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.820147+0000", 2024-05-08T18:09:31.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014271613000000001 2024-05-08T18:09:31.047 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.047 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.047 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.047 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1910 3.a 3:537830e8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.21:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:31.047 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:25.987700+0000", 2024-05-08T18:09:31.047 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.9890400029999995, 2024-05-08T18:09:31.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020512796999999999, 2024-05-08T18:09:31.047 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.047 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.047 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.047 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.048 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.048 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.048 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1910 2024-05-08T18:09:31.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.048 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.987700+0000", 2024-05-08T18:09:31.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.987700+0000", 2024-05-08T18:09:31.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.987703+0000", 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1130000000000001e-06 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991635+0000", 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039315579999999999 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991673+0000", 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8550000000000002e-05 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991691+0000", 2024-05-08T18:09:31.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.768e-05 2024-05-08T18:09:31.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991796+0000", 2024-05-08T18:09:31.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105474 2024-05-08T18:09:31.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.992021+0000", 2024-05-08T18:09:31.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022432999999999999 2024-05-08T18:09:31.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:31.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.992664+0000", 2024-05-08T18:09:31.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064343099999999997 2024-05-08T18:09:31.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.004478+0000", 2024-05-08T18:09:31.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011814069 2024-05-08T18:09:31.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.008061+0000", 2024-05-08T18:09:31.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035826289999999999 2024-05-08T18:09:31.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.008129+0000", 2024-05-08T18:09:31.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8734999999999998e-05 2024-05-08T18:09:31.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.008213+0000", 2024-05-08T18:09:31.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3227999999999997e-05 2024-05-08T18:09:31.052 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.052 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.052 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.052 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1937 3.35 3:afad9b8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.kKJI4mkViIqglOaR5LKVFjY-f90axEe_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:31.052 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:26.656524+0000", 2024-05-08T18:09:31.052 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.3202156289999998, 2024-05-08T18:09:31.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025036721000000001, 2024-05-08T18:09:31.052 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.053 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.053 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.053 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.053 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.053 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.053 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1937 2024-05-08T18:09:31.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.053 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.656524+0000", 2024-05-08T18:09:31.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.656524+0000", 2024-05-08T18:09:31.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.656528+0000", 2024-05-08T18:09:31.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7469999999999999e-06 2024-05-08T18:09:31.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.661958+0000", 2024-05-08T18:09:31.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054303229999999999 2024-05-08T18:09:31.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.662000+0000", 2024-05-08T18:09:31.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1412999999999998e-05 2024-05-08T18:09:31.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.662018+0000", 2024-05-08T18:09:31.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8162999999999999e-05 2024-05-08T18:09:31.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.662193+0000", 2024-05-08T18:09:31.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000175518 2024-05-08T18:09:31.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.662674+0000", 2024-05-08T18:09:31.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048055800000000002 2024-05-08T18:09:31.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:31.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.663088+0000", 2024-05-08T18:09:31.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041393799999999998 2024-05-08T18:09:31.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.680805+0000", 2024-05-08T18:09:31.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017716942999999999 2024-05-08T18:09:31.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.681387+0000", 2024-05-08T18:09:31.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00058174300000000002 2024-05-08T18:09:31.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.681483+0000", 2024-05-08T18:09:31.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6168999999999994e-05 2024-05-08T18:09:31.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.681561+0000", 2024-05-08T18:09:31.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8206000000000003e-05 2024-05-08T18:09:31.057 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.057 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.057 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.058 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1951 3.26 3:66b697c3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.seZFA2ZEY-Crt1uNfyqRLzirbZGBgqA_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:31.058 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:26.935268+0000", 2024-05-08T18:09:31.058 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.0414717280000003, 2024-05-08T18:09:31.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021970598000000001, 2024-05-08T18:09:31.058 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.058 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.058 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.058 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.058 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.058 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.058 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1951 2024-05-08T18:09:31.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.058 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.935268+0000", 2024-05-08T18:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.935268+0000", 2024-05-08T18:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.935271+0000", 2024-05-08T18:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.943e-06 2024-05-08T18:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939177+0000", 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039056239999999999 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939217+0000", 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0639000000000002e-05 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939236+0000", 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8580000000000002e-05 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939315+0000", 2024-05-08T18:09:31.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9297999999999999e-05 2024-05-08T18:09:31.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939427+0000", 2024-05-08T18:09:31.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000111999 2024-05-08T18:09:31.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:31.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939520+0000", 2024-05-08T18:09:31.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2717e-05 2024-05-08T18:09:31.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.956451+0000", 2024-05-08T18:09:31.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016931531999999999 2024-05-08T18:09:31.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.957119+0000", 2024-05-08T18:09:31.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00066793099999999997 2024-05-08T18:09:31.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.957190+0000", 2024-05-08T18:09:31.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0894000000000003e-05 2024-05-08T18:09:31.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.957239+0000", 2024-05-08T18:09:31.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8440999999999999e-05 2024-05-08T18:09:31.063 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.063 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.063 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.063 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1978 3.20 3:06c7576f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.32:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:31.063 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.490306+0000", 2024-05-08T18:09:31.063 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 3.4864335479999999, 2024-05-08T18:09:31.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022573467999999999, 2024-05-08T18:09:31.063 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.063 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.063 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.063 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.063 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.063 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.064 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1978 2024-05-08T18:09:31.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.064 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.490306+0000", 2024-05-08T18:09:31.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.490306+0000", 2024-05-08T18:09:31.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.490308+0000", 2024-05-08T18:09:31.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1440000000000001e-06 2024-05-08T18:09:31.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.494869+0000", 2024-05-08T18:09:31.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045608669999999997 2024-05-08T18:09:31.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.494904+0000", 2024-05-08T18:09:31.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4313000000000002e-05 2024-05-08T18:09:31.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.494924+0000", 2024-05-08T18:09:31.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0322999999999998e-05 2024-05-08T18:09:31.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.495122+0000", 2024-05-08T18:09:31.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019849700000000001 2024-05-08T18:09:31.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.495386+0000", 2024-05-08T18:09:31.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026385100000000001 2024-05-08T18:09:31.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:31.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.496266+0000", 2024-05-08T18:09:31.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000880184 2024-05-08T18:09:31.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.505362+0000", 2024-05-08T18:09:31.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0090952729999999992 2024-05-08T18:09:31.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.512528+0000", 2024-05-08T18:09:31.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00716593 2024-05-08T18:09:31.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.512736+0000", 2024-05-08T18:09:31.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020801399999999999 2024-05-08T18:09:31.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.512880+0000", 2024-05-08T18:09:31.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144072 2024-05-08T18:09:31.068 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.068 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.068 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.068 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1981 3.10 3:0ac06fda:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.G5bm6z3gJ2RUQJmZVjgkH_wtdE6Lk0X_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:31.068 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.593918+0000", 2024-05-08T18:09:31.068 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 3.3828218849999998, 2024-05-08T18:09:31.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.03011194, 2024-05-08T18:09:31.068 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.068 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.068 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.069 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.069 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.069 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.069 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1981 2024-05-08T18:09:31.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.069 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.593918+0000", 2024-05-08T18:09:31.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.593918+0000", 2024-05-08T18:09:31.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.593921+0000", 2024-05-08T18:09:31.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.886e-06 2024-05-08T18:09:31.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601287+0000", 2024-05-08T18:09:31.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073666119999999998 2024-05-08T18:09:31.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601352+0000", 2024-05-08T18:09:31.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4949000000000004e-05 2024-05-08T18:09:31.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601387+0000", 2024-05-08T18:09:31.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4422999999999999e-05 2024-05-08T18:09:31.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601621+0000", 2024-05-08T18:09:31.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000234317 2024-05-08T18:09:31.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601892+0000", 2024-05-08T18:09:31.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027052000000000001 2024-05-08T18:09:31.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:31.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.602131+0000", 2024-05-08T18:09:31.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023928799999999999 2024-05-08T18:09:31.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.613758+0000", 2024-05-08T18:09:31.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011626745000000001 2024-05-08T18:09:31.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.623860+0000", 2024-05-08T18:09:31.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010102709 2024-05-08T18:09:31.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.623958+0000", 2024-05-08T18:09:31.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8076000000000001e-05 2024-05-08T18:09:31.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.624030+0000", 2024-05-08T18:09:31.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1415000000000007e-05 2024-05-08T18:09:31.073 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.073 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.073 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.073 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1982 3.2c 3:37eb8330:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.G5bm6z3gJ2RUQJmZVjgkH_wtdE6Lk0X_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:31.073 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.601454+0000", 2024-05-08T18:09:31.074 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 3.3752862459999999, 2024-05-08T18:09:31.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022793639000000001, 2024-05-08T18:09:31.074 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.074 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.074 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.074 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.074 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.074 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.074 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1982 2024-05-08T18:09:31.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.074 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601454+0000", 2024-05-08T18:09:31.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601454+0000", 2024-05-08T18:09:31.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601456+0000", 2024-05-08T18:09:31.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8669999999999998e-06 2024-05-08T18:09:31.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.604859+0000", 2024-05-08T18:09:31.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034024260000000001 2024-05-08T18:09:31.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.604906+0000", 2024-05-08T18:09:31.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7092999999999998e-05 2024-05-08T18:09:31.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.604923+0000", 2024-05-08T18:09:31.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.662e-05 2024-05-08T18:09:31.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.605130+0000", 2024-05-08T18:09:31.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020757100000000001 2024-05-08T18:09:31.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.605526+0000", 2024-05-08T18:09:31.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039611600000000001 2024-05-08T18:09:31.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:31.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.605857+0000", 2024-05-08T18:09:31.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033062 2024-05-08T18:09:31.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.621816+0000", 2024-05-08T18:09:31.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015958882000000001 2024-05-08T18:09:31.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.623918+0000", 2024-05-08T18:09:31.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021022340000000001 2024-05-08T18:09:31.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.624122+0000", 2024-05-08T18:09:31.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020434500000000001 2024-05-08T18:09:31.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.624247+0000", 2024-05-08T18:09:31.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486499999999999 2024-05-08T18:09:31.079 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.079 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.079 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.079 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2124 3.a 3:52e5bbd1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.2vC9gBnJ_DBfUNfPnYYwG6Mssyx01u3_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:31.079 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:30.313981+0000", 2024-05-08T18:09:31.079 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.66275857900000001, 2024-05-08T18:09:31.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019640139000000001, 2024-05-08T18:09:31.079 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.079 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.080 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.080 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.080 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.080 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.080 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2124 2024-05-08T18:09:31.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.080 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.313981+0000", 2024-05-08T18:09:31.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.313981+0000", 2024-05-08T18:09:31.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.313984+0000", 2024-05-08T18:09:31.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5500000000000001e-06 2024-05-08T18:09:31.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.318031+0000", 2024-05-08T18:09:31.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040471400000000003 2024-05-08T18:09:31.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.318073+0000", 2024-05-08T18:09:31.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1593e-05 2024-05-08T18:09:31.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.318091+0000", 2024-05-08T18:09:31.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8556e-05 2024-05-08T18:09:31.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.318203+0000", 2024-05-08T18:09:31.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000111422 2024-05-08T18:09:31.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.318425+0000", 2024-05-08T18:09:31.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022266199999999999 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.318633+0000", 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000207937 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.332144+0000", 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013510561000000001 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.333463+0000", 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001318867 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.333553+0000", 2024-05-08T18:09:31.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0112999999999996e-05 2024-05-08T18:09:31.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.333621+0000", 2024-05-08T18:09:31.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8738000000000005e-05 2024-05-08T18:09:31.084 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.084 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.084 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.084 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.084 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.084 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:31.085 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.60 2024-05-08T18:09:31.085 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:31.085 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 61 2024-05-08T18:09:31.086 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:31.086 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:31.086 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119325 s, 879 MB/s 2024-05-08T18:09:31.086 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:31.088+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:31.087 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:09:31.187 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:31.188+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:31.220 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:31.220 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:31.220 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:31.220 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:31.220 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.61 2024-05-08T18:09:31.220 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:31.220 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 62 2024-05-08T18:09:31.234 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:09:31.235 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:31.235 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:31.235 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123904 s, 846 MB/s 2024-05-08T18:09:31.288 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:31.289+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:31.358 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:31.358 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:31.358 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:31.358 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:31.358 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:31.373 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:09:31.394 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.62 2024-05-08T18:09:31.394 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:31.394 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 63 2024-05-08T18:09:31.409 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:31.409 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:31.409 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012602 s, 832 MB/s 2024-05-08T18:09:31.416 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:31.417+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:31.489 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:31.492+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:31.553 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:31.553 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:31.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:31.553 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:31.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.553 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:09:31.553 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:31.553 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 148.73634275800001, 2024-05-08T18:09:31.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.16213206199999999, 2024-05-08T18:09:31.553 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.554 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.554 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.554 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.554 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:09:31.554 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:09:31.554 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1 2024-05-08T18:09:31.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.554 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:31.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:31.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814494+0000", 2024-05-08T18:09:31.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:09:31.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814520+0000", 2024-05-08T18:09:31.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-05 2024-05-08T18:09:31.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814543+0000", 2024-05-08T18:09:31.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2353000000000001e-05 2024-05-08T18:09:31.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814563+0000", 2024-05-08T18:09:31.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.048e-05 2024-05-08T18:09:31.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814677+0000", 2024-05-08T18:09:31.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113632 2024-05-08T18:09:31.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814705+0000", 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8626999999999999e-05 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971115+0000", 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.156409825 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971438+0000", 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00032289200000000002 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971849+0000", 2024-05-08T18:09:31.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041139300000000002 2024-05-08T18:09:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.975364+0000", 2024-05-08T18:09:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035148390000000001 2024-05-08T18:09:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976474+0000", 2024-05-08T18:09:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001110099 2024-05-08T18:09:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976564+0000", 2024-05-08T18:09:31.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9522000000000001e-05 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976624+0000", 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9616e-05 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 148.44098602400001, 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021440811000000001, 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.559 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.560 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.560 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:09:31.560 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:09:31.560 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 52 2024-05-08T18:09:31.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.560 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:09:31.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109848+0000", 2024-05-08T18:09:31.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109849+0000", 2024-05-08T18:09:31.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1370000000000001e-06 2024-05-08T18:09:31.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109861+0000", 2024-05-08T18:09:31.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1559999999999999e-05 2024-05-08T18:09:31.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109878+0000", 2024-05-08T18:09:31.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7105999999999999e-05 2024-05-08T18:09:31.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.109892+0000", 2024-05-08T18:09:31.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3577000000000001e-05 2024-05-08T18:09:31.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126161+0000", 2024-05-08T18:09:31.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016269458000000001 2024-05-08T18:09:31.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126299+0000", 2024-05-08T18:09:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000138405 2024-05-08T18:09:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.126534+0000", 2024-05-08T18:09:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000234875 2024-05-08T18:09:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.127543+0000", 2024-05-08T18:09:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001008852 2024-05-08T18:09:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131128+0000", 2024-05-08T18:09:31.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035844359999999999 2024-05-08T18:09:31.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131222+0000", 2024-05-08T18:09:31.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3905000000000003e-05 2024-05-08T18:09:31.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:03.131289+0000", 2024-05-08T18:09:31.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7500000000000001e-05 2024-05-08T18:09:31.564 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.564 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.564 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.565 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1194 3.16 e85/20 3:6b2325a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_6:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:31.565 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:31.565 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 24.529940547999999, 2024-05-08T18:09:31.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024064767000000001, 2024-05-08T18:09:31.565 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.565 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.565 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.565 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:31.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:31.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020897+0000", 2024-05-08T18:09:31.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9699999999999999e-06 2024-05-08T18:09:31.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027491+0000", 2024-05-08T18:09:31.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065945229999999997 2024-05-08T18:09:31.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027543+0000", 2024-05-08T18:09:31.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1319000000000001e-05 2024-05-08T18:09:31.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027573+0000", 2024-05-08T18:09:31.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0380000000000001e-05 2024-05-08T18:09:31.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027737+0000", 2024-05-08T18:09:31.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000163871 2024-05-08T18:09:31.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027782+0000", 2024-05-08T18:09:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5519999999999998e-05 2024-05-08T18:09:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044819+0000", 2024-05-08T18:09:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017036481999999999 2024-05-08T18:09:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044958+0000", 2024-05-08T18:09:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013970200000000001 2024-05-08T18:09:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1202 3.14 e85/20 3:2a8c8569:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_14:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 24.44399048, 2024-05-08T18:09:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023371860000000001, 2024-05-08T18:09:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106846+0000", 2024-05-08T18:09:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:09:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110841+0000", 2024-05-08T18:09:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039945479999999997 2024-05-08T18:09:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110888+0000", 2024-05-08T18:09:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7349999999999999e-05 2024-05-08T18:09:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110913+0000", 2024-05-08T18:09:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5055999999999999e-05 2024-05-08T18:09:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.111067+0000", 2024-05-08T18:09:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015329800000000001 2024-05-08T18:09:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.111110+0000", 2024-05-08T18:09:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3649000000000002e-05 2024-05-08T18:09:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130087+0000", 2024-05-08T18:09:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018976186999999999 2024-05-08T18:09:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130216+0000", 2024-05-08T18:09:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012911199999999999 2024-05-08T18:09:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1207 3.15 3:a96d965c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 24.398408204999999, 2024-05-08T18:09:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02864527, 2024-05-08T18:09:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1207 2024-05-08T18:09:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152430+0000", 2024-05-08T18:09:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1230000000000002e-06 2024-05-08T18:09:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157227+0000", 2024-05-08T18:09:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047968769999999997 2024-05-08T18:09:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157268+0000", 2024-05-08T18:09:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0673000000000002e-05 2024-05-08T18:09:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157293+0000", 2024-05-08T18:09:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5469999999999998e-05 2024-05-08T18:09:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157483+0000", 2024-05-08T18:09:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018973300000000001 2024-05-08T18:09:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157750+0000", 2024-05-08T18:09:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026736400000000002 2024-05-08T18:09:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157982+0000", 2024-05-08T18:09:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023154299999999999 2024-05-08T18:09:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.171224+0000", 2024-05-08T18:09:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013242115 2024-05-08T18:09:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180801+0000", 2024-05-08T18:09:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0095766749999999998 2024-05-08T18:09:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180919+0000", 2024-05-08T18:09:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118546 2024-05-08T18:09:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.181071+0000", 2024-05-08T18:09:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152151 2024-05-08T18:09:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1224 3.13 3:c82cef46:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.912354559000001, 2024-05-08T18:09:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025580821, 2024-05-08T18:09:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1224 2024-05-08T18:09:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638484+0000", 2024-05-08T18:09:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1989999999999999e-06 2024-05-08T18:09:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643068+0000", 2024-05-08T18:09:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045841859999999996 2024-05-08T18:09:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643099+0000", 2024-05-08T18:09:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1331999999999997e-05 2024-05-08T18:09:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643117+0000", 2024-05-08T18:09:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7176999999999998e-05 2024-05-08T18:09:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643262+0000", 2024-05-08T18:09:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014521299999999999 2024-05-08T18:09:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643523+0000", 2024-05-08T18:09:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000260783 2024-05-08T18:09:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643768+0000", 2024-05-08T18:09:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024567399999999998 2024-05-08T18:09:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.662501+0000", 2024-05-08T18:09:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018732988999999999 2024-05-08T18:09:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663964+0000", 2024-05-08T18:09:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001463074 2024-05-08T18:09:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.664015+0000", 2024-05-08T18:09:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0549e-05 2024-05-08T18:09:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.664061+0000", 2024-05-08T18:09:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5645000000000001e-05 2024-05-08T18:09:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1255 3.12 e85/20 3:48af9d8c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_11:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.069356607, 2024-05-08T18:09:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021924084999999999, 2024-05-08T18:09:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481479+0000", 2024-05-08T18:09:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999999999999999e-06 2024-05-08T18:09:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.485998+0000", 2024-05-08T18:09:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045194600000000003 2024-05-08T18:09:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486023+0000", 2024-05-08T18:09:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4516999999999999e-05 2024-05-08T18:09:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486033+0000", 2024-05-08T18:09:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0529e-05 2024-05-08T18:09:31.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486172+0000", 2024-05-08T18:09:31.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013829599999999999 2024-05-08T18:09:31.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486234+0000", 2024-05-08T18:09:31.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2156000000000006e-05 2024-05-08T18:09:31.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.503338+0000", 2024-05-08T18:09:31.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017104346999999999 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.503402+0000", 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3579999999999998e-05 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1277 3.3f 3:ffe0c8dc:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.465707575, 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025789262, 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.588 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.589 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.589 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.589 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.589 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1277 2024-05-08T18:09:31.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.589 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:31.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:31.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085130+0000", 2024-05-08T18:09:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4659999999999999e-06 2024-05-08T18:09:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089237+0000", 2024-05-08T18:09:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004106424 2024-05-08T18:09:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089281+0000", 2024-05-08T18:09:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4053e-05 2024-05-08T18:09:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089300+0000", 2024-05-08T18:09:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9057000000000001e-05 2024-05-08T18:09:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089467+0000", 2024-05-08T18:09:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000167734 2024-05-08T18:09:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089839+0000", 2024-05-08T18:09:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037171900000000001 2024-05-08T18:09:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.090206+0000", 2024-05-08T18:09:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036716500000000003 2024-05-08T18:09:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.105682+0000", 2024-05-08T18:09:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015475495000000001 2024-05-08T18:09:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110695+0000", 2024-05-08T18:09:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050135420000000002 2024-05-08T18:09:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110779+0000", 2024-05-08T18:09:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3914999999999999e-05 2024-05-08T18:09:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110916+0000", 2024-05-08T18:09:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136692 2024-05-08T18:09:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1283 3.39 3:9ca6d3f9:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.381621990999999, 2024-05-08T18:09:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022844218999999999, 2024-05-08T18:09:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1283 2024-05-08T18:09:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169215+0000", 2024-05-08T18:09:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9529999999999999e-06 2024-05-08T18:09:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173086+0000", 2024-05-08T18:09:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003870582 2024-05-08T18:09:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173107+0000", 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1608999999999999e-05 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173117+0000", 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8090000000000004e-06 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173192+0000", 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4676000000000001e-05 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173197+0000", 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0710000000000002e-06 2024-05-08T18:09:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.175963+0000", 2024-05-08T18:09:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027662810000000002 2024-05-08T18:09:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.176138+0000", 2024-05-08T18:09:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017430500000000001 2024-05-08T18:09:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.176332+0000", 2024-05-08T18:09:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019477000000000001 2024-05-08T18:09:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.184230+0000", 2024-05-08T18:09:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078977630000000004 2024-05-08T18:09:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.191962+0000", 2024-05-08T18:09:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077315830000000002 2024-05-08T18:09:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.192015+0000", 2024-05-08T18:09:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2992999999999999e-05 2024-05-08T18:09:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.192056+0000", 2024-05-08T18:09:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1823999999999998e-05 2024-05-08T18:09:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1412 3.3f 3:fe02d1ba:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.593169965000001, 2024-05-08T18:09:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023048524000000001, 2024-05-08T18:09:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1412 2024-05-08T18:09:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957668+0000", 2024-05-08T18:09:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8999999999999999e-06 2024-05-08T18:09:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963142+0000", 2024-05-08T18:09:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005473627 2024-05-08T18:09:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963181+0000", 2024-05-08T18:09:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.93e-05 2024-05-08T18:09:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963199+0000", 2024-05-08T18:09:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7866000000000001e-05 2024-05-08T18:09:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963347+0000", 2024-05-08T18:09:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014816800000000001 2024-05-08T18:09:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963603+0000", 2024-05-08T18:09:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025623099999999999 2024-05-08T18:09:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963843+0000", 2024-05-08T18:09:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023961699999999999 2024-05-08T18:09:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.975743+0000", 2024-05-08T18:09:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011899998 2024-05-08T18:09:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980533+0000", 2024-05-08T18:09:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047898749999999999 2024-05-08T18:09:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980638+0000", 2024-05-08T18:09:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010527300000000001 2024-05-08T18:09:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980713+0000", 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4668999999999999e-05 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1417 3.15 3:a8711592:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.005810+0000", 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.545024664, 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021479357000000001, 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1417 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.005810+0000", 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.005810+0000", 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.005813+0000", 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6899999999999998e-06 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.009925+0000", 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041117039999999999 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.009975+0000", 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9759000000000003e-05 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010001+0000", 2024-05-08T18:09:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6267000000000001e-05 2024-05-08T18:09:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010128+0000", 2024-05-08T18:09:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012743100000000001 2024-05-08T18:09:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010403+0000", 2024-05-08T18:09:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027485699999999999 2024-05-08T18:09:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010633+0000", 2024-05-08T18:09:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000229254 2024-05-08T18:09:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023537+0000", 2024-05-08T18:09:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012904456 2024-05-08T18:09:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.027115+0000", 2024-05-08T18:09:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003577818 2024-05-08T18:09:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.027222+0000", 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000106879 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.027289+0000", 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7242000000000004e-05 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1420 3.e 3:72accb8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.8:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.515101094999999, 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025387064000000001, 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1420 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035736+0000", 2024-05-08T18:09:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0240000000000002e-06 2024-05-08T18:09:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039738+0000", 2024-05-08T18:09:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004001419 2024-05-08T18:09:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039775+0000", 2024-05-08T18:09:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7696e-05 2024-05-08T18:09:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039792+0000", 2024-05-08T18:09:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7183000000000001e-05 2024-05-08T18:09:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039909+0000", 2024-05-08T18:09:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116915 2024-05-08T18:09:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.040173+0000", 2024-05-08T18:09:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026373100000000001 2024-05-08T18:09:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.041106+0000", 2024-05-08T18:09:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093293100000000002 2024-05-08T18:09:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060858+0000", 2024-05-08T18:09:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019752232000000002 2024-05-08T18:09:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060894+0000", 2024-05-08T18:09:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6056000000000002e-05 2024-05-08T18:09:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.061023+0000", 2024-05-08T18:09:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128849 2024-05-08T18:09:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.061120+0000", 2024-05-08T18:09:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7027999999999993e-05 2024-05-08T18:09:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1429 3.3b 3:dcac3b7e:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.473560+0000", 2024-05-08T18:09:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.077273779999999, 2024-05-08T18:09:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021091181000000001, 2024-05-08T18:09:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1429 2024-05-08T18:09:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.473560+0000", 2024-05-08T18:09:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.473560+0000", 2024-05-08T18:09:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.473563+0000", 2024-05-08T18:09:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.103e-06 2024-05-08T18:09:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477321+0000", 2024-05-08T18:09:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037581120000000001 2024-05-08T18:09:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477342+0000", 2024-05-08T18:09:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1607000000000002e-05 2024-05-08T18:09:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477352+0000", 2024-05-08T18:09:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0138e-05 2024-05-08T18:09:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477440+0000", 2024-05-08T18:09:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7557000000000002e-05 2024-05-08T18:09:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477582+0000", 2024-05-08T18:09:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014232700000000001 2024-05-08T18:09:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.477723+0000", 2024-05-08T18:09:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140564 2024-05-08T18:09:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.483995+0000", 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006272082 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.494563+0000", 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01056786 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.494611+0000", 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8062000000000002e-05 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.494652+0000", 2024-05-08T18:09:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0769000000000002e-05 2024-05-08T18:09:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1448 3.15 3:a83ea02a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.9:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.646913276999999, 2024-05-08T18:09:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021945044, 2024-05-08T18:09:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1448 2024-05-08T18:09:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903924+0000", 2024-05-08T18:09:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5790000000000002e-06 2024-05-08T18:09:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907773+0000", 2024-05-08T18:09:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038495740000000001 2024-05-08T18:09:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907796+0000", 2024-05-08T18:09:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3011e-05 2024-05-08T18:09:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907806+0000", 2024-05-08T18:09:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9729999999999992e-06 2024-05-08T18:09:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907885+0000", 2024-05-08T18:09:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8799000000000002e-05 2024-05-08T18:09:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.908059+0000", 2024-05-08T18:09:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017370100000000001 2024-05-08T18:09:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.908581+0000", 2024-05-08T18:09:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052234099999999995 2024-05-08T18:09:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.918050+0000", 2024-05-08T18:09:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00946871 2024-05-08T18:09:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925682+0000", 2024-05-08T18:09:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0076326689999999999 2024-05-08T18:09:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925817+0000", 2024-05-08T18:09:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013451000000000001 2024-05-08T18:09:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925866+0000", 2024-05-08T18:09:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9177e-05 2024-05-08T18:09:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1904 3.3b 3:dd91eaf5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.20:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:25.873222+0000", 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.6776118430000002, 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021920749999999999, 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1904 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.873222+0000", 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.873222+0000", 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.873224+0000", 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.007e-06 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.876973+0000", 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003748735 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.877002+0000", 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8792000000000001e-05 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.877017+0000", 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5017e-05 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.877186+0000", 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016915800000000001 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.877618+0000", 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043144899999999998 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.878816+0000", 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011984700000000001 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.894131+0000", 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015314876 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.894825+0000", 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00069365599999999996 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.895019+0000", 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000194441 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.895143+0000", 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012414899999999999 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1931 3.15 3:a838452a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.rt8jcH7t-Si0Elu5GsS4JhWyuPnbJ5v_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.0309226330000003, 2024-05-08T18:09:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022148926999999999, 2024-05-08T18:09:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1931 2024-05-08T18:09:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519915+0000", 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4070000000000002e-06 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523840+0000", 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00392494 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523881+0000", 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0729999999999998e-05 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523901+0000", 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9816000000000001e-05 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524034+0000", 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013357199999999999 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524297+0000", 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000262697 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524555+0000", 2024-05-08T18:09:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025802099999999999 2024-05-08T18:09:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.535170+0000", 2024-05-08T18:09:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010615528000000001 2024-05-08T18:09:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.541876+0000", 2024-05-08T18:09:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006705562 2024-05-08T18:09:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.541984+0000", 2024-05-08T18:09:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108585 2024-05-08T18:09:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.542061+0000", 2024-05-08T18:09:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6069000000000006e-05 2024-05-08T18:09:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1990 3.2d 3:b4aceac7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.34:head [create,setxattr user.rgw.idtag (61) in=14b,setxattr user.rgw.tail_tag (61) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.742290+0000", 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 3.808543974, 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023330152999999999, 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1990 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.742290+0000", 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.742290+0000", 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.742293+0000", 2024-05-08T18:09:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7369999999999998e-06 2024-05-08T18:09:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747757+0000", 2024-05-08T18:09:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054638079999999997 2024-05-08T18:09:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747799+0000", 2024-05-08T18:09:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:09:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747819+0000", 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0183e-05 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747973+0000", 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015351500000000001 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.748251+0000", 2024-05-08T18:09:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027811699999999998 2024-05-08T18:09:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.749139+0000", 2024-05-08T18:09:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00088849299999999997 2024-05-08T18:09:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.763612+0000", 2024-05-08T18:09:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014472992 2024-05-08T18:09:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.765137+0000", 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001524823 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.765399+0000", 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026171700000000002 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.765620+0000", 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000221595 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1999 3.13 3:c81aceb2:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.qFJD7RDtXlCNRHqLIdswZJm3STCASHM_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.958634+0000", 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 3.5922005260000001, 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022563374000000001, 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1999 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.958634+0000", 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.958634+0000", 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.958637+0000", 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2830000000000002e-06 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.963827+0000", 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051899609999999999 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.964764+0000", 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093745000000000005 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.964794+0000", 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.957e-05 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.965016+0000", 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000221671 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.965297+0000", 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028171000000000001 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.965547+0000", 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024940800000000001 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.979720+0000", 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01417321 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.981028+0000", 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013080489999999999 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.981129+0000", 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010111900000000001 2024-05-08T18:09:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.981197+0000", 2024-05-08T18:09:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7942999999999996e-05 2024-05-08T18:09:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2130 3.39 3:9f8cf400:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.K7V9dh3caEYHsi9YlGwMWJrNO2rnOUe_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:30.419212+0000", 2024-05-08T18:09:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.1316220130000001, 2024-05-08T18:09:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025593207999999999, 2024-05-08T18:09:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2130 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.419212+0000", 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.419212+0000", 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.419215+0000", 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0699999999999998e-06 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423670+0000", 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044546990000000003 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423704+0000", 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4329999999999998e-05 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423720+0000", 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5769000000000001e-05 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423820+0000", 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9964999999999996e-05 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423947+0000", 2024-05-08T18:09:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012709400000000001 2024-05-08T18:09:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.424047+0000", 2024-05-08T18:09:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9841999999999997e-05 2024-05-08T18:09:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.430460+0000", 2024-05-08T18:09:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064128040000000002 2024-05-08T18:09:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.444733+0000", 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014272741 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.444776+0000", 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3594000000000003e-05 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.444805+0000", 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9300000000000001e-05 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2154 3.3f 3:fcf45f1d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.qNSXsO6ho8FgR2BwOnKV1ad9WHxWBC2_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:31.002294+0000", 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.548540154, 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021215682999999999, 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2154 2024-05-08T18:09:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.002294+0000", 2024-05-08T18:09:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.002294+0000", 2024-05-08T18:09:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.002298+0000", 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3969999999999998e-06 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.008224+0000", 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059265899999999998 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.008267+0000", 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.008287+0000", 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0593000000000001e-05 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.008402+0000", 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000114269 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.008632+0000", 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023028600000000001 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.008837+0000", 2024-05-08T18:09:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020552100000000001 2024-05-08T18:09:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.021022+0000", 2024-05-08T18:09:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01218414 2024-05-08T18:09:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.023409+0000", 2024-05-08T18:09:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023870129999999999 2024-05-08T18:09:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.023456+0000", 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7852999999999997e-05 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.023510+0000", 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3338000000000003e-05 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:31.662 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.63 2024-05-08T18:09:31.662 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:31.662 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 64 2024-05-08T18:09:31.663 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:31.663 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:31.663 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.013705 s, 765 MB/s 2024-05-08T18:09:31.664 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:31.661+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:31.664 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:09:31.764 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:31.765+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:31.765 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.64 2024-05-08T18:09:31.766 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:31.766 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 65 2024-05-08T18:09:31.780 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:31.780 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:31.780 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114805 s, 913 MB/s 2024-05-08T18:09:31.802 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:31.802 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:31.802 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:31.802 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:31.816 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:09:31.865 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:31.865+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:31.885 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:09:31.906 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.65 2024-05-08T18:09:31.906 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:31.906 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 66 2024-05-08T18:09:31.918 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:31.918 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:31.918 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00946721 s, 1.1 GB/s 2024-05-08T18:09:31.943 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:31.943 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:31.943 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:31.943 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:31.943 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:31.959 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:09:31.966 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:31.965+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:32.047 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.66 2024-05-08T18:09:32.047 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:32.047 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 67 2024-05-08T18:09:32.057 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:32.057 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:32.058 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00925656 s, 1.1 GB/s 2024-05-08T18:09:32.066 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:32.065+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1221 3.20 e85/20 3:071d1257:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_5:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.530382211999999, 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019872899999999999, 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.133 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.133 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:32.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:32.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605944+0000", 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.77e-06 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612548+0000", 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066036519999999998 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612580+0000", 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1945e-05 2024-05-08T18:09:32.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612593+0000", 2024-05-08T18:09:32.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3665999999999999e-05 2024-05-08T18:09:32.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612758+0000", 2024-05-08T18:09:32.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016427600000000001 2024-05-08T18:09:32.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612832+0000", 2024-05-08T18:09:32.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4493000000000007e-05 2024-05-08T18:09:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.625728+0000", 2024-05-08T18:09:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012895471 2024-05-08T18:09:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.625815+0000", 2024-05-08T18:09:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7627000000000007e-05 2024-05-08T18:09:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1227 3.6 3:6359f987:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.452208654, 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022831489999999999, 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1227 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684119+0000", 2024-05-08T18:09:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.678e-06 2024-05-08T18:09:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687247+0000", 2024-05-08T18:09:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031279820000000001 2024-05-08T18:09:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687274+0000", 2024-05-08T18:09:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7174000000000001e-05 2024-05-08T18:09:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687289+0000", 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5364999999999999e-05 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687421+0000", 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013197999999999999 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687681+0000", 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025951099999999998 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687981+0000", 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030021799999999999 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706004+0000", 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018023441000000001 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706867+0000", 2024-05-08T18:09:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00086241200000000001 2024-05-08T18:09:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706901+0000", 2024-05-08T18:09:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4325000000000001e-05 2024-05-08T18:09:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706948+0000", 2024-05-08T18:09:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6403999999999998e-05 2024-05-08T18:09:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.142 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1246 3.6 3:6220dfe7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.775529172999999, 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020211156000000001, 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1246 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360799+0000", 2024-05-08T18:09:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4939999999999999e-06 2024-05-08T18:09:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363474+0000", 2024-05-08T18:09:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026745190000000002 2024-05-08T18:09:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363511+0000", 2024-05-08T18:09:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7722000000000002e-05 2024-05-08T18:09:32.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363528+0000", 2024-05-08T18:09:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6600999999999999e-05 2024-05-08T18:09:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363637+0000", 2024-05-08T18:09:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108855 2024-05-08T18:09:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363792+0000", 2024-05-08T18:09:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000155561 2024-05-08T18:09:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363921+0000", 2024-05-08T18:09:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128501 2024-05-08T18:09:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.378377+0000", 2024-05-08T18:09:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014456577999999999 2024-05-08T18:09:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380848+0000", 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024703329999999999 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380940+0000", 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2264999999999998e-05 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.381007+0000", 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6727e-05 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1254 3.32 3:4e133ae2:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.471375+0000", 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.664949586999999, 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019094796000000001, 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1254 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.471375+0000", 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.471375+0000", 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.471378+0000", 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4739999999999999e-06 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.475068+0000", 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036907260000000001 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.475103+0000", 2024-05-08T18:09:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4962000000000002e-05 2024-05-08T18:09:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.475127+0000", 2024-05-08T18:09:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3669e-05 2024-05-08T18:09:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.475226+0000", 2024-05-08T18:09:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9529000000000002e-05 2024-05-08T18:09:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.475399+0000", 2024-05-08T18:09:32.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172397 2024-05-08T18:09:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.475564+0000", 2024-05-08T18:09:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016564499999999999 2024-05-08T18:09:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.489014+0000", 2024-05-08T18:09:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013449416 2024-05-08T18:09:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:32.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.490200+0000", 2024-05-08T18:09:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011856659999999999 2024-05-08T18:09:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.490351+0000", 2024-05-08T18:09:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015105300000000001 2024-05-08T18:09:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.490470+0000", 2024-05-08T18:09:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119259 2024-05-08T18:09:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.154 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1255 3.12 3:48af9d8c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.654511306, 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025868088000000001, 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1255 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481816+0000", 2024-05-08T18:09:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6390000000000001e-06 2024-05-08T18:09:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484725+0000", 2024-05-08T18:09:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00290865 2024-05-08T18:09:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484750+0000", 2024-05-08T18:09:32.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5009999999999999e-05 2024-05-08T18:09:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484763+0000", 2024-05-08T18:09:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2976000000000001e-05 2024-05-08T18:09:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484848+0000", 2024-05-08T18:09:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5232e-05 2024-05-08T18:09:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.485026+0000", 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000177706 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.485186+0000", 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016076900000000001 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.491881+0000", 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066950539999999998 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507591+0000", 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015709724000000001 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507638+0000", 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6684999999999998e-05 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507681+0000", 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3643000000000002e-05 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1395 3.17 3:eb9c68a5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.363882565000001, 2024-05-08T18:09:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026590425000000001, 2024-05-08T18:09:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:32.161 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1395 2024-05-08T18:09:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772445+0000", 2024-05-08T18:09:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0970000000000002e-06 2024-05-08T18:09:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775066+0000", 2024-05-08T18:09:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026205730000000002 2024-05-08T18:09:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775101+0000", 2024-05-08T18:09:32.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4876000000000003e-05 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775116+0000", 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5566999999999999e-05 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775200+0000", 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3808999999999997e-05 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775307+0000", 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000107366 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775430+0000", 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012280599999999999 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.779395+0000", 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003964357 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.798911+0000", 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019516386 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.798982+0000", 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0759000000000005e-05 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.799033+0000", 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0828999999999997e-05 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1404 3.1b 3:d97dd5be:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.263052379000001, 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020100535999999999, 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1404 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873276+0000", 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.45e-06 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875542+0000", 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002266746 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875570+0000", 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7826000000000001e-05 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875585+0000", 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4681999999999999e-05 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875667+0000", 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2429000000000006e-05 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875833+0000", 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165959 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875991+0000", 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015766099999999999 2024-05-08T18:09:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.884154+0000", 2024-05-08T18:09:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081625329999999996 2024-05-08T18:09:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.892970+0000", 2024-05-08T18:09:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0088168540000000007 2024-05-08T18:09:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.893166+0000", 2024-05-08T18:09:32.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019573 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.893373+0000", 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020666599999999999 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1410 3.30 e87/20 3:0e0f1cce:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_16:head v 87'5, mlcod=86'3)", 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.944309+0000", 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.192015539, 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019500263, 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.944309+0000", 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.944309+0000", 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.944312+0000", 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.36e-06 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.949766+0000", 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005453042 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.949791+0000", 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5114999999999999e-05 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.949805+0000", 2024-05-08T18:09:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4511e-05 2024-05-08T18:09:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.949884+0000", 2024-05-08T18:09:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8571000000000004e-05 2024-05-08T18:09:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.949910+0000", 2024-05-08T18:09:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6239999999999999e-05 2024-05-08T18:09:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.963680+0000", 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01377025 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.963809+0000", 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012917399999999999 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1426 3.3 e87/20 3:c1fceb03:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_4:head v 87'7, mlcod=86'5)", 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.708866275999998, 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020804152999999999, 2024-05-08T18:09:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427461+0000", 2024-05-08T18:09:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.57e-06 2024-05-08T18:09:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433712+0000", 2024-05-08T18:09:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062511729999999996 2024-05-08T18:09:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433759+0000", 2024-05-08T18:09:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6397000000000003e-05 2024-05-08T18:09:32.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433779+0000", 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0196000000000001e-05 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433922+0000", 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014305599999999999 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433970+0000", 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7933000000000003e-05 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.448060+0000", 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01409064 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.448263+0000", 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020218800000000001 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1452 3.18 e87/20 3:1a3be52d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_2:head v 87'4, mlcod=86'2)", 2024-05-08T18:09:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.808319144999999, 2024-05-08T18:09:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020634468, 2024-05-08T18:09:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328008+0000", 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2589999999999999e-06 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330832+0000", 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028243719999999999 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330867+0000", 2024-05-08T18:09:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4776e-05 2024-05-08T18:09:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330883+0000", 2024-05-08T18:09:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6121999999999999e-05 2024-05-08T18:09:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.331031+0000", 2024-05-08T18:09:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148412 2024-05-08T18:09:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.331075+0000", 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3126e-05 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.348521+0000", 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017446351999999998 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.348640+0000", 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119049 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1461 3.32 3:4ca91a7f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.523055+0000", 2024-05-08T18:09:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.613269546000001, 2024-05-08T18:09:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019351531000000002, 2024-05-08T18:09:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1461 2024-05-08T18:09:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.523055+0000", 2024-05-08T18:09:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.523055+0000", 2024-05-08T18:09:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.523059+0000", 2024-05-08T18:09:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1679999999999997e-06 2024-05-08T18:09:32.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.527171+0000", 2024-05-08T18:09:32.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041119930000000004 2024-05-08T18:09:32.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.527219+0000", 2024-05-08T18:09:32.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7682000000000002e-05 2024-05-08T18:09:32.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.527240+0000", 2024-05-08T18:09:32.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1013999999999999e-05 2024-05-08T18:09:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.527409+0000", 2024-05-08T18:09:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016853699999999999 2024-05-08T18:09:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.527737+0000", 2024-05-08T18:09:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032809799999999997 2024-05-08T18:09:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:32.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.528015+0000", 2024-05-08T18:09:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027825099999999998 2024-05-08T18:09:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.538178+0000", 2024-05-08T18:09:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010163434000000001 2024-05-08T18:09:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.542251+0000", 2024-05-08T18:09:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040725659999999997 2024-05-08T18:09:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.542335+0000", 2024-05-08T18:09:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4225000000000001e-05 2024-05-08T18:09:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.542407+0000", 2024-05-08T18:09:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1563000000000006e-05 2024-05-08T18:09:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1463 3.17 3:ebd3133d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:32.190 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.562828725999999, 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023934057000000002, 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1463 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573500+0000", 2024-05-08T18:09:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7670000000000001e-06 2024-05-08T18:09:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575722+0000", 2024-05-08T18:09:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022226559999999999 2024-05-08T18:09:32.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575781+0000", 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8746999999999998e-05 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575810+0000", 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8407000000000001e-05 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575981+0000", 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017151499999999999 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.576369+0000", 2024-05-08T18:09:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038807000000000002 2024-05-08T18:09:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.576675+0000", 2024-05-08T18:09:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030572800000000001 2024-05-08T18:09:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.585475+0000", 2024-05-08T18:09:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087997630000000004 2024-05-08T18:09:32.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597202+0000", 2024-05-08T18:09:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011727849 2024-05-08T18:09:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597316+0000", 2024-05-08T18:09:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113546 2024-05-08T18:09:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597430+0000", 2024-05-08T18:09:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114009 2024-05-08T18:09:32.195 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1913 3.17 3:ea65dc81:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.vOI1jtaftCZSAcjtRhSYPcY8omHGfbO_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 6.0442242479999999, 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020076618000000001, 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1913 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092104+0000", 2024-05-08T18:09:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2279999999999998e-06 2024-05-08T18:09:32.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094163+0000", 2024-05-08T18:09:32.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020592710000000001 2024-05-08T18:09:32.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094206+0000", 2024-05-08T18:09:32.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3072999999999999e-05 2024-05-08T18:09:32.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094231+0000", 2024-05-08T18:09:32.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4819000000000001e-05 2024-05-08T18:09:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094325+0000", 2024-05-08T18:09:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4029000000000004e-05 2024-05-08T18:09:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094439+0000", 2024-05-08T18:09:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113878 2024-05-08T18:09:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094533+0000", 2024-05-08T18:09:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4733000000000003e-05 2024-05-08T18:09:32.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.099901+0000", 2024-05-08T18:09:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053678789999999999 2024-05-08T18:09:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.111944+0000", 2024-05-08T18:09:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012042855999999999 2024-05-08T18:09:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.112051+0000", 2024-05-08T18:09:32.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010673100000000001 2024-05-08T18:09:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.112177+0000", 2024-05-08T18:09:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012612100000000001 2024-05-08T18:09:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1928 3.23 3:c76f4655:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.24:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.728385222, 2024-05-08T18:09:32.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026452139, 2024-05-08T18:09:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1928 2024-05-08T18:09:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407943+0000", 2024-05-08T18:09:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4170000000000001e-06 2024-05-08T18:09:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412466+0000", 2024-05-08T18:09:32.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045230720000000004 2024-05-08T18:09:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412503+0000", 2024-05-08T18:09:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7287999999999999e-05 2024-05-08T18:09:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412520+0000", 2024-05-08T18:09:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7206000000000001e-05 2024-05-08T18:09:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412719+0000", 2024-05-08T18:09:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000198975 2024-05-08T18:09:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412989+0000", 2024-05-08T18:09:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000269256 2024-05-08T18:09:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.413870+0000", 2024-05-08T18:09:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00088159999999999996 2024-05-08T18:09:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.433846+0000", 2024-05-08T18:09:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019975822000000001 2024-05-08T18:09:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434198+0000", 2024-05-08T18:09:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035164000000000001 2024-05-08T18:09:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434318+0000", 2024-05-08T18:09:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120604 2024-05-08T18:09:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434392+0000", 2024-05-08T18:09:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3258999999999998e-05 2024-05-08T18:09:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1940 3.1f 3:fb7497ee:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.26:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.690326+0000", 2024-05-08T18:09:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.4459983970000003, 2024-05-08T18:09:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018971935999999998, 2024-05-08T18:09:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.207 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1940 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.690326+0000", 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.690326+0000", 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.690329+0000", 2024-05-08T18:09:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2260000000000001e-06 2024-05-08T18:09:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.692635+0000", 2024-05-08T18:09:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023053990000000001 2024-05-08T18:09:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.692674+0000", 2024-05-08T18:09:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9162999999999998e-05 2024-05-08T18:09:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.692693+0000", 2024-05-08T18:09:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8510000000000001e-05 2024-05-08T18:09:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.692871+0000", 2024-05-08T18:09:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017809299999999999 2024-05-08T18:09:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.693172+0000", 2024-05-08T18:09:32.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030159499999999999 2024-05-08T18:09:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.694059+0000", 2024-05-08T18:09:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00088701100000000005 2024-05-08T18:09:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.703784+0000", 2024-05-08T18:09:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0097242969999999998 2024-05-08T18:09:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.709098+0000", 2024-05-08T18:09:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053147589999999996 2024-05-08T18:09:32.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.709220+0000", 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000122027 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.709298+0000", 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7855999999999995e-05 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:2130 3.39 e93/20 3:9f8cf400:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.K7V9dh3caEYHsi9YlGwMWJrNO2rnOUe_1:head v 93'7, mlcod=90'5)", 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.428375+0000", 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.707949275, 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020125661, 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.428375+0000", 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.428375+0000", 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.428378+0000", 2024-05-08T18:09:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.96e-06 2024-05-08T18:09:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436642+0000", 2024-05-08T18:09:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0082638899999999994 2024-05-08T18:09:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436681+0000", 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8389999999999997e-05 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436705+0000", 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4049e-05 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436805+0000", 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010063100000000001 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436825+0000", 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9817e-05 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.448397+0000", 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011572086000000001 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.448501+0000", 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103838 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.216 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2139 3.3d 3:bf4c8f68:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.57:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.593560+0000", 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.5427647310000001, 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026176721999999999, 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2139 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.593560+0000", 2024-05-08T18:09:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.593560+0000", 2024-05-08T18:09:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.593564+0000", 2024-05-08T18:09:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8330000000000004e-06 2024-05-08T18:09:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597295+0000", 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037317090000000002 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597337+0000", 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1628999999999997e-05 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597356+0000", 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9079000000000001e-05 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597523+0000", 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016655500000000001 2024-05-08T18:09:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597893+0000", 2024-05-08T18:09:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037072199999999998 2024-05-08T18:09:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.598918+0000", 2024-05-08T18:09:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010249790000000001 2024-05-08T18:09:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.618213+0000", 2024-05-08T18:09:32.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019294772000000002 2024-05-08T18:09:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619538+0000", 2024-05-08T18:09:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001324424 2024-05-08T18:09:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619657+0000", 2024-05-08T18:09:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119091 2024-05-08T18:09:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619737+0000", 2024-05-08T18:09:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9929e-05 2024-05-08T18:09:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2157 3.17 3:e9343ebc:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.60:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.032761+0000", 2024-05-08T18:09:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.1035633410000001, 2024-05-08T18:09:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019666783, 2024-05-08T18:09:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.222 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2157 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.032761+0000", 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.032761+0000", 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.032764+0000", 2024-05-08T18:09:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1329999999999999e-06 2024-05-08T18:09:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035544+0000", 2024-05-08T18:09:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027793679999999999 2024-05-08T18:09:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035584+0000", 2024-05-08T18:09:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9935999999999998e-05 2024-05-08T18:09:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035602+0000", 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8496e-05 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035728+0000", 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012599200000000001 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.036019+0000", 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000290475 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.036929+0000", 2024-05-08T18:09:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091045700000000004 2024-05-08T18:09:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.049721+0000", 2024-05-08T18:09:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012791360999999999 2024-05-08T18:09:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.052216+0000", 2024-05-08T18:09:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024957619999999999 2024-05-08T18:09:32.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.052350+0000", 2024-05-08T18:09:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013327799999999999 2024-05-08T18:09:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.052428+0000", 2024-05-08T18:09:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8524999999999998e-05 2024-05-08T18:09:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.227 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2166 3.1f 3:fb9a1743:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.eyqVZ0B-P5u9ACEPSRoUzw86bQPcrsX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.348722+0000", 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.78760246899999997, 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020031361000000001, 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2166 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.348722+0000", 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.348722+0000", 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.348727+0000", 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4959999999999998e-06 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.351828+0000", 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003101786 2024-05-08T18:09:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.351865+0000", 2024-05-08T18:09:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6519000000000001e-05 2024-05-08T18:09:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.351891+0000", 2024-05-08T18:09:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6233000000000001e-05 2024-05-08T18:09:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.352076+0000", 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018498000000000001 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.352511+0000", 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043521899999999998 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.352931+0000", 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041997900000000001 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.365888+0000", 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012956578999999999 2024-05-08T18:09:32.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:32.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.368517+0000", 2024-05-08T18:09:32.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002629471 2024-05-08T18:09:32.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.368616+0000", 2024-05-08T18:09:32.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8740999999999995e-05 2024-05-08T18:09:32.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.368754+0000", 2024-05-08T18:09:32.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137358 2024-05-08T18:09:32.233 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.233 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.233 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.233 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2190 3.1 3:8364520c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.6cWLHpOdr1veoeL1lcBsJwZn6mj4f5g_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:32.233 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:32.004731+0000", 2024-05-08T18:09:32.233 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.13159368499999999, 2024-05-08T18:09:32.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024468832999999999, 2024-05-08T18:09:32.233 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:32.233 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:32.233 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:32.233 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:32.233 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:32.234 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:32.234 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2190 2024-05-08T18:09:32.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.234 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:32.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:32.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.004731+0000", 2024-05-08T18:09:32.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:32.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.004731+0000", 2024-05-08T18:09:32.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:32.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:32.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.004734+0000", 2024-05-08T18:09:32.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5299999999999999e-06 2024-05-08T18:09:32.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:32.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.006911+0000", 2024-05-08T18:09:32.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002177203 2024-05-08T18:09:32.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:32.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.006936+0000", 2024-05-08T18:09:32.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5772e-05 2024-05-08T18:09:32.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.006950+0000", 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.397e-05 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.007054+0000", 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010354200000000001 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.007233+0000", 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017882600000000001 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.007409+0000", 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000176212 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.020682+0000", 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013272894 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.029125+0000", 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084428090000000008 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.029167+0000", 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2409e-05 2024-05-08T18:09:32.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:32.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:32.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:32.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.029200+0000", 2024-05-08T18:09:32.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2666000000000002e-05 2024-05-08T18:09:32.238 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.238 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.238 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.238 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:32.238 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:32.238 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:32.240 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:09:32.240 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.67 2024-05-08T18:09:32.240 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:32.240 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 68 2024-05-08T18:09:32.240 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:32.241 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:32.241 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114244 s, 918 MB/s 2024-05-08T18:09:32.241 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:32.240+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:32.340 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:32.340+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:32.348 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:09:32.354 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.68 2024-05-08T18:09:32.354 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:32.354 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 69 2024-05-08T18:09:32.366 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:32.366 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:32.366 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0100884 s, 1.0 GB/s 2024-05-08T18:09:32.417 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:32.417 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:32.417 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:32.438 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:09:32.475 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.69 2024-05-08T18:09:32.475 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:32.475 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 70 2024-05-08T18:09:32.475 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:32.476+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:32.488 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:32.488 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:32.489 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120024 s, 874 MB/s 2024-05-08T18:09:32.504 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:32.504 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:32.523 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:32.523 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:32.542 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:32.541+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:32.543 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:32.543 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:32.561 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:32.561 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:32.583 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:32.583 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:32.596 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.70 2024-05-08T18:09:32.596 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:32.596 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 71 2024-05-08T18:09:32.604 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:32.604 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:32.605 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:32.605 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:32.607 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:32.607 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:32.608 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00998578 s, 1.1 GB/s 2024-05-08T18:09:32.624 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:09:32.626 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:32.626 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:32.643 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:32.641+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:32.648 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:32.648 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:32.713 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.71 2024-05-08T18:09:32.713 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:32.713 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 72 2024-05-08T18:09:32.724 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:32.724 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:32.724 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00917097 s, 1.1 GB/s 2024-05-08T18:09:32.743 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:32.744+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:32.751 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:32.751 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:32.769 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:09:32.824 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.72 2024-05-08T18:09:32.824 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:32.824 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 73 2024-05-08T18:09:32.835 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:32.835 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:32.835 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00937972 s, 1.1 GB/s 2024-05-08T18:09:32.840 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-05-08T18:09:32.847 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:32.844+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:32.944 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:32.944+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:32.946 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.73 2024-05-08T18:09:32.946 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:32.946 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 74 2024-05-08T18:09:32.949 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:32.949 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:32.957 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:32.957 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:32.957 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00933695 s, 1.1 GB/s 2024-05-08T18:09:32.965 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:09:33.045 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:33.045+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:33.065 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.74 2024-05-08T18:09:33.065 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:33.065 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 75 2024-05-08T18:09:33.076 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:33.077 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:33.077 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101285 s, 1.0 GB/s 2024-05-08T18:09:33.135 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:33.136 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:33.146 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:33.148+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:33.156 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:09:33.184 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.75 2024-05-08T18:09:33.184 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:33.184 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 76 2024-05-08T18:09:33.210 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:33.210 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:33.210 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00996036 s, 1.1 GB/s 2024-05-08T18:09:33.247 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:33.245+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:33.311 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:33.311 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:33.326 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:09:33.347 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.76 2024-05-08T18:09:33.347 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:33.347 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 77 2024-05-08T18:09:33.347 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:33.345+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:33.359 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:33.359 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:33.359 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0096225 s, 1.1 GB/s 2024-05-08T18:09:33.448 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:33.449+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:33.478 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.77 2024-05-08T18:09:33.478 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:33.478 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 78 2024-05-08T18:09:33.479 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:33.479 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:33.490 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:33.490 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:33.490 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101671 s, 1.0 GB/s 2024-05-08T18:09:33.496 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:09:33.585 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:33.588+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:33.623 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.78 2024-05-08T18:09:33.623 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:33.623 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 79 2024-05-08T18:09:33.635 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:33.635 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:33.635 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0104252 s, 1.0 GB/s 2024-05-08T18:09:33.649 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:33.648+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:33.673 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:33.673 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:33.693 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:09:33.760 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.79 2024-05-08T18:09:33.760 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:33.760 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 80 2024-05-08T18:09:33.761 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:33.760+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:33.772 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:33.773 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:33.773 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0102506 s, 1.0 GB/s 2024-05-08T18:09:33.851 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:33.849+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:33.893 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:33.893 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:33.900 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.80 2024-05-08T18:09:33.901 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:33.901 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 81 2024-05-08T18:09:33.908 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:09:33.915 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:33.916 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:33.916 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122496 s, 856 MB/s 2024-05-08T18:09:33.956 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:33.957+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:34.012 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.81 2024-05-08T18:09:34.012 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:34.012 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 82 2024-05-08T18:09:34.024 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:34.024 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:34.024 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0100203 s, 1.0 GB/s 2024-05-08T18:09:34.043 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:34.043 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:34.058 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:09:34.061 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:34.060+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:34.142 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.82 2024-05-08T18:09:34.142 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:34.142 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 83 2024-05-08T18:09:34.153 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:34.153+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:34.154 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:34.155 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:34.155 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.010965 s, 956 MB/s 2024-05-08T18:09:34.233 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:34.233 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:34.247 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:09:34.267 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.83 2024-05-08T18:09:34.267 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:34.267 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 84 2024-05-08T18:09:34.282 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:34.282 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:34.282 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124828 s, 840 MB/s 2024-05-08T18:09:34.292 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:34.293+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:34.355 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:34.353+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:34.404 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.84 2024-05-08T18:09:34.404 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:34.404 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 85 2024-05-08T18:09:34.417 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:34.417 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:34.417 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111489 s, 941 MB/s 2024-05-08T18:09:34.425 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:34.425 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:34.439 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:09:34.484 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:34.485+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:34.549 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.85 2024-05-08T18:09:34.549 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:34.549 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 86 2024-05-08T18:09:34.557 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:34.556+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:34.565 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:34.565 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:34.565 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0129154 s, 812 MB/s 2024-05-08T18:09:34.612 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:34.612 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:34.626 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:09:34.657 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:34.660+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:34.672 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:09:34.707 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.86 2024-05-08T18:09:34.707 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:34.707 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 87 2024-05-08T18:09:34.719 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:34.719 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:34.719 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0103954 s, 1.0 GB/s 2024-05-08T18:09:34.757 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:34.757 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:34.758 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:34.757+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:34.771 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:09:34.826 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:34.826 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:34.842 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.87 2024-05-08T18:09:34.842 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:34.842 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 88 2024-05-08T18:09:34.843 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:34.843 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:34.852 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:34.853 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:34.853 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00907484 s, 1.2 GB/s 2024-05-08T18:09:34.859 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:34.860+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:34.865 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:34.865 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:34.869 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:09:34.898 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:34.898 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:34.928 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:34.928 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:34.946 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:34.946 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:34.959 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:34.960+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:34.960 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:09:34.965 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:34.965 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:34.965 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.88 2024-05-08T18:09:34.966 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:34.966 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 89 2024-05-08T18:09:34.978 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:34.978 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:34.978 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.010238 s, 1.0 GB/s 2024-05-08T18:09:34.984 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:35.016 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:35.016 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:35.078 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.89 2024-05-08T18:09:35.078 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:35.078 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 90 2024-05-08T18:09:35.079 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:35.080+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:35.089 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:35.089 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:35.089 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00924491 s, 1.1 GB/s 2024-05-08T18:09:35.089 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:35.090 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:35.090 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:35.090 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:35.103 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:09:35.119 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-08T18:09:35.119 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-08T18:09:35.119 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-05-08T18:09:35.119 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-05-08T18:09:35.165 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:35.168+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:35.186 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.90 2024-05-08T18:09:35.186 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:35.186 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 91 2024-05-08T18:09:35.197 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:35.197 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:35.197 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00952819 s, 1.1 GB/s 2024-05-08T18:09:35.222 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:35.222 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:35.222 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:35.222 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:35.222 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:35.236 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:09:35.262 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:35.264+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:35.286 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.91 2024-05-08T18:09:35.286 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:35.286 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 92 2024-05-08T18:09:35.296 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:35.296 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:35.296 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00891165 s, 1.2 GB/s 2024-05-08T18:09:35.362 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:35.364+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:35.370 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:35.370 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:35.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:35.370 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:35.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.370 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:09:35.370 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:35.370 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 131.83461245999999, 2024-05-08T18:09:35.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.032012946, 2024-05-08T18:09:35.370 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.370 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.371 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.371 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.371 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.371 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.371 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:09:35.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.371 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:35.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:35.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535484+0000", 2024-05-08T18:09:35.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7929999999999999e-06 2024-05-08T18:09:35.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535500+0000", 2024-05-08T18:09:35.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5226e-05 2024-05-08T18:09:35.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535535+0000", 2024-05-08T18:09:35.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5213000000000003e-05 2024-05-08T18:09:35.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535564+0000", 2024-05-08T18:09:35.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9360999999999999e-05 2024-05-08T18:09:35.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535757+0000", 2024-05-08T18:09:35.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000193229 2024-05-08T18:09:35.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:35.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535775+0000", 2024-05-08T18:09:35.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7098000000000001e-05 2024-05-08T18:09:35.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556004+0000", 2024-05-08T18:09:35.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020229068999999999 2024-05-08T18:09:35.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:35.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556036+0000", 2024-05-08T18:09:35.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1943000000000002e-05 2024-05-08T18:09:35.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.564721+0000", 2024-05-08T18:09:35.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086853320000000005 2024-05-08T18:09:35.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565032+0000", 2024-05-08T18:09:35.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031121799999999999 2024-05-08T18:09:35.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:35.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565365+0000", 2024-05-08T18:09:35.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000332744 2024-05-08T18:09:35.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567305+0000", 2024-05-08T18:09:35.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00194016 2024-05-08T18:09:35.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567368+0000", 2024-05-08T18:09:35.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3342000000000004e-05 2024-05-08T18:09:35.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567433+0000", 2024-05-08T18:09:35.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4726000000000003e-05 2024-05-08T18:09:35.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567494+0000", 2024-05-08T18:09:35.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0492000000000003e-05 2024-05-08T18:09:35.377 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.377 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.377 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.377 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1189 3.20 3:054e8a9f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:35.377 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:35.377 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 28.409923054, 2024-05-08T18:09:35.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025093629999999999, 2024-05-08T18:09:35.378 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.378 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.378 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.378 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.378 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.378 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.378 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1189 2024-05-08T18:09:35.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.378 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:35.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:35.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960173+0000", 2024-05-08T18:09:35.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.65e-06 2024-05-08T18:09:35.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965720+0000", 2024-05-08T18:09:35.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055476340000000001 2024-05-08T18:09:35.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965757+0000", 2024-05-08T18:09:35.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6223000000000002e-05 2024-05-08T18:09:35.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965774+0000", 2024-05-08T18:09:35.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6952999999999998e-05 2024-05-08T18:09:35.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965930+0000", 2024-05-08T18:09:35.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015611800000000001 2024-05-08T18:09:35.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966190+0000", 2024-05-08T18:09:35.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025999399999999999 2024-05-08T18:09:35.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:35.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966440+0000", 2024-05-08T18:09:35.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025007600000000001 2024-05-08T18:09:35.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981042+0000", 2024-05-08T18:09:35.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01460257 2024-05-08T18:09:35.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.984969+0000", 2024-05-08T18:09:35.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039265159999999997 2024-05-08T18:09:35.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985135+0000", 2024-05-08T18:09:35.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016630400000000001 2024-05-08T18:09:35.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985264+0000", 2024-05-08T18:09:35.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012859199999999999 2024-05-08T18:09:35.383 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.383 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.383 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.383 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1209 3.35 3:af4c6abe:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:35.383 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:35.383 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 28.194661407000002, 2024-05-08T18:09:35.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027313356, 2024-05-08T18:09:35.384 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.384 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.384 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.384 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.384 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.384 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.384 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1209 2024-05-08T18:09:35.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.384 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:35.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:35.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175436+0000", 2024-05-08T18:09:35.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3800000000000004e-06 2024-05-08T18:09:35.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179472+0000", 2024-05-08T18:09:35.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040357020000000004 2024-05-08T18:09:35.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179515+0000", 2024-05-08T18:09:35.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2988999999999998e-05 2024-05-08T18:09:35.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179534+0000", 2024-05-08T18:09:35.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8743e-05 2024-05-08T18:09:35.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179673+0000", 2024-05-08T18:09:35.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013983800000000001 2024-05-08T18:09:35.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179933+0000", 2024-05-08T18:09:35.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025967999999999998 2024-05-08T18:09:35.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:35.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180161+0000", 2024-05-08T18:09:35.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022826300000000001 2024-05-08T18:09:35.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.200613+0000", 2024-05-08T18:09:35.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020451766999999999 2024-05-08T18:09:35.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202567+0000", 2024-05-08T18:09:35.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019541160000000001 2024-05-08T18:09:35.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202665+0000", 2024-05-08T18:09:35.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8055999999999998e-05 2024-05-08T18:09:35.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202745+0000", 2024-05-08T18:09:35.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9821999999999996e-05 2024-05-08T18:09:35.389 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.389 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.389 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.389 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1221 3.20 3:071d1257:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:35.389 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:35.389 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 27.775346532, 2024-05-08T18:09:35.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02822473, 2024-05-08T18:09:35.389 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.389 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.389 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.389 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.389 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.390 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.390 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1221 2024-05-08T18:09:35.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.390 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:35.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:35.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594751+0000", 2024-05-08T18:09:35.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3769999999999998e-06 2024-05-08T18:09:35.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600627+0000", 2024-05-08T18:09:35.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058764389999999998 2024-05-08T18:09:35.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600672+0000", 2024-05-08T18:09:35.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4805999999999998e-05 2024-05-08T18:09:35.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600704+0000", 2024-05-08T18:09:35.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2026000000000001e-05 2024-05-08T18:09:35.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600884+0000", 2024-05-08T18:09:35.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000179385 2024-05-08T18:09:35.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601296+0000", 2024-05-08T18:09:35.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041257400000000002 2024-05-08T18:09:35.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:35.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601742+0000", 2024-05-08T18:09:35.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044585399999999998 2024-05-08T18:09:35.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.617360+0000", 2024-05-08T18:09:35.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015617982000000001 2024-05-08T18:09:35.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622618+0000", 2024-05-08T18:09:35.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052577420000000001 2024-05-08T18:09:35.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622835+0000", 2024-05-08T18:09:35.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021674699999999999 2024-05-08T18:09:35.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622971+0000", 2024-05-08T18:09:35.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679799999999999 2024-05-08T18:09:35.394 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.394 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.394 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.394 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1275 3.33 e85/20 3:ccdf9558:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_3:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:35.394 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:35.394 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.316503495999999, 2024-05-08T18:09:35.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020251129, 2024-05-08T18:09:35.395 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.395 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.395 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.395 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:35.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:35.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053592+0000", 2024-05-08T18:09:35.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5189999999999999e-06 2024-05-08T18:09:35.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059662+0000", 2024-05-08T18:09:35.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060699289999999999 2024-05-08T18:09:35.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059680+0000", 2024-05-08T18:09:35.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7558999999999999e-05 2024-05-08T18:09:35.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059689+0000", 2024-05-08T18:09:35.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2320000000000007e-06 2024-05-08T18:09:35.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059826+0000", 2024-05-08T18:09:35.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136792 2024-05-08T18:09:35.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059867+0000", 2024-05-08T18:09:35.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1689e-05 2024-05-08T18:09:35.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073728+0000", 2024-05-08T18:09:35.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01386104 2024-05-08T18:09:35.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073841+0000", 2024-05-08T18:09:35.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011236899999999999 2024-05-08T18:09:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1286 3.20 3:07ccb256:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.165808882, 2024-05-08T18:09:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022546805999999999, 2024-05-08T18:09:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.400 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1286 2024-05-08T18:09:35.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.401 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:35.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:35.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204287+0000", 2024-05-08T18:09:35.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8880000000000001e-06 2024-05-08T18:09:35.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208135+0000", 2024-05-08T18:09:35.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038480960000000001 2024-05-08T18:09:35.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208158+0000", 2024-05-08T18:09:35.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-05 2024-05-08T18:09:35.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208172+0000", 2024-05-08T18:09:35.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:09:35.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208251+0000", 2024-05-08T18:09:35.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8863999999999996e-05 2024-05-08T18:09:35.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208387+0000", 2024-05-08T18:09:35.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013615099999999999 2024-05-08T18:09:35.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:35.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208488+0000", 2024-05-08T18:09:35.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101366 2024-05-08T18:09:35.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.214533+0000", 2024-05-08T18:09:35.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060444829999999998 2024-05-08T18:09:35.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226742+0000", 2024-05-08T18:09:35.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012208798 2024-05-08T18:09:35.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226792+0000", 2024-05-08T18:09:35.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0565999999999997e-05 2024-05-08T18:09:35.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226831+0000", 2024-05-08T18:09:35.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8816999999999998e-05 2024-05-08T18:09:35.405 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.405 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.405 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.405 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1397 3.34 e87/20 3:2c6418f0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_3:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:35.405 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:35.405 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.567376892999999, 2024-05-08T18:09:35.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019946450000000001, 2024-05-08T18:09:35.406 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.406 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.406 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.406 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:35.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:35.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802717+0000", 2024-05-08T18:09:35.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0400000000000005e-07 2024-05-08T18:09:35.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807936+0000", 2024-05-08T18:09:35.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052192489999999996 2024-05-08T18:09:35.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807971+0000", 2024-05-08T18:09:35.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4517000000000002e-05 2024-05-08T18:09:35.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807993+0000", 2024-05-08T18:09:35.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2463000000000002e-05 2024-05-08T18:09:35.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.808151+0000", 2024-05-08T18:09:35.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015751400000000001 2024-05-08T18:09:35.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.808197+0000", 2024-05-08T18:09:35.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6637000000000001e-05 2024-05-08T18:09:35.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822537+0000", 2024-05-08T18:09:35.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014339607000000001 2024-05-08T18:09:35.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822663+0000", 2024-05-08T18:09:35.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125659 2024-05-08T18:09:35.409 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.409 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.409 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.409 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1399 3.2c 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:35.409 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:35.409 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.550665362, 2024-05-08T18:09:35.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030683200000000001, 2024-05-08T18:09:35.410 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.410 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.410 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.410 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.410 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.410 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.410 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1399 2024-05-08T18:09:35.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.410 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:35.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:35.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819432+0000", 2024-05-08T18:09:35.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7759999999999999e-06 2024-05-08T18:09:35.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825021+0000", 2024-05-08T18:09:35.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055895859999999997 2024-05-08T18:09:35.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825052+0000", 2024-05-08T18:09:35.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1047000000000003e-05 2024-05-08T18:09:35.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825068+0000", 2024-05-08T18:09:35.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6138999999999999e-05 2024-05-08T18:09:35.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825218+0000", 2024-05-08T18:09:35.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014997200000000001 2024-05-08T18:09:35.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825490+0000", 2024-05-08T18:09:35.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000271446 2024-05-08T18:09:35.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:35.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825710+0000", 2024-05-08T18:09:35.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220354 2024-05-08T18:09:35.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.839642+0000", 2024-05-08T18:09:35.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013932363 2024-05-08T18:09:35.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849813+0000", 2024-05-08T18:09:35.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010170461 2024-05-08T18:09:35.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849981+0000", 2024-05-08T18:09:35.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016776399999999999 2024-05-08T18:09:35.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.850111+0000", 2024-05-08T18:09:35.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013029200000000001 2024-05-08T18:09:35.415 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.415 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.415 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.415 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1406 3.20 3:05e3d3c1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:35.416 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:35.416 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.481094250999998, 2024-05-08T18:09:35.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022642778999999998, 2024-05-08T18:09:35.416 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.416 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.416 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.416 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.416 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.416 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.416 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1406 2024-05-08T18:09:35.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.416 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:35.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:35.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.889003+0000", 2024-05-08T18:09:35.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8670000000000004e-06 2024-05-08T18:09:35.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893237+0000", 2024-05-08T18:09:35.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042339999999999999 2024-05-08T18:09:35.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893279+0000", 2024-05-08T18:09:35.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2225999999999999e-05 2024-05-08T18:09:35.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893305+0000", 2024-05-08T18:09:35.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.618e-05 2024-05-08T18:09:35.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893479+0000", 2024-05-08T18:09:35.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017357700000000001 2024-05-08T18:09:35.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893736+0000", 2024-05-08T18:09:35.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025701700000000001 2024-05-08T18:09:35.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:35.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893993+0000", 2024-05-08T18:09:35.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025750700000000003 2024-05-08T18:09:35.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904227+0000", 2024-05-08T18:09:35.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010234073 2024-05-08T18:09:35.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911471+0000", 2024-05-08T18:09:35.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0072441909999999997 2024-05-08T18:09:35.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911567+0000", 2024-05-08T18:09:35.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5685000000000003e-05 2024-05-08T18:09:35.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911642+0000", 2024-05-08T18:09:35.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4456000000000007e-05 2024-05-08T18:09:35.421 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.421 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.421 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.421 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1416 3.2c 3:345ebd70:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:35.421 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:35.421 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.373723045999999, 2024-05-08T18:09:35.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027523229999999999, 2024-05-08T18:09:35.421 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.421 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.421 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1416 2024-05-08T18:09:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:35.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996374+0000", 2024-05-08T18:09:35.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.506e-06 2024-05-08T18:09:35.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000305+0000", 2024-05-08T18:09:35.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003931197 2024-05-08T18:09:35.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000346+0000", 2024-05-08T18:09:35.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1396000000000001e-05 2024-05-08T18:09:35.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000364+0000", 2024-05-08T18:09:35.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.806e-05 2024-05-08T18:09:35.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000490+0000", 2024-05-08T18:09:35.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012581800000000001 2024-05-08T18:09:35.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000755+0000", 2024-05-08T18:09:35.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026484700000000002 2024-05-08T18:09:35.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:35.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000992+0000", 2024-05-08T18:09:35.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023701700000000001 2024-05-08T18:09:35.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010465+0000", 2024-05-08T18:09:35.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094726429999999993 2024-05-08T18:09:35.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023679+0000", 2024-05-08T18:09:35.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013214105 2024-05-08T18:09:35.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023776+0000", 2024-05-08T18:09:35.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7258999999999998e-05 2024-05-08T18:09:35.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023893+0000", 2024-05-08T18:09:35.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117382 2024-05-08T18:09:35.426 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1451 3.36 3:6da4b5f8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.073050413000001, 2024-05-08T18:09:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022119236, 2024-05-08T18:09:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1451 2024-05-08T18:09:35.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.428 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:35.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:35.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297046+0000", 2024-05-08T18:09:35.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6030000000000001e-06 2024-05-08T18:09:35.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301125+0000", 2024-05-08T18:09:35.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004079058 2024-05-08T18:09:35.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301163+0000", 2024-05-08T18:09:35.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7286000000000002e-05 2024-05-08T18:09:35.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301181+0000", 2024-05-08T18:09:35.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.844e-05 2024-05-08T18:09:35.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301325+0000", 2024-05-08T18:09:35.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144284 2024-05-08T18:09:35.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301602+0000", 2024-05-08T18:09:35.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027665399999999998 2024-05-08T18:09:35.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:35.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301835+0000", 2024-05-08T18:09:35.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023292699999999999 2024-05-08T18:09:35.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.318166+0000", 2024-05-08T18:09:35.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016331061000000001 2024-05-08T18:09:35.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.318991+0000", 2024-05-08T18:09:35.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000825427 2024-05-08T18:09:35.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.319082+0000", 2024-05-08T18:09:35.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0743999999999997e-05 2024-05-08T18:09:35.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.319162+0000", 2024-05-08T18:09:35.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9752000000000005e-05 2024-05-08T18:09:35.432 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.432 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.432 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.432 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1471 3.26 3:6495ae89:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:35.432 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:35.432 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.673446192, 2024-05-08T18:09:35.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022361453, 2024-05-08T18:09:35.432 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.432 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.432 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.432 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.433 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.433 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.433 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1471 2024-05-08T18:09:35.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.433 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:35.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:35.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696650+0000", 2024-05-08T18:09:35.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8839999999999998e-06 2024-05-08T18:09:35.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700528+0000", 2024-05-08T18:09:35.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038783390000000002 2024-05-08T18:09:35.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700554+0000", 2024-05-08T18:09:35.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6106e-05 2024-05-08T18:09:35.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700566+0000", 2024-05-08T18:09:35.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2021000000000001e-05 2024-05-08T18:09:35.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700682+0000", 2024-05-08T18:09:35.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115457 2024-05-08T18:09:35.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700951+0000", 2024-05-08T18:09:35.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026891699999999997 2024-05-08T18:09:35.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:35.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.701210+0000", 2024-05-08T18:09:35.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000259017 2024-05-08T18:09:35.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718848+0000", 2024-05-08T18:09:35.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017638132000000001 2024-05-08T18:09:35.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718917+0000", 2024-05-08T18:09:35.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9564e-05 2024-05-08T18:09:35.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718968+0000", 2024-05-08T18:09:35.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1028e-05 2024-05-08T18:09:35.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.719008+0000", 2024-05-08T18:09:35.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9987999999999997e-05 2024-05-08T18:09:35.437 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.437 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.437 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.437 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1669 3.2c 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-05-08T18:09:35.437 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:35.437 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 17.570181088999998, 2024-05-08T18:09:35.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020235185999999999, 2024-05-08T18:09:35.438 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.438 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.438 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-05-08T18:09:35.438 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.438 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.438 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.438 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1669 2024-05-08T18:09:35.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.438 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:35.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:35.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799916+0000", 2024-05-08T18:09:35.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7730000000000001e-06 2024-05-08T18:09:35.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799931+0000", 2024-05-08T18:09:35.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5227e-05 2024-05-08T18:09:35.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799969+0000", 2024-05-08T18:09:35.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7883000000000003e-05 2024-05-08T18:09:35.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799986+0000", 2024-05-08T18:09:35.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6728999999999999e-05 2024-05-08T18:09:35.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.800123+0000", 2024-05-08T18:09:35.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013784600000000001 2024-05-08T18:09:35.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:35.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.800135+0000", 2024-05-08T18:09:35.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1336e-05 2024-05-08T18:09:35.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.805653+0000", 2024-05-08T18:09:35.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055179890000000001 2024-05-08T18:09:35.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.805876+0000", 2024-05-08T18:09:35.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022279 2024-05-08T18:09:35.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.820147+0000", 2024-05-08T18:09:35.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014271613000000001 2024-05-08T18:09:35.442 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.442 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.442 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.443 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1910 3.a 3:537830e8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.21:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:35.443 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:25.987700+0000", 2024-05-08T18:09:35.443 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.3823932669999994, 2024-05-08T18:09:35.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020512796999999999, 2024-05-08T18:09:35.443 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.443 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.443 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.443 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.443 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.443 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.443 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1910 2024-05-08T18:09:35.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.443 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.987700+0000", 2024-05-08T18:09:35.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.987700+0000", 2024-05-08T18:09:35.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.987703+0000", 2024-05-08T18:09:35.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1130000000000001e-06 2024-05-08T18:09:35.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991635+0000", 2024-05-08T18:09:35.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039315579999999999 2024-05-08T18:09:35.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991673+0000", 2024-05-08T18:09:35.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8550000000000002e-05 2024-05-08T18:09:35.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991691+0000", 2024-05-08T18:09:35.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.768e-05 2024-05-08T18:09:35.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991796+0000", 2024-05-08T18:09:35.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105474 2024-05-08T18:09:35.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.992021+0000", 2024-05-08T18:09:35.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022432999999999999 2024-05-08T18:09:35.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:35.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.992664+0000", 2024-05-08T18:09:35.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064343099999999997 2024-05-08T18:09:35.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.004478+0000", 2024-05-08T18:09:35.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011814069 2024-05-08T18:09:35.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.008061+0000", 2024-05-08T18:09:35.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035826289999999999 2024-05-08T18:09:35.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.008129+0000", 2024-05-08T18:09:35.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8734999999999998e-05 2024-05-08T18:09:35.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.008213+0000", 2024-05-08T18:09:35.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3227999999999997e-05 2024-05-08T18:09:35.447 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.447 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.448 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.448 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1937 3.35 3:afad9b8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.kKJI4mkViIqglOaR5LKVFjY-f90axEe_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:35.448 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:26.656524+0000", 2024-05-08T18:09:35.448 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.7135688929999997, 2024-05-08T18:09:35.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025036721000000001, 2024-05-08T18:09:35.448 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.448 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.448 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.448 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.448 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.448 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.448 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1937 2024-05-08T18:09:35.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.449 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.656524+0000", 2024-05-08T18:09:35.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.656524+0000", 2024-05-08T18:09:35.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.656528+0000", 2024-05-08T18:09:35.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7469999999999999e-06 2024-05-08T18:09:35.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.661958+0000", 2024-05-08T18:09:35.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054303229999999999 2024-05-08T18:09:35.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.662000+0000", 2024-05-08T18:09:35.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1412999999999998e-05 2024-05-08T18:09:35.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.662018+0000", 2024-05-08T18:09:35.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8162999999999999e-05 2024-05-08T18:09:35.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.662193+0000", 2024-05-08T18:09:35.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000175518 2024-05-08T18:09:35.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.662674+0000", 2024-05-08T18:09:35.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048055800000000002 2024-05-08T18:09:35.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:35.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.663088+0000", 2024-05-08T18:09:35.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041393799999999998 2024-05-08T18:09:35.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.680805+0000", 2024-05-08T18:09:35.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017716942999999999 2024-05-08T18:09:35.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.681387+0000", 2024-05-08T18:09:35.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00058174300000000002 2024-05-08T18:09:35.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.681483+0000", 2024-05-08T18:09:35.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6168999999999994e-05 2024-05-08T18:09:35.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.681561+0000", 2024-05-08T18:09:35.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8206000000000003e-05 2024-05-08T18:09:35.453 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.453 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.453 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.453 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1951 3.26 3:66b697c3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.seZFA2ZEY-Crt1uNfyqRLzirbZGBgqA_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:35.453 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:26.935268+0000", 2024-05-08T18:09:35.453 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.4348249919999994, 2024-05-08T18:09:35.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021970598000000001, 2024-05-08T18:09:35.453 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.453 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.454 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.454 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.454 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.454 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.454 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1951 2024-05-08T18:09:35.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.454 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.935268+0000", 2024-05-08T18:09:35.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.935268+0000", 2024-05-08T18:09:35.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.935271+0000", 2024-05-08T18:09:35.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.943e-06 2024-05-08T18:09:35.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939177+0000", 2024-05-08T18:09:35.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039056239999999999 2024-05-08T18:09:35.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939217+0000", 2024-05-08T18:09:35.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0639000000000002e-05 2024-05-08T18:09:35.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939236+0000", 2024-05-08T18:09:35.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8580000000000002e-05 2024-05-08T18:09:35.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939315+0000", 2024-05-08T18:09:35.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9297999999999999e-05 2024-05-08T18:09:35.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939427+0000", 2024-05-08T18:09:35.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000111999 2024-05-08T18:09:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939520+0000", 2024-05-08T18:09:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2717e-05 2024-05-08T18:09:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.956451+0000", 2024-05-08T18:09:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016931531999999999 2024-05-08T18:09:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.957119+0000", 2024-05-08T18:09:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00066793099999999997 2024-05-08T18:09:35.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.957190+0000", 2024-05-08T18:09:35.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0894000000000003e-05 2024-05-08T18:09:35.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.957239+0000", 2024-05-08T18:09:35.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8440999999999999e-05 2024-05-08T18:09:35.458 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.458 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.458 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.459 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1978 3.20 3:06c7576f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.32:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:35.459 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.490306+0000", 2024-05-08T18:09:35.459 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 7.8797868119999999, 2024-05-08T18:09:35.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022573467999999999, 2024-05-08T18:09:35.459 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.459 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.459 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.459 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.459 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.459 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.459 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1978 2024-05-08T18:09:35.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.459 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.490306+0000", 2024-05-08T18:09:35.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.490306+0000", 2024-05-08T18:09:35.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.490308+0000", 2024-05-08T18:09:35.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1440000000000001e-06 2024-05-08T18:09:35.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.494869+0000", 2024-05-08T18:09:35.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045608669999999997 2024-05-08T18:09:35.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.494904+0000", 2024-05-08T18:09:35.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4313000000000002e-05 2024-05-08T18:09:35.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.494924+0000", 2024-05-08T18:09:35.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0322999999999998e-05 2024-05-08T18:09:35.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.495122+0000", 2024-05-08T18:09:35.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019849700000000001 2024-05-08T18:09:35.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.495386+0000", 2024-05-08T18:09:35.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026385100000000001 2024-05-08T18:09:35.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:35.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.496266+0000", 2024-05-08T18:09:35.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000880184 2024-05-08T18:09:35.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.505362+0000", 2024-05-08T18:09:35.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0090952729999999992 2024-05-08T18:09:35.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.512528+0000", 2024-05-08T18:09:35.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00716593 2024-05-08T18:09:35.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.512736+0000", 2024-05-08T18:09:35.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020801399999999999 2024-05-08T18:09:35.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.512880+0000", 2024-05-08T18:09:35.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144072 2024-05-08T18:09:35.464 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.464 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.464 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.464 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1981 3.10 3:0ac06fda:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.G5bm6z3gJ2RUQJmZVjgkH_wtdE6Lk0X_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:35.464 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.593918+0000", 2024-05-08T18:09:35.464 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 7.7761751490000002, 2024-05-08T18:09:35.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.03011194, 2024-05-08T18:09:35.464 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.464 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.464 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.465 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.465 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.465 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.465 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1981 2024-05-08T18:09:35.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.465 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.593918+0000", 2024-05-08T18:09:35.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.593918+0000", 2024-05-08T18:09:35.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.593921+0000", 2024-05-08T18:09:35.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.886e-06 2024-05-08T18:09:35.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601287+0000", 2024-05-08T18:09:35.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073666119999999998 2024-05-08T18:09:35.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601352+0000", 2024-05-08T18:09:35.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4949000000000004e-05 2024-05-08T18:09:35.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601387+0000", 2024-05-08T18:09:35.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4422999999999999e-05 2024-05-08T18:09:35.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601621+0000", 2024-05-08T18:09:35.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000234317 2024-05-08T18:09:35.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601892+0000", 2024-05-08T18:09:35.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027052000000000001 2024-05-08T18:09:35.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:35.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.602131+0000", 2024-05-08T18:09:35.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023928799999999999 2024-05-08T18:09:35.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.613758+0000", 2024-05-08T18:09:35.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011626745000000001 2024-05-08T18:09:35.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.623860+0000", 2024-05-08T18:09:35.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010102709 2024-05-08T18:09:35.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.623958+0000", 2024-05-08T18:09:35.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8076000000000001e-05 2024-05-08T18:09:35.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.624030+0000", 2024-05-08T18:09:35.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1415000000000007e-05 2024-05-08T18:09:35.470 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.470 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.470 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.470 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1982 3.2c 3:37eb8330:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.G5bm6z3gJ2RUQJmZVjgkH_wtdE6Lk0X_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:35.470 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.601454+0000", 2024-05-08T18:09:35.470 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 7.7686395099999999, 2024-05-08T18:09:35.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022793639000000001, 2024-05-08T18:09:35.471 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.471 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.471 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.471 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.471 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.471 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.471 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1982 2024-05-08T18:09:35.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.471 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601454+0000", 2024-05-08T18:09:35.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601454+0000", 2024-05-08T18:09:35.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601456+0000", 2024-05-08T18:09:35.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8669999999999998e-06 2024-05-08T18:09:35.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.604859+0000", 2024-05-08T18:09:35.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034024260000000001 2024-05-08T18:09:35.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.604906+0000", 2024-05-08T18:09:35.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7092999999999998e-05 2024-05-08T18:09:35.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.604923+0000", 2024-05-08T18:09:35.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.662e-05 2024-05-08T18:09:35.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.605130+0000", 2024-05-08T18:09:35.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020757100000000001 2024-05-08T18:09:35.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.605526+0000", 2024-05-08T18:09:35.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039611600000000001 2024-05-08T18:09:35.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:35.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.605857+0000", 2024-05-08T18:09:35.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033062 2024-05-08T18:09:35.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.621816+0000", 2024-05-08T18:09:35.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015958882000000001 2024-05-08T18:09:35.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.623918+0000", 2024-05-08T18:09:35.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021022340000000001 2024-05-08T18:09:35.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.624122+0000", 2024-05-08T18:09:35.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020434500000000001 2024-05-08T18:09:35.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.624247+0000", 2024-05-08T18:09:35.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486499999999999 2024-05-08T18:09:35.476 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.476 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.476 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.476 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2208 3.10 3:08359eaa:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.JvpG1UkgF07tjBx14bFPyAh6Qi9W8uk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:35.476 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:32.430144+0000", 2024-05-08T18:09:35.476 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 2.9399487880000001, 2024-05-08T18:09:35.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022193701, 2024-05-08T18:09:35.476 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.476 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.476 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:35.476 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.477 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.477 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.477 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2208 2024-05-08T18:09:35.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.477 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.430144+0000", 2024-05-08T18:09:35.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.430144+0000", 2024-05-08T18:09:35.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.430147+0000", 2024-05-08T18:09:35.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.016e-06 2024-05-08T18:09:35.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.434914+0000", 2024-05-08T18:09:35.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047662060000000003 2024-05-08T18:09:35.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.434954+0000", 2024-05-08T18:09:35.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0565999999999998e-05 2024-05-08T18:09:35.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.434973+0000", 2024-05-08T18:09:35.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8519999999999999e-05 2024-05-08T18:09:35.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.435143+0000", 2024-05-08T18:09:35.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017024799999999999 2024-05-08T18:09:35.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.435414+0000", 2024-05-08T18:09:35.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000271628 2024-05-08T18:09:35.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:35.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.435656+0000", 2024-05-08T18:09:35.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024159800000000001 2024-05-08T18:09:35.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:35.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.451116+0000", 2024-05-08T18:09:35.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015460135999999999 2024-05-08T18:09:35.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:35.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.452109+0000", 2024-05-08T18:09:35.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00099277799999999993 2024-05-08T18:09:35.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:35.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.452209+0000", 2024-05-08T18:09:35.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010048300000000001 2024-05-08T18:09:35.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:35.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.452338+0000", 2024-05-08T18:09:35.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128522 2024-05-08T18:09:35.481 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.481 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.481 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.481 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.482 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.482 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:35.482 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.92 2024-05-08T18:09:35.483 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:35.483 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 93 2024-05-08T18:09:35.483 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:35.483 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:35.484 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0104111 s, 1.0 GB/s 2024-05-08T18:09:35.485 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:09:35.485 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:35.481+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:35.486 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:09:35.486 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:35.486 INFO:teuthology.orchestra.run.smithi080.stdout: "epoch": 94, 2024-05-08T18:09:35.486 INFO:teuthology.orchestra.run.smithi080.stdout: "fsid": "0d8284a2-bb69-4df9-9f45-9ef5b469ca40", 2024-05-08T18:09:35.486 INFO:teuthology.orchestra.run.smithi080.stdout: "created": "2024-05-08T18:06:48.916680+0000", 2024-05-08T18:09:35.486 INFO:teuthology.orchestra.run.smithi080.stdout: "modified": "2024-05-08T18:09:32.845288+0000", 2024-05-08T18:09:35.486 INFO:teuthology.orchestra.run.smithi080.stdout: "last_up_change": "2024-05-08T18:07:00.796481+0000", 2024-05-08T18:09:35.486 INFO:teuthology.orchestra.run.smithi080.stdout: "last_in_change": "2024-05-08T18:06:51.530709+0000", 2024-05-08T18:09:35.486 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-05-08T18:09:35.486 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_num": 5799936, 2024-05-08T18:09:35.486 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_set": [ 2024-05-08T18:09:35.487 INFO:teuthology.orchestra.run.smithi080.stdout: "pglog_hardlimit", 2024-05-08T18:09:35.487 INFO:teuthology.orchestra.run.smithi080.stdout: "purged_snapdirs", 2024-05-08T18:09:35.487 INFO:teuthology.orchestra.run.smithi080.stdout: "recovery_deletes", 2024-05-08T18:09:35.487 INFO:teuthology.orchestra.run.smithi080.stdout: "sortbitwise" 2024-05-08T18:09:35.487 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-05-08T18:09:35.487 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_version": 4, 2024-05-08T18:09:35.487 INFO:teuthology.orchestra.run.smithi080.stdout: "full_ratio": 0.94999998807907104, 2024-05-08T18:09:35.487 INFO:teuthology.orchestra.run.smithi080.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-05-08T18:09:35.487 INFO:teuthology.orchestra.run.smithi080.stdout: "nearfull_ratio": 0.85000002384185791, 2024-05-08T18:09:35.487 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_snapshot": "", 2024-05-08T18:09:35.487 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_max": 8, 2024-05-08T18:09:35.487 INFO:teuthology.orchestra.run.smithi080.stdout: "max_osd": 8, 2024-05-08T18:09:35.487 INFO:teuthology.orchestra.run.smithi080.stdout: "require_min_compat_client": "luminous", 2024-05-08T18:09:35.487 INFO:teuthology.orchestra.run.smithi080.stdout: "min_compat_client": "luminous", 2024-05-08T18:09:35.487 INFO:teuthology.orchestra.run.smithi080.stdout: "require_osd_release": "squid", 2024-05-08T18:09:35.488 INFO:teuthology.orchestra.run.smithi080.stdout: "allow_crimson": false, 2024-05-08T18:09:35.488 INFO:teuthology.orchestra.run.smithi080.stdout: "pools": [ 2024-05-08T18:09:35.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.488 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 1, 2024-05-08T18:09:35.488 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": ".mgr", 2024-05-08T18:09:35.488 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:01.699859+0000", 2024-05-08T18:09:35.488 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:09:35.488 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:09:35.488 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:09:35.488 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:09:35.488 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:09:35.488 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:09:35.488 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:09:35.488 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:09:35.489 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:09:35.489 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:09:35.489 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:09:35.489 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:09:35.489 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 1, 2024-05-08T18:09:35.489 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 1, 2024-05-08T18:09:35.489 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 1, 2024-05-08T18:09:35.489 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 1, 2024-05-08T18:09:35.489 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 1, 2024-05-08T18:09:35.489 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:09:35.489 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:09:35.489 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:09:35.489 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:09:35.489 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:09:35.490 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:09:35.490 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:09:35.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.490 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "16", 2024-05-08T18:09:35.490 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:09:35.490 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:09:35.490 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:09:35.490 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:09:35.490 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:09:35.490 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:09:35.490 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:09:35.490 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:09:35.490 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:09:35.490 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:09:35.491 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:09:35.491 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:09:35.491 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:09:35.491 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:09:35.491 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:09:35.491 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:09:35.491 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:09:35.491 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:09:35.491 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:09:35.491 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:09:35.491 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:09:35.491 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:09:35.491 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:09:35.491 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:09:35.491 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:09:35.492 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:09:35.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.492 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:09:35.492 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:09:35.492 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:09:35.492 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:09:35.492 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:09:35.492 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:09:35.492 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:09:35.492 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:09:35.492 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:09:35.492 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:09:35.492 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:09:35.493 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-05-08T18:09:35.493 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_max": 32, 2024-05-08T18:09:35.493 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_min": 1 2024-05-08T18:09:35.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.493 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:09:35.493 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": {} 2024-05-08T18:09:35.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.493 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:09:35.493 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:09:35.493 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 8, 2024-05-08T18:09:35.493 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 8, 2024-05-08T18:09:35.493 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 0.25, 2024-05-08T18:09:35.493 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 2, 2024-05-08T18:09:35.493 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 2, 2024-05-08T18:09:35.493 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:09:35.493 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:09:35.494 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:09:35.494 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.494 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 2, 2024-05-08T18:09:35.494 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "rbd", 2024-05-08T18:09:35.494 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:07.479756+0000", 2024-05-08T18:09:35.494 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:09:35.494 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:09:35.494 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:09:35.494 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:09:35.494 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:09:35.494 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:09:35.495 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:09:35.495 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:09:35.495 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:09:35.495 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:09:35.495 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:09:35.495 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:09:35.495 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 8, 2024-05-08T18:09:35.495 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 8, 2024-05-08T18:09:35.495 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 8, 2024-05-08T18:09:35.495 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 8, 2024-05-08T18:09:35.495 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 8, 2024-05-08T18:09:35.495 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:09:35.495 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:09:35.495 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:09:35.495 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:09:35.495 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:09:35.496 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:09:35.496 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:09:35.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.496 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "19", 2024-05-08T18:09:35.496 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:09:35.496 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:09:35.496 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:09:35.496 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:09:35.496 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:09:35.496 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:09:35.496 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:09:35.496 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:09:35.496 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:09:35.496 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:09:35.496 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:09:35.496 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:09:35.497 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:09:35.497 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:09:35.497 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:09:35.497 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:09:35.497 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:09:35.497 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:09:35.497 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:09:35.497 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:09:35.497 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:09:35.497 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:09:35.497 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:09:35.497 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:09:35.497 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:09:35.497 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:09:35.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.498 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:09:35.498 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:09:35.498 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:09:35.498 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:09:35.498 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:09:35.498 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:09:35.498 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:09:35.498 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:09:35.498 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:09:35.498 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:09:35.498 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:09:35.498 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:09:35.498 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:09:35.498 INFO:teuthology.orchestra.run.smithi080.stdout: "rbd": {} 2024-05-08T18:09:35.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.499 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:09:35.499 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:09:35.499 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.9900000095367432, 2024-05-08T18:09:35.499 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.9900000095367432, 2024-05-08T18:09:35.499 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 0.87999999523162842, 2024-05-08T18:09:35.499 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.75, 2024-05-08T18:09:35.499 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.75, 2024-05-08T18:09:35.499 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:09:35.499 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:09:35.499 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:09:35.499 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.499 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 3, 2024-05-08T18:09:35.499 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.buckets.data", 2024-05-08T18:09:35.500 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:14.110093+0000", 2024-05-08T18:09:35.500 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:09:35.500 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:09:35.500 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:09:35.500 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:09:35.500 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:09:35.500 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:09:35.500 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:09:35.500 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:09:35.500 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:09:35.500 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:09:35.500 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:09:35.500 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:09:35.500 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 64, 2024-05-08T18:09:35.500 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 64, 2024-05-08T18:09:35.500 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 64, 2024-05-08T18:09:35.501 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 64, 2024-05-08T18:09:35.501 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 64, 2024-05-08T18:09:35.501 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:09:35.501 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:09:35.501 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:09:35.501 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:09:35.501 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:09:35.501 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:09:35.501 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:09:35.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.501 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "22", 2024-05-08T18:09:35.501 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:09:35.501 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:09:35.501 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:09:35.502 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:09:35.502 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:09:35.502 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:09:35.502 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:09:35.502 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:09:35.502 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:09:35.502 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:09:35.502 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:09:35.502 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:09:35.502 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:09:35.502 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:09:35.502 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:09:35.502 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:09:35.503 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:09:35.503 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:09:35.503 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:09:35.503 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:09:35.503 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:09:35.503 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:09:35.503 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:09:35.503 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:09:35.503 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:09:35.503 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:09:35.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.503 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:09:35.503 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:09:35.503 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:09:35.503 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:09:35.504 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:09:35.504 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:09:35.504 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:09:35.504 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:09:35.504 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:09:35.504 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:09:35.504 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:09:35.504 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:09:35.504 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:09:35.504 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:09:35.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.504 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:09:35.504 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:09:35.504 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.25, 2024-05-08T18:09:35.505 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.25, 2024-05-08T18:09:35.505 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:09:35.505 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.25, 2024-05-08T18:09:35.505 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.25, 2024-05-08T18:09:35.505 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:09:35.505 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:09:35.505 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:09:35.505 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.505 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 4, 2024-05-08T18:09:35.505 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.buckets.index", 2024-05-08T18:09:35.505 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:15.798248+0000", 2024-05-08T18:09:35.505 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:09:35.506 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:09:35.506 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:09:35.506 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:09:35.506 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:09:35.506 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:09:35.506 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:09:35.506 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:09:35.506 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:09:35.506 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:09:35.506 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:09:35.506 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:09:35.506 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 64, 2024-05-08T18:09:35.506 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 64, 2024-05-08T18:09:35.507 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 64, 2024-05-08T18:09:35.507 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 64, 2024-05-08T18:09:35.507 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 64, 2024-05-08T18:09:35.507 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:09:35.507 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:09:35.507 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:09:35.507 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:09:35.507 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:09:35.507 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:09:35.507 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:09:35.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.507 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "24", 2024-05-08T18:09:35.507 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:09:35.507 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:09:35.507 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:09:35.508 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:09:35.508 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:09:35.508 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:09:35.508 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:09:35.508 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:09:35.508 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:09:35.508 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:09:35.508 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:09:35.508 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:09:35.508 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:09:35.508 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:09:35.508 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:09:35.508 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:09:35.509 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:09:35.509 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:09:35.509 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:09:35.509 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:09:35.509 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:09:35.509 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:09:35.509 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:09:35.509 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:09:35.509 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:09:35.509 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:09:35.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.509 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:09:35.509 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:09:35.510 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:09:35.510 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:09:35.510 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:09:35.510 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:09:35.510 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:09:35.510 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:09:35.510 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:09:35.510 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:09:35.510 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:09:35.510 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:09:35.510 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:09:35.510 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:09:35.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.511 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:09:35.511 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:09:35.511 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 2, 2024-05-08T18:09:35.511 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 2, 2024-05-08T18:09:35.511 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:09:35.511 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 2, 2024-05-08T18:09:35.511 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 2, 2024-05-08T18:09:35.511 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:09:35.511 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:09:35.511 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:09:35.511 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.511 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 5, 2024-05-08T18:09:35.512 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": ".rgw.root", 2024-05-08T18:09:35.512 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:17.763573+0000", 2024-05-08T18:09:35.512 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:09:35.512 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:09:35.512 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:09:35.512 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:09:35.512 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:09:35.512 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:09:35.512 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:09:35.512 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:09:35.512 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:09:35.512 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:09:35.512 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:09:35.512 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:09:35.513 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-05-08T18:09:35.513 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-05-08T18:09:35.513 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-05-08T18:09:35.513 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-05-08T18:09:35.513 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-05-08T18:09:35.513 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:09:35.513 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:09:35.513 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:09:35.513 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:09:35.513 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:09:35.513 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:09:35.513 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:09:35.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.513 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "26", 2024-05-08T18:09:35.513 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:09:35.513 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:09:35.514 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:09:35.514 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:09:35.514 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:09:35.514 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:09:35.514 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:09:35.514 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:09:35.514 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:09:35.514 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:09:35.514 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:09:35.514 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:09:35.514 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:09:35.514 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:09:35.514 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:09:35.515 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:09:35.515 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:09:35.515 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:09:35.515 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:09:35.515 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:09:35.515 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:09:35.515 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:09:35.515 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:09:35.515 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:09:35.515 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:09:35.515 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:09:35.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.515 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:09:35.515 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:09:35.515 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:09:35.516 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:09:35.516 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:09:35.516 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:09:35.516 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:09:35.516 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:09:35.516 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:09:35.516 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:09:35.516 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:09:35.516 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:09:35.516 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:09:35.516 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:09:35.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.516 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:09:35.516 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:09:35.516 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.25, 2024-05-08T18:09:35.517 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.25, 2024-05-08T18:09:35.517 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:09:35.517 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.25, 2024-05-08T18:09:35.517 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.25, 2024-05-08T18:09:35.517 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:09:35.517 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:09:35.517 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:09:35.517 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.517 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 6, 2024-05-08T18:09:35.517 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.log", 2024-05-08T18:09:35.517 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:19.656809+0000", 2024-05-08T18:09:35.517 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:09:35.517 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:09:35.518 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:09:35.518 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:09:35.518 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:09:35.518 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:09:35.518 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:09:35.518 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:09:35.518 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:09:35.518 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:09:35.518 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:09:35.518 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:09:35.518 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-05-08T18:09:35.518 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-05-08T18:09:35.518 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-05-08T18:09:35.518 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-05-08T18:09:35.519 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-05-08T18:09:35.519 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:09:35.519 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:09:35.519 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:09:35.519 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:09:35.519 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:09:35.519 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:09:35.519 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:09:35.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.519 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "28", 2024-05-08T18:09:35.519 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:09:35.519 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:09:35.519 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:09:35.519 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:09:35.519 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:09:35.520 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:09:35.520 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:09:35.520 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:09:35.520 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:09:35.520 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:09:35.520 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:09:35.520 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:09:35.520 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:09:35.520 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:09:35.520 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:09:35.520 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:09:35.520 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:09:35.520 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:09:35.521 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:09:35.521 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:09:35.521 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:09:35.521 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:09:35.521 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:09:35.521 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:09:35.521 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:09:35.521 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:09:35.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.521 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:09:35.521 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:09:35.521 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:09:35.521 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:09:35.522 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:09:35.522 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:09:35.522 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:09:35.522 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:09:35.522 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:09:35.522 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:09:35.522 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:09:35.522 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:09:35.522 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:09:35.522 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:09:35.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.522 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:09:35.522 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:09:35.523 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.5, 2024-05-08T18:09:35.523 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.5, 2024-05-08T18:09:35.523 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:09:35.523 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.5, 2024-05-08T18:09:35.523 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.5, 2024-05-08T18:09:35.523 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:09:35.523 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:09:35.523 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:09:35.523 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.523 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 7, 2024-05-08T18:09:35.523 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.control", 2024-05-08T18:09:35.523 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:21.569514+0000", 2024-05-08T18:09:35.524 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:09:35.524 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:09:35.524 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:09:35.524 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:09:35.524 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:09:35.524 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:09:35.524 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:09:35.524 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:09:35.524 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:09:35.524 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:09:35.524 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:09:35.524 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:09:35.524 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-05-08T18:09:35.525 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-05-08T18:09:35.525 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-05-08T18:09:35.525 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-05-08T18:09:35.525 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-05-08T18:09:35.525 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:09:35.525 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:09:35.525 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:09:35.525 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:09:35.525 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:09:35.525 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:09:35.525 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:09:35.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.525 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "30", 2024-05-08T18:09:35.525 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:09:35.526 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:09:35.526 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:09:35.526 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:09:35.526 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:09:35.526 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:09:35.526 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:09:35.526 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:09:35.526 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:09:35.526 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:09:35.526 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:09:35.526 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:09:35.526 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:09:35.526 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:09:35.526 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:09:35.527 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:09:35.527 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:09:35.527 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:09:35.527 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:09:35.527 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:09:35.527 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:09:35.527 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:09:35.527 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:09:35.527 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:09:35.527 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:09:35.527 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:09:35.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.527 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:09:35.527 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:09:35.527 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:09:35.527 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:09:35.528 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:09:35.528 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:09:35.528 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:09:35.528 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:09:35.528 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:09:35.528 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:09:35.528 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:09:35.528 INFO:teuthology.orchestra.run.smithi080.stdout: "options": {}, 2024-05-08T18:09:35.528 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:09:35.528 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:09:35.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.528 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:09:35.528 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:09:35.528 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.75, 2024-05-08T18:09:35.529 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.75, 2024-05-08T18:09:35.529 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:09:35.529 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.75, 2024-05-08T18:09:35.529 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.75, 2024-05-08T18:09:35.529 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:09:35.529 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:09:35.529 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:09:35.529 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.529 INFO:teuthology.orchestra.run.smithi080.stdout: "pool": 8, 2024-05-08T18:09:35.529 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_name": "default.rgw.meta", 2024-05-08T18:09:35.529 INFO:teuthology.orchestra.run.smithi080.stdout: "create_time": "2024-05-08T18:07:23.704646+0000", 2024-05-08T18:09:35.529 INFO:teuthology.orchestra.run.smithi080.stdout: "flags": 1, 2024-05-08T18:09:35.529 INFO:teuthology.orchestra.run.smithi080.stdout: "flags_names": "hashpspool", 2024-05-08T18:09:35.530 INFO:teuthology.orchestra.run.smithi080.stdout: "type": 1, 2024-05-08T18:09:35.530 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 2, 2024-05-08T18:09:35.530 INFO:teuthology.orchestra.run.smithi080.stdout: "min_size": 1, 2024-05-08T18:09:35.530 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_rule": 0, 2024-05-08T18:09:35.530 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:09:35.530 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:09:35.530 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:09:35.530 INFO:teuthology.orchestra.run.smithi080.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:09:35.530 INFO:teuthology.orchestra.run.smithi080.stdout: "object_hash": 2, 2024-05-08T18:09:35.530 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:09:35.530 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num": 32, 2024-05-08T18:09:35.530 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num": 32, 2024-05-08T18:09:35.530 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_placement_num_target": 32, 2024-05-08T18:09:35.530 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_target": 32, 2024-05-08T18:09:35.531 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_num_pending": 32, 2024-05-08T18:09:35.531 INFO:teuthology.orchestra.run.smithi080.stdout: "last_pg_merge_meta": { 2024-05-08T18:09:35.531 INFO:teuthology.orchestra.run.smithi080.stdout: "source_pgid": "0.0", 2024-05-08T18:09:35.531 INFO:teuthology.orchestra.run.smithi080.stdout: "ready_epoch": 0, 2024-05-08T18:09:35.531 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_started": 0, 2024-05-08T18:09:35.531 INFO:teuthology.orchestra.run.smithi080.stdout: "last_epoch_clean": 0, 2024-05-08T18:09:35.531 INFO:teuthology.orchestra.run.smithi080.stdout: "source_version": "0'0", 2024-05-08T18:09:35.531 INFO:teuthology.orchestra.run.smithi080.stdout: "target_version": "0'0" 2024-05-08T18:09:35.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.531 INFO:teuthology.orchestra.run.smithi080.stdout: "last_change": "32", 2024-05-08T18:09:35.531 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend": "0", 2024-05-08T18:09:35.531 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:09:35.531 INFO:teuthology.orchestra.run.smithi080.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:09:35.532 INFO:teuthology.orchestra.run.smithi080.stdout: "auid": 0, 2024-05-08T18:09:35.532 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:09:35.532 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_seq": 0, 2024-05-08T18:09:35.532 INFO:teuthology.orchestra.run.smithi080.stdout: "snap_epoch": 0, 2024-05-08T18:09:35.532 INFO:teuthology.orchestra.run.smithi080.stdout: "pool_snaps": [], 2024-05-08T18:09:35.532 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps": "[]", 2024-05-08T18:09:35.532 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_bytes": 0, 2024-05-08T18:09:35.532 INFO:teuthology.orchestra.run.smithi080.stdout: "quota_max_objects": 0, 2024-05-08T18:09:35.532 INFO:teuthology.orchestra.run.smithi080.stdout: "tiers": [], 2024-05-08T18:09:35.532 INFO:teuthology.orchestra.run.smithi080.stdout: "tier_of": -1, 2024-05-08T18:09:35.532 INFO:teuthology.orchestra.run.smithi080.stdout: "read_tier": -1, 2024-05-08T18:09:35.532 INFO:teuthology.orchestra.run.smithi080.stdout: "write_tier": -1, 2024-05-08T18:09:35.532 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_mode": "none", 2024-05-08T18:09:35.532 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_bytes": 0, 2024-05-08T18:09:35.533 INFO:teuthology.orchestra.run.smithi080.stdout: "target_max_objects": 0, 2024-05-08T18:09:35.533 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:09:35.533 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:09:35.533 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:09:35.533 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_flush_age": 0, 2024-05-08T18:09:35.533 INFO:teuthology.orchestra.run.smithi080.stdout: "cache_min_evict_age": 0, 2024-05-08T18:09:35.533 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profile": "", 2024-05-08T18:09:35.533 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_params": { 2024-05-08T18:09:35.533 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "none" 2024-05-08T18:09:35.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.533 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_period": 0, 2024-05-08T18:09:35.533 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_count": 0, 2024-05-08T18:09:35.533 INFO:teuthology.orchestra.run.smithi080.stdout: "use_gmt_hitset": true, 2024-05-08T18:09:35.533 INFO:teuthology.orchestra.run.smithi080.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:09:35.533 INFO:teuthology.orchestra.run.smithi080.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:09:35.533 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:09:35.534 INFO:teuthology.orchestra.run.smithi080.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:09:35.534 INFO:teuthology.orchestra.run.smithi080.stdout: "grade_table": [], 2024-05-08T18:09:35.534 INFO:teuthology.orchestra.run.smithi080.stdout: "stripe_width": 0, 2024-05-08T18:09:35.534 INFO:teuthology.orchestra.run.smithi080.stdout: "expected_num_objects": 0, 2024-05-08T18:09:35.534 INFO:teuthology.orchestra.run.smithi080.stdout: "fast_read": false, 2024-05-08T18:09:35.534 INFO:teuthology.orchestra.run.smithi080.stdout: "options": { 2024-05-08T18:09:35.534 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_autoscale_bias": 4 2024-05-08T18:09:35.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.534 INFO:teuthology.orchestra.run.smithi080.stdout: "application_metadata": { 2024-05-08T18:09:35.534 INFO:teuthology.orchestra.run.smithi080.stdout: "rgw": {} 2024-05-08T18:09:35.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.534 INFO:teuthology.orchestra.run.smithi080.stdout: "read_balance": { 2024-05-08T18:09:35.534 INFO:teuthology.orchestra.run.smithi080.stdout: "score_type": "Fair distribution", 2024-05-08T18:09:35.534 INFO:teuthology.orchestra.run.smithi080.stdout: "score_acting": 1.5, 2024-05-08T18:09:35.535 INFO:teuthology.orchestra.run.smithi080.stdout: "score_stable": 1.5, 2024-05-08T18:09:35.535 INFO:teuthology.orchestra.run.smithi080.stdout: "optimal_score": 1, 2024-05-08T18:09:35.535 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_acting": 1.5, 2024-05-08T18:09:35.535 INFO:teuthology.orchestra.run.smithi080.stdout: "raw_score_stable": 1.5, 2024-05-08T18:09:35.535 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:09:35.535 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity": 1, 2024-05-08T18:09:35.535 INFO:teuthology.orchestra.run.smithi080.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:09:35.535 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.535 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.535 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-05-08T18:09:35.535 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-05-08T18:09:35.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.535 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-05-08T18:09:35.535 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "e14e7bbc-18b8-4961-bcde-109f22cc52e6", 2024-05-08T18:09:35.535 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:09:35.536 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:09:35.536 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:09:35.536 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:09:35.536 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:09:35.536 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:09:35.536 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:09:35.536 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 30, 2024-05-08T18:09:35.536 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:09:35.536 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:09:35.536 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:09:35.536 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.536 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.536 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6809", 2024-05-08T18:09:35.536 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:09:35.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.537 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.537 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6812", 2024-05-08T18:09:35.537 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:09:35.537 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.537 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.537 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:09:35.537 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.537 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.537 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6815", 2024-05-08T18:09:35.537 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:09:35.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.538 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.538 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6817", 2024-05-08T18:09:35.538 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:09:35.538 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.538 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.538 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:09:35.538 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.538 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.538 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6822", 2024-05-08T18:09:35.538 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:09:35.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.539 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.539 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6823", 2024-05-08T18:09:35.539 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:09:35.539 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.539 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.539 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:09:35.539 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.539 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.539 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6819", 2024-05-08T18:09:35.539 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:09:35.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.539 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.539 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6821", 2024-05-08T18:09:35.540 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3565382691 2024-05-08T18:09:35.540 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.540 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.540 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6812/3565382691", 2024-05-08T18:09:35.540 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6817/3565382691", 2024-05-08T18:09:35.540 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6823/3565382691", 2024-05-08T18:09:35.540 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6821/3565382691", 2024-05-08T18:09:35.540 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:09:35.540 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:09:35.540 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:09:35.540 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.540 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-05-08T18:09:35.541 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "d4ce30c2-52b8-45a3-8a34-b0addc8311dd", 2024-05-08T18:09:35.541 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:09:35.541 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:09:35.541 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:09:35.541 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:09:35.541 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:09:35.541 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:09:35.541 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:09:35.541 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 84, 2024-05-08T18:09:35.541 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:09:35.541 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:09:35.541 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:09:35.541 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.541 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.542 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6800", 2024-05-08T18:09:35.542 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:09:35.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.542 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.542 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6801", 2024-05-08T18:09:35.542 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:09:35.542 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.542 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.542 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:09:35.542 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.543 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.543 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6802", 2024-05-08T18:09:35.543 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:09:35.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.543 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.543 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6803", 2024-05-08T18:09:35.543 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:09:35.543 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.543 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.544 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:09:35.544 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.544 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.544 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6806", 2024-05-08T18:09:35.544 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:09:35.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.544 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.544 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6807", 2024-05-08T18:09:35.544 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:09:35.544 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.544 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.545 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:09:35.545 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.545 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.545 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6804", 2024-05-08T18:09:35.545 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:09:35.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.545 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.545 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6805", 2024-05-08T18:09:35.545 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3922502534 2024-05-08T18:09:35.545 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.545 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.546 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6801/3922502534", 2024-05-08T18:09:35.546 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6803/3922502534", 2024-05-08T18:09:35.546 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6807/3922502534", 2024-05-08T18:09:35.546 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6805/3922502534", 2024-05-08T18:09:35.546 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:09:35.546 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:09:35.546 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:09:35.546 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.546 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-05-08T18:09:35.546 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "0049cbe1-578f-4202-a572-2328d79f0496", 2024-05-08T18:09:35.546 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:09:35.546 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:09:35.547 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:09:35.547 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:09:35.547 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:09:35.547 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:09:35.547 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:09:35.547 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 47, 2024-05-08T18:09:35.547 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:09:35.547 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:09:35.547 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:09:35.547 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.547 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.547 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6824", 2024-05-08T18:09:35.547 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:09:35.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.548 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.548 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6825", 2024-05-08T18:09:35.548 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:09:35.548 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.548 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.548 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:09:35.548 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.548 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.548 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6826", 2024-05-08T18:09:35.548 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:09:35.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.548 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6827", 2024-05-08T18:09:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:09:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:09:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6830", 2024-05-08T18:09:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:09:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6831", 2024-05-08T18:09:35.549 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:09:35.550 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.550 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.550 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:09:35.550 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.550 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.550 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6828", 2024-05-08T18:09:35.550 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:09:35.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.550 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.550 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6829", 2024-05-08T18:09:35.550 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3474282780 2024-05-08T18:09:35.550 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.551 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.551 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6825/3474282780", 2024-05-08T18:09:35.551 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6827/3474282780", 2024-05-08T18:09:35.551 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6831/3474282780", 2024-05-08T18:09:35.551 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6829/3474282780", 2024-05-08T18:09:35.551 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:09:35.551 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:09:35.551 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:09:35.551 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.551 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-05-08T18:09:35.552 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3ec754a0-b0ca-4d44-bce0-7c380245ec0a", 2024-05-08T18:09:35.552 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:09:35.552 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:09:35.552 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:09:35.552 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:09:35.552 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:09:35.552 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:09:35.552 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:09:35.552 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 47, 2024-05-08T18:09:35.552 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:09:35.552 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:09:35.552 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:09:35.552 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.553 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.553 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6808", 2024-05-08T18:09:35.553 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:09:35.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.553 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.553 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6810", 2024-05-08T18:09:35.553 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:09:35.553 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.553 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.553 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:09:35.553 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.553 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.554 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6811", 2024-05-08T18:09:35.554 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:09:35.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.554 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.554 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6813", 2024-05-08T18:09:35.554 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:09:35.554 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.554 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.554 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:09:35.554 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.555 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.555 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6818", 2024-05-08T18:09:35.555 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:09:35.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.555 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.555 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6820", 2024-05-08T18:09:35.555 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:09:35.555 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.555 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.555 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:09:35.556 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.556 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.556 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6814", 2024-05-08T18:09:35.556 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:09:35.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.556 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.556 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.80:6816", 2024-05-08T18:09:35.556 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3525633066 2024-05-08T18:09:35.556 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.556 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.556 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.80:6810/3525633066", 2024-05-08T18:09:35.556 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.80:6813/3525633066", 2024-05-08T18:09:35.557 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.80:6820/3525633066", 2024-05-08T18:09:35.557 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.80:6816/3525633066", 2024-05-08T18:09:35.557 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:09:35.557 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:09:35.557 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:09:35.557 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.557 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-05-08T18:09:35.557 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d", 2024-05-08T18:09:35.557 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:09:35.557 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:09:35.557 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:09:35.557 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:09:35.557 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:09:35.558 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:09:35.558 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:09:35.558 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 47, 2024-05-08T18:09:35.558 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:09:35.558 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:09:35.558 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:09:35.558 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.558 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.558 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6816", 2024-05-08T18:09:35.558 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:09:35.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.558 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.559 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6817", 2024-05-08T18:09:35.559 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:09:35.559 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.559 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.559 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:09:35.559 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.559 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.559 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6819", 2024-05-08T18:09:35.559 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:09:35.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.559 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.559 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6821", 2024-05-08T18:09:35.560 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:09:35.560 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.560 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.560 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:09:35.560 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.560 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.560 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6827", 2024-05-08T18:09:35.560 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:09:35.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.560 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.560 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6829", 2024-05-08T18:09:35.561 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:09:35.561 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.561 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.561 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:09:35.561 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.561 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.561 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6823", 2024-05-08T18:09:35.561 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:09:35.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.561 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.561 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6825", 2024-05-08T18:09:35.561 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 4103080494 2024-05-08T18:09:35.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.562 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.562 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.115:6817/4103080494", 2024-05-08T18:09:35.562 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.115:6821/4103080494", 2024-05-08T18:09:35.562 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.115:6829/4103080494", 2024-05-08T18:09:35.562 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.115:6825/4103080494", 2024-05-08T18:09:35.562 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:09:35.562 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:09:35.562 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:09:35.562 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-05-08T18:09:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "3dc618ad-e40d-418e-844c-57572043f866", 2024-05-08T18:09:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:09:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:09:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:09:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:09:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:09:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:09:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:09:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 30, 2024-05-08T18:09:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:09:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:09:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:09:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.563 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.564 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6818", 2024-05-08T18:09:35.564 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:09:35.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.564 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.564 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6820", 2024-05-08T18:09:35.564 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:09:35.564 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.564 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.564 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:09:35.564 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.564 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.564 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6822", 2024-05-08T18:09:35.565 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:09:35.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.565 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.565 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6824", 2024-05-08T18:09:35.565 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:09:35.565 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.565 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.565 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:09:35.565 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.566 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.566 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6830", 2024-05-08T18:09:35.566 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:09:35.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.566 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.566 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6831", 2024-05-08T18:09:35.566 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:09:35.566 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.566 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.566 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:09:35.566 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.567 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.567 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6826", 2024-05-08T18:09:35.567 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:09:35.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.567 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.567 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6828", 2024-05-08T18:09:35.567 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 87947085 2024-05-08T18:09:35.567 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.567 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.567 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.115:6820/87947085", 2024-05-08T18:09:35.567 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.115:6824/87947085", 2024-05-08T18:09:35.568 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.115:6831/87947085", 2024-05-08T18:09:35.568 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.115:6828/87947085", 2024-05-08T18:09:35.568 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:09:35.568 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:09:35.568 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:09:35.568 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.568 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-05-08T18:09:35.568 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "1f8172c6-5d27-4542-80a6-1c630dddf752", 2024-05-08T18:09:35.568 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:09:35.568 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:09:35.568 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:09:35.568 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:09:35.569 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:09:35.569 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:09:35.569 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:09:35.569 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 30, 2024-05-08T18:09:35.569 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:09:35.569 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:09:35.569 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:09:35.569 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.569 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.569 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6800", 2024-05-08T18:09:35.569 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:09:35.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.570 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.570 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6801", 2024-05-08T18:09:35.570 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:09:35.570 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.570 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.570 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:09:35.570 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.570 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.570 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6802", 2024-05-08T18:09:35.570 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:09:35.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.571 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.571 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6803", 2024-05-08T18:09:35.571 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:09:35.571 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.571 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.571 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:09:35.571 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.571 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.571 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6806", 2024-05-08T18:09:35.571 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:09:35.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.572 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.572 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6807", 2024-05-08T18:09:35.572 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:09:35.572 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.572 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.572 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:09:35.572 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.572 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.572 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6804", 2024-05-08T18:09:35.573 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:09:35.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.573 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.573 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6805", 2024-05-08T18:09:35.573 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2090404725 2024-05-08T18:09:35.573 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.573 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.573 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.115:6801/2090404725", 2024-05-08T18:09:35.573 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.115:6803/2090404725", 2024-05-08T18:09:35.573 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.115:6807/2090404725", 2024-05-08T18:09:35.574 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.115:6805/2090404725", 2024-05-08T18:09:35.574 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:09:35.574 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:09:35.574 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:09:35.574 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.574 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-05-08T18:09:35.574 INFO:teuthology.orchestra.run.smithi080.stdout: "uuid": "e4146a73-11ca-4499-afa7-23e23d70a662", 2024-05-08T18:09:35.574 INFO:teuthology.orchestra.run.smithi080.stdout: "up": 1, 2024-05-08T18:09:35.574 INFO:teuthology.orchestra.run.smithi080.stdout: "in": 1, 2024-05-08T18:09:35.575 INFO:teuthology.orchestra.run.smithi080.stdout: "weight": 1, 2024-05-08T18:09:35.575 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_affinity": 1, 2024-05-08T18:09:35.575 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_begin": 0, 2024-05-08T18:09:35.575 INFO:teuthology.orchestra.run.smithi080.stdout: "last_clean_end": 0, 2024-05-08T18:09:35.575 INFO:teuthology.orchestra.run.smithi080.stdout: "up_from": 13, 2024-05-08T18:09:35.575 INFO:teuthology.orchestra.run.smithi080.stdout: "up_thru": 30, 2024-05-08T18:09:35.575 INFO:teuthology.orchestra.run.smithi080.stdout: "down_at": 0, 2024-05-08T18:09:35.575 INFO:teuthology.orchestra.run.smithi080.stdout: "lost_at": 0, 2024-05-08T18:09:35.575 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addrs": { 2024-05-08T18:09:35.575 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.575 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.575 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6808", 2024-05-08T18:09:35.576 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:09:35.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.576 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.576 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6809", 2024-05-08T18:09:35.576 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:09:35.576 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.576 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.576 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addrs": { 2024-05-08T18:09:35.576 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.576 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.576 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6810", 2024-05-08T18:09:35.576 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:09:35.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.577 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.577 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6811", 2024-05-08T18:09:35.577 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:09:35.577 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.577 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.577 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addrs": { 2024-05-08T18:09:35.577 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.577 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.577 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6814", 2024-05-08T18:09:35.577 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:09:35.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.578 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.578 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6815", 2024-05-08T18:09:35.578 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:09:35.578 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.578 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.578 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addrs": { 2024-05-08T18:09:35.578 INFO:teuthology.orchestra.run.smithi080.stdout: "addrvec": [ 2024-05-08T18:09:35.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.578 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v2", 2024-05-08T18:09:35.578 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6812", 2024-05-08T18:09:35.578 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:09:35.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.579 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T18:09:35.579 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "172.21.15.115:6813", 2024-05-08T18:09:35.579 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 133828553 2024-05-08T18:09:35.579 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.579 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.579 INFO:teuthology.orchestra.run.smithi080.stdout: "public_addr": "172.21.15.115:6809/133828553", 2024-05-08T18:09:35.579 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_addr": "172.21.15.115:6811/133828553", 2024-05-08T18:09:35.579 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_back_addr": "172.21.15.115:6815/133828553", 2024-05-08T18:09:35.579 INFO:teuthology.orchestra.run.smithi080.stdout: "heartbeat_front_addr": "172.21.15.115:6813/133828553", 2024-05-08T18:09:35.579 INFO:teuthology.orchestra.run.smithi080.stdout: "state": [ 2024-05-08T18:09:35.579 INFO:teuthology.orchestra.run.smithi080.stdout: "exists", 2024-05-08T18:09:35.579 INFO:teuthology.orchestra.run.smithi080.stdout: "up" 2024-05-08T18:09:35.579 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.580 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.580 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-05-08T18:09:35.580 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_xinfo": [ 2024-05-08T18:09:35.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.580 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 0, 2024-05-08T18:09:35.580 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:09:35.580 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:09:35.580 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:09:35.580 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:09:35.580 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:09:35.580 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:56.936317+0000", 2024-05-08T18:09:35.580 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:09:35.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.580 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 1, 2024-05-08T18:09:35.580 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:09:35.581 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:09:35.581 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:09:35.581 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:09:35.581 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:09:35.581 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:56.814583+0000", 2024-05-08T18:09:35.581 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:09:35.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.581 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 2, 2024-05-08T18:09:35.581 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:09:35.581 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:09:35.581 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:09:35.581 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:09:35.581 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:09:35.582 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:57.168294+0000", 2024-05-08T18:09:35.582 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:09:35.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.582 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 3, 2024-05-08T18:09:35.582 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:09:35.582 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:09:35.582 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:09:35.582 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:09:35.582 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:09:35.582 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:56.751445+0000", 2024-05-08T18:09:35.582 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:09:35.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.583 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 4, 2024-05-08T18:09:35.583 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:09:35.583 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:09:35.583 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:09:35.583 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:09:35.583 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:09:35.583 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:57.091268+0000", 2024-05-08T18:09:35.583 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:09:35.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.583 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 5, 2024-05-08T18:09:35.583 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:09:35.583 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:09:35.583 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:09:35.584 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:09:35.584 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:09:35.584 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:57.113133+0000", 2024-05-08T18:09:35.584 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:09:35.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.584 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 6, 2024-05-08T18:09:35.584 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:09:35.584 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:09:35.584 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:09:35.584 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:09:35.584 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:09:35.584 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:57.054822+0000", 2024-05-08T18:09:35.584 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:09:35.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.585 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": 7, 2024-05-08T18:09:35.585 INFO:teuthology.orchestra.run.smithi080.stdout: "down_stamp": "0.000000", 2024-05-08T18:09:35.585 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_probability": 0, 2024-05-08T18:09:35.585 INFO:teuthology.orchestra.run.smithi080.stdout: "laggy_interval": 0, 2024-05-08T18:09:35.585 INFO:teuthology.orchestra.run.smithi080.stdout: "features": 4540701547738038271, 2024-05-08T18:09:35.585 INFO:teuthology.orchestra.run.smithi080.stdout: "old_weight": 0, 2024-05-08T18:09:35.585 INFO:teuthology.orchestra.run.smithi080.stdout: "last_purged_snaps_scrub": "2024-05-08T18:06:57.057214+0000", 2024-05-08T18:09:35.585 INFO:teuthology.orchestra.run.smithi080.stdout: "dead_epoch": 0 2024-05-08T18:09:35.585 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.585 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-05-08T18:09:35.585 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap": [ 2024-05-08T18:09:35.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.585 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.3f", 2024-05-08T18:09:35.586 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-05-08T18:09:35.586 INFO:teuthology.orchestra.run.smithi080.stdout: 3, 2024-05-08T18:09:35.586 INFO:teuthology.orchestra.run.smithi080.stdout: 7 2024-05-08T18:09:35.586 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.586 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "6.c", 2024-05-08T18:09:35.586 INFO:teuthology.orchestra.run.smithi080.stdout: "osds": [ 2024-05-08T18:09:35.586 INFO:teuthology.orchestra.run.smithi080.stdout: 1, 2024-05-08T18:09:35.586 INFO:teuthology.orchestra.run.smithi080.stdout: 7 2024-05-08T18:09:35.586 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.586 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.586 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-05-08T18:09:35.587 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_items": [ 2024-05-08T18:09:35.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.587 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "3.f", 2024-05-08T18:09:35.587 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-05-08T18:09:35.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.587 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 7, 2024-05-08T18:09:35.587 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 2 2024-05-08T18:09:35.587 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.587 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.587 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "3.1e", 2024-05-08T18:09:35.587 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-05-08T18:09:35.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.587 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 3, 2024-05-08T18:09:35.588 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 1 2024-05-08T18:09:35.588 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.588 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.588 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "3.2a", 2024-05-08T18:09:35.588 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-05-08T18:09:35.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.588 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 5, 2024-05-08T18:09:35.588 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 2 2024-05-08T18:09:35.588 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.588 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.588 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "3.3a", 2024-05-08T18:09:35.589 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-05-08T18:09:35.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.589 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 5, 2024-05-08T18:09:35.589 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 2 2024-05-08T18:09:35.589 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.589 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.589 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.c", 2024-05-08T18:09:35.589 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-05-08T18:09:35.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.589 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 3, 2024-05-08T18:09:35.589 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 2 2024-05-08T18:09:35.589 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.589 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.590 INFO:teuthology.orchestra.run.smithi080.stdout: "pgid": "4.10", 2024-05-08T18:09:35.590 INFO:teuthology.orchestra.run.smithi080.stdout: "mappings": [ 2024-05-08T18:09:35.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:35.590 INFO:teuthology.orchestra.run.smithi080.stdout: "from": 1, 2024-05-08T18:09:35.590 INFO:teuthology.orchestra.run.smithi080.stdout: "to": 2 2024-05-08T18:09:35.590 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.590 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:35.590 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.590 INFO:teuthology.orchestra.run.smithi080.stdout: ], 2024-05-08T18:09:35.590 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_upmap_primaries": [], 2024-05-08T18:09:35.590 INFO:teuthology.orchestra.run.smithi080.stdout: "pg_temp": [], 2024-05-08T18:09:35.590 INFO:teuthology.orchestra.run.smithi080.stdout: "primary_temp": [], 2024-05-08T18:09:35.590 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklist": {}, 2024-05-08T18:09:35.591 INFO:teuthology.orchestra.run.smithi080.stdout: "range_blocklist": {}, 2024-05-08T18:09:35.591 INFO:teuthology.orchestra.run.smithi080.stdout: "erasure_code_profiles": { 2024-05-08T18:09:35.591 INFO:teuthology.orchestra.run.smithi080.stdout: "default": { 2024-05-08T18:09:35.591 INFO:teuthology.orchestra.run.smithi080.stdout: "crush-failure-domain": "osd", 2024-05-08T18:09:35.591 INFO:teuthology.orchestra.run.smithi080.stdout: "k": "2", 2024-05-08T18:09:35.591 INFO:teuthology.orchestra.run.smithi080.stdout: "m": "1", 2024-05-08T18:09:35.591 INFO:teuthology.orchestra.run.smithi080.stdout: "plugin": "jerasure", 2024-05-08T18:09:35.591 INFO:teuthology.orchestra.run.smithi080.stdout: "technique": "reed_sol_van" 2024-05-08T18:09:35.591 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:35.591 INFO:teuthology.orchestra.run.smithi080.stdout: "removed_snaps_queue": [], 2024-05-08T18:09:35.591 INFO:teuthology.orchestra.run.smithi080.stdout: "new_removed_snaps": [], 2024-05-08T18:09:35.591 INFO:teuthology.orchestra.run.smithi080.stdout: "new_purged_snaps": [], 2024-05-08T18:09:35.591 INFO:teuthology.orchestra.run.smithi080.stdout: "crush_node_flags": {}, 2024-05-08T18:09:35.591 INFO:teuthology.orchestra.run.smithi080.stdout: "device_class_flags": {}, 2024-05-08T18:09:35.592 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode": { 2024-05-08T18:09:35.592 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_enabled": false, 2024-05-08T18:09:35.592 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_bucket_count": 0, 2024-05-08T18:09:35.592 INFO:teuthology.orchestra.run.smithi080.stdout: "degraded_stretch_mode": 0, 2024-05-08T18:09:35.592 INFO:teuthology.orchestra.run.smithi080.stdout: "recovering_stretch_mode": 0, 2024-05-08T18:09:35.592 INFO:teuthology.orchestra.run.smithi080.stdout: "stretch_mode_bucket": 0 2024-05-08T18:09:35.592 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:35.592 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:35.593 INFO:tasks.thrashosds.thrasher:j is {'epoch': 94, 'fsid': '0d8284a2-bb69-4df9-9f45-9ef5b469ca40', 'created': '2024-05-08T18:06:48.916680+0000', 'modified': '2024-05-08T18:09:32.845288+0000', 'last_up_change': '2024-05-08T18:07:00.796481+0000', 'last_in_change': '2024-05-08T18:06:51.530709+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T18:07:01.699859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-08T18:07:07.479756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2024-05-08T18:07:14.110093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2024-05-08T18:07:15.798248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': '.rgw.root', 'create_time': '2024-05-08T18:07:17.763573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'default.rgw.log', 'create_time': '2024-05-08T18:07:19.656809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'default.rgw.control', 'create_time': '2024-05-08T18:07:21.569514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2024-05-08T18:07:23.704646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'e14e7bbc-18b8-4961-bcde-109f22cc52e6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6809', 'nonce': 3565382691}, {'type': 'v1', 'addr': '172.21.15.80:6812', 'nonce': 3565382691}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6815', 'nonce': 3565382691}, {'type': 'v1', 'addr': '172.21.15.80:6817', 'nonce': 3565382691}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6822', 'nonce': 3565382691}, {'type': 'v1', 'addr': '172.21.15.80:6823', 'nonce': 3565382691}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6819', 'nonce': 3565382691}, {'type': 'v1', 'addr': '172.21.15.80:6821', 'nonce': 3565382691}]}, 'public_addr': '172.21.15.80:6812/3565382691', 'cluster_addr': '172.21.15.80:6817/3565382691', 'heartbeat_back_addr': '172.21.15.80:6823/3565382691', 'heartbeat_front_addr': '172.21.15.80:6821/3565382691', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'd4ce30c2-52b8-45a3-8a34-b0addc8311dd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 84, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6800', 'nonce': 3922502534}, {'type': 'v1', 'addr': '172.21.15.80:6801', 'nonce': 3922502534}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6802', 'nonce': 3922502534}, {'type': 'v1', 'addr': '172.21.15.80:6803', 'nonce': 3922502534}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6806', 'nonce': 3922502534}, {'type': 'v1', 'addr': '172.21.15.80:6807', 'nonce': 3922502534}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6804', 'nonce': 3922502534}, {'type': 'v1', 'addr': '172.21.15.80:6805', 'nonce': 3922502534}]}, 'public_addr': '172.21.15.80:6801/3922502534', 'cluster_addr': '172.21.15.80:6803/3922502534', 'heartbeat_back_addr': '172.21.15.80:6807/3922502534', 'heartbeat_front_addr': '172.21.15.80:6805/3922502534', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0049cbe1-578f-4202-a572-2328d79f0496', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 47, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6824', 'nonce': 3474282780}, {'type': 'v1', 'addr': '172.21.15.80:6825', 'nonce': 3474282780}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6826', 'nonce': 3474282780}, {'type': 'v1', 'addr': '172.21.15.80:6827', 'nonce': 3474282780}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6830', 'nonce': 3474282780}, {'type': 'v1', 'addr': '172.21.15.80:6831', 'nonce': 3474282780}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6828', 'nonce': 3474282780}, {'type': 'v1', 'addr': '172.21.15.80:6829', 'nonce': 3474282780}]}, 'public_addr': '172.21.15.80:6825/3474282780', 'cluster_addr': '172.21.15.80:6827/3474282780', 'heartbeat_back_addr': '172.21.15.80:6831/3474282780', 'heartbeat_front_addr': '172.21.15.80:6829/3474282780', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '3ec754a0-b0ca-4d44-bce0-7c380245ec0a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 47, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6808', 'nonce': 3525633066}, {'type': 'v1', 'addr': '172.21.15.80:6810', 'nonce': 3525633066}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6811', 'nonce': 3525633066}, {'type': 'v1', 'addr': '172.21.15.80:6813', 'nonce': 3525633066}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6818', 'nonce': 3525633066}, {'type': 'v1', 'addr': '172.21.15.80:6820', 'nonce': 3525633066}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.80:6814', 'nonce': 3525633066}, {'type': 'v1', 'addr': '172.21.15.80:6816', 'nonce': 3525633066}]}, 'public_addr': '172.21.15.80:6810/3525633066', 'cluster_addr': '172.21.15.80:6813/3525633066', 'heartbeat_back_addr': '172.21.15.80:6820/3525633066', 'heartbeat_front_addr': '172.21.15.80:6816/3525633066', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 47, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6816', 'nonce': 4103080494}, {'type': 'v1', 'addr': '172.21.15.115:6817', 'nonce': 4103080494}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6819', 'nonce': 4103080494}, {'type': 'v1', 'addr': '172.21.15.115:6821', 'nonce': 4103080494}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6827', 'nonce': 4103080494}, {'type': 'v1', 'addr': '172.21.15.115:6829', 'nonce': 4103080494}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6823', 'nonce': 4103080494}, {'type': 'v1', 'addr': '172.21.15.115:6825', 'nonce': 4103080494}]}, 'public_addr': '172.21.15.115:6817/4103080494', 'cluster_addr': '172.21.15.115:6821/4103080494', 'heartbeat_back_addr': '172.21.15.115:6829/4103080494', 'heartbeat_front_addr': '172.21.15.115:6825/4103080494', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '3dc618ad-e40d-418e-844c-57572043f866', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6818', 'nonce': 87947085}, {'type': 'v1', 'addr': '172.21.15.115:6820', 'nonce': 87947085}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6822', 'nonce': 87947085}, {'type': 'v1', 'addr': '172.21.15.115:6824', 'nonce': 87947085}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6830', 'nonce': 87947085}, {'type': 'v1', 'addr': '172.21.15.115:6831', 'nonce': 87947085}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6826', 'nonce': 87947085}, {'type': 'v1', 'addr': '172.21.15.115:6828', 'nonce': 87947085}]}, 'public_addr': '172.21.15.115:6820/87947085', 'cluster_addr': '172.21.15.115:6824/87947085', 'heartbeat_back_addr': '172.21.15.115:6831/87947085', 'heartbeat_front_addr': '172.21.15.115:6828/87947085', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '1f8172c6-5d27-4542-80a6-1c630dddf752', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6800', 'nonce': 2090404725}, {'type': 'v1', 'addr': '172.21.15.115:6801', 'nonce': 2090404725}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6802', 'nonce': 2090404725}, {'type': 'v1', 'addr': '172.21.15.115:6803', 'nonce': 2090404725}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6806', 'nonce': 2090404725}, {'type': 'v1', 'addr': '172.21.15.115:6807', 'nonce': 2090404725}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6804', 'nonce': 2090404725}, {'type': 'v1', 'addr': '172.21.15.115:6805', 'nonce': 2090404725}]}, 'public_addr': '172.21.15.115:6801/2090404725', 'cluster_addr': '172.21.15.115:6803/2090404725', 'heartbeat_back_addr': '172.21.15.115:6807/2090404725', 'heartbeat_front_addr': '172.21.15.115:6805/2090404725', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e4146a73-11ca-4499-afa7-23e23d70a662', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6808', 'nonce': 133828553}, {'type': 'v1', 'addr': '172.21.15.115:6809', 'nonce': 133828553}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6810', 'nonce': 133828553}, {'type': 'v1', 'addr': '172.21.15.115:6811', 'nonce': 133828553}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6814', 'nonce': 133828553}, {'type': 'v1', 'addr': '172.21.15.115:6815', 'nonce': 133828553}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6812', 'nonce': 133828553}, {'type': 'v1', 'addr': '172.21.15.115:6813', 'nonce': 133828553}]}, 'public_addr': '172.21.15.115:6809/133828553', 'cluster_addr': '172.21.15.115:6811/133828553', 'heartbeat_back_addr': '172.21.15.115:6815/133828553', 'heartbeat_front_addr': '172.21.15.115:6813/133828553', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:56.936317+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:56.814583+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:57.168294+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:56.751445+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:57.091268+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:57.113133+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:57.054822+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:06:57.057214+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.3f', 'osds': [3, 7]}, {'pgid': '6.c', 'osds': [1, 7]}], 'pg_upmap_items': [{'pgid': '3.f', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '3.1e', 'mappings': [{'from': 3, 'to': 1}]}, {'pgid': '3.2a', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '3.3a', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '4.c', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '4.10', 'mappings': [{'from': 1, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-05-08T18:09:35.593 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:09:35.594 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.93 2024-05-08T18:09:35.595 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:35.595 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 94 2024-05-08T18:09:35.595 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:35.595 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:35.595 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0116598 s, 899 MB/s 2024-05-08T18:09:35.596 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:35.593+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:35.644 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.94 2024-05-08T18:09:35.645 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:35.645 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 95 2024-05-08T18:09:35.657 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:35.657 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:35.657 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0104033 s, 1.0 GB/s 2024-05-08T18:09:35.696 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:35.697+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:35.729 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:35.729 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:35.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.729 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2375 3.13 3:ca3ab424:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.bZOT8fXVYEqYoX4kzIRAcQpKCGz8ihc_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152 in=2097152b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:35.729 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:35.722535+0000", 2024-05-08T18:09:35.729 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0083843909999999997, 2024-05-08T18:09:35.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084163629999999996, 2024-05-08T18:09:35.729 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.729 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.729 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "waiting for sub ops", 2024-05-08T18:09:35.729 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:35.729 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:35.729 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:35.730 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2375 2024-05-08T18:09:35.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.730 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.722535+0000", 2024-05-08T18:09:35.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.722535+0000", 2024-05-08T18:09:35.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.722538+0000", 2024-05-08T18:09:35.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5729999999999999e-06 2024-05-08T18:09:35.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.724457+0000", 2024-05-08T18:09:35.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019186870000000001 2024-05-08T18:09:35.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.724498+0000", 2024-05-08T18:09:35.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0652999999999999e-05 2024-05-08T18:09:35.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.724522+0000", 2024-05-08T18:09:35.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4729999999999999e-05 2024-05-08T18:09:35.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.724733+0000", 2024-05-08T18:09:35.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021029100000000001 2024-05-08T18:09:35.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.725167+0000", 2024-05-08T18:09:35.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043441999999999998 2024-05-08T18:09:35.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:35.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.725637+0000", 2024-05-08T18:09:35.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00047022600000000002 2024-05-08T18:09:35.733 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.733 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.733 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.733 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:2374 3.16 e94/20 3:695c3abd:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.bZOT8fXVYEqYoX4kzIRAcQpKCGz8ihc_1:head v 94'11, mlcod=93'9)", 2024-05-08T18:09:35.733 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:35.723966+0000", 2024-05-08T18:09:35.733 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0069532869999999998, 2024-05-08T18:09:35.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0070347789999999997, 2024-05-08T18:09:35.733 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:35.733 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:35.733 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-05-08T18:09:35.734 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:35.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:35.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.723966+0000", 2024-05-08T18:09:35.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:35.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.723966+0000", 2024-05-08T18:09:35.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:35.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:35.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.723968+0000", 2024-05-08T18:09:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.176e-06 2024-05-08T18:09:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.727091+0000", 2024-05-08T18:09:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003123083 2024-05-08T18:09:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.727116+0000", 2024-05-08T18:09:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5072e-05 2024-05-08T18:09:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:35.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.727127+0000", 2024-05-08T18:09:35.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0978999999999999e-05 2024-05-08T18:09:35.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:35.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.727257+0000", 2024-05-08T18:09:35.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000129932 2024-05-08T18:09:35.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:35.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:35.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:35.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.727311+0000", 2024-05-08T18:09:35.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4026000000000001e-05 2024-05-08T18:09:35.736 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.736 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:35.736 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.737 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:35.737 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-05-08T18:09:35.737 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 2 2024-05-08T18:09:35.737 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:35.746 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:09:35.771 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.95 2024-05-08T18:09:35.771 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:35.771 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 96 2024-05-08T18:09:35.782 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:35.782 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:35.782 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00931763 s, 1.1 GB/s 2024-05-08T18:09:35.832 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:35.833+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:35.875 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-05-08T18:09:35.890 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.96 2024-05-08T18:09:35.890 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:35.890 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 97 2024-05-08T18:09:35.897 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:35.896+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:35.904 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:35.904 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:35.905 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119152 s, 880 MB/s 2024-05-08T18:09:35.918 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:35.918 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:35.918 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:35.918 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:35.918 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:35.932 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:09:35.948 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:09:35.955 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:09:35.971 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2024-05-08T18:09:35.885548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1667928487,"num_objects":642,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":642,"num_whiteouts":0,"num_read":1778,"num_read_kb":1025119,"num_write":2051,"num_write_kb":1671035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1270,"ondisk_log_size":1270,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3442308,"kb_used_data":3192872,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":751532412,"statfs":{"total":773094113280,"available":769569189888,"internally_reserved":0,"allocated":3269500928,"data_stored":3265350854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":387973120,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":263,"num_read_kb":189,"num_write":600,"num_write_kb":378962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.182392"},"pg_stats":[{"pgid":"3.3f","version":"93'8","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.865083+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:09:29.865083+0000","last_peered":"2024-05-08T18:09:29.865083+0000","last_clean":"2024-05-08T18:09:29.865083+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:09:29.865083+0000","last_undegraded":"2024-05-08T18:09:29.865083+0000","last_fullsized":"2024-05-08T18:09:29.865083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.999954+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:09:29.999954+0000","last_peered":"2024-05-08T18:09:29.999954+0000","last_clean":"2024-05-08T18:09:29.999954+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:09:29.999954+0000","last_undegraded":"2024-05-08T18:09:29.999954+0000","last_fullsized":"2024-05-08T18:09:29.999954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"93'7","reported_seq":165,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.028879+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:09:31.028879+0000","last_peered":"2024-05-08T18:09:31.028879+0000","last_clean":"2024-05-08T18:09:31.028879+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:09:31.028879+0000","last_undegraded":"2024-05-08T18:09:31.028879+0000","last_fullsized":"2024-05-08T18:09:31.028879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8198,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864274+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:09:29.864274+0000","last_peered":"2024-05-08T18:09:29.864274+0000","last_clean":"2024-05-08T18:09:29.864274+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:09:29.864274+0000","last_undegraded":"2024-05-08T18:09:29.864274+0000","last_fullsized":"2024-05-08T18:09:29.864274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"93'12","reported_seq":171,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864614+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:09:29.864614+0000","last_peered":"2024-05-08T18:09:29.864614+0000","last_clean":"2024-05-08T18:09:29.864614+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:09:29.864614+0000","last_undegraded":"2024-05-08T18:09:29.864614+0000","last_fullsized":"2024-05-08T18:09:29.864614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":22,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.855015+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:09:29.855015+0000","last_peered":"2024-05-08T18:09:29.855015+0000","last_clean":"2024-05-08T18:09:29.855015+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:09:29.855015+0000","last_undegraded":"2024-05-08T18:09:29.855015+0000","last_fullsized":"2024-05-08T18:09:29.855015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"92'9","reported_seq":170,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.001038+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:09:30.001038+0000","last_peered":"2024-05-08T18:09:30.001038+0000","last_clean":"2024-05-08T18:09:30.001038+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:09:30.001038+0000","last_undegraded":"2024-05-08T18:09:30.001038+0000","last_fullsized":"2024-05-08T18:09:30.001038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":19,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":148,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.866772+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:09:29.866772+0000","last_peered":"2024-05-08T18:09:29.866772+0000","last_clean":"2024-05-08T18:09:29.866772+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:09:29.866772+0000","last_undegraded":"2024-05-08T18:09:29.866772+0000","last_fullsized":"2024-05-08T18:09:29.866772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"91'3","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864411+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:09:29.864411+0000","last_peered":"2024-05-08T18:09:29.864411+0000","last_clean":"2024-05-08T18:09:29.864411+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:09:29.864411+0000","last_undegraded":"2024-05-08T18:09:29.864411+0000","last_fullsized":"2024-05-08T18:09:29.864411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892327+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:09:29.892327+0000","last_peered":"2024-05-08T18:09:29.892327+0000","last_clean":"2024-05-08T18:09:29.892327+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:09:29.892327+0000","last_undegraded":"2024-05-08T18:09:29.892327+0000","last_fullsized":"2024-05-08T18:09:29.892327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"93'3","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.988040+0000","last_change":"2024-05-08T18:07:55.439965+0000","last_active":"2024-05-08T18:09:29.988040+0000","last_peered":"2024-05-08T18:09:29.988040+0000","last_clean":"2024-05-08T18:09:29.988040+0000","last_became_active":"2024-05-08T18:07:55.439578+0000","last_became_peered":"2024-05-08T18:07:55.439578+0000","last_unstale":"2024-05-08T18:09:29.988040+0000","last_undegraded":"2024-05-08T18:09:29.988040+0000","last_fullsized":"2024-05-08T18:09:29.988040+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:30.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"93'26","reported_seq":179,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.191868+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:09:31.191868+0000","last_peered":"2024-05-08T18:09:31.191868+0000","last_clean":"2024-05-08T18:09:31.191868+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:09:31.191868+0000","last_undegraded":"2024-05-08T18:09:31.191868+0000","last_fullsized":"2024-05-08T18:09:31.191868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":60,"num_write":37,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"93'7","reported_seq":165,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864484+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:09:29.864484+0000","last_peered":"2024-05-08T18:09:29.864484+0000","last_clean":"2024-05-08T18:09:29.864484+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:09:29.864484+0000","last_undegraded":"2024-05-08T18:09:29.864484+0000","last_fullsized":"2024-05-08T18:09:29.864484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":17,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.001843+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:09:30.001843+0000","last_peered":"2024-05-08T18:09:30.001843+0000","last_clean":"2024-05-08T18:09:30.001843+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:09:30.001843+0000","last_undegraded":"2024-05-08T18:09:30.001843+0000","last_fullsized":"2024-05-08T18:09:30.001843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"93'5","reported_seq":162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863241+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:09:29.863241+0000","last_peered":"2024-05-08T18:09:29.863241+0000","last_clean":"2024-05-08T18:09:29.863241+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:09:29.863241+0000","last_undegraded":"2024-05-08T18:09:29.863241+0000","last_fullsized":"2024-05-08T18:09:29.863241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":25,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":112,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.874162+0000","last_change":"2024-05-08T18:07:47.007132+0000","last_active":"2024-05-08T18:09:29.874162+0000","last_peered":"2024-05-08T18:09:29.874162+0000","last_clean":"2024-05-08T18:09:29.874162+0000","last_became_active":"2024-05-08T18:07:47.006744+0000","last_became_peered":"2024-05-08T18:07:47.006744+0000","last_unstale":"2024-05-08T18:09:29.874162+0000","last_undegraded":"2024-05-08T18:09:29.874162+0000","last_fullsized":"2024-05-08T18:09:29.874162+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:32.802677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.854913+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:09:29.854913+0000","last_peered":"2024-05-08T18:09:29.854913+0000","last_clean":"2024-05-08T18:09:29.854913+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:09:29.854913+0000","last_undegraded":"2024-05-08T18:09:29.854913+0000","last_fullsized":"2024-05-08T18:09:29.854913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"92'10","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.865025+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:09:29.865025+0000","last_peered":"2024-05-08T18:09:29.865025+0000","last_clean":"2024-05-08T18:09:29.865025+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:09:29.865025+0000","last_undegraded":"2024-05-08T18:09:29.865025+0000","last_fullsized":"2024-05-08T18:09:29.865025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864271+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:09:29.864271+0000","last_peered":"2024-05-08T18:09:29.864271+0000","last_clean":"2024-05-08T18:09:29.864271+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:09:29.864271+0000","last_undegraded":"2024-05-08T18:09:29.864271+0000","last_fullsized":"2024-05-08T18:09:29.864271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"92'8","reported_seq":165,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892712+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:09:29.892712+0000","last_peered":"2024-05-08T18:09:29.892712+0000","last_clean":"2024-05-08T18:09:29.892712+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:09:29.892712+0000","last_undegraded":"2024-05-08T18:09:29.892712+0000","last_fullsized":"2024-05-08T18:09:29.892712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"93'23","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.027718+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:09:31.027718+0000","last_peered":"2024-05-08T18:09:31.027718+0000","last_clean":"2024-05-08T18:09:31.027718+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:09:31.027718+0000","last_undegraded":"2024-05-08T18:09:31.027718+0000","last_fullsized":"2024-05-08T18:09:31.027718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":55,"num_write":33,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"91'5","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892951+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:09:29.892951+0000","last_peered":"2024-05-08T18:09:29.892951+0000","last_clean":"2024-05-08T18:09:29.892951+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:09:29.892951+0000","last_undegraded":"2024-05-08T18:09:29.892951+0000","last_fullsized":"2024-05-08T18:09:29.892951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.988145+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:09:29.988145+0000","last_peered":"2024-05-08T18:09:29.988145+0000","last_clean":"2024-05-08T18:09:29.988145+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:09:29.988145+0000","last_undegraded":"2024-05-08T18:09:29.988145+0000","last_fullsized":"2024-05-08T18:09:29.988145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"92'6","reported_seq":162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.855978+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:09:29.855978+0000","last_peered":"2024-05-08T18:09:29.855978+0000","last_clean":"2024-05-08T18:09:29.855978+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:09:29.855978+0000","last_undegraded":"2024-05-08T18:09:29.855978+0000","last_fullsized":"2024-05-08T18:09:29.855978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.988662+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:09:29.988662+0000","last_peered":"2024-05-08T18:09:29.988662+0000","last_clean":"2024-05-08T18:09:29.988662+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:09:29.988662+0000","last_undegraded":"2024-05-08T18:09:29.988662+0000","last_fullsized":"2024-05-08T18:09:29.988662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"92'5","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.865184+0000","last_change":"2024-05-08T18:07:15.480500+0000","last_active":"2024-05-08T18:09:29.865184+0000","last_peered":"2024-05-08T18:09:29.865184+0000","last_clean":"2024-05-08T18:09:29.865184+0000","last_became_active":"2024-05-08T18:07:15.480192+0000","last_became_peered":"2024-05-08T18:07:15.480192+0000","last_unstale":"2024-05-08T18:09:29.865184+0000","last_undegraded":"2024-05-08T18:09:29.865184+0000","last_fullsized":"2024-05-08T18:09:29.865184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.856806+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:09:29.856806+0000","last_peered":"2024-05-08T18:09:29.856806+0000","last_clean":"2024-05-08T18:09:29.856806+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:09:29.856806+0000","last_undegraded":"2024-05-08T18:09:29.856806+0000","last_fullsized":"2024-05-08T18:09:29.856806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"93'8","reported_seq":165,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.116068+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:09:30.116068+0000","last_peered":"2024-05-08T18:09:30.116068+0000","last_clean":"2024-05-08T18:09:30.116068+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:09:30.116068+0000","last_undegraded":"2024-05-08T18:09:30.116068+0000","last_fullsized":"2024-05-08T18:09:30.116068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":133,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.854430+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:09:29.854430+0000","last_peered":"2024-05-08T18:09:29.854430+0000","last_clean":"2024-05-08T18:09:29.854430+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:09:29.854430+0000","last_undegraded":"2024-05-08T18:09:29.854430+0000","last_fullsized":"2024-05-08T18:09:29.854430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.872461+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:09:29.872461+0000","last_peered":"2024-05-08T18:09:29.872461+0000","last_clean":"2024-05-08T18:09:29.872461+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:09:29.872461+0000","last_undegraded":"2024-05-08T18:09:29.872461+0000","last_fullsized":"2024-05-08T18:09:29.872461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"93'7","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864616+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:09:29.864616+0000","last_peered":"2024-05-08T18:09:29.864616+0000","last_clean":"2024-05-08T18:09:29.864616+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:09:29.864616+0000","last_undegraded":"2024-05-08T18:09:29.864616+0000","last_fullsized":"2024-05-08T18:09:29.864616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.001374+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:09:30.001374+0000","last_peered":"2024-05-08T18:09:30.001374+0000","last_clean":"2024-05-08T18:09:30.001374+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:09:30.001374+0000","last_undegraded":"2024-05-08T18:09:30.001374+0000","last_fullsized":"2024-05-08T18:09:30.001374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"90'10","reported_seq":157,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.868257+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:09:29.868257+0000","last_peered":"2024-05-08T18:09:29.868257+0000","last_clean":"2024-05-08T18:09:29.868257+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:09:29.868257+0000","last_undegraded":"2024-05-08T18:09:29.868257+0000","last_fullsized":"2024-05-08T18:09:29.868257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":138,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864834+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:09:29.864834+0000","last_peered":"2024-05-08T18:09:29.864834+0000","last_clean":"2024-05-08T18:09:29.864834+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:09:29.864834+0000","last_undegraded":"2024-05-08T18:09:29.864834+0000","last_fullsized":"2024-05-08T18:09:29.864834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":133,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.999769+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:09:29.999769+0000","last_peered":"2024-05-08T18:09:29.999769+0000","last_clean":"2024-05-08T18:09:29.999769+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:09:29.999769+0000","last_undegraded":"2024-05-08T18:09:29.999769+0000","last_fullsized":"2024-05-08T18:09:29.999769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.001940+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:09:30.001940+0000","last_peered":"2024-05-08T18:09:30.001940+0000","last_clean":"2024-05-08T18:09:30.001940+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:09:30.001940+0000","last_undegraded":"2024-05-08T18:09:30.001940+0000","last_fullsized":"2024-05-08T18:09:30.001940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"93'7","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.023756+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:09:30.023756+0000","last_peered":"2024-05-08T18:09:30.023756+0000","last_clean":"2024-05-08T18:09:30.023756+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:09:30.023756+0000","last_undegraded":"2024-05-08T18:09:30.023756+0000","last_fullsized":"2024-05-08T18:09:30.023756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":27,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":146,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.872335+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:09:29.872335+0000","last_peered":"2024-05-08T18:09:29.872335+0000","last_clean":"2024-05-08T18:09:29.872335+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:09:29.872335+0000","last_undegraded":"2024-05-08T18:09:29.872335+0000","last_fullsized":"2024-05-08T18:09:29.872335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.857012+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:09:29.857012+0000","last_peered":"2024-05-08T18:09:29.857012+0000","last_clean":"2024-05-08T18:09:29.857012+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:09:29.857012+0000","last_undegraded":"2024-05-08T18:09:29.857012+0000","last_fullsized":"2024-05-08T18:09:29.857012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":137,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.856633+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:09:29.856633+0000","last_peered":"2024-05-08T18:09:29.856633+0000","last_clean":"2024-05-08T18:09:29.856633+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:09:29.856633+0000","last_undegraded":"2024-05-08T18:09:29.856633+0000","last_fullsized":"2024-05-08T18:09:29.856633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":132,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864449+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:09:29.864449+0000","last_peered":"2024-05-08T18:09:29.864449+0000","last_clean":"2024-05-08T18:09:29.864449+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:09:29.864449+0000","last_undegraded":"2024-05-08T18:09:29.864449+0000","last_fullsized":"2024-05-08T18:09:29.864449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"90'6","reported_seq":157,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.870470+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:09:29.870470+0000","last_peered":"2024-05-08T18:09:29.870470+0000","last_clean":"2024-05-08T18:09:29.870470+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:09:29.870470+0000","last_undegraded":"2024-05-08T18:09:29.870470+0000","last_fullsized":"2024-05-08T18:09:29.870470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"93'5","reported_seq":162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864697+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:09:29.864697+0000","last_peered":"2024-05-08T18:09:29.864697+0000","last_clean":"2024-05-08T18:09:29.864697+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:09:29.864697+0000","last_undegraded":"2024-05-08T18:09:29.864697+0000","last_fullsized":"2024-05-08T18:09:29.864697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":146,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.874074+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:09:29.874074+0000","last_peered":"2024-05-08T18:09:29.874074+0000","last_clean":"2024-05-08T18:09:29.874074+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:09:29.874074+0000","last_undegraded":"2024-05-08T18:09:29.874074+0000","last_fullsized":"2024-05-08T18:09:29.874074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":157,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.988370+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:09:29.988370+0000","last_peered":"2024-05-08T18:09:29.988370+0000","last_clean":"2024-05-08T18:09:29.988370+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:09:29.988370+0000","last_undegraded":"2024-05-08T18:09:29.988370+0000","last_fullsized":"2024-05-08T18:09:29.988370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"90'11","reported_seq":184,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864602+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:09:29.864602+0000","last_peered":"2024-05-08T18:09:29.864602+0000","last_clean":"2024-05-08T18:09:29.864602+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:09:29.864602+0000","last_undegraded":"2024-05-08T18:09:29.864602+0000","last_fullsized":"2024-05-08T18:09:29.864602+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"90'1","reported_seq":134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.855402+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:09:29.855402+0000","last_peered":"2024-05-08T18:09:29.855402+0000","last_clean":"2024-05-08T18:09:29.855402+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:09:29.855402+0000","last_undegraded":"2024-05-08T18:09:29.855402+0000","last_fullsized":"2024-05-08T18:09:29.855402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.873744+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:09:29.873744+0000","last_peered":"2024-05-08T18:09:29.873744+0000","last_clean":"2024-05-08T18:09:29.873744+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:09:29.873744+0000","last_undegraded":"2024-05-08T18:09:29.873744+0000","last_fullsized":"2024-05-08T18:09:29.873744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"92'5","reported_seq":157,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892084+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:09:29.892084+0000","last_peered":"2024-05-08T18:09:29.892084+0000","last_clean":"2024-05-08T18:09:29.892084+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:09:29.892084+0000","last_undegraded":"2024-05-08T18:09:29.892084+0000","last_fullsized":"2024-05-08T18:09:29.892084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.001714+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:09:30.001714+0000","last_peered":"2024-05-08T18:09:30.001714+0000","last_clean":"2024-05-08T18:09:30.001714+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:09:30.001714+0000","last_undegraded":"2024-05-08T18:09:30.001714+0000","last_fullsized":"2024-05-08T18:09:30.001714+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"90'10","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864842+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:09:29.864842+0000","last_peered":"2024-05-08T18:09:29.864842+0000","last_clean":"2024-05-08T18:09:29.864842+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:09:29.864842+0000","last_undegraded":"2024-05-08T18:09:29.864842+0000","last_fullsized":"2024-05-08T18:09:29.864842+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"90'11","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.862927+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:09:29.862927+0000","last_peered":"2024-05-08T18:09:29.862927+0000","last_clean":"2024-05-08T18:09:29.862927+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:09:29.862927+0000","last_undegraded":"2024-05-08T18:09:29.862927+0000","last_fullsized":"2024-05-08T18:09:29.862927+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.000210+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:09:30.000210+0000","last_peered":"2024-05-08T18:09:30.000210+0000","last_clean":"2024-05-08T18:09:30.000210+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:09:30.000210+0000","last_undegraded":"2024-05-08T18:09:30.000210+0000","last_fullsized":"2024-05-08T18:09:30.000210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"93'13","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.988653+0000","last_change":"2024-05-08T18:07:55.357969+0000","last_active":"2024-05-08T18:09:29.988653+0000","last_peered":"2024-05-08T18:09:29.988653+0000","last_clean":"2024-05-08T18:09:29.988653+0000","last_became_active":"2024-05-08T18:07:55.357205+0000","last_became_peered":"2024-05-08T18:07:55.357205+0000","last_unstale":"2024-05-08T18:09:29.988653+0000","last_undegraded":"2024-05-08T18:09:29.988653+0000","last_fullsized":"2024-05-08T18:09:29.988653+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:04.667292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":12,"num_read_kb":28678,"num_write":33,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":147,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864091+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:09:29.864091+0000","last_peered":"2024-05-08T18:09:29.864091+0000","last_clean":"2024-05-08T18:09:29.864091+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:09:29.864091+0000","last_undegraded":"2024-05-08T18:09:29.864091+0000","last_fullsized":"2024-05-08T18:09:29.864091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"90'20","reported_seq":174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.999985+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:09:29.999985+0000","last_peered":"2024-05-08T18:09:29.999985+0000","last_clean":"2024-05-08T18:09:29.999985+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:09:29.999985+0000","last_undegraded":"2024-05-08T18:09:29.999985+0000","last_fullsized":"2024-05-08T18:09:29.999985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":138,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.073166+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:09:30.073166+0000","last_peered":"2024-05-08T18:09:30.073166+0000","last_clean":"2024-05-08T18:09:30.073166+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:09:30.073166+0000","last_undegraded":"2024-05-08T18:09:30.073166+0000","last_fullsized":"2024-05-08T18:09:30.073166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.000942+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:09:30.000942+0000","last_peered":"2024-05-08T18:09:30.000942+0000","last_clean":"2024-05-08T18:09:30.000942+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:09:30.000942+0000","last_undegraded":"2024-05-08T18:09:30.000942+0000","last_fullsized":"2024-05-08T18:09:30.000942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"90'2","reported_seq":155,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.855344+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:09:29.855344+0000","last_peered":"2024-05-08T18:09:29.855344+0000","last_clean":"2024-05-08T18:09:29.855344+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:09:29.855344+0000","last_undegraded":"2024-05-08T18:09:29.855344+0000","last_fullsized":"2024-05-08T18:09:29.855344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"91'6","reported_seq":165,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864962+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:09:29.864962+0000","last_peered":"2024-05-08T18:09:29.864962+0000","last_clean":"2024-05-08T18:09:29.864962+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:09:29.864962+0000","last_undegraded":"2024-05-08T18:09:29.864962+0000","last_fullsized":"2024-05-08T18:09:29.864962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":12294,"num_write":36,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":147,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.987812+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:09:29.987812+0000","last_peered":"2024-05-08T18:09:29.987812+0000","last_clean":"2024-05-08T18:09:29.987812+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:09:29.987812+0000","last_undegraded":"2024-05-08T18:09:29.987812+0000","last_fullsized":"2024-05-08T18:09:29.987812+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"90'10","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.866266+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:09:29.866266+0000","last_peered":"2024-05-08T18:09:29.866266+0000","last_clean":"2024-05-08T18:09:29.866266+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:09:29.866266+0000","last_undegraded":"2024-05-08T18:09:29.866266+0000","last_fullsized":"2024-05-08T18:09:29.866266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":138,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.862936+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:09:29.862936+0000","last_peered":"2024-05-08T18:09:29.862936+0000","last_clean":"2024-05-08T18:09:29.862936+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:09:29.862936+0000","last_undegraded":"2024-05-08T18:09:29.862936+0000","last_fullsized":"2024-05-08T18:09:29.862936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":133,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892651+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:09:29.892651+0000","last_peered":"2024-05-08T18:09:29.892651+0000","last_clean":"2024-05-08T18:09:29.892651+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:09:29.892651+0000","last_undegraded":"2024-05-08T18:09:29.892651+0000","last_fullsized":"2024-05-08T18:09:29.892651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"93'11","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.230038+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:09:30.230038+0000","last_peered":"2024-05-08T18:09:30.230038+0000","last_clean":"2024-05-08T18:09:30.230038+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:09:30.230038+0000","last_undegraded":"2024-05-08T18:09:30.230038+0000","last_fullsized":"2024-05-08T18:09:30.230038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":16,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"91'2","reported_seq":158,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.865420+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:09:29.865420+0000","last_peered":"2024-05-08T18:09:29.865420+0000","last_clean":"2024-05-08T18:09:29.865420+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:09:29.865420+0000","last_undegraded":"2024-05-08T18:09:29.865420+0000","last_fullsized":"2024-05-08T18:09:29.865420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":146,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.988378+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:09:29.988378+0000","last_peered":"2024-05-08T18:09:29.988378+0000","last_clean":"2024-05-08T18:09:29.988378+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:09:29.988378+0000","last_undegraded":"2024-05-08T18:09:29.988378+0000","last_fullsized":"2024-05-08T18:09:29.988378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"90'16","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864093+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:09:29.864093+0000","last_peered":"2024-05-08T18:09:29.864093+0000","last_clean":"2024-05-08T18:09:29.864093+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:09:29.864093+0000","last_undegraded":"2024-05-08T18:09:29.864093+0000","last_fullsized":"2024-05-08T18:09:29.864093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"90'11","reported_seq":173,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863978+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:09:29.863978+0000","last_peered":"2024-05-08T18:09:29.863978+0000","last_clean":"2024-05-08T18:09:29.863978+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:09:29.863978+0000","last_undegraded":"2024-05-08T18:09:29.863978+0000","last_fullsized":"2024-05-08T18:09:29.863978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"90'1","reported_seq":133,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.868794+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:09:29.868794+0000","last_peered":"2024-05-08T18:09:29.868794+0000","last_clean":"2024-05-08T18:09:29.868794+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:09:29.868794+0000","last_undegraded":"2024-05-08T18:09:29.868794+0000","last_fullsized":"2024-05-08T18:09:29.868794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.868645+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:09:29.868645+0000","last_peered":"2024-05-08T18:09:29.868645+0000","last_clean":"2024-05-08T18:09:29.868645+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:09:29.868645+0000","last_undegraded":"2024-05-08T18:09:29.868645+0000","last_fullsized":"2024-05-08T18:09:29.868645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"92'10","reported_seq":171,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.001251+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:09:30.001251+0000","last_peered":"2024-05-08T18:09:30.001251+0000","last_clean":"2024-05-08T18:09:30.001251+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:09:30.001251+0000","last_undegraded":"2024-05-08T18:09:30.001251+0000","last_fullsized":"2024-05-08T18:09:30.001251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":147,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.988205+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:09:29.988205+0000","last_peered":"2024-05-08T18:09:29.988205+0000","last_clean":"2024-05-08T18:09:29.988205+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:09:29.988205+0000","last_undegraded":"2024-05-08T18:09:29.988205+0000","last_fullsized":"2024-05-08T18:09:29.988205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"90'14","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864957+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:09:29.864957+0000","last_peered":"2024-05-08T18:09:29.864957+0000","last_clean":"2024-05-08T18:09:29.864957+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:09:29.864957+0000","last_undegraded":"2024-05-08T18:09:29.864957+0000","last_fullsized":"2024-05-08T18:09:29.864957+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":138,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.987725+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:09:29.987725+0000","last_peered":"2024-05-08T18:09:29.987725+0000","last_clean":"2024-05-08T18:09:29.987725+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:09:29.987725+0000","last_undegraded":"2024-05-08T18:09:29.987725+0000","last_fullsized":"2024-05-08T18:09:29.987725+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.074447+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:09:30.074447+0000","last_peered":"2024-05-08T18:09:30.074447+0000","last_clean":"2024-05-08T18:09:30.074447+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:09:30.074447+0000","last_undegraded":"2024-05-08T18:09:30.074447+0000","last_fullsized":"2024-05-08T18:09:30.074447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":155,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.856553+0000","last_change":"2024-05-08T18:07:55.356946+0000","last_active":"2024-05-08T18:09:29.856553+0000","last_peered":"2024-05-08T18:09:29.856553+0000","last_clean":"2024-05-08T18:09:29.856553+0000","last_became_active":"2024-05-08T18:07:55.355948+0000","last_became_peered":"2024-05-08T18:07:55.355948+0000","last_unstale":"2024-05-08T18:09:29.856553+0000","last_undegraded":"2024-05-08T18:09:29.856553+0000","last_fullsized":"2024-05-08T18:09:29.856553+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:04.163382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"91'7","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864646+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:09:29.864646+0000","last_peered":"2024-05-08T18:09:29.864646+0000","last_clean":"2024-05-08T18:09:29.864646+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:09:29.864646+0000","last_undegraded":"2024-05-08T18:09:29.864646+0000","last_fullsized":"2024-05-08T18:09:29.864646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":146,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.988347+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:09:29.988347+0000","last_peered":"2024-05-08T18:09:29.988347+0000","last_clean":"2024-05-08T18:09:29.988347+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:09:29.988347+0000","last_undegraded":"2024-05-08T18:09:29.988347+0000","last_fullsized":"2024-05-08T18:09:29.988347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"91'14","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.856894+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:09:29.856894+0000","last_peered":"2024-05-08T18:09:29.856894+0000","last_clean":"2024-05-08T18:09:29.856894+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:09:29.856894+0000","last_undegraded":"2024-05-08T18:09:29.856894+0000","last_fullsized":"2024-05-08T18:09:29.856894+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":17,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":136,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864908+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:09:29.864908+0000","last_peered":"2024-05-08T18:09:29.864908+0000","last_clean":"2024-05-08T18:09:29.864908+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:09:29.864908+0000","last_undegraded":"2024-05-08T18:09:29.864908+0000","last_fullsized":"2024-05-08T18:09:29.864908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"90'2","reported_seq":137,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.862333+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:09:29.862333+0000","last_peered":"2024-05-08T18:09:29.862333+0000","last_clean":"2024-05-08T18:09:29.862333+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:09:29.862333+0000","last_undegraded":"2024-05-08T18:09:29.862333+0000","last_fullsized":"2024-05-08T18:09:29.862333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.857064+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:09:29.857064+0000","last_peered":"2024-05-08T18:09:29.857064+0000","last_clean":"2024-05-08T18:09:29.857064+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:09:29.857064+0000","last_undegraded":"2024-05-08T18:09:29.857064+0000","last_fullsized":"2024-05-08T18:09:29.857064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"93'3","reported_seq":156,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892418+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:09:29.892418+0000","last_peered":"2024-05-08T18:09:29.892418+0000","last_clean":"2024-05-08T18:09:29.892418+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:09:29.892418+0000","last_undegraded":"2024-05-08T18:09:29.892418+0000","last_fullsized":"2024-05-08T18:09:29.892418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":146,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.073497+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:09:30.073497+0000","last_peered":"2024-05-08T18:09:30.073497+0000","last_clean":"2024-05-08T18:09:30.073497+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:09:30.073497+0000","last_undegraded":"2024-05-08T18:09:30.073497+0000","last_fullsized":"2024-05-08T18:09:30.073497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"90'16","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.988812+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:09:29.988812+0000","last_peered":"2024-05-08T18:09:29.988812+0000","last_clean":"2024-05-08T18:09:29.988812+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:09:29.988812+0000","last_undegraded":"2024-05-08T18:09:29.988812+0000","last_fullsized":"2024-05-08T18:09:29.988812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"90'11","reported_seq":178,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.988559+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:09:29.988559+0000","last_peered":"2024-05-08T18:09:29.988559+0000","last_clean":"2024-05-08T18:09:29.988559+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:09:29.988559+0000","last_undegraded":"2024-05-08T18:09:29.988559+0000","last_fullsized":"2024-05-08T18:09:29.988559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":135,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.073253+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:09:30.073253+0000","last_peered":"2024-05-08T18:09:30.073253+0000","last_clean":"2024-05-08T18:09:30.073253+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:09:30.073253+0000","last_undegraded":"2024-05-08T18:09:30.073253+0000","last_fullsized":"2024-05-08T18:09:30.073253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"93'17","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.396918+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:09:31.396918+0000","last_peered":"2024-05-08T18:09:31.396918+0000","last_clean":"2024-05-08T18:09:31.396918+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:09:31.396918+0000","last_undegraded":"2024-05-08T18:09:31.396918+0000","last_fullsized":"2024-05-08T18:09:31.396918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":25,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"93'8","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.856167+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:09:29.856167+0000","last_peered":"2024-05-08T18:09:29.856167+0000","last_clean":"2024-05-08T18:09:29.856167+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:09:29.856167+0000","last_undegraded":"2024-05-08T18:09:29.856167+0000","last_fullsized":"2024-05-08T18:09:29.856167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":18,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.001681+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:09:30.001681+0000","last_peered":"2024-05-08T18:09:30.001681+0000","last_clean":"2024-05-08T18:09:30.001681+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:09:30.001681+0000","last_undegraded":"2024-05-08T18:09:30.001681+0000","last_fullsized":"2024-05-08T18:09:30.001681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.073281+0000","last_change":"2024-05-08T18:09:06.402195+0000","last_active":"2024-05-08T18:09:30.073281+0000","last_peered":"2024-05-08T18:09:30.073281+0000","last_clean":"2024-05-08T18:09:30.073281+0000","last_became_active":"2024-05-08T18:09:06.380401+0000","last_became_peered":"2024-05-08T18:09:06.380401+0000","last_unstale":"2024-05-08T18:09:30.073281+0000","last_undegraded":"2024-05-08T18:09:30.073281+0000","last_fullsized":"2024-05-08T18:09:30.073281+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:36.840412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"90'11","reported_seq":176,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892506+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:09:29.892506+0000","last_peered":"2024-05-08T18:09:29.892506+0000","last_clean":"2024-05-08T18:09:29.892506+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:09:29.892506+0000","last_undegraded":"2024-05-08T18:09:29.892506+0000","last_fullsized":"2024-05-08T18:09:29.892506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.855145+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:09:29.855145+0000","last_peered":"2024-05-08T18:09:29.855145+0000","last_clean":"2024-05-08T18:09:29.855145+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:09:29.855145+0000","last_undegraded":"2024-05-08T18:09:29.855145+0000","last_fullsized":"2024-05-08T18:09:29.855145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":151,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.074797+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:09:30.074797+0000","last_peered":"2024-05-08T18:09:30.074797+0000","last_clean":"2024-05-08T18:09:30.074797+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:09:30.074797+0000","last_undegraded":"2024-05-08T18:09:30.074797+0000","last_fullsized":"2024-05-08T18:09:30.074797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"92'8","reported_seq":170,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863419+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:09:29.863419+0000","last_peered":"2024-05-08T18:09:29.863419+0000","last_clean":"2024-05-08T18:09:29.863419+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:09:29.863419+0000","last_undegraded":"2024-05-08T18:09:29.863419+0000","last_fullsized":"2024-05-08T18:09:29.863419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":153,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.857219+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:09:29.857219+0000","last_peered":"2024-05-08T18:09:29.857219+0000","last_clean":"2024-05-08T18:09:29.857219+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:09:29.857219+0000","last_undegraded":"2024-05-08T18:09:29.857219+0000","last_fullsized":"2024-05-08T18:09:29.857219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"90'19","reported_seq":171,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.001370+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:09:30.001370+0000","last_peered":"2024-05-08T18:09:30.001370+0000","last_clean":"2024-05-08T18:09:30.001370+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:09:30.001370+0000","last_undegraded":"2024-05-08T18:09:30.001370+0000","last_fullsized":"2024-05-08T18:09:30.001370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":31,"num_read_kb":21,"num_write":20,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":136,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892047+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:09:29.892047+0000","last_peered":"2024-05-08T18:09:29.892047+0000","last_clean":"2024-05-08T18:09:29.892047+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:09:29.892047+0000","last_undegraded":"2024-05-08T18:09:29.892047+0000","last_fullsized":"2024-05-08T18:09:29.892047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":135,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.073076+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:09:30.073076+0000","last_peered":"2024-05-08T18:09:30.073076+0000","last_clean":"2024-05-08T18:09:30.073076+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:09:30.073076+0000","last_undegraded":"2024-05-08T18:09:30.073076+0000","last_fullsized":"2024-05-08T18:09:30.073076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892807+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:09:29.892807+0000","last_peered":"2024-05-08T18:09:29.892807+0000","last_clean":"2024-05-08T18:09:29.892807+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:09:29.892807+0000","last_undegraded":"2024-05-08T18:09:29.892807+0000","last_fullsized":"2024-05-08T18:09:29.892807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":257,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864011+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:09:29.864011+0000","last_peered":"2024-05-08T18:09:29.864011+0000","last_clean":"2024-05-08T18:09:29.864011+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:09:29.864011+0000","last_undegraded":"2024-05-08T18:09:29.864011+0000","last_fullsized":"2024-05-08T18:09:29.864011+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.000959+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:09:30.000959+0000","last_peered":"2024-05-08T18:09:30.000959+0000","last_clean":"2024-05-08T18:09:30.000959+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:09:30.000959+0000","last_undegraded":"2024-05-08T18:09:30.000959+0000","last_fullsized":"2024-05-08T18:09:30.000959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'7","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863904+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:09:29.863904+0000","last_peered":"2024-05-08T18:09:29.863904+0000","last_clean":"2024-05-08T18:09:29.863904+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:09:29.863904+0000","last_undegraded":"2024-05-08T18:09:29.863904+0000","last_fullsized":"2024-05-08T18:09:29.863904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":24582,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":147,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864465+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:09:29.864465+0000","last_peered":"2024-05-08T18:09:29.864465+0000","last_clean":"2024-05-08T18:09:29.864465+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:09:29.864465+0000","last_undegraded":"2024-05-08T18:09:29.864465+0000","last_fullsized":"2024-05-08T18:09:29.864465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"90'16","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.001980+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:09:30.001980+0000","last_peered":"2024-05-08T18:09:30.001980+0000","last_clean":"2024-05-08T18:09:30.001980+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:09:30.001980+0000","last_undegraded":"2024-05-08T18:09:30.001980+0000","last_fullsized":"2024-05-08T18:09:30.001980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":136,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.869111+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:09:29.869111+0000","last_peered":"2024-05-08T18:09:29.869111+0000","last_clean":"2024-05-08T18:09:29.869111+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:09:29.869111+0000","last_undegraded":"2024-05-08T18:09:29.869111+0000","last_fullsized":"2024-05-08T18:09:29.869111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":132,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.891818+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:09:29.891818+0000","last_peered":"2024-05-08T18:09:29.891818+0000","last_clean":"2024-05-08T18:09:29.891818+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:09:29.891818+0000","last_undegraded":"2024-05-08T18:09:29.891818+0000","last_fullsized":"2024-05-08T18:09:29.891818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.870013+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:09:29.870013+0000","last_peered":"2024-05-08T18:09:29.870013+0000","last_clean":"2024-05-08T18:09:29.870013+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:09:29.870013+0000","last_undegraded":"2024-05-08T18:09:29.870013+0000","last_fullsized":"2024-05-08T18:09:29.870013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863888+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:09:29.863888+0000","last_peered":"2024-05-08T18:09:29.863888+0000","last_clean":"2024-05-08T18:09:29.863888+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:09:29.863888+0000","last_undegraded":"2024-05-08T18:09:29.863888+0000","last_fullsized":"2024-05-08T18:09:29.863888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.866158+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:09:29.866158+0000","last_peered":"2024-05-08T18:09:29.866158+0000","last_clean":"2024-05-08T18:09:29.866158+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:09:29.866158+0000","last_undegraded":"2024-05-08T18:09:29.866158+0000","last_fullsized":"2024-05-08T18:09:29.866158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":25,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":146,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.002259+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:09:30.002259+0000","last_peered":"2024-05-08T18:09:30.002259+0000","last_clean":"2024-05-08T18:09:30.002259+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:09:30.002259+0000","last_undegraded":"2024-05-08T18:09:30.002259+0000","last_fullsized":"2024-05-08T18:09:30.002259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"90'34","reported_seq":224,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.073378+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:09:30.073378+0000","last_peered":"2024-05-08T18:09:30.073378+0000","last_clean":"2024-05-08T18:09:30.073378+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:09:30.073378+0000","last_undegraded":"2024-05-08T18:09:30.073378+0000","last_fullsized":"2024-05-08T18:09:30.073378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19535,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":55,"num_read_kb":40,"num_write":30,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":139,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864766+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:09:29.864766+0000","last_peered":"2024-05-08T18:09:29.864766+0000","last_clean":"2024-05-08T18:09:29.864766+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:09:29.864766+0000","last_undegraded":"2024-05-08T18:09:29.864766+0000","last_fullsized":"2024-05-08T18:09:29.864766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.073064+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:09:30.073064+0000","last_peered":"2024-05-08T18:09:30.073064+0000","last_clean":"2024-05-08T18:09:30.073064+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:09:30.073064+0000","last_undegraded":"2024-05-08T18:09:30.073064+0000","last_fullsized":"2024-05-08T18:09:30.073064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"93'9","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.118189+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:09:30.118189+0000","last_peered":"2024-05-08T18:09:30.118189+0000","last_clean":"2024-05-08T18:09:30.118189+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:09:30.118189+0000","last_undegraded":"2024-05-08T18:09:30.118189+0000","last_fullsized":"2024-05-08T18:09:30.118189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":20,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.987974+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:09:29.987974+0000","last_peered":"2024-05-08T18:09:29.987974+0000","last_clean":"2024-05-08T18:09:29.987974+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:09:29.987974+0000","last_undegraded":"2024-05-08T18:09:29.987974+0000","last_fullsized":"2024-05-08T18:09:29.987974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"92'7","reported_seq":165,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.072899+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:09:30.072899+0000","last_peered":"2024-05-08T18:09:30.072899+0000","last_clean":"2024-05-08T18:09:30.072899+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:09:30.072899+0000","last_undegraded":"2024-05-08T18:09:30.072899+0000","last_fullsized":"2024-05-08T18:09:30.072899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":148,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.988817+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:09:29.988817+0000","last_peered":"2024-05-08T18:09:29.988817+0000","last_clean":"2024-05-08T18:09:29.988817+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:09:29.988817+0000","last_undegraded":"2024-05-08T18:09:29.988817+0000","last_fullsized":"2024-05-08T18:09:29.988817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":190,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.865106+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:09:29.865106+0000","last_peered":"2024-05-08T18:09:29.865106+0000","last_clean":"2024-05-08T18:09:29.865106+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:09:29.865106+0000","last_undegraded":"2024-05-08T18:09:29.865106+0000","last_fullsized":"2024-05-08T18:09:29.865106+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":137,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.865963+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:09:29.865963+0000","last_peered":"2024-05-08T18:09:29.865963+0000","last_clean":"2024-05-08T18:09:29.865963+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:09:29.865963+0000","last_undegraded":"2024-05-08T18:09:29.865963+0000","last_fullsized":"2024-05-08T18:09:29.865963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.865676+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:09:29.865676+0000","last_peered":"2024-05-08T18:09:29.865676+0000","last_clean":"2024-05-08T18:09:29.865676+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:09:29.865676+0000","last_undegraded":"2024-05-08T18:09:29.865676+0000","last_fullsized":"2024-05-08T18:09:29.865676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"90'6","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.073725+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:09:30.073725+0000","last_peered":"2024-05-08T18:09:30.073725+0000","last_clean":"2024-05-08T18:09:30.073725+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:09:30.073725+0000","last_undegraded":"2024-05-08T18:09:30.073725+0000","last_fullsized":"2024-05-08T18:09:30.073725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.000608+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:09:30.000608+0000","last_peered":"2024-05-08T18:09:30.000608+0000","last_clean":"2024-05-08T18:09:30.000608+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:09:30.000608+0000","last_undegraded":"2024-05-08T18:09:30.000608+0000","last_fullsized":"2024-05-08T18:09:30.000608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"92'12","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.856077+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:09:29.856077+0000","last_peered":"2024-05-08T18:09:29.856077+0000","last_clean":"2024-05-08T18:09:29.856077+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:09:29.856077+0000","last_undegraded":"2024-05-08T18:09:29.856077+0000","last_fullsized":"2024-05-08T18:09:29.856077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":32,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864298+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:09:29.864298+0000","last_peered":"2024-05-08T18:09:29.864298+0000","last_clean":"2024-05-08T18:09:29.864298+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:09:29.864298+0000","last_undegraded":"2024-05-08T18:09:29.864298+0000","last_fullsized":"2024-05-08T18:09:29.864298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.873389+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:09:29.873389+0000","last_peered":"2024-05-08T18:09:29.873389+0000","last_clean":"2024-05-08T18:09:29.873389+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:09:29.873389+0000","last_undegraded":"2024-05-08T18:09:29.873389+0000","last_fullsized":"2024-05-08T18:09:29.873389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":135,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892767+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:09:29.892767+0000","last_peered":"2024-05-08T18:09:29.892767+0000","last_clean":"2024-05-08T18:09:29.892767+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:09:29.892767+0000","last_undegraded":"2024-05-08T18:09:29.892767+0000","last_fullsized":"2024-05-08T18:09:29.892767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":133,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.999596+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:09:29.999596+0000","last_peered":"2024-05-08T18:09:29.999596+0000","last_clean":"2024-05-08T18:09:29.999596+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:09:29.999596+0000","last_undegraded":"2024-05-08T18:09:29.999596+0000","last_fullsized":"2024-05-08T18:09:29.999596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'10","reported_seq":164,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.073253+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:09:30.073253+0000","last_peered":"2024-05-08T18:09:30.073253+0000","last_clean":"2024-05-08T18:09:30.073253+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:09:30.073253+0000","last_undegraded":"2024-05-08T18:09:30.073253+0000","last_fullsized":"2024-05-08T18:09:30.073253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"92'6","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.002165+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:09:30.002165+0000","last_peered":"2024-05-08T18:09:30.002165+0000","last_clean":"2024-05-08T18:09:30.002165+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:09:30.002165+0000","last_undegraded":"2024-05-08T18:09:30.002165+0000","last_fullsized":"2024-05-08T18:09:30.002165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":6,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.074047+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:09:30.074047+0000","last_peered":"2024-05-08T18:09:30.074047+0000","last_clean":"2024-05-08T18:09:30.074047+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:09:30.074047+0000","last_undegraded":"2024-05-08T18:09:30.074047+0000","last_fullsized":"2024-05-08T18:09:30.074047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.867465+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:09:29.867465+0000","last_peered":"2024-05-08T18:09:29.867465+0000","last_clean":"2024-05-08T18:09:29.867465+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:09:29.867465+0000","last_undegraded":"2024-05-08T18:09:29.867465+0000","last_fullsized":"2024-05-08T18:09:29.867465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"90'20","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864279+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:09:29.864279+0000","last_peered":"2024-05-08T18:09:29.864279+0000","last_clean":"2024-05-08T18:09:29.864279+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:09:29.864279+0000","last_undegraded":"2024-05-08T18:09:29.864279+0000","last_fullsized":"2024-05-08T18:09:29.864279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":138,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.854663+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:09:29.854663+0000","last_peered":"2024-05-08T18:09:29.854663+0000","last_clean":"2024-05-08T18:09:29.854663+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:09:29.854663+0000","last_undegraded":"2024-05-08T18:09:29.854663+0000","last_fullsized":"2024-05-08T18:09:29.854663+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"90'2","reported_seq":135,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.867739+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:09:29.867739+0000","last_peered":"2024-05-08T18:09:29.867739+0000","last_clean":"2024-05-08T18:09:29.867739+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:09:29.867739+0000","last_undegraded":"2024-05-08T18:09:29.867739+0000","last_fullsized":"2024-05-08T18:09:29.867739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"93'15","reported_seq":164,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.559686+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:09:31.559686+0000","last_peered":"2024-05-08T18:09:31.559686+0000","last_clean":"2024-05-08T18:09:31.559686+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:09:31.559686+0000","last_undegraded":"2024-05-08T18:09:31.559686+0000","last_fullsized":"2024-05-08T18:09:31.559686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":35,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"92'6","reported_seq":164,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.073841+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:09:30.073841+0000","last_peered":"2024-05-08T18:09:30.073841+0000","last_clean":"2024-05-08T18:09:30.073841+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:09:30.073841+0000","last_undegraded":"2024-05-08T18:09:30.073841+0000","last_fullsized":"2024-05-08T18:09:30.073841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":26,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.865545+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:09:29.865545+0000","last_peered":"2024-05-08T18:09:29.865545+0000","last_clean":"2024-05-08T18:09:29.865545+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:09:29.865545+0000","last_undegraded":"2024-05-08T18:09:29.865545+0000","last_fullsized":"2024-05-08T18:09:29.865545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892088+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:09:29.892088+0000","last_peered":"2024-05-08T18:09:29.892088+0000","last_clean":"2024-05-08T18:09:29.892088+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:09:29.892088+0000","last_undegraded":"2024-05-08T18:09:29.892088+0000","last_fullsized":"2024-05-08T18:09:29.892088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":164,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.073823+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:09:30.073823+0000","last_peered":"2024-05-08T18:09:30.073823+0000","last_clean":"2024-05-08T18:09:30.073823+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:09:30.073823+0000","last_undegraded":"2024-05-08T18:09:30.073823+0000","last_fullsized":"2024-05-08T18:09:30.073823+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"90'11","reported_seq":175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.000011+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:09:30.000011+0000","last_peered":"2024-05-08T18:09:30.000011+0000","last_clean":"2024-05-08T18:09:30.000011+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:09:30.000011+0000","last_undegraded":"2024-05-08T18:09:30.000011+0000","last_fullsized":"2024-05-08T18:09:30.000011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"90'3","reported_seq":138,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.873904+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:09:29.873904+0000","last_peered":"2024-05-08T18:09:29.873904+0000","last_clean":"2024-05-08T18:09:29.873904+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:09:29.873904+0000","last_undegraded":"2024-05-08T18:09:29.873904+0000","last_fullsized":"2024-05-08T18:09:29.873904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":151,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.862841+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:09:29.862841+0000","last_peered":"2024-05-08T18:09:29.862841+0000","last_clean":"2024-05-08T18:09:29.862841+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:09:29.862841+0000","last_undegraded":"2024-05-08T18:09:29.862841+0000","last_fullsized":"2024-05-08T18:09:29.862841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"93'8","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.890752+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:09:29.890752+0000","last_peered":"2024-05-08T18:09:29.890752+0000","last_clean":"2024-05-08T18:09:29.890752+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:09:29.890752+0000","last_undegraded":"2024-05-08T18:09:29.890752+0000","last_fullsized":"2024-05-08T18:09:29.890752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":18,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.075186+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:09:30.075186+0000","last_peered":"2024-05-08T18:09:30.075186+0000","last_clean":"2024-05-08T18:09:30.075186+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:09:30.075186+0000","last_undegraded":"2024-05-08T18:09:30.075186+0000","last_fullsized":"2024-05-08T18:09:30.075186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":146,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.854973+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:09:29.854973+0000","last_peered":"2024-05-08T18:09:29.854973+0000","last_clean":"2024-05-08T18:09:29.854973+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:09:29.854973+0000","last_undegraded":"2024-05-08T18:09:29.854973+0000","last_fullsized":"2024-05-08T18:09:29.854973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":157,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.855103+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:09:29.855103+0000","last_peered":"2024-05-08T18:09:29.855103+0000","last_clean":"2024-05-08T18:09:29.855103+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:09:29.855103+0000","last_undegraded":"2024-05-08T18:09:29.855103+0000","last_fullsized":"2024-05-08T18:09:29.855103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"90'11","reported_seq":189,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.867308+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:09:29.867308+0000","last_peered":"2024-05-08T18:09:29.867308+0000","last_clean":"2024-05-08T18:09:29.867308+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:09:29.867308+0000","last_undegraded":"2024-05-08T18:09:29.867308+0000","last_fullsized":"2024-05-08T18:09:29.867308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":132,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.866141+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:09:29.866141+0000","last_peered":"2024-05-08T18:09:29.866141+0000","last_clean":"2024-05-08T18:09:29.866141+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:09:29.866141+0000","last_undegraded":"2024-05-08T18:09:29.866141+0000","last_fullsized":"2024-05-08T18:09:29.866141+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.855504+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:09:29.855504+0000","last_peered":"2024-05-08T18:09:29.855504+0000","last_clean":"2024-05-08T18:09:29.855504+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:09:29.855504+0000","last_undegraded":"2024-05-08T18:09:29.855504+0000","last_fullsized":"2024-05-08T18:09:29.855504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'9","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.871721+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:09:29.871721+0000","last_peered":"2024-05-08T18:09:29.871721+0000","last_clean":"2024-05-08T18:09:29.871721+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:09:29.871721+0000","last_undegraded":"2024-05-08T18:09:29.871721+0000","last_fullsized":"2024-05-08T18:09:29.871721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":16390,"num_write":59,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":158,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.893060+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:09:29.893060+0000","last_peered":"2024-05-08T18:09:29.893060+0000","last_clean":"2024-05-08T18:09:29.893060+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:09:29.893060+0000","last_undegraded":"2024-05-08T18:09:29.893060+0000","last_fullsized":"2024-05-08T18:09:29.893060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":147,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.862666+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:09:29.862666+0000","last_peered":"2024-05-08T18:09:29.862666+0000","last_clean":"2024-05-08T18:09:29.862666+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:09:29.862666+0000","last_undegraded":"2024-05-08T18:09:29.862666+0000","last_fullsized":"2024-05-08T18:09:29.862666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"90'24","reported_seq":184,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864110+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:09:29.864110+0000","last_peered":"2024-05-08T18:09:29.864110+0000","last_clean":"2024-05-08T18:09:29.864110+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:09:29.864110+0000","last_undegraded":"2024-05-08T18:09:29.864110+0000","last_fullsized":"2024-05-08T18:09:29.864110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19506,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":43,"num_read_kb":29,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":139,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863327+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:09:29.863327+0000","last_peered":"2024-05-08T18:09:29.863327+0000","last_clean":"2024-05-08T18:09:29.863327+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:09:29.863327+0000","last_undegraded":"2024-05-08T18:09:29.863327+0000","last_fullsized":"2024-05-08T18:09:29.863327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":133,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.000937+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:09:30.000937+0000","last_peered":"2024-05-08T18:09:30.000937+0000","last_clean":"2024-05-08T18:09:30.000937+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:09:30.000937+0000","last_undegraded":"2024-05-08T18:09:30.000937+0000","last_fullsized":"2024-05-08T18:09:30.000937+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":133,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864847+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:09:29.864847+0000","last_peered":"2024-05-08T18:09:29.864847+0000","last_clean":"2024-05-08T18:09:29.864847+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:09:29.864847+0000","last_undegraded":"2024-05-08T18:09:29.864847+0000","last_fullsized":"2024-05-08T18:09:29.864847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"93'9","reported_seq":158,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.891734+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:09:30.891734+0000","last_peered":"2024-05-08T18:09:30.891734+0000","last_clean":"2024-05-08T18:09:30.891734+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:09:30.891734+0000","last_undegraded":"2024-05-08T18:09:30.891734+0000","last_fullsized":"2024-05-08T18:09:30.891734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":20,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"92'4","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.855948+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:09:29.855948+0000","last_peered":"2024-05-08T18:09:29.855948+0000","last_clean":"2024-05-08T18:09:29.855948+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:09:29.855948+0000","last_undegraded":"2024-05-08T18:09:29.855948+0000","last_fullsized":"2024-05-08T18:09:29.855948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":146,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.073302+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:09:30.073302+0000","last_peered":"2024-05-08T18:09:30.073302+0000","last_clean":"2024-05-08T18:09:30.073302+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:09:30.073302+0000","last_undegraded":"2024-05-08T18:09:30.073302+0000","last_fullsized":"2024-05-08T18:09:30.073302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"90'13","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.867446+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:09:29.867446+0000","last_peered":"2024-05-08T18:09:29.867446+0000","last_clean":"2024-05-08T18:09:29.867446+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:09:29.867446+0000","last_undegraded":"2024-05-08T18:09:29.867446+0000","last_fullsized":"2024-05-08T18:09:29.867446+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":138,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.862476+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:09:29.862476+0000","last_peered":"2024-05-08T18:09:29.862476+0000","last_clean":"2024-05-08T18:09:29.862476+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:09:29.862476+0000","last_undegraded":"2024-05-08T18:09:29.862476+0000","last_fullsized":"2024-05-08T18:09:29.862476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":135,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.873134+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:09:29.873134+0000","last_peered":"2024-05-08T18:09:29.873134+0000","last_clean":"2024-05-08T18:09:29.873134+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:09:29.873134+0000","last_undegraded":"2024-05-08T18:09:29.873134+0000","last_fullsized":"2024-05-08T18:09:29.873134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.073206+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:09:30.073206+0000","last_peered":"2024-05-08T18:09:30.073206+0000","last_clean":"2024-05-08T18:09:30.073206+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:09:30.073206+0000","last_undegraded":"2024-05-08T18:09:30.073206+0000","last_fullsized":"2024-05-08T18:09:30.073206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"92'11","reported_seq":172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.865330+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:09:29.865330+0000","last_peered":"2024-05-08T18:09:29.865330+0000","last_clean":"2024-05-08T18:09:29.865330+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:09:29.865330+0000","last_undegraded":"2024-05-08T18:09:29.865330+0000","last_fullsized":"2024-05-08T18:09:29.865330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":11,"num_read_kb":24582,"num_write":31,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":146,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.865456+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:09:29.865456+0000","last_peered":"2024-05-08T18:09:29.865456+0000","last_clean":"2024-05-08T18:09:29.865456+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:09:29.865456+0000","last_undegraded":"2024-05-08T18:09:29.865456+0000","last_fullsized":"2024-05-08T18:09:29.865456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"48'5","reported_seq":147,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864421+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:09:29.864421+0000","last_peered":"2024-05-08T18:09:29.864421+0000","last_clean":"2024-05-08T18:09:29.864421+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:09:29.864421+0000","last_undegraded":"2024-05-08T18:09:29.864421+0000","last_fullsized":"2024-05-08T18:09:29.864421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":138,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864093+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:09:29.864093+0000","last_peered":"2024-05-08T18:09:29.864093+0000","last_clean":"2024-05-08T18:09:29.864093+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:09:29.864093+0000","last_undegraded":"2024-05-08T18:09:29.864093+0000","last_fullsized":"2024-05-08T18:09:29.864093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"90'2","reported_seq":135,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864135+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:09:29.864135+0000","last_peered":"2024-05-08T18:09:29.864135+0000","last_clean":"2024-05-08T18:09:29.864135+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:09:29.864135+0000","last_undegraded":"2024-05-08T18:09:29.864135+0000","last_fullsized":"2024-05-08T18:09:29.864135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863236+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:09:29.863236+0000","last_peered":"2024-05-08T18:09:29.863236+0000","last_clean":"2024-05-08T18:09:29.863236+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:09:29.863236+0000","last_undegraded":"2024-05-08T18:09:29.863236+0000","last_fullsized":"2024-05-08T18:09:29.863236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"92'7","reported_seq":165,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.002269+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:09:30.002269+0000","last_peered":"2024-05-08T18:09:30.002269+0000","last_clean":"2024-05-08T18:09:30.002269+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:09:30.002269+0000","last_undegraded":"2024-05-08T18:09:30.002269+0000","last_fullsized":"2024-05-08T18:09:30.002269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":146,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863656+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:09:29.863656+0000","last_peered":"2024-05-08T18:09:29.863656+0000","last_clean":"2024-05-08T18:09:29.863656+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:09:29.863656+0000","last_undegraded":"2024-05-08T18:09:29.863656+0000","last_fullsized":"2024-05-08T18:09:29.863656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"90'12","reported_seq":162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864918+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:09:29.864918+0000","last_peered":"2024-05-08T18:09:29.864918+0000","last_clean":"2024-05-08T18:09:29.864918+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:09:29.864918+0000","last_undegraded":"2024-05-08T18:09:29.864918+0000","last_fullsized":"2024-05-08T18:09:29.864918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":136,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892022+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:09:29.892022+0000","last_peered":"2024-05-08T18:09:29.892022+0000","last_clean":"2024-05-08T18:09:29.892022+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:09:29.892022+0000","last_undegraded":"2024-05-08T18:09:29.892022+0000","last_fullsized":"2024-05-08T18:09:29.892022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":133,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.000736+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:09:30.000736+0000","last_peered":"2024-05-08T18:09:30.000736+0000","last_clean":"2024-05-08T18:09:30.000736+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:09:30.000736+0000","last_undegraded":"2024-05-08T18:09:30.000736+0000","last_fullsized":"2024-05-08T18:09:30.000736+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":155,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863057+0000","last_change":"2024-05-08T18:07:55.359230+0000","last_active":"2024-05-08T18:09:29.863057+0000","last_peered":"2024-05-08T18:09:29.863057+0000","last_clean":"2024-05-08T18:09:29.863057+0000","last_became_active":"2024-05-08T18:07:55.358047+0000","last_became_peered":"2024-05-08T18:07:55.358047+0000","last_unstale":"2024-05-08T18:09:29.863057+0000","last_undegraded":"2024-05-08T18:09:29.863057+0000","last_fullsized":"2024-05-08T18:09:29.863057+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:52.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"93'8","reported_seq":164,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.866073+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:09:29.866073+0000","last_peered":"2024-05-08T18:09:29.866073+0000","last_clean":"2024-05-08T18:09:29.866073+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:09:29.866073+0000","last_undegraded":"2024-05-08T18:09:29.866073+0000","last_fullsized":"2024-05-08T18:09:29.866073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":28,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":144,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892649+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:09:29.892649+0000","last_peered":"2024-05-08T18:09:29.892649+0000","last_clean":"2024-05-08T18:09:29.892649+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:09:29.892649+0000","last_undegraded":"2024-05-08T18:09:29.892649+0000","last_fullsized":"2024-05-08T18:09:29.892649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"90'11","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863926+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:09:29.863926+0000","last_peered":"2024-05-08T18:09:29.863926+0000","last_clean":"2024-05-08T18:09:29.863926+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:09:29.863926+0000","last_undegraded":"2024-05-08T18:09:29.863926+0000","last_fullsized":"2024-05-08T18:09:29.863926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":136,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.866171+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:09:29.866171+0000","last_peered":"2024-05-08T18:09:29.866171+0000","last_clean":"2024-05-08T18:09:29.866171+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:09:29.866171+0000","last_undegraded":"2024-05-08T18:09:29.866171+0000","last_fullsized":"2024-05-08T18:09:29.866171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":148,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892961+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:09:29.892961+0000","last_peered":"2024-05-08T18:09:29.892961+0000","last_clean":"2024-05-08T18:09:29.892961+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:09:29.892961+0000","last_undegraded":"2024-05-08T18:09:29.892961+0000","last_fullsized":"2024-05-08T18:09:29.892961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"93'7","reported_seq":165,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863357+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:09:29.863357+0000","last_peered":"2024-05-08T18:09:29.863357+0000","last_clean":"2024-05-08T18:09:29.863357+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:09:29.863357+0000","last_undegraded":"2024-05-08T18:09:29.863357+0000","last_fullsized":"2024-05-08T18:09:29.863357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":17,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":153,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.869362+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:09:29.869362+0000","last_peered":"2024-05-08T18:09:29.869362+0000","last_clean":"2024-05-08T18:09:29.869362+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:09:29.869362+0000","last_undegraded":"2024-05-08T18:09:29.869362+0000","last_fullsized":"2024-05-08T18:09:29.869362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"90'14","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.074285+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:09:30.074285+0000","last_peered":"2024-05-08T18:09:30.074285+0000","last_clean":"2024-05-08T18:09:30.074285+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:09:30.074285+0000","last_undegraded":"2024-05-08T18:09:30.074285+0000","last_fullsized":"2024-05-08T18:09:30.074285+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":137,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.000854+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:09:30.000854+0000","last_peered":"2024-05-08T18:09:30.000854+0000","last_clean":"2024-05-08T18:09:30.000854+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:09:30.000854+0000","last_undegraded":"2024-05-08T18:09:30.000854+0000","last_fullsized":"2024-05-08T18:09:30.000854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864254+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:09:29.864254+0000","last_peered":"2024-05-08T18:09:29.864254+0000","last_clean":"2024-05-08T18:09:29.864254+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:09:29.864254+0000","last_undegraded":"2024-05-08T18:09:29.864254+0000","last_fullsized":"2024-05-08T18:09:29.864254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.869769+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:09:29.869769+0000","last_peered":"2024-05-08T18:09:29.869769+0000","last_clean":"2024-05-08T18:09:29.869769+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:09:29.869769+0000","last_undegraded":"2024-05-08T18:09:29.869769+0000","last_fullsized":"2024-05-08T18:09:29.869769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"91'3","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.073704+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:09:30.073704+0000","last_peered":"2024-05-08T18:09:30.073704+0000","last_clean":"2024-05-08T18:09:30.073704+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:09:30.073704+0000","last_undegraded":"2024-05-08T18:09:30.073704+0000","last_fullsized":"2024-05-08T18:09:30.073704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":144,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892841+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:09:29.892841+0000","last_peered":"2024-05-08T18:09:29.892841+0000","last_clean":"2024-05-08T18:09:29.892841+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:09:29.892841+0000","last_undegraded":"2024-05-08T18:09:29.892841+0000","last_fullsized":"2024-05-08T18:09:29.892841+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"90'16","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864384+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:09:29.864384+0000","last_peered":"2024-05-08T18:09:29.864384+0000","last_clean":"2024-05-08T18:09:29.864384+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:09:29.864384+0000","last_undegraded":"2024-05-08T18:09:29.864384+0000","last_fullsized":"2024-05-08T18:09:29.864384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":138,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.074304+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:09:30.074304+0000","last_peered":"2024-05-08T18:09:30.074304+0000","last_clean":"2024-05-08T18:09:30.074304+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:09:30.074304+0000","last_undegraded":"2024-05-08T18:09:30.074304+0000","last_fullsized":"2024-05-08T18:09:30.074304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":132,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.891953+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:09:29.891953+0000","last_peered":"2024-05-08T18:09:29.891953+0000","last_clean":"2024-05-08T18:09:29.891953+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:09:29.891953+0000","last_undegraded":"2024-05-08T18:09:29.891953+0000","last_fullsized":"2024-05-08T18:09:29.891953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.872946+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:09:29.872946+0000","last_peered":"2024-05-08T18:09:29.872946+0000","last_clean":"2024-05-08T18:09:29.872946+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:09:29.872946+0000","last_undegraded":"2024-05-08T18:09:29.872946+0000","last_fullsized":"2024-05-08T18:09:29.872946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"93'5","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.855419+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:09:29.855419+0000","last_peered":"2024-05-08T18:09:29.855419+0000","last_clean":"2024-05-08T18:09:29.855419+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:09:29.855419+0000","last_undegraded":"2024-05-08T18:09:29.855419+0000","last_fullsized":"2024-05-08T18:09:29.855419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":15,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.856683+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:09:29.856683+0000","last_peered":"2024-05-08T18:09:29.856683+0000","last_clean":"2024-05-08T18:09:29.856683+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:09:29.856683+0000","last_undegraded":"2024-05-08T18:09:29.856683+0000","last_fullsized":"2024-05-08T18:09:29.856683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"90'12","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.874080+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:09:29.874080+0000","last_peered":"2024-05-08T18:09:29.874080+0000","last_clean":"2024-05-08T18:09:29.874080+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:09:29.874080+0000","last_undegraded":"2024-05-08T18:09:29.874080+0000","last_fullsized":"2024-05-08T18:09:29.874080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":139,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.074570+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:09:30.074570+0000","last_peered":"2024-05-08T18:09:30.074570+0000","last_clean":"2024-05-08T18:09:30.074570+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:09:30.074570+0000","last_undegraded":"2024-05-08T18:09:30.074570+0000","last_fullsized":"2024-05-08T18:09:30.074570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":133,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.999925+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:09:29.999925+0000","last_peered":"2024-05-08T18:09:29.999925+0000","last_clean":"2024-05-08T18:09:29.999925+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:09:29.999925+0000","last_undegraded":"2024-05-08T18:09:29.999925+0000","last_fullsized":"2024-05-08T18:09:29.999925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"90'6","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.988663+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:09:29.988663+0000","last_peered":"2024-05-08T18:09:29.988663+0000","last_clean":"2024-05-08T18:09:29.988663+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:09:29.988663+0000","last_undegraded":"2024-05-08T18:09:29.988663+0000","last_fullsized":"2024-05-08T18:09:29.988663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"92'9","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.866521+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:09:29.866521+0000","last_peered":"2024-05-08T18:09:29.866521+0000","last_clean":"2024-05-08T18:09:29.866521+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:09:29.866521+0000","last_undegraded":"2024-05-08T18:09:29.866521+0000","last_fullsized":"2024-05-08T18:09:29.866521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":146,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.074625+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:09:30.074625+0000","last_peered":"2024-05-08T18:09:30.074625+0000","last_clean":"2024-05-08T18:09:30.074625+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:09:30.074625+0000","last_undegraded":"2024-05-08T18:09:30.074625+0000","last_fullsized":"2024-05-08T18:09:30.074625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"91'11","reported_seq":158,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.857185+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:09:29.857185+0000","last_peered":"2024-05-08T18:09:29.857185+0000","last_clean":"2024-05-08T18:09:29.857185+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:09:29.857185+0000","last_undegraded":"2024-05-08T18:09:29.857185+0000","last_fullsized":"2024-05-08T18:09:29.857185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"90'11","reported_seq":181,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892965+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:09:29.892965+0000","last_peered":"2024-05-08T18:09:29.892965+0000","last_clean":"2024-05-08T18:09:29.892965+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:09:29.892965+0000","last_undegraded":"2024-05-08T18:09:29.892965+0000","last_fullsized":"2024-05-08T18:09:29.892965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"90'5","reported_seq":140,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863657+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:09:29.863657+0000","last_peered":"2024-05-08T18:09:29.863657+0000","last_clean":"2024-05-08T18:09:29.863657+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:09:29.863657+0000","last_undegraded":"2024-05-08T18:09:29.863657+0000","last_fullsized":"2024-05-08T18:09:29.863657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.854968+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:09:29.854968+0000","last_peered":"2024-05-08T18:09:29.854968+0000","last_clean":"2024-05-08T18:09:29.854968+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:09:29.854968+0000","last_undegraded":"2024-05-08T18:09:29.854968+0000","last_fullsized":"2024-05-08T18:09:29.854968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"93'5","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.001155+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:09:30.001155+0000","last_peered":"2024-05-08T18:09:30.001155+0000","last_clean":"2024-05-08T18:09:30.001155+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:09:30.001155+0000","last_undegraded":"2024-05-08T18:09:30.001155+0000","last_fullsized":"2024-05-08T18:09:30.001155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":25,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":146,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864046+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:09:29.864046+0000","last_peered":"2024-05-08T18:09:29.864046+0000","last_clean":"2024-05-08T18:09:29.864046+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:09:29.864046+0000","last_undegraded":"2024-05-08T18:09:29.864046+0000","last_fullsized":"2024-05-08T18:09:29.864046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"90'16","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.000235+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:09:30.000235+0000","last_peered":"2024-05-08T18:09:30.000235+0000","last_clean":"2024-05-08T18:09:30.000235+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:09:30.000235+0000","last_undegraded":"2024-05-08T18:09:30.000235+0000","last_fullsized":"2024-05-08T18:09:30.000235+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":136,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863278+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:09:29.863278+0000","last_peered":"2024-05-08T18:09:29.863278+0000","last_clean":"2024-05-08T18:09:29.863278+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:09:29.863278+0000","last_undegraded":"2024-05-08T18:09:29.863278+0000","last_fullsized":"2024-05-08T18:09:29.863278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"90'1","reported_seq":135,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.865164+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:09:29.865164+0000","last_peered":"2024-05-08T18:09:29.865164+0000","last_clean":"2024-05-08T18:09:29.865164+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:09:29.865164+0000","last_undegraded":"2024-05-08T18:09:29.865164+0000","last_fullsized":"2024-05-08T18:09:29.865164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.855198+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:09:29.855198+0000","last_peered":"2024-05-08T18:09:29.855198+0000","last_clean":"2024-05-08T18:09:29.855198+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:09:29.855198+0000","last_undegraded":"2024-05-08T18:09:29.855198+0000","last_fullsized":"2024-05-08T18:09:29.855198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"93'4","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.002172+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:09:30.002172+0000","last_peered":"2024-05-08T18:09:30.002172+0000","last_clean":"2024-05-08T18:09:30.002172+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:09:30.002172+0000","last_undegraded":"2024-05-08T18:09:30.002172+0000","last_fullsized":"2024-05-08T18:09:30.002172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.000798+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:09:30.000798+0000","last_peered":"2024-05-08T18:09:30.000798+0000","last_clean":"2024-05-08T18:09:30.000798+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:09:30.000798+0000","last_undegraded":"2024-05-08T18:09:30.000798+0000","last_fullsized":"2024-05-08T18:09:30.000798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"90'12","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863673+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:09:29.863673+0000","last_peered":"2024-05-08T18:09:29.863673+0000","last_clean":"2024-05-08T18:09:29.863673+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:09:29.863673+0000","last_undegraded":"2024-05-08T18:09:29.863673+0000","last_fullsized":"2024-05-08T18:09:29.863673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":136,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892252+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:09:29.892252+0000","last_peered":"2024-05-08T18:09:29.892252+0000","last_clean":"2024-05-08T18:09:29.892252+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:09:29.892252+0000","last_undegraded":"2024-05-08T18:09:29.892252+0000","last_fullsized":"2024-05-08T18:09:29.892252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.873123+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:09:29.873123+0000","last_peered":"2024-05-08T18:09:29.873123+0000","last_clean":"2024-05-08T18:09:29.873123+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:09:29.873123+0000","last_undegraded":"2024-05-08T18:09:29.873123+0000","last_fullsized":"2024-05-08T18:09:29.873123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863629+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:09:29.863629+0000","last_peered":"2024-05-08T18:09:29.863629+0000","last_clean":"2024-05-08T18:09:29.863629+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:09:29.863629+0000","last_undegraded":"2024-05-08T18:09:29.863629+0000","last_fullsized":"2024-05-08T18:09:29.863629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"93'9","reported_seq":114,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.115377+0000","last_change":"2024-05-08T18:07:55.439856+0000","last_active":"2024-05-08T18:09:30.115377+0000","last_peered":"2024-05-08T18:09:30.115377+0000","last_clean":"2024-05-08T18:09:30.115377+0000","last_became_active":"2024-05-08T18:07:55.439188+0000","last_became_peered":"2024-05-08T18:07:55.439188+0000","last_unstale":"2024-05-08T18:09:30.115377+0000","last_undegraded":"2024-05-08T18:09:30.115377+0000","last_fullsized":"2024-05-08T18:09:30.115377+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:40.273251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":9,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.854430+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:09:29.854430+0000","last_peered":"2024-05-08T18:09:29.854430+0000","last_clean":"2024-05-08T18:09:29.854430+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:09:29.854430+0000","last_undegraded":"2024-05-08T18:09:29.854430+0000","last_fullsized":"2024-05-08T18:09:29.854430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"90'7","reported_seq":154,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.866759+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:09:29.866759+0000","last_peered":"2024-05-08T18:09:29.866759+0000","last_clean":"2024-05-08T18:09:29.866759+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:09:29.866759+0000","last_undegraded":"2024-05-08T18:09:29.866759+0000","last_fullsized":"2024-05-08T18:09:29.866759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":137,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.854696+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:09:29.854696+0000","last_peered":"2024-05-08T18:09:29.854696+0000","last_clean":"2024-05-08T18:09:29.854696+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:09:29.854696+0000","last_undegraded":"2024-05-08T18:09:29.854696+0000","last_fullsized":"2024-05-08T18:09:29.854696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864982+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:09:29.864982+0000","last_peered":"2024-05-08T18:09:29.864982+0000","last_clean":"2024-05-08T18:09:29.864982+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:09:29.864982+0000","last_undegraded":"2024-05-08T18:09:29.864982+0000","last_fullsized":"2024-05-08T18:09:29.864982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.855142+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:09:29.855142+0000","last_peered":"2024-05-08T18:09:29.855142+0000","last_clean":"2024-05-08T18:09:29.855142+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:09:29.855142+0000","last_undegraded":"2024-05-08T18:09:29.855142+0000","last_fullsized":"2024-05-08T18:09:29.855142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"93'8","reported_seq":164,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.865946+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:09:29.865946+0000","last_peered":"2024-05-08T18:09:29.865946+0000","last_clean":"2024-05-08T18:09:29.865946+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:09:29.865946+0000","last_undegraded":"2024-05-08T18:09:29.865946+0000","last_fullsized":"2024-05-08T18:09:29.865946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":28,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":147,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.072914+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:09:30.072914+0000","last_peered":"2024-05-08T18:09:30.072914+0000","last_clean":"2024-05-08T18:09:30.072914+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:09:30.072914+0000","last_undegraded":"2024-05-08T18:09:30.072914+0000","last_fullsized":"2024-05-08T18:09:30.072914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"90'10","reported_seq":158,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.854862+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:09:29.854862+0000","last_peered":"2024-05-08T18:09:29.854862+0000","last_clean":"2024-05-08T18:09:29.854862+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:09:29.854862+0000","last_undegraded":"2024-05-08T18:09:29.854862+0000","last_fullsized":"2024-05-08T18:09:29.854862+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":136,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864346+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:09:29.864346+0000","last_peered":"2024-05-08T18:09:29.864346+0000","last_clean":"2024-05-08T18:09:29.864346+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:09:29.864346+0000","last_undegraded":"2024-05-08T18:09:29.864346+0000","last_fullsized":"2024-05-08T18:09:29.864346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":133,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.856710+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:09:29.856710+0000","last_peered":"2024-05-08T18:09:29.856710+0000","last_clean":"2024-05-08T18:09:29.856710+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:09:29.856710+0000","last_undegraded":"2024-05-08T18:09:29.856710+0000","last_fullsized":"2024-05-08T18:09:29.856710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"92'17","reported_seq":171,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.074684+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:09:30.074684+0000","last_peered":"2024-05-08T18:09:30.074684+0000","last_clean":"2024-05-08T18:09:30.074684+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:09:30.074684+0000","last_undegraded":"2024-05-08T18:09:30.074684+0000","last_fullsized":"2024-05-08T18:09:30.074684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":40,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"93'12","reported_seq":170,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.465834+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:09:30.465834+0000","last_peered":"2024-05-08T18:09:30.465834+0000","last_clean":"2024-05-08T18:09:30.465834+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:09:30.465834+0000","last_undegraded":"2024-05-08T18:09:30.465834+0000","last_fullsized":"2024-05-08T18:09:30.465834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":62,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":151,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.074918+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:09:30.074918+0000","last_peered":"2024-05-08T18:09:30.074918+0000","last_clean":"2024-05-08T18:09:30.074918+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:09:30.074918+0000","last_undegraded":"2024-05-08T18:09:30.074918+0000","last_fullsized":"2024-05-08T18:09:30.074918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"92'7","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.987730+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:09:29.987730+0000","last_peered":"2024-05-08T18:09:29.987730+0000","last_clean":"2024-05-08T18:09:29.987730+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:09:29.987730+0000","last_undegraded":"2024-05-08T18:09:29.987730+0000","last_fullsized":"2024-05-08T18:09:29.987730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.001606+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:09:30.001606+0000","last_peered":"2024-05-08T18:09:30.001606+0000","last_clean":"2024-05-08T18:09:30.001606+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:09:30.001606+0000","last_undegraded":"2024-05-08T18:09:30.001606+0000","last_fullsized":"2024-05-08T18:09:30.001606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"93'6","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.000608+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:09:30.000608+0000","last_peered":"2024-05-08T18:09:30.000608+0000","last_clean":"2024-05-08T18:09:30.000608+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:09:30.000608+0000","last_undegraded":"2024-05-08T18:09:30.000608+0000","last_fullsized":"2024-05-08T18:09:30.000608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":26,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":151,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.073946+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:09:30.073946+0000","last_peered":"2024-05-08T18:09:30.073946+0000","last_clean":"2024-05-08T18:09:30.073946+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:09:30.073946+0000","last_undegraded":"2024-05-08T18:09:30.073946+0000","last_fullsized":"2024-05-08T18:09:30.073946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"92'4","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.867102+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:09:29.867102+0000","last_peered":"2024-05-08T18:09:29.867102+0000","last_clean":"2024-05-08T18:09:29.867102+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:09:29.867102+0000","last_undegraded":"2024-05-08T18:09:29.867102+0000","last_fullsized":"2024-05-08T18:09:29.867102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":151,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.866050+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:09:29.866050+0000","last_peered":"2024-05-08T18:09:29.866050+0000","last_clean":"2024-05-08T18:09:29.866050+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:09:29.866050+0000","last_undegraded":"2024-05-08T18:09:29.866050+0000","last_fullsized":"2024-05-08T18:09:29.866050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"93'8","reported_seq":168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.872841+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:09:29.872841+0000","last_peered":"2024-05-08T18:09:29.872841+0000","last_clean":"2024-05-08T18:09:29.872841+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:09:29.872841+0000","last_undegraded":"2024-05-08T18:09:29.872841+0000","last_fullsized":"2024-05-08T18:09:29.872841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.855286+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:09:29.855286+0000","last_peered":"2024-05-08T18:09:29.855286+0000","last_clean":"2024-05-08T18:09:29.855286+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:09:29.855286+0000","last_undegraded":"2024-05-08T18:09:29.855286+0000","last_fullsized":"2024-05-08T18:09:29.855286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"92'7","reported_seq":165,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.074853+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:09:30.074853+0000","last_peered":"2024-05-08T18:09:30.074853+0000","last_clean":"2024-05-08T18:09:30.074853+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:09:30.074853+0000","last_undegraded":"2024-05-08T18:09:30.074853+0000","last_fullsized":"2024-05-08T18:09:30.074853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":27,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"92'15","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.862962+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:09:29.862962+0000","last_peered":"2024-05-08T18:09:29.862962+0000","last_clean":"2024-05-08T18:09:29.862962+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:09:29.862962+0000","last_undegraded":"2024-05-08T18:09:29.862962+0000","last_fullsized":"2024-05-08T18:09:29.862962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":21,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"92'6","reported_seq":164,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892784+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:09:29.892784+0000","last_peered":"2024-05-08T18:09:29.892784+0000","last_clean":"2024-05-08T18:09:29.892784+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:09:29.892784+0000","last_undegraded":"2024-05-08T18:09:29.892784+0000","last_fullsized":"2024-05-08T18:09:29.892784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"90'12","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.891922+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:09:29.891922+0000","last_peered":"2024-05-08T18:09:29.891922+0000","last_clean":"2024-05-08T18:09:29.891922+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:09:29.891922+0000","last_undegraded":"2024-05-08T18:09:29.891922+0000","last_fullsized":"2024-05-08T18:09:29.891922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"91'3","reported_seq":159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.873865+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:09:29.873865+0000","last_peered":"2024-05-08T18:09:29.873865+0000","last_clean":"2024-05-08T18:09:29.873865+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:09:29.873865+0000","last_undegraded":"2024-05-08T18:09:29.873865+0000","last_fullsized":"2024-05-08T18:09:29.873865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":148,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.865061+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:09:29.865061+0000","last_peered":"2024-05-08T18:09:29.865061+0000","last_clean":"2024-05-08T18:09:29.865061+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:09:29.865061+0000","last_undegraded":"2024-05-08T18:09:29.865061+0000","last_fullsized":"2024-05-08T18:09:29.865061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"93'15","reported_seq":176,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.134227+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:09:30.134227+0000","last_peered":"2024-05-08T18:09:30.134227+0000","last_clean":"2024-05-08T18:09:30.134227+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:09:30.134227+0000","last_undegraded":"2024-05-08T18:09:30.134227+0000","last_fullsized":"2024-05-08T18:09:30.134227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":11,"num_read_kb":24582,"num_write":45,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.857347+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:09:29.857347+0000","last_peered":"2024-05-08T18:09:29.857347+0000","last_clean":"2024-05-08T18:09:29.857347+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:09:29.857347+0000","last_undegraded":"2024-05-08T18:09:29.857347+0000","last_fullsized":"2024-05-08T18:09:29.857347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"92'5","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863988+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:09:29.863988+0000","last_peered":"2024-05-08T18:09:29.863988+0000","last_clean":"2024-05-08T18:09:29.863988+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:09:29.863988+0000","last_undegraded":"2024-05-08T18:09:29.863988+0000","last_fullsized":"2024-05-08T18:09:29.863988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":151,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.988525+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:09:29.988525+0000","last_peered":"2024-05-08T18:09:29.988525+0000","last_clean":"2024-05-08T18:09:29.988525+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:09:29.988525+0000","last_undegraded":"2024-05-08T18:09:29.988525+0000","last_fullsized":"2024-05-08T18:09:29.988525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"93'6","reported_seq":108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.988137+0000","last_change":"2024-05-08T18:07:55.445745+0000","last_active":"2024-05-08T18:09:29.988137+0000","last_peered":"2024-05-08T18:09:29.988137+0000","last_clean":"2024-05-08T18:09:29.988137+0000","last_became_active":"2024-05-08T18:07:55.444935+0000","last_became_peered":"2024-05-08T18:07:55.444935+0000","last_unstale":"2024-05-08T18:09:29.988137+0000","last_undegraded":"2024-05-08T18:09:29.988137+0000","last_fullsized":"2024-05-08T18:09:29.988137+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:37.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":6,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":150,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.856517+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:09:29.856517+0000","last_peered":"2024-05-08T18:09:29.856517+0000","last_clean":"2024-05-08T18:09:29.856517+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:09:29.856517+0000","last_undegraded":"2024-05-08T18:09:29.856517+0000","last_fullsized":"2024-05-08T18:09:29.856517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"91'4","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.868088+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:09:29.868088+0000","last_peered":"2024-05-08T18:09:29.868088+0000","last_clean":"2024-05-08T18:09:29.868088+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:09:29.868088+0000","last_undegraded":"2024-05-08T18:09:29.868088+0000","last_fullsized":"2024-05-08T18:09:29.868088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":8198,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":151,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864348+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:09:29.864348+0000","last_peered":"2024-05-08T18:09:29.864348+0000","last_clean":"2024-05-08T18:09:29.864348+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:09:29.864348+0000","last_undegraded":"2024-05-08T18:09:29.864348+0000","last_fullsized":"2024-05-08T18:09:29.864348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"92'7","reported_seq":165,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.892550+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:09:29.892550+0000","last_peered":"2024-05-08T18:09:29.892550+0000","last_clean":"2024-05-08T18:09:29.892550+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:09:29.892550+0000","last_undegraded":"2024-05-08T18:09:29.892550+0000","last_fullsized":"2024-05-08T18:09:29.892550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.864423+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:09:29.864423+0000","last_peered":"2024-05-08T18:09:29.864423+0000","last_clean":"2024-05-08T18:09:29.864423+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:09:29.864423+0000","last_undegraded":"2024-05-08T18:09:29.864423+0000","last_fullsized":"2024-05-08T18:09:29.864423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"93'6","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.584726+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:09:31.584726+0000","last_peered":"2024-05-08T18:09:31.584726+0000","last_clean":"2024-05-08T18:09:31.584726+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:09:31.584726+0000","last_undegraded":"2024-05-08T18:09:31.584726+0000","last_fullsized":"2024-05-08T18:09:31.584726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":4102,"num_write":36,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"92'15","reported_seq":166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.862819+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:09:29.862819+0000","last_peered":"2024-05-08T18:09:29.862819+0000","last_clean":"2024-05-08T18:09:29.862819+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:09:29.862819+0000","last_undegraded":"2024-05-08T18:09:29.862819+0000","last_fullsized":"2024-05-08T18:09:29.862819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":35,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":173,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.988862+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:09:29.988862+0000","last_peered":"2024-05-08T18:09:29.988862+0000","last_clean":"2024-05-08T18:09:29.988862+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:09:29.988862+0000","last_undegraded":"2024-05-08T18:09:29.988862+0000","last_fullsized":"2024-05-08T18:09:29.988862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":151,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.863833+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:09:29.863833+0000","last_peered":"2024-05-08T18:09:29.863833+0000","last_clean":"2024-05-08T18:09:29.863833+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:09:29.863833+0000","last_undegraded":"2024-05-08T18:09:29.863833+0000","last_fullsized":"2024-05-08T18:09:29.863833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"91'7","reported_seq":164,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.002388+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:09:30.002388+0000","last_peered":"2024-05-08T18:09:30.002388+0000","last_clean":"2024-05-08T18:09:30.002388+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:09:30.002388+0000","last_undegraded":"2024-05-08T18:09:30.002388+0000","last_fullsized":"2024-05-08T18:09:30.002388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":7,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"93'11","reported_seq":170,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.000429+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:09:30.000429+0000","last_peered":"2024-05-08T18:09:30.000429+0000","last_clean":"2024-05-08T18:09:30.000429+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:09:30.000429+0000","last_undegraded":"2024-05-08T18:09:30.000429+0000","last_fullsized":"2024-05-08T18:09:30.000429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":21,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":148,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:29.865075+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:09:29.865075+0000","last_peered":"2024-05-08T18:09:29.865075+0000","last_clean":"2024-05-08T18:09:29.865075+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:09:29.865075+0000","last_undegraded":"2024-05-08T18:09:29.865075+0000","last_fullsized":"2024-05-08T18:09:29.865075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'8","reported_seq":169,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.073500+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:09:30.073500+0000","last_peered":"2024-05-08T18:09:30.073500+0000","last_clean":"2024-05-08T18:09:30.073500+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:09:30.073500+0000","last_undegraded":"2024-05-08T18:09:30.073500+0000","last_fullsized":"2024-05-08T18:09:30.073500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T18:09:30.002062+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:09:30.002062+0000","last_peered":"2024-05-08T18:09:30.002062+0000","last_clean":"2024-05-08T18:09:30.002062+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:09:30.002062+0000","last_undegraded":"2024-05-08T18:09:30.002062+0000","last_fullsized":"2024-05-08T18:09:30.002062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1079,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":19,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":99587,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":722,"num_read_kb":481,"num_write":447,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":119454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":439,"ondisk_log_size":439,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":636,"num_read_kb":470,"num_write":282,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1667235840,"num_objects":429,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":429,"num_whiteouts":0,"num_read":300,"num_read_kb":1024060,"num_write":1179,"num_write_kb":1669120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3340763136,"data_stored":3340763136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":449,"ondisk_log_size":449,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":420004,"kb_used_data":388824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93951836,"statfs":{"total":96636764160,"available":96206680064,"internally_reserved":0,"allocated":398155776,"data_stored":397610742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":355888,"kb_used_data":324708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94015952,"statfs":{"total":96636764160,"available":96272334848,"internally_reserved":0,"allocated":332500992,"data_stored":331996343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":519784,"kb_used_data":488604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93852056,"statfs":{"total":96636764160,"available":96104505344,"internally_reserved":0,"allocated":500330496,"data_stored":499775925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":476700,"kb_used_data":445520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93895140,"statfs":{"total":96636764160,"available":96148623360,"internally_reserved":0,"allocated":456212480,"data_stored":455722776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":513600,"kb_used_data":482420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93858240,"statfs":{"total":96636764160,"available":96110837760,"internally_reserved":0,"allocated":493998080,"data_stored":493477231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298524,"kb_used_data":267344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94073316,"statfs":{"total":96636764160,"available":96331075584,"internally_reserved":0,"allocated":273760256,"data_stored":273269833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304724,"kb_used_data":273544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94067116,"statfs":{"total":96636764160,"available":96324726784,"internally_reserved":0,"allocated":280109056,"data_stored":279584177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":553084,"kb_used_data":521908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93818756,"statfs":{"total":96636764160,"available":96070406144,"internally_reserved":0,"allocated":534433792,"data_stored":533913827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532676608,"data_stored":532676608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":283115520,"data_stored":283115520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":276824064,"data_stored":276824064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":507510784,"data_stored":507510784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":467664896,"data_stored":467664896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":528482304,"data_stored":528482304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":333447168,"data_stored":333447168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":411041792,"data_stored":411041792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":12085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":29031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":12416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":18266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":12018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":23883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:09:36.012 INFO:tasks.thrashosds.thrasher:Setting 3.33 to [6, 7, 1, 4] 2024-05-08T18:09:36.013 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.33', '6', '7', '1', '4'] 2024-05-08T18:09:36.013 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.33 6 7 1 4 2024-05-08T18:09:36.014 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.97 2024-05-08T18:09:36.014 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:36.014 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 98 2024-05-08T18:09:36.014 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:36.014 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:36.015 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00921726 s, 1.1 GB/s 2024-05-08T18:09:36.015 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:36.017+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:36.095 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.98 2024-05-08T18:09:36.095 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:36.095 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 99 2024-05-08T18:09:36.107 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:36.107 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:36.107 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0102546 s, 1.0 GB/s 2024-05-08T18:09:36.115 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:36.116+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:36.141 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:09:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 153.32717655299999, 2024-05-08T18:09:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.16213206199999999, 2024-05-08T18:09:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:09:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:09:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1 2024-05-08T18:09:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814494+0000", 2024-05-08T18:09:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:09:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814520+0000", 2024-05-08T18:09:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-05 2024-05-08T18:09:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814543+0000", 2024-05-08T18:09:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2353000000000001e-05 2024-05-08T18:09:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814563+0000", 2024-05-08T18:09:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.048e-05 2024-05-08T18:09:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814677+0000", 2024-05-08T18:09:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113632 2024-05-08T18:09:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814705+0000", 2024-05-08T18:09:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8626999999999999e-05 2024-05-08T18:09:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971115+0000", 2024-05-08T18:09:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.156409825 2024-05-08T18:09:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971438+0000", 2024-05-08T18:09:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00032289200000000002 2024-05-08T18:09:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971849+0000", 2024-05-08T18:09:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041139300000000002 2024-05-08T18:09:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.975364+0000", 2024-05-08T18:09:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035148390000000001 2024-05-08T18:09:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976474+0000", 2024-05-08T18:09:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001110099 2024-05-08T18:09:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976564+0000", 2024-05-08T18:09:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9522000000000001e-05 2024-05-08T18:09:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976624+0000", 2024-05-08T18:09:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9616e-05 2024-05-08T18:09:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1194 3.16 e85/20 3:6b2325a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_6:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 29.120774343000001, 2024-05-08T18:09:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024064767000000001, 2024-05-08T18:09:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020897+0000", 2024-05-08T18:09:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9699999999999999e-06 2024-05-08T18:09:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027491+0000", 2024-05-08T18:09:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065945229999999997 2024-05-08T18:09:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027543+0000", 2024-05-08T18:09:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1319000000000001e-05 2024-05-08T18:09:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027573+0000", 2024-05-08T18:09:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0380000000000001e-05 2024-05-08T18:09:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027737+0000", 2024-05-08T18:09:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000163871 2024-05-08T18:09:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027782+0000", 2024-05-08T18:09:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5519999999999998e-05 2024-05-08T18:09:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044819+0000", 2024-05-08T18:09:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017036481999999999 2024-05-08T18:09:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044958+0000", 2024-05-08T18:09:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013970200000000001 2024-05-08T18:09:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1202 3.14 e85/20 3:2a8c8569:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_14:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 29.034824274999998, 2024-05-08T18:09:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023371860000000001, 2024-05-08T18:09:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106846+0000", 2024-05-08T18:09:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:09:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110841+0000", 2024-05-08T18:09:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039945479999999997 2024-05-08T18:09:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110888+0000", 2024-05-08T18:09:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7349999999999999e-05 2024-05-08T18:09:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110913+0000", 2024-05-08T18:09:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5055999999999999e-05 2024-05-08T18:09:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.111067+0000", 2024-05-08T18:09:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015329800000000001 2024-05-08T18:09:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.111110+0000", 2024-05-08T18:09:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3649000000000002e-05 2024-05-08T18:09:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130087+0000", 2024-05-08T18:09:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018976186999999999 2024-05-08T18:09:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130216+0000", 2024-05-08T18:09:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012911199999999999 2024-05-08T18:09:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1207 3.15 3:a96d965c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 28.989242000000001, 2024-05-08T18:09:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02864527, 2024-05-08T18:09:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1207 2024-05-08T18:09:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152430+0000", 2024-05-08T18:09:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1230000000000002e-06 2024-05-08T18:09:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157227+0000", 2024-05-08T18:09:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047968769999999997 2024-05-08T18:09:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157268+0000", 2024-05-08T18:09:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0673000000000002e-05 2024-05-08T18:09:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157293+0000", 2024-05-08T18:09:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5469999999999998e-05 2024-05-08T18:09:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157483+0000", 2024-05-08T18:09:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018973300000000001 2024-05-08T18:09:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157750+0000", 2024-05-08T18:09:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026736400000000002 2024-05-08T18:09:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157982+0000", 2024-05-08T18:09:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023154299999999999 2024-05-08T18:09:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.171224+0000", 2024-05-08T18:09:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013242115 2024-05-08T18:09:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180801+0000", 2024-05-08T18:09:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0095766749999999998 2024-05-08T18:09:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180919+0000", 2024-05-08T18:09:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118546 2024-05-08T18:09:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.181071+0000", 2024-05-08T18:09:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152151 2024-05-08T18:09:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1224 3.13 3:c82cef46:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 28.503188353999999, 2024-05-08T18:09:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025580821, 2024-05-08T18:09:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1224 2024-05-08T18:09:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638484+0000", 2024-05-08T18:09:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1989999999999999e-06 2024-05-08T18:09:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643068+0000", 2024-05-08T18:09:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045841859999999996 2024-05-08T18:09:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643099+0000", 2024-05-08T18:09:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1331999999999997e-05 2024-05-08T18:09:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643117+0000", 2024-05-08T18:09:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7176999999999998e-05 2024-05-08T18:09:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643262+0000", 2024-05-08T18:09:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014521299999999999 2024-05-08T18:09:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643523+0000", 2024-05-08T18:09:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000260783 2024-05-08T18:09:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643768+0000", 2024-05-08T18:09:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024567399999999998 2024-05-08T18:09:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.662501+0000", 2024-05-08T18:09:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018732988999999999 2024-05-08T18:09:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663964+0000", 2024-05-08T18:09:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001463074 2024-05-08T18:09:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.664015+0000", 2024-05-08T18:09:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0549e-05 2024-05-08T18:09:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.664061+0000", 2024-05-08T18:09:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5645000000000001e-05 2024-05-08T18:09:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1255 3.12 e85/20 3:48af9d8c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_11:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 27.660190402000001, 2024-05-08T18:09:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021924084999999999, 2024-05-08T18:09:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481479+0000", 2024-05-08T18:09:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999999999999999e-06 2024-05-08T18:09:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.485998+0000", 2024-05-08T18:09:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045194600000000003 2024-05-08T18:09:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486023+0000", 2024-05-08T18:09:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4516999999999999e-05 2024-05-08T18:09:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486033+0000", 2024-05-08T18:09:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0529e-05 2024-05-08T18:09:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486172+0000", 2024-05-08T18:09:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013829599999999999 2024-05-08T18:09:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486234+0000", 2024-05-08T18:09:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2156000000000006e-05 2024-05-08T18:09:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.503338+0000", 2024-05-08T18:09:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017104346999999999 2024-05-08T18:09:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.503402+0000", 2024-05-08T18:09:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3579999999999998e-05 2024-05-08T18:09:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1277 3.3f 3:ffe0c8dc:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 27.056541370000001, 2024-05-08T18:09:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025789262, 2024-05-08T18:09:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1277 2024-05-08T18:09:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085130+0000", 2024-05-08T18:09:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4659999999999999e-06 2024-05-08T18:09:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089237+0000", 2024-05-08T18:09:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004106424 2024-05-08T18:09:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089281+0000", 2024-05-08T18:09:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4053e-05 2024-05-08T18:09:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089300+0000", 2024-05-08T18:09:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9057000000000001e-05 2024-05-08T18:09:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089467+0000", 2024-05-08T18:09:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000167734 2024-05-08T18:09:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089839+0000", 2024-05-08T18:09:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037171900000000001 2024-05-08T18:09:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.090206+0000", 2024-05-08T18:09:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036716500000000003 2024-05-08T18:09:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.105682+0000", 2024-05-08T18:09:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015475495000000001 2024-05-08T18:09:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110695+0000", 2024-05-08T18:09:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050135420000000002 2024-05-08T18:09:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110779+0000", 2024-05-08T18:09:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3914999999999999e-05 2024-05-08T18:09:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110916+0000", 2024-05-08T18:09:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136692 2024-05-08T18:09:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1283 3.39 3:9ca6d3f9:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.972455786000001, 2024-05-08T18:09:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022844218999999999, 2024-05-08T18:09:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1283 2024-05-08T18:09:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169215+0000", 2024-05-08T18:09:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9529999999999999e-06 2024-05-08T18:09:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173086+0000", 2024-05-08T18:09:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003870582 2024-05-08T18:09:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173107+0000", 2024-05-08T18:09:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1608999999999999e-05 2024-05-08T18:09:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173117+0000", 2024-05-08T18:09:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8090000000000004e-06 2024-05-08T18:09:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173192+0000", 2024-05-08T18:09:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4676000000000001e-05 2024-05-08T18:09:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173197+0000", 2024-05-08T18:09:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0710000000000002e-06 2024-05-08T18:09:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.175963+0000", 2024-05-08T18:09:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027662810000000002 2024-05-08T18:09:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.176138+0000", 2024-05-08T18:09:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017430500000000001 2024-05-08T18:09:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.176332+0000", 2024-05-08T18:09:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019477000000000001 2024-05-08T18:09:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.184230+0000", 2024-05-08T18:09:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078977630000000004 2024-05-08T18:09:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.191962+0000", 2024-05-08T18:09:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077315830000000002 2024-05-08T18:09:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.192015+0000", 2024-05-08T18:09:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2992999999999999e-05 2024-05-08T18:09:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.192056+0000", 2024-05-08T18:09:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1823999999999998e-05 2024-05-08T18:09:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1412 3.3f 3:fe02d1ba:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 24.18400376, 2024-05-08T18:09:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023048524000000001, 2024-05-08T18:09:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1412 2024-05-08T18:09:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957668+0000", 2024-05-08T18:09:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8999999999999999e-06 2024-05-08T18:09:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963142+0000", 2024-05-08T18:09:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005473627 2024-05-08T18:09:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963181+0000", 2024-05-08T18:09:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.93e-05 2024-05-08T18:09:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963199+0000", 2024-05-08T18:09:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7866000000000001e-05 2024-05-08T18:09:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963347+0000", 2024-05-08T18:09:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014816800000000001 2024-05-08T18:09:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963603+0000", 2024-05-08T18:09:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025623099999999999 2024-05-08T18:09:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963843+0000", 2024-05-08T18:09:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023961699999999999 2024-05-08T18:09:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.975743+0000", 2024-05-08T18:09:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011899998 2024-05-08T18:09:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980533+0000", 2024-05-08T18:09:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047898749999999999 2024-05-08T18:09:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980638+0000", 2024-05-08T18:09:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010527300000000001 2024-05-08T18:09:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980713+0000", 2024-05-08T18:09:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4668999999999999e-05 2024-05-08T18:09:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1420 3.e 3:72accb8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.8:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 24.10593489, 2024-05-08T18:09:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025387064000000001, 2024-05-08T18:09:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1420 2024-05-08T18:09:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035736+0000", 2024-05-08T18:09:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0240000000000002e-06 2024-05-08T18:09:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039738+0000", 2024-05-08T18:09:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004001419 2024-05-08T18:09:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039775+0000", 2024-05-08T18:09:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7696e-05 2024-05-08T18:09:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039792+0000", 2024-05-08T18:09:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7183000000000001e-05 2024-05-08T18:09:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039909+0000", 2024-05-08T18:09:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116915 2024-05-08T18:09:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.040173+0000", 2024-05-08T18:09:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026373100000000001 2024-05-08T18:09:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.041106+0000", 2024-05-08T18:09:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093293100000000002 2024-05-08T18:09:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060858+0000", 2024-05-08T18:09:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019752232000000002 2024-05-08T18:09:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060894+0000", 2024-05-08T18:09:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6056000000000002e-05 2024-05-08T18:09:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.061023+0000", 2024-05-08T18:09:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128849 2024-05-08T18:09:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.061120+0000", 2024-05-08T18:09:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7027999999999993e-05 2024-05-08T18:09:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1448 3.15 3:a83ea02a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.9:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.237747072000001, 2024-05-08T18:09:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021945044, 2024-05-08T18:09:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1448 2024-05-08T18:09:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903924+0000", 2024-05-08T18:09:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5790000000000002e-06 2024-05-08T18:09:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907773+0000", 2024-05-08T18:09:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038495740000000001 2024-05-08T18:09:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907796+0000", 2024-05-08T18:09:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3011e-05 2024-05-08T18:09:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907806+0000", 2024-05-08T18:09:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9729999999999992e-06 2024-05-08T18:09:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907885+0000", 2024-05-08T18:09:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8799000000000002e-05 2024-05-08T18:09:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.908059+0000", 2024-05-08T18:09:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017370100000000001 2024-05-08T18:09:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.908581+0000", 2024-05-08T18:09:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052234099999999995 2024-05-08T18:09:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.918050+0000", 2024-05-08T18:09:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00946871 2024-05-08T18:09:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925682+0000", 2024-05-08T18:09:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0076326689999999999 2024-05-08T18:09:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925817+0000", 2024-05-08T18:09:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013451000000000001 2024-05-08T18:09:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925866+0000", 2024-05-08T18:09:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9177e-05 2024-05-08T18:09:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1931 3.15 3:a838452a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.rt8jcH7t-Si0Elu5GsS4JhWyuPnbJ5v_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.6217564279999994, 2024-05-08T18:09:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022148926999999999, 2024-05-08T18:09:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1931 2024-05-08T18:09:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519915+0000", 2024-05-08T18:09:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4070000000000002e-06 2024-05-08T18:09:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523840+0000", 2024-05-08T18:09:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00392494 2024-05-08T18:09:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523881+0000", 2024-05-08T18:09:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0729999999999998e-05 2024-05-08T18:09:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523901+0000", 2024-05-08T18:09:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9816000000000001e-05 2024-05-08T18:09:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524034+0000", 2024-05-08T18:09:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013357199999999999 2024-05-08T18:09:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524297+0000", 2024-05-08T18:09:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000262697 2024-05-08T18:09:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524555+0000", 2024-05-08T18:09:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025802099999999999 2024-05-08T18:09:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.535170+0000", 2024-05-08T18:09:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010615528000000001 2024-05-08T18:09:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.541876+0000", 2024-05-08T18:09:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006705562 2024-05-08T18:09:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.541984+0000", 2024-05-08T18:09:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108585 2024-05-08T18:09:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.542061+0000", 2024-05-08T18:09:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6069000000000006e-05 2024-05-08T18:09:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1990 3.2d 3:b4aceac7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.34:head [create,setxattr user.rgw.idtag (61) in=14b,setxattr user.rgw.tail_tag (61) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.742290+0000", 2024-05-08T18:09:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.3993777690000009, 2024-05-08T18:09:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023330152999999999, 2024-05-08T18:09:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1990 2024-05-08T18:09:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.742290+0000", 2024-05-08T18:09:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.742290+0000", 2024-05-08T18:09:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.742293+0000", 2024-05-08T18:09:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7369999999999998e-06 2024-05-08T18:09:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747757+0000", 2024-05-08T18:09:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054638079999999997 2024-05-08T18:09:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747799+0000", 2024-05-08T18:09:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:09:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747819+0000", 2024-05-08T18:09:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0183e-05 2024-05-08T18:09:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747973+0000", 2024-05-08T18:09:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015351500000000001 2024-05-08T18:09:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.748251+0000", 2024-05-08T18:09:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027811699999999998 2024-05-08T18:09:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.749139+0000", 2024-05-08T18:09:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00088849299999999997 2024-05-08T18:09:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.763612+0000", 2024-05-08T18:09:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014472992 2024-05-08T18:09:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.765137+0000", 2024-05-08T18:09:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001524823 2024-05-08T18:09:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.765399+0000", 2024-05-08T18:09:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026171700000000002 2024-05-08T18:09:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.765620+0000", 2024-05-08T18:09:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000221595 2024-05-08T18:09:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1999 3.13 3:c81aceb2:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.qFJD7RDtXlCNRHqLIdswZJm3STCASHM_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.958634+0000", 2024-05-08T18:09:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.1830343209999992, 2024-05-08T18:09:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022563374000000001, 2024-05-08T18:09:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1999 2024-05-08T18:09:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.958634+0000", 2024-05-08T18:09:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.958634+0000", 2024-05-08T18:09:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.958637+0000", 2024-05-08T18:09:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2830000000000002e-06 2024-05-08T18:09:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.963827+0000", 2024-05-08T18:09:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051899609999999999 2024-05-08T18:09:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.964764+0000", 2024-05-08T18:09:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093745000000000005 2024-05-08T18:09:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.964794+0000", 2024-05-08T18:09:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.957e-05 2024-05-08T18:09:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.965016+0000", 2024-05-08T18:09:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000221671 2024-05-08T18:09:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.965297+0000", 2024-05-08T18:09:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028171000000000001 2024-05-08T18:09:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.965547+0000", 2024-05-08T18:09:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024940800000000001 2024-05-08T18:09:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.979720+0000", 2024-05-08T18:09:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01417321 2024-05-08T18:09:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.981028+0000", 2024-05-08T18:09:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013080489999999999 2024-05-08T18:09:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.981129+0000", 2024-05-08T18:09:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010111900000000001 2024-05-08T18:09:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.981197+0000", 2024-05-08T18:09:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7942999999999996e-05 2024-05-08T18:09:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2130 3.39 3:9f8cf400:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.K7V9dh3caEYHsi9YlGwMWJrNO2rnOUe_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:30.419212+0000", 2024-05-08T18:09:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.7224558080000003, 2024-05-08T18:09:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025593207999999999, 2024-05-08T18:09:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2130 2024-05-08T18:09:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.419212+0000", 2024-05-08T18:09:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.419212+0000", 2024-05-08T18:09:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.419215+0000", 2024-05-08T18:09:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0699999999999998e-06 2024-05-08T18:09:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423670+0000", 2024-05-08T18:09:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044546990000000003 2024-05-08T18:09:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423704+0000", 2024-05-08T18:09:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4329999999999998e-05 2024-05-08T18:09:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423720+0000", 2024-05-08T18:09:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5769000000000001e-05 2024-05-08T18:09:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423820+0000", 2024-05-08T18:09:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9964999999999996e-05 2024-05-08T18:09:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423947+0000", 2024-05-08T18:09:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012709400000000001 2024-05-08T18:09:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.424047+0000", 2024-05-08T18:09:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9841999999999997e-05 2024-05-08T18:09:36.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.430460+0000", 2024-05-08T18:09:36.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064128040000000002 2024-05-08T18:09:36.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.444733+0000", 2024-05-08T18:09:36.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014272741 2024-05-08T18:09:36.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.444776+0000", 2024-05-08T18:09:36.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3594000000000003e-05 2024-05-08T18:09:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.444805+0000", 2024-05-08T18:09:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9300000000000001e-05 2024-05-08T18:09:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2175 3.2d 3:b44c7524:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.63:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:31.556724+0000", 2024-05-08T18:09:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.5849440179999998, 2024-05-08T18:09:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.028086578000000001, 2024-05-08T18:09:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.224 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.224 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.224 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:36.224 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.224 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2175 2024-05-08T18:09:36.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.224 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.556724+0000", 2024-05-08T18:09:36.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.556724+0000", 2024-05-08T18:09:36.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.556727+0000", 2024-05-08T18:09:36.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3239999999999999e-06 2024-05-08T18:09:36.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561115+0000", 2024-05-08T18:09:36.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043878659999999998 2024-05-08T18:09:36.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561151+0000", 2024-05-08T18:09:36.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6247e-05 2024-05-08T18:09:36.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561177+0000", 2024-05-08T18:09:36.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5876000000000001e-05 2024-05-08T18:09:36.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561310+0000", 2024-05-08T18:09:36.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013296200000000001 2024-05-08T18:09:36.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561658+0000", 2024-05-08T18:09:36.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034749599999999998 2024-05-08T18:09:36.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:36.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.562604+0000", 2024-05-08T18:09:36.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00094605000000000004 2024-05-08T18:09:36.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.574717+0000", 2024-05-08T18:09:36.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012113153999999999 2024-05-08T18:09:36.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.584594+0000", 2024-05-08T18:09:36.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0098766830000000007 2024-05-08T18:09:36.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.584723+0000", 2024-05-08T18:09:36.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012911800000000001 2024-05-08T18:09:36.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.584811+0000", 2024-05-08T18:09:36.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7801999999999997e-05 2024-05-08T18:09:36.228 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.228 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.228 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2199 3.15 3:a8780bcf:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.67:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:32.172858+0000", 2024-05-08T18:09:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 3.9688104700000002, 2024-05-08T18:09:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022099601999999999, 2024-05-08T18:09:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2199 2024-05-08T18:09:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.230 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.172858+0000", 2024-05-08T18:09:36.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.172858+0000", 2024-05-08T18:09:36.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.172861+0000", 2024-05-08T18:09:36.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.337e-06 2024-05-08T18:09:36.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177201+0000", 2024-05-08T18:09:36.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043402989999999997 2024-05-08T18:09:36.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177239+0000", 2024-05-08T18:09:36.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8157000000000001e-05 2024-05-08T18:09:36.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177257+0000", 2024-05-08T18:09:36.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.806e-05 2024-05-08T18:09:36.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177426+0000", 2024-05-08T18:09:36.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016871799999999999 2024-05-08T18:09:36.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177706+0000", 2024-05-08T18:09:36.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027945800000000001 2024-05-08T18:09:36.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:36.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.178615+0000", 2024-05-08T18:09:36.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00090926799999999997 2024-05-08T18:09:36.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.192797+0000", 2024-05-08T18:09:36.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014181724 2024-05-08T18:09:36.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.194761+0000", 2024-05-08T18:09:36.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001963963 2024-05-08T18:09:36.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.194882+0000", 2024-05-08T18:09:36.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120952 2024-05-08T18:09:36.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.194957+0000", 2024-05-08T18:09:36.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5666000000000004e-05 2024-05-08T18:09:36.234 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.234 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.234 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.235 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2205 3.e 3:736fbc51:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.68:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:36.235 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:32.330919+0000", 2024-05-08T18:09:36.235 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 3.8107494690000001, 2024-05-08T18:09:36.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024623565, 2024-05-08T18:09:36.235 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.235 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.235 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.235 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.235 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:36.235 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.235 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2205 2024-05-08T18:09:36.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.236 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.330919+0000", 2024-05-08T18:09:36.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.330919+0000", 2024-05-08T18:09:36.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.330922+0000", 2024-05-08T18:09:36.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1470000000000001e-06 2024-05-08T18:09:36.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.334876+0000", 2024-05-08T18:09:36.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039544890000000003 2024-05-08T18:09:36.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.334914+0000", 2024-05-08T18:09:36.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7973999999999999e-05 2024-05-08T18:09:36.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.334932+0000", 2024-05-08T18:09:36.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7319000000000001e-05 2024-05-08T18:09:36.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.335093+0000", 2024-05-08T18:09:36.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000161149 2024-05-08T18:09:36.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.335364+0000", 2024-05-08T18:09:36.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027133799999999998 2024-05-08T18:09:36.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:36.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.336278+0000", 2024-05-08T18:09:36.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00091437799999999998 2024-05-08T18:09:36.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.353978+0000", 2024-05-08T18:09:36.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017699914000000001 2024-05-08T18:09:36.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.355343+0000", 2024-05-08T18:09:36.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001364346 2024-05-08T18:09:36.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.355463+0000", 2024-05-08T18:09:36.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120789 2024-05-08T18:09:36.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.355542+0000", 2024-05-08T18:09:36.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8721999999999996e-05 2024-05-08T18:09:36.240 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.240 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.240 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.241 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2356 3.d 3:b3bbc07d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.8wN2GlL8rBYEiTXR4sMZd0wed6qVyrX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:36.241 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:35.353910+0000", 2024-05-08T18:09:36.241 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.78775835000000005, 2024-05-08T18:09:36.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023189147, 2024-05-08T18:09:36.241 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.241 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.241 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.241 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.241 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:36.241 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.241 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2356 2024-05-08T18:09:36.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.242 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.353910+0000", 2024-05-08T18:09:36.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.353910+0000", 2024-05-08T18:09:36.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.353913+0000", 2024-05-08T18:09:36.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.67e-06 2024-05-08T18:09:36.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358160+0000", 2024-05-08T18:09:36.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042467099999999999 2024-05-08T18:09:36.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358200+0000", 2024-05-08T18:09:36.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0272999999999999e-05 2024-05-08T18:09:36.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358225+0000", 2024-05-08T18:09:36.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5003000000000001e-05 2024-05-08T18:09:36.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358331+0000", 2024-05-08T18:09:36.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010557599999999999 2024-05-08T18:09:36.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358517+0000", 2024-05-08T18:09:36.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018577200000000001 2024-05-08T18:09:36.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:36.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358677+0000", 2024-05-08T18:09:36.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000160342 2024-05-08T18:09:36.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.368776+0000", 2024-05-08T18:09:36.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010098763 2024-05-08T18:09:36.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.376804+0000", 2024-05-08T18:09:36.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0080286369999999999 2024-05-08T18:09:36.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.376977+0000", 2024-05-08T18:09:36.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000172349 2024-05-08T18:09:36.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.377099+0000", 2024-05-08T18:09:36.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000122052 2024-05-08T18:09:36.246 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.246 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.246 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.246 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2380 3.e 3:713200a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.N3BoeKsRn7I3GNNh1gsMqBxJl5ACtoq_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:36.246 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:35.841683+0000", 2024-05-08T18:09:36.247 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.299985163, 2024-05-08T18:09:36.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025074545, 2024-05-08T18:09:36.247 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:36.247 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:36.247 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.247 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:36.247 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:36.247 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.247 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2380 2024-05-08T18:09:36.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.247 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:36.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:36.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.841683+0000", 2024-05-08T18:09:36.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:36.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.841683+0000", 2024-05-08T18:09:36.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:36.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:36.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.841685+0000", 2024-05-08T18:09:36.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3020000000000002e-06 2024-05-08T18:09:36.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:36.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845397+0000", 2024-05-08T18:09:36.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037116240000000002 2024-05-08T18:09:36.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:36.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845421+0000", 2024-05-08T18:09:36.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4468e-05 2024-05-08T18:09:36.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845434+0000", 2024-05-08T18:09:36.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2989999999999999e-05 2024-05-08T18:09:36.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845532+0000", 2024-05-08T18:09:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7841000000000001e-05 2024-05-08T18:09:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845749+0000", 2024-05-08T18:09:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021645099999999999 2024-05-08T18:09:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845973+0000", 2024-05-08T18:09:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000224744 2024-05-08T18:09:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866275+0000", 2024-05-08T18:09:36.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020301471000000001 2024-05-08T18:09:36.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:36.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866644+0000", 2024-05-08T18:09:36.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036915800000000002 2024-05-08T18:09:36.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:36.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866704+0000", 2024-05-08T18:09:36.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0495000000000003e-05 2024-05-08T18:09:36.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:36.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:36.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:36.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866757+0000", 2024-05-08T18:09:36.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3001000000000003e-05 2024-05-08T18:09:36.252 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.252 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.252 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.252 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:36.252 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:36.252 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:36.253 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.99 2024-05-08T18:09:36.253 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:36.253 INFO:tasks.workunit.client.0.smithi080.stdout:uploading file - part 100 2024-05-08T18:09:36.253 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records in 2024-05-08T18:09:36.254 INFO:tasks.workunit.client.0.smithi080.stderr:1+0 records out 2024-05-08T18:09:36.254 INFO:tasks.workunit.client.0.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00898191 s, 1.2 GB/s 2024-05-08T18:09:36.254 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:36.253+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:36.254 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:09:36.354 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:36.353+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:36.382 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:36.382 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:36.382 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:36.382 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:36.396 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:09:36.455 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:36.456+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:36.511 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:36.512 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:36.512 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:36.512 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:36.512 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:36.526 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:09:36.556 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:36.557+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:36.656 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:36.657+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:36.691 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:36.691 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:36.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:36.692 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:36.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.692 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1221 3.20 e85/20 3:071d1257:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_5:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:36.692 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:36.692 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.088320287999998, 2024-05-08T18:09:36.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019872899999999999, 2024-05-08T18:09:36.692 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.692 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.692 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.692 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:36.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:36.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605944+0000", 2024-05-08T18:09:36.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.77e-06 2024-05-08T18:09:36.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612548+0000", 2024-05-08T18:09:36.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066036519999999998 2024-05-08T18:09:36.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612580+0000", 2024-05-08T18:09:36.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1945e-05 2024-05-08T18:09:36.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612593+0000", 2024-05-08T18:09:36.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3665999999999999e-05 2024-05-08T18:09:36.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612758+0000", 2024-05-08T18:09:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016427600000000001 2024-05-08T18:09:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612832+0000", 2024-05-08T18:09:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4493000000000007e-05 2024-05-08T18:09:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.625728+0000", 2024-05-08T18:09:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012895471 2024-05-08T18:09:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.625815+0000", 2024-05-08T18:09:36.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7627000000000007e-05 2024-05-08T18:09:36.696 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.696 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.696 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.696 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1227 3.6 3:6359f987:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:36.696 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:36.696 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.010146729999999, 2024-05-08T18:09:36.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022831489999999999, 2024-05-08T18:09:36.696 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.696 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.696 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.696 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:36.696 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:36.697 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.697 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1227 2024-05-08T18:09:36.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.697 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:36.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:36.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684119+0000", 2024-05-08T18:09:36.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.678e-06 2024-05-08T18:09:36.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687247+0000", 2024-05-08T18:09:36.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031279820000000001 2024-05-08T18:09:36.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687274+0000", 2024-05-08T18:09:36.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7174000000000001e-05 2024-05-08T18:09:36.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687289+0000", 2024-05-08T18:09:36.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5364999999999999e-05 2024-05-08T18:09:36.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687421+0000", 2024-05-08T18:09:36.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013197999999999999 2024-05-08T18:09:36.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687681+0000", 2024-05-08T18:09:36.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025951099999999998 2024-05-08T18:09:36.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:36.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687981+0000", 2024-05-08T18:09:36.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030021799999999999 2024-05-08T18:09:36.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:36.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706004+0000", 2024-05-08T18:09:36.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018023441000000001 2024-05-08T18:09:36.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706867+0000", 2024-05-08T18:09:36.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00086241200000000001 2024-05-08T18:09:36.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706901+0000", 2024-05-08T18:09:36.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4325000000000001e-05 2024-05-08T18:09:36.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706948+0000", 2024-05-08T18:09:36.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6403999999999998e-05 2024-05-08T18:09:36.701 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.701 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.701 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.702 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1246 3.6 3:6220dfe7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:36.702 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:36.702 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.333467249000002, 2024-05-08T18:09:36.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020211156000000001, 2024-05-08T18:09:36.702 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.702 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.702 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.702 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:36.702 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:36.702 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.702 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1246 2024-05-08T18:09:36.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.702 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:36.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:36.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360799+0000", 2024-05-08T18:09:36.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4939999999999999e-06 2024-05-08T18:09:36.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363474+0000", 2024-05-08T18:09:36.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026745190000000002 2024-05-08T18:09:36.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363511+0000", 2024-05-08T18:09:36.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7722000000000002e-05 2024-05-08T18:09:36.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363528+0000", 2024-05-08T18:09:36.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6600999999999999e-05 2024-05-08T18:09:36.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363637+0000", 2024-05-08T18:09:36.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108855 2024-05-08T18:09:36.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363792+0000", 2024-05-08T18:09:36.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000155561 2024-05-08T18:09:36.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:36.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363921+0000", 2024-05-08T18:09:36.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128501 2024-05-08T18:09:36.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:36.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.378377+0000", 2024-05-08T18:09:36.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014456577999999999 2024-05-08T18:09:36.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380848+0000", 2024-05-08T18:09:36.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024703329999999999 2024-05-08T18:09:36.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380940+0000", 2024-05-08T18:09:36.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2264999999999998e-05 2024-05-08T18:09:36.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.381007+0000", 2024-05-08T18:09:36.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6727e-05 2024-05-08T18:09:36.707 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.707 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.707 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.707 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1255 3.12 3:48af9d8c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:36.707 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:36.707 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.212449381999999, 2024-05-08T18:09:36.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025868088000000001, 2024-05-08T18:09:36.707 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.707 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.707 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.707 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:36.708 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:36.708 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.708 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1255 2024-05-08T18:09:36.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.708 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:36.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:36.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481816+0000", 2024-05-08T18:09:36.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6390000000000001e-06 2024-05-08T18:09:36.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484725+0000", 2024-05-08T18:09:36.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00290865 2024-05-08T18:09:36.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484750+0000", 2024-05-08T18:09:36.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5009999999999999e-05 2024-05-08T18:09:36.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484763+0000", 2024-05-08T18:09:36.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2976000000000001e-05 2024-05-08T18:09:36.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484848+0000", 2024-05-08T18:09:36.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5232e-05 2024-05-08T18:09:36.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.485026+0000", 2024-05-08T18:09:36.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000177706 2024-05-08T18:09:36.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:36.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.485186+0000", 2024-05-08T18:09:36.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016076900000000001 2024-05-08T18:09:36.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:36.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.491881+0000", 2024-05-08T18:09:36.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066950539999999998 2024-05-08T18:09:36.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507591+0000", 2024-05-08T18:09:36.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015709724000000001 2024-05-08T18:09:36.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507638+0000", 2024-05-08T18:09:36.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6684999999999998e-05 2024-05-08T18:09:36.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507681+0000", 2024-05-08T18:09:36.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3643000000000002e-05 2024-05-08T18:09:36.712 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.713 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.713 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.713 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1395 3.17 3:eb9c68a5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:36.713 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:36.713 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.921820641, 2024-05-08T18:09:36.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026590425000000001, 2024-05-08T18:09:36.713 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.713 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.713 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.713 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:36.713 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:36.713 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.713 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1395 2024-05-08T18:09:36.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.714 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:36.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:36.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772445+0000", 2024-05-08T18:09:36.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0970000000000002e-06 2024-05-08T18:09:36.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775066+0000", 2024-05-08T18:09:36.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026205730000000002 2024-05-08T18:09:36.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775101+0000", 2024-05-08T18:09:36.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4876000000000003e-05 2024-05-08T18:09:36.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775116+0000", 2024-05-08T18:09:36.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5566999999999999e-05 2024-05-08T18:09:36.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775200+0000", 2024-05-08T18:09:36.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3808999999999997e-05 2024-05-08T18:09:36.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775307+0000", 2024-05-08T18:09:36.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000107366 2024-05-08T18:09:36.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:36.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775430+0000", 2024-05-08T18:09:36.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012280599999999999 2024-05-08T18:09:36.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:36.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.779395+0000", 2024-05-08T18:09:36.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003964357 2024-05-08T18:09:36.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.798911+0000", 2024-05-08T18:09:36.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019516386 2024-05-08T18:09:36.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.798982+0000", 2024-05-08T18:09:36.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0759000000000005e-05 2024-05-08T18:09:36.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.799033+0000", 2024-05-08T18:09:36.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0828999999999997e-05 2024-05-08T18:09:36.718 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.718 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.718 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.718 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1404 3.1b 3:d97dd5be:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:36.718 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:36.718 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.820990455, 2024-05-08T18:09:36.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020100535999999999, 2024-05-08T18:09:36.719 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.719 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.719 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.719 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:36.719 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:36.719 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.719 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1404 2024-05-08T18:09:36.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.719 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:36.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:36.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873276+0000", 2024-05-08T18:09:36.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.45e-06 2024-05-08T18:09:36.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875542+0000", 2024-05-08T18:09:36.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002266746 2024-05-08T18:09:36.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875570+0000", 2024-05-08T18:09:36.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7826000000000001e-05 2024-05-08T18:09:36.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875585+0000", 2024-05-08T18:09:36.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4681999999999999e-05 2024-05-08T18:09:36.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875667+0000", 2024-05-08T18:09:36.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2429000000000006e-05 2024-05-08T18:09:36.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875833+0000", 2024-05-08T18:09:36.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165959 2024-05-08T18:09:36.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:36.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875991+0000", 2024-05-08T18:09:36.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015766099999999999 2024-05-08T18:09:36.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:36.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.884154+0000", 2024-05-08T18:09:36.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081625329999999996 2024-05-08T18:09:36.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.892970+0000", 2024-05-08T18:09:36.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0088168540000000007 2024-05-08T18:09:36.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.893166+0000", 2024-05-08T18:09:36.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019573 2024-05-08T18:09:36.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.893373+0000", 2024-05-08T18:09:36.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020666599999999999 2024-05-08T18:09:36.723 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.723 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.723 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.724 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1426 3.3 e87/20 3:c1fceb03:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_4:head v 87'7, mlcod=86'5)", 2024-05-08T18:09:36.724 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:36.724 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.266804352000001, 2024-05-08T18:09:36.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020804152999999999, 2024-05-08T18:09:36.724 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.724 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.724 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.724 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:36.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:36.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427461+0000", 2024-05-08T18:09:36.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.57e-06 2024-05-08T18:09:36.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433712+0000", 2024-05-08T18:09:36.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062511729999999996 2024-05-08T18:09:36.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433759+0000", 2024-05-08T18:09:36.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6397000000000003e-05 2024-05-08T18:09:36.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433779+0000", 2024-05-08T18:09:36.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0196000000000001e-05 2024-05-08T18:09:36.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433922+0000", 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014305599999999999 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433970+0000", 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7933000000000003e-05 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.448060+0000", 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01409064 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.448263+0000", 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020218800000000001 2024-05-08T18:09:36.727 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.728 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.728 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.728 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1452 3.18 e87/20 3:1a3be52d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_2:head v 87'4, mlcod=86'2)", 2024-05-08T18:09:36.728 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:36.728 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.366257221000001, 2024-05-08T18:09:36.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020634468, 2024-05-08T18:09:36.728 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.728 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.728 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.728 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:36.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:36.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328008+0000", 2024-05-08T18:09:36.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2589999999999999e-06 2024-05-08T18:09:36.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330832+0000", 2024-05-08T18:09:36.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028243719999999999 2024-05-08T18:09:36.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330867+0000", 2024-05-08T18:09:36.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4776e-05 2024-05-08T18:09:36.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330883+0000", 2024-05-08T18:09:36.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6121999999999999e-05 2024-05-08T18:09:36.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.331031+0000", 2024-05-08T18:09:36.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148412 2024-05-08T18:09:36.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.331075+0000", 2024-05-08T18:09:36.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3126e-05 2024-05-08T18:09:36.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.348521+0000", 2024-05-08T18:09:36.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017446351999999998 2024-05-08T18:09:36.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.348640+0000", 2024-05-08T18:09:36.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119049 2024-05-08T18:09:36.732 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.732 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.732 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.732 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1463 3.17 3:ebd3133d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:36.732 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:36.732 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.120766801999999, 2024-05-08T18:09:36.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023934057000000002, 2024-05-08T18:09:36.732 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.732 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.732 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.732 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:36.732 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:36.733 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.733 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1463 2024-05-08T18:09:36.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.733 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:36.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:36.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573500+0000", 2024-05-08T18:09:36.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7670000000000001e-06 2024-05-08T18:09:36.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575722+0000", 2024-05-08T18:09:36.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022226559999999999 2024-05-08T18:09:36.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575781+0000", 2024-05-08T18:09:36.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8746999999999998e-05 2024-05-08T18:09:36.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575810+0000", 2024-05-08T18:09:36.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8407000000000001e-05 2024-05-08T18:09:36.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575981+0000", 2024-05-08T18:09:36.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017151499999999999 2024-05-08T18:09:36.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.576369+0000", 2024-05-08T18:09:36.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038807000000000002 2024-05-08T18:09:36.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:36.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.576675+0000", 2024-05-08T18:09:36.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030572800000000001 2024-05-08T18:09:36.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:36.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.585475+0000", 2024-05-08T18:09:36.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087997630000000004 2024-05-08T18:09:36.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597202+0000", 2024-05-08T18:09:36.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011727849 2024-05-08T18:09:36.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597316+0000", 2024-05-08T18:09:36.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113546 2024-05-08T18:09:36.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597430+0000", 2024-05-08T18:09:36.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114009 2024-05-08T18:09:36.737 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.737 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.737 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.738 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1913 3.17 3:ea65dc81:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.vOI1jtaftCZSAcjtRhSYPcY8omHGfbO_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:36.738 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:36.738 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.602162324, 2024-05-08T18:09:36.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020076618000000001, 2024-05-08T18:09:36.738 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.738 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.738 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.738 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:36.738 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:36.738 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.738 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1913 2024-05-08T18:09:36.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.738 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:36.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:36.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092104+0000", 2024-05-08T18:09:36.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2279999999999998e-06 2024-05-08T18:09:36.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094163+0000", 2024-05-08T18:09:36.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020592710000000001 2024-05-08T18:09:36.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094206+0000", 2024-05-08T18:09:36.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3072999999999999e-05 2024-05-08T18:09:36.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094231+0000", 2024-05-08T18:09:36.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4819000000000001e-05 2024-05-08T18:09:36.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094325+0000", 2024-05-08T18:09:36.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4029000000000004e-05 2024-05-08T18:09:36.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094439+0000", 2024-05-08T18:09:36.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113878 2024-05-08T18:09:36.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:36.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094533+0000", 2024-05-08T18:09:36.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4733000000000003e-05 2024-05-08T18:09:36.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:36.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.099901+0000", 2024-05-08T18:09:36.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053678789999999999 2024-05-08T18:09:36.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.111944+0000", 2024-05-08T18:09:36.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012042855999999999 2024-05-08T18:09:36.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.112051+0000", 2024-05-08T18:09:36.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010673100000000001 2024-05-08T18:09:36.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.112177+0000", 2024-05-08T18:09:36.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012612100000000001 2024-05-08T18:09:36.743 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.743 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.743 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.743 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1928 3.23 3:c76f4655:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.24:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:36.743 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:36.743 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.286323297999999, 2024-05-08T18:09:36.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026452139, 2024-05-08T18:09:36.744 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.744 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.744 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.744 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:36.744 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:36.744 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.744 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1928 2024-05-08T18:09:36.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.744 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:36.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:36.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407943+0000", 2024-05-08T18:09:36.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4170000000000001e-06 2024-05-08T18:09:36.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412466+0000", 2024-05-08T18:09:36.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045230720000000004 2024-05-08T18:09:36.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412503+0000", 2024-05-08T18:09:36.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7287999999999999e-05 2024-05-08T18:09:36.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412520+0000", 2024-05-08T18:09:36.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7206000000000001e-05 2024-05-08T18:09:36.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412719+0000", 2024-05-08T18:09:36.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000198975 2024-05-08T18:09:36.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412989+0000", 2024-05-08T18:09:36.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000269256 2024-05-08T18:09:36.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:36.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.413870+0000", 2024-05-08T18:09:36.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00088159999999999996 2024-05-08T18:09:36.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.433846+0000", 2024-05-08T18:09:36.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019975822000000001 2024-05-08T18:09:36.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:36.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434198+0000", 2024-05-08T18:09:36.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035164000000000001 2024-05-08T18:09:36.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434318+0000", 2024-05-08T18:09:36.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120604 2024-05-08T18:09:36.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434392+0000", 2024-05-08T18:09:36.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3258999999999998e-05 2024-05-08T18:09:36.748 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.749 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.749 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.749 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:2130 3.39 e93/20 3:9f8cf400:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.K7V9dh3caEYHsi9YlGwMWJrNO2rnOUe_1:head v 93'7, mlcod=90'5)", 2024-05-08T18:09:36.749 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.428375+0000", 2024-05-08T18:09:36.749 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 6.2658873509999999, 2024-05-08T18:09:36.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020125661, 2024-05-08T18:09:36.749 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.749 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.749 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.749 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.428375+0000", 2024-05-08T18:09:36.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.428375+0000", 2024-05-08T18:09:36.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.428378+0000", 2024-05-08T18:09:36.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.96e-06 2024-05-08T18:09:36.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436642+0000", 2024-05-08T18:09:36.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0082638899999999994 2024-05-08T18:09:36.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436681+0000", 2024-05-08T18:09:36.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8389999999999997e-05 2024-05-08T18:09:36.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436705+0000", 2024-05-08T18:09:36.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4049e-05 2024-05-08T18:09:36.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436805+0000", 2024-05-08T18:09:36.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010063100000000001 2024-05-08T18:09:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436825+0000", 2024-05-08T18:09:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9817e-05 2024-05-08T18:09:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.448397+0000", 2024-05-08T18:09:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011572086000000001 2024-05-08T18:09:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.448501+0000", 2024-05-08T18:09:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103838 2024-05-08T18:09:36.752 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.753 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.753 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.753 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2139 3.3d 3:bf4c8f68:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.57:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:36.753 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.593560+0000", 2024-05-08T18:09:36.753 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 6.1007028070000002, 2024-05-08T18:09:36.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026176721999999999, 2024-05-08T18:09:36.753 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.753 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.753 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.753 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:36.753 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:36.753 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.753 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2139 2024-05-08T18:09:36.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.754 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.593560+0000", 2024-05-08T18:09:36.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.593560+0000", 2024-05-08T18:09:36.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.593564+0000", 2024-05-08T18:09:36.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8330000000000004e-06 2024-05-08T18:09:36.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597295+0000", 2024-05-08T18:09:36.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037317090000000002 2024-05-08T18:09:36.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597337+0000", 2024-05-08T18:09:36.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1628999999999997e-05 2024-05-08T18:09:36.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597356+0000", 2024-05-08T18:09:36.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9079000000000001e-05 2024-05-08T18:09:36.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597523+0000", 2024-05-08T18:09:36.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016655500000000001 2024-05-08T18:09:36.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597893+0000", 2024-05-08T18:09:36.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037072199999999998 2024-05-08T18:09:36.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:36.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.598918+0000", 2024-05-08T18:09:36.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010249790000000001 2024-05-08T18:09:36.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:36.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.618213+0000", 2024-05-08T18:09:36.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019294772000000002 2024-05-08T18:09:36.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619538+0000", 2024-05-08T18:09:36.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001324424 2024-05-08T18:09:36.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619657+0000", 2024-05-08T18:09:36.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119091 2024-05-08T18:09:36.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619737+0000", 2024-05-08T18:09:36.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9929e-05 2024-05-08T18:09:36.758 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.758 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.758 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.758 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2157 3.17 3:e9343ebc:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.60:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:36.759 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.032761+0000", 2024-05-08T18:09:36.759 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.6615014170000002, 2024-05-08T18:09:36.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019666783, 2024-05-08T18:09:36.759 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.759 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.759 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.759 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:36.759 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:36.759 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.759 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2157 2024-05-08T18:09:36.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.759 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.032761+0000", 2024-05-08T18:09:36.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.032761+0000", 2024-05-08T18:09:36.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.032764+0000", 2024-05-08T18:09:36.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1329999999999999e-06 2024-05-08T18:09:36.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035544+0000", 2024-05-08T18:09:36.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027793679999999999 2024-05-08T18:09:36.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035584+0000", 2024-05-08T18:09:36.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9935999999999998e-05 2024-05-08T18:09:36.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035602+0000", 2024-05-08T18:09:36.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8496e-05 2024-05-08T18:09:36.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035728+0000", 2024-05-08T18:09:36.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012599200000000001 2024-05-08T18:09:36.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.036019+0000", 2024-05-08T18:09:36.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000290475 2024-05-08T18:09:36.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:36.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.036929+0000", 2024-05-08T18:09:36.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091045700000000004 2024-05-08T18:09:36.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:36.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.049721+0000", 2024-05-08T18:09:36.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012791360999999999 2024-05-08T18:09:36.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.052216+0000", 2024-05-08T18:09:36.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024957619999999999 2024-05-08T18:09:36.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.052350+0000", 2024-05-08T18:09:36.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013327799999999999 2024-05-08T18:09:36.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.052428+0000", 2024-05-08T18:09:36.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8524999999999998e-05 2024-05-08T18:09:36.764 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.764 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.764 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.764 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2166 3.1f 3:fb9a1743:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.eyqVZ0B-P5u9ACEPSRoUzw86bQPcrsX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:36.764 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.348722+0000", 2024-05-08T18:09:36.764 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.3455405450000004, 2024-05-08T18:09:36.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020031361000000001, 2024-05-08T18:09:36.764 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.764 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.764 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.764 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:36.764 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:36.764 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.764 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2166 2024-05-08T18:09:36.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.765 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.348722+0000", 2024-05-08T18:09:36.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.348722+0000", 2024-05-08T18:09:36.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.348727+0000", 2024-05-08T18:09:36.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4959999999999998e-06 2024-05-08T18:09:36.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.351828+0000", 2024-05-08T18:09:36.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003101786 2024-05-08T18:09:36.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.351865+0000", 2024-05-08T18:09:36.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6519000000000001e-05 2024-05-08T18:09:36.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.351891+0000", 2024-05-08T18:09:36.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6233000000000001e-05 2024-05-08T18:09:36.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.352076+0000", 2024-05-08T18:09:36.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018498000000000001 2024-05-08T18:09:36.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.352511+0000", 2024-05-08T18:09:36.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043521899999999998 2024-05-08T18:09:36.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:36.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.352931+0000", 2024-05-08T18:09:36.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041997900000000001 2024-05-08T18:09:36.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:36.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.365888+0000", 2024-05-08T18:09:36.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012956578999999999 2024-05-08T18:09:36.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.368517+0000", 2024-05-08T18:09:36.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002629471 2024-05-08T18:09:36.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.368616+0000", 2024-05-08T18:09:36.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8740999999999995e-05 2024-05-08T18:09:36.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.368754+0000", 2024-05-08T18:09:36.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137358 2024-05-08T18:09:36.769 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.769 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.769 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.769 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2190 3.1 3:8364520c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.6cWLHpOdr1veoeL1lcBsJwZn6mj4f5g_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:36.769 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:32.004731+0000", 2024-05-08T18:09:36.769 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.6895317609999996, 2024-05-08T18:09:36.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024468832999999999, 2024-05-08T18:09:36.769 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.769 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.770 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.770 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:36.770 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:36.770 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.770 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2190 2024-05-08T18:09:36.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.770 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.004731+0000", 2024-05-08T18:09:36.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.004731+0000", 2024-05-08T18:09:36.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.004734+0000", 2024-05-08T18:09:36.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5299999999999999e-06 2024-05-08T18:09:36.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.006911+0000", 2024-05-08T18:09:36.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002177203 2024-05-08T18:09:36.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.006936+0000", 2024-05-08T18:09:36.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5772e-05 2024-05-08T18:09:36.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.006950+0000", 2024-05-08T18:09:36.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.397e-05 2024-05-08T18:09:36.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.007054+0000", 2024-05-08T18:09:36.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010354200000000001 2024-05-08T18:09:36.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.007233+0000", 2024-05-08T18:09:36.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017882600000000001 2024-05-08T18:09:36.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:36.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.007409+0000", 2024-05-08T18:09:36.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000176212 2024-05-08T18:09:36.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:36.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.020682+0000", 2024-05-08T18:09:36.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013272894 2024-05-08T18:09:36.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.029125+0000", 2024-05-08T18:09:36.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084428090000000008 2024-05-08T18:09:36.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.029167+0000", 2024-05-08T18:09:36.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2409e-05 2024-05-08T18:09:36.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.029200+0000", 2024-05-08T18:09:36.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2666000000000002e-05 2024-05-08T18:09:36.775 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.775 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.775 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.775 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2203 3.1 3:82cc66a1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.iRfSb7b_Mb9pWyJBdZSShCS0gvDvtAQ_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:36.775 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:32.309316+0000", 2024-05-08T18:09:36.775 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.3849467650000005, 2024-05-08T18:09:36.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021097028, 2024-05-08T18:09:36.775 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.775 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.775 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.775 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:36.776 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:36.776 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.776 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2203 2024-05-08T18:09:36.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.776 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.309316+0000", 2024-05-08T18:09:36.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.309316+0000", 2024-05-08T18:09:36.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.309319+0000", 2024-05-08T18:09:36.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4000000000000001e-06 2024-05-08T18:09:36.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311275+0000", 2024-05-08T18:09:36.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019557720000000002 2024-05-08T18:09:36.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311313+0000", 2024-05-08T18:09:36.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8176000000000002e-05 2024-05-08T18:09:36.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311332+0000", 2024-05-08T18:09:36.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8986000000000001e-05 2024-05-08T18:09:36.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311414+0000", 2024-05-08T18:09:36.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1615999999999999e-05 2024-05-08T18:09:36.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311531+0000", 2024-05-08T18:09:36.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117379 2024-05-08T18:09:36.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:36.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311651+0000", 2024-05-08T18:09:36.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119938 2024-05-08T18:09:36.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:36.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.316731+0000", 2024-05-08T18:09:36.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050797459999999996 2024-05-08T18:09:36.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.330315+0000", 2024-05-08T18:09:36.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013584311999999999 2024-05-08T18:09:36.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.330370+0000", 2024-05-08T18:09:36.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5145000000000001e-05 2024-05-08T18:09:36.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.330413+0000", 2024-05-08T18:09:36.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2558000000000001e-05 2024-05-08T18:09:36.781 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.781 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.781 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.781 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2333 3.2b 3:d6cf7d4d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.tRy7Sv7BxoOoArPn6bd9wC4O5pse0_S_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:36.781 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:34.929579+0000", 2024-05-08T18:09:36.781 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.764683781, 2024-05-08T18:09:36.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020680451999999998, 2024-05-08T18:09:36.781 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.781 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.781 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.781 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:36.781 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:36.782 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.782 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2333 2024-05-08T18:09:36.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.782 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.929579+0000", 2024-05-08T18:09:36.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.929579+0000", 2024-05-08T18:09:36.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.929581+0000", 2024-05-08T18:09:36.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2170000000000001e-06 2024-05-08T18:09:36.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930432+0000", 2024-05-08T18:09:36.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000850733 2024-05-08T18:09:36.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930457+0000", 2024-05-08T18:09:36.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4953999999999999e-05 2024-05-08T18:09:36.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930468+0000", 2024-05-08T18:09:36.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:09:36.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930554+0000", 2024-05-08T18:09:36.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6224999999999995e-05 2024-05-08T18:09:36.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930684+0000", 2024-05-08T18:09:36.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013002599999999999 2024-05-08T18:09:36.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:36.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930799+0000", 2024-05-08T18:09:36.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114677 2024-05-08T18:09:36.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:36.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.936892+0000", 2024-05-08T18:09:36.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0060934259999999999 2024-05-08T18:09:36.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.950172+0000", 2024-05-08T18:09:36.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013279783999999999 2024-05-08T18:09:36.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.950220+0000", 2024-05-08T18:09:36.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7623999999999997e-05 2024-05-08T18:09:36.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.950259+0000", 2024-05-08T18:09:36.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.964e-05 2024-05-08T18:09:36.786 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.786 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.786 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.786 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2368 3.1b 3:dafb8647:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.o-lCHuSByDkvoT4LKUkRADgejSfQyJd_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:36.787 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:35.599786+0000", 2024-05-08T18:09:36.787 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.0944766889999999, 2024-05-08T18:09:36.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01993903, 2024-05-08T18:09:36.787 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.787 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.787 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.787 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:36.787 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:36.787 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.787 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2368 2024-05-08T18:09:36.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.787 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.599786+0000", 2024-05-08T18:09:36.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.599786+0000", 2024-05-08T18:09:36.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.599790+0000", 2024-05-08T18:09:36.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0759999999999996e-06 2024-05-08T18:09:36.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.601733+0000", 2024-05-08T18:09:36.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019429670000000001 2024-05-08T18:09:36.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.601787+0000", 2024-05-08T18:09:36.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4354999999999997e-05 2024-05-08T18:09:36.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.601815+0000", 2024-05-08T18:09:36.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7546999999999999e-05 2024-05-08T18:09:36.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.601924+0000", 2024-05-08T18:09:36.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010891300000000001 2024-05-08T18:09:36.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.602077+0000", 2024-05-08T18:09:36.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015319500000000001 2024-05-08T18:09:36.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:36.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.602204+0000", 2024-05-08T18:09:36.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127238 2024-05-08T18:09:36.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:36.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.614205+0000", 2024-05-08T18:09:36.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012000508 2024-05-08T18:09:36.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.619624+0000", 2024-05-08T18:09:36.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054195759999999997 2024-05-08T18:09:36.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.619667+0000", 2024-05-08T18:09:36.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2552000000000002e-05 2024-05-08T18:09:36.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.619725+0000", 2024-05-08T18:09:36.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8103000000000003e-05 2024-05-08T18:09:36.792 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.792 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.792 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.792 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2404 3.1 3:8218d405:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.bqgynIkQNaRvS-N0e0aQapo0Dh5XrQ2_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-05-08T18:09:36.792 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:36.285791+0000", 2024-05-08T18:09:36.792 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.40847202199999999, 2024-05-08T18:09:36.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023034451000000001, 2024-05-08T18:09:36.792 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:36.792 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:36.792 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2404 2024-05-08T18:09:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.285791+0000", 2024-05-08T18:09:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.285791+0000", 2024-05-08T18:09:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:36.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.285794+0000", 2024-05-08T18:09:36.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0290000000000001e-06 2024-05-08T18:09:36.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:36.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.287780+0000", 2024-05-08T18:09:36.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019862360000000002 2024-05-08T18:09:36.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:36.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.287815+0000", 2024-05-08T18:09:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5150000000000001e-05 2024-05-08T18:09:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.287830+0000", 2024-05-08T18:09:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4688000000000001e-05 2024-05-08T18:09:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.287909+0000", 2024-05-08T18:09:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9437999999999994e-05 2024-05-08T18:09:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:36.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.288035+0000", 2024-05-08T18:09:36.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012566899999999999 2024-05-08T18:09:36.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:36.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.288141+0000", 2024-05-08T18:09:36.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106463 2024-05-08T18:09:36.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:36.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.296390+0000", 2024-05-08T18:09:36.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008248488 2024-05-08T18:09:36.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.308672+0000", 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012282039 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.308760+0000", 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8350999999999995e-05 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.308825+0000", 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4900000000000005e-05 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:36.797 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:36.798 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:36.799 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:09:36.799 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:36.800+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:36.877 INFO:teuthology.orchestra.run.smithi080.stderr:set 3.33 pg_upmap_items mapping to [6->7,1->4] 2024-05-08T18:09:36.899 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:36.900+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:36.978 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:36.978 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:36.978 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:36.978 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:36.993 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:09:37.000 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:37.001+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:37.038 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:09:37.100 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:37.101+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:37.115 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:37.116 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:37.130 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:09:37.179 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:37.179 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:37.197 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:37.197 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:37.200 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:37.200+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:37.214 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:37.214 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:37.232 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:37.232 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:37.255 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:37.256 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:37.256 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:37.256 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:37.272 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:09:37.277 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:37.278 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:37.299 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:37.299 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:37.301 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:37.301+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:37.319 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:37.319 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:37.393 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:37.393 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:37.403 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:37.401+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:37.407 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:09:37.504 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:37.504+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:37.528 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:37.528 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:37.544 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:09:37.604 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:37.605+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:37.705 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:37.704+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:37.721 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:37.721 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:37.735 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:09:37.825 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:37.828+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:37.903 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:09:37.904 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:37.905 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:37.906 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:37.908+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:37.920 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:09:38.014 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:38.016+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:38.098 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:38.098 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:38.109 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:38.108+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:38.112 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:09:38.209 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:38.208+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:38.283 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:38.283 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:38.297 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:09:38.342 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:38.344+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:38.411 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:38.412+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:38.423 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:38.423 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:38.437 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:09:38.512 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:38.513+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:38.555 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:38.555 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:38.569 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:09:38.612 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:38.613+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:38.713 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:38.713+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:38.735 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:38.735 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:38.750 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:09:38.836 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:38.837+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:38.901 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-05-08T18:09:38.914 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:38.914 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:38.915 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:38.913+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:38.928 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:09:39.016 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:39.016+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:39.101 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:39.101 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:39.115 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:09:39.117 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:39.117+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:39.218 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:39.217+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:39.386 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:09:39.388 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:39.388 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:39.388 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:09:39.389 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:39.388+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:39.488 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:39.488+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:39.548 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:39.548 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:39.569 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:39.569 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:39.580 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:39.580 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:39.583 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:09:39.597 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:39.598 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:39.618 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:39.618 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:39.631 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:39.633+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:39.652 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:39.652 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:39.673 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:39.673 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:39.689 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:39.689+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:39.699 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:39.699 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:39.701 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:39.701 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:39.701 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:39.701 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:39.701 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:39.715 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:09:39.721 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:39.721 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:39.790 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:39.792+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:39.883 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:39.883 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:39.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:39.884 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:39.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.884 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:09:39.884 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:39.884 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 136.34637862700001, 2024-05-08T18:09:39.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.032012946, 2024-05-08T18:09:39.884 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.884 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.884 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.884 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.884 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.884 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.884 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:09:39.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.884 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:39.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:39.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535484+0000", 2024-05-08T18:09:39.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7929999999999999e-06 2024-05-08T18:09:39.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535500+0000", 2024-05-08T18:09:39.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5226e-05 2024-05-08T18:09:39.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535535+0000", 2024-05-08T18:09:39.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5213000000000003e-05 2024-05-08T18:09:39.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535564+0000", 2024-05-08T18:09:39.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9360999999999999e-05 2024-05-08T18:09:39.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535757+0000", 2024-05-08T18:09:39.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000193229 2024-05-08T18:09:39.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:39.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535775+0000", 2024-05-08T18:09:39.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7098000000000001e-05 2024-05-08T18:09:39.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556004+0000", 2024-05-08T18:09:39.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020229068999999999 2024-05-08T18:09:39.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:39.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556036+0000", 2024-05-08T18:09:39.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1943000000000002e-05 2024-05-08T18:09:39.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.564721+0000", 2024-05-08T18:09:39.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086853320000000005 2024-05-08T18:09:39.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565032+0000", 2024-05-08T18:09:39.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031121799999999999 2024-05-08T18:09:39.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:39.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565365+0000", 2024-05-08T18:09:39.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000332744 2024-05-08T18:09:39.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567305+0000", 2024-05-08T18:09:39.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00194016 2024-05-08T18:09:39.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567368+0000", 2024-05-08T18:09:39.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3342000000000004e-05 2024-05-08T18:09:39.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567433+0000", 2024-05-08T18:09:39.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4726000000000003e-05 2024-05-08T18:09:39.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567494+0000", 2024-05-08T18:09:39.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0492000000000003e-05 2024-05-08T18:09:39.892 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.892 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.892 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.892 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1189 3.20 3:054e8a9f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:39.892 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:39.892 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 32.921689221000001, 2024-05-08T18:09:39.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025093629999999999, 2024-05-08T18:09:39.892 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.892 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.892 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.893 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.893 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.893 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.893 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1189 2024-05-08T18:09:39.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.893 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:39.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:39.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960173+0000", 2024-05-08T18:09:39.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.65e-06 2024-05-08T18:09:39.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965720+0000", 2024-05-08T18:09:39.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055476340000000001 2024-05-08T18:09:39.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965757+0000", 2024-05-08T18:09:39.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6223000000000002e-05 2024-05-08T18:09:39.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965774+0000", 2024-05-08T18:09:39.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6952999999999998e-05 2024-05-08T18:09:39.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965930+0000", 2024-05-08T18:09:39.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015611800000000001 2024-05-08T18:09:39.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966190+0000", 2024-05-08T18:09:39.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025999399999999999 2024-05-08T18:09:39.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:39.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966440+0000", 2024-05-08T18:09:39.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025007600000000001 2024-05-08T18:09:39.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981042+0000", 2024-05-08T18:09:39.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01460257 2024-05-08T18:09:39.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.984969+0000", 2024-05-08T18:09:39.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039265159999999997 2024-05-08T18:09:39.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985135+0000", 2024-05-08T18:09:39.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016630400000000001 2024-05-08T18:09:39.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985264+0000", 2024-05-08T18:09:39.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012859199999999999 2024-05-08T18:09:39.897 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.897 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.897 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.898 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1209 3.35 3:af4c6abe:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:39.898 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:39.898 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 32.706427574000003, 2024-05-08T18:09:39.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027313356, 2024-05-08T18:09:39.898 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.898 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.898 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.898 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.898 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.898 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.898 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1209 2024-05-08T18:09:39.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.899 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:39.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:39.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175436+0000", 2024-05-08T18:09:39.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3800000000000004e-06 2024-05-08T18:09:39.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179472+0000", 2024-05-08T18:09:39.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040357020000000004 2024-05-08T18:09:39.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179515+0000", 2024-05-08T18:09:39.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2988999999999998e-05 2024-05-08T18:09:39.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179534+0000", 2024-05-08T18:09:39.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8743e-05 2024-05-08T18:09:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179673+0000", 2024-05-08T18:09:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013983800000000001 2024-05-08T18:09:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179933+0000", 2024-05-08T18:09:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025967999999999998 2024-05-08T18:09:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180161+0000", 2024-05-08T18:09:39.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022826300000000001 2024-05-08T18:09:39.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.200613+0000", 2024-05-08T18:09:39.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020451766999999999 2024-05-08T18:09:39.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202567+0000", 2024-05-08T18:09:39.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019541160000000001 2024-05-08T18:09:39.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202665+0000", 2024-05-08T18:09:39.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8055999999999998e-05 2024-05-08T18:09:39.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202745+0000", 2024-05-08T18:09:39.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9821999999999996e-05 2024-05-08T18:09:39.903 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.903 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.903 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.903 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1221 3.20 3:071d1257:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:39.903 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:39.903 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 32.287112698999998, 2024-05-08T18:09:39.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02822473, 2024-05-08T18:09:39.903 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.904 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.904 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.904 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.904 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.904 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.904 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1221 2024-05-08T18:09:39.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.904 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:39.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:39.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594751+0000", 2024-05-08T18:09:39.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3769999999999998e-06 2024-05-08T18:09:39.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600627+0000", 2024-05-08T18:09:39.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058764389999999998 2024-05-08T18:09:39.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600672+0000", 2024-05-08T18:09:39.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4805999999999998e-05 2024-05-08T18:09:39.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600704+0000", 2024-05-08T18:09:39.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2026000000000001e-05 2024-05-08T18:09:39.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600884+0000", 2024-05-08T18:09:39.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000179385 2024-05-08T18:09:39.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601296+0000", 2024-05-08T18:09:39.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041257400000000002 2024-05-08T18:09:39.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:39.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601742+0000", 2024-05-08T18:09:39.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044585399999999998 2024-05-08T18:09:39.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.617360+0000", 2024-05-08T18:09:39.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015617982000000001 2024-05-08T18:09:39.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622618+0000", 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052577420000000001 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622835+0000", 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021674699999999999 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622971+0000", 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679799999999999 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.908 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1275 3.33 e85/20 3:ccdf9558:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_3:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:39.909 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:39.909 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.828269663, 2024-05-08T18:09:39.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020251129, 2024-05-08T18:09:39.909 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.909 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.909 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.909 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:39.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:39.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053592+0000", 2024-05-08T18:09:39.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5189999999999999e-06 2024-05-08T18:09:39.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059662+0000", 2024-05-08T18:09:39.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060699289999999999 2024-05-08T18:09:39.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059680+0000", 2024-05-08T18:09:39.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7558999999999999e-05 2024-05-08T18:09:39.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059689+0000", 2024-05-08T18:09:39.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2320000000000007e-06 2024-05-08T18:09:39.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059826+0000", 2024-05-08T18:09:39.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136792 2024-05-08T18:09:39.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059867+0000", 2024-05-08T18:09:39.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1689e-05 2024-05-08T18:09:39.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073728+0000", 2024-05-08T18:09:39.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01386104 2024-05-08T18:09:39.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073841+0000", 2024-05-08T18:09:39.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011236899999999999 2024-05-08T18:09:39.912 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.913 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.913 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.913 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1286 3.20 3:07ccb256:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:39.913 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:39.913 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.677575049000001, 2024-05-08T18:09:39.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022546805999999999, 2024-05-08T18:09:39.913 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.913 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.913 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.913 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.913 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.913 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.913 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1286 2024-05-08T18:09:39.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.914 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:39.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:39.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204287+0000", 2024-05-08T18:09:39.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8880000000000001e-06 2024-05-08T18:09:39.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208135+0000", 2024-05-08T18:09:39.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038480960000000001 2024-05-08T18:09:39.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208158+0000", 2024-05-08T18:09:39.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-05 2024-05-08T18:09:39.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208172+0000", 2024-05-08T18:09:39.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:09:39.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208251+0000", 2024-05-08T18:09:39.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8863999999999996e-05 2024-05-08T18:09:39.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208387+0000", 2024-05-08T18:09:39.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013615099999999999 2024-05-08T18:09:39.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:39.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208488+0000", 2024-05-08T18:09:39.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101366 2024-05-08T18:09:39.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.214533+0000", 2024-05-08T18:09:39.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060444829999999998 2024-05-08T18:09:39.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226742+0000", 2024-05-08T18:09:39.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012208798 2024-05-08T18:09:39.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226792+0000", 2024-05-08T18:09:39.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0565999999999997e-05 2024-05-08T18:09:39.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226831+0000", 2024-05-08T18:09:39.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8816999999999998e-05 2024-05-08T18:09:39.918 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.918 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.918 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.919 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1397 3.34 e87/20 3:2c6418f0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_3:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:39.919 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:39.919 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 28.07914306, 2024-05-08T18:09:39.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019946450000000001, 2024-05-08T18:09:39.919 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.919 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.919 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.919 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:39.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:39.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802717+0000", 2024-05-08T18:09:39.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0400000000000005e-07 2024-05-08T18:09:39.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807936+0000", 2024-05-08T18:09:39.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052192489999999996 2024-05-08T18:09:39.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807971+0000", 2024-05-08T18:09:39.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4517000000000002e-05 2024-05-08T18:09:39.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807993+0000", 2024-05-08T18:09:39.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2463000000000002e-05 2024-05-08T18:09:39.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.808151+0000", 2024-05-08T18:09:39.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015751400000000001 2024-05-08T18:09:39.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.808197+0000", 2024-05-08T18:09:39.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6637000000000001e-05 2024-05-08T18:09:39.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822537+0000", 2024-05-08T18:09:39.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014339607000000001 2024-05-08T18:09:39.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822663+0000", 2024-05-08T18:09:39.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125659 2024-05-08T18:09:39.922 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.922 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.923 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.923 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1399 3.2c 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:39.923 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:39.923 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 28.062431529000001, 2024-05-08T18:09:39.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030683200000000001, 2024-05-08T18:09:39.923 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.923 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.923 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.923 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.923 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.923 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.924 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1399 2024-05-08T18:09:39.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.924 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:39.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:39.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819432+0000", 2024-05-08T18:09:39.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7759999999999999e-06 2024-05-08T18:09:39.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825021+0000", 2024-05-08T18:09:39.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055895859999999997 2024-05-08T18:09:39.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825052+0000", 2024-05-08T18:09:39.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1047000000000003e-05 2024-05-08T18:09:39.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825068+0000", 2024-05-08T18:09:39.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6138999999999999e-05 2024-05-08T18:09:39.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825218+0000", 2024-05-08T18:09:39.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014997200000000001 2024-05-08T18:09:39.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825490+0000", 2024-05-08T18:09:39.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000271446 2024-05-08T18:09:39.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:39.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825710+0000", 2024-05-08T18:09:39.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220354 2024-05-08T18:09:39.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.839642+0000", 2024-05-08T18:09:39.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013932363 2024-05-08T18:09:39.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849813+0000", 2024-05-08T18:09:39.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010170461 2024-05-08T18:09:39.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849981+0000", 2024-05-08T18:09:39.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016776399999999999 2024-05-08T18:09:39.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.850111+0000", 2024-05-08T18:09:39.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013029200000000001 2024-05-08T18:09:39.928 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.928 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.928 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.929 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1406 3.20 3:05e3d3c1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:39.929 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:39.929 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 27.992860417999999, 2024-05-08T18:09:39.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022642778999999998, 2024-05-08T18:09:39.929 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.929 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.929 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.929 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.929 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.929 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.929 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1406 2024-05-08T18:09:39.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.929 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:39.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:39.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.889003+0000", 2024-05-08T18:09:39.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8670000000000004e-06 2024-05-08T18:09:39.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893237+0000", 2024-05-08T18:09:39.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042339999999999999 2024-05-08T18:09:39.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893279+0000", 2024-05-08T18:09:39.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2225999999999999e-05 2024-05-08T18:09:39.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893305+0000", 2024-05-08T18:09:39.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.618e-05 2024-05-08T18:09:39.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893479+0000", 2024-05-08T18:09:39.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017357700000000001 2024-05-08T18:09:39.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893736+0000", 2024-05-08T18:09:39.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025701700000000001 2024-05-08T18:09:39.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:39.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893993+0000", 2024-05-08T18:09:39.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025750700000000003 2024-05-08T18:09:39.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904227+0000", 2024-05-08T18:09:39.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010234073 2024-05-08T18:09:39.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911471+0000", 2024-05-08T18:09:39.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0072441909999999997 2024-05-08T18:09:39.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911567+0000", 2024-05-08T18:09:39.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5685000000000003e-05 2024-05-08T18:09:39.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911642+0000", 2024-05-08T18:09:39.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4456000000000007e-05 2024-05-08T18:09:39.934 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.934 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.934 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.934 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1416 3.2c 3:345ebd70:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:39.934 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:39.934 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 27.885489213, 2024-05-08T18:09:39.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027523229999999999, 2024-05-08T18:09:39.935 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.935 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.935 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.935 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.935 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.935 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.935 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1416 2024-05-08T18:09:39.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.935 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:39.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:39.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996374+0000", 2024-05-08T18:09:39.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.506e-06 2024-05-08T18:09:39.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000305+0000", 2024-05-08T18:09:39.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003931197 2024-05-08T18:09:39.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000346+0000", 2024-05-08T18:09:39.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1396000000000001e-05 2024-05-08T18:09:39.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000364+0000", 2024-05-08T18:09:39.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.806e-05 2024-05-08T18:09:39.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000490+0000", 2024-05-08T18:09:39.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012581800000000001 2024-05-08T18:09:39.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000755+0000", 2024-05-08T18:09:39.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026484700000000002 2024-05-08T18:09:39.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:39.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000992+0000", 2024-05-08T18:09:39.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023701700000000001 2024-05-08T18:09:39.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010465+0000", 2024-05-08T18:09:39.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094726429999999993 2024-05-08T18:09:39.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023679+0000", 2024-05-08T18:09:39.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013214105 2024-05-08T18:09:39.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023776+0000", 2024-05-08T18:09:39.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7258999999999998e-05 2024-05-08T18:09:39.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023893+0000", 2024-05-08T18:09:39.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117382 2024-05-08T18:09:39.939 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.940 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.940 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.940 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1451 3.36 3:6da4b5f8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:39.940 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:39.940 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.584816580000002, 2024-05-08T18:09:39.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022119236, 2024-05-08T18:09:39.940 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.940 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.940 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.940 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.941 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.941 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.941 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1451 2024-05-08T18:09:39.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.941 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:39.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:39.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297046+0000", 2024-05-08T18:09:39.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6030000000000001e-06 2024-05-08T18:09:39.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301125+0000", 2024-05-08T18:09:39.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004079058 2024-05-08T18:09:39.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301163+0000", 2024-05-08T18:09:39.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7286000000000002e-05 2024-05-08T18:09:39.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301181+0000", 2024-05-08T18:09:39.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.844e-05 2024-05-08T18:09:39.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301325+0000", 2024-05-08T18:09:39.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144284 2024-05-08T18:09:39.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301602+0000", 2024-05-08T18:09:39.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027665399999999998 2024-05-08T18:09:39.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:39.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301835+0000", 2024-05-08T18:09:39.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023292699999999999 2024-05-08T18:09:39.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.318166+0000", 2024-05-08T18:09:39.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016331061000000001 2024-05-08T18:09:39.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.318991+0000", 2024-05-08T18:09:39.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000825427 2024-05-08T18:09:39.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.319082+0000", 2024-05-08T18:09:39.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0743999999999997e-05 2024-05-08T18:09:39.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.319162+0000", 2024-05-08T18:09:39.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9752000000000005e-05 2024-05-08T18:09:39.945 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.945 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.945 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.945 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1471 3.26 3:6495ae89:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:39.945 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:39.946 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.185212359000001, 2024-05-08T18:09:39.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022361453, 2024-05-08T18:09:39.946 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.946 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.946 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.946 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.946 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.946 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.946 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1471 2024-05-08T18:09:39.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.946 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:39.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:39.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696650+0000", 2024-05-08T18:09:39.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8839999999999998e-06 2024-05-08T18:09:39.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700528+0000", 2024-05-08T18:09:39.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038783390000000002 2024-05-08T18:09:39.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700554+0000", 2024-05-08T18:09:39.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6106e-05 2024-05-08T18:09:39.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700566+0000", 2024-05-08T18:09:39.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2021000000000001e-05 2024-05-08T18:09:39.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700682+0000", 2024-05-08T18:09:39.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115457 2024-05-08T18:09:39.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700951+0000", 2024-05-08T18:09:39.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026891699999999997 2024-05-08T18:09:39.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:39.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.701210+0000", 2024-05-08T18:09:39.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000259017 2024-05-08T18:09:39.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718848+0000", 2024-05-08T18:09:39.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017638132000000001 2024-05-08T18:09:39.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718917+0000", 2024-05-08T18:09:39.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9564e-05 2024-05-08T18:09:39.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718968+0000", 2024-05-08T18:09:39.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1028e-05 2024-05-08T18:09:39.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.719008+0000", 2024-05-08T18:09:39.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9987999999999997e-05 2024-05-08T18:09:39.951 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.951 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.951 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.951 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1669 3.2c 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-05-08T18:09:39.951 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:39.951 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.081947255999999, 2024-05-08T18:09:39.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020235185999999999, 2024-05-08T18:09:39.951 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.951 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.951 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-05-08T18:09:39.951 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.951 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.952 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.952 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1669 2024-05-08T18:09:39.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.952 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:39.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:39.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799916+0000", 2024-05-08T18:09:39.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7730000000000001e-06 2024-05-08T18:09:39.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799931+0000", 2024-05-08T18:09:39.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5227e-05 2024-05-08T18:09:39.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799969+0000", 2024-05-08T18:09:39.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7883000000000003e-05 2024-05-08T18:09:39.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799986+0000", 2024-05-08T18:09:39.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6728999999999999e-05 2024-05-08T18:09:39.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.800123+0000", 2024-05-08T18:09:39.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013784600000000001 2024-05-08T18:09:39.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:39.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.800135+0000", 2024-05-08T18:09:39.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1336e-05 2024-05-08T18:09:39.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.805653+0000", 2024-05-08T18:09:39.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055179890000000001 2024-05-08T18:09:39.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.805876+0000", 2024-05-08T18:09:39.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022279 2024-05-08T18:09:39.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.820147+0000", 2024-05-08T18:09:39.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014271613000000001 2024-05-08T18:09:39.955 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.955 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.955 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1910 3.a 3:537830e8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.21:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:25.987700+0000", 2024-05-08T18:09:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.894159434000001, 2024-05-08T18:09:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020512796999999999, 2024-05-08T18:09:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1910 2024-05-08T18:09:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.987700+0000", 2024-05-08T18:09:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.987700+0000", 2024-05-08T18:09:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.987703+0000", 2024-05-08T18:09:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1130000000000001e-06 2024-05-08T18:09:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991635+0000", 2024-05-08T18:09:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039315579999999999 2024-05-08T18:09:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991673+0000", 2024-05-08T18:09:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8550000000000002e-05 2024-05-08T18:09:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991691+0000", 2024-05-08T18:09:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.768e-05 2024-05-08T18:09:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991796+0000", 2024-05-08T18:09:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105474 2024-05-08T18:09:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.992021+0000", 2024-05-08T18:09:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022432999999999999 2024-05-08T18:09:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.992664+0000", 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064343099999999997 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.004478+0000", 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011814069 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.008061+0000", 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035826289999999999 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.008129+0000", 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8734999999999998e-05 2024-05-08T18:09:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.008213+0000", 2024-05-08T18:09:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3227999999999997e-05 2024-05-08T18:09:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1937 3.35 3:afad9b8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.kKJI4mkViIqglOaR5LKVFjY-f90axEe_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:26.656524+0000", 2024-05-08T18:09:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.225335060000001, 2024-05-08T18:09:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025036721000000001, 2024-05-08T18:09:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.962 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.962 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.962 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.962 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.962 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.962 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1937 2024-05-08T18:09:39.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.962 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.656524+0000", 2024-05-08T18:09:39.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.656524+0000", 2024-05-08T18:09:39.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.656528+0000", 2024-05-08T18:09:39.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7469999999999999e-06 2024-05-08T18:09:39.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.661958+0000", 2024-05-08T18:09:39.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054303229999999999 2024-05-08T18:09:39.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.662000+0000", 2024-05-08T18:09:39.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1412999999999998e-05 2024-05-08T18:09:39.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.662018+0000", 2024-05-08T18:09:39.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8162999999999999e-05 2024-05-08T18:09:39.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.662193+0000", 2024-05-08T18:09:39.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000175518 2024-05-08T18:09:39.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.662674+0000", 2024-05-08T18:09:39.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048055800000000002 2024-05-08T18:09:39.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:39.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.663088+0000", 2024-05-08T18:09:39.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041393799999999998 2024-05-08T18:09:39.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.680805+0000", 2024-05-08T18:09:39.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017716942999999999 2024-05-08T18:09:39.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.681387+0000", 2024-05-08T18:09:39.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00058174300000000002 2024-05-08T18:09:39.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.681483+0000", 2024-05-08T18:09:39.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6168999999999994e-05 2024-05-08T18:09:39.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.681561+0000", 2024-05-08T18:09:39.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8206000000000003e-05 2024-05-08T18:09:39.966 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.966 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.967 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.967 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1951 3.26 3:66b697c3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.seZFA2ZEY-Crt1uNfyqRLzirbZGBgqA_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:39.967 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:26.935268+0000", 2024-05-08T18:09:39.967 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.946591159, 2024-05-08T18:09:39.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021970598000000001, 2024-05-08T18:09:39.967 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.967 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.967 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.967 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.967 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.967 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.968 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1951 2024-05-08T18:09:39.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.968 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.935268+0000", 2024-05-08T18:09:39.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.935268+0000", 2024-05-08T18:09:39.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.935271+0000", 2024-05-08T18:09:39.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.943e-06 2024-05-08T18:09:39.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939177+0000", 2024-05-08T18:09:39.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039056239999999999 2024-05-08T18:09:39.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939217+0000", 2024-05-08T18:09:39.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0639000000000002e-05 2024-05-08T18:09:39.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939236+0000", 2024-05-08T18:09:39.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8580000000000002e-05 2024-05-08T18:09:39.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939315+0000", 2024-05-08T18:09:39.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9297999999999999e-05 2024-05-08T18:09:39.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939427+0000", 2024-05-08T18:09:39.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000111999 2024-05-08T18:09:39.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:39.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939520+0000", 2024-05-08T18:09:39.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2717e-05 2024-05-08T18:09:39.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.956451+0000", 2024-05-08T18:09:39.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016931531999999999 2024-05-08T18:09:39.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.957119+0000", 2024-05-08T18:09:39.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00066793099999999997 2024-05-08T18:09:39.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.957190+0000", 2024-05-08T18:09:39.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0894000000000003e-05 2024-05-08T18:09:39.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.957239+0000", 2024-05-08T18:09:39.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8440999999999999e-05 2024-05-08T18:09:39.972 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.972 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.972 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.973 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1978 3.20 3:06c7576f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.32:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:39.973 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.490306+0000", 2024-05-08T18:09:39.973 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.391552979, 2024-05-08T18:09:39.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022573467999999999, 2024-05-08T18:09:39.973 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.973 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.973 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.973 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.973 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.973 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.973 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1978 2024-05-08T18:09:39.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.973 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.490306+0000", 2024-05-08T18:09:39.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.490306+0000", 2024-05-08T18:09:39.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.490308+0000", 2024-05-08T18:09:39.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1440000000000001e-06 2024-05-08T18:09:39.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.494869+0000", 2024-05-08T18:09:39.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045608669999999997 2024-05-08T18:09:39.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.494904+0000", 2024-05-08T18:09:39.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4313000000000002e-05 2024-05-08T18:09:39.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.494924+0000", 2024-05-08T18:09:39.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0322999999999998e-05 2024-05-08T18:09:39.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.495122+0000", 2024-05-08T18:09:39.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019849700000000001 2024-05-08T18:09:39.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.495386+0000", 2024-05-08T18:09:39.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026385100000000001 2024-05-08T18:09:39.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:39.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.496266+0000", 2024-05-08T18:09:39.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000880184 2024-05-08T18:09:39.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.505362+0000", 2024-05-08T18:09:39.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0090952729999999992 2024-05-08T18:09:39.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.512528+0000", 2024-05-08T18:09:39.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00716593 2024-05-08T18:09:39.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.512736+0000", 2024-05-08T18:09:39.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020801399999999999 2024-05-08T18:09:39.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.512880+0000", 2024-05-08T18:09:39.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144072 2024-05-08T18:09:39.978 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.978 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.978 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.978 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1981 3.10 3:0ac06fda:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.G5bm6z3gJ2RUQJmZVjgkH_wtdE6Lk0X_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:39.978 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.593918+0000", 2024-05-08T18:09:39.978 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.287941316, 2024-05-08T18:09:39.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.03011194, 2024-05-08T18:09:39.978 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.978 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.979 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.979 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.979 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.979 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.979 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1981 2024-05-08T18:09:39.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.979 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.593918+0000", 2024-05-08T18:09:39.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.593918+0000", 2024-05-08T18:09:39.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.593921+0000", 2024-05-08T18:09:39.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.886e-06 2024-05-08T18:09:39.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601287+0000", 2024-05-08T18:09:39.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073666119999999998 2024-05-08T18:09:39.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601352+0000", 2024-05-08T18:09:39.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4949000000000004e-05 2024-05-08T18:09:39.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601387+0000", 2024-05-08T18:09:39.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4422999999999999e-05 2024-05-08T18:09:39.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601621+0000", 2024-05-08T18:09:39.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000234317 2024-05-08T18:09:39.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601892+0000", 2024-05-08T18:09:39.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027052000000000001 2024-05-08T18:09:39.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:39.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.602131+0000", 2024-05-08T18:09:39.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023928799999999999 2024-05-08T18:09:39.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.613758+0000", 2024-05-08T18:09:39.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011626745000000001 2024-05-08T18:09:39.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.623860+0000", 2024-05-08T18:09:39.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010102709 2024-05-08T18:09:39.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.623958+0000", 2024-05-08T18:09:39.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8076000000000001e-05 2024-05-08T18:09:39.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.624030+0000", 2024-05-08T18:09:39.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1415000000000007e-05 2024-05-08T18:09:39.984 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.984 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.984 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.984 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1982 3.2c 3:37eb8330:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.G5bm6z3gJ2RUQJmZVjgkH_wtdE6Lk0X_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:39.984 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.601454+0000", 2024-05-08T18:09:39.984 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.280405676999999, 2024-05-08T18:09:39.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022793639000000001, 2024-05-08T18:09:39.984 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.984 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.985 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.985 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.985 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.985 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.985 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1982 2024-05-08T18:09:39.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.985 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601454+0000", 2024-05-08T18:09:39.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601454+0000", 2024-05-08T18:09:39.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601456+0000", 2024-05-08T18:09:39.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8669999999999998e-06 2024-05-08T18:09:39.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.604859+0000", 2024-05-08T18:09:39.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034024260000000001 2024-05-08T18:09:39.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.604906+0000", 2024-05-08T18:09:39.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7092999999999998e-05 2024-05-08T18:09:39.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.604923+0000", 2024-05-08T18:09:39.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.662e-05 2024-05-08T18:09:39.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.605130+0000", 2024-05-08T18:09:39.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020757100000000001 2024-05-08T18:09:39.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.605526+0000", 2024-05-08T18:09:39.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039611600000000001 2024-05-08T18:09:39.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:39.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.605857+0000", 2024-05-08T18:09:39.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033062 2024-05-08T18:09:39.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.621816+0000", 2024-05-08T18:09:39.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015958882000000001 2024-05-08T18:09:39.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.623918+0000", 2024-05-08T18:09:39.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021022340000000001 2024-05-08T18:09:39.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.624122+0000", 2024-05-08T18:09:39.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020434500000000001 2024-05-08T18:09:39.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.624247+0000", 2024-05-08T18:09:39.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486499999999999 2024-05-08T18:09:39.989 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.989 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.989 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.990 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2208 3.10 3:08359eaa:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.JvpG1UkgF07tjBx14bFPyAh6Qi9W8uk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:39.990 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:32.430144+0000", 2024-05-08T18:09:39.990 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 7.4517149549999999, 2024-05-08T18:09:39.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022193701, 2024-05-08T18:09:39.990 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:39.990 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:39.990 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:39.990 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:39.990 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:39.990 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:39.990 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2208 2024-05-08T18:09:39.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.990 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:39.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:39.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.430144+0000", 2024-05-08T18:09:39.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:39.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.430144+0000", 2024-05-08T18:09:39.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:39.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:39.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.430147+0000", 2024-05-08T18:09:39.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.016e-06 2024-05-08T18:09:39.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:39.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.434914+0000", 2024-05-08T18:09:39.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047662060000000003 2024-05-08T18:09:39.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:39.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.434954+0000", 2024-05-08T18:09:39.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0565999999999998e-05 2024-05-08T18:09:39.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:39.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.434973+0000", 2024-05-08T18:09:39.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8519999999999999e-05 2024-05-08T18:09:39.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:39.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.435143+0000", 2024-05-08T18:09:39.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017024799999999999 2024-05-08T18:09:39.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:39.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.435414+0000", 2024-05-08T18:09:39.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000271628 2024-05-08T18:09:39.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:39.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.435656+0000", 2024-05-08T18:09:39.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024159800000000001 2024-05-08T18:09:39.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:39.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.451116+0000", 2024-05-08T18:09:39.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015460135999999999 2024-05-08T18:09:39.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:39.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.452109+0000", 2024-05-08T18:09:39.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00099277799999999993 2024-05-08T18:09:39.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:39.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.452209+0000", 2024-05-08T18:09:39.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010048300000000001 2024-05-08T18:09:39.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:39.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:39.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:39.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.452338+0000", 2024-05-08T18:09:39.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128522 2024-05-08T18:09:39.995 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.995 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.995 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.995 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:39.995 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:39.995 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:39.996 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:09:39.997 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:39.997+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:40.098 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:40.097+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:40.170 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:40.170 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:40.170 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:40.170 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:40.184 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:09:40.228 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:40.229+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:40.299 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:40.300+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:40.353 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:40.353 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:40.367 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:09:40.412 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:40.413+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:40.498 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:40.498 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:40.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:40.498 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:40.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.498 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:09:40.498 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:40.498 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 157.68169668799999, 2024-05-08T18:09:40.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.16213206199999999, 2024-05-08T18:09:40.498 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.498 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.499 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.499 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.499 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:09:40.499 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:09:40.501 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1 2024-05-08T18:09:40.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.501 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:40.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:40.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814494+0000", 2024-05-08T18:09:40.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:09:40.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814520+0000", 2024-05-08T18:09:40.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-05 2024-05-08T18:09:40.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814543+0000", 2024-05-08T18:09:40.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2353000000000001e-05 2024-05-08T18:09:40.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814563+0000", 2024-05-08T18:09:40.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.048e-05 2024-05-08T18:09:40.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814677+0000", 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113632 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814705+0000", 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8626999999999999e-05 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971115+0000", 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.156409825 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971438+0000", 2024-05-08T18:09:40.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00032289200000000002 2024-05-08T18:09:40.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:40.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971849+0000", 2024-05-08T18:09:40.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041139300000000002 2024-05-08T18:09:40.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.975364+0000", 2024-05-08T18:09:40.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035148390000000001 2024-05-08T18:09:40.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976474+0000", 2024-05-08T18:09:40.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001110099 2024-05-08T18:09:40.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976564+0000", 2024-05-08T18:09:40.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9522000000000001e-05 2024-05-08T18:09:40.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976624+0000", 2024-05-08T18:09:40.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9616e-05 2024-05-08T18:09:40.506 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.506 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.506 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1194 3.16 e85/20 3:6b2325a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_6:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 33.475294478000002, 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024064767000000001, 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020897+0000", 2024-05-08T18:09:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9699999999999999e-06 2024-05-08T18:09:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027491+0000", 2024-05-08T18:09:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065945229999999997 2024-05-08T18:09:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027543+0000", 2024-05-08T18:09:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1319000000000001e-05 2024-05-08T18:09:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027573+0000", 2024-05-08T18:09:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0380000000000001e-05 2024-05-08T18:09:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027737+0000", 2024-05-08T18:09:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000163871 2024-05-08T18:09:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027782+0000", 2024-05-08T18:09:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5519999999999998e-05 2024-05-08T18:09:40.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044819+0000", 2024-05-08T18:09:40.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017036481999999999 2024-05-08T18:09:40.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044958+0000", 2024-05-08T18:09:40.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013970200000000001 2024-05-08T18:09:40.510 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.510 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.510 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.511 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1202 3.14 e85/20 3:2a8c8569:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_14:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:40.511 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:40.511 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 33.38934441, 2024-05-08T18:09:40.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023371860000000001, 2024-05-08T18:09:40.511 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.511 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.511 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.511 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:40.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:40.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106846+0000", 2024-05-08T18:09:40.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:09:40.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110841+0000", 2024-05-08T18:09:40.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039945479999999997 2024-05-08T18:09:40.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110888+0000", 2024-05-08T18:09:40.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7349999999999999e-05 2024-05-08T18:09:40.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110913+0000", 2024-05-08T18:09:40.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5055999999999999e-05 2024-05-08T18:09:40.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.111067+0000", 2024-05-08T18:09:40.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015329800000000001 2024-05-08T18:09:40.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.111110+0000", 2024-05-08T18:09:40.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3649000000000002e-05 2024-05-08T18:09:40.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130087+0000", 2024-05-08T18:09:40.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018976186999999999 2024-05-08T18:09:40.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130216+0000", 2024-05-08T18:09:40.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012911199999999999 2024-05-08T18:09:40.514 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.514 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.515 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.515 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1207 3.15 3:a96d965c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:40.515 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:40.515 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 33.343762134999999, 2024-05-08T18:09:40.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02864527, 2024-05-08T18:09:40.515 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.515 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.515 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.515 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.515 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:40.515 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:40.515 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1207 2024-05-08T18:09:40.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152430+0000", 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1230000000000002e-06 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157227+0000", 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047968769999999997 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157268+0000", 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0673000000000002e-05 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157293+0000", 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5469999999999998e-05 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157483+0000", 2024-05-08T18:09:40.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018973300000000001 2024-05-08T18:09:40.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157750+0000", 2024-05-08T18:09:40.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026736400000000002 2024-05-08T18:09:40.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:40.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157982+0000", 2024-05-08T18:09:40.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023154299999999999 2024-05-08T18:09:40.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.171224+0000", 2024-05-08T18:09:40.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013242115 2024-05-08T18:09:40.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180801+0000", 2024-05-08T18:09:40.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0095766749999999998 2024-05-08T18:09:40.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180919+0000", 2024-05-08T18:09:40.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118546 2024-05-08T18:09:40.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.181071+0000", 2024-05-08T18:09:40.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152151 2024-05-08T18:09:40.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1224 3.13 3:c82cef46:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 32.857708488999997, 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025580821, 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1224 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.520 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:40.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:40.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638484+0000", 2024-05-08T18:09:40.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1989999999999999e-06 2024-05-08T18:09:40.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643068+0000", 2024-05-08T18:09:40.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045841859999999996 2024-05-08T18:09:40.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643099+0000", 2024-05-08T18:09:40.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1331999999999997e-05 2024-05-08T18:09:40.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643117+0000", 2024-05-08T18:09:40.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7176999999999998e-05 2024-05-08T18:09:40.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643262+0000", 2024-05-08T18:09:40.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014521299999999999 2024-05-08T18:09:40.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643523+0000", 2024-05-08T18:09:40.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000260783 2024-05-08T18:09:40.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:40.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643768+0000", 2024-05-08T18:09:40.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024567399999999998 2024-05-08T18:09:40.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.662501+0000", 2024-05-08T18:09:40.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018732988999999999 2024-05-08T18:09:40.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663964+0000", 2024-05-08T18:09:40.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001463074 2024-05-08T18:09:40.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.664015+0000", 2024-05-08T18:09:40.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0549e-05 2024-05-08T18:09:40.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.664061+0000", 2024-05-08T18:09:40.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5645000000000001e-05 2024-05-08T18:09:40.525 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.525 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.525 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.525 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1255 3.12 e85/20 3:48af9d8c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_11:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:40.525 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:40.525 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 32.014710536999999, 2024-05-08T18:09:40.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021924084999999999, 2024-05-08T18:09:40.525 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.525 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.525 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.525 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:40.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:40.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481479+0000", 2024-05-08T18:09:40.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999999999999999e-06 2024-05-08T18:09:40.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.485998+0000", 2024-05-08T18:09:40.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045194600000000003 2024-05-08T18:09:40.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486023+0000", 2024-05-08T18:09:40.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4516999999999999e-05 2024-05-08T18:09:40.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486033+0000", 2024-05-08T18:09:40.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0529e-05 2024-05-08T18:09:40.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486172+0000", 2024-05-08T18:09:40.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013829599999999999 2024-05-08T18:09:40.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486234+0000", 2024-05-08T18:09:40.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2156000000000006e-05 2024-05-08T18:09:40.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.503338+0000", 2024-05-08T18:09:40.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017104346999999999 2024-05-08T18:09:40.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.503402+0000", 2024-05-08T18:09:40.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3579999999999998e-05 2024-05-08T18:09:40.529 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.529 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.529 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.529 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1277 3.3f 3:ffe0c8dc:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:40.529 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:40.529 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 31.411061504999999, 2024-05-08T18:09:40.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025789262, 2024-05-08T18:09:40.529 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.529 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.529 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.529 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.529 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:40.530 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:40.530 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1277 2024-05-08T18:09:40.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.530 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:40.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:40.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085130+0000", 2024-05-08T18:09:40.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4659999999999999e-06 2024-05-08T18:09:40.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089237+0000", 2024-05-08T18:09:40.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004106424 2024-05-08T18:09:40.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089281+0000", 2024-05-08T18:09:40.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4053e-05 2024-05-08T18:09:40.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089300+0000", 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9057000000000001e-05 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089467+0000", 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000167734 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089839+0000", 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037171900000000001 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.090206+0000", 2024-05-08T18:09:40.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036716500000000003 2024-05-08T18:09:40.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.105682+0000", 2024-05-08T18:09:40.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015475495000000001 2024-05-08T18:09:40.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110695+0000", 2024-05-08T18:09:40.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050135420000000002 2024-05-08T18:09:40.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110779+0000", 2024-05-08T18:09:40.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3914999999999999e-05 2024-05-08T18:09:40.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110916+0000", 2024-05-08T18:09:40.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136692 2024-05-08T18:09:40.534 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.534 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.534 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.534 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1283 3.39 3:9ca6d3f9:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:40.534 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 31.326975920999999, 2024-05-08T18:09:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022844218999999999, 2024-05-08T18:09:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1283 2024-05-08T18:09:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169215+0000", 2024-05-08T18:09:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9529999999999999e-06 2024-05-08T18:09:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173086+0000", 2024-05-08T18:09:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003870582 2024-05-08T18:09:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173107+0000", 2024-05-08T18:09:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1608999999999999e-05 2024-05-08T18:09:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173117+0000", 2024-05-08T18:09:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8090000000000004e-06 2024-05-08T18:09:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173192+0000", 2024-05-08T18:09:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4676000000000001e-05 2024-05-08T18:09:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173197+0000", 2024-05-08T18:09:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0710000000000002e-06 2024-05-08T18:09:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.175963+0000", 2024-05-08T18:09:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027662810000000002 2024-05-08T18:09:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.176138+0000", 2024-05-08T18:09:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017430500000000001 2024-05-08T18:09:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.176332+0000", 2024-05-08T18:09:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019477000000000001 2024-05-08T18:09:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.184230+0000", 2024-05-08T18:09:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078977630000000004 2024-05-08T18:09:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.191962+0000", 2024-05-08T18:09:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077315830000000002 2024-05-08T18:09:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.192015+0000", 2024-05-08T18:09:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2992999999999999e-05 2024-05-08T18:09:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.192056+0000", 2024-05-08T18:09:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1823999999999998e-05 2024-05-08T18:09:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1412 3.3f 3:fe02d1ba:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 28.538523895000001, 2024-05-08T18:09:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023048524000000001, 2024-05-08T18:09:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1412 2024-05-08T18:09:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957668+0000", 2024-05-08T18:09:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8999999999999999e-06 2024-05-08T18:09:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963142+0000", 2024-05-08T18:09:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005473627 2024-05-08T18:09:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963181+0000", 2024-05-08T18:09:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.93e-05 2024-05-08T18:09:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963199+0000", 2024-05-08T18:09:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7866000000000001e-05 2024-05-08T18:09:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963347+0000", 2024-05-08T18:09:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014816800000000001 2024-05-08T18:09:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963603+0000", 2024-05-08T18:09:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025623099999999999 2024-05-08T18:09:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963843+0000", 2024-05-08T18:09:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023961699999999999 2024-05-08T18:09:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.975743+0000", 2024-05-08T18:09:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011899998 2024-05-08T18:09:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980533+0000", 2024-05-08T18:09:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047898749999999999 2024-05-08T18:09:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980638+0000", 2024-05-08T18:09:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010527300000000001 2024-05-08T18:09:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980713+0000", 2024-05-08T18:09:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4668999999999999e-05 2024-05-08T18:09:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1420 3.e 3:72accb8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.8:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 28.460455025000002, 2024-05-08T18:09:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025387064000000001, 2024-05-08T18:09:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1420 2024-05-08T18:09:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035736+0000", 2024-05-08T18:09:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0240000000000002e-06 2024-05-08T18:09:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039738+0000", 2024-05-08T18:09:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004001419 2024-05-08T18:09:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039775+0000", 2024-05-08T18:09:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7696e-05 2024-05-08T18:09:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039792+0000", 2024-05-08T18:09:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7183000000000001e-05 2024-05-08T18:09:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039909+0000", 2024-05-08T18:09:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116915 2024-05-08T18:09:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.040173+0000", 2024-05-08T18:09:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026373100000000001 2024-05-08T18:09:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.041106+0000", 2024-05-08T18:09:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093293100000000002 2024-05-08T18:09:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060858+0000", 2024-05-08T18:09:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019752232000000002 2024-05-08T18:09:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060894+0000", 2024-05-08T18:09:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6056000000000002e-05 2024-05-08T18:09:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.061023+0000", 2024-05-08T18:09:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128849 2024-05-08T18:09:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.061120+0000", 2024-05-08T18:09:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7027999999999993e-05 2024-05-08T18:09:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1448 3.15 3:a83ea02a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.9:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 27.592267206999999, 2024-05-08T18:09:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021945044, 2024-05-08T18:09:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1448 2024-05-08T18:09:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903924+0000", 2024-05-08T18:09:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5790000000000002e-06 2024-05-08T18:09:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907773+0000", 2024-05-08T18:09:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038495740000000001 2024-05-08T18:09:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907796+0000", 2024-05-08T18:09:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3011e-05 2024-05-08T18:09:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907806+0000", 2024-05-08T18:09:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9729999999999992e-06 2024-05-08T18:09:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907885+0000", 2024-05-08T18:09:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8799000000000002e-05 2024-05-08T18:09:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.908059+0000", 2024-05-08T18:09:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017370100000000001 2024-05-08T18:09:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.908581+0000", 2024-05-08T18:09:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052234099999999995 2024-05-08T18:09:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.918050+0000", 2024-05-08T18:09:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00946871 2024-05-08T18:09:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925682+0000", 2024-05-08T18:09:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0076326689999999999 2024-05-08T18:09:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925817+0000", 2024-05-08T18:09:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013451000000000001 2024-05-08T18:09:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925866+0000", 2024-05-08T18:09:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9177e-05 2024-05-08T18:09:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1931 3.15 3:a838452a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.rt8jcH7t-Si0Elu5GsS4JhWyuPnbJ5v_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.976276563000001, 2024-05-08T18:09:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022148926999999999, 2024-05-08T18:09:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1931 2024-05-08T18:09:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519915+0000", 2024-05-08T18:09:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4070000000000002e-06 2024-05-08T18:09:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523840+0000", 2024-05-08T18:09:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00392494 2024-05-08T18:09:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523881+0000", 2024-05-08T18:09:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0729999999999998e-05 2024-05-08T18:09:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523901+0000", 2024-05-08T18:09:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9816000000000001e-05 2024-05-08T18:09:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524034+0000", 2024-05-08T18:09:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013357199999999999 2024-05-08T18:09:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524297+0000", 2024-05-08T18:09:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000262697 2024-05-08T18:09:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524555+0000", 2024-05-08T18:09:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025802099999999999 2024-05-08T18:09:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.535170+0000", 2024-05-08T18:09:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010615528000000001 2024-05-08T18:09:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.541876+0000", 2024-05-08T18:09:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006705562 2024-05-08T18:09:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.541984+0000", 2024-05-08T18:09:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108585 2024-05-08T18:09:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.542061+0000", 2024-05-08T18:09:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6069000000000006e-05 2024-05-08T18:09:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1990 3.2d 3:b4aceac7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.34:head [create,setxattr user.rgw.idtag (61) in=14b,setxattr user.rgw.tail_tag (61) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.742290+0000", 2024-05-08T18:09:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.753897904, 2024-05-08T18:09:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023330152999999999, 2024-05-08T18:09:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1990 2024-05-08T18:09:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.742290+0000", 2024-05-08T18:09:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.742290+0000", 2024-05-08T18:09:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.742293+0000", 2024-05-08T18:09:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7369999999999998e-06 2024-05-08T18:09:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747757+0000", 2024-05-08T18:09:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054638079999999997 2024-05-08T18:09:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747799+0000", 2024-05-08T18:09:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:09:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747819+0000", 2024-05-08T18:09:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0183e-05 2024-05-08T18:09:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747973+0000", 2024-05-08T18:09:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015351500000000001 2024-05-08T18:09:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.748251+0000", 2024-05-08T18:09:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027811699999999998 2024-05-08T18:09:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.749139+0000", 2024-05-08T18:09:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00088849299999999997 2024-05-08T18:09:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.763612+0000", 2024-05-08T18:09:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014472992 2024-05-08T18:09:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.765137+0000", 2024-05-08T18:09:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001524823 2024-05-08T18:09:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.765399+0000", 2024-05-08T18:09:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026171700000000002 2024-05-08T18:09:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.765620+0000", 2024-05-08T18:09:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000221595 2024-05-08T18:09:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1999 3.13 3:c81aceb2:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.qFJD7RDtXlCNRHqLIdswZJm3STCASHM_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.958634+0000", 2024-05-08T18:09:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.537554456000001, 2024-05-08T18:09:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022563374000000001, 2024-05-08T18:09:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1999 2024-05-08T18:09:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.958634+0000", 2024-05-08T18:09:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.958634+0000", 2024-05-08T18:09:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.958637+0000", 2024-05-08T18:09:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2830000000000002e-06 2024-05-08T18:09:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.963827+0000", 2024-05-08T18:09:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051899609999999999 2024-05-08T18:09:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.964764+0000", 2024-05-08T18:09:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093745000000000005 2024-05-08T18:09:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.964794+0000", 2024-05-08T18:09:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.957e-05 2024-05-08T18:09:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.965016+0000", 2024-05-08T18:09:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000221671 2024-05-08T18:09:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.965297+0000", 2024-05-08T18:09:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028171000000000001 2024-05-08T18:09:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.965547+0000", 2024-05-08T18:09:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024940800000000001 2024-05-08T18:09:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.979720+0000", 2024-05-08T18:09:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01417321 2024-05-08T18:09:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.981028+0000", 2024-05-08T18:09:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013080489999999999 2024-05-08T18:09:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.981129+0000", 2024-05-08T18:09:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010111900000000001 2024-05-08T18:09:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.981197+0000", 2024-05-08T18:09:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7942999999999996e-05 2024-05-08T18:09:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2130 3.39 3:9f8cf400:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.K7V9dh3caEYHsi9YlGwMWJrNO2rnOUe_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:30.419212+0000", 2024-05-08T18:09:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 10.076975943000001, 2024-05-08T18:09:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025593207999999999, 2024-05-08T18:09:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2130 2024-05-08T18:09:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.419212+0000", 2024-05-08T18:09:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.419212+0000", 2024-05-08T18:09:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.419215+0000", 2024-05-08T18:09:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0699999999999998e-06 2024-05-08T18:09:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423670+0000", 2024-05-08T18:09:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044546990000000003 2024-05-08T18:09:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423704+0000", 2024-05-08T18:09:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4329999999999998e-05 2024-05-08T18:09:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423720+0000", 2024-05-08T18:09:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5769000000000001e-05 2024-05-08T18:09:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423820+0000", 2024-05-08T18:09:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9964999999999996e-05 2024-05-08T18:09:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423947+0000", 2024-05-08T18:09:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012709400000000001 2024-05-08T18:09:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.424047+0000", 2024-05-08T18:09:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9841999999999997e-05 2024-05-08T18:09:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.430460+0000", 2024-05-08T18:09:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064128040000000002 2024-05-08T18:09:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.444733+0000", 2024-05-08T18:09:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014272741 2024-05-08T18:09:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.444776+0000", 2024-05-08T18:09:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3594000000000003e-05 2024-05-08T18:09:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.444805+0000", 2024-05-08T18:09:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9300000000000001e-05 2024-05-08T18:09:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2175 3.2d 3:b44c7524:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.63:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:31.556724+0000", 2024-05-08T18:09:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.9394641529999994, 2024-05-08T18:09:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.028086578000000001, 2024-05-08T18:09:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2175 2024-05-08T18:09:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.556724+0000", 2024-05-08T18:09:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.556724+0000", 2024-05-08T18:09:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.556727+0000", 2024-05-08T18:09:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3239999999999999e-06 2024-05-08T18:09:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561115+0000", 2024-05-08T18:09:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043878659999999998 2024-05-08T18:09:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561151+0000", 2024-05-08T18:09:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6247e-05 2024-05-08T18:09:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561177+0000", 2024-05-08T18:09:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5876000000000001e-05 2024-05-08T18:09:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561310+0000", 2024-05-08T18:09:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013296200000000001 2024-05-08T18:09:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561658+0000", 2024-05-08T18:09:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034749599999999998 2024-05-08T18:09:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.562604+0000", 2024-05-08T18:09:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00094605000000000004 2024-05-08T18:09:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.574717+0000", 2024-05-08T18:09:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012113153999999999 2024-05-08T18:09:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.584594+0000", 2024-05-08T18:09:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0098766830000000007 2024-05-08T18:09:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.584723+0000", 2024-05-08T18:09:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012911800000000001 2024-05-08T18:09:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.584811+0000", 2024-05-08T18:09:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7801999999999997e-05 2024-05-08T18:09:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2199 3.15 3:a8780bcf:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.67:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:32.172858+0000", 2024-05-08T18:09:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.3233306050000007, 2024-05-08T18:09:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022099601999999999, 2024-05-08T18:09:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2199 2024-05-08T18:09:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.172858+0000", 2024-05-08T18:09:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.172858+0000", 2024-05-08T18:09:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.172861+0000", 2024-05-08T18:09:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.337e-06 2024-05-08T18:09:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177201+0000", 2024-05-08T18:09:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043402989999999997 2024-05-08T18:09:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177239+0000", 2024-05-08T18:09:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8157000000000001e-05 2024-05-08T18:09:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177257+0000", 2024-05-08T18:09:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.806e-05 2024-05-08T18:09:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177426+0000", 2024-05-08T18:09:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016871799999999999 2024-05-08T18:09:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177706+0000", 2024-05-08T18:09:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027945800000000001 2024-05-08T18:09:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.178615+0000", 2024-05-08T18:09:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00090926799999999997 2024-05-08T18:09:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.192797+0000", 2024-05-08T18:09:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014181724 2024-05-08T18:09:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.194761+0000", 2024-05-08T18:09:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001963963 2024-05-08T18:09:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.194882+0000", 2024-05-08T18:09:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120952 2024-05-08T18:09:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.194957+0000", 2024-05-08T18:09:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5666000000000004e-05 2024-05-08T18:09:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2205 3.e 3:736fbc51:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.68:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:32.330919+0000", 2024-05-08T18:09:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.1652696040000006, 2024-05-08T18:09:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024623565, 2024-05-08T18:09:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2205 2024-05-08T18:09:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.330919+0000", 2024-05-08T18:09:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.330919+0000", 2024-05-08T18:09:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.330922+0000", 2024-05-08T18:09:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1470000000000001e-06 2024-05-08T18:09:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.334876+0000", 2024-05-08T18:09:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039544890000000003 2024-05-08T18:09:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.334914+0000", 2024-05-08T18:09:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7973999999999999e-05 2024-05-08T18:09:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.334932+0000", 2024-05-08T18:09:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7319000000000001e-05 2024-05-08T18:09:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.335093+0000", 2024-05-08T18:09:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000161149 2024-05-08T18:09:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.335364+0000", 2024-05-08T18:09:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027133799999999998 2024-05-08T18:09:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.336278+0000", 2024-05-08T18:09:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00091437799999999998 2024-05-08T18:09:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.353978+0000", 2024-05-08T18:09:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017699914000000001 2024-05-08T18:09:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.355343+0000", 2024-05-08T18:09:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001364346 2024-05-08T18:09:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.355463+0000", 2024-05-08T18:09:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120789 2024-05-08T18:09:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.355542+0000", 2024-05-08T18:09:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8721999999999996e-05 2024-05-08T18:09:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2356 3.d 3:b3bbc07d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.8wN2GlL8rBYEiTXR4sMZd0wed6qVyrX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:35.353910+0000", 2024-05-08T18:09:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1422784850000003, 2024-05-08T18:09:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023189147, 2024-05-08T18:09:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2356 2024-05-08T18:09:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.353910+0000", 2024-05-08T18:09:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.353910+0000", 2024-05-08T18:09:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.353913+0000", 2024-05-08T18:09:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.67e-06 2024-05-08T18:09:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358160+0000", 2024-05-08T18:09:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042467099999999999 2024-05-08T18:09:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358200+0000", 2024-05-08T18:09:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0272999999999999e-05 2024-05-08T18:09:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358225+0000", 2024-05-08T18:09:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5003000000000001e-05 2024-05-08T18:09:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358331+0000", 2024-05-08T18:09:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010557599999999999 2024-05-08T18:09:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358517+0000", 2024-05-08T18:09:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018577200000000001 2024-05-08T18:09:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358677+0000", 2024-05-08T18:09:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000160342 2024-05-08T18:09:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.368776+0000", 2024-05-08T18:09:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010098763 2024-05-08T18:09:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.376804+0000", 2024-05-08T18:09:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0080286369999999999 2024-05-08T18:09:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.376977+0000", 2024-05-08T18:09:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000172349 2024-05-08T18:09:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.377099+0000", 2024-05-08T18:09:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000122052 2024-05-08T18:09:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2380 3.e 3:713200a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.N3BoeKsRn7I3GNNh1gsMqBxJl5ACtoq_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:35.841683+0000", 2024-05-08T18:09:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.6545052980000001, 2024-05-08T18:09:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025074545, 2024-05-08T18:09:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2380 2024-05-08T18:09:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.841683+0000", 2024-05-08T18:09:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.841683+0000", 2024-05-08T18:09:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.841685+0000", 2024-05-08T18:09:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3020000000000002e-06 2024-05-08T18:09:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845397+0000", 2024-05-08T18:09:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037116240000000002 2024-05-08T18:09:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845421+0000", 2024-05-08T18:09:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4468e-05 2024-05-08T18:09:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845434+0000", 2024-05-08T18:09:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2989999999999999e-05 2024-05-08T18:09:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845532+0000", 2024-05-08T18:09:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7841000000000001e-05 2024-05-08T18:09:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845749+0000", 2024-05-08T18:09:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021645099999999999 2024-05-08T18:09:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845973+0000", 2024-05-08T18:09:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000224744 2024-05-08T18:09:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866275+0000", 2024-05-08T18:09:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020301471000000001 2024-05-08T18:09:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866644+0000", 2024-05-08T18:09:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036915800000000002 2024-05-08T18:09:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866704+0000", 2024-05-08T18:09:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0495000000000003e-05 2024-05-08T18:09:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866757+0000", 2024-05-08T18:09:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3001000000000003e-05 2024-05-08T18:09:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:40.608 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:40.610 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:40.609+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:40.610 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:09:40.711 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:40.712+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:40.741 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:40.742 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:40.742 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:40.742 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:40.755 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:09:40.812 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:40.813+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:40.913 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:40.912+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:40.917 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:40.918 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:40.918 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:40.918 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:40.918 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:40.926 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:09:40.937 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:09:41.025 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:41.028+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:41.104 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:41.104 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:41.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:41.104 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:41.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.104 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1221 3.20 e85/20 3:071d1257:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_5:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:41.104 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:41.104 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.502417631, 2024-05-08T18:09:41.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019872899999999999, 2024-05-08T18:09:41.104 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.104 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.105 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.105 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:41.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:41.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605944+0000", 2024-05-08T18:09:41.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.77e-06 2024-05-08T18:09:41.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612548+0000", 2024-05-08T18:09:41.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066036519999999998 2024-05-08T18:09:41.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612580+0000", 2024-05-08T18:09:41.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1945e-05 2024-05-08T18:09:41.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612593+0000", 2024-05-08T18:09:41.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3665999999999999e-05 2024-05-08T18:09:41.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612758+0000", 2024-05-08T18:09:41.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016427600000000001 2024-05-08T18:09:41.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612832+0000", 2024-05-08T18:09:41.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4493000000000007e-05 2024-05-08T18:09:41.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.625728+0000", 2024-05-08T18:09:41.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012895471 2024-05-08T18:09:41.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.625815+0000", 2024-05-08T18:09:41.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7627000000000007e-05 2024-05-08T18:09:41.108 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.108 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.108 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.109 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1227 3.6 3:6359f987:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:41.109 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:41.109 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.424244072999997, 2024-05-08T18:09:41.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022831489999999999, 2024-05-08T18:09:41.109 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.109 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.109 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.109 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.109 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.109 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.109 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1227 2024-05-08T18:09:41.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.109 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:41.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:41.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684119+0000", 2024-05-08T18:09:41.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.678e-06 2024-05-08T18:09:41.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687247+0000", 2024-05-08T18:09:41.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031279820000000001 2024-05-08T18:09:41.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687274+0000", 2024-05-08T18:09:41.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7174000000000001e-05 2024-05-08T18:09:41.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687289+0000", 2024-05-08T18:09:41.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5364999999999999e-05 2024-05-08T18:09:41.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687421+0000", 2024-05-08T18:09:41.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013197999999999999 2024-05-08T18:09:41.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687681+0000", 2024-05-08T18:09:41.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025951099999999998 2024-05-08T18:09:41.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687981+0000", 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030021799999999999 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706004+0000", 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018023441000000001 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706867+0000", 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00086241200000000001 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706901+0000", 2024-05-08T18:09:41.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4325000000000001e-05 2024-05-08T18:09:41.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706948+0000", 2024-05-08T18:09:41.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6403999999999998e-05 2024-05-08T18:09:41.114 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.114 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.114 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.115 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1246 3.6 3:6220dfe7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:41.115 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:41.115 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.747564592000003, 2024-05-08T18:09:41.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020211156000000001, 2024-05-08T18:09:41.115 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.115 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.115 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.115 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.115 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.115 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.115 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1246 2024-05-08T18:09:41.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.116 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:41.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:41.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360799+0000", 2024-05-08T18:09:41.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4939999999999999e-06 2024-05-08T18:09:41.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363474+0000", 2024-05-08T18:09:41.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026745190000000002 2024-05-08T18:09:41.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363511+0000", 2024-05-08T18:09:41.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7722000000000002e-05 2024-05-08T18:09:41.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363528+0000", 2024-05-08T18:09:41.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6600999999999999e-05 2024-05-08T18:09:41.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363637+0000", 2024-05-08T18:09:41.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108855 2024-05-08T18:09:41.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363792+0000", 2024-05-08T18:09:41.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000155561 2024-05-08T18:09:41.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:41.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363921+0000", 2024-05-08T18:09:41.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128501 2024-05-08T18:09:41.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.378377+0000", 2024-05-08T18:09:41.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014456577999999999 2024-05-08T18:09:41.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380848+0000", 2024-05-08T18:09:41.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024703329999999999 2024-05-08T18:09:41.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380940+0000", 2024-05-08T18:09:41.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2264999999999998e-05 2024-05-08T18:09:41.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.381007+0000", 2024-05-08T18:09:41.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6727e-05 2024-05-08T18:09:41.120 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.120 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.120 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.121 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1255 3.12 3:48af9d8c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:41.121 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:41.121 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.626546724999997, 2024-05-08T18:09:41.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025868088000000001, 2024-05-08T18:09:41.121 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.121 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.121 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.121 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.121 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.121 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.121 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1255 2024-05-08T18:09:41.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.122 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:41.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:41.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481816+0000", 2024-05-08T18:09:41.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6390000000000001e-06 2024-05-08T18:09:41.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484725+0000", 2024-05-08T18:09:41.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00290865 2024-05-08T18:09:41.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484750+0000", 2024-05-08T18:09:41.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5009999999999999e-05 2024-05-08T18:09:41.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484763+0000", 2024-05-08T18:09:41.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2976000000000001e-05 2024-05-08T18:09:41.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484848+0000", 2024-05-08T18:09:41.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5232e-05 2024-05-08T18:09:41.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.485026+0000", 2024-05-08T18:09:41.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000177706 2024-05-08T18:09:41.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:41.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.485186+0000", 2024-05-08T18:09:41.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016076900000000001 2024-05-08T18:09:41.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.491881+0000", 2024-05-08T18:09:41.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066950539999999998 2024-05-08T18:09:41.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507591+0000", 2024-05-08T18:09:41.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015709724000000001 2024-05-08T18:09:41.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507638+0000", 2024-05-08T18:09:41.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6684999999999998e-05 2024-05-08T18:09:41.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507681+0000", 2024-05-08T18:09:41.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3643000000000002e-05 2024-05-08T18:09:41.126 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.126 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.126 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.126 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1395 3.17 3:eb9c68a5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:41.126 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:41.126 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.335917984000002, 2024-05-08T18:09:41.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026590425000000001, 2024-05-08T18:09:41.126 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1395 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:41.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772445+0000", 2024-05-08T18:09:41.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0970000000000002e-06 2024-05-08T18:09:41.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775066+0000", 2024-05-08T18:09:41.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026205730000000002 2024-05-08T18:09:41.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775101+0000", 2024-05-08T18:09:41.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4876000000000003e-05 2024-05-08T18:09:41.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775116+0000", 2024-05-08T18:09:41.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5566999999999999e-05 2024-05-08T18:09:41.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775200+0000", 2024-05-08T18:09:41.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3808999999999997e-05 2024-05-08T18:09:41.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775307+0000", 2024-05-08T18:09:41.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000107366 2024-05-08T18:09:41.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:41.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775430+0000", 2024-05-08T18:09:41.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012280599999999999 2024-05-08T18:09:41.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.779395+0000", 2024-05-08T18:09:41.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003964357 2024-05-08T18:09:41.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.798911+0000", 2024-05-08T18:09:41.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019516386 2024-05-08T18:09:41.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.798982+0000", 2024-05-08T18:09:41.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0759000000000005e-05 2024-05-08T18:09:41.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.799033+0000", 2024-05-08T18:09:41.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0828999999999997e-05 2024-05-08T18:09:41.131 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.131 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.131 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.132 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1404 3.1b 3:d97dd5be:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:41.132 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:41.132 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.235087797999999, 2024-05-08T18:09:41.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020100535999999999, 2024-05-08T18:09:41.132 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.132 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.132 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.132 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.132 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.132 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.132 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1404 2024-05-08T18:09:41.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.132 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:41.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:41.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873276+0000", 2024-05-08T18:09:41.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.45e-06 2024-05-08T18:09:41.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875542+0000", 2024-05-08T18:09:41.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002266746 2024-05-08T18:09:41.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875570+0000", 2024-05-08T18:09:41.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7826000000000001e-05 2024-05-08T18:09:41.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875585+0000", 2024-05-08T18:09:41.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4681999999999999e-05 2024-05-08T18:09:41.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875667+0000", 2024-05-08T18:09:41.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2429000000000006e-05 2024-05-08T18:09:41.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875833+0000", 2024-05-08T18:09:41.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165959 2024-05-08T18:09:41.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:41.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875991+0000", 2024-05-08T18:09:41.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015766099999999999 2024-05-08T18:09:41.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.884154+0000", 2024-05-08T18:09:41.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081625329999999996 2024-05-08T18:09:41.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.892970+0000", 2024-05-08T18:09:41.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0088168540000000007 2024-05-08T18:09:41.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.893166+0000", 2024-05-08T18:09:41.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019573 2024-05-08T18:09:41.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.893373+0000", 2024-05-08T18:09:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020666599999999999 2024-05-08T18:09:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1426 3.3 e87/20 3:c1fceb03:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_4:head v 87'7, mlcod=86'5)", 2024-05-08T18:09:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.680901694999999, 2024-05-08T18:09:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020804152999999999, 2024-05-08T18:09:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.137 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427461+0000", 2024-05-08T18:09:41.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.57e-06 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433712+0000", 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062511729999999996 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433759+0000", 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6397000000000003e-05 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433779+0000", 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0196000000000001e-05 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433922+0000", 2024-05-08T18:09:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014305599999999999 2024-05-08T18:09:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433970+0000", 2024-05-08T18:09:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7933000000000003e-05 2024-05-08T18:09:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.448060+0000", 2024-05-08T18:09:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01409064 2024-05-08T18:09:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.448263+0000", 2024-05-08T18:09:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020218800000000001 2024-05-08T18:09:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1452 3.18 e87/20 3:1a3be52d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_2:head v 87'4, mlcod=86'2)", 2024-05-08T18:09:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 27.780354564, 2024-05-08T18:09:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020634468, 2024-05-08T18:09:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.141 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328008+0000", 2024-05-08T18:09:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2589999999999999e-06 2024-05-08T18:09:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330832+0000", 2024-05-08T18:09:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028243719999999999 2024-05-08T18:09:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330867+0000", 2024-05-08T18:09:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4776e-05 2024-05-08T18:09:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330883+0000", 2024-05-08T18:09:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6121999999999999e-05 2024-05-08T18:09:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.331031+0000", 2024-05-08T18:09:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148412 2024-05-08T18:09:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.331075+0000", 2024-05-08T18:09:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3126e-05 2024-05-08T18:09:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.348521+0000", 2024-05-08T18:09:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017446351999999998 2024-05-08T18:09:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.348640+0000", 2024-05-08T18:09:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119049 2024-05-08T18:09:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1463 3.17 3:ebd3133d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:41.145 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 27.534864145, 2024-05-08T18:09:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023934057000000002, 2024-05-08T18:09:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1463 2024-05-08T18:09:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573500+0000", 2024-05-08T18:09:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7670000000000001e-06 2024-05-08T18:09:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575722+0000", 2024-05-08T18:09:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022226559999999999 2024-05-08T18:09:41.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575781+0000", 2024-05-08T18:09:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8746999999999998e-05 2024-05-08T18:09:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575810+0000", 2024-05-08T18:09:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8407000000000001e-05 2024-05-08T18:09:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575981+0000", 2024-05-08T18:09:41.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017151499999999999 2024-05-08T18:09:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.576369+0000", 2024-05-08T18:09:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038807000000000002 2024-05-08T18:09:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.576675+0000", 2024-05-08T18:09:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030572800000000001 2024-05-08T18:09:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.585475+0000", 2024-05-08T18:09:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087997630000000004 2024-05-08T18:09:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597202+0000", 2024-05-08T18:09:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011727849 2024-05-08T18:09:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597316+0000", 2024-05-08T18:09:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113546 2024-05-08T18:09:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597430+0000", 2024-05-08T18:09:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114009 2024-05-08T18:09:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1913 3.17 3:ea65dc81:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.vOI1jtaftCZSAcjtRhSYPcY8omHGfbO_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.016259667, 2024-05-08T18:09:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020076618000000001, 2024-05-08T18:09:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.151 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1913 2024-05-08T18:09:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092104+0000", 2024-05-08T18:09:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2279999999999998e-06 2024-05-08T18:09:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094163+0000", 2024-05-08T18:09:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020592710000000001 2024-05-08T18:09:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094206+0000", 2024-05-08T18:09:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3072999999999999e-05 2024-05-08T18:09:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094231+0000", 2024-05-08T18:09:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4819000000000001e-05 2024-05-08T18:09:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094325+0000", 2024-05-08T18:09:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4029000000000004e-05 2024-05-08T18:09:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094439+0000", 2024-05-08T18:09:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113878 2024-05-08T18:09:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094533+0000", 2024-05-08T18:09:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4733000000000003e-05 2024-05-08T18:09:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.099901+0000", 2024-05-08T18:09:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053678789999999999 2024-05-08T18:09:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.111944+0000", 2024-05-08T18:09:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012042855999999999 2024-05-08T18:09:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.112051+0000", 2024-05-08T18:09:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010673100000000001 2024-05-08T18:09:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.112177+0000", 2024-05-08T18:09:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012612100000000001 2024-05-08T18:09:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.156 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1928 3.23 3:c76f4655:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.24:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.700420641000001, 2024-05-08T18:09:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026452139, 2024-05-08T18:09:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.157 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1928 2024-05-08T18:09:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407943+0000", 2024-05-08T18:09:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4170000000000001e-06 2024-05-08T18:09:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412466+0000", 2024-05-08T18:09:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045230720000000004 2024-05-08T18:09:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412503+0000", 2024-05-08T18:09:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7287999999999999e-05 2024-05-08T18:09:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412520+0000", 2024-05-08T18:09:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7206000000000001e-05 2024-05-08T18:09:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412719+0000", 2024-05-08T18:09:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000198975 2024-05-08T18:09:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412989+0000", 2024-05-08T18:09:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000269256 2024-05-08T18:09:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.413870+0000", 2024-05-08T18:09:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00088159999999999996 2024-05-08T18:09:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.433846+0000", 2024-05-08T18:09:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019975822000000001 2024-05-08T18:09:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434198+0000", 2024-05-08T18:09:41.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035164000000000001 2024-05-08T18:09:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434318+0000", 2024-05-08T18:09:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120604 2024-05-08T18:09:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434392+0000", 2024-05-08T18:09:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3258999999999998e-05 2024-05-08T18:09:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:2130 3.39 e93/20 3:9f8cf400:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.K7V9dh3caEYHsi9YlGwMWJrNO2rnOUe_1:head v 93'7, mlcod=90'5)", 2024-05-08T18:09:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.428375+0000", 2024-05-08T18:09:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.679984694, 2024-05-08T18:09:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020125661, 2024-05-08T18:09:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.428375+0000", 2024-05-08T18:09:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.428375+0000", 2024-05-08T18:09:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.428378+0000", 2024-05-08T18:09:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.96e-06 2024-05-08T18:09:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436642+0000", 2024-05-08T18:09:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0082638899999999994 2024-05-08T18:09:41.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436681+0000", 2024-05-08T18:09:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8389999999999997e-05 2024-05-08T18:09:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436705+0000", 2024-05-08T18:09:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4049e-05 2024-05-08T18:09:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436805+0000", 2024-05-08T18:09:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010063100000000001 2024-05-08T18:09:41.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436825+0000", 2024-05-08T18:09:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9817e-05 2024-05-08T18:09:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.448397+0000", 2024-05-08T18:09:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011572086000000001 2024-05-08T18:09:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.448501+0000", 2024-05-08T18:09:41.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103838 2024-05-08T18:09:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2139 3.3d 3:bf4c8f68:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.57:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.593560+0000", 2024-05-08T18:09:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.514800149999999, 2024-05-08T18:09:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026176721999999999, 2024-05-08T18:09:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.167 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2139 2024-05-08T18:09:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.593560+0000", 2024-05-08T18:09:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.593560+0000", 2024-05-08T18:09:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.593564+0000", 2024-05-08T18:09:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8330000000000004e-06 2024-05-08T18:09:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597295+0000", 2024-05-08T18:09:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037317090000000002 2024-05-08T18:09:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597337+0000", 2024-05-08T18:09:41.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1628999999999997e-05 2024-05-08T18:09:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597356+0000", 2024-05-08T18:09:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9079000000000001e-05 2024-05-08T18:09:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597523+0000", 2024-05-08T18:09:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016655500000000001 2024-05-08T18:09:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597893+0000", 2024-05-08T18:09:41.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037072199999999998 2024-05-08T18:09:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.598918+0000", 2024-05-08T18:09:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010249790000000001 2024-05-08T18:09:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.618213+0000", 2024-05-08T18:09:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019294772000000002 2024-05-08T18:09:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619538+0000", 2024-05-08T18:09:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001324424 2024-05-08T18:09:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619657+0000", 2024-05-08T18:09:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119091 2024-05-08T18:09:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619737+0000", 2024-05-08T18:09:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9929e-05 2024-05-08T18:09:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.172 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2157 3.17 3:e9343ebc:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.60:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.032761+0000", 2024-05-08T18:09:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.07559876, 2024-05-08T18:09:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019666783, 2024-05-08T18:09:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2157 2024-05-08T18:09:41.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.032761+0000", 2024-05-08T18:09:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.032761+0000", 2024-05-08T18:09:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.032764+0000", 2024-05-08T18:09:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1329999999999999e-06 2024-05-08T18:09:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035544+0000", 2024-05-08T18:09:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027793679999999999 2024-05-08T18:09:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035584+0000", 2024-05-08T18:09:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9935999999999998e-05 2024-05-08T18:09:41.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035602+0000", 2024-05-08T18:09:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8496e-05 2024-05-08T18:09:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035728+0000", 2024-05-08T18:09:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012599200000000001 2024-05-08T18:09:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.036019+0000", 2024-05-08T18:09:41.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000290475 2024-05-08T18:09:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.036929+0000", 2024-05-08T18:09:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091045700000000004 2024-05-08T18:09:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.049721+0000", 2024-05-08T18:09:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012791360999999999 2024-05-08T18:09:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.052216+0000", 2024-05-08T18:09:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024957619999999999 2024-05-08T18:09:41.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.052350+0000", 2024-05-08T18:09:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013327799999999999 2024-05-08T18:09:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.052428+0000", 2024-05-08T18:09:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8524999999999998e-05 2024-05-08T18:09:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.178 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2166 3.1f 3:fb9a1743:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.eyqVZ0B-P5u9ACEPSRoUzw86bQPcrsX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.348722+0000", 2024-05-08T18:09:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.7596378880000003, 2024-05-08T18:09:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020031361000000001, 2024-05-08T18:09:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.179 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2166 2024-05-08T18:09:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.348722+0000", 2024-05-08T18:09:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.348722+0000", 2024-05-08T18:09:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.348727+0000", 2024-05-08T18:09:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4959999999999998e-06 2024-05-08T18:09:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.351828+0000", 2024-05-08T18:09:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003101786 2024-05-08T18:09:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.351865+0000", 2024-05-08T18:09:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6519000000000001e-05 2024-05-08T18:09:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.351891+0000", 2024-05-08T18:09:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6233000000000001e-05 2024-05-08T18:09:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.352076+0000", 2024-05-08T18:09:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018498000000000001 2024-05-08T18:09:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.352511+0000", 2024-05-08T18:09:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043521899999999998 2024-05-08T18:09:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.352931+0000", 2024-05-08T18:09:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041997900000000001 2024-05-08T18:09:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.365888+0000", 2024-05-08T18:09:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012956578999999999 2024-05-08T18:09:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.368517+0000", 2024-05-08T18:09:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002629471 2024-05-08T18:09:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.368616+0000", 2024-05-08T18:09:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8740999999999995e-05 2024-05-08T18:09:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.368754+0000", 2024-05-08T18:09:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137358 2024-05-08T18:09:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2190 3.1 3:8364520c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.6cWLHpOdr1veoeL1lcBsJwZn6mj4f5g_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:41.184 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:32.004731+0000", 2024-05-08T18:09:41.185 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.1036291039999995, 2024-05-08T18:09:41.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024468832999999999, 2024-05-08T18:09:41.185 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.185 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.185 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.185 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.185 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.185 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.185 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2190 2024-05-08T18:09:41.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.185 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.004731+0000", 2024-05-08T18:09:41.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.004731+0000", 2024-05-08T18:09:41.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.004734+0000", 2024-05-08T18:09:41.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5299999999999999e-06 2024-05-08T18:09:41.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.006911+0000", 2024-05-08T18:09:41.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002177203 2024-05-08T18:09:41.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.006936+0000", 2024-05-08T18:09:41.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5772e-05 2024-05-08T18:09:41.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.006950+0000", 2024-05-08T18:09:41.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.397e-05 2024-05-08T18:09:41.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.007054+0000", 2024-05-08T18:09:41.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010354200000000001 2024-05-08T18:09:41.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.007233+0000", 2024-05-08T18:09:41.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017882600000000001 2024-05-08T18:09:41.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:41.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.007409+0000", 2024-05-08T18:09:41.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000176212 2024-05-08T18:09:41.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.020682+0000", 2024-05-08T18:09:41.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013272894 2024-05-08T18:09:41.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.029125+0000", 2024-05-08T18:09:41.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084428090000000008 2024-05-08T18:09:41.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.029167+0000", 2024-05-08T18:09:41.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2409e-05 2024-05-08T18:09:41.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.029200+0000", 2024-05-08T18:09:41.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2666000000000002e-05 2024-05-08T18:09:41.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.190 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.190 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2203 3.1 3:82cc66a1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.iRfSb7b_Mb9pWyJBdZSShCS0gvDvtAQ_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:41.190 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:32.309316+0000", 2024-05-08T18:09:41.190 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.7990441080000004, 2024-05-08T18:09:41.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021097028, 2024-05-08T18:09:41.190 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.190 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.190 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.190 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.190 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.191 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.191 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2203 2024-05-08T18:09:41.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.191 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.309316+0000", 2024-05-08T18:09:41.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.309316+0000", 2024-05-08T18:09:41.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.309319+0000", 2024-05-08T18:09:41.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4000000000000001e-06 2024-05-08T18:09:41.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311275+0000", 2024-05-08T18:09:41.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019557720000000002 2024-05-08T18:09:41.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311313+0000", 2024-05-08T18:09:41.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8176000000000002e-05 2024-05-08T18:09:41.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311332+0000", 2024-05-08T18:09:41.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8986000000000001e-05 2024-05-08T18:09:41.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311414+0000", 2024-05-08T18:09:41.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1615999999999999e-05 2024-05-08T18:09:41.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311531+0000", 2024-05-08T18:09:41.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117379 2024-05-08T18:09:41.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:41.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311651+0000", 2024-05-08T18:09:41.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119938 2024-05-08T18:09:41.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.316731+0000", 2024-05-08T18:09:41.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050797459999999996 2024-05-08T18:09:41.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.330315+0000", 2024-05-08T18:09:41.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013584311999999999 2024-05-08T18:09:41.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.330370+0000", 2024-05-08T18:09:41.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5145000000000001e-05 2024-05-08T18:09:41.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.330413+0000", 2024-05-08T18:09:41.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2558000000000001e-05 2024-05-08T18:09:41.195 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.195 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.195 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.196 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2333 3.2b 3:d6cf7d4d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.tRy7Sv7BxoOoArPn6bd9wC4O5pse0_S_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:41.196 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:34.929579+0000", 2024-05-08T18:09:41.196 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 6.1787811240000003, 2024-05-08T18:09:41.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020680451999999998, 2024-05-08T18:09:41.196 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.196 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.196 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.196 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.196 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.196 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.196 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2333 2024-05-08T18:09:41.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.196 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.929579+0000", 2024-05-08T18:09:41.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.929579+0000", 2024-05-08T18:09:41.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.929581+0000", 2024-05-08T18:09:41.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2170000000000001e-06 2024-05-08T18:09:41.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930432+0000", 2024-05-08T18:09:41.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000850733 2024-05-08T18:09:41.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930457+0000", 2024-05-08T18:09:41.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4953999999999999e-05 2024-05-08T18:09:41.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930468+0000", 2024-05-08T18:09:41.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:09:41.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930554+0000", 2024-05-08T18:09:41.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6224999999999995e-05 2024-05-08T18:09:41.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930684+0000", 2024-05-08T18:09:41.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013002599999999999 2024-05-08T18:09:41.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:41.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930799+0000", 2024-05-08T18:09:41.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114677 2024-05-08T18:09:41.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.936892+0000", 2024-05-08T18:09:41.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0060934259999999999 2024-05-08T18:09:41.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.950172+0000", 2024-05-08T18:09:41.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013279783999999999 2024-05-08T18:09:41.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.950220+0000", 2024-05-08T18:09:41.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7623999999999997e-05 2024-05-08T18:09:41.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.950259+0000", 2024-05-08T18:09:41.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.964e-05 2024-05-08T18:09:41.201 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.201 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.201 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.201 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2368 3.1b 3:dafb8647:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.o-lCHuSByDkvoT4LKUkRADgejSfQyJd_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:41.201 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:35.599786+0000", 2024-05-08T18:09:41.201 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.5085740320000003, 2024-05-08T18:09:41.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01993903, 2024-05-08T18:09:41.201 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.201 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.202 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.202 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.202 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.202 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.202 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2368 2024-05-08T18:09:41.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.202 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.599786+0000", 2024-05-08T18:09:41.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.599786+0000", 2024-05-08T18:09:41.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.599790+0000", 2024-05-08T18:09:41.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0759999999999996e-06 2024-05-08T18:09:41.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.601733+0000", 2024-05-08T18:09:41.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019429670000000001 2024-05-08T18:09:41.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.601787+0000", 2024-05-08T18:09:41.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4354999999999997e-05 2024-05-08T18:09:41.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.601815+0000", 2024-05-08T18:09:41.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7546999999999999e-05 2024-05-08T18:09:41.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.601924+0000", 2024-05-08T18:09:41.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010891300000000001 2024-05-08T18:09:41.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.602077+0000", 2024-05-08T18:09:41.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015319500000000001 2024-05-08T18:09:41.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:41.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.602204+0000", 2024-05-08T18:09:41.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127238 2024-05-08T18:09:41.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.614205+0000", 2024-05-08T18:09:41.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012000508 2024-05-08T18:09:41.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.619624+0000", 2024-05-08T18:09:41.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054195759999999997 2024-05-08T18:09:41.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.619667+0000", 2024-05-08T18:09:41.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2552000000000002e-05 2024-05-08T18:09:41.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.619725+0000", 2024-05-08T18:09:41.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8103000000000003e-05 2024-05-08T18:09:41.206 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.206 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.206 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2404 3.1 3:8218d405:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.bqgynIkQNaRvS-N0e0aQapo0Dh5XrQ2_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:36.285791+0000", 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.8225693649999997, 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023034451000000001, 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2404 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.285791+0000", 2024-05-08T18:09:41.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.285791+0000", 2024-05-08T18:09:41.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.285794+0000", 2024-05-08T18:09:41.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0290000000000001e-06 2024-05-08T18:09:41.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.287780+0000", 2024-05-08T18:09:41.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019862360000000002 2024-05-08T18:09:41.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.287815+0000", 2024-05-08T18:09:41.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5150000000000001e-05 2024-05-08T18:09:41.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.287830+0000", 2024-05-08T18:09:41.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4688000000000001e-05 2024-05-08T18:09:41.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.287909+0000", 2024-05-08T18:09:41.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9437999999999994e-05 2024-05-08T18:09:41.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.288035+0000", 2024-05-08T18:09:41.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012566899999999999 2024-05-08T18:09:41.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:41.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.288141+0000", 2024-05-08T18:09:41.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106463 2024-05-08T18:09:41.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.296390+0000", 2024-05-08T18:09:41.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008248488 2024-05-08T18:09:41.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.308672+0000", 2024-05-08T18:09:41.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012282039 2024-05-08T18:09:41.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.308760+0000", 2024-05-08T18:09:41.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8350999999999995e-05 2024-05-08T18:09:41.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.308825+0000", 2024-05-08T18:09:41.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4900000000000005e-05 2024-05-08T18:09:41.212 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.212 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.212 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.212 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.212 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.212 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:41.214 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:09:41.214 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:41.213+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:41.314 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:41.313+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:41.387 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:41.387 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:41.387 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:41.387 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:41.407 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:09:41.415 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:41.417+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:41.516 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:41.517+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:41.528 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:41.528 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:41.528 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:41.529 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:41.529 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:41.544 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:09:41.617 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:41.617+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:41.675 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:41.675 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:41.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:41.675 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:41.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.675 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1190 3.31 3:8c795880:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:41.675 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:06.973959+0000", 2024-05-08T18:09:41.675 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.701153085000001, 2024-05-08T18:09:41.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025546121000000001, 2024-05-08T18:09:41.676 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.676 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.676 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.676 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.676 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.676 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.676 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1190 2024-05-08T18:09:41.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.676 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.973959+0000", 2024-05-08T18:09:41.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.973959+0000", 2024-05-08T18:09:41.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.973961+0000", 2024-05-08T18:09:41.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6740000000000001e-06 2024-05-08T18:09:41.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.976932+0000", 2024-05-08T18:09:41.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002971062 2024-05-08T18:09:41.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.976957+0000", 2024-05-08T18:09:41.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4865999999999999e-05 2024-05-08T18:09:41.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.976969+0000", 2024-05-08T18:09:41.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1419e-05 2024-05-08T18:09:41.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.977041+0000", 2024-05-08T18:09:41.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2389000000000001e-05 2024-05-08T18:09:41.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.977198+0000", 2024-05-08T18:09:41.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015675800000000001 2024-05-08T18:09:41.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:41.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.977368+0000", 2024-05-08T18:09:41.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017024299999999999 2024-05-08T18:09:41.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.989016+0000", 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011647719000000001 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.999371+0000", 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010354942000000001 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.999441+0000", 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0166000000000005e-05 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.999505+0000", 2024-05-08T18:09:41.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3882999999999998e-05 2024-05-08T18:09:41.681 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.681 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.681 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.681 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1192 3.1e 3:7833f47f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:41.681 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:06.995724+0000", 2024-05-08T18:09:41.681 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.679387933000001, 2024-05-08T18:09:41.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019501026000000001, 2024-05-08T18:09:41.681 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.681 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.681 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.681 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.681 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.682 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.682 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1192 2024-05-08T18:09:41.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.682 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.995724+0000", 2024-05-08T18:09:41.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.995724+0000", 2024-05-08T18:09:41.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.995727+0000", 2024-05-08T18:09:41.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5449999999999999e-06 2024-05-08T18:09:41.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997495+0000", 2024-05-08T18:09:41.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001768167 2024-05-08T18:09:41.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997520+0000", 2024-05-08T18:09:41.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4672e-05 2024-05-08T18:09:41.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997541+0000", 2024-05-08T18:09:41.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1022e-05 2024-05-08T18:09:41.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997626+0000", 2024-05-08T18:09:41.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5096e-05 2024-05-08T18:09:41.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997751+0000", 2024-05-08T18:09:41.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012461500000000001 2024-05-08T18:09:41.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:41.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997853+0000", 2024-05-08T18:09:41.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010228199999999999 2024-05-08T18:09:41.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.005501+0000", 2024-05-08T18:09:41.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076478550000000003 2024-05-08T18:09:41.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.014958+0000", 2024-05-08T18:09:41.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0094574370000000008 2024-05-08T18:09:41.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.015084+0000", 2024-05-08T18:09:41.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125105 2024-05-08T18:09:41.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.015225+0000", 2024-05-08T18:09:41.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014123 2024-05-08T18:09:41.687 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.687 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.687 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.687 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1203 3.1a e85/20 3:592e440d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_15:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:41.687 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.119764+0000", 2024-05-08T18:09:41.687 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.555347388000001, 2024-05-08T18:09:41.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016393982000000001, 2024-05-08T18:09:41.687 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.687 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.687 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.687 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.119764+0000", 2024-05-08T18:09:41.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.119764+0000", 2024-05-08T18:09:41.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.119766+0000", 2024-05-08T18:09:41.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9750000000000001e-06 2024-05-08T18:09:41.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.124838+0000", 2024-05-08T18:09:41.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050712480000000004 2024-05-08T18:09:41.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.124870+0000", 2024-05-08T18:09:41.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2974e-05 2024-05-08T18:09:41.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.124884+0000", 2024-05-08T18:09:41.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3202e-05 2024-05-08T18:09:41.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.124992+0000", 2024-05-08T18:09:41.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108199 2024-05-08T18:09:41.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.125028+0000", 2024-05-08T18:09:41.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6050000000000002e-05 2024-05-08T18:09:41.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.136085+0000", 2024-05-08T18:09:41.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011057320000000001 2024-05-08T18:09:41.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.136158+0000", 2024-05-08T18:09:41.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3014000000000003e-05 2024-05-08T18:09:41.691 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.691 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.691 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.691 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1227 3.6 e85/20 3:6359f987:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_11:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:41.691 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.688168+0000", 2024-05-08T18:09:41.691 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.986943242000002, 2024-05-08T18:09:41.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018452023000000001, 2024-05-08T18:09:41.691 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.691 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.692 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.692 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.688168+0000", 2024-05-08T18:09:41.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.688168+0000", 2024-05-08T18:09:41.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.688170+0000", 2024-05-08T18:09:41.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6330000000000001e-06 2024-05-08T18:09:41.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.691987+0000", 2024-05-08T18:09:41.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003817076 2024-05-08T18:09:41.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.692031+0000", 2024-05-08T18:09:41.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3509e-05 2024-05-08T18:09:41.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.692054+0000", 2024-05-08T18:09:41.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3419999999999999e-05 2024-05-08T18:09:41.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.692204+0000", 2024-05-08T18:09:41.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015017900000000001 2024-05-08T18:09:41.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.692272+0000", 2024-05-08T18:09:41.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7410999999999995e-05 2024-05-08T18:09:41.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706582+0000", 2024-05-08T18:09:41.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014310671000000001 2024-05-08T18:09:41.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706620+0000", 2024-05-08T18:09:41.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8124000000000003e-05 2024-05-08T18:09:41.695 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.695 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.695 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.695 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1246 3.6 e85/20 3:6220dfe7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_2:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:41.695 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.364093+0000", 2024-05-08T18:09:41.695 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.311018941999997, 2024-05-08T18:09:41.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016480529000000001, 2024-05-08T18:09:41.696 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.696 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.696 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.696 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.364093+0000", 2024-05-08T18:09:41.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.364093+0000", 2024-05-08T18:09:41.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.364095+0000", 2024-05-08T18:09:41.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1789999999999998e-06 2024-05-08T18:09:41.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.366818+0000", 2024-05-08T18:09:41.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027231270000000001 2024-05-08T18:09:41.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.366852+0000", 2024-05-08T18:09:41.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4106999999999997e-05 2024-05-08T18:09:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.366867+0000", 2024-05-08T18:09:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4715000000000001e-05 2024-05-08T18:09:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.366955+0000", 2024-05-08T18:09:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8398000000000003e-05 2024-05-08T18:09:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.366986+0000", 2024-05-08T18:09:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0433000000000002e-05 2024-05-08T18:09:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380506+0000", 2024-05-08T18:09:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013520628999999999 2024-05-08T18:09:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380573+0000", 2024-05-08T18:09:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6940999999999995e-05 2024-05-08T18:09:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.700 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1257 3.31 3:8ed6384b:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:41.700 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.507760+0000", 2024-05-08T18:09:41.700 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.167351789000001, 2024-05-08T18:09:41.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017518249999999999, 2024-05-08T18:09:41.700 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.700 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.700 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.700 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.700 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.700 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.700 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1257 2024-05-08T18:09:41.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.700 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507760+0000", 2024-05-08T18:09:41.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507760+0000", 2024-05-08T18:09:41.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507764+0000", 2024-05-08T18:09:41.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7069999999999998e-06 2024-05-08T18:09:41.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510115+0000", 2024-05-08T18:09:41.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023510150000000001 2024-05-08T18:09:41.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510152+0000", 2024-05-08T18:09:41.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7234000000000003e-05 2024-05-08T18:09:41.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510168+0000", 2024-05-08T18:09:41.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5764e-05 2024-05-08T18:09:41.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510264+0000", 2024-05-08T18:09:41.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6362999999999999e-05 2024-05-08T18:09:41.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510466+0000", 2024-05-08T18:09:41.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020249999999999999 2024-05-08T18:09:41.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:41.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510644+0000", 2024-05-08T18:09:41.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017767299999999999 2024-05-08T18:09:41.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.516056+0000", 2024-05-08T18:09:41.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054117770000000004 2024-05-08T18:09:41.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.525154+0000", 2024-05-08T18:09:41.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090977999999999996 2024-05-08T18:09:41.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.525224+0000", 2024-05-08T18:09:41.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0204999999999996e-05 2024-05-08T18:09:41.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.525278+0000", 2024-05-08T18:09:41.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4212000000000002e-05 2024-05-08T18:09:41.705 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.705 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.705 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.705 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1266 3.4 3:21e00898:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:41.705 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.610411+0000", 2024-05-08T18:09:41.705 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.064701083000003, 2024-05-08T18:09:41.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017041107999999999, 2024-05-08T18:09:41.705 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.705 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.706 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.706 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.706 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.706 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.706 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1266 2024-05-08T18:09:41.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.706 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.610411+0000", 2024-05-08T18:09:41.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.610411+0000", 2024-05-08T18:09:41.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.610414+0000", 2024-05-08T18:09:41.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.732e-06 2024-05-08T18:09:41.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.612834+0000", 2024-05-08T18:09:41.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024191949999999999 2024-05-08T18:09:41.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.612866+0000", 2024-05-08T18:09:41.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2271999999999999e-05 2024-05-08T18:09:41.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.612880+0000", 2024-05-08T18:09:41.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4202000000000001e-05 2024-05-08T18:09:41.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.612987+0000", 2024-05-08T18:09:41.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106661 2024-05-08T18:09:41.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.613152+0000", 2024-05-08T18:09:41.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016484900000000001 2024-05-08T18:09:41.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:41.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.613303+0000", 2024-05-08T18:09:41.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151509 2024-05-08T18:09:41.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.622289+0000", 2024-05-08T18:09:41.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089858160000000006 2024-05-08T18:09:41.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.627348+0000", 2024-05-08T18:09:41.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005059638 2024-05-08T18:09:41.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.627401+0000", 2024-05-08T18:09:41.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2191999999999998e-05 2024-05-08T18:09:41.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.627452+0000", 2024-05-08T18:09:41.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1041999999999997e-05 2024-05-08T18:09:41.711 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.711 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.711 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.711 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1284 3.1e 3:7ad9fe5d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:41.711 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:09.185629+0000", 2024-05-08T18:09:41.711 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.489482406999997, 2024-05-08T18:09:41.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.029384772999999999, 2024-05-08T18:09:41.712 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.712 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.712 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.712 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.712 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.712 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.712 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1284 2024-05-08T18:09:41.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.712 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.185629+0000", 2024-05-08T18:09:41.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.185629+0000", 2024-05-08T18:09:41.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.185633+0000", 2024-05-08T18:09:41.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6030000000000001e-06 2024-05-08T18:09:41.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.188065+0000", 2024-05-08T18:09:41.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002431768 2024-05-08T18:09:41.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.188092+0000", 2024-05-08T18:09:41.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7849999999999999e-05 2024-05-08T18:09:41.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.188106+0000", 2024-05-08T18:09:41.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3977e-05 2024-05-08T18:09:41.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.188207+0000", 2024-05-08T18:09:41.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010083 2024-05-08T18:09:41.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:09:41.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.188218+0000", 2024-05-08T18:09:41.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0954999999999999e-05 2024-05-08T18:09:41.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.198300+0000", 2024-05-08T18:09:41.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010081543 2024-05-08T18:09:41.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.198481+0000", 2024-05-08T18:09:41.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018105399999999999 2024-05-08T18:09:41.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:41.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.198658+0000", 2024-05-08T18:09:41.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017734599999999999 2024-05-08T18:09:41.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.206728+0000", 2024-05-08T18:09:41.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0080693320000000002 2024-05-08T18:09:41.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.214880+0000", 2024-05-08T18:09:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008152767 2024-05-08T18:09:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.214957+0000", 2024-05-08T18:09:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6230999999999996e-05 2024-05-08T18:09:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.215014+0000", 2024-05-08T18:09:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7516999999999998e-05 2024-05-08T18:09:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.718 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1396 3.0 3:01138f2d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:41.718 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.783501+0000", 2024-05-08T18:09:41.718 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.891611121, 2024-05-08T18:09:41.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021225469, 2024-05-08T18:09:41.718 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.718 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.718 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.718 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.718 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.718 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.718 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1396 2024-05-08T18:09:41.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.718 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.783501+0000", 2024-05-08T18:09:41.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.783501+0000", 2024-05-08T18:09:41.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.783503+0000", 2024-05-08T18:09:41.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6639999999999998e-06 2024-05-08T18:09:41.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.785066+0000", 2024-05-08T18:09:41.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015625389999999999 2024-05-08T18:09:41.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.785088+0000", 2024-05-08T18:09:41.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2538e-05 2024-05-08T18:09:41.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.785101+0000", 2024-05-08T18:09:41.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2274e-05 2024-05-08T18:09:41.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.785191+0000", 2024-05-08T18:09:41.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9992000000000002e-05 2024-05-08T18:09:41.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:09:41.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.785199+0000", 2024-05-08T18:09:41.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6270000000000006e-06 2024-05-08T18:09:41.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.787346+0000", 2024-05-08T18:09:41.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002146677 2024-05-08T18:09:41.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.787499+0000", 2024-05-08T18:09:41.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000153523 2024-05-08T18:09:41.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:41.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.787648+0000", 2024-05-08T18:09:41.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014867999999999999 2024-05-08T18:09:41.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.796686+0000", 2024-05-08T18:09:41.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090379859999999996 2024-05-08T18:09:41.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.804546+0000", 2024-05-08T18:09:41.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0078594770000000001 2024-05-08T18:09:41.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.804645+0000", 2024-05-08T18:09:41.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9269000000000001e-05 2024-05-08T18:09:41.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.804726+0000", 2024-05-08T18:09:41.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1223000000000005e-05 2024-05-08T18:09:41.723 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.724 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.724 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.724 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1454 3.1a e87/20 3:5820ba98:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_4:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:41.724 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.374062+0000", 2024-05-08T18:09:41.724 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.301049709000001, 2024-05-08T18:09:41.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024401293000000001, 2024-05-08T18:09:41.724 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.724 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.724 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.724 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.374062+0000", 2024-05-08T18:09:41.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.374062+0000", 2024-05-08T18:09:41.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.374065+0000", 2024-05-08T18:09:41.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.05e-06 2024-05-08T18:09:41.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.725 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.725 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.380308+0000", 2024-05-08T18:09:41.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062425099999999997 2024-05-08T18:09:41.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.380346+0000", 2024-05-08T18:09:41.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8679e-05 2024-05-08T18:09:41.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.380364+0000", 2024-05-08T18:09:41.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7897000000000002e-05 2024-05-08T18:09:41.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.380531+0000", 2024-05-08T18:09:41.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016653499999999999 2024-05-08T18:09:41.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.380624+0000", 2024-05-08T18:09:41.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3189000000000005e-05 2024-05-08T18:09:41.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.398276+0000", 2024-05-08T18:09:41.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017652151000000001 2024-05-08T18:09:41.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.398463+0000", 2024-05-08T18:09:41.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018728199999999999 2024-05-08T18:09:41.728 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.728 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.728 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.728 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1459 3.25 3:a5b1b07d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:41.728 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.475662+0000", 2024-05-08T18:09:41.728 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.199449524999999, 2024-05-08T18:09:41.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026407317, 2024-05-08T18:09:41.728 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.728 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.728 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.728 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1459 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.475662+0000", 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.475662+0000", 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.475666+0000", 2024-05-08T18:09:41.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.206e-06 2024-05-08T18:09:41.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481021+0000", 2024-05-08T18:09:41.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005354981 2024-05-08T18:09:41.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481069+0000", 2024-05-08T18:09:41.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7722000000000002e-05 2024-05-08T18:09:41.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481096+0000", 2024-05-08T18:09:41.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6737000000000002e-05 2024-05-08T18:09:41.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481275+0000", 2024-05-08T18:09:41.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000178806 2024-05-08T18:09:41.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481544+0000", 2024-05-08T18:09:41.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026962399999999999 2024-05-08T18:09:41.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:41.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481794+0000", 2024-05-08T18:09:41.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024961200000000002 2024-05-08T18:09:41.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.490808+0000", 2024-05-08T18:09:41.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090146419999999998 2024-05-08T18:09:41.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.501769+0000", 2024-05-08T18:09:41.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010960437 2024-05-08T18:09:41.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.501939+0000", 2024-05-08T18:09:41.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169915 2024-05-08T18:09:41.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.502069+0000", 2024-05-08T18:09:41.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013063500000000001 2024-05-08T18:09:41.733 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.733 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.733 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.733 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1922 3.4 3:22938f7c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.23:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:41.733 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.257795+0000", 2024-05-08T18:09:41.733 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.417316508000001, 2024-05-08T18:09:41.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022203639000000001, 2024-05-08T18:09:41.734 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.734 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.734 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.734 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.734 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.734 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.734 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1922 2024-05-08T18:09:41.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.734 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.257795+0000", 2024-05-08T18:09:41.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.257795+0000", 2024-05-08T18:09:41.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.257798+0000", 2024-05-08T18:09:41.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7640000000000001e-06 2024-05-08T18:09:41.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.735 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.261913+0000", 2024-05-08T18:09:41.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041147900000000001 2024-05-08T18:09:41.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.735 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.261954+0000", 2024-05-08T18:09:41.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1551999999999998e-05 2024-05-08T18:09:41.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.261980+0000", 2024-05-08T18:09:41.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5692999999999999e-05 2024-05-08T18:09:41.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.262169+0000", 2024-05-08T18:09:41.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018944200000000001 2024-05-08T18:09:41.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.262428+0000", 2024-05-08T18:09:41.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000258807 2024-05-08T18:09:41.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:41.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.263242+0000", 2024-05-08T18:09:41.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081388000000000001 2024-05-08T18:09:41.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.276171+0000", 2024-05-08T18:09:41.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012928822 2024-05-08T18:09:41.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.279811+0000", 2024-05-08T18:09:41.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003640192 2024-05-08T18:09:41.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.279923+0000", 2024-05-08T18:09:41.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112111 2024-05-08T18:09:41.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.279999+0000", 2024-05-08T18:09:41.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5586000000000004e-05 2024-05-08T18:09:41.738 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.738 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.738 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.739 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1925 3.1e 3:7b22772f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.f9IQ_hbLdIRU4qgZOuIL42noK1mqHg9_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:41.739 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.378495+0000", 2024-05-08T18:09:41.739 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.296617061999999, 2024-05-08T18:09:41.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020602933, 2024-05-08T18:09:41.739 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.739 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.739 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.739 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.739 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.739 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.739 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1925 2024-05-08T18:09:41.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.739 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.378495+0000", 2024-05-08T18:09:41.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.378495+0000", 2024-05-08T18:09:41.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.378499+0000", 2024-05-08T18:09:41.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9469999999999996e-06 2024-05-08T18:09:41.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381093+0000", 2024-05-08T18:09:41.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025949129999999999 2024-05-08T18:09:41.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381142+0000", 2024-05-08T18:09:41.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8123e-05 2024-05-08T18:09:41.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381170+0000", 2024-05-08T18:09:41.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7996000000000001e-05 2024-05-08T18:09:41.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381318+0000", 2024-05-08T18:09:41.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014873100000000001 2024-05-08T18:09:41.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381588+0000", 2024-05-08T18:09:41.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026920900000000002 2024-05-08T18:09:41.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:41.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381814+0000", 2024-05-08T18:09:41.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000226412 2024-05-08T18:09:41.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.392475+0000", 2024-05-08T18:09:41.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010661547 2024-05-08T18:09:41.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.398954+0000", 2024-05-08T18:09:41.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006478658 2024-05-08T18:09:41.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.399036+0000", 2024-05-08T18:09:41.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2300999999999997e-05 2024-05-08T18:09:41.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.399098+0000", 2024-05-08T18:09:41.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1095999999999999e-05 2024-05-08T18:09:41.744 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.744 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.744 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.744 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1960 3.0 3:02610446:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.29:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:41.744 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:27.095423+0000", 2024-05-08T18:09:41.744 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.579688892, 2024-05-08T18:09:41.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023746634999999999, 2024-05-08T18:09:41.744 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.744 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.744 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.745 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.745 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.745 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.745 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1960 2024-05-08T18:09:41.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.745 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.095423+0000", 2024-05-08T18:09:41.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.095423+0000", 2024-05-08T18:09:41.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.095426+0000", 2024-05-08T18:09:41.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9569999999999998e-06 2024-05-08T18:09:41.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.097717+0000", 2024-05-08T18:09:41.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022911160000000002 2024-05-08T18:09:41.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.746 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.097759+0000", 2024-05-08T18:09:41.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2178999999999997e-05 2024-05-08T18:09:41.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.097777+0000", 2024-05-08T18:09:41.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8255999999999999e-05 2024-05-08T18:09:41.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.097926+0000", 2024-05-08T18:09:41.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014899100000000001 2024-05-08T18:09:41.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.098285+0000", 2024-05-08T18:09:41.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035904099999999999 2024-05-08T18:09:41.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:41.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.099249+0000", 2024-05-08T18:09:41.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00096372000000000005 2024-05-08T18:09:41.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.109626+0000", 2024-05-08T18:09:41.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010376849 2024-05-08T18:09:41.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.118973+0000", 2024-05-08T18:09:41.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0093474160000000008 2024-05-08T18:09:41.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.119093+0000", 2024-05-08T18:09:41.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119615 2024-05-08T18:09:41.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.119169+0000", 2024-05-08T18:09:41.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6495000000000005e-05 2024-05-08T18:09:41.749 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.749 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.749 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.750 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1966 3.25 3:a7ea9643:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.30:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:41.750 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:27.248331+0000", 2024-05-08T18:09:41.750 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.426780657, 2024-05-08T18:09:41.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018780688, 2024-05-08T18:09:41.750 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.750 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.750 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.750 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.750 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.750 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.750 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1966 2024-05-08T18:09:41.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.751 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.248331+0000", 2024-05-08T18:09:41.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.248331+0000", 2024-05-08T18:09:41.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.248334+0000", 2024-05-08T18:09:41.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4839999999999998e-06 2024-05-08T18:09:41.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.250557+0000", 2024-05-08T18:09:41.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022238319999999998 2024-05-08T18:09:41.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.752 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.250588+0000", 2024-05-08T18:09:41.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1041999999999999e-05 2024-05-08T18:09:41.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.752 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.250601+0000", 2024-05-08T18:09:41.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2928999999999999e-05 2024-05-08T18:09:41.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.250695+0000", 2024-05-08T18:09:41.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4011999999999994e-05 2024-05-08T18:09:41.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.250854+0000", 2024-05-08T18:09:41.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015883600000000001 2024-05-08T18:09:41.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:41.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.251385+0000", 2024-05-08T18:09:41.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053124200000000002 2024-05-08T18:09:41.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.265113+0000", 2024-05-08T18:09:41.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013727614000000001 2024-05-08T18:09:41.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.266991+0000", 2024-05-08T18:09:41.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001878275 2024-05-08T18:09:41.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.267051+0000", 2024-05-08T18:09:41.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9363000000000001e-05 2024-05-08T18:09:41.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.267112+0000", 2024-05-08T18:09:41.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1058999999999999e-05 2024-05-08T18:09:41.755 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.755 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.755 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.755 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2136 3.3e 3:7e6feb55:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.HfAxvQBa5Hc-UtPiYKXpRY3njm6jIb-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:41.756 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.563178+0000", 2024-05-08T18:09:41.756 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.111934100999999, 2024-05-08T18:09:41.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024664469000000001, 2024-05-08T18:09:41.756 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.756 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.756 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.756 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.756 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.756 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.756 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2136 2024-05-08T18:09:41.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.756 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.563178+0000", 2024-05-08T18:09:41.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.563178+0000", 2024-05-08T18:09:41.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.563181+0000", 2024-05-08T18:09:41.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.676e-06 2024-05-08T18:09:41.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.565700+0000", 2024-05-08T18:09:41.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025191860000000001 2024-05-08T18:09:41.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.565745+0000", 2024-05-08T18:09:41.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4438999999999999e-05 2024-05-08T18:09:41.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.565766+0000", 2024-05-08T18:09:41.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0905999999999999e-05 2024-05-08T18:09:41.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.565934+0000", 2024-05-08T18:09:41.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016784699999999999 2024-05-08T18:09:41.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.566337+0000", 2024-05-08T18:09:41.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040316700000000001 2024-05-08T18:09:41.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:41.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.566743+0000", 2024-05-08T18:09:41.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040581900000000003 2024-05-08T18:09:41.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.584555+0000", 2024-05-08T18:09:41.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017812093000000001 2024-05-08T18:09:41.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.587652+0000", 2024-05-08T18:09:41.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00309706 2024-05-08T18:09:41.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.587774+0000", 2024-05-08T18:09:41.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012271499999999999 2024-05-08T18:09:41.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.587842+0000", 2024-05-08T18:09:41.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7560999999999999e-05 2024-05-08T18:09:41.761 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.761 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.761 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.761 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2142 3.1e 3:7b76bf40:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.dbl7KmEpihzAmy1_6tIHfaLaiCXT2yc_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:41.761 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.723193+0000", 2024-05-08T18:09:41.761 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.951918615, 2024-05-08T18:09:41.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018688923, 2024-05-08T18:09:41.761 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.761 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.761 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.761 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.762 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.762 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.762 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2142 2024-05-08T18:09:41.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.762 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.723193+0000", 2024-05-08T18:09:41.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.723193+0000", 2024-05-08T18:09:41.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.723197+0000", 2024-05-08T18:09:41.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8600000000000003e-06 2024-05-08T18:09:41.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.726285+0000", 2024-05-08T18:09:41.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030876480000000001 2024-05-08T18:09:41.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.726331+0000", 2024-05-08T18:09:41.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6903000000000001e-05 2024-05-08T18:09:41.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.726351+0000", 2024-05-08T18:09:41.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9769999999999999e-05 2024-05-08T18:09:41.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.726487+0000", 2024-05-08T18:09:41.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013600400000000001 2024-05-08T18:09:41.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.726752+0000", 2024-05-08T18:09:41.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026510200000000002 2024-05-08T18:09:41.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:41.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.727027+0000", 2024-05-08T18:09:41.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027441199999999997 2024-05-08T18:09:41.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.736805+0000", 2024-05-08T18:09:41.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0097778540000000008 2024-05-08T18:09:41.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.741782+0000", 2024-05-08T18:09:41.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049770989999999996 2024-05-08T18:09:41.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.741837+0000", 2024-05-08T18:09:41.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5671999999999998e-05 2024-05-08T18:09:41.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.741882+0000", 2024-05-08T18:09:41.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4598999999999998e-05 2024-05-08T18:09:41.766 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.766 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.766 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.766 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:2181 3.8 e93/20 3:12ff5737:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.64:head v 93'9, mlcod=87'7)", 2024-05-08T18:09:41.766 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.752726+0000", 2024-05-08T18:09:41.766 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.9223854239999998, 2024-05-08T18:09:41.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017928070000000001, 2024-05-08T18:09:41.767 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.767 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.767 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.767 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.752726+0000", 2024-05-08T18:09:41.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.752726+0000", 2024-05-08T18:09:41.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.752728+0000", 2024-05-08T18:09:41.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6479999999999999e-06 2024-05-08T18:09:41.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.755318+0000", 2024-05-08T18:09:41.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025904470000000001 2024-05-08T18:09:41.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.755348+0000", 2024-05-08T18:09:41.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0012999999999999e-05 2024-05-08T18:09:41.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.755366+0000", 2024-05-08T18:09:41.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7634000000000001e-05 2024-05-08T18:09:41.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.755466+0000", 2024-05-08T18:09:41.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9993000000000003e-05 2024-05-08T18:09:41.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.755502+0000", 2024-05-08T18:09:41.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6078000000000003e-05 2024-05-08T18:09:41.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.770536+0000", 2024-05-08T18:09:41.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015033786 2024-05-08T18:09:41.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.770654+0000", 2024-05-08T18:09:41.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118471 2024-05-08T18:09:41.771 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.771 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.771 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.771 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2184 3.4 3:22f35135:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.6RUONhXxP9eF42Kebi9zd8ZJKTDUTd3_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:41.771 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.864429+0000", 2024-05-08T18:09:41.771 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.8106831230000004, 2024-05-08T18:09:41.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019853949999999999, 2024-05-08T18:09:41.771 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.771 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.771 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.771 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.771 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.772 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.772 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2184 2024-05-08T18:09:41.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.772 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.864429+0000", 2024-05-08T18:09:41.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.864429+0000", 2024-05-08T18:09:41.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.864431+0000", 2024-05-08T18:09:41.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6819999999999999e-06 2024-05-08T18:09:41.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866285+0000", 2024-05-08T18:09:41.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001853941 2024-05-08T18:09:41.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866316+0000", 2024-05-08T18:09:41.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1186999999999998e-05 2024-05-08T18:09:41.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866331+0000", 2024-05-08T18:09:41.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4956999999999999e-05 2024-05-08T18:09:41.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866416+0000", 2024-05-08T18:09:41.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4882000000000005e-05 2024-05-08T18:09:41.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866610+0000", 2024-05-08T18:09:41.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019346700000000001 2024-05-08T18:09:41.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:41.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866803+0000", 2024-05-08T18:09:41.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019362099999999999 2024-05-08T18:09:41.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.884053+0000", 2024-05-08T18:09:41.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017250168 2024-05-08T18:09:41.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.884145+0000", 2024-05-08T18:09:41.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1782999999999999e-05 2024-05-08T18:09:41.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.884204+0000", 2024-05-08T18:09:41.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8511000000000003e-05 2024-05-08T18:09:41.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.884283+0000", 2024-05-08T18:09:41.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8751000000000005e-05 2024-05-08T18:09:41.776 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.777 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.777 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.777 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2365 3.31 3:8db5ccf0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.93:head [create,setxattr user.rgw.idtag (61) in=14b,setxattr user.rgw.tail_tag (61) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:41.777 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:35.496834+0000", 2024-05-08T18:09:41.777 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 6.1782771990000001, 2024-05-08T18:09:41.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019483308000000001, 2024-05-08T18:09:41.777 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:41.777 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:41.777 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:41.777 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:41.777 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:41.778 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:41.778 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2365 2024-05-08T18:09:41.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.778 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:41.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:41.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.496834+0000", 2024-05-08T18:09:41.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:41.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.496834+0000", 2024-05-08T18:09:41.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:41.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:41.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.496836+0000", 2024-05-08T18:09:41.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.265e-06 2024-05-08T18:09:41.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:41.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499074+0000", 2024-05-08T18:09:41.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002237789 2024-05-08T18:09:41.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:41.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499101+0000", 2024-05-08T18:09:41.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7251e-05 2024-05-08T18:09:41.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:41.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499112+0000", 2024-05-08T18:09:41.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.135e-05 2024-05-08T18:09:41.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:41.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499189+0000", 2024-05-08T18:09:41.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6567000000000001e-05 2024-05-08T18:09:41.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:41.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499364+0000", 2024-05-08T18:09:41.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017557200000000001 2024-05-08T18:09:41.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:41.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499845+0000", 2024-05-08T18:09:41.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000480292 2024-05-08T18:09:41.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:41.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.515138+0000", 2024-05-08T18:09:41.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01529324 2024-05-08T18:09:41.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:41.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.516091+0000", 2024-05-08T18:09:41.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00095270100000000003 2024-05-08T18:09:41.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:41.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.516218+0000", 2024-05-08T18:09:41.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012745700000000001 2024-05-08T18:09:41.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:41.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:41.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:41.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.516318+0000", 2024-05-08T18:09:41.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9823999999999998e-05 2024-05-08T18:09:41.782 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.782 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.782 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.783 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:41.783 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:41.783 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:41.783 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:09:41.784 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:41.785+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:41.785 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:09:41.885 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:41.884+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:41.926 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-05-08T18:09:41.959 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:41.959 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:41.959 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:41.972 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:09:41.982 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:41.983 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:41.985 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:41.985+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:42.001 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:42.001 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:42.024 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:42.025 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:42.043 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:42.043 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:42.063 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:42.063 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:42.083 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:42.083 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:42.085 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:42.088+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:42.101 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:42.101 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:42.108 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:42.108 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:42.114 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:09:42.129 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:42.129 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:42.187 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:42.185+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:42.244 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:42.244 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:42.260 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:09:42.305 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:42.308+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:42.386 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:42.386 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:42.389 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:42.388+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:42.402 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:09:42.489 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:42.489+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:42.574 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:42.574 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:42.589 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:09:42.591 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:42.589+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:42.692 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:42.692+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:42.707 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:42.707 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:42.724 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:09:42.793 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:42.792+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:42.855 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:42.855 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:42.870 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:09:42.893 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:42.896+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:42.988 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:42.989 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:42.994 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:42.996+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:43.003 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:09:43.094 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:43.092+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:43.125 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:43.125 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:43.139 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:09:43.232 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:43.232+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:43.296 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:43.296+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:43.320 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:43.320 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:43.334 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:09:43.397 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:43.400+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:43.496 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:43.496 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:43.498 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:43.496+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:43.512 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:09:43.600 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:43.600+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:43.680 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:43.680 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:43.694 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:09:43.700 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:43.704+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:43.800 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:43.800+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:43.864 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:43.864 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:43.878 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:09:43.920 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:43.920+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:43.955 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:09:44.002 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:44.008+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:44.042 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:44.043 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:44.056 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:09:44.104 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:44.104+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:44.146 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:09:44.184 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:44.184 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:44.199 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:09:44.243 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:44.240+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:44.286 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:44.286 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:44.302 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:44.303 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:44.309 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:44.308+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:44.320 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:44.321 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:44.337 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:44.337 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:44.356 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:44.356 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:44.366 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:44.366 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:44.376 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:44.376 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:44.384 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:09:44.395 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:44.395 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:44.405 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:44.408+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:44.412 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:44.412 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:44.506 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:44.512+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:44.544 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:44.545 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:44.545 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:44.545 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:44.545 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:44.558 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:09:44.608 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:44.612+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:44.686 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:44.686 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:44.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:44.686 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:44.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.686 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:09:44.687 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:44.687 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 161.86993533099999, 2024-05-08T18:09:44.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.16213206199999999, 2024-05-08T18:09:44.687 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.687 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.687 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.687 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.687 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:09:44.687 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:09:44.687 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1 2024-05-08T18:09:44.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.687 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:44.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:44.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814494+0000", 2024-05-08T18:09:44.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:09:44.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814520+0000", 2024-05-08T18:09:44.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-05 2024-05-08T18:09:44.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814543+0000", 2024-05-08T18:09:44.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2353000000000001e-05 2024-05-08T18:09:44.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814563+0000", 2024-05-08T18:09:44.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.048e-05 2024-05-08T18:09:44.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814677+0000", 2024-05-08T18:09:44.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113632 2024-05-08T18:09:44.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:44.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814705+0000", 2024-05-08T18:09:44.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8626999999999999e-05 2024-05-08T18:09:44.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971115+0000", 2024-05-08T18:09:44.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.156409825 2024-05-08T18:09:44.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971438+0000", 2024-05-08T18:09:44.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00032289200000000002 2024-05-08T18:09:44.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:44.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971849+0000", 2024-05-08T18:09:44.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041139300000000002 2024-05-08T18:09:44.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.975364+0000", 2024-05-08T18:09:44.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035148390000000001 2024-05-08T18:09:44.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976474+0000", 2024-05-08T18:09:44.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001110099 2024-05-08T18:09:44.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976564+0000", 2024-05-08T18:09:44.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9522000000000001e-05 2024-05-08T18:09:44.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976624+0000", 2024-05-08T18:09:44.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9616e-05 2024-05-08T18:09:44.693 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.693 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.693 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.693 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1194 3.16 e85/20 3:6b2325a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_6:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:44.693 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:44.693 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 37.663533121, 2024-05-08T18:09:44.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024064767000000001, 2024-05-08T18:09:44.693 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.693 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.693 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.694 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:44.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:44.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020897+0000", 2024-05-08T18:09:44.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9699999999999999e-06 2024-05-08T18:09:44.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027491+0000", 2024-05-08T18:09:44.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065945229999999997 2024-05-08T18:09:44.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027543+0000", 2024-05-08T18:09:44.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1319000000000001e-05 2024-05-08T18:09:44.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027573+0000", 2024-05-08T18:09:44.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0380000000000001e-05 2024-05-08T18:09:44.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027737+0000", 2024-05-08T18:09:44.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000163871 2024-05-08T18:09:44.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027782+0000", 2024-05-08T18:09:44.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5519999999999998e-05 2024-05-08T18:09:44.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044819+0000", 2024-05-08T18:09:44.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017036481999999999 2024-05-08T18:09:44.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044958+0000", 2024-05-08T18:09:44.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013970200000000001 2024-05-08T18:09:44.697 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.697 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.697 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.697 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1202 3.14 e85/20 3:2a8c8569:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_14:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:44.697 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:44.697 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 37.577583052999998, 2024-05-08T18:09:44.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023371860000000001, 2024-05-08T18:09:44.698 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.698 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.698 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.698 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:44.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:44.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106846+0000", 2024-05-08T18:09:44.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:09:44.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110841+0000", 2024-05-08T18:09:44.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039945479999999997 2024-05-08T18:09:44.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110888+0000", 2024-05-08T18:09:44.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7349999999999999e-05 2024-05-08T18:09:44.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110913+0000", 2024-05-08T18:09:44.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5055999999999999e-05 2024-05-08T18:09:44.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.111067+0000", 2024-05-08T18:09:44.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015329800000000001 2024-05-08T18:09:44.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.111110+0000", 2024-05-08T18:09:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3649000000000002e-05 2024-05-08T18:09:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130087+0000", 2024-05-08T18:09:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018976186999999999 2024-05-08T18:09:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130216+0000", 2024-05-08T18:09:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012911199999999999 2024-05-08T18:09:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.701 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.702 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.702 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1207 3.15 3:a96d965c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:44.702 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:44.702 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 37.532000777999997, 2024-05-08T18:09:44.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02864527, 2024-05-08T18:09:44.702 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.702 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.702 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.702 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.702 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:44.702 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:44.703 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1207 2024-05-08T18:09:44.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.703 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:44.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:44.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152430+0000", 2024-05-08T18:09:44.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1230000000000002e-06 2024-05-08T18:09:44.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157227+0000", 2024-05-08T18:09:44.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047968769999999997 2024-05-08T18:09:44.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157268+0000", 2024-05-08T18:09:44.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0673000000000002e-05 2024-05-08T18:09:44.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157293+0000", 2024-05-08T18:09:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5469999999999998e-05 2024-05-08T18:09:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157483+0000", 2024-05-08T18:09:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018973300000000001 2024-05-08T18:09:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157750+0000", 2024-05-08T18:09:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026736400000000002 2024-05-08T18:09:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:44.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157982+0000", 2024-05-08T18:09:44.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023154299999999999 2024-05-08T18:09:44.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.171224+0000", 2024-05-08T18:09:44.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013242115 2024-05-08T18:09:44.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180801+0000", 2024-05-08T18:09:44.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0095766749999999998 2024-05-08T18:09:44.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180919+0000", 2024-05-08T18:09:44.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118546 2024-05-08T18:09:44.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.181071+0000", 2024-05-08T18:09:44.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152151 2024-05-08T18:09:44.707 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.707 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.707 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.707 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1224 3.13 3:c82cef46:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:44.707 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:44.708 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 37.045947132000002, 2024-05-08T18:09:44.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025580821, 2024-05-08T18:09:44.708 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.708 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.708 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.708 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.708 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:44.708 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:44.708 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1224 2024-05-08T18:09:44.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.708 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:44.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:44.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638484+0000", 2024-05-08T18:09:44.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1989999999999999e-06 2024-05-08T18:09:44.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643068+0000", 2024-05-08T18:09:44.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045841859999999996 2024-05-08T18:09:44.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643099+0000", 2024-05-08T18:09:44.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1331999999999997e-05 2024-05-08T18:09:44.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643117+0000", 2024-05-08T18:09:44.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7176999999999998e-05 2024-05-08T18:09:44.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643262+0000", 2024-05-08T18:09:44.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014521299999999999 2024-05-08T18:09:44.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643523+0000", 2024-05-08T18:09:44.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000260783 2024-05-08T18:09:44.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:44.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643768+0000", 2024-05-08T18:09:44.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024567399999999998 2024-05-08T18:09:44.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.662501+0000", 2024-05-08T18:09:44.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018732988999999999 2024-05-08T18:09:44.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663964+0000", 2024-05-08T18:09:44.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001463074 2024-05-08T18:09:44.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.664015+0000", 2024-05-08T18:09:44.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0549e-05 2024-05-08T18:09:44.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.664061+0000", 2024-05-08T18:09:44.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5645000000000001e-05 2024-05-08T18:09:44.713 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.713 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.713 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.713 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1255 3.12 e85/20 3:48af9d8c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_11:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:44.713 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:44.713 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 36.202949179999997, 2024-05-08T18:09:44.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021924084999999999, 2024-05-08T18:09:44.713 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.714 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.714 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.714 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:44.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:44.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481479+0000", 2024-05-08T18:09:44.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999999999999999e-06 2024-05-08T18:09:44.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.485998+0000", 2024-05-08T18:09:44.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045194600000000003 2024-05-08T18:09:44.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486023+0000", 2024-05-08T18:09:44.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4516999999999999e-05 2024-05-08T18:09:44.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486033+0000", 2024-05-08T18:09:44.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0529e-05 2024-05-08T18:09:44.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486172+0000", 2024-05-08T18:09:44.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013829599999999999 2024-05-08T18:09:44.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486234+0000", 2024-05-08T18:09:44.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2156000000000006e-05 2024-05-08T18:09:44.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.503338+0000", 2024-05-08T18:09:44.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017104346999999999 2024-05-08T18:09:44.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.503402+0000", 2024-05-08T18:09:44.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3579999999999998e-05 2024-05-08T18:09:44.717 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.717 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.717 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.718 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1277 3.3f 3:ffe0c8dc:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:44.718 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:44.718 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.599300147999998, 2024-05-08T18:09:44.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025789262, 2024-05-08T18:09:44.718 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.718 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.718 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.718 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.718 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:44.718 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:44.718 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1277 2024-05-08T18:09:44.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.718 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:44.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:44.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085130+0000", 2024-05-08T18:09:44.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4659999999999999e-06 2024-05-08T18:09:44.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089237+0000", 2024-05-08T18:09:44.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004106424 2024-05-08T18:09:44.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089281+0000", 2024-05-08T18:09:44.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4053e-05 2024-05-08T18:09:44.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089300+0000", 2024-05-08T18:09:44.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9057000000000001e-05 2024-05-08T18:09:44.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089467+0000", 2024-05-08T18:09:44.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000167734 2024-05-08T18:09:44.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089839+0000", 2024-05-08T18:09:44.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037171900000000001 2024-05-08T18:09:44.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:44.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.090206+0000", 2024-05-08T18:09:44.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036716500000000003 2024-05-08T18:09:44.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.105682+0000", 2024-05-08T18:09:44.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015475495000000001 2024-05-08T18:09:44.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110695+0000", 2024-05-08T18:09:44.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050135420000000002 2024-05-08T18:09:44.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110779+0000", 2024-05-08T18:09:44.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3914999999999999e-05 2024-05-08T18:09:44.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110916+0000", 2024-05-08T18:09:44.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136692 2024-05-08T18:09:44.723 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.723 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.723 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.723 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1283 3.39 3:9ca6d3f9:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:44.723 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:44.723 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.515214563999997, 2024-05-08T18:09:44.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022844218999999999, 2024-05-08T18:09:44.724 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.724 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.724 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.724 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.724 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:44.724 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:44.724 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1283 2024-05-08T18:09:44.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.724 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:44.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:44.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169215+0000", 2024-05-08T18:09:44.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9529999999999999e-06 2024-05-08T18:09:44.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173086+0000", 2024-05-08T18:09:44.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003870582 2024-05-08T18:09:44.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173107+0000", 2024-05-08T18:09:44.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1608999999999999e-05 2024-05-08T18:09:44.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173117+0000", 2024-05-08T18:09:44.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8090000000000004e-06 2024-05-08T18:09:44.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173192+0000", 2024-05-08T18:09:44.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4676000000000001e-05 2024-05-08T18:09:44.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:44.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173197+0000", 2024-05-08T18:09:44.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0710000000000002e-06 2024-05-08T18:09:44.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.175963+0000", 2024-05-08T18:09:44.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027662810000000002 2024-05-08T18:09:44.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.176138+0000", 2024-05-08T18:09:44.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017430500000000001 2024-05-08T18:09:44.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:44.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.176332+0000", 2024-05-08T18:09:44.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019477000000000001 2024-05-08T18:09:44.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.184230+0000", 2024-05-08T18:09:44.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078977630000000004 2024-05-08T18:09:44.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.191962+0000", 2024-05-08T18:09:44.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077315830000000002 2024-05-08T18:09:44.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.192015+0000", 2024-05-08T18:09:44.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2992999999999999e-05 2024-05-08T18:09:44.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.192056+0000", 2024-05-08T18:09:44.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1823999999999998e-05 2024-05-08T18:09:44.729 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.729 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.729 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.730 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1412 3.3f 3:fe02d1ba:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:44.730 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:44.730 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 32.726762538000003, 2024-05-08T18:09:44.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023048524000000001, 2024-05-08T18:09:44.730 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.730 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.730 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.730 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.730 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:44.730 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:44.730 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1412 2024-05-08T18:09:44.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.730 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:44.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:44.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957668+0000", 2024-05-08T18:09:44.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8999999999999999e-06 2024-05-08T18:09:44.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963142+0000", 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005473627 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963181+0000", 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.93e-05 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963199+0000", 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7866000000000001e-05 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963347+0000", 2024-05-08T18:09:44.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014816800000000001 2024-05-08T18:09:44.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963603+0000", 2024-05-08T18:09:44.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025623099999999999 2024-05-08T18:09:44.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:44.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963843+0000", 2024-05-08T18:09:44.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023961699999999999 2024-05-08T18:09:44.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.975743+0000", 2024-05-08T18:09:44.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011899998 2024-05-08T18:09:44.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980533+0000", 2024-05-08T18:09:44.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047898749999999999 2024-05-08T18:09:44.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980638+0000", 2024-05-08T18:09:44.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010527300000000001 2024-05-08T18:09:44.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980713+0000", 2024-05-08T18:09:44.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4668999999999999e-05 2024-05-08T18:09:44.735 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.735 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.735 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.735 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1420 3.e 3:72accb8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.8:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:44.735 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:44.735 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 32.648693668, 2024-05-08T18:09:44.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025387064000000001, 2024-05-08T18:09:44.735 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.735 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.735 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.735 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.735 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:44.736 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:44.736 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1420 2024-05-08T18:09:44.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.736 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:44.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:44.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035736+0000", 2024-05-08T18:09:44.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0240000000000002e-06 2024-05-08T18:09:44.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039738+0000", 2024-05-08T18:09:44.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004001419 2024-05-08T18:09:44.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039775+0000", 2024-05-08T18:09:44.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7696e-05 2024-05-08T18:09:44.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039792+0000", 2024-05-08T18:09:44.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7183000000000001e-05 2024-05-08T18:09:44.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039909+0000", 2024-05-08T18:09:44.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116915 2024-05-08T18:09:44.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.040173+0000", 2024-05-08T18:09:44.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026373100000000001 2024-05-08T18:09:44.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:44.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.041106+0000", 2024-05-08T18:09:44.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093293100000000002 2024-05-08T18:09:44.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060858+0000", 2024-05-08T18:09:44.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019752232000000002 2024-05-08T18:09:44.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060894+0000", 2024-05-08T18:09:44.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6056000000000002e-05 2024-05-08T18:09:44.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.061023+0000", 2024-05-08T18:09:44.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128849 2024-05-08T18:09:44.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.061120+0000", 2024-05-08T18:09:44.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7027999999999993e-05 2024-05-08T18:09:44.740 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.740 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.740 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.741 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1448 3.15 3:a83ea02a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.9:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:44.741 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:44.741 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 31.780505850000001, 2024-05-08T18:09:44.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021945044, 2024-05-08T18:09:44.741 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.741 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.741 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.741 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.741 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:44.741 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:44.741 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1448 2024-05-08T18:09:44.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.741 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:44.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:44.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903924+0000", 2024-05-08T18:09:44.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5790000000000002e-06 2024-05-08T18:09:44.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907773+0000", 2024-05-08T18:09:44.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038495740000000001 2024-05-08T18:09:44.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907796+0000", 2024-05-08T18:09:44.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3011e-05 2024-05-08T18:09:44.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907806+0000", 2024-05-08T18:09:44.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9729999999999992e-06 2024-05-08T18:09:44.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907885+0000", 2024-05-08T18:09:44.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8799000000000002e-05 2024-05-08T18:09:44.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.908059+0000", 2024-05-08T18:09:44.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017370100000000001 2024-05-08T18:09:44.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:44.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.908581+0000", 2024-05-08T18:09:44.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052234099999999995 2024-05-08T18:09:44.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.918050+0000", 2024-05-08T18:09:44.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00946871 2024-05-08T18:09:44.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925682+0000", 2024-05-08T18:09:44.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0076326689999999999 2024-05-08T18:09:44.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925817+0000", 2024-05-08T18:09:44.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013451000000000001 2024-05-08T18:09:44.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925866+0000", 2024-05-08T18:09:44.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9177e-05 2024-05-08T18:09:44.746 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.746 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.746 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.746 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1931 3.15 3:a838452a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.rt8jcH7t-Si0Elu5GsS4JhWyuPnbJ5v_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:44.746 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:44.746 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.164515206000001, 2024-05-08T18:09:44.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022148926999999999, 2024-05-08T18:09:44.747 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.747 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.747 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.747 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.747 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:44.747 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:44.747 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1931 2024-05-08T18:09:44.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.747 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:44.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:44.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519915+0000", 2024-05-08T18:09:44.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4070000000000002e-06 2024-05-08T18:09:44.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523840+0000", 2024-05-08T18:09:44.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00392494 2024-05-08T18:09:44.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523881+0000", 2024-05-08T18:09:44.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0729999999999998e-05 2024-05-08T18:09:44.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523901+0000", 2024-05-08T18:09:44.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9816000000000001e-05 2024-05-08T18:09:44.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524034+0000", 2024-05-08T18:09:44.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013357199999999999 2024-05-08T18:09:44.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524297+0000", 2024-05-08T18:09:44.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000262697 2024-05-08T18:09:44.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:44.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524555+0000", 2024-05-08T18:09:44.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025802099999999999 2024-05-08T18:09:44.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.535170+0000", 2024-05-08T18:09:44.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010615528000000001 2024-05-08T18:09:44.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.541876+0000", 2024-05-08T18:09:44.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006705562 2024-05-08T18:09:44.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.541984+0000", 2024-05-08T18:09:44.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108585 2024-05-08T18:09:44.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.542061+0000", 2024-05-08T18:09:44.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6069000000000006e-05 2024-05-08T18:09:44.751 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.752 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.752 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1990 3.2d 3:b4aceac7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.34:head [create,setxattr user.rgw.idtag (61) in=14b,setxattr user.rgw.tail_tag (61) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:44.752 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.742290+0000", 2024-05-08T18:09:44.752 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 16.942136547, 2024-05-08T18:09:44.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023330152999999999, 2024-05-08T18:09:44.752 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.752 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.752 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.752 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.752 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:44.752 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:44.752 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1990 2024-05-08T18:09:44.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.753 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.742290+0000", 2024-05-08T18:09:44.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.742290+0000", 2024-05-08T18:09:44.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.742293+0000", 2024-05-08T18:09:44.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7369999999999998e-06 2024-05-08T18:09:44.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747757+0000", 2024-05-08T18:09:44.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054638079999999997 2024-05-08T18:09:44.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747799+0000", 2024-05-08T18:09:44.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:09:44.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747819+0000", 2024-05-08T18:09:44.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0183e-05 2024-05-08T18:09:44.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747973+0000", 2024-05-08T18:09:44.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015351500000000001 2024-05-08T18:09:44.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.748251+0000", 2024-05-08T18:09:44.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027811699999999998 2024-05-08T18:09:44.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:44.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.749139+0000", 2024-05-08T18:09:44.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00088849299999999997 2024-05-08T18:09:44.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.763612+0000", 2024-05-08T18:09:44.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014472992 2024-05-08T18:09:44.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.765137+0000", 2024-05-08T18:09:44.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001524823 2024-05-08T18:09:44.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.765399+0000", 2024-05-08T18:09:44.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026171700000000002 2024-05-08T18:09:44.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.765620+0000", 2024-05-08T18:09:44.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000221595 2024-05-08T18:09:44.757 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.757 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.757 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.757 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1999 3.13 3:c81aceb2:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.qFJD7RDtXlCNRHqLIdswZJm3STCASHM_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:44.757 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.958634+0000", 2024-05-08T18:09:44.758 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 16.725793099000001, 2024-05-08T18:09:44.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022563374000000001, 2024-05-08T18:09:44.758 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.758 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.758 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.758 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.758 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:44.758 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:44.758 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1999 2024-05-08T18:09:44.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.758 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.958634+0000", 2024-05-08T18:09:44.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.958634+0000", 2024-05-08T18:09:44.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.958637+0000", 2024-05-08T18:09:44.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2830000000000002e-06 2024-05-08T18:09:44.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.963827+0000", 2024-05-08T18:09:44.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051899609999999999 2024-05-08T18:09:44.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.964764+0000", 2024-05-08T18:09:44.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093745000000000005 2024-05-08T18:09:44.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.964794+0000", 2024-05-08T18:09:44.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.957e-05 2024-05-08T18:09:44.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.965016+0000", 2024-05-08T18:09:44.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000221671 2024-05-08T18:09:44.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.965297+0000", 2024-05-08T18:09:44.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028171000000000001 2024-05-08T18:09:44.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:44.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.965547+0000", 2024-05-08T18:09:44.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024940800000000001 2024-05-08T18:09:44.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.979720+0000", 2024-05-08T18:09:44.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01417321 2024-05-08T18:09:44.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.981028+0000", 2024-05-08T18:09:44.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013080489999999999 2024-05-08T18:09:44.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.981129+0000", 2024-05-08T18:09:44.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010111900000000001 2024-05-08T18:09:44.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.981197+0000", 2024-05-08T18:09:44.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7942999999999996e-05 2024-05-08T18:09:44.763 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.763 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.763 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.763 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2130 3.39 3:9f8cf400:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.K7V9dh3caEYHsi9YlGwMWJrNO2rnOUe_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:44.763 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:30.419212+0000", 2024-05-08T18:09:44.763 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.265214586000001, 2024-05-08T18:09:44.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025593207999999999, 2024-05-08T18:09:44.763 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.763 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.763 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.763 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.764 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:44.764 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:44.764 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2130 2024-05-08T18:09:44.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.764 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.419212+0000", 2024-05-08T18:09:44.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.419212+0000", 2024-05-08T18:09:44.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.419215+0000", 2024-05-08T18:09:44.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0699999999999998e-06 2024-05-08T18:09:44.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423670+0000", 2024-05-08T18:09:44.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044546990000000003 2024-05-08T18:09:44.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423704+0000", 2024-05-08T18:09:44.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4329999999999998e-05 2024-05-08T18:09:44.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423720+0000", 2024-05-08T18:09:44.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5769000000000001e-05 2024-05-08T18:09:44.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423820+0000", 2024-05-08T18:09:44.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9964999999999996e-05 2024-05-08T18:09:44.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423947+0000", 2024-05-08T18:09:44.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012709400000000001 2024-05-08T18:09:44.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:44.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.424047+0000", 2024-05-08T18:09:44.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9841999999999997e-05 2024-05-08T18:09:44.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.430460+0000", 2024-05-08T18:09:44.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064128040000000002 2024-05-08T18:09:44.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.444733+0000", 2024-05-08T18:09:44.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014272741 2024-05-08T18:09:44.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.444776+0000", 2024-05-08T18:09:44.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3594000000000003e-05 2024-05-08T18:09:44.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.444805+0000", 2024-05-08T18:09:44.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9300000000000001e-05 2024-05-08T18:09:44.768 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.769 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.769 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.769 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2175 3.2d 3:b44c7524:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.63:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:44.769 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:31.556724+0000", 2024-05-08T18:09:44.769 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.127702795999999, 2024-05-08T18:09:44.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.028086578000000001, 2024-05-08T18:09:44.769 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.769 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.769 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.769 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.769 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:44.769 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:44.769 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2175 2024-05-08T18:09:44.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.770 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.556724+0000", 2024-05-08T18:09:44.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.556724+0000", 2024-05-08T18:09:44.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.556727+0000", 2024-05-08T18:09:44.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3239999999999999e-06 2024-05-08T18:09:44.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561115+0000", 2024-05-08T18:09:44.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043878659999999998 2024-05-08T18:09:44.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561151+0000", 2024-05-08T18:09:44.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6247e-05 2024-05-08T18:09:44.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561177+0000", 2024-05-08T18:09:44.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5876000000000001e-05 2024-05-08T18:09:44.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561310+0000", 2024-05-08T18:09:44.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013296200000000001 2024-05-08T18:09:44.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561658+0000", 2024-05-08T18:09:44.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034749599999999998 2024-05-08T18:09:44.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:44.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.562604+0000", 2024-05-08T18:09:44.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00094605000000000004 2024-05-08T18:09:44.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.574717+0000", 2024-05-08T18:09:44.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012113153999999999 2024-05-08T18:09:44.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.584594+0000", 2024-05-08T18:09:44.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0098766830000000007 2024-05-08T18:09:44.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.584723+0000", 2024-05-08T18:09:44.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012911800000000001 2024-05-08T18:09:44.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.584811+0000", 2024-05-08T18:09:44.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7801999999999997e-05 2024-05-08T18:09:44.774 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.774 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.774 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.774 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2199 3.15 3:a8780bcf:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.67:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:44.775 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:32.172858+0000", 2024-05-08T18:09:44.775 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.511569248000001, 2024-05-08T18:09:44.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022099601999999999, 2024-05-08T18:09:44.775 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.775 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.775 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.775 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.775 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:44.775 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:44.775 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2199 2024-05-08T18:09:44.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.775 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.172858+0000", 2024-05-08T18:09:44.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.172858+0000", 2024-05-08T18:09:44.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.172861+0000", 2024-05-08T18:09:44.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.337e-06 2024-05-08T18:09:44.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177201+0000", 2024-05-08T18:09:44.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043402989999999997 2024-05-08T18:09:44.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177239+0000", 2024-05-08T18:09:44.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8157000000000001e-05 2024-05-08T18:09:44.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177257+0000", 2024-05-08T18:09:44.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.806e-05 2024-05-08T18:09:44.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177426+0000", 2024-05-08T18:09:44.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016871799999999999 2024-05-08T18:09:44.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177706+0000", 2024-05-08T18:09:44.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027945800000000001 2024-05-08T18:09:44.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:44.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.178615+0000", 2024-05-08T18:09:44.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00090926799999999997 2024-05-08T18:09:44.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.192797+0000", 2024-05-08T18:09:44.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014181724 2024-05-08T18:09:44.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.194761+0000", 2024-05-08T18:09:44.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001963963 2024-05-08T18:09:44.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.194882+0000", 2024-05-08T18:09:44.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120952 2024-05-08T18:09:44.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.194957+0000", 2024-05-08T18:09:44.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5666000000000004e-05 2024-05-08T18:09:44.780 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.780 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.780 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.780 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2205 3.e 3:736fbc51:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.68:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:44.780 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:32.330919+0000", 2024-05-08T18:09:44.780 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.353508247000001, 2024-05-08T18:09:44.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024623565, 2024-05-08T18:09:44.780 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.781 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.781 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.781 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.781 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:44.781 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:44.781 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2205 2024-05-08T18:09:44.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.781 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.330919+0000", 2024-05-08T18:09:44.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.330919+0000", 2024-05-08T18:09:44.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.330922+0000", 2024-05-08T18:09:44.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1470000000000001e-06 2024-05-08T18:09:44.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.334876+0000", 2024-05-08T18:09:44.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039544890000000003 2024-05-08T18:09:44.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.334914+0000", 2024-05-08T18:09:44.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7973999999999999e-05 2024-05-08T18:09:44.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.334932+0000", 2024-05-08T18:09:44.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7319000000000001e-05 2024-05-08T18:09:44.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.335093+0000", 2024-05-08T18:09:44.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000161149 2024-05-08T18:09:44.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.335364+0000", 2024-05-08T18:09:44.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027133799999999998 2024-05-08T18:09:44.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:44.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.336278+0000", 2024-05-08T18:09:44.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00091437799999999998 2024-05-08T18:09:44.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.353978+0000", 2024-05-08T18:09:44.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017699914000000001 2024-05-08T18:09:44.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.355343+0000", 2024-05-08T18:09:44.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001364346 2024-05-08T18:09:44.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.355463+0000", 2024-05-08T18:09:44.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120789 2024-05-08T18:09:44.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.355542+0000", 2024-05-08T18:09:44.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8721999999999996e-05 2024-05-08T18:09:44.786 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.786 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.786 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.786 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2356 3.d 3:b3bbc07d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.8wN2GlL8rBYEiTXR4sMZd0wed6qVyrX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:44.786 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:35.353910+0000", 2024-05-08T18:09:44.786 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.3305171280000003, 2024-05-08T18:09:44.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023189147, 2024-05-08T18:09:44.786 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.786 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.786 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.786 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.787 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:44.787 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:44.787 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2356 2024-05-08T18:09:44.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.787 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.353910+0000", 2024-05-08T18:09:44.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.353910+0000", 2024-05-08T18:09:44.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.353913+0000", 2024-05-08T18:09:44.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.67e-06 2024-05-08T18:09:44.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358160+0000", 2024-05-08T18:09:44.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042467099999999999 2024-05-08T18:09:44.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358200+0000", 2024-05-08T18:09:44.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0272999999999999e-05 2024-05-08T18:09:44.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358225+0000", 2024-05-08T18:09:44.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5003000000000001e-05 2024-05-08T18:09:44.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358331+0000", 2024-05-08T18:09:44.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010557599999999999 2024-05-08T18:09:44.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358517+0000", 2024-05-08T18:09:44.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018577200000000001 2024-05-08T18:09:44.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:44.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358677+0000", 2024-05-08T18:09:44.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000160342 2024-05-08T18:09:44.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.368776+0000", 2024-05-08T18:09:44.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010098763 2024-05-08T18:09:44.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.376804+0000", 2024-05-08T18:09:44.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0080286369999999999 2024-05-08T18:09:44.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.376977+0000", 2024-05-08T18:09:44.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000172349 2024-05-08T18:09:44.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.377099+0000", 2024-05-08T18:09:44.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000122052 2024-05-08T18:09:44.791 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.791 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.792 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.792 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2380 3.e 3:713200a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.N3BoeKsRn7I3GNNh1gsMqBxJl5ACtoq_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:44.792 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:35.841683+0000", 2024-05-08T18:09:44.792 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.8427439410000002, 2024-05-08T18:09:44.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025074545, 2024-05-08T18:09:44.792 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:44.792 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:44.792 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:44.792 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:44.792 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:44.792 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:44.792 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2380 2024-05-08T18:09:44.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.793 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:44.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:44.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.841683+0000", 2024-05-08T18:09:44.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:44.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.841683+0000", 2024-05-08T18:09:44.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:44.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:44.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.841685+0000", 2024-05-08T18:09:44.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3020000000000002e-06 2024-05-08T18:09:44.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:44.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845397+0000", 2024-05-08T18:09:44.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037116240000000002 2024-05-08T18:09:44.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:44.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845421+0000", 2024-05-08T18:09:44.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4468e-05 2024-05-08T18:09:44.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:44.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845434+0000", 2024-05-08T18:09:44.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2989999999999999e-05 2024-05-08T18:09:44.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:44.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845532+0000", 2024-05-08T18:09:44.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7841000000000001e-05 2024-05-08T18:09:44.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:44.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845749+0000", 2024-05-08T18:09:44.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021645099999999999 2024-05-08T18:09:44.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:44.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845973+0000", 2024-05-08T18:09:44.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000224744 2024-05-08T18:09:44.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:44.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866275+0000", 2024-05-08T18:09:44.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020301471000000001 2024-05-08T18:09:44.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:44.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866644+0000", 2024-05-08T18:09:44.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036915800000000002 2024-05-08T18:09:44.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:44.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866704+0000", 2024-05-08T18:09:44.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0495000000000003e-05 2024-05-08T18:09:44.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:44.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:44.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:44.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866757+0000", 2024-05-08T18:09:44.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3001000000000003e-05 2024-05-08T18:09:44.797 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.797 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.797 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.797 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:44.797 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:44.797 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:44.799 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:09:44.799 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:44.804+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:44.899 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:44.904+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:44.935 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-05-08T18:09:44.947 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:44.947 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:44.947 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:44.947 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:44.969 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:09:45.004 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:45.000+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:45.101 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:45.104+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:45.133 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:45.133 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:45.133 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:45.133 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:45.133 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:45.146 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:09:45.237 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:45.244+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:45.303 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:45.308+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:45.315 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:45.315 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1221 3.20 e85/20 3:071d1257:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_5:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.712781063999998, 2024-05-08T18:09:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019872899999999999, 2024-05-08T18:09:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:45.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605944+0000", 2024-05-08T18:09:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.77e-06 2024-05-08T18:09:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612548+0000", 2024-05-08T18:09:45.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066036519999999998 2024-05-08T18:09:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612580+0000", 2024-05-08T18:09:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1945e-05 2024-05-08T18:09:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612593+0000", 2024-05-08T18:09:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3665999999999999e-05 2024-05-08T18:09:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612758+0000", 2024-05-08T18:09:45.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016427600000000001 2024-05-08T18:09:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612832+0000", 2024-05-08T18:09:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4493000000000007e-05 2024-05-08T18:09:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.625728+0000", 2024-05-08T18:09:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012895471 2024-05-08T18:09:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.625815+0000", 2024-05-08T18:09:45.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7627000000000007e-05 2024-05-08T18:09:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1227 3.6 3:6359f987:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.634607506000002, 2024-05-08T18:09:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022831489999999999, 2024-05-08T18:09:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.320 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1227 2024-05-08T18:09:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684119+0000", 2024-05-08T18:09:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.678e-06 2024-05-08T18:09:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687247+0000", 2024-05-08T18:09:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031279820000000001 2024-05-08T18:09:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687274+0000", 2024-05-08T18:09:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7174000000000001e-05 2024-05-08T18:09:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687289+0000", 2024-05-08T18:09:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5364999999999999e-05 2024-05-08T18:09:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687421+0000", 2024-05-08T18:09:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013197999999999999 2024-05-08T18:09:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687681+0000", 2024-05-08T18:09:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025951099999999998 2024-05-08T18:09:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687981+0000", 2024-05-08T18:09:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030021799999999999 2024-05-08T18:09:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706004+0000", 2024-05-08T18:09:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018023441000000001 2024-05-08T18:09:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706867+0000", 2024-05-08T18:09:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00086241200000000001 2024-05-08T18:09:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706901+0000", 2024-05-08T18:09:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4325000000000001e-05 2024-05-08T18:09:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706948+0000", 2024-05-08T18:09:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6403999999999998e-05 2024-05-08T18:09:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1246 3.6 3:6220dfe7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:45.325 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.957928025000001, 2024-05-08T18:09:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020211156000000001, 2024-05-08T18:09:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1246 2024-05-08T18:09:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:45.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360799+0000", 2024-05-08T18:09:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4939999999999999e-06 2024-05-08T18:09:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363474+0000", 2024-05-08T18:09:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026745190000000002 2024-05-08T18:09:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363511+0000", 2024-05-08T18:09:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7722000000000002e-05 2024-05-08T18:09:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363528+0000", 2024-05-08T18:09:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6600999999999999e-05 2024-05-08T18:09:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363637+0000", 2024-05-08T18:09:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108855 2024-05-08T18:09:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363792+0000", 2024-05-08T18:09:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000155561 2024-05-08T18:09:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363921+0000", 2024-05-08T18:09:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128501 2024-05-08T18:09:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.378377+0000", 2024-05-08T18:09:45.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014456577999999999 2024-05-08T18:09:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380848+0000", 2024-05-08T18:09:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024703329999999999 2024-05-08T18:09:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380940+0000", 2024-05-08T18:09:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2264999999999998e-05 2024-05-08T18:09:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.381007+0000", 2024-05-08T18:09:45.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6727e-05 2024-05-08T18:09:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1255 3.12 3:48af9d8c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.836910158000002, 2024-05-08T18:09:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025868088000000001, 2024-05-08T18:09:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.331 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1255 2024-05-08T18:09:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481816+0000", 2024-05-08T18:09:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6390000000000001e-06 2024-05-08T18:09:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484725+0000", 2024-05-08T18:09:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00290865 2024-05-08T18:09:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484750+0000", 2024-05-08T18:09:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5009999999999999e-05 2024-05-08T18:09:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484763+0000", 2024-05-08T18:09:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2976000000000001e-05 2024-05-08T18:09:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484848+0000", 2024-05-08T18:09:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5232e-05 2024-05-08T18:09:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.485026+0000", 2024-05-08T18:09:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000177706 2024-05-08T18:09:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:45.334 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.485186+0000", 2024-05-08T18:09:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016076900000000001 2024-05-08T18:09:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.491881+0000", 2024-05-08T18:09:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066950539999999998 2024-05-08T18:09:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507591+0000", 2024-05-08T18:09:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015709724000000001 2024-05-08T18:09:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507638+0000", 2024-05-08T18:09:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6684999999999998e-05 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507681+0000", 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3643000000000002e-05 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1395 3.17 3:eb9c68a5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.546281417000003, 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026590425000000001, 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.336 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1395 2024-05-08T18:09:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:45.337 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772445+0000", 2024-05-08T18:09:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0970000000000002e-06 2024-05-08T18:09:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775066+0000", 2024-05-08T18:09:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026205730000000002 2024-05-08T18:09:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775101+0000", 2024-05-08T18:09:45.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4876000000000003e-05 2024-05-08T18:09:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775116+0000", 2024-05-08T18:09:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5566999999999999e-05 2024-05-08T18:09:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775200+0000", 2024-05-08T18:09:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3808999999999997e-05 2024-05-08T18:09:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775307+0000", 2024-05-08T18:09:45.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000107366 2024-05-08T18:09:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775430+0000", 2024-05-08T18:09:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012280599999999999 2024-05-08T18:09:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.779395+0000", 2024-05-08T18:09:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003964357 2024-05-08T18:09:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.798911+0000", 2024-05-08T18:09:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019516386 2024-05-08T18:09:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.798982+0000", 2024-05-08T18:09:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0759000000000005e-05 2024-05-08T18:09:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.799033+0000", 2024-05-08T18:09:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0828999999999997e-05 2024-05-08T18:09:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1404 3.1b 3:d97dd5be:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.445451231, 2024-05-08T18:09:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020100535999999999, 2024-05-08T18:09:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1404 2024-05-08T18:09:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873276+0000", 2024-05-08T18:09:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.45e-06 2024-05-08T18:09:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875542+0000", 2024-05-08T18:09:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002266746 2024-05-08T18:09:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875570+0000", 2024-05-08T18:09:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7826000000000001e-05 2024-05-08T18:09:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875585+0000", 2024-05-08T18:09:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4681999999999999e-05 2024-05-08T18:09:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875667+0000", 2024-05-08T18:09:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2429000000000006e-05 2024-05-08T18:09:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875833+0000", 2024-05-08T18:09:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165959 2024-05-08T18:09:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875991+0000", 2024-05-08T18:09:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015766099999999999 2024-05-08T18:09:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.345 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.884154+0000", 2024-05-08T18:09:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081625329999999996 2024-05-08T18:09:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.892970+0000", 2024-05-08T18:09:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0088168540000000007 2024-05-08T18:09:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.893166+0000", 2024-05-08T18:09:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019573 2024-05-08T18:09:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.893373+0000", 2024-05-08T18:09:45.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020666599999999999 2024-05-08T18:09:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1426 3.3 e87/20 3:c1fceb03:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_4:head v 87'7, mlcod=86'5)", 2024-05-08T18:09:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.891265128000001, 2024-05-08T18:09:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020804152999999999, 2024-05-08T18:09:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.347 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427461+0000", 2024-05-08T18:09:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.57e-06 2024-05-08T18:09:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433712+0000", 2024-05-08T18:09:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062511729999999996 2024-05-08T18:09:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433759+0000", 2024-05-08T18:09:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6397000000000003e-05 2024-05-08T18:09:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433779+0000", 2024-05-08T18:09:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0196000000000001e-05 2024-05-08T18:09:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433922+0000", 2024-05-08T18:09:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014305599999999999 2024-05-08T18:09:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433970+0000", 2024-05-08T18:09:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7933000000000003e-05 2024-05-08T18:09:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.448060+0000", 2024-05-08T18:09:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01409064 2024-05-08T18:09:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.448263+0000", 2024-05-08T18:09:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020218800000000001 2024-05-08T18:09:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1452 3.18 e87/20 3:1a3be52d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_2:head v 87'4, mlcod=86'2)", 2024-05-08T18:09:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 31.990717997000001, 2024-05-08T18:09:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020634468, 2024-05-08T18:09:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328008+0000", 2024-05-08T18:09:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2589999999999999e-06 2024-05-08T18:09:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330832+0000", 2024-05-08T18:09:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028243719999999999 2024-05-08T18:09:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330867+0000", 2024-05-08T18:09:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4776e-05 2024-05-08T18:09:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330883+0000", 2024-05-08T18:09:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6121999999999999e-05 2024-05-08T18:09:45.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.331031+0000", 2024-05-08T18:09:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148412 2024-05-08T18:09:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.331075+0000", 2024-05-08T18:09:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3126e-05 2024-05-08T18:09:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.348521+0000", 2024-05-08T18:09:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017446351999999998 2024-05-08T18:09:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.348640+0000", 2024-05-08T18:09:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119049 2024-05-08T18:09:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1463 3.17 3:ebd3133d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:45.355 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 31.745227578000002, 2024-05-08T18:09:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023934057000000002, 2024-05-08T18:09:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1463 2024-05-08T18:09:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.356 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573500+0000", 2024-05-08T18:09:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7670000000000001e-06 2024-05-08T18:09:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575722+0000", 2024-05-08T18:09:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022226559999999999 2024-05-08T18:09:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575781+0000", 2024-05-08T18:09:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8746999999999998e-05 2024-05-08T18:09:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.358 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575810+0000", 2024-05-08T18:09:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8407000000000001e-05 2024-05-08T18:09:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575981+0000", 2024-05-08T18:09:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017151499999999999 2024-05-08T18:09:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.576369+0000", 2024-05-08T18:09:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038807000000000002 2024-05-08T18:09:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.576675+0000", 2024-05-08T18:09:45.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030572800000000001 2024-05-08T18:09:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.585475+0000", 2024-05-08T18:09:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087997630000000004 2024-05-08T18:09:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597202+0000", 2024-05-08T18:09:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011727849 2024-05-08T18:09:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597316+0000", 2024-05-08T18:09:45.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113546 2024-05-08T18:09:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597430+0000", 2024-05-08T18:09:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114009 2024-05-08T18:09:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1913 3.17 3:ea65dc81:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.vOI1jtaftCZSAcjtRhSYPcY8omHGfbO_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.226623100000001, 2024-05-08T18:09:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020076618000000001, 2024-05-08T18:09:45.361 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1913 2024-05-08T18:09:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.362 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092104+0000", 2024-05-08T18:09:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2279999999999998e-06 2024-05-08T18:09:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094163+0000", 2024-05-08T18:09:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020592710000000001 2024-05-08T18:09:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094206+0000", 2024-05-08T18:09:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3072999999999999e-05 2024-05-08T18:09:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094231+0000", 2024-05-08T18:09:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4819000000000001e-05 2024-05-08T18:09:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094325+0000", 2024-05-08T18:09:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4029000000000004e-05 2024-05-08T18:09:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094439+0000", 2024-05-08T18:09:45.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113878 2024-05-08T18:09:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094533+0000", 2024-05-08T18:09:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4733000000000003e-05 2024-05-08T18:09:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.099901+0000", 2024-05-08T18:09:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053678789999999999 2024-05-08T18:09:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.111944+0000", 2024-05-08T18:09:45.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012042855999999999 2024-05-08T18:09:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.112051+0000", 2024-05-08T18:09:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010673100000000001 2024-05-08T18:09:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.112177+0000", 2024-05-08T18:09:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012612100000000001 2024-05-08T18:09:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1928 3.23 3:c76f4655:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.24:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.910784073999999, 2024-05-08T18:09:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026452139, 2024-05-08T18:09:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1928 2024-05-08T18:09:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407943+0000", 2024-05-08T18:09:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4170000000000001e-06 2024-05-08T18:09:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412466+0000", 2024-05-08T18:09:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045230720000000004 2024-05-08T18:09:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412503+0000", 2024-05-08T18:09:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7287999999999999e-05 2024-05-08T18:09:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412520+0000", 2024-05-08T18:09:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7206000000000001e-05 2024-05-08T18:09:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412719+0000", 2024-05-08T18:09:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000198975 2024-05-08T18:09:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412989+0000", 2024-05-08T18:09:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000269256 2024-05-08T18:09:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.413870+0000", 2024-05-08T18:09:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00088159999999999996 2024-05-08T18:09:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.433846+0000", 2024-05-08T18:09:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019975822000000001 2024-05-08T18:09:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434198+0000", 2024-05-08T18:09:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035164000000000001 2024-05-08T18:09:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434318+0000", 2024-05-08T18:09:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120604 2024-05-08T18:09:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434392+0000", 2024-05-08T18:09:45.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3258999999999998e-05 2024-05-08T18:09:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:2130 3.39 e93/20 3:9f8cf400:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.K7V9dh3caEYHsi9YlGwMWJrNO2rnOUe_1:head v 93'7, mlcod=90'5)", 2024-05-08T18:09:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.428375+0000", 2024-05-08T18:09:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.890348126999999, 2024-05-08T18:09:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020125661, 2024-05-08T18:09:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.428375+0000", 2024-05-08T18:09:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.428375+0000", 2024-05-08T18:09:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.428378+0000", 2024-05-08T18:09:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.96e-06 2024-05-08T18:09:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436642+0000", 2024-05-08T18:09:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0082638899999999994 2024-05-08T18:09:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436681+0000", 2024-05-08T18:09:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8389999999999997e-05 2024-05-08T18:09:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436705+0000", 2024-05-08T18:09:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4049e-05 2024-05-08T18:09:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436805+0000", 2024-05-08T18:09:45.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010063100000000001 2024-05-08T18:09:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436825+0000", 2024-05-08T18:09:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9817e-05 2024-05-08T18:09:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.448397+0000", 2024-05-08T18:09:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011572086000000001 2024-05-08T18:09:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.448501+0000", 2024-05-08T18:09:45.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103838 2024-05-08T18:09:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2139 3.3d 3:bf4c8f68:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.57:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.593560+0000", 2024-05-08T18:09:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.725163583000001, 2024-05-08T18:09:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026176721999999999, 2024-05-08T18:09:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2139 2024-05-08T18:09:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.593560+0000", 2024-05-08T18:09:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.593560+0000", 2024-05-08T18:09:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.593564+0000", 2024-05-08T18:09:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8330000000000004e-06 2024-05-08T18:09:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597295+0000", 2024-05-08T18:09:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037317090000000002 2024-05-08T18:09:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597337+0000", 2024-05-08T18:09:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1628999999999997e-05 2024-05-08T18:09:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597356+0000", 2024-05-08T18:09:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9079000000000001e-05 2024-05-08T18:09:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597523+0000", 2024-05-08T18:09:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016655500000000001 2024-05-08T18:09:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597893+0000", 2024-05-08T18:09:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037072199999999998 2024-05-08T18:09:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.598918+0000", 2024-05-08T18:09:45.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010249790000000001 2024-05-08T18:09:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.618213+0000", 2024-05-08T18:09:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019294772000000002 2024-05-08T18:09:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619538+0000", 2024-05-08T18:09:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001324424 2024-05-08T18:09:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619657+0000", 2024-05-08T18:09:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119091 2024-05-08T18:09:45.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619737+0000", 2024-05-08T18:09:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9929e-05 2024-05-08T18:09:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2157 3.17 3:e9343ebc:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.60:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.032761+0000", 2024-05-08T18:09:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.285962193, 2024-05-08T18:09:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019666783, 2024-05-08T18:09:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.381 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2157 2024-05-08T18:09:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.032761+0000", 2024-05-08T18:09:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.032761+0000", 2024-05-08T18:09:45.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.032764+0000", 2024-05-08T18:09:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1329999999999999e-06 2024-05-08T18:09:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035544+0000", 2024-05-08T18:09:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027793679999999999 2024-05-08T18:09:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035584+0000", 2024-05-08T18:09:45.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9935999999999998e-05 2024-05-08T18:09:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035602+0000", 2024-05-08T18:09:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8496e-05 2024-05-08T18:09:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035728+0000", 2024-05-08T18:09:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012599200000000001 2024-05-08T18:09:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.036019+0000", 2024-05-08T18:09:45.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000290475 2024-05-08T18:09:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.036929+0000", 2024-05-08T18:09:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091045700000000004 2024-05-08T18:09:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.049721+0000", 2024-05-08T18:09:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012791360999999999 2024-05-08T18:09:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.052216+0000", 2024-05-08T18:09:45.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024957619999999999 2024-05-08T18:09:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.052350+0000", 2024-05-08T18:09:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013327799999999999 2024-05-08T18:09:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.052428+0000", 2024-05-08T18:09:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8524999999999998e-05 2024-05-08T18:09:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2166 3.1f 3:fb9a1743:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.eyqVZ0B-P5u9ACEPSRoUzw86bQPcrsX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.348722+0000", 2024-05-08T18:09:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.970001321, 2024-05-08T18:09:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020031361000000001, 2024-05-08T18:09:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2166 2024-05-08T18:09:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.348722+0000", 2024-05-08T18:09:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.348722+0000", 2024-05-08T18:09:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.348727+0000", 2024-05-08T18:09:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4959999999999998e-06 2024-05-08T18:09:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.351828+0000", 2024-05-08T18:09:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003101786 2024-05-08T18:09:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.351865+0000", 2024-05-08T18:09:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6519000000000001e-05 2024-05-08T18:09:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.351891+0000", 2024-05-08T18:09:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6233000000000001e-05 2024-05-08T18:09:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.352076+0000", 2024-05-08T18:09:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018498000000000001 2024-05-08T18:09:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.352511+0000", 2024-05-08T18:09:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043521899999999998 2024-05-08T18:09:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.352931+0000", 2024-05-08T18:09:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041997900000000001 2024-05-08T18:09:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.365888+0000", 2024-05-08T18:09:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012956578999999999 2024-05-08T18:09:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.368517+0000", 2024-05-08T18:09:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002629471 2024-05-08T18:09:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.368616+0000", 2024-05-08T18:09:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8740999999999995e-05 2024-05-08T18:09:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.368754+0000", 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137358 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2190 3.1 3:8364520c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.6cWLHpOdr1veoeL1lcBsJwZn6mj4f5g_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:32.004731+0000", 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.313992537000001, 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024468832999999999, 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.392 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2190 2024-05-08T18:09:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.004731+0000", 2024-05-08T18:09:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.004731+0000", 2024-05-08T18:09:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.004734+0000", 2024-05-08T18:09:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5299999999999999e-06 2024-05-08T18:09:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.006911+0000", 2024-05-08T18:09:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002177203 2024-05-08T18:09:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.006936+0000", 2024-05-08T18:09:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5772e-05 2024-05-08T18:09:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.006950+0000", 2024-05-08T18:09:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.397e-05 2024-05-08T18:09:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.007054+0000", 2024-05-08T18:09:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010354200000000001 2024-05-08T18:09:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.007233+0000", 2024-05-08T18:09:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017882600000000001 2024-05-08T18:09:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.007409+0000", 2024-05-08T18:09:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000176212 2024-05-08T18:09:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.020682+0000", 2024-05-08T18:09:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013272894 2024-05-08T18:09:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.029125+0000", 2024-05-08T18:09:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084428090000000008 2024-05-08T18:09:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.029167+0000", 2024-05-08T18:09:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2409e-05 2024-05-08T18:09:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.029200+0000", 2024-05-08T18:09:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2666000000000002e-05 2024-05-08T18:09:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2203 3.1 3:82cc66a1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.iRfSb7b_Mb9pWyJBdZSShCS0gvDvtAQ_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:32.309316+0000", 2024-05-08T18:09:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.009407541, 2024-05-08T18:09:45.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021097028, 2024-05-08T18:09:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2203 2024-05-08T18:09:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.309316+0000", 2024-05-08T18:09:45.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.309316+0000", 2024-05-08T18:09:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.309319+0000", 2024-05-08T18:09:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4000000000000001e-06 2024-05-08T18:09:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311275+0000", 2024-05-08T18:09:45.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019557720000000002 2024-05-08T18:09:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311313+0000", 2024-05-08T18:09:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8176000000000002e-05 2024-05-08T18:09:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311332+0000", 2024-05-08T18:09:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8986000000000001e-05 2024-05-08T18:09:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311414+0000", 2024-05-08T18:09:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1615999999999999e-05 2024-05-08T18:09:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311531+0000", 2024-05-08T18:09:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117379 2024-05-08T18:09:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311651+0000", 2024-05-08T18:09:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119938 2024-05-08T18:09:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.316731+0000", 2024-05-08T18:09:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050797459999999996 2024-05-08T18:09:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.330315+0000", 2024-05-08T18:09:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013584311999999999 2024-05-08T18:09:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.330370+0000", 2024-05-08T18:09:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5145000000000001e-05 2024-05-08T18:09:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.330413+0000", 2024-05-08T18:09:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2558000000000001e-05 2024-05-08T18:09:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2333 3.2b 3:d6cf7d4d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.tRy7Sv7BxoOoArPn6bd9wC4O5pse0_S_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:34.929579+0000", 2024-05-08T18:09:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.389144557, 2024-05-08T18:09:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020680451999999998, 2024-05-08T18:09:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.403 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2333 2024-05-08T18:09:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.929579+0000", 2024-05-08T18:09:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.929579+0000", 2024-05-08T18:09:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.929581+0000", 2024-05-08T18:09:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2170000000000001e-06 2024-05-08T18:09:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930432+0000", 2024-05-08T18:09:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000850733 2024-05-08T18:09:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930457+0000", 2024-05-08T18:09:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4953999999999999e-05 2024-05-08T18:09:45.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930468+0000", 2024-05-08T18:09:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:09:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930554+0000", 2024-05-08T18:09:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6224999999999995e-05 2024-05-08T18:09:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930684+0000", 2024-05-08T18:09:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013002599999999999 2024-05-08T18:09:45.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930799+0000", 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114677 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.936892+0000", 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0060934259999999999 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.950172+0000", 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013279783999999999 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.950220+0000", 2024-05-08T18:09:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7623999999999997e-05 2024-05-08T18:09:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.950259+0000", 2024-05-08T18:09:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.964e-05 2024-05-08T18:09:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2368 3.1b 3:dafb8647:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.o-lCHuSByDkvoT4LKUkRADgejSfQyJd_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:35.599786+0000", 2024-05-08T18:09:45.408 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.7189374649999998, 2024-05-08T18:09:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01993903, 2024-05-08T18:09:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2368 2024-05-08T18:09:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.599786+0000", 2024-05-08T18:09:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.599786+0000", 2024-05-08T18:09:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.599790+0000", 2024-05-08T18:09:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0759999999999996e-06 2024-05-08T18:09:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.601733+0000", 2024-05-08T18:09:45.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019429670000000001 2024-05-08T18:09:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.601787+0000", 2024-05-08T18:09:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4354999999999997e-05 2024-05-08T18:09:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.601815+0000", 2024-05-08T18:09:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7546999999999999e-05 2024-05-08T18:09:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.601924+0000", 2024-05-08T18:09:45.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010891300000000001 2024-05-08T18:09:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.602077+0000", 2024-05-08T18:09:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015319500000000001 2024-05-08T18:09:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.602204+0000", 2024-05-08T18:09:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127238 2024-05-08T18:09:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.614205+0000", 2024-05-08T18:09:45.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012000508 2024-05-08T18:09:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.619624+0000", 2024-05-08T18:09:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054195759999999997 2024-05-08T18:09:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.619667+0000", 2024-05-08T18:09:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2552000000000002e-05 2024-05-08T18:09:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.619725+0000", 2024-05-08T18:09:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8103000000000003e-05 2024-05-08T18:09:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2404 3.1 3:8218d405:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.bqgynIkQNaRvS-N0e0aQapo0Dh5XrQ2_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-05-08T18:09:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:36.285791+0000", 2024-05-08T18:09:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.0329327979999992, 2024-05-08T18:09:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023034451000000001, 2024-05-08T18:09:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.414 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2404 2024-05-08T18:09:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.285791+0000", 2024-05-08T18:09:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.285791+0000", 2024-05-08T18:09:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.285794+0000", 2024-05-08T18:09:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0290000000000001e-06 2024-05-08T18:09:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.287780+0000", 2024-05-08T18:09:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019862360000000002 2024-05-08T18:09:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.287815+0000", 2024-05-08T18:09:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5150000000000001e-05 2024-05-08T18:09:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.287830+0000", 2024-05-08T18:09:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4688000000000001e-05 2024-05-08T18:09:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.287909+0000", 2024-05-08T18:09:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9437999999999994e-05 2024-05-08T18:09:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.288035+0000", 2024-05-08T18:09:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012566899999999999 2024-05-08T18:09:45.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.288141+0000", 2024-05-08T18:09:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106463 2024-05-08T18:09:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.296390+0000", 2024-05-08T18:09:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008248488 2024-05-08T18:09:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.308672+0000", 2024-05-08T18:09:45.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012282039 2024-05-08T18:09:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.308760+0000", 2024-05-08T18:09:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8350999999999995e-05 2024-05-08T18:09:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.308825+0000", 2024-05-08T18:09:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4900000000000005e-05 2024-05-08T18:09:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.419 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.420 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.420 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:45.421 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:09:45.421 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:45.420+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:45.521 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:45.528+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:45.597 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:45.597 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:45.597 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:45.597 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:45.611 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:09:45.622 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:45.620+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:45.722 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:45.720+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:45.767 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:45.768 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:45.768 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:45.768 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:45.768 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:45.781 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:09:45.825 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:45.832+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:45.898 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:45.898 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:45.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:45.898 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:45.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.898 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1190 3.31 3:8c795880:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:45.898 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:06.973959+0000", 2024-05-08T18:09:45.898 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.927612793999998, 2024-05-08T18:09:45.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025546121000000001, 2024-05-08T18:09:45.899 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.899 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.899 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.899 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.899 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.899 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.899 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1190 2024-05-08T18:09:45.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.899 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.973959+0000", 2024-05-08T18:09:45.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.973959+0000", 2024-05-08T18:09:45.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.973961+0000", 2024-05-08T18:09:45.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6740000000000001e-06 2024-05-08T18:09:45.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.976932+0000", 2024-05-08T18:09:45.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002971062 2024-05-08T18:09:45.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.976957+0000", 2024-05-08T18:09:45.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4865999999999999e-05 2024-05-08T18:09:45.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.976969+0000", 2024-05-08T18:09:45.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1419e-05 2024-05-08T18:09:45.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.977041+0000", 2024-05-08T18:09:45.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2389000000000001e-05 2024-05-08T18:09:45.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.977198+0000", 2024-05-08T18:09:45.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015675800000000001 2024-05-08T18:09:45.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:45.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.977368+0000", 2024-05-08T18:09:45.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017024299999999999 2024-05-08T18:09:45.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.989016+0000", 2024-05-08T18:09:45.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011647719000000001 2024-05-08T18:09:45.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.999371+0000", 2024-05-08T18:09:45.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010354942000000001 2024-05-08T18:09:45.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.999441+0000", 2024-05-08T18:09:45.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0166000000000005e-05 2024-05-08T18:09:45.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.999505+0000", 2024-05-08T18:09:45.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3882999999999998e-05 2024-05-08T18:09:45.903 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.903 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.904 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.904 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1192 3.1e 3:7833f47f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:45.904 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:06.995724+0000", 2024-05-08T18:09:45.904 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.905847641999998, 2024-05-08T18:09:45.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019501026000000001, 2024-05-08T18:09:45.904 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.904 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.904 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.904 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.904 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.904 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.904 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1192 2024-05-08T18:09:45.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.905 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.995724+0000", 2024-05-08T18:09:45.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.995724+0000", 2024-05-08T18:09:45.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.995727+0000", 2024-05-08T18:09:45.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5449999999999999e-06 2024-05-08T18:09:45.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997495+0000", 2024-05-08T18:09:45.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001768167 2024-05-08T18:09:45.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997520+0000", 2024-05-08T18:09:45.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4672e-05 2024-05-08T18:09:45.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997541+0000", 2024-05-08T18:09:45.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1022e-05 2024-05-08T18:09:45.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997626+0000", 2024-05-08T18:09:45.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5096e-05 2024-05-08T18:09:45.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997751+0000", 2024-05-08T18:09:45.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012461500000000001 2024-05-08T18:09:45.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:45.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997853+0000", 2024-05-08T18:09:45.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010228199999999999 2024-05-08T18:09:45.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.005501+0000", 2024-05-08T18:09:45.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076478550000000003 2024-05-08T18:09:45.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.014958+0000", 2024-05-08T18:09:45.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0094574370000000008 2024-05-08T18:09:45.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.015084+0000", 2024-05-08T18:09:45.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125105 2024-05-08T18:09:45.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.015225+0000", 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014123 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1203 3.1a e85/20 3:592e440d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_15:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.119764+0000", 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.781807096999998, 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016393982000000001, 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.909 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.119764+0000", 2024-05-08T18:09:45.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.119764+0000", 2024-05-08T18:09:45.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.119766+0000", 2024-05-08T18:09:45.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9750000000000001e-06 2024-05-08T18:09:45.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.124838+0000", 2024-05-08T18:09:45.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050712480000000004 2024-05-08T18:09:45.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.124870+0000", 2024-05-08T18:09:45.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2974e-05 2024-05-08T18:09:45.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.124884+0000", 2024-05-08T18:09:45.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3202e-05 2024-05-08T18:09:45.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.124992+0000", 2024-05-08T18:09:45.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108199 2024-05-08T18:09:45.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.125028+0000", 2024-05-08T18:09:45.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6050000000000002e-05 2024-05-08T18:09:45.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.136085+0000", 2024-05-08T18:09:45.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011057320000000001 2024-05-08T18:09:45.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.136158+0000", 2024-05-08T18:09:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3014000000000003e-05 2024-05-08T18:09:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1227 3.6 e85/20 3:6359f987:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_11:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.688168+0000", 2024-05-08T18:09:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.213402950999999, 2024-05-08T18:09:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018452023000000001, 2024-05-08T18:09:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.913 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.914 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.688168+0000", 2024-05-08T18:09:45.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.688168+0000", 2024-05-08T18:09:45.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.688170+0000", 2024-05-08T18:09:45.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6330000000000001e-06 2024-05-08T18:09:45.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.691987+0000", 2024-05-08T18:09:45.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003817076 2024-05-08T18:09:45.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.692031+0000", 2024-05-08T18:09:45.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3509e-05 2024-05-08T18:09:45.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.692054+0000", 2024-05-08T18:09:45.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3419999999999999e-05 2024-05-08T18:09:45.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.692204+0000", 2024-05-08T18:09:45.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015017900000000001 2024-05-08T18:09:45.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.692272+0000", 2024-05-08T18:09:45.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7410999999999995e-05 2024-05-08T18:09:45.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706582+0000", 2024-05-08T18:09:45.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014310671000000001 2024-05-08T18:09:45.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706620+0000", 2024-05-08T18:09:45.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8124000000000003e-05 2024-05-08T18:09:45.917 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.917 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.917 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.917 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1246 3.6 e85/20 3:6220dfe7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_2:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:45.917 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.364093+0000", 2024-05-08T18:09:45.917 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.537478651000001, 2024-05-08T18:09:45.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016480529000000001, 2024-05-08T18:09:45.917 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.917 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.918 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.918 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.364093+0000", 2024-05-08T18:09:45.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.364093+0000", 2024-05-08T18:09:45.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.364095+0000", 2024-05-08T18:09:45.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1789999999999998e-06 2024-05-08T18:09:45.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.366818+0000", 2024-05-08T18:09:45.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027231270000000001 2024-05-08T18:09:45.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.366852+0000", 2024-05-08T18:09:45.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4106999999999997e-05 2024-05-08T18:09:45.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.366867+0000", 2024-05-08T18:09:45.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4715000000000001e-05 2024-05-08T18:09:45.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.366955+0000", 2024-05-08T18:09:45.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8398000000000003e-05 2024-05-08T18:09:45.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.366986+0000", 2024-05-08T18:09:45.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0433000000000002e-05 2024-05-08T18:09:45.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380506+0000", 2024-05-08T18:09:45.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013520628999999999 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380573+0000", 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6940999999999995e-05 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1257 3.31 3:8ed6384b:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.507760+0000", 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.393811497999998, 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017518249999999999, 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.921 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1257 2024-05-08T18:09:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507760+0000", 2024-05-08T18:09:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507760+0000", 2024-05-08T18:09:45.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507764+0000", 2024-05-08T18:09:45.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7069999999999998e-06 2024-05-08T18:09:45.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510115+0000", 2024-05-08T18:09:45.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023510150000000001 2024-05-08T18:09:45.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510152+0000", 2024-05-08T18:09:45.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7234000000000003e-05 2024-05-08T18:09:45.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510168+0000", 2024-05-08T18:09:45.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5764e-05 2024-05-08T18:09:45.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510264+0000", 2024-05-08T18:09:45.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6362999999999999e-05 2024-05-08T18:09:45.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510466+0000", 2024-05-08T18:09:45.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020249999999999999 2024-05-08T18:09:45.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:45.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510644+0000", 2024-05-08T18:09:45.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017767299999999999 2024-05-08T18:09:45.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.516056+0000", 2024-05-08T18:09:45.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054117770000000004 2024-05-08T18:09:45.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.525154+0000", 2024-05-08T18:09:45.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090977999999999996 2024-05-08T18:09:45.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.525224+0000", 2024-05-08T18:09:45.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0204999999999996e-05 2024-05-08T18:09:45.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.525278+0000", 2024-05-08T18:09:45.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4212000000000002e-05 2024-05-08T18:09:45.926 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.926 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.926 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.926 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1266 3.4 3:21e00898:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:45.926 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.610411+0000", 2024-05-08T18:09:45.927 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.291160791999999, 2024-05-08T18:09:45.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017041107999999999, 2024-05-08T18:09:45.927 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.927 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.927 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.927 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.927 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.927 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.927 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1266 2024-05-08T18:09:45.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.927 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.610411+0000", 2024-05-08T18:09:45.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.610411+0000", 2024-05-08T18:09:45.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.610414+0000", 2024-05-08T18:09:45.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.732e-06 2024-05-08T18:09:45.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.612834+0000", 2024-05-08T18:09:45.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024191949999999999 2024-05-08T18:09:45.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.612866+0000", 2024-05-08T18:09:45.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2271999999999999e-05 2024-05-08T18:09:45.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.612880+0000", 2024-05-08T18:09:45.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4202000000000001e-05 2024-05-08T18:09:45.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.612987+0000", 2024-05-08T18:09:45.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106661 2024-05-08T18:09:45.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.613152+0000", 2024-05-08T18:09:45.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016484900000000001 2024-05-08T18:09:45.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:45.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.613303+0000", 2024-05-08T18:09:45.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151509 2024-05-08T18:09:45.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.622289+0000", 2024-05-08T18:09:45.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089858160000000006 2024-05-08T18:09:45.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.627348+0000", 2024-05-08T18:09:45.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005059638 2024-05-08T18:09:45.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.627401+0000", 2024-05-08T18:09:45.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2191999999999998e-05 2024-05-08T18:09:45.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.627452+0000", 2024-05-08T18:09:45.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1041999999999997e-05 2024-05-08T18:09:45.931 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.931 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1284 3.1e 3:7ad9fe5d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:09.185629+0000", 2024-05-08T18:09:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.715942116000001, 2024-05-08T18:09:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.029384772999999999, 2024-05-08T18:09:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1284 2024-05-08T18:09:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.185629+0000", 2024-05-08T18:09:45.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.185629+0000", 2024-05-08T18:09:45.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.185633+0000", 2024-05-08T18:09:45.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6030000000000001e-06 2024-05-08T18:09:45.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.188065+0000", 2024-05-08T18:09:45.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002431768 2024-05-08T18:09:45.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.188092+0000", 2024-05-08T18:09:45.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7849999999999999e-05 2024-05-08T18:09:45.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.188106+0000", 2024-05-08T18:09:45.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3977e-05 2024-05-08T18:09:45.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.188207+0000", 2024-05-08T18:09:45.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010083 2024-05-08T18:09:45.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:09:45.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.188218+0000", 2024-05-08T18:09:45.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0954999999999999e-05 2024-05-08T18:09:45.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.198300+0000", 2024-05-08T18:09:45.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010081543 2024-05-08T18:09:45.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.198481+0000", 2024-05-08T18:09:45.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018105399999999999 2024-05-08T18:09:45.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:45.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.198658+0000", 2024-05-08T18:09:45.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017734599999999999 2024-05-08T18:09:45.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.206728+0000", 2024-05-08T18:09:45.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0080693320000000002 2024-05-08T18:09:45.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.214880+0000", 2024-05-08T18:09:45.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008152767 2024-05-08T18:09:45.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.214957+0000", 2024-05-08T18:09:45.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6230999999999996e-05 2024-05-08T18:09:45.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.215014+0000", 2024-05-08T18:09:45.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7516999999999998e-05 2024-05-08T18:09:45.937 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.937 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.937 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.938 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1396 3.0 3:01138f2d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:45.938 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.783501+0000", 2024-05-08T18:09:45.938 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.118070830000001, 2024-05-08T18:09:45.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021225469, 2024-05-08T18:09:45.938 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.938 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.938 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.938 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.938 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.938 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.938 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1396 2024-05-08T18:09:45.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.938 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.783501+0000", 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.783501+0000", 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.783503+0000", 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6639999999999998e-06 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.785066+0000", 2024-05-08T18:09:45.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015625389999999999 2024-05-08T18:09:45.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.785088+0000", 2024-05-08T18:09:45.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2538e-05 2024-05-08T18:09:45.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.785101+0000", 2024-05-08T18:09:45.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2274e-05 2024-05-08T18:09:45.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.785191+0000", 2024-05-08T18:09:45.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9992000000000002e-05 2024-05-08T18:09:45.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:09:45.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.785199+0000", 2024-05-08T18:09:45.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6270000000000006e-06 2024-05-08T18:09:45.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.787346+0000", 2024-05-08T18:09:45.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002146677 2024-05-08T18:09:45.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.787499+0000", 2024-05-08T18:09:45.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000153523 2024-05-08T18:09:45.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:45.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.787648+0000", 2024-05-08T18:09:45.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014867999999999999 2024-05-08T18:09:45.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.796686+0000", 2024-05-08T18:09:45.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090379859999999996 2024-05-08T18:09:45.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.804546+0000", 2024-05-08T18:09:45.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0078594770000000001 2024-05-08T18:09:45.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.804645+0000", 2024-05-08T18:09:45.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9269000000000001e-05 2024-05-08T18:09:45.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.804726+0000", 2024-05-08T18:09:45.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1223000000000005e-05 2024-05-08T18:09:45.943 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.943 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.943 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.944 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1454 3.1a e87/20 3:5820ba98:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_4:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:45.944 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.374062+0000", 2024-05-08T18:09:45.944 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.527509418000001, 2024-05-08T18:09:45.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024401293000000001, 2024-05-08T18:09:45.944 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.944 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.944 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.944 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.374062+0000", 2024-05-08T18:09:45.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.374062+0000", 2024-05-08T18:09:45.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.374065+0000", 2024-05-08T18:09:45.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.05e-06 2024-05-08T18:09:45.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.380308+0000", 2024-05-08T18:09:45.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062425099999999997 2024-05-08T18:09:45.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.380346+0000", 2024-05-08T18:09:45.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8679e-05 2024-05-08T18:09:45.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.380364+0000", 2024-05-08T18:09:45.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7897000000000002e-05 2024-05-08T18:09:45.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.380531+0000", 2024-05-08T18:09:45.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016653499999999999 2024-05-08T18:09:45.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.380624+0000", 2024-05-08T18:09:45.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3189000000000005e-05 2024-05-08T18:09:45.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.398276+0000", 2024-05-08T18:09:45.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017652151000000001 2024-05-08T18:09:45.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.398463+0000", 2024-05-08T18:09:45.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018728199999999999 2024-05-08T18:09:45.947 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.947 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.947 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.947 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1459 3.25 3:a5b1b07d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:45.947 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.475662+0000", 2024-05-08T18:09:45.948 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.425909234000002, 2024-05-08T18:09:45.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026407317, 2024-05-08T18:09:45.948 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.948 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.948 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.948 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.948 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.948 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.948 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1459 2024-05-08T18:09:45.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.948 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.475662+0000", 2024-05-08T18:09:45.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.475662+0000", 2024-05-08T18:09:45.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.475666+0000", 2024-05-08T18:09:45.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.206e-06 2024-05-08T18:09:45.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481021+0000", 2024-05-08T18:09:45.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005354981 2024-05-08T18:09:45.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481069+0000", 2024-05-08T18:09:45.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7722000000000002e-05 2024-05-08T18:09:45.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481096+0000", 2024-05-08T18:09:45.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6737000000000002e-05 2024-05-08T18:09:45.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481275+0000", 2024-05-08T18:09:45.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000178806 2024-05-08T18:09:45.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481544+0000", 2024-05-08T18:09:45.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026962399999999999 2024-05-08T18:09:45.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:45.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481794+0000", 2024-05-08T18:09:45.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024961200000000002 2024-05-08T18:09:45.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.490808+0000", 2024-05-08T18:09:45.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090146419999999998 2024-05-08T18:09:45.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.501769+0000", 2024-05-08T18:09:45.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010960437 2024-05-08T18:09:45.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.501939+0000", 2024-05-08T18:09:45.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169915 2024-05-08T18:09:45.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.502069+0000", 2024-05-08T18:09:45.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013063500000000001 2024-05-08T18:09:45.953 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.953 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.953 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.953 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1922 3.4 3:22938f7c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.23:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:45.953 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.257795+0000", 2024-05-08T18:09:45.953 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.643776216999999, 2024-05-08T18:09:45.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022203639000000001, 2024-05-08T18:09:45.953 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.953 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.953 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.954 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.954 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.954 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.954 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1922 2024-05-08T18:09:45.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.954 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.257795+0000", 2024-05-08T18:09:45.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.257795+0000", 2024-05-08T18:09:45.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.257798+0000", 2024-05-08T18:09:45.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7640000000000001e-06 2024-05-08T18:09:45.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.261913+0000", 2024-05-08T18:09:45.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041147900000000001 2024-05-08T18:09:45.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.261954+0000", 2024-05-08T18:09:45.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1551999999999998e-05 2024-05-08T18:09:45.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.261980+0000", 2024-05-08T18:09:45.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5692999999999999e-05 2024-05-08T18:09:45.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.262169+0000", 2024-05-08T18:09:45.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018944200000000001 2024-05-08T18:09:45.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.262428+0000", 2024-05-08T18:09:45.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000258807 2024-05-08T18:09:45.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:45.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.263242+0000", 2024-05-08T18:09:45.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081388000000000001 2024-05-08T18:09:45.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.276171+0000", 2024-05-08T18:09:45.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012928822 2024-05-08T18:09:45.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.279811+0000", 2024-05-08T18:09:45.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003640192 2024-05-08T18:09:45.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.279923+0000", 2024-05-08T18:09:45.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112111 2024-05-08T18:09:45.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.279999+0000", 2024-05-08T18:09:45.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5586000000000004e-05 2024-05-08T18:09:45.958 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.959 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.959 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.959 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1925 3.1e 3:7b22772f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.f9IQ_hbLdIRU4qgZOuIL42noK1mqHg9_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:45.959 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.378495+0000", 2024-05-08T18:09:45.959 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.523076770999999, 2024-05-08T18:09:45.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020602933, 2024-05-08T18:09:45.959 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.959 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.959 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.959 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.959 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.959 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.959 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1925 2024-05-08T18:09:45.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.960 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.378495+0000", 2024-05-08T18:09:45.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.378495+0000", 2024-05-08T18:09:45.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.378499+0000", 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9469999999999996e-06 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381093+0000", 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025949129999999999 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381142+0000", 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8123e-05 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381170+0000", 2024-05-08T18:09:45.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7996000000000001e-05 2024-05-08T18:09:45.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381318+0000", 2024-05-08T18:09:45.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014873100000000001 2024-05-08T18:09:45.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381588+0000", 2024-05-08T18:09:45.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026920900000000002 2024-05-08T18:09:45.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:45.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381814+0000", 2024-05-08T18:09:45.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000226412 2024-05-08T18:09:45.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.392475+0000", 2024-05-08T18:09:45.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010661547 2024-05-08T18:09:45.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.398954+0000", 2024-05-08T18:09:45.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006478658 2024-05-08T18:09:45.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.399036+0000", 2024-05-08T18:09:45.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2300999999999997e-05 2024-05-08T18:09:45.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.399098+0000", 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1095999999999999e-05 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1960 3.0 3:02610446:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.29:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:27.095423+0000", 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.806148601, 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023746634999999999, 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.964 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.965 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.965 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.965 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1960 2024-05-08T18:09:45.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.965 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.095423+0000", 2024-05-08T18:09:45.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.095423+0000", 2024-05-08T18:09:45.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.095426+0000", 2024-05-08T18:09:45.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9569999999999998e-06 2024-05-08T18:09:45.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.097717+0000", 2024-05-08T18:09:45.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022911160000000002 2024-05-08T18:09:45.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.097759+0000", 2024-05-08T18:09:45.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2178999999999997e-05 2024-05-08T18:09:45.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.097777+0000", 2024-05-08T18:09:45.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8255999999999999e-05 2024-05-08T18:09:45.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.097926+0000", 2024-05-08T18:09:45.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014899100000000001 2024-05-08T18:09:45.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.098285+0000", 2024-05-08T18:09:45.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035904099999999999 2024-05-08T18:09:45.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:45.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.099249+0000", 2024-05-08T18:09:45.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00096372000000000005 2024-05-08T18:09:45.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.109626+0000", 2024-05-08T18:09:45.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010376849 2024-05-08T18:09:45.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.118973+0000", 2024-05-08T18:09:45.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0093474160000000008 2024-05-08T18:09:45.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.119093+0000", 2024-05-08T18:09:45.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119615 2024-05-08T18:09:45.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.119169+0000", 2024-05-08T18:09:45.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6495000000000005e-05 2024-05-08T18:09:45.969 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.969 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.969 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.969 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1966 3.25 3:a7ea9643:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.30:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:45.970 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:27.248331+0000", 2024-05-08T18:09:45.970 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.653240365999999, 2024-05-08T18:09:45.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018780688, 2024-05-08T18:09:45.970 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.970 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.970 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.970 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.970 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.970 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.970 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1966 2024-05-08T18:09:45.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.970 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.248331+0000", 2024-05-08T18:09:45.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.248331+0000", 2024-05-08T18:09:45.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.248334+0000", 2024-05-08T18:09:45.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4839999999999998e-06 2024-05-08T18:09:45.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.250557+0000", 2024-05-08T18:09:45.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022238319999999998 2024-05-08T18:09:45.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.250588+0000", 2024-05-08T18:09:45.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1041999999999999e-05 2024-05-08T18:09:45.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.250601+0000", 2024-05-08T18:09:45.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2928999999999999e-05 2024-05-08T18:09:45.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.250695+0000", 2024-05-08T18:09:45.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4011999999999994e-05 2024-05-08T18:09:45.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.250854+0000", 2024-05-08T18:09:45.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015883600000000001 2024-05-08T18:09:45.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:45.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.251385+0000", 2024-05-08T18:09:45.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053124200000000002 2024-05-08T18:09:45.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.265113+0000", 2024-05-08T18:09:45.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013727614000000001 2024-05-08T18:09:45.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.266991+0000", 2024-05-08T18:09:45.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001878275 2024-05-08T18:09:45.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.267051+0000", 2024-05-08T18:09:45.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9363000000000001e-05 2024-05-08T18:09:45.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.267112+0000", 2024-05-08T18:09:45.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1058999999999999e-05 2024-05-08T18:09:45.975 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.975 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.975 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.975 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2136 3.3e 3:7e6feb55:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.HfAxvQBa5Hc-UtPiYKXpRY3njm6jIb-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:45.975 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.563178+0000", 2024-05-08T18:09:45.975 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.338393809999999, 2024-05-08T18:09:45.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024664469000000001, 2024-05-08T18:09:45.975 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.975 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.975 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.975 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.975 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2136 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.563178+0000", 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.563178+0000", 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.563181+0000", 2024-05-08T18:09:45.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.676e-06 2024-05-08T18:09:45.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.565700+0000", 2024-05-08T18:09:45.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025191860000000001 2024-05-08T18:09:45.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.565745+0000", 2024-05-08T18:09:45.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4438999999999999e-05 2024-05-08T18:09:45.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.565766+0000", 2024-05-08T18:09:45.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0905999999999999e-05 2024-05-08T18:09:45.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.565934+0000", 2024-05-08T18:09:45.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016784699999999999 2024-05-08T18:09:45.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.566337+0000", 2024-05-08T18:09:45.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040316700000000001 2024-05-08T18:09:45.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:45.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.566743+0000", 2024-05-08T18:09:45.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040581900000000003 2024-05-08T18:09:45.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.584555+0000", 2024-05-08T18:09:45.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017812093000000001 2024-05-08T18:09:45.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.587652+0000", 2024-05-08T18:09:45.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00309706 2024-05-08T18:09:45.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.587774+0000", 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012271499999999999 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.587842+0000", 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7560999999999999e-05 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2142 3.1e 3:7b76bf40:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.dbl7KmEpihzAmy1_6tIHfaLaiCXT2yc_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.723193+0000", 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.178378324000001, 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018688923, 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.980 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.981 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.981 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.981 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.981 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.981 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2142 2024-05-08T18:09:45.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.981 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.723193+0000", 2024-05-08T18:09:45.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.723193+0000", 2024-05-08T18:09:45.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.723197+0000", 2024-05-08T18:09:45.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8600000000000003e-06 2024-05-08T18:09:45.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.726285+0000", 2024-05-08T18:09:45.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030876480000000001 2024-05-08T18:09:45.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.726331+0000", 2024-05-08T18:09:45.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6903000000000001e-05 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.726351+0000", 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9769999999999999e-05 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.726487+0000", 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013600400000000001 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.726752+0000", 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026510200000000002 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:45.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.727027+0000", 2024-05-08T18:09:45.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027441199999999997 2024-05-08T18:09:45.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.736805+0000", 2024-05-08T18:09:45.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0097778540000000008 2024-05-08T18:09:45.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.741782+0000", 2024-05-08T18:09:45.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049770989999999996 2024-05-08T18:09:45.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.741837+0000", 2024-05-08T18:09:45.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5671999999999998e-05 2024-05-08T18:09:45.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.741882+0000", 2024-05-08T18:09:45.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4598999999999998e-05 2024-05-08T18:09:45.985 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.985 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.985 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.985 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:2181 3.8 e93/20 3:12ff5737:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.64:head v 93'9, mlcod=87'7)", 2024-05-08T18:09:45.985 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.752726+0000", 2024-05-08T18:09:45.985 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.148845133, 2024-05-08T18:09:45.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017928070000000001, 2024-05-08T18:09:45.986 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.986 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.986 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.986 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.752726+0000", 2024-05-08T18:09:45.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.752726+0000", 2024-05-08T18:09:45.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.752728+0000", 2024-05-08T18:09:45.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6479999999999999e-06 2024-05-08T18:09:45.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.755318+0000", 2024-05-08T18:09:45.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025904470000000001 2024-05-08T18:09:45.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.755348+0000", 2024-05-08T18:09:45.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0012999999999999e-05 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.755366+0000", 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7634000000000001e-05 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.755466+0000", 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9993000000000003e-05 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.755502+0000", 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6078000000000003e-05 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.770536+0000", 2024-05-08T18:09:45.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015033786 2024-05-08T18:09:45.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.770654+0000", 2024-05-08T18:09:45.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118471 2024-05-08T18:09:45.989 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.989 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.989 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.989 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2184 3.4 3:22f35135:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.6RUONhXxP9eF42Kebi9zd8ZJKTDUTd3_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:45.989 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.864429+0000", 2024-05-08T18:09:45.990 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.037142832000001, 2024-05-08T18:09:45.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019853949999999999, 2024-05-08T18:09:45.990 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.990 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.990 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.990 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.990 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.990 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.990 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2184 2024-05-08T18:09:45.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.990 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.864429+0000", 2024-05-08T18:09:45.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.864429+0000", 2024-05-08T18:09:45.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.864431+0000", 2024-05-08T18:09:45.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6819999999999999e-06 2024-05-08T18:09:45.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866285+0000", 2024-05-08T18:09:45.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001853941 2024-05-08T18:09:45.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866316+0000", 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1186999999999998e-05 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866331+0000", 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4956999999999999e-05 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866416+0000", 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4882000000000005e-05 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866610+0000", 2024-05-08T18:09:45.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019346700000000001 2024-05-08T18:09:45.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:45.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866803+0000", 2024-05-08T18:09:45.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019362099999999999 2024-05-08T18:09:45.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.884053+0000", 2024-05-08T18:09:45.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017250168 2024-05-08T18:09:45.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.884145+0000", 2024-05-08T18:09:45.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1782999999999999e-05 2024-05-08T18:09:45.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.884204+0000", 2024-05-08T18:09:45.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8511000000000003e-05 2024-05-08T18:09:45.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:45.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.884283+0000", 2024-05-08T18:09:45.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8751000000000005e-05 2024-05-08T18:09:45.994 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.994 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:45.994 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:45.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.995 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2365 3.31 3:8db5ccf0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.93:head [create,setxattr user.rgw.idtag (61) in=14b,setxattr user.rgw.tail_tag (61) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:45.995 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:35.496834+0000", 2024-05-08T18:09:45.995 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.404736908, 2024-05-08T18:09:45.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019483308000000001, 2024-05-08T18:09:45.995 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:45.995 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:45.995 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:45.995 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:45.995 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:45.995 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:45.995 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2365 2024-05-08T18:09:45.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.995 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:45.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:45.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.496834+0000", 2024-05-08T18:09:45.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:45.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.496834+0000", 2024-05-08T18:09:45.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:45.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:45.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.496836+0000", 2024-05-08T18:09:45.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.265e-06 2024-05-08T18:09:45.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:45.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499074+0000", 2024-05-08T18:09:45.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002237789 2024-05-08T18:09:45.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:45.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499101+0000", 2024-05-08T18:09:45.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7251e-05 2024-05-08T18:09:45.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:45.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499112+0000", 2024-05-08T18:09:45.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.135e-05 2024-05-08T18:09:45.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:45.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499189+0000", 2024-05-08T18:09:45.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6567000000000001e-05 2024-05-08T18:09:45.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:45.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499364+0000", 2024-05-08T18:09:45.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017557200000000001 2024-05-08T18:09:45.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:45.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499845+0000", 2024-05-08T18:09:45.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000480292 2024-05-08T18:09:45.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:45.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.515138+0000", 2024-05-08T18:09:45.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01529324 2024-05-08T18:09:45.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:45.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.516091+0000", 2024-05-08T18:09:45.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00095270100000000003 2024-05-08T18:09:45.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:45.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:45.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:45.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.516218+0000", 2024-05-08T18:09:45.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012745700000000001 2024-05-08T18:09:45.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.516318+0000", 2024-05-08T18:09:46.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9823999999999998e-05 2024-05-08T18:09:46.000 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.000 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.000 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.000 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.000 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.000 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:46.001 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:09:46.002 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:46.000+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:46.102 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:46.104+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:46.176 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:46.176 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:46.176 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:46.176 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:46.189 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:09:46.234 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:46.240+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:46.303 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:46.304 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:46.304 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:46.304 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:46.304 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:46.304 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:46.308+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:46.317 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:09:46.405 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:46.404+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:46.430 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:09:46.478 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:46.478 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:46.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:46.478 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:46.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.478 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1197 3.2e 3:760a6639:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:46.478 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.051025+0000", 2024-05-08T18:09:46.478 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.430515104000001, 2024-05-08T18:09:46.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021808514000000001, 2024-05-08T18:09:46.478 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.478 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.478 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.479 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.479 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.479 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.479 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1197 2024-05-08T18:09:46.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.479 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.051025+0000", 2024-05-08T18:09:46.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.051025+0000", 2024-05-08T18:09:46.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.051028+0000", 2024-05-08T18:09:46.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2839999999999998e-06 2024-05-08T18:09:46.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.054428+0000", 2024-05-08T18:09:46.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033998449999999999 2024-05-08T18:09:46.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.054454+0000", 2024-05-08T18:09:46.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5800999999999999e-05 2024-05-08T18:09:46.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.054468+0000", 2024-05-08T18:09:46.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4222999999999999e-05 2024-05-08T18:09:46.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.054550+0000", 2024-05-08T18:09:46.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2702999999999997e-05 2024-05-08T18:09:46.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.054736+0000", 2024-05-08T18:09:46.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018505099999999999 2024-05-08T18:09:46.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:46.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.054910+0000", 2024-05-08T18:09:46.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017438999999999999 2024-05-08T18:09:46.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.064167+0000", 2024-05-08T18:09:46.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0092570510000000005 2024-05-08T18:09:46.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.072684+0000", 2024-05-08T18:09:46.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085174129999999997 2024-05-08T18:09:46.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.072764+0000", 2024-05-08T18:09:46.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9104999999999996e-05 2024-05-08T18:09:46.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.072833+0000", 2024-05-08T18:09:46.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9647999999999995e-05 2024-05-08T18:09:46.483 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.483 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.483 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.483 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1201 3.f 3:f0c9f301:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:46.484 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.093741+0000", 2024-05-08T18:09:46.484 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.387799088000001, 2024-05-08T18:09:46.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019020305000000001, 2024-05-08T18:09:46.484 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.484 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.484 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.484 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.484 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.484 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.484 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1201 2024-05-08T18:09:46.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.484 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.093741+0000", 2024-05-08T18:09:46.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.093741+0000", 2024-05-08T18:09:46.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.093744+0000", 2024-05-08T18:09:46.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9299999999999999e-06 2024-05-08T18:09:46.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.095182+0000", 2024-05-08T18:09:46.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014389030000000001 2024-05-08T18:09:46.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.095215+0000", 2024-05-08T18:09:46.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2783000000000001e-05 2024-05-08T18:09:46.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.095230+0000", 2024-05-08T18:09:46.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4986e-05 2024-05-08T18:09:46.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.095337+0000", 2024-05-08T18:09:46.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010696600000000001 2024-05-08T18:09:46.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.095493+0000", 2024-05-08T18:09:46.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015615299999999999 2024-05-08T18:09:46.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:46.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.095647+0000", 2024-05-08T18:09:46.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015379 2024-05-08T18:09:46.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.102582+0000", 2024-05-08T18:09:46.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0069345029999999998 2024-05-08T18:09:46.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.112643+0000", 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010061439 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.112708+0000", 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4890999999999999e-05 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.112761+0000", 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2961000000000003e-05 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.489 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1204 3.2e 3:748aabc2:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:46.489 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.123555+0000", 2024-05-08T18:09:46.489 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.357984403000003, 2024-05-08T18:09:46.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018601724, 2024-05-08T18:09:46.489 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.489 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.489 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.489 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.489 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.489 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.489 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1204 2024-05-08T18:09:46.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.489 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.123555+0000", 2024-05-08T18:09:46.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.123555+0000", 2024-05-08T18:09:46.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.123558+0000", 2024-05-08T18:09:46.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:09:46.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.125312+0000", 2024-05-08T18:09:46.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001753526 2024-05-08T18:09:46.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.125334+0000", 2024-05-08T18:09:46.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2700999999999998e-05 2024-05-08T18:09:46.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.125346+0000", 2024-05-08T18:09:46.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2054e-05 2024-05-08T18:09:46.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.125434+0000", 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7307999999999998e-05 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.125621+0000", 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018727899999999999 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.125792+0000", 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017101599999999999 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.136124+0000", 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010331633999999999 2024-05-08T18:09:46.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.142030+0000", 2024-05-08T18:09:46.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059065899999999998 2024-05-08T18:09:46.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.142104+0000", 2024-05-08T18:09:46.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3370999999999999e-05 2024-05-08T18:09:46.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.142157+0000", 2024-05-08T18:09:46.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3538000000000001e-05 2024-05-08T18:09:46.493 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.494 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.494 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.494 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1223 3.2e 3:74a5b043:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:46.494 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.619449+0000", 2024-05-08T18:09:46.494 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.862090950999999, 2024-05-08T18:09:46.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022896092, 2024-05-08T18:09:46.494 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.494 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.494 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.494 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.494 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.494 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.494 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1223 2024-05-08T18:09:46.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.495 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.619449+0000", 2024-05-08T18:09:46.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.619449+0000", 2024-05-08T18:09:46.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.619452+0000", 2024-05-08T18:09:46.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0139999999999999e-06 2024-05-08T18:09:46.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.623169+0000", 2024-05-08T18:09:46.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037173620000000001 2024-05-08T18:09:46.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.623198+0000", 2024-05-08T18:09:46.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8436e-05 2024-05-08T18:09:46.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.623212+0000", 2024-05-08T18:09:46.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4375999999999999e-05 2024-05-08T18:09:46.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.623288+0000", 2024-05-08T18:09:46.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5548000000000002e-05 2024-05-08T18:09:46.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.623403+0000", 2024-05-08T18:09:46.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115369 2024-05-08T18:09:46.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:46.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.623502+0000", 2024-05-08T18:09:46.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9420999999999996e-05 2024-05-08T18:09:46.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.630872+0000", 2024-05-08T18:09:46.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00736997 2024-05-08T18:09:46.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.642200+0000", 2024-05-08T18:09:46.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011327802999999999 2024-05-08T18:09:46.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.642266+0000", 2024-05-08T18:09:46.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6223000000000006e-05 2024-05-08T18:09:46.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.642345+0000", 2024-05-08T18:09:46.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8570000000000002e-05 2024-05-08T18:09:46.499 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.499 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.499 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.499 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1225 3.2a 3:5632ffeb:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:46.499 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.662322+0000", 2024-05-08T18:09:46.499 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.819218036000002, 2024-05-08T18:09:46.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019646277, 2024-05-08T18:09:46.499 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.499 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.500 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.500 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.500 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.500 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.500 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1225 2024-05-08T18:09:46.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.500 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.662322+0000", 2024-05-08T18:09:46.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.662322+0000", 2024-05-08T18:09:46.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.662325+0000", 2024-05-08T18:09:46.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2380000000000002e-06 2024-05-08T18:09:46.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.665682+0000", 2024-05-08T18:09:46.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033573650000000002 2024-05-08T18:09:46.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.665716+0000", 2024-05-08T18:09:46.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3365999999999999e-05 2024-05-08T18:09:46.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.665730+0000", 2024-05-08T18:09:46.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4358e-05 2024-05-08T18:09:46.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.665864+0000", 2024-05-08T18:09:46.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013442099999999999 2024-05-08T18:09:46.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.666105+0000", 2024-05-08T18:09:46.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000240972 2024-05-08T18:09:46.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:46.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.666341+0000", 2024-05-08T18:09:46.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023601500000000001 2024-05-08T18:09:46.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.673810+0000", 2024-05-08T18:09:46.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0074687499999999997 2024-05-08T18:09:46.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.681779+0000", 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0079686170000000008 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.681880+0000", 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100806 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.681968+0000", 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8368999999999994e-05 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.504 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1280 3.2e 3:75e8bee5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:46.505 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:09.132622+0000", 2024-05-08T18:09:46.505 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.348917311999998, 2024-05-08T18:09:46.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0202191, 2024-05-08T18:09:46.505 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.505 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.505 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.505 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.505 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.505 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.505 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1280 2024-05-08T18:09:46.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.505 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.132622+0000", 2024-05-08T18:09:46.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.132622+0000", 2024-05-08T18:09:46.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.132626+0000", 2024-05-08T18:09:46.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0090000000000001e-06 2024-05-08T18:09:46.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.135466+0000", 2024-05-08T18:09:46.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028392349999999998 2024-05-08T18:09:46.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.135497+0000", 2024-05-08T18:09:46.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1707e-05 2024-05-08T18:09:46.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.135513+0000", 2024-05-08T18:09:46.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5500999999999999e-05 2024-05-08T18:09:46.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.135689+0000", 2024-05-08T18:09:46.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017570899999999999 2024-05-08T18:09:46.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.136084+0000", 2024-05-08T18:09:46.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000395867 2024-05-08T18:09:46.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:46.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.136557+0000", 2024-05-08T18:09:46.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047274099999999999 2024-05-08T18:09:46.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.145350+0000", 2024-05-08T18:09:46.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087923819999999996 2024-05-08T18:09:46.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.152722+0000", 2024-05-08T18:09:46.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073719270000000003 2024-05-08T18:09:46.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.152795+0000", 2024-05-08T18:09:46.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3620000000000003e-05 2024-05-08T18:09:46.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.152842+0000", 2024-05-08T18:09:46.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6402000000000001e-05 2024-05-08T18:09:46.509 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.510 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.510 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.510 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1401 3.f 3:f32613bc:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:46.510 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.841917+0000", 2024-05-08T18:09:46.510 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.639622868000004, 2024-05-08T18:09:46.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022767473, 2024-05-08T18:09:46.510 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.510 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.510 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.510 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.510 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.510 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.510 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1401 2024-05-08T18:09:46.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.511 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.841917+0000", 2024-05-08T18:09:46.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.841917+0000", 2024-05-08T18:09:46.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.841921+0000", 2024-05-08T18:09:46.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1439999999999996e-06 2024-05-08T18:09:46.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.847079+0000", 2024-05-08T18:09:46.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051577150000000002 2024-05-08T18:09:46.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.847118+0000", 2024-05-08T18:09:46.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9473e-05 2024-05-08T18:09:46.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.847144+0000", 2024-05-08T18:09:46.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6149e-05 2024-05-08T18:09:46.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.847239+0000", 2024-05-08T18:09:46.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4643999999999997e-05 2024-05-08T18:09:46.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.847353+0000", 2024-05-08T18:09:46.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113589 2024-05-08T18:09:46.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:46.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.847447+0000", 2024-05-08T18:09:46.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4111999999999996e-05 2024-05-08T18:09:46.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.855437+0000", 2024-05-08T18:09:46.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0079898620000000004 2024-05-08T18:09:46.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.864564+0000", 2024-05-08T18:09:46.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0091273310000000007 2024-05-08T18:09:46.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.864637+0000", 2024-05-08T18:09:46.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2855000000000006e-05 2024-05-08T18:09:46.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.864684+0000", 2024-05-08T18:09:46.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7599000000000003e-05 2024-05-08T18:09:46.515 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.515 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.515 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.515 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1438 3.f 3:f18ace44:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:46.515 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.657507+0000", 2024-05-08T18:09:46.515 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.824033077999999, 2024-05-08T18:09:46.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020692261, 2024-05-08T18:09:46.515 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.515 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.516 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.516 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.516 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.516 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.516 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1438 2024-05-08T18:09:46.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.516 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.657507+0000", 2024-05-08T18:09:46.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.657507+0000", 2024-05-08T18:09:46.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.657511+0000", 2024-05-08T18:09:46.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0500000000000002e-06 2024-05-08T18:09:46.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.662087+0000", 2024-05-08T18:09:46.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045766920000000003 2024-05-08T18:09:46.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.662132+0000", 2024-05-08T18:09:46.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4645999999999999e-05 2024-05-08T18:09:46.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.662151+0000", 2024-05-08T18:09:46.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8927e-05 2024-05-08T18:09:46.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.662322+0000", 2024-05-08T18:09:46.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017104199999999999 2024-05-08T18:09:46.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.662619+0000", 2024-05-08T18:09:46.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00029650800000000001 2024-05-08T18:09:46.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:46.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.662961+0000", 2024-05-08T18:09:46.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034270699999999998 2024-05-08T18:09:46.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.673277+0000", 2024-05-08T18:09:46.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010315441999999999 2024-05-08T18:09:46.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.677898+0000", 2024-05-08T18:09:46.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046212750000000002 2024-05-08T18:09:46.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.678078+0000", 2024-05-08T18:09:46.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180166 2024-05-08T18:09:46.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.678199+0000", 2024-05-08T18:09:46.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012080599999999999 2024-05-08T18:09:46.520 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.520 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.520 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.521 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1440 3.2e 3:774e4dff:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:46.521 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.698834+0000", 2024-05-08T18:09:46.521 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.782705565999997, 2024-05-08T18:09:46.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020162098, 2024-05-08T18:09:46.521 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.521 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.521 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.521 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.521 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.521 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.521 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1440 2024-05-08T18:09:46.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.521 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.698834+0000", 2024-05-08T18:09:46.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.698834+0000", 2024-05-08T18:09:46.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.698839+0000", 2024-05-08T18:09:46.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5600000000000004e-06 2024-05-08T18:09:46.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.701943+0000", 2024-05-08T18:09:46.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031039100000000001 2024-05-08T18:09:46.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.701987+0000", 2024-05-08T18:09:46.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4295999999999997e-05 2024-05-08T18:09:46.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.702006+0000", 2024-05-08T18:09:46.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9409999999999999e-05 2024-05-08T18:09:46.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.702151+0000", 2024-05-08T18:09:46.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000144423 2024-05-08T18:09:46.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.702433+0000", 2024-05-08T18:09:46.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028230200000000001 2024-05-08T18:09:46.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:46.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.702666+0000", 2024-05-08T18:09:46.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023294799999999999 2024-05-08T18:09:46.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.712684+0000", 2024-05-08T18:09:46.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010018068999999999 2024-05-08T18:09:46.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.718828+0000", 2024-05-08T18:09:46.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061441810000000003 2024-05-08T18:09:46.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.718923+0000", 2024-05-08T18:09:46.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4928999999999999e-05 2024-05-08T18:09:46.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.718996+0000", 2024-05-08T18:09:46.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3070000000000003e-05 2024-05-08T18:09:46.526 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.526 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.526 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.526 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1443 3.21 3:8729b090:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:46.526 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.765398+0000", 2024-05-08T18:09:46.526 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.716141544999999, 2024-05-08T18:09:46.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0192067, 2024-05-08T18:09:46.526 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.526 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.526 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.526 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.527 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1443 2024-05-08T18:09:46.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.527 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.765398+0000", 2024-05-08T18:09:46.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.765398+0000", 2024-05-08T18:09:46.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.765403+0000", 2024-05-08T18:09:46.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3699999999999997e-06 2024-05-08T18:09:46.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.768400+0000", 2024-05-08T18:09:46.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029976809999999999 2024-05-08T18:09:46.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.768448+0000", 2024-05-08T18:09:46.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7317000000000001e-05 2024-05-08T18:09:46.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.768475+0000", 2024-05-08T18:09:46.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7583e-05 2024-05-08T18:09:46.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.768673+0000", 2024-05-08T18:09:46.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000198042 2024-05-08T18:09:46.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.768996+0000", 2024-05-08T18:09:46.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032296099999999997 2024-05-08T18:09:46.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:46.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.769342+0000", 2024-05-08T18:09:46.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034602 2024-05-08T18:09:46.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.778043+0000", 2024-05-08T18:09:46.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087005009999999994 2024-05-08T18:09:46.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.784508+0000", 2024-05-08T18:09:46.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006465658 2024-05-08T18:09:46.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.784563+0000", 2024-05-08T18:09:46.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4228999999999999e-05 2024-05-08T18:09:46.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.784605+0000", 2024-05-08T18:09:46.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2338e-05 2024-05-08T18:09:46.531 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.531 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.531 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.531 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1455 3.21 3:878affb7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:46.531 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.391548+0000", 2024-05-08T18:09:46.531 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.089991435000002, 2024-05-08T18:09:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023279116999999998, 2024-05-08T18:09:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1455 2024-05-08T18:09:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.391548+0000", 2024-05-08T18:09:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.391548+0000", 2024-05-08T18:09:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.391553+0000", 2024-05-08T18:09:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3089999999999997e-06 2024-05-08T18:09:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.394736+0000", 2024-05-08T18:09:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031830869999999998 2024-05-08T18:09:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.394780+0000", 2024-05-08T18:09:46.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4335999999999997e-05 2024-05-08T18:09:46.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.394808+0000", 2024-05-08T18:09:46.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7963e-05 2024-05-08T18:09:46.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.394955+0000", 2024-05-08T18:09:46.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014733199999999999 2024-05-08T18:09:46.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.395266+0000", 2024-05-08T18:09:46.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031033800000000001 2024-05-08T18:09:46.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:46.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.395554+0000", 2024-05-08T18:09:46.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028860099999999998 2024-05-08T18:09:46.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.405727+0000", 2024-05-08T18:09:46.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01017234 2024-05-08T18:09:46.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.414598+0000", 2024-05-08T18:09:46.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0088716760000000002 2024-05-08T18:09:46.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.414732+0000", 2024-05-08T18:09:46.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133356 2024-05-08T18:09:46.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.414827+0000", 2024-05-08T18:09:46.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5779000000000006e-05 2024-05-08T18:09:46.536 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.536 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.536 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.537 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1462 3.f 3:f149d717:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:46.537 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.548400+0000", 2024-05-08T18:09:46.537 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.933139367999999, 2024-05-08T18:09:46.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024933295000000001, 2024-05-08T18:09:46.537 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.537 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.537 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.537 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.537 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.537 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.537 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1462 2024-05-08T18:09:46.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.537 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.548400+0000", 2024-05-08T18:09:46.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.548400+0000", 2024-05-08T18:09:46.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.548404+0000", 2024-05-08T18:09:46.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4199999999999999e-06 2024-05-08T18:09:46.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.553868+0000", 2024-05-08T18:09:46.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054640549999999998 2024-05-08T18:09:46.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.553924+0000", 2024-05-08T18:09:46.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5927000000000002e-05 2024-05-08T18:09:46.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.553951+0000", 2024-05-08T18:09:46.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7032000000000001e-05 2024-05-08T18:09:46.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.554267+0000", 2024-05-08T18:09:46.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000316294 2024-05-08T18:09:46.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.554529+0000", 2024-05-08T18:09:46.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026151899999999999 2024-05-08T18:09:46.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:46.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.554775+0000", 2024-05-08T18:09:46.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024608099999999999 2024-05-08T18:09:46.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.570143+0000", 2024-05-08T18:09:46.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015368257999999999 2024-05-08T18:09:46.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573020+0000", 2024-05-08T18:09:46.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028767689999999999 2024-05-08T18:09:46.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573201+0000", 2024-05-08T18:09:46.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018154799999999999 2024-05-08T18:09:46.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573334+0000", 2024-05-08T18:09:46.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132392 2024-05-08T18:09:46.542 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.542 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.542 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.542 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1467 3.2e 3:7582a1db:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:46.542 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.649589+0000", 2024-05-08T18:09:46.542 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.831951193000002, 2024-05-08T18:09:46.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019061583, 2024-05-08T18:09:46.542 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.542 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.542 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.542 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.542 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.542 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.543 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1467 2024-05-08T18:09:46.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.543 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.649589+0000", 2024-05-08T18:09:46.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.649589+0000", 2024-05-08T18:09:46.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.649592+0000", 2024-05-08T18:09:46.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5530000000000001e-06 2024-05-08T18:09:46.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.651593+0000", 2024-05-08T18:09:46.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020007689999999999 2024-05-08T18:09:46.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.651630+0000", 2024-05-08T18:09:46.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6968999999999998e-05 2024-05-08T18:09:46.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.651649+0000", 2024-05-08T18:09:46.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9089e-05 2024-05-08T18:09:46.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.651760+0000", 2024-05-08T18:09:46.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000111381 2024-05-08T18:09:46.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.652026+0000", 2024-05-08T18:09:46.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026602199999999998 2024-05-08T18:09:46.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:46.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.652270+0000", 2024-05-08T18:09:46.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024386399999999999 2024-05-08T18:09:46.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.663508+0000", 2024-05-08T18:09:46.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011237636 2024-05-08T18:09:46.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.668541+0000", 2024-05-08T18:09:46.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050334150000000003 2024-05-08T18:09:46.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.668594+0000", 2024-05-08T18:09:46.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3216e-05 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.668650+0000", 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5668999999999998e-05 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1960 3.0 e92/20 3:02610446:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.29:head v 92'6, mlcod=91'4)", 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:27.099605+0000", 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.381934280999999, 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018988175999999999, 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.547 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.548 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.099605+0000", 2024-05-08T18:09:46.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.099605+0000", 2024-05-08T18:09:46.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.099606+0000", 2024-05-08T18:09:46.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1699999999999998e-07 2024-05-08T18:09:46.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.103861+0000", 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042553340000000004 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.103903+0000", 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1903000000000002e-05 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.103922+0000", 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8902999999999998e-05 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.104096+0000", 2024-05-08T18:09:46.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017361300000000001 2024-05-08T18:09:46.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.104166+0000", 2024-05-08T18:09:46.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0648999999999994e-05 2024-05-08T18:09:46.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.118456+0000", 2024-05-08T18:09:46.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014289359999999999 2024-05-08T18:09:46.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.118594+0000", 2024-05-08T18:09:46.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137897 2024-05-08T18:09:46.551 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.551 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.551 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.551 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1984 3.21 3:8684244f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.33:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:46.551 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:27.631410+0000", 2024-05-08T18:09:46.551 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.850129397, 2024-05-08T18:09:46.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026559544000000001, 2024-05-08T18:09:46.551 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.552 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.552 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.552 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.552 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.552 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.552 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1984 2024-05-08T18:09:46.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.552 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.631410+0000", 2024-05-08T18:09:46.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.631410+0000", 2024-05-08T18:09:46.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.631413+0000", 2024-05-08T18:09:46.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6060000000000001e-06 2024-05-08T18:09:46.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.633229+0000", 2024-05-08T18:09:46.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001816062 2024-05-08T18:09:46.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.633250+0000", 2024-05-08T18:09:46.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0673e-05 2024-05-08T18:09:46.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.633260+0000", 2024-05-08T18:09:46.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0499999999999999e-05 2024-05-08T18:09:46.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.633326+0000", 2024-05-08T18:09:46.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5370000000000006e-05 2024-05-08T18:09:46.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.633464+0000", 2024-05-08T18:09:46.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000138274 2024-05-08T18:09:46.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:46.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.633829+0000", 2024-05-08T18:09:46.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036489299999999998 2024-05-08T18:09:46.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.643024+0000", 2024-05-08T18:09:46.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0091956929999999996 2024-05-08T18:09:46.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.657888+0000", 2024-05-08T18:09:46.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014863538000000001 2024-05-08T18:09:46.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.657937+0000", 2024-05-08T18:09:46.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9452e-05 2024-05-08T18:09:46.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.657970+0000", 2024-05-08T18:09:46.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2483000000000001e-05 2024-05-08T18:09:46.556 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.556 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.556 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.557 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1993 3.f 3:f3d3e753:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.bVoEl83lWbAlYGAKHGGh3DdtSVOS65h_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:46.557 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:27.841449+0000", 2024-05-08T18:09:46.557 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.640090544, 2024-05-08T18:09:46.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021619421999999999, 2024-05-08T18:09:46.557 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.557 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.557 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.557 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1993 2024-05-08T18:09:46.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.557 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.841449+0000", 2024-05-08T18:09:46.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.841449+0000", 2024-05-08T18:09:46.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.841453+0000", 2024-05-08T18:09:46.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4199999999999999e-06 2024-05-08T18:09:46.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.843334+0000", 2024-05-08T18:09:46.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018811959999999999 2024-05-08T18:09:46.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.843358+0000", 2024-05-08T18:09:46.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3995e-05 2024-05-08T18:09:46.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.843369+0000", 2024-05-08T18:09:46.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0869999999999999e-05 2024-05-08T18:09:46.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.843456+0000", 2024-05-08T18:09:46.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6873000000000007e-05 2024-05-08T18:09:46.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.843644+0000", 2024-05-08T18:09:46.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018803 2024-05-08T18:09:46.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:46.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.843821+0000", 2024-05-08T18:09:46.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000177009 2024-05-08T18:09:46.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.853256+0000", 2024-05-08T18:09:46.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009435077 2024-05-08T18:09:46.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.862994+0000", 2024-05-08T18:09:46.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0097380709999999992 2024-05-08T18:09:46.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.863033+0000", 2024-05-08T18:09:46.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9595999999999998e-05 2024-05-08T18:09:46.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.863069+0000", 2024-05-08T18:09:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5284999999999998e-05 2024-05-08T18:09:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:2139 3.3d e93/20 3:bf4c8f68:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.57:head v 93'12, mlcod=91'10)", 2024-05-08T18:09:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.599268+0000", 2024-05-08T18:09:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.882272129, 2024-05-08T18:09:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019922117999999999, 2024-05-08T18:09:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.562 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.599268+0000", 2024-05-08T18:09:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.599268+0000", 2024-05-08T18:09:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.599268+0000", 2024-05-08T18:09:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0999999999999999e-07 2024-05-08T18:09:46.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.603384+0000", 2024-05-08T18:09:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004115723 2024-05-08T18:09:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.603422+0000", 2024-05-08T18:09:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8206e-05 2024-05-08T18:09:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.603440+0000", 2024-05-08T18:09:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8093000000000001e-05 2024-05-08T18:09:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.603574+0000", 2024-05-08T18:09:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013377800000000001 2024-05-08T18:09:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.603616+0000", 2024-05-08T18:09:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1792999999999998e-05 2024-05-08T18:09:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619039+0000", 2024-05-08T18:09:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015423584000000001 2024-05-08T18:09:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619190+0000", 2024-05-08T18:09:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150431 2024-05-08T18:09:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2148 3.3a 3:5e7eab38:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.umHd6qkh40rxG2J_0Hf4-0RSq48k1ir_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.871806+0000", 2024-05-08T18:09:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.609733912999999, 2024-05-08T18:09:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019799187999999999, 2024-05-08T18:09:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.566 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2148 2024-05-08T18:09:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.871806+0000", 2024-05-08T18:09:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.871806+0000", 2024-05-08T18:09:46.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.871810+0000", 2024-05-08T18:09:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8859999999999997e-06 2024-05-08T18:09:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.875274+0000", 2024-05-08T18:09:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034643429999999999 2024-05-08T18:09:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.875322+0000", 2024-05-08T18:09:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8168999999999999e-05 2024-05-08T18:09:46.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.875347+0000", 2024-05-08T18:09:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4326000000000001e-05 2024-05-08T18:09:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.875483+0000", 2024-05-08T18:09:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000136897 2024-05-08T18:09:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.875623+0000", 2024-05-08T18:09:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013914900000000001 2024-05-08T18:09:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.875743+0000", 2024-05-08T18:09:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120593 2024-05-08T18:09:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.890474+0000", 2024-05-08T18:09:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014730853 2024-05-08T18:09:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.891514+0000", 2024-05-08T18:09:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010401919999999999 2024-05-08T18:09:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.891562+0000", 2024-05-08T18:09:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8019000000000002e-05 2024-05-08T18:09:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.891605+0000", 2024-05-08T18:09:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2760999999999999e-05 2024-05-08T18:09:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:2175 3.2d e93/20 3:b44c7524:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.63:head v 93'6, mlcod=92'4)", 2024-05-08T18:09:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.566905+0000", 2024-05-08T18:09:46.571 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.914634769999999, 2024-05-08T18:09:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021205742999999999, 2024-05-08T18:09:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.566905+0000", 2024-05-08T18:09:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.566905+0000", 2024-05-08T18:09:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.566907+0000", 2024-05-08T18:09:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0269999999999998e-06 2024-05-08T18:09:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.574211+0000", 2024-05-08T18:09:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073044240000000003 2024-05-08T18:09:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.574244+0000", 2024-05-08T18:09:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2842999999999997e-05 2024-05-08T18:09:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.574261+0000", 2024-05-08T18:09:46.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6523000000000001e-05 2024-05-08T18:09:46.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.574375+0000", 2024-05-08T18:09:46.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114481 2024-05-08T18:09:46.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.574419+0000", 2024-05-08T18:09:46.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4106000000000001e-05 2024-05-08T18:09:46.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.587931+0000", 2024-05-08T18:09:46.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013512045 2024-05-08T18:09:46.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.588111+0000", 2024-05-08T18:09:46.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017929400000000001 2024-05-08T18:09:46.575 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.575 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.575 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.575 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2193 3.f 3:f037a6c5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.66:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:46.575 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:32.033127+0000", 2024-05-08T18:09:46.575 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.448413159999999, 2024-05-08T18:09:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019575115000000001, 2024-05-08T18:09:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2193 2024-05-08T18:09:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.033127+0000", 2024-05-08T18:09:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:46.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.033127+0000", 2024-05-08T18:09:46.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:46.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:46.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.033129+0000", 2024-05-08T18:09:46.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2460000000000002e-06 2024-05-08T18:09:46.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:46.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.034975+0000", 2024-05-08T18:09:46.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018464480000000001 2024-05-08T18:09:46.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:46.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.035000+0000", 2024-05-08T18:09:46.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4481000000000002e-05 2024-05-08T18:09:46.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:46.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.035010+0000", 2024-05-08T18:09:46.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0531e-05 2024-05-08T18:09:46.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:46.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.035094+0000", 2024-05-08T18:09:46.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3919999999999996e-05 2024-05-08T18:09:46.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:46.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.035276+0000", 2024-05-08T18:09:46.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000181991 2024-05-08T18:09:46.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:46.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.035784+0000", 2024-05-08T18:09:46.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050825200000000005 2024-05-08T18:09:46.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:46.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.045852+0000", 2024-05-08T18:09:46.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010068002 2024-05-08T18:09:46.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:46.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.052608+0000", 2024-05-08T18:09:46.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067558389999999996 2024-05-08T18:09:46.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:46.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.052666+0000", 2024-05-08T18:09:46.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7887999999999999e-05 2024-05-08T18:09:46.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:46.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:46.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:46.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.052702+0000", 2024-05-08T18:09:46.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5516999999999999e-05 2024-05-08T18:09:46.580 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.580 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.580 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.580 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:46.581 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:46.581 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:46.582 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:09:46.582 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:46.583 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:46.583 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:46.583 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:46.583 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:46.588+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:46.596 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:46.596 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:46.613 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:46.613 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:46.633 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:46.634 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:46.654 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:46.654 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:46.674 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:46.674 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:46.683 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:46.680+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:46.695 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:46.695 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:46.707 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:46.707 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:46.721 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:09:46.783 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:46.780+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:46.877 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:46.877 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:46.884 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:46.884+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:46.891 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:09:46.957 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:09:47.001 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:47.008+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:47.011 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:47.011 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:47.026 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:09:47.085 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:47.084+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:47.156 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:47.156 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:47.170 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:09:47.212 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:47.212+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:47.287 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:47.292+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:47.333 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:47.333 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:47.348 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:09:47.388 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:47.392+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:47.465 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:47.465 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:47.480 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:09:47.523 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:47.524+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:47.590 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:47.588+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:47.603 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:47.603 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:47.616 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:09:47.690 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:47.696+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:47.781 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:47.782 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:47.791 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:47.796+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:47.796 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:09:47.892 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:47.892+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:47.920 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:47.920 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:47.935 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:09:47.973 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is set 2024-05-08T18:09:48.034 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:48.040+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:48.094 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:48.094 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:48.094 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:48.092+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:48.108 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:09:48.200 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-08T18:09:48.200+0000 7efd7804d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25275) UID: 0 2024-05-08T18:09:48.273 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:48.273 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:48.288 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:09:48.332 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:48.332+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:48.397 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T18:09:48.400+0000 7f48c8ab8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25196) UID: 0 2024-05-08T18:09:48.455 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:48.455 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:48.469 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:09:48.498 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T18:09:48.504+0000 7f8e72e3c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25199) UID: 0 2024-05-08T18:09:48.590 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:48.590 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:48.598 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:48.604+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:48.604 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:09:48.699 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:48.696+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:48.712 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:09:48.724 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:48.724 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:48.739 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:09:48.800 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:48.804+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:48.812 INFO:tasks.workunit.client.0.smithi080.stdout:adding file to bucket buck_2024_04_8_18_09_23: 10Mb.100 2024-05-08T18:09:48.813 INFO:tasks.workunit.client.0.smithi080.stdout:upload file successful 2024-05-08T18:09:48.813 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.1 from bucket to /tmp/downloadfile.1 2024-05-08T18:09:48.813 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.2 from bucket to /tmp/downloadfile.2 2024-05-08T18:09:48.813 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.3 from bucket to /tmp/downloadfile.3 2024-05-08T18:09:48.813 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.4 from bucket to /tmp/downloadfile.4 2024-05-08T18:09:48.813 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.5 from bucket to /tmp/downloadfile.5 2024-05-08T18:09:48.813 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.6 from bucket to /tmp/downloadfile.6 2024-05-08T18:09:48.813 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.7 from bucket to /tmp/downloadfile.7 2024-05-08T18:09:48.813 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.8 from bucket to /tmp/downloadfile.8 2024-05-08T18:09:48.813 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.9 from bucket to /tmp/downloadfile.9 2024-05-08T18:09:48.813 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.10 from bucket to /tmp/downloadfile.10 2024-05-08T18:09:48.813 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.11 from bucket to /tmp/downloadfile.11 2024-05-08T18:09:48.813 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.12 from bucket to /tmp/downloadfile.12 2024-05-08T18:09:48.813 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.13 from bucket to /tmp/downloadfile.13 2024-05-08T18:09:48.813 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.14 from bucket to /tmp/downloadfile.14 2024-05-08T18:09:48.814 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.15 from bucket to /tmp/downloadfile.15 2024-05-08T18:09:48.814 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.16 from bucket to /tmp/downloadfile.16 2024-05-08T18:09:48.814 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.17 from bucket to /tmp/downloadfile.17 2024-05-08T18:09:48.814 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.18 from bucket to /tmp/downloadfile.18 2024-05-08T18:09:48.814 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.19 from bucket to /tmp/downloadfile.19 2024-05-08T18:09:48.814 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.20 from bucket to /tmp/downloadfile.20 2024-05-08T18:09:48.814 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.21 from bucket to /tmp/downloadfile.21 2024-05-08T18:09:48.814 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.22 from bucket to /tmp/downloadfile.22 2024-05-08T18:09:48.814 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.23 from bucket to /tmp/downloadfile.23 2024-05-08T18:09:48.814 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.24 from bucket to /tmp/downloadfile.24 2024-05-08T18:09:48.814 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.25 from bucket to /tmp/downloadfile.25 2024-05-08T18:09:48.814 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.26 from bucket to /tmp/downloadfile.26 2024-05-08T18:09:48.814 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.27 from bucket to /tmp/downloadfile.27 2024-05-08T18:09:48.814 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.28 from bucket to /tmp/downloadfile.28 2024-05-08T18:09:48.815 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.29 from bucket to /tmp/downloadfile.29 2024-05-08T18:09:48.815 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.30 from bucket to /tmp/downloadfile.30 2024-05-08T18:09:48.815 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.31 from bucket to /tmp/downloadfile.31 2024-05-08T18:09:48.815 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.32 from bucket to /tmp/downloadfile.32 2024-05-08T18:09:48.815 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.33 from bucket to /tmp/downloadfile.33 2024-05-08T18:09:48.815 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.34 from bucket to /tmp/downloadfile.34 2024-05-08T18:09:48.815 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.35 from bucket to /tmp/downloadfile.35 2024-05-08T18:09:48.815 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.36 from bucket to /tmp/downloadfile.36 2024-05-08T18:09:48.815 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.37 from bucket to /tmp/downloadfile.37 2024-05-08T18:09:48.815 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.38 from bucket to /tmp/downloadfile.38 2024-05-08T18:09:48.815 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.39 from bucket to /tmp/downloadfile.39 2024-05-08T18:09:48.815 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.40 from bucket to /tmp/downloadfile.40 2024-05-08T18:09:48.815 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.41 from bucket to /tmp/downloadfile.41 2024-05-08T18:09:48.815 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.42 from bucket to /tmp/downloadfile.42 2024-05-08T18:09:48.815 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.43 from bucket to /tmp/downloadfile.43 2024-05-08T18:09:48.815 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.44 from bucket to /tmp/downloadfile.44 2024-05-08T18:09:48.816 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.45 from bucket to /tmp/downloadfile.45 2024-05-08T18:09:48.816 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.46 from bucket to /tmp/downloadfile.46 2024-05-08T18:09:48.816 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.47 from bucket to /tmp/downloadfile.47 2024-05-08T18:09:48.816 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.48 from bucket to /tmp/downloadfile.48 2024-05-08T18:09:48.816 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.49 from bucket to /tmp/downloadfile.49 2024-05-08T18:09:48.816 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.50 from bucket to /tmp/downloadfile.50 2024-05-08T18:09:48.816 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.51 from bucket to /tmp/downloadfile.51 2024-05-08T18:09:48.816 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.52 from bucket to /tmp/downloadfile.52 2024-05-08T18:09:48.816 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.53 from bucket to /tmp/downloadfile.53 2024-05-08T18:09:48.816 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.54 from bucket to /tmp/downloadfile.54 2024-05-08T18:09:48.816 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.55 from bucket to /tmp/downloadfile.55 2024-05-08T18:09:48.816 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.56 from bucket to /tmp/downloadfile.56 2024-05-08T18:09:48.816 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.57 from bucket to /tmp/downloadfile.57 2024-05-08T18:09:48.816 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.58 from bucket to /tmp/downloadfile.58 2024-05-08T18:09:48.816 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.59 from bucket to /tmp/downloadfile.59 2024-05-08T18:09:48.817 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.60 from bucket to /tmp/downloadfile.60 2024-05-08T18:09:48.817 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.61 from bucket to /tmp/downloadfile.61 2024-05-08T18:09:48.817 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.62 from bucket to /tmp/downloadfile.62 2024-05-08T18:09:48.817 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.63 from bucket to /tmp/downloadfile.63 2024-05-08T18:09:48.817 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.64 from bucket to /tmp/downloadfile.64 2024-05-08T18:09:48.817 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.65 from bucket to /tmp/downloadfile.65 2024-05-08T18:09:48.817 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.66 from bucket to /tmp/downloadfile.66 2024-05-08T18:09:48.817 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.67 from bucket to /tmp/downloadfile.67 2024-05-08T18:09:48.817 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.68 from bucket to /tmp/downloadfile.68 2024-05-08T18:09:48.817 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.69 from bucket to /tmp/downloadfile.69 2024-05-08T18:09:48.817 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.70 from bucket to /tmp/downloadfile.70 2024-05-08T18:09:48.817 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.71 from bucket to /tmp/downloadfile.71 2024-05-08T18:09:48.817 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.72 from bucket to /tmp/downloadfile.72 2024-05-08T18:09:48.817 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.73 from bucket to /tmp/downloadfile.73 2024-05-08T18:09:48.817 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.74 from bucket to /tmp/downloadfile.74 2024-05-08T18:09:48.818 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.75 from bucket to /tmp/downloadfile.75 2024-05-08T18:09:48.818 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.76 from bucket to /tmp/downloadfile.76 2024-05-08T18:09:48.818 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.77 from bucket to /tmp/downloadfile.77 2024-05-08T18:09:48.818 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.78 from bucket to /tmp/downloadfile.78 2024-05-08T18:09:48.818 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.79 from bucket to /tmp/downloadfile.79 2024-05-08T18:09:48.818 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.80 from bucket to /tmp/downloadfile.80 2024-05-08T18:09:48.818 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.81 from bucket to /tmp/downloadfile.81 2024-05-08T18:09:48.818 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.82 from bucket to /tmp/downloadfile.82 2024-05-08T18:09:48.818 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.83 from bucket to /tmp/downloadfile.83 2024-05-08T18:09:48.818 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.84 from bucket to /tmp/downloadfile.84 2024-05-08T18:09:48.818 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.85 from bucket to /tmp/downloadfile.85 2024-05-08T18:09:48.818 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.86 from bucket to /tmp/downloadfile.86 2024-05-08T18:09:48.818 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.87 from bucket to /tmp/downloadfile.87 2024-05-08T18:09:48.818 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.88 from bucket to /tmp/downloadfile.88 2024-05-08T18:09:48.818 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.89 from bucket to /tmp/downloadfile.89 2024-05-08T18:09:48.819 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.90 from bucket to /tmp/downloadfile.90 2024-05-08T18:09:48.819 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.91 from bucket to /tmp/downloadfile.91 2024-05-08T18:09:48.819 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.92 from bucket to /tmp/downloadfile.92 2024-05-08T18:09:48.819 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.93 from bucket to /tmp/downloadfile.93 2024-05-08T18:09:48.819 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.94 from bucket to /tmp/downloadfile.94 2024-05-08T18:09:48.819 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.95 from bucket to /tmp/downloadfile.95 2024-05-08T18:09:48.819 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.96 from bucket to /tmp/downloadfile.96 2024-05-08T18:09:48.819 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.97 from bucket to /tmp/downloadfile.97 2024-05-08T18:09:48.819 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.98 from bucket to /tmp/downloadfile.98 2024-05-08T18:09:48.819 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.99 from bucket to /tmp/downloadfile.99 2024-05-08T18:09:48.819 INFO:tasks.workunit.client.0.smithi080.stdout:Downloading 10Mb.100 from bucket to /tmp/downloadfile.100 2024-05-08T18:09:48.819 INFO:tasks.workunit.client.0.smithi080.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T18:09:48.819 INFO:tasks.workunit.client.0.smithi080.stdout:Test case: PASSED - checksum verification for multipart upload passed 2024-05-08T18:09:48.819 INFO:tasks.workunit.client.0.smithi080.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T18:09:48.855 INFO:teuthology.orchestra.run.smithi080.stdout:osd.0: {} 2024-05-08T18:09:48.855 INFO:teuthology.orchestra.run.smithi080.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:09:48.873 INFO:teuthology.orchestra.run.smithi080.stdout:osd.1: {} 2024-05-08T18:09:48.874 INFO:teuthology.orchestra.run.smithi080.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:09:48.892 INFO:teuthology.orchestra.run.smithi080.stdout:osd.2: {} 2024-05-08T18:09:48.892 INFO:teuthology.orchestra.run.smithi080.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:09:48.900 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:48.900+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:48.906 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-05-08T18:09:48.906 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:09:48.908 INFO:teuthology.orchestra.run.smithi080.stdout:osd.3: {} 2024-05-08T18:09:48.908 INFO:teuthology.orchestra.run.smithi080.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:09:48.923 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:09:48.929 INFO:teuthology.orchestra.run.smithi080.stdout:osd.4: {} 2024-05-08T18:09:48.929 INFO:teuthology.orchestra.run.smithi080.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:09:48.948 INFO:teuthology.orchestra.run.smithi080.stdout:osd.5: {} 2024-05-08T18:09:48.949 INFO:teuthology.orchestra.run.smithi080.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:09:48.968 INFO:teuthology.orchestra.run.smithi080.stdout:osd.6: {} 2024-05-08T18:09:48.968 INFO:teuthology.orchestra.run.smithi080.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:09:48.986 INFO:teuthology.orchestra.run.smithi080.stdout:osd.7: {} 2024-05-08T18:09:48.987 INFO:teuthology.orchestra.run.smithi080.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:09:49.002 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:49.000+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:49.044 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:49.044 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:49.044 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:49.044 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:49.058 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:09:49.102 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:49.100+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:49.204 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:49.204+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:49.223 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:49.223 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:49.223 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:49.237 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:09:49.305 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:49.304+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:49.363 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:49.363 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:49.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:49.364 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:49.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.364 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1221 3.20 e85/20 3:071d1257:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_5:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:49.364 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:49.364 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 41.758353720000002, 2024-05-08T18:09:49.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019872899999999999, 2024-05-08T18:09:49.364 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.364 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.364 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.364 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:49.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605942+0000", 2024-05-08T18:09:49.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.605944+0000", 2024-05-08T18:09:49.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.77e-06 2024-05-08T18:09:49.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612548+0000", 2024-05-08T18:09:49.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066036519999999998 2024-05-08T18:09:49.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612580+0000", 2024-05-08T18:09:49.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1945e-05 2024-05-08T18:09:49.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612593+0000", 2024-05-08T18:09:49.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3665999999999999e-05 2024-05-08T18:09:49.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.367 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.367 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612758+0000", 2024-05-08T18:09:49.367 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016427600000000001 2024-05-08T18:09:49.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.367 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.367 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.612832+0000", 2024-05-08T18:09:49.367 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4493000000000007e-05 2024-05-08T18:09:49.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.367 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.367 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.625728+0000", 2024-05-08T18:09:49.367 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012895471 2024-05-08T18:09:49.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.625815+0000", 2024-05-08T18:09:49.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7627000000000007e-05 2024-05-08T18:09:49.368 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.368 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.368 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.368 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1227 3.6 3:6359f987:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:49.368 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:49.368 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 41.680180161999999, 2024-05-08T18:09:49.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022831489999999999, 2024-05-08T18:09:49.368 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.368 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.368 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.369 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.369 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.369 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.369 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1227 2024-05-08T18:09:49.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.369 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:49.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684116+0000", 2024-05-08T18:09:49.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.684119+0000", 2024-05-08T18:09:49.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.678e-06 2024-05-08T18:09:49.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687247+0000", 2024-05-08T18:09:49.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031279820000000001 2024-05-08T18:09:49.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687274+0000", 2024-05-08T18:09:49.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7174000000000001e-05 2024-05-08T18:09:49.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687289+0000", 2024-05-08T18:09:49.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5364999999999999e-05 2024-05-08T18:09:49.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687421+0000", 2024-05-08T18:09:49.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013197999999999999 2024-05-08T18:09:49.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687681+0000", 2024-05-08T18:09:49.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025951099999999998 2024-05-08T18:09:49.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:49.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.687981+0000", 2024-05-08T18:09:49.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030021799999999999 2024-05-08T18:09:49.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706004+0000", 2024-05-08T18:09:49.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018023441000000001 2024-05-08T18:09:49.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706867+0000", 2024-05-08T18:09:49.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00086241200000000001 2024-05-08T18:09:49.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706901+0000", 2024-05-08T18:09:49.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4325000000000001e-05 2024-05-08T18:09:49.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706948+0000", 2024-05-08T18:09:49.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6403999999999998e-05 2024-05-08T18:09:49.373 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.373 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.374 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.374 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1246 3.6 3:6220dfe7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:49.374 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:49.374 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 41.003500680999998, 2024-05-08T18:09:49.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020211156000000001, 2024-05-08T18:09:49.374 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.374 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.374 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.374 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.374 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1246 2024-05-08T18:09:49.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.375 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:49.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360795+0000", 2024-05-08T18:09:49.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.360799+0000", 2024-05-08T18:09:49.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4939999999999999e-06 2024-05-08T18:09:49.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363474+0000", 2024-05-08T18:09:49.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026745190000000002 2024-05-08T18:09:49.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363511+0000", 2024-05-08T18:09:49.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7722000000000002e-05 2024-05-08T18:09:49.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363528+0000", 2024-05-08T18:09:49.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6600999999999999e-05 2024-05-08T18:09:49.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363637+0000", 2024-05-08T18:09:49.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108855 2024-05-08T18:09:49.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363792+0000", 2024-05-08T18:09:49.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000155561 2024-05-08T18:09:49.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:49.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.363921+0000", 2024-05-08T18:09:49.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000128501 2024-05-08T18:09:49.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.378377+0000", 2024-05-08T18:09:49.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014456577999999999 2024-05-08T18:09:49.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380848+0000", 2024-05-08T18:09:49.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024703329999999999 2024-05-08T18:09:49.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380940+0000", 2024-05-08T18:09:49.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2264999999999998e-05 2024-05-08T18:09:49.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.381007+0000", 2024-05-08T18:09:49.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6727e-05 2024-05-08T18:09:49.379 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.379 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.379 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.380 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1255 3.12 3:48af9d8c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:49.380 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:49.380 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 40.882482813999999, 2024-05-08T18:09:49.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025868088000000001, 2024-05-08T18:09:49.380 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.380 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.380 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.380 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.380 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.380 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.380 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1255 2024-05-08T18:09:49.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.380 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:49.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481813+0000", 2024-05-08T18:09:49.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.481816+0000", 2024-05-08T18:09:49.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6390000000000001e-06 2024-05-08T18:09:49.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484725+0000", 2024-05-08T18:09:49.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00290865 2024-05-08T18:09:49.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484750+0000", 2024-05-08T18:09:49.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5009999999999999e-05 2024-05-08T18:09:49.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484763+0000", 2024-05-08T18:09:49.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2976000000000001e-05 2024-05-08T18:09:49.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.484848+0000", 2024-05-08T18:09:49.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5232e-05 2024-05-08T18:09:49.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.485026+0000", 2024-05-08T18:09:49.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000177706 2024-05-08T18:09:49.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:49.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.485186+0000", 2024-05-08T18:09:49.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016076900000000001 2024-05-08T18:09:49.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.491881+0000", 2024-05-08T18:09:49.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066950539999999998 2024-05-08T18:09:49.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507591+0000", 2024-05-08T18:09:49.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015709724000000001 2024-05-08T18:09:49.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507638+0000", 2024-05-08T18:09:49.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6684999999999998e-05 2024-05-08T18:09:49.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507681+0000", 2024-05-08T18:09:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3643000000000002e-05 2024-05-08T18:09:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1395 3.17 3:eb9c68a5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.591854073, 2024-05-08T18:09:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026590425000000001, 2024-05-08T18:09:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.386 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.386 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.386 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.386 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1395 2024-05-08T18:09:49.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.386 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:49.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772442+0000", 2024-05-08T18:09:49.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.772445+0000", 2024-05-08T18:09:49.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0970000000000002e-06 2024-05-08T18:09:49.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775066+0000", 2024-05-08T18:09:49.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026205730000000002 2024-05-08T18:09:49.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775101+0000", 2024-05-08T18:09:49.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4876000000000003e-05 2024-05-08T18:09:49.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775116+0000", 2024-05-08T18:09:49.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5566999999999999e-05 2024-05-08T18:09:49.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775200+0000", 2024-05-08T18:09:49.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3808999999999997e-05 2024-05-08T18:09:49.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775307+0000", 2024-05-08T18:09:49.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000107366 2024-05-08T18:09:49.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:49.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.775430+0000", 2024-05-08T18:09:49.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012280599999999999 2024-05-08T18:09:49.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.779395+0000", 2024-05-08T18:09:49.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003964357 2024-05-08T18:09:49.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.798911+0000", 2024-05-08T18:09:49.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019516386 2024-05-08T18:09:49.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.798982+0000", 2024-05-08T18:09:49.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0759000000000005e-05 2024-05-08T18:09:49.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.799033+0000", 2024-05-08T18:09:49.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0828999999999997e-05 2024-05-08T18:09:49.390 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.390 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.390 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.391 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1404 3.1b 3:d97dd5be:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:49.391 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:49.391 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.491023886999997, 2024-05-08T18:09:49.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020100535999999999, 2024-05-08T18:09:49.391 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.391 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.391 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.391 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.391 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.391 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.391 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1404 2024-05-08T18:09:49.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.391 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:49.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873272+0000", 2024-05-08T18:09:49.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.873276+0000", 2024-05-08T18:09:49.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.45e-06 2024-05-08T18:09:49.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875542+0000", 2024-05-08T18:09:49.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002266746 2024-05-08T18:09:49.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875570+0000", 2024-05-08T18:09:49.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7826000000000001e-05 2024-05-08T18:09:49.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875585+0000", 2024-05-08T18:09:49.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4681999999999999e-05 2024-05-08T18:09:49.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875667+0000", 2024-05-08T18:09:49.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2429000000000006e-05 2024-05-08T18:09:49.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875833+0000", 2024-05-08T18:09:49.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165959 2024-05-08T18:09:49.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:49.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.875991+0000", 2024-05-08T18:09:49.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015766099999999999 2024-05-08T18:09:49.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.884154+0000", 2024-05-08T18:09:49.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081625329999999996 2024-05-08T18:09:49.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.892970+0000", 2024-05-08T18:09:49.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0088168540000000007 2024-05-08T18:09:49.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.893166+0000", 2024-05-08T18:09:49.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019573 2024-05-08T18:09:49.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.893373+0000", 2024-05-08T18:09:49.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020666599999999999 2024-05-08T18:09:49.396 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.396 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.396 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.396 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1426 3.3 e87/20 3:c1fceb03:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_4:head v 87'7, mlcod=86'5)", 2024-05-08T18:09:49.396 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:49.396 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.936837783999998, 2024-05-08T18:09:49.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020804152999999999, 2024-05-08T18:09:49.397 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.397 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.397 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.397 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:49.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427458+0000", 2024-05-08T18:09:49.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.427461+0000", 2024-05-08T18:09:49.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.57e-06 2024-05-08T18:09:49.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433712+0000", 2024-05-08T18:09:49.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062511729999999996 2024-05-08T18:09:49.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433759+0000", 2024-05-08T18:09:49.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6397000000000003e-05 2024-05-08T18:09:49.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433779+0000", 2024-05-08T18:09:49.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0196000000000001e-05 2024-05-08T18:09:49.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433922+0000", 2024-05-08T18:09:49.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014305599999999999 2024-05-08T18:09:49.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433970+0000", 2024-05-08T18:09:49.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7933000000000003e-05 2024-05-08T18:09:49.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.448060+0000", 2024-05-08T18:09:49.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01409064 2024-05-08T18:09:49.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.448263+0000", 2024-05-08T18:09:49.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020218800000000001 2024-05-08T18:09:49.400 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.400 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.401 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.401 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1452 3.18 e87/20 3:1a3be52d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_2:head v 87'4, mlcod=86'2)", 2024-05-08T18:09:49.401 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:49.401 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.036290653000002, 2024-05-08T18:09:49.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020634468, 2024-05-08T18:09:49.401 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.401 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.401 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.401 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:49.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328006+0000", 2024-05-08T18:09:49.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.328008+0000", 2024-05-08T18:09:49.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2589999999999999e-06 2024-05-08T18:09:49.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330832+0000", 2024-05-08T18:09:49.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028243719999999999 2024-05-08T18:09:49.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330867+0000", 2024-05-08T18:09:49.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4776e-05 2024-05-08T18:09:49.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.330883+0000", 2024-05-08T18:09:49.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6121999999999999e-05 2024-05-08T18:09:49.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.331031+0000", 2024-05-08T18:09:49.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000148412 2024-05-08T18:09:49.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.331075+0000", 2024-05-08T18:09:49.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3126e-05 2024-05-08T18:09:49.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.348521+0000", 2024-05-08T18:09:49.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017446351999999998 2024-05-08T18:09:49.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.348640+0000", 2024-05-08T18:09:49.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119049 2024-05-08T18:09:49.405 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.405 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.405 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.405 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1463 3.17 3:ebd3133d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:49.405 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:49.405 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 35.790800234000002, 2024-05-08T18:09:49.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023934057000000002, 2024-05-08T18:09:49.405 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.405 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.405 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.405 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.405 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.405 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.406 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1463 2024-05-08T18:09:49.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.406 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:49.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573496+0000", 2024-05-08T18:09:49.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573500+0000", 2024-05-08T18:09:49.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7670000000000001e-06 2024-05-08T18:09:49.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575722+0000", 2024-05-08T18:09:49.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022226559999999999 2024-05-08T18:09:49.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575781+0000", 2024-05-08T18:09:49.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8746999999999998e-05 2024-05-08T18:09:49.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575810+0000", 2024-05-08T18:09:49.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8407000000000001e-05 2024-05-08T18:09:49.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.575981+0000", 2024-05-08T18:09:49.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017151499999999999 2024-05-08T18:09:49.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.576369+0000", 2024-05-08T18:09:49.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038807000000000002 2024-05-08T18:09:49.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:49.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.576675+0000", 2024-05-08T18:09:49.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00030572800000000001 2024-05-08T18:09:49.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.585475+0000", 2024-05-08T18:09:49.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087997630000000004 2024-05-08T18:09:49.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597202+0000", 2024-05-08T18:09:49.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011727849 2024-05-08T18:09:49.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597316+0000", 2024-05-08T18:09:49.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113546 2024-05-08T18:09:49.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.597430+0000", 2024-05-08T18:09:49.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114009 2024-05-08T18:09:49.410 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.410 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.410 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.410 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1913 3.17 3:ea65dc81:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.vOI1jtaftCZSAcjtRhSYPcY8omHGfbO_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:49.411 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:49.411 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.272195755999999, 2024-05-08T18:09:49.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020076618000000001, 2024-05-08T18:09:49.411 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.411 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.411 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.411 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.411 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.411 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.411 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1913 2024-05-08T18:09:49.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.411 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:49.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092100+0000", 2024-05-08T18:09:49.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.092104+0000", 2024-05-08T18:09:49.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2279999999999998e-06 2024-05-08T18:09:49.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094163+0000", 2024-05-08T18:09:49.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020592710000000001 2024-05-08T18:09:49.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094206+0000", 2024-05-08T18:09:49.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3072999999999999e-05 2024-05-08T18:09:49.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094231+0000", 2024-05-08T18:09:49.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4819000000000001e-05 2024-05-08T18:09:49.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094325+0000", 2024-05-08T18:09:49.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4029000000000004e-05 2024-05-08T18:09:49.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094439+0000", 2024-05-08T18:09:49.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113878 2024-05-08T18:09:49.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:49.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.094533+0000", 2024-05-08T18:09:49.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4733000000000003e-05 2024-05-08T18:09:49.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.099901+0000", 2024-05-08T18:09:49.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053678789999999999 2024-05-08T18:09:49.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.111944+0000", 2024-05-08T18:09:49.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012042855999999999 2024-05-08T18:09:49.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.112051+0000", 2024-05-08T18:09:49.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010673100000000001 2024-05-08T18:09:49.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.112177+0000", 2024-05-08T18:09:49.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012612100000000001 2024-05-08T18:09:49.415 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.416 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.416 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.416 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1928 3.23 3:c76f4655:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.24:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:49.416 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:49.416 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 22.95635673, 2024-05-08T18:09:49.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026452139, 2024-05-08T18:09:49.416 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.416 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.416 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.416 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.416 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.416 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.416 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1928 2024-05-08T18:09:49.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.417 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:49.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407939+0000", 2024-05-08T18:09:49.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.407943+0000", 2024-05-08T18:09:49.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4170000000000001e-06 2024-05-08T18:09:49.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412466+0000", 2024-05-08T18:09:49.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045230720000000004 2024-05-08T18:09:49.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412503+0000", 2024-05-08T18:09:49.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7287999999999999e-05 2024-05-08T18:09:49.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412520+0000", 2024-05-08T18:09:49.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7206000000000001e-05 2024-05-08T18:09:49.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412719+0000", 2024-05-08T18:09:49.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000198975 2024-05-08T18:09:49.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.412989+0000", 2024-05-08T18:09:49.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000269256 2024-05-08T18:09:49.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:49.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.413870+0000", 2024-05-08T18:09:49.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00088159999999999996 2024-05-08T18:09:49.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.433846+0000", 2024-05-08T18:09:49.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019975822000000001 2024-05-08T18:09:49.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434198+0000", 2024-05-08T18:09:49.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035164000000000001 2024-05-08T18:09:49.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434318+0000", 2024-05-08T18:09:49.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120604 2024-05-08T18:09:49.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.434392+0000", 2024-05-08T18:09:49.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3258999999999998e-05 2024-05-08T18:09:49.421 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.421 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.421 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.421 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:2130 3.39 e93/20 3:9f8cf400:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.K7V9dh3caEYHsi9YlGwMWJrNO2rnOUe_1:head v 93'7, mlcod=90'5)", 2024-05-08T18:09:49.421 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.428375+0000", 2024-05-08T18:09:49.422 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.935920783, 2024-05-08T18:09:49.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020125661, 2024-05-08T18:09:49.422 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.422 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.422 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.422 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.428375+0000", 2024-05-08T18:09:49.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.428375+0000", 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.428378+0000", 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.96e-06 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436642+0000", 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0082638899999999994 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436681+0000", 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8389999999999997e-05 2024-05-08T18:09:49.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436705+0000", 2024-05-08T18:09:49.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4049e-05 2024-05-08T18:09:49.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436805+0000", 2024-05-08T18:09:49.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010063100000000001 2024-05-08T18:09:49.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.436825+0000", 2024-05-08T18:09:49.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9817e-05 2024-05-08T18:09:49.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.448397+0000", 2024-05-08T18:09:49.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011572086000000001 2024-05-08T18:09:49.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.448501+0000", 2024-05-08T18:09:49.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103838 2024-05-08T18:09:49.425 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.425 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.425 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.426 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2139 3.3d 3:bf4c8f68:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.57:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:49.426 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.593560+0000", 2024-05-08T18:09:49.426 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.770736239000001, 2024-05-08T18:09:49.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026176721999999999, 2024-05-08T18:09:49.426 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.426 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.426 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.426 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.426 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.426 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.426 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2139 2024-05-08T18:09:49.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.426 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.593560+0000", 2024-05-08T18:09:49.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.593560+0000", 2024-05-08T18:09:49.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.593564+0000", 2024-05-08T18:09:49.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8330000000000004e-06 2024-05-08T18:09:49.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597295+0000", 2024-05-08T18:09:49.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037317090000000002 2024-05-08T18:09:49.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597337+0000", 2024-05-08T18:09:49.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1628999999999997e-05 2024-05-08T18:09:49.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597356+0000", 2024-05-08T18:09:49.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9079000000000001e-05 2024-05-08T18:09:49.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597523+0000", 2024-05-08T18:09:49.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016655500000000001 2024-05-08T18:09:49.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.597893+0000", 2024-05-08T18:09:49.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037072199999999998 2024-05-08T18:09:49.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:49.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.598918+0000", 2024-05-08T18:09:49.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010249790000000001 2024-05-08T18:09:49.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.618213+0000", 2024-05-08T18:09:49.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019294772000000002 2024-05-08T18:09:49.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619538+0000", 2024-05-08T18:09:49.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001324424 2024-05-08T18:09:49.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619657+0000", 2024-05-08T18:09:49.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119091 2024-05-08T18:09:49.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619737+0000", 2024-05-08T18:09:49.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9929e-05 2024-05-08T18:09:49.431 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.431 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.431 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.431 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2157 3.17 3:e9343ebc:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.60:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:49.431 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.032761+0000", 2024-05-08T18:09:49.431 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.331534849000001, 2024-05-08T18:09:49.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019666783, 2024-05-08T18:09:49.431 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.432 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.432 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.432 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.432 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.432 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.432 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2157 2024-05-08T18:09:49.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.432 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.032761+0000", 2024-05-08T18:09:49.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.032761+0000", 2024-05-08T18:09:49.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.032764+0000", 2024-05-08T18:09:49.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1329999999999999e-06 2024-05-08T18:09:49.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035544+0000", 2024-05-08T18:09:49.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027793679999999999 2024-05-08T18:09:49.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035584+0000", 2024-05-08T18:09:49.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9935999999999998e-05 2024-05-08T18:09:49.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035602+0000", 2024-05-08T18:09:49.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8496e-05 2024-05-08T18:09:49.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.035728+0000", 2024-05-08T18:09:49.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012599200000000001 2024-05-08T18:09:49.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.036019+0000", 2024-05-08T18:09:49.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000290475 2024-05-08T18:09:49.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:49.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.036929+0000", 2024-05-08T18:09:49.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00091045700000000004 2024-05-08T18:09:49.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.049721+0000", 2024-05-08T18:09:49.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012791360999999999 2024-05-08T18:09:49.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.052216+0000", 2024-05-08T18:09:49.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024957619999999999 2024-05-08T18:09:49.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.052350+0000", 2024-05-08T18:09:49.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013327799999999999 2024-05-08T18:09:49.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.052428+0000", 2024-05-08T18:09:49.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8524999999999998e-05 2024-05-08T18:09:49.437 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.437 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.437 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.437 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2166 3.1f 3:fb9a1743:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.eyqVZ0B-P5u9ACEPSRoUzw86bQPcrsX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:49.437 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.348722+0000", 2024-05-08T18:09:49.437 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.015573976999999, 2024-05-08T18:09:49.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020031361000000001, 2024-05-08T18:09:49.437 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.437 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.437 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.437 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.437 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.437 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.438 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2166 2024-05-08T18:09:49.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.438 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.348722+0000", 2024-05-08T18:09:49.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.348722+0000", 2024-05-08T18:09:49.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.348727+0000", 2024-05-08T18:09:49.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4959999999999998e-06 2024-05-08T18:09:49.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.351828+0000", 2024-05-08T18:09:49.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003101786 2024-05-08T18:09:49.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.351865+0000", 2024-05-08T18:09:49.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6519000000000001e-05 2024-05-08T18:09:49.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.351891+0000", 2024-05-08T18:09:49.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6233000000000001e-05 2024-05-08T18:09:49.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.352076+0000", 2024-05-08T18:09:49.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018498000000000001 2024-05-08T18:09:49.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.352511+0000", 2024-05-08T18:09:49.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043521899999999998 2024-05-08T18:09:49.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:49.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.352931+0000", 2024-05-08T18:09:49.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041997900000000001 2024-05-08T18:09:49.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.365888+0000", 2024-05-08T18:09:49.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012956578999999999 2024-05-08T18:09:49.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.368517+0000", 2024-05-08T18:09:49.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002629471 2024-05-08T18:09:49.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.368616+0000", 2024-05-08T18:09:49.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8740999999999995e-05 2024-05-08T18:09:49.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.368754+0000", 2024-05-08T18:09:49.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137358 2024-05-08T18:09:49.442 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.442 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.442 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.443 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2190 3.1 3:8364520c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.6cWLHpOdr1veoeL1lcBsJwZn6mj4f5g_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:49.443 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:32.004731+0000", 2024-05-08T18:09:49.443 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.359565193000002, 2024-05-08T18:09:49.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024468832999999999, 2024-05-08T18:09:49.443 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.443 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.443 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.443 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.443 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.443 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.443 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2190 2024-05-08T18:09:49.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.443 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.004731+0000", 2024-05-08T18:09:49.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.004731+0000", 2024-05-08T18:09:49.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.004734+0000", 2024-05-08T18:09:49.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5299999999999999e-06 2024-05-08T18:09:49.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.006911+0000", 2024-05-08T18:09:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002177203 2024-05-08T18:09:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.006936+0000", 2024-05-08T18:09:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5772e-05 2024-05-08T18:09:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.006950+0000", 2024-05-08T18:09:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.397e-05 2024-05-08T18:09:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.007054+0000", 2024-05-08T18:09:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010354200000000001 2024-05-08T18:09:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.007233+0000", 2024-05-08T18:09:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017882600000000001 2024-05-08T18:09:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.007409+0000", 2024-05-08T18:09:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000176212 2024-05-08T18:09:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.020682+0000", 2024-05-08T18:09:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013272894 2024-05-08T18:09:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.029125+0000", 2024-05-08T18:09:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084428090000000008 2024-05-08T18:09:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.029167+0000", 2024-05-08T18:09:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2409e-05 2024-05-08T18:09:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.029200+0000", 2024-05-08T18:09:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2666000000000002e-05 2024-05-08T18:09:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2203 3.1 3:82cc66a1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.iRfSb7b_Mb9pWyJBdZSShCS0gvDvtAQ_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:32.309316+0000", 2024-05-08T18:09:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.054980196999999, 2024-05-08T18:09:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021097028, 2024-05-08T18:09:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.448 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2203 2024-05-08T18:09:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.309316+0000", 2024-05-08T18:09:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.309316+0000", 2024-05-08T18:09:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.309319+0000", 2024-05-08T18:09:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4000000000000001e-06 2024-05-08T18:09:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311275+0000", 2024-05-08T18:09:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019557720000000002 2024-05-08T18:09:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311313+0000", 2024-05-08T18:09:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8176000000000002e-05 2024-05-08T18:09:49.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311332+0000", 2024-05-08T18:09:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8986000000000001e-05 2024-05-08T18:09:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311414+0000", 2024-05-08T18:09:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1615999999999999e-05 2024-05-08T18:09:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311531+0000", 2024-05-08T18:09:49.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117379 2024-05-08T18:09:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.311651+0000", 2024-05-08T18:09:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119938 2024-05-08T18:09:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.316731+0000", 2024-05-08T18:09:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050797459999999996 2024-05-08T18:09:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.330315+0000", 2024-05-08T18:09:49.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013584311999999999 2024-05-08T18:09:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.330370+0000", 2024-05-08T18:09:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5145000000000001e-05 2024-05-08T18:09:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.330413+0000", 2024-05-08T18:09:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2558000000000001e-05 2024-05-08T18:09:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.453 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2333 3.2b 3:d6cf7d4d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.tRy7Sv7BxoOoArPn6bd9wC4O5pse0_S_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:34.929579+0000", 2024-05-08T18:09:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.434717213000001, 2024-05-08T18:09:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020680451999999998, 2024-05-08T18:09:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2333 2024-05-08T18:09:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.929579+0000", 2024-05-08T18:09:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.929579+0000", 2024-05-08T18:09:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.929581+0000", 2024-05-08T18:09:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2170000000000001e-06 2024-05-08T18:09:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930432+0000", 2024-05-08T18:09:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000850733 2024-05-08T18:09:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930457+0000", 2024-05-08T18:09:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4953999999999999e-05 2024-05-08T18:09:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930468+0000", 2024-05-08T18:09:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1146e-05 2024-05-08T18:09:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930554+0000", 2024-05-08T18:09:49.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6224999999999995e-05 2024-05-08T18:09:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930684+0000", 2024-05-08T18:09:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013002599999999999 2024-05-08T18:09:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.930799+0000", 2024-05-08T18:09:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114677 2024-05-08T18:09:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.936892+0000", 2024-05-08T18:09:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0060934259999999999 2024-05-08T18:09:49.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.950172+0000", 2024-05-08T18:09:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013279783999999999 2024-05-08T18:09:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.950220+0000", 2024-05-08T18:09:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7623999999999997e-05 2024-05-08T18:09:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:34.950259+0000", 2024-05-08T18:09:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.964e-05 2024-05-08T18:09:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2368 3.1b 3:dafb8647:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.o-lCHuSByDkvoT4LKUkRADgejSfQyJd_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:35.599786+0000", 2024-05-08T18:09:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.764510121000001, 2024-05-08T18:09:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01993903, 2024-05-08T18:09:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2368 2024-05-08T18:09:49.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.599786+0000", 2024-05-08T18:09:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.599786+0000", 2024-05-08T18:09:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.599790+0000", 2024-05-08T18:09:49.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0759999999999996e-06 2024-05-08T18:09:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.601733+0000", 2024-05-08T18:09:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019429670000000001 2024-05-08T18:09:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.601787+0000", 2024-05-08T18:09:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4354999999999997e-05 2024-05-08T18:09:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.601815+0000", 2024-05-08T18:09:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7546999999999999e-05 2024-05-08T18:09:49.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.601924+0000", 2024-05-08T18:09:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010891300000000001 2024-05-08T18:09:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.602077+0000", 2024-05-08T18:09:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015319500000000001 2024-05-08T18:09:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.602204+0000", 2024-05-08T18:09:49.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127238 2024-05-08T18:09:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.614205+0000", 2024-05-08T18:09:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012000508 2024-05-08T18:09:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.619624+0000", 2024-05-08T18:09:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054195759999999997 2024-05-08T18:09:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.619667+0000", 2024-05-08T18:09:49.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2552000000000002e-05 2024-05-08T18:09:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.619725+0000", 2024-05-08T18:09:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8103000000000003e-05 2024-05-08T18:09:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2404 3.1 3:8218d405:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.bqgynIkQNaRvS-N0e0aQapo0Dh5XrQ2_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-05-08T18:09:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:36.285791+0000", 2024-05-08T18:09:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.078505454, 2024-05-08T18:09:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023034451000000001, 2024-05-08T18:09:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2404 2024-05-08T18:09:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.285791+0000", 2024-05-08T18:09:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.285791+0000", 2024-05-08T18:09:49.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.285794+0000", 2024-05-08T18:09:49.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0290000000000001e-06 2024-05-08T18:09:49.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.287780+0000", 2024-05-08T18:09:49.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019862360000000002 2024-05-08T18:09:49.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.287815+0000", 2024-05-08T18:09:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5150000000000001e-05 2024-05-08T18:09:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.287830+0000", 2024-05-08T18:09:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4688000000000001e-05 2024-05-08T18:09:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.287909+0000", 2024-05-08T18:09:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9437999999999994e-05 2024-05-08T18:09:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.288035+0000", 2024-05-08T18:09:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012566899999999999 2024-05-08T18:09:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.288141+0000", 2024-05-08T18:09:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106463 2024-05-08T18:09:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.296390+0000", 2024-05-08T18:09:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008248488 2024-05-08T18:09:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.308672+0000", 2024-05-08T18:09:49.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012282039 2024-05-08T18:09:49.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.308760+0000", 2024-05-08T18:09:49.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8350999999999995e-05 2024-05-08T18:09:49.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.308825+0000", 2024-05-08T18:09:49.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4900000000000005e-05 2024-05-08T18:09:49.469 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.469 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.469 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.469 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.470 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.470 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:49.471 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:09:49.472 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:49.468+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:49.571 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:49.576+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:49.603 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:49.603 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:49.603 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:49.603 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:49.616 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:09:49.673 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-08T18:09:49.672+0000 7fd4ba355640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25273) UID: 0 2024-05-08T18:09:49.773 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:49.772+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:49.780 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:49.780 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:49.780 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:49.780 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:49.780 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:49.794 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:09:49.875 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:49.872+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:49.919 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:49.919 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:49.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:49.920 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:49.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.920 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1190 3.31 3:8c795880:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:49.920 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:06.973959+0000", 2024-05-08T18:09:49.920 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.948462646000003, 2024-05-08T18:09:49.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025546121000000001, 2024-05-08T18:09:49.920 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.920 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.920 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.920 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.920 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.920 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.920 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1190 2024-05-08T18:09:49.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.973959+0000", 2024-05-08T18:09:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.973959+0000", 2024-05-08T18:09:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.973961+0000", 2024-05-08T18:09:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6740000000000001e-06 2024-05-08T18:09:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.976932+0000", 2024-05-08T18:09:49.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002971062 2024-05-08T18:09:49.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.976957+0000", 2024-05-08T18:09:49.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4865999999999999e-05 2024-05-08T18:09:49.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.976969+0000", 2024-05-08T18:09:49.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1419e-05 2024-05-08T18:09:49.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.977041+0000", 2024-05-08T18:09:49.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2389000000000001e-05 2024-05-08T18:09:49.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.977198+0000", 2024-05-08T18:09:49.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015675800000000001 2024-05-08T18:09:49.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:49.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.977368+0000", 2024-05-08T18:09:49.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017024299999999999 2024-05-08T18:09:49.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.989016+0000", 2024-05-08T18:09:49.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011647719000000001 2024-05-08T18:09:49.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.999371+0000", 2024-05-08T18:09:49.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010354942000000001 2024-05-08T18:09:49.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.999441+0000", 2024-05-08T18:09:49.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0166000000000005e-05 2024-05-08T18:09:49.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.925 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.925 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.999505+0000", 2024-05-08T18:09:49.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3882999999999998e-05 2024-05-08T18:09:49.925 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.925 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.925 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.925 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1192 3.1e 3:7833f47f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:49.925 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:06.995724+0000", 2024-05-08T18:09:49.925 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.926697494000003, 2024-05-08T18:09:49.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019501026000000001, 2024-05-08T18:09:49.925 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.926 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.926 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.926 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.926 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.926 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.926 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1192 2024-05-08T18:09:49.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.926 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.995724+0000", 2024-05-08T18:09:49.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.995724+0000", 2024-05-08T18:09:49.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.995727+0000", 2024-05-08T18:09:49.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5449999999999999e-06 2024-05-08T18:09:49.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997495+0000", 2024-05-08T18:09:49.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001768167 2024-05-08T18:09:49.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997520+0000", 2024-05-08T18:09:49.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4672e-05 2024-05-08T18:09:49.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997541+0000", 2024-05-08T18:09:49.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1022e-05 2024-05-08T18:09:49.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997626+0000", 2024-05-08T18:09:49.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5096e-05 2024-05-08T18:09:49.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997751+0000", 2024-05-08T18:09:49.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012461500000000001 2024-05-08T18:09:49.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:49.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:06.997853+0000", 2024-05-08T18:09:49.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010228199999999999 2024-05-08T18:09:49.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.005501+0000", 2024-05-08T18:09:49.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076478550000000003 2024-05-08T18:09:49.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.014958+0000", 2024-05-08T18:09:49.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0094574370000000008 2024-05-08T18:09:49.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.015084+0000", 2024-05-08T18:09:49.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125105 2024-05-08T18:09:49.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.015225+0000", 2024-05-08T18:09:49.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014123 2024-05-08T18:09:49.930 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.930 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.930 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.930 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1203 3.1a e85/20 3:592e440d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_15:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:49.930 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.119764+0000", 2024-05-08T18:09:49.931 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.802656949000003, 2024-05-08T18:09:49.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016393982000000001, 2024-05-08T18:09:49.931 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.931 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.931 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.931 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.119764+0000", 2024-05-08T18:09:49.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.931 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.931 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.119764+0000", 2024-05-08T18:09:49.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.119766+0000", 2024-05-08T18:09:49.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9750000000000001e-06 2024-05-08T18:09:49.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.124838+0000", 2024-05-08T18:09:49.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050712480000000004 2024-05-08T18:09:49.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.124870+0000", 2024-05-08T18:09:49.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2974e-05 2024-05-08T18:09:49.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.124884+0000", 2024-05-08T18:09:49.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3202e-05 2024-05-08T18:09:49.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.124992+0000", 2024-05-08T18:09:49.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108199 2024-05-08T18:09:49.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.125028+0000", 2024-05-08T18:09:49.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6050000000000002e-05 2024-05-08T18:09:49.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.136085+0000", 2024-05-08T18:09:49.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011057320000000001 2024-05-08T18:09:49.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.136158+0000", 2024-05-08T18:09:49.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3014000000000003e-05 2024-05-08T18:09:49.934 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.934 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.934 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.934 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1227 3.6 e85/20 3:6359f987:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_11:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:49.934 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.688168+0000", 2024-05-08T18:09:49.934 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.234252802999997, 2024-05-08T18:09:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018452023000000001, 2024-05-08T18:09:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.688168+0000", 2024-05-08T18:09:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.688168+0000", 2024-05-08T18:09:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.688170+0000", 2024-05-08T18:09:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6330000000000001e-06 2024-05-08T18:09:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.691987+0000", 2024-05-08T18:09:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003817076 2024-05-08T18:09:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.692031+0000", 2024-05-08T18:09:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3509e-05 2024-05-08T18:09:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.692054+0000", 2024-05-08T18:09:49.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3419999999999999e-05 2024-05-08T18:09:49.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.692204+0000", 2024-05-08T18:09:49.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015017900000000001 2024-05-08T18:09:49.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.692272+0000", 2024-05-08T18:09:49.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7410999999999995e-05 2024-05-08T18:09:49.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706582+0000", 2024-05-08T18:09:49.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014310671000000001 2024-05-08T18:09:49.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.706620+0000", 2024-05-08T18:09:49.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8124000000000003e-05 2024-05-08T18:09:49.938 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.938 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.938 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.938 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1246 3.6 e85/20 3:6220dfe7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_2:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:49.938 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.364093+0000", 2024-05-08T18:09:49.938 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 41.558328502999998, 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016480529000000001, 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.364093+0000", 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.364093+0000", 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.364095+0000", 2024-05-08T18:09:49.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1789999999999998e-06 2024-05-08T18:09:49.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.366818+0000", 2024-05-08T18:09:49.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027231270000000001 2024-05-08T18:09:49.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.366852+0000", 2024-05-08T18:09:49.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4106999999999997e-05 2024-05-08T18:09:49.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.366867+0000", 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4715000000000001e-05 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.366955+0000", 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8398000000000003e-05 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.366986+0000", 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0433000000000002e-05 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380506+0000", 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013520628999999999 2024-05-08T18:09:49.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.380573+0000", 2024-05-08T18:09:49.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6940999999999995e-05 2024-05-08T18:09:49.942 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.942 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.942 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.942 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1257 3.31 3:8ed6384b:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:49.942 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.507760+0000", 2024-05-08T18:09:49.942 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 41.414661350000003, 2024-05-08T18:09:49.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017518249999999999, 2024-05-08T18:09:49.942 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.943 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.943 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.943 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.943 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.943 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.943 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1257 2024-05-08T18:09:49.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.943 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507760+0000", 2024-05-08T18:09:49.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507760+0000", 2024-05-08T18:09:49.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.507764+0000", 2024-05-08T18:09:49.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7069999999999998e-06 2024-05-08T18:09:49.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510115+0000", 2024-05-08T18:09:49.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023510150000000001 2024-05-08T18:09:49.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510152+0000", 2024-05-08T18:09:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7234000000000003e-05 2024-05-08T18:09:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510168+0000", 2024-05-08T18:09:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5764e-05 2024-05-08T18:09:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510264+0000", 2024-05-08T18:09:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6362999999999999e-05 2024-05-08T18:09:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510466+0000", 2024-05-08T18:09:49.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020249999999999999 2024-05-08T18:09:49.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:49.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.510644+0000", 2024-05-08T18:09:49.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017767299999999999 2024-05-08T18:09:49.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.516056+0000", 2024-05-08T18:09:49.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054117770000000004 2024-05-08T18:09:49.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.525154+0000", 2024-05-08T18:09:49.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090977999999999996 2024-05-08T18:09:49.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.525224+0000", 2024-05-08T18:09:49.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0204999999999996e-05 2024-05-08T18:09:49.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.525278+0000", 2024-05-08T18:09:49.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4212000000000002e-05 2024-05-08T18:09:49.947 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.947 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.947 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.947 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1266 3.4 3:21e00898:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:08.610411+0000", 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 41.312010643999997, 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017041107999999999, 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1266 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.610411+0000", 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.610411+0000", 2024-05-08T18:09:49.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.610414+0000", 2024-05-08T18:09:49.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.732e-06 2024-05-08T18:09:49.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.612834+0000", 2024-05-08T18:09:49.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024191949999999999 2024-05-08T18:09:49.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.612866+0000", 2024-05-08T18:09:49.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2271999999999999e-05 2024-05-08T18:09:49.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.612880+0000", 2024-05-08T18:09:49.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4202000000000001e-05 2024-05-08T18:09:49.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.612987+0000", 2024-05-08T18:09:49.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106661 2024-05-08T18:09:49.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.613152+0000", 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016484900000000001 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.613303+0000", 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151509 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.622289+0000", 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089858160000000006 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.627348+0000", 2024-05-08T18:09:49.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005059638 2024-05-08T18:09:49.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.627401+0000", 2024-05-08T18:09:49.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2191999999999998e-05 2024-05-08T18:09:49.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:08.627452+0000", 2024-05-08T18:09:49.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1041999999999997e-05 2024-05-08T18:09:49.952 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.952 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.952 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.952 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1284 3.1e 3:7ad9fe5d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:49.953 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:09.185629+0000", 2024-05-08T18:09:49.953 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 40.736791967999999, 2024-05-08T18:09:49.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.029384772999999999, 2024-05-08T18:09:49.953 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.953 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.953 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.953 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.953 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.953 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.953 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1284 2024-05-08T18:09:49.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.953 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.185629+0000", 2024-05-08T18:09:49.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.185629+0000", 2024-05-08T18:09:49.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.185633+0000", 2024-05-08T18:09:49.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6030000000000001e-06 2024-05-08T18:09:49.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.188065+0000", 2024-05-08T18:09:49.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002431768 2024-05-08T18:09:49.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.188092+0000", 2024-05-08T18:09:49.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7849999999999999e-05 2024-05-08T18:09:49.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.188106+0000", 2024-05-08T18:09:49.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3977e-05 2024-05-08T18:09:49.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.188207+0000", 2024-05-08T18:09:49.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010083 2024-05-08T18:09:49.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:09:49.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.188218+0000", 2024-05-08T18:09:49.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0954999999999999e-05 2024-05-08T18:09:49.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.198300+0000", 2024-05-08T18:09:49.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010081543 2024-05-08T18:09:49.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.198481+0000", 2024-05-08T18:09:49.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018105399999999999 2024-05-08T18:09:49.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:49.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.198658+0000", 2024-05-08T18:09:49.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017734599999999999 2024-05-08T18:09:49.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.206728+0000", 2024-05-08T18:09:49.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0080693320000000002 2024-05-08T18:09:49.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.214880+0000", 2024-05-08T18:09:49.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008152767 2024-05-08T18:09:49.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.214957+0000", 2024-05-08T18:09:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6230999999999996e-05 2024-05-08T18:09:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.215014+0000", 2024-05-08T18:09:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7516999999999998e-05 2024-05-08T18:09:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1396 3.0 3:01138f2d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:49.959 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.783501+0000", 2024-05-08T18:09:49.959 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.138920681999998, 2024-05-08T18:09:49.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021225469, 2024-05-08T18:09:49.959 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.959 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.959 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.959 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.959 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.959 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.959 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1396 2024-05-08T18:09:49.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.959 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.783501+0000", 2024-05-08T18:09:49.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.783501+0000", 2024-05-08T18:09:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.783503+0000", 2024-05-08T18:09:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6639999999999998e-06 2024-05-08T18:09:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.785066+0000", 2024-05-08T18:09:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015625389999999999 2024-05-08T18:09:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.785088+0000", 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2538e-05 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.785101+0000", 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2274e-05 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.785191+0000", 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9992000000000002e-05 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-08T18:09:49.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.785199+0000", 2024-05-08T18:09:49.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6270000000000006e-06 2024-05-08T18:09:49.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.787346+0000", 2024-05-08T18:09:49.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002146677 2024-05-08T18:09:49.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.787499+0000", 2024-05-08T18:09:49.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000153523 2024-05-08T18:09:49.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:49.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.787648+0000", 2024-05-08T18:09:49.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014867999999999999 2024-05-08T18:09:49.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.796686+0000", 2024-05-08T18:09:49.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090379859999999996 2024-05-08T18:09:49.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.804546+0000", 2024-05-08T18:09:49.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0078594770000000001 2024-05-08T18:09:49.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.804645+0000", 2024-05-08T18:09:49.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9269000000000001e-05 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.804726+0000", 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1223000000000005e-05 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1454 3.1a e87/20 3:5820ba98:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_4:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.374062+0000", 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.548359269999999, 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024401293000000001, 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.964 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.374062+0000", 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.374062+0000", 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.374065+0000", 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.05e-06 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.380308+0000", 2024-05-08T18:09:49.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062425099999999997 2024-05-08T18:09:49.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.380346+0000", 2024-05-08T18:09:49.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8679e-05 2024-05-08T18:09:49.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.380364+0000", 2024-05-08T18:09:49.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7897000000000002e-05 2024-05-08T18:09:49.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.380531+0000", 2024-05-08T18:09:49.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016653499999999999 2024-05-08T18:09:49.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.380624+0000", 2024-05-08T18:09:49.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3189000000000005e-05 2024-05-08T18:09:49.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.398276+0000", 2024-05-08T18:09:49.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017652151000000001 2024-05-08T18:09:49.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.398463+0000", 2024-05-08T18:09:49.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018728199999999999 2024-05-08T18:09:49.968 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.968 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.968 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.968 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1459 3.25 3:a5b1b07d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:49.968 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.475662+0000", 2024-05-08T18:09:49.968 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.446759086, 2024-05-08T18:09:49.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026407317, 2024-05-08T18:09:49.968 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.968 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.968 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.969 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.969 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.969 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.969 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1459 2024-05-08T18:09:49.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.969 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.475662+0000", 2024-05-08T18:09:49.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.475662+0000", 2024-05-08T18:09:49.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.475666+0000", 2024-05-08T18:09:49.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.206e-06 2024-05-08T18:09:49.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481021+0000", 2024-05-08T18:09:49.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.005354981 2024-05-08T18:09:49.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481069+0000", 2024-05-08T18:09:49.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7722000000000002e-05 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481096+0000", 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6737000000000002e-05 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481275+0000", 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000178806 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481544+0000", 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026962399999999999 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:49.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481794+0000", 2024-05-08T18:09:49.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024961200000000002 2024-05-08T18:09:49.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.490808+0000", 2024-05-08T18:09:49.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090146419999999998 2024-05-08T18:09:49.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.501769+0000", 2024-05-08T18:09:49.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010960437 2024-05-08T18:09:49.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.501939+0000", 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169915 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.502069+0000", 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013063500000000001 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1922 3.4 3:22938f7c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.23:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.257795+0000", 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.664626069000001, 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022203639000000001, 2024-05-08T18:09:49.973 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.974 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.974 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.974 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.974 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.974 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.974 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1922 2024-05-08T18:09:49.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.974 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.257795+0000", 2024-05-08T18:09:49.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.257795+0000", 2024-05-08T18:09:49.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.257798+0000", 2024-05-08T18:09:49.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7640000000000001e-06 2024-05-08T18:09:49.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.261913+0000", 2024-05-08T18:09:49.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041147900000000001 2024-05-08T18:09:49.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.261954+0000", 2024-05-08T18:09:49.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1551999999999998e-05 2024-05-08T18:09:49.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.261980+0000", 2024-05-08T18:09:49.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5692999999999999e-05 2024-05-08T18:09:49.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.262169+0000", 2024-05-08T18:09:49.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018944200000000001 2024-05-08T18:09:49.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.262428+0000", 2024-05-08T18:09:49.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000258807 2024-05-08T18:09:49.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:49.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.263242+0000", 2024-05-08T18:09:49.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00081388000000000001 2024-05-08T18:09:49.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.276171+0000", 2024-05-08T18:09:49.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012928822 2024-05-08T18:09:49.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.279811+0000", 2024-05-08T18:09:49.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003640192 2024-05-08T18:09:49.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.279923+0000", 2024-05-08T18:09:49.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112111 2024-05-08T18:09:49.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.279999+0000", 2024-05-08T18:09:49.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5586000000000004e-05 2024-05-08T18:09:49.978 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.978 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.978 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.978 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1925 3.1e 3:7b22772f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.f9IQ_hbLdIRU4qgZOuIL42noK1mqHg9_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:49.978 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.378495+0000", 2024-05-08T18:09:49.979 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.543926623000001, 2024-05-08T18:09:49.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020602933, 2024-05-08T18:09:49.979 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.979 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.979 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.979 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.979 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.979 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.979 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1925 2024-05-08T18:09:49.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.979 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.378495+0000", 2024-05-08T18:09:49.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.378495+0000", 2024-05-08T18:09:49.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.378499+0000", 2024-05-08T18:09:49.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9469999999999996e-06 2024-05-08T18:09:49.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381093+0000", 2024-05-08T18:09:49.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025949129999999999 2024-05-08T18:09:49.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381142+0000", 2024-05-08T18:09:49.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8123e-05 2024-05-08T18:09:49.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381170+0000", 2024-05-08T18:09:49.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7996000000000001e-05 2024-05-08T18:09:49.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381318+0000", 2024-05-08T18:09:49.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014873100000000001 2024-05-08T18:09:49.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381588+0000", 2024-05-08T18:09:49.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026920900000000002 2024-05-08T18:09:49.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:49.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.381814+0000", 2024-05-08T18:09:49.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000226412 2024-05-08T18:09:49.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.392475+0000", 2024-05-08T18:09:49.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010661547 2024-05-08T18:09:49.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.398954+0000", 2024-05-08T18:09:49.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006478658 2024-05-08T18:09:49.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.399036+0000", 2024-05-08T18:09:49.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2300999999999997e-05 2024-05-08T18:09:49.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.399098+0000", 2024-05-08T18:09:49.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1095999999999999e-05 2024-05-08T18:09:49.983 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.983 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.983 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.984 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1960 3.0 3:02610446:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.29:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:49.984 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:27.095423+0000", 2024-05-08T18:09:49.984 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 22.826998453000002, 2024-05-08T18:09:49.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023746634999999999, 2024-05-08T18:09:49.984 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.984 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.984 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.984 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.984 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.984 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.984 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1960 2024-05-08T18:09:49.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.984 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.095423+0000", 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.095423+0000", 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.095426+0000", 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9569999999999998e-06 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.097717+0000", 2024-05-08T18:09:49.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022911160000000002 2024-05-08T18:09:49.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.097759+0000", 2024-05-08T18:09:49.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2178999999999997e-05 2024-05-08T18:09:49.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.097777+0000", 2024-05-08T18:09:49.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8255999999999999e-05 2024-05-08T18:09:49.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.097926+0000", 2024-05-08T18:09:49.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014899100000000001 2024-05-08T18:09:49.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.098285+0000", 2024-05-08T18:09:49.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035904099999999999 2024-05-08T18:09:49.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:49.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.099249+0000", 2024-05-08T18:09:49.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00096372000000000005 2024-05-08T18:09:49.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.109626+0000", 2024-05-08T18:09:49.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010376849 2024-05-08T18:09:49.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.118973+0000", 2024-05-08T18:09:49.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0093474160000000008 2024-05-08T18:09:49.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.119093+0000", 2024-05-08T18:09:49.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119615 2024-05-08T18:09:49.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.119169+0000", 2024-05-08T18:09:49.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6495000000000005e-05 2024-05-08T18:09:49.989 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.989 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.989 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.989 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1966 3.25 3:a7ea9643:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.30:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:49.989 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:27.248331+0000", 2024-05-08T18:09:49.989 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 22.674090218, 2024-05-08T18:09:49.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018780688, 2024-05-08T18:09:49.989 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.989 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.989 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.989 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.989 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.989 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.989 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1966 2024-05-08T18:09:49.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.990 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.248331+0000", 2024-05-08T18:09:49.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.248331+0000", 2024-05-08T18:09:49.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.248334+0000", 2024-05-08T18:09:49.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4839999999999998e-06 2024-05-08T18:09:49.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.250557+0000", 2024-05-08T18:09:49.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022238319999999998 2024-05-08T18:09:49.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.250588+0000", 2024-05-08T18:09:49.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1041999999999999e-05 2024-05-08T18:09:49.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.250601+0000", 2024-05-08T18:09:49.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2928999999999999e-05 2024-05-08T18:09:49.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.250695+0000", 2024-05-08T18:09:49.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4011999999999994e-05 2024-05-08T18:09:49.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.250854+0000", 2024-05-08T18:09:49.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015883600000000001 2024-05-08T18:09:49.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:49.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.251385+0000", 2024-05-08T18:09:49.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053124200000000002 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.265113+0000", 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013727614000000001 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.266991+0000", 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001878275 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.267051+0000", 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9363000000000001e-05 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.267112+0000", 2024-05-08T18:09:49.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1058999999999999e-05 2024-05-08T18:09:49.994 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.994 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.994 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.994 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2136 3.3e 3:7e6feb55:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.HfAxvQBa5Hc-UtPiYKXpRY3njm6jIb-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:49.994 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.563178+0000", 2024-05-08T18:09:49.994 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.359243662000001, 2024-05-08T18:09:49.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024664469000000001, 2024-05-08T18:09:49.994 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.994 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:49.994 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:49.994 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:49.995 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:49.995 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:49.995 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2136 2024-05-08T18:09:49.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.995 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:49.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:49.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.563178+0000", 2024-05-08T18:09:49.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:49.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.563178+0000", 2024-05-08T18:09:49.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:49.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.563181+0000", 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.676e-06 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.565700+0000", 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025191860000000001 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.565745+0000", 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4438999999999999e-05 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:49.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.565766+0000", 2024-05-08T18:09:49.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0905999999999999e-05 2024-05-08T18:09:49.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:49.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.565934+0000", 2024-05-08T18:09:49.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016784699999999999 2024-05-08T18:09:49.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:49.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.566337+0000", 2024-05-08T18:09:49.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040316700000000001 2024-05-08T18:09:49.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:49.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.566743+0000", 2024-05-08T18:09:49.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040581900000000003 2024-05-08T18:09:49.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:49.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.584555+0000", 2024-05-08T18:09:49.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017812093000000001 2024-05-08T18:09:49.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:49.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.587652+0000", 2024-05-08T18:09:49.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00309706 2024-05-08T18:09:49.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:49.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.587774+0000", 2024-05-08T18:09:49.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012271499999999999 2024-05-08T18:09:49.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:49.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.587842+0000", 2024-05-08T18:09:49.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7560999999999999e-05 2024-05-08T18:09:49.999 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.999 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:49.999 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:49.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:49.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:49.999 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2142 3.1e 3:7b76bf40:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.dbl7KmEpihzAmy1_6tIHfaLaiCXT2yc_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:49.999 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.723193+0000", 2024-05-08T18:09:49.999 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.199228175999998, 2024-05-08T18:09:49.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018688923, 2024-05-08T18:09:49.999 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:49.999 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.000 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.000 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.000 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.000 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.000 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2142 2024-05-08T18:09:50.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.000 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.723193+0000", 2024-05-08T18:09:50.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.723193+0000", 2024-05-08T18:09:50.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.723197+0000", 2024-05-08T18:09:50.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8600000000000003e-06 2024-05-08T18:09:50.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.726285+0000", 2024-05-08T18:09:50.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030876480000000001 2024-05-08T18:09:50.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.726331+0000", 2024-05-08T18:09:50.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6903000000000001e-05 2024-05-08T18:09:50.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.726351+0000", 2024-05-08T18:09:50.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9769999999999999e-05 2024-05-08T18:09:50.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.726487+0000", 2024-05-08T18:09:50.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013600400000000001 2024-05-08T18:09:50.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.726752+0000", 2024-05-08T18:09:50.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026510200000000002 2024-05-08T18:09:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.727027+0000", 2024-05-08T18:09:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027441199999999997 2024-05-08T18:09:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.736805+0000", 2024-05-08T18:09:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0097778540000000008 2024-05-08T18:09:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.741782+0000", 2024-05-08T18:09:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049770989999999996 2024-05-08T18:09:50.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.741837+0000", 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5671999999999998e-05 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.741882+0000", 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4598999999999998e-05 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:2181 3.8 e93/20 3:12ff5737:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.64:head v 93'9, mlcod=87'7)", 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.752726+0000", 2024-05-08T18:09:50.004 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.169694985, 2024-05-08T18:09:50.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017928070000000001, 2024-05-08T18:09:50.005 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.005 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.005 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.005 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.752726+0000", 2024-05-08T18:09:50.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.752726+0000", 2024-05-08T18:09:50.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.752728+0000", 2024-05-08T18:09:50.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6479999999999999e-06 2024-05-08T18:09:50.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.755318+0000", 2024-05-08T18:09:50.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025904470000000001 2024-05-08T18:09:50.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.755348+0000", 2024-05-08T18:09:50.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0012999999999999e-05 2024-05-08T18:09:50.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.755366+0000", 2024-05-08T18:09:50.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7634000000000001e-05 2024-05-08T18:09:50.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.755466+0000", 2024-05-08T18:09:50.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9993000000000003e-05 2024-05-08T18:09:50.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.755502+0000", 2024-05-08T18:09:50.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6078000000000003e-05 2024-05-08T18:09:50.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.770536+0000", 2024-05-08T18:09:50.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015033786 2024-05-08T18:09:50.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.770654+0000", 2024-05-08T18:09:50.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118471 2024-05-08T18:09:50.008 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.008 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.008 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.008 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2184 3.4 3:22f35135:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.6RUONhXxP9eF42Kebi9zd8ZJKTDUTd3_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:50.008 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.864429+0000", 2024-05-08T18:09:50.008 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.057992683999998, 2024-05-08T18:09:50.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019853949999999999, 2024-05-08T18:09:50.008 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.009 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.009 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.009 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.009 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.009 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.009 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2184 2024-05-08T18:09:50.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.009 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.864429+0000", 2024-05-08T18:09:50.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.864429+0000", 2024-05-08T18:09:50.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.864431+0000", 2024-05-08T18:09:50.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6819999999999999e-06 2024-05-08T18:09:50.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866285+0000", 2024-05-08T18:09:50.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001853941 2024-05-08T18:09:50.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866316+0000", 2024-05-08T18:09:50.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1186999999999998e-05 2024-05-08T18:09:50.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866331+0000", 2024-05-08T18:09:50.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4956999999999999e-05 2024-05-08T18:09:50.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866416+0000", 2024-05-08T18:09:50.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4882000000000005e-05 2024-05-08T18:09:50.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866610+0000", 2024-05-08T18:09:50.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019346700000000001 2024-05-08T18:09:50.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:50.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.866803+0000", 2024-05-08T18:09:50.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019362099999999999 2024-05-08T18:09:50.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.884053+0000", 2024-05-08T18:09:50.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017250168 2024-05-08T18:09:50.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.884145+0000", 2024-05-08T18:09:50.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1782999999999999e-05 2024-05-08T18:09:50.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.884204+0000", 2024-05-08T18:09:50.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8511000000000003e-05 2024-05-08T18:09:50.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.884283+0000", 2024-05-08T18:09:50.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8751000000000005e-05 2024-05-08T18:09:50.013 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.013 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.013 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.014 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2365 3.31 3:8db5ccf0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.93:head [create,setxattr user.rgw.idtag (61) in=14b,setxattr user.rgw.tail_tag (61) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:50.014 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:35.496834+0000", 2024-05-08T18:09:50.014 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.42558676, 2024-05-08T18:09:50.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019483308000000001, 2024-05-08T18:09:50.014 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.014 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.014 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.014 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.014 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.014 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.014 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2365 2024-05-08T18:09:50.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.014 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.496834+0000", 2024-05-08T18:09:50.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.496834+0000", 2024-05-08T18:09:50.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.496836+0000", 2024-05-08T18:09:50.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.265e-06 2024-05-08T18:09:50.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499074+0000", 2024-05-08T18:09:50.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002237789 2024-05-08T18:09:50.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499101+0000", 2024-05-08T18:09:50.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7251e-05 2024-05-08T18:09:50.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499112+0000", 2024-05-08T18:09:50.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.135e-05 2024-05-08T18:09:50.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499189+0000", 2024-05-08T18:09:50.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6567000000000001e-05 2024-05-08T18:09:50.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499364+0000", 2024-05-08T18:09:50.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017557200000000001 2024-05-08T18:09:50.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:50.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.499845+0000", 2024-05-08T18:09:50.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000480292 2024-05-08T18:09:50.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.515138+0000", 2024-05-08T18:09:50.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01529324 2024-05-08T18:09:50.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.516091+0000", 2024-05-08T18:09:50.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00095270100000000003 2024-05-08T18:09:50.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.516218+0000", 2024-05-08T18:09:50.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012745700000000001 2024-05-08T18:09:50.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:35.516318+0000", 2024-05-08T18:09:50.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9823999999999998e-05 2024-05-08T18:09:50.019 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.019 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.019 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.019 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.019 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.019 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:50.020 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:09:50.021 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:09:50.021 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:50.020+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:50.122 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:50.120+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:50.125 INFO:tasks.workunit.client.0.smithi080.stdout:user 0.353962627795653 deleted 2024-05-08T18:09:50.132 INFO:tasks.workunit.client.0.smithi080.stdout:OK 2024-05-08T18:09:50.132 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T18:09:50.132 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T18:09:50.183 INFO:tasks.workunit:Stopping ['rgw/s3_multipart_upload.pl'] on client.0... 2024-05-08T18:09:50.183 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-08T18:09:50.188 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:50.188 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:50.188 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:50.188 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:50.206 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:09:50.255 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T18:09:50.260+0000 7f55e4fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25193) UID: 0 2024-05-08T18:09:50.323 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-08T18:09:50.324+0000 7fc68220a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25268) UID: 0 2024-05-08T18:09:50.369 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:50.369 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:50.369 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:50.369 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:50.369 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:50.383 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:09:50.433 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T18:09:50.440+0000 7f2d7ad80640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25198) UID: 0 2024-05-08T18:09:50.484 DEBUG:teuthology.parallel:result is None 2024-05-08T18:09:50.484 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T18:09:50.503 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:50.503 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:50.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:50.504 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:50.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.504 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1197 3.2e 3:760a6639:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:50.504 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.051025+0000", 2024-05-08T18:09:50.504 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.455094484999996, 2024-05-08T18:09:50.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021808514000000001, 2024-05-08T18:09:50.504 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.504 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.504 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.504 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.504 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.504 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.504 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1197 2024-05-08T18:09:50.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.505 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.051025+0000", 2024-05-08T18:09:50.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.051025+0000", 2024-05-08T18:09:50.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.051028+0000", 2024-05-08T18:09:50.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2839999999999998e-06 2024-05-08T18:09:50.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.054428+0000", 2024-05-08T18:09:50.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033998449999999999 2024-05-08T18:09:50.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.054454+0000", 2024-05-08T18:09:50.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5800999999999999e-05 2024-05-08T18:09:50.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.054468+0000", 2024-05-08T18:09:50.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4222999999999999e-05 2024-05-08T18:09:50.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.054550+0000", 2024-05-08T18:09:50.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2702999999999997e-05 2024-05-08T18:09:50.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.054736+0000", 2024-05-08T18:09:50.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018505099999999999 2024-05-08T18:09:50.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:50.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.054910+0000", 2024-05-08T18:09:50.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017438999999999999 2024-05-08T18:09:50.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.064167+0000", 2024-05-08T18:09:50.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0092570510000000005 2024-05-08T18:09:50.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.072684+0000", 2024-05-08T18:09:50.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085174129999999997 2024-05-08T18:09:50.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.072764+0000", 2024-05-08T18:09:50.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9104999999999996e-05 2024-05-08T18:09:50.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.072833+0000", 2024-05-08T18:09:50.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9647999999999995e-05 2024-05-08T18:09:50.509 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.509 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.509 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.509 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1201 3.f 3:f0c9f301:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:50.509 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.093741+0000", 2024-05-08T18:09:50.509 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.412378468999997, 2024-05-08T18:09:50.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019020305000000001, 2024-05-08T18:09:50.510 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.510 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.510 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.510 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.510 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.510 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.510 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1201 2024-05-08T18:09:50.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.510 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.093741+0000", 2024-05-08T18:09:50.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.093741+0000", 2024-05-08T18:09:50.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.093744+0000", 2024-05-08T18:09:50.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9299999999999999e-06 2024-05-08T18:09:50.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.095182+0000", 2024-05-08T18:09:50.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014389030000000001 2024-05-08T18:09:50.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.095215+0000", 2024-05-08T18:09:50.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2783000000000001e-05 2024-05-08T18:09:50.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.095230+0000", 2024-05-08T18:09:50.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4986e-05 2024-05-08T18:09:50.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.095337+0000", 2024-05-08T18:09:50.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010696600000000001 2024-05-08T18:09:50.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.095493+0000", 2024-05-08T18:09:50.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015615299999999999 2024-05-08T18:09:50.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:50.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.095647+0000", 2024-05-08T18:09:50.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015379 2024-05-08T18:09:50.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.102582+0000", 2024-05-08T18:09:50.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0069345029999999998 2024-05-08T18:09:50.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.112643+0000", 2024-05-08T18:09:50.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010061439 2024-05-08T18:09:50.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.112708+0000", 2024-05-08T18:09:50.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4890999999999999e-05 2024-05-08T18:09:50.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.112761+0000", 2024-05-08T18:09:50.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2961000000000003e-05 2024-05-08T18:09:50.515 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.515 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.515 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.515 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1204 3.2e 3:748aabc2:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:50.515 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.123555+0000", 2024-05-08T18:09:50.515 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.382563783999998, 2024-05-08T18:09:50.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018601724, 2024-05-08T18:09:50.515 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.515 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.515 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.515 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.516 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.516 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.516 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1204 2024-05-08T18:09:50.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.516 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.123555+0000", 2024-05-08T18:09:50.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.123555+0000", 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.123558+0000", 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.125312+0000", 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001753526 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.125334+0000", 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2700999999999998e-05 2024-05-08T18:09:50.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.125346+0000", 2024-05-08T18:09:50.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2054e-05 2024-05-08T18:09:50.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.125434+0000", 2024-05-08T18:09:50.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7307999999999998e-05 2024-05-08T18:09:50.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.125621+0000", 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018727899999999999 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.125792+0000", 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017101599999999999 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.136124+0000", 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010331633999999999 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.142030+0000", 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059065899999999998 2024-05-08T18:09:50.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.142104+0000", 2024-05-08T18:09:50.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3370999999999999e-05 2024-05-08T18:09:50.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.142157+0000", 2024-05-08T18:09:50.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3538000000000001e-05 2024-05-08T18:09:50.520 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.520 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.520 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.520 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1223 3.2e 3:74a5b043:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:50.521 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.619449+0000", 2024-05-08T18:09:50.521 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.886670332000001, 2024-05-08T18:09:50.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022896092, 2024-05-08T18:09:50.521 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.521 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.521 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.521 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.521 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.521 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.521 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1223 2024-05-08T18:09:50.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.521 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.619449+0000", 2024-05-08T18:09:50.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.619449+0000", 2024-05-08T18:09:50.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.619452+0000", 2024-05-08T18:09:50.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0139999999999999e-06 2024-05-08T18:09:50.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.623169+0000", 2024-05-08T18:09:50.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037173620000000001 2024-05-08T18:09:50.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.623198+0000", 2024-05-08T18:09:50.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8436e-05 2024-05-08T18:09:50.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.623212+0000", 2024-05-08T18:09:50.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4375999999999999e-05 2024-05-08T18:09:50.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.623288+0000", 2024-05-08T18:09:50.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5548000000000002e-05 2024-05-08T18:09:50.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.623403+0000", 2024-05-08T18:09:50.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115369 2024-05-08T18:09:50.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:50.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.623502+0000", 2024-05-08T18:09:50.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9420999999999996e-05 2024-05-08T18:09:50.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.630872+0000", 2024-05-08T18:09:50.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00736997 2024-05-08T18:09:50.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.642200+0000", 2024-05-08T18:09:50.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011327802999999999 2024-05-08T18:09:50.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.642266+0000", 2024-05-08T18:09:50.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6223000000000006e-05 2024-05-08T18:09:50.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.642345+0000", 2024-05-08T18:09:50.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8570000000000002e-05 2024-05-08T18:09:50.526 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.526 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.526 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.526 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1225 3.2a 3:5632ffeb:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:50.526 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.662322+0000", 2024-05-08T18:09:50.526 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.843797416999998, 2024-05-08T18:09:50.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019646277, 2024-05-08T18:09:50.526 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.526 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.527 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.527 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1225 2024-05-08T18:09:50.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.527 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.662322+0000", 2024-05-08T18:09:50.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.662322+0000", 2024-05-08T18:09:50.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.662325+0000", 2024-05-08T18:09:50.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2380000000000002e-06 2024-05-08T18:09:50.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.665682+0000", 2024-05-08T18:09:50.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033573650000000002 2024-05-08T18:09:50.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.665716+0000", 2024-05-08T18:09:50.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3365999999999999e-05 2024-05-08T18:09:50.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.665730+0000", 2024-05-08T18:09:50.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4358e-05 2024-05-08T18:09:50.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.665864+0000", 2024-05-08T18:09:50.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013442099999999999 2024-05-08T18:09:50.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.666105+0000", 2024-05-08T18:09:50.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000240972 2024-05-08T18:09:50.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:50.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.666341+0000", 2024-05-08T18:09:50.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023601500000000001 2024-05-08T18:09:50.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.673810+0000", 2024-05-08T18:09:50.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0074687499999999997 2024-05-08T18:09:50.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.681779+0000", 2024-05-08T18:09:50.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0079686170000000008 2024-05-08T18:09:50.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.681880+0000", 2024-05-08T18:09:50.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100806 2024-05-08T18:09:50.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.681968+0000", 2024-05-08T18:09:50.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8368999999999994e-05 2024-05-08T18:09:50.531 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.532 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.532 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.532 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1280 3.2e 3:75e8bee5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:50.532 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:09.132622+0000", 2024-05-08T18:09:50.532 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 41.373496693, 2024-05-08T18:09:50.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0202191, 2024-05-08T18:09:50.532 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.532 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.532 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.532 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.532 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.532 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.532 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1280 2024-05-08T18:09:50.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.533 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.132622+0000", 2024-05-08T18:09:50.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.132622+0000", 2024-05-08T18:09:50.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.132626+0000", 2024-05-08T18:09:50.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0090000000000001e-06 2024-05-08T18:09:50.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.135466+0000", 2024-05-08T18:09:50.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028392349999999998 2024-05-08T18:09:50.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.135497+0000", 2024-05-08T18:09:50.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1707e-05 2024-05-08T18:09:50.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.135513+0000", 2024-05-08T18:09:50.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5500999999999999e-05 2024-05-08T18:09:50.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.135689+0000", 2024-05-08T18:09:50.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017570899999999999 2024-05-08T18:09:50.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.136084+0000", 2024-05-08T18:09:50.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000395867 2024-05-08T18:09:50.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:50.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.136557+0000", 2024-05-08T18:09:50.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047274099999999999 2024-05-08T18:09:50.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.145350+0000", 2024-05-08T18:09:50.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087923819999999996 2024-05-08T18:09:50.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.152722+0000", 2024-05-08T18:09:50.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073719270000000003 2024-05-08T18:09:50.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.152795+0000", 2024-05-08T18:09:50.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3620000000000003e-05 2024-05-08T18:09:50.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.152842+0000", 2024-05-08T18:09:50.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6402000000000001e-05 2024-05-08T18:09:50.537 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.537 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.538 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.538 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1401 3.f 3:f32613bc:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:50.538 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.841917+0000", 2024-05-08T18:09:50.538 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.664202248999999, 2024-05-08T18:09:50.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022767473, 2024-05-08T18:09:50.538 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.538 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.538 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.538 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.538 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.538 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.538 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1401 2024-05-08T18:09:50.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.539 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.841917+0000", 2024-05-08T18:09:50.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.841917+0000", 2024-05-08T18:09:50.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.841921+0000", 2024-05-08T18:09:50.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1439999999999996e-06 2024-05-08T18:09:50.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.847079+0000", 2024-05-08T18:09:50.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051577150000000002 2024-05-08T18:09:50.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.847118+0000", 2024-05-08T18:09:50.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9473e-05 2024-05-08T18:09:50.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.847144+0000", 2024-05-08T18:09:50.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6149e-05 2024-05-08T18:09:50.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.847239+0000", 2024-05-08T18:09:50.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4643999999999997e-05 2024-05-08T18:09:50.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.847353+0000", 2024-05-08T18:09:50.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113589 2024-05-08T18:09:50.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:50.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.847447+0000", 2024-05-08T18:09:50.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4111999999999996e-05 2024-05-08T18:09:50.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.855437+0000", 2024-05-08T18:09:50.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0079898620000000004 2024-05-08T18:09:50.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.864564+0000", 2024-05-08T18:09:50.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0091273310000000007 2024-05-08T18:09:50.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.864637+0000", 2024-05-08T18:09:50.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2855000000000006e-05 2024-05-08T18:09:50.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.864684+0000", 2024-05-08T18:09:50.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7599000000000003e-05 2024-05-08T18:09:50.543 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.543 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.543 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.543 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1438 3.f 3:f18ace44:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:50.543 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.657507+0000", 2024-05-08T18:09:50.543 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.848612459000002, 2024-05-08T18:09:50.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020692261, 2024-05-08T18:09:50.544 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.544 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.544 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.544 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.544 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.544 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.544 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1438 2024-05-08T18:09:50.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.544 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.657507+0000", 2024-05-08T18:09:50.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.657507+0000", 2024-05-08T18:09:50.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.657511+0000", 2024-05-08T18:09:50.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0500000000000002e-06 2024-05-08T18:09:50.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.662087+0000", 2024-05-08T18:09:50.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045766920000000003 2024-05-08T18:09:50.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.662132+0000", 2024-05-08T18:09:50.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4645999999999999e-05 2024-05-08T18:09:50.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.662151+0000", 2024-05-08T18:09:50.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8927e-05 2024-05-08T18:09:50.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.662322+0000", 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017104199999999999 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.662619+0000", 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00029650800000000001 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.662961+0000", 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034270699999999998 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.673277+0000", 2024-05-08T18:09:50.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010315441999999999 2024-05-08T18:09:50.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.677898+0000", 2024-05-08T18:09:50.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046212750000000002 2024-05-08T18:09:50.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.678078+0000", 2024-05-08T18:09:50.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180166 2024-05-08T18:09:50.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.678199+0000", 2024-05-08T18:09:50.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012080599999999999 2024-05-08T18:09:50.548 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1440 3.2e 3:774e4dff:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.698834+0000", 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.807284946999999, 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020162098, 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1440 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.549 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.698834+0000", 2024-05-08T18:09:50.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.698834+0000", 2024-05-08T18:09:50.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.698839+0000", 2024-05-08T18:09:50.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5600000000000004e-06 2024-05-08T18:09:50.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.701943+0000", 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031039100000000001 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.701987+0000", 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4295999999999997e-05 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.702006+0000", 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9409999999999999e-05 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.702151+0000", 2024-05-08T18:09:50.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000144423 2024-05-08T18:09:50.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.702433+0000", 2024-05-08T18:09:50.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028230200000000001 2024-05-08T18:09:50.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:50.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.702666+0000", 2024-05-08T18:09:50.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023294799999999999 2024-05-08T18:09:50.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.712684+0000", 2024-05-08T18:09:50.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010018068999999999 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.718828+0000", 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061441810000000003 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.718923+0000", 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4928999999999999e-05 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.718996+0000", 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3070000000000003e-05 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.553 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.554 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.554 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1443 3.21 3:8729b090:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:50.554 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.765398+0000", 2024-05-08T18:09:50.554 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.740720926000002, 2024-05-08T18:09:50.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0192067, 2024-05-08T18:09:50.554 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.554 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.554 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.554 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.554 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.554 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.554 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1443 2024-05-08T18:09:50.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.555 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.765398+0000", 2024-05-08T18:09:50.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.765398+0000", 2024-05-08T18:09:50.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.765403+0000", 2024-05-08T18:09:50.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3699999999999997e-06 2024-05-08T18:09:50.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.768400+0000", 2024-05-08T18:09:50.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029976809999999999 2024-05-08T18:09:50.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.768448+0000", 2024-05-08T18:09:50.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7317000000000001e-05 2024-05-08T18:09:50.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.768475+0000", 2024-05-08T18:09:50.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7583e-05 2024-05-08T18:09:50.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.768673+0000", 2024-05-08T18:09:50.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000198042 2024-05-08T18:09:50.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.768996+0000", 2024-05-08T18:09:50.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032296099999999997 2024-05-08T18:09:50.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:50.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.769342+0000", 2024-05-08T18:09:50.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034602 2024-05-08T18:09:50.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.778043+0000", 2024-05-08T18:09:50.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087005009999999994 2024-05-08T18:09:50.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.784508+0000", 2024-05-08T18:09:50.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006465658 2024-05-08T18:09:50.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.784563+0000", 2024-05-08T18:09:50.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4228999999999999e-05 2024-05-08T18:09:50.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.784605+0000", 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2338e-05 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1455 3.21 3:878affb7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.391548+0000", 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.114570815999997, 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023279116999999998, 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.559 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.560 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1455 2024-05-08T18:09:50.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.560 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.391548+0000", 2024-05-08T18:09:50.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.391548+0000", 2024-05-08T18:09:50.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.391553+0000", 2024-05-08T18:09:50.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3089999999999997e-06 2024-05-08T18:09:50.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.394736+0000", 2024-05-08T18:09:50.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031830869999999998 2024-05-08T18:09:50.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.394780+0000", 2024-05-08T18:09:50.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4335999999999997e-05 2024-05-08T18:09:50.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.394808+0000", 2024-05-08T18:09:50.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7963e-05 2024-05-08T18:09:50.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.394955+0000", 2024-05-08T18:09:50.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014733199999999999 2024-05-08T18:09:50.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.395266+0000", 2024-05-08T18:09:50.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031033800000000001 2024-05-08T18:09:50.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:50.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.395554+0000", 2024-05-08T18:09:50.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028860099999999998 2024-05-08T18:09:50.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.405727+0000", 2024-05-08T18:09:50.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01017234 2024-05-08T18:09:50.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.414598+0000", 2024-05-08T18:09:50.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0088716760000000002 2024-05-08T18:09:50.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.414732+0000", 2024-05-08T18:09:50.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133356 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.414827+0000", 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5779000000000006e-05 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1462 3.f 3:f149d717:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.548400+0000", 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.957718749000001, 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024933295000000001, 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.565 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.565 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.565 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.565 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1462 2024-05-08T18:09:50.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.565 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.548400+0000", 2024-05-08T18:09:50.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.548400+0000", 2024-05-08T18:09:50.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.548404+0000", 2024-05-08T18:09:50.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4199999999999999e-06 2024-05-08T18:09:50.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.553868+0000", 2024-05-08T18:09:50.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054640549999999998 2024-05-08T18:09:50.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.553924+0000", 2024-05-08T18:09:50.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5927000000000002e-05 2024-05-08T18:09:50.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.553951+0000", 2024-05-08T18:09:50.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7032000000000001e-05 2024-05-08T18:09:50.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.554267+0000", 2024-05-08T18:09:50.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000316294 2024-05-08T18:09:50.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.554529+0000", 2024-05-08T18:09:50.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026151899999999999 2024-05-08T18:09:50.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:50.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.554775+0000", 2024-05-08T18:09:50.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024608099999999999 2024-05-08T18:09:50.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.570143+0000", 2024-05-08T18:09:50.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015368257999999999 2024-05-08T18:09:50.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573020+0000", 2024-05-08T18:09:50.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028767689999999999 2024-05-08T18:09:50.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573201+0000", 2024-05-08T18:09:50.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018154799999999999 2024-05-08T18:09:50.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.573334+0000", 2024-05-08T18:09:50.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132392 2024-05-08T18:09:50.569 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.569 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.569 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.569 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1467 3.2e 3:7582a1db:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:50.569 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.649589+0000", 2024-05-08T18:09:50.570 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.856530573999997, 2024-05-08T18:09:50.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019061583, 2024-05-08T18:09:50.570 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.570 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.570 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.570 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.570 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.570 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.570 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1467 2024-05-08T18:09:50.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.570 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.649589+0000", 2024-05-08T18:09:50.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.649589+0000", 2024-05-08T18:09:50.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.649592+0000", 2024-05-08T18:09:50.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5530000000000001e-06 2024-05-08T18:09:50.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.651593+0000", 2024-05-08T18:09:50.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020007689999999999 2024-05-08T18:09:50.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.651630+0000", 2024-05-08T18:09:50.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6968999999999998e-05 2024-05-08T18:09:50.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.651649+0000", 2024-05-08T18:09:50.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9089e-05 2024-05-08T18:09:50.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.651760+0000", 2024-05-08T18:09:50.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000111381 2024-05-08T18:09:50.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.652026+0000", 2024-05-08T18:09:50.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026602199999999998 2024-05-08T18:09:50.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:50.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.652270+0000", 2024-05-08T18:09:50.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024386399999999999 2024-05-08T18:09:50.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.663508+0000", 2024-05-08T18:09:50.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011237636 2024-05-08T18:09:50.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.668541+0000", 2024-05-08T18:09:50.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050334150000000003 2024-05-08T18:09:50.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.668594+0000", 2024-05-08T18:09:50.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3216e-05 2024-05-08T18:09:50.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.668650+0000", 2024-05-08T18:09:50.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5668999999999998e-05 2024-05-08T18:09:50.575 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.575 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.575 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.575 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1960 3.0 e92/20 3:02610446:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.29:head v 92'6, mlcod=91'4)", 2024-05-08T18:09:50.575 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:27.099605+0000", 2024-05-08T18:09:50.575 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.406513661999998, 2024-05-08T18:09:50.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018988175999999999, 2024-05-08T18:09:50.575 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.575 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.575 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.575 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.099605+0000", 2024-05-08T18:09:50.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.099605+0000", 2024-05-08T18:09:50.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.099606+0000", 2024-05-08T18:09:50.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1699999999999998e-07 2024-05-08T18:09:50.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.103861+0000", 2024-05-08T18:09:50.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042553340000000004 2024-05-08T18:09:50.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.103903+0000", 2024-05-08T18:09:50.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1903000000000002e-05 2024-05-08T18:09:50.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.103922+0000", 2024-05-08T18:09:50.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8902999999999998e-05 2024-05-08T18:09:50.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.104096+0000", 2024-05-08T18:09:50.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017361300000000001 2024-05-08T18:09:50.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.104166+0000", 2024-05-08T18:09:50.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0648999999999994e-05 2024-05-08T18:09:50.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.118456+0000", 2024-05-08T18:09:50.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014289359999999999 2024-05-08T18:09:50.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.118594+0000", 2024-05-08T18:09:50.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137897 2024-05-08T18:09:50.579 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.579 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.579 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.579 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1984 3.21 3:8684244f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.33:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:50.579 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:27.631410+0000", 2024-05-08T18:09:50.579 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 22.874708777999999, 2024-05-08T18:09:50.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026559544000000001, 2024-05-08T18:09:50.579 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.580 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.580 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.580 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.580 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.580 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.580 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1984 2024-05-08T18:09:50.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.580 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.631410+0000", 2024-05-08T18:09:50.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.631410+0000", 2024-05-08T18:09:50.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.631413+0000", 2024-05-08T18:09:50.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6060000000000001e-06 2024-05-08T18:09:50.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.633229+0000", 2024-05-08T18:09:50.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001816062 2024-05-08T18:09:50.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.633250+0000", 2024-05-08T18:09:50.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0673e-05 2024-05-08T18:09:50.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.633260+0000", 2024-05-08T18:09:50.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0499999999999999e-05 2024-05-08T18:09:50.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.633326+0000", 2024-05-08T18:09:50.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5370000000000006e-05 2024-05-08T18:09:50.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.633464+0000", 2024-05-08T18:09:50.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000138274 2024-05-08T18:09:50.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:50.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.633829+0000", 2024-05-08T18:09:50.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036489299999999998 2024-05-08T18:09:50.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.643024+0000", 2024-05-08T18:09:50.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0091956929999999996 2024-05-08T18:09:50.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.657888+0000", 2024-05-08T18:09:50.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014863538000000001 2024-05-08T18:09:50.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.657937+0000", 2024-05-08T18:09:50.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9452e-05 2024-05-08T18:09:50.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.657970+0000", 2024-05-08T18:09:50.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2483000000000001e-05 2024-05-08T18:09:50.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.584 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.585 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1993 3.f 3:f3d3e753:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.bVoEl83lWbAlYGAKHGGh3DdtSVOS65h_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:50.585 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:27.841449+0000", 2024-05-08T18:09:50.585 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 22.664669924999998, 2024-05-08T18:09:50.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021619421999999999, 2024-05-08T18:09:50.585 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.585 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.585 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.585 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.585 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.585 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.585 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1993 2024-05-08T18:09:50.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.585 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.841449+0000", 2024-05-08T18:09:50.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.841449+0000", 2024-05-08T18:09:50.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.841453+0000", 2024-05-08T18:09:50.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4199999999999999e-06 2024-05-08T18:09:50.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.843334+0000", 2024-05-08T18:09:50.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018811959999999999 2024-05-08T18:09:50.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.843358+0000", 2024-05-08T18:09:50.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3995e-05 2024-05-08T18:09:50.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.843369+0000", 2024-05-08T18:09:50.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0869999999999999e-05 2024-05-08T18:09:50.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.843456+0000", 2024-05-08T18:09:50.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6873000000000007e-05 2024-05-08T18:09:50.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.843644+0000", 2024-05-08T18:09:50.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018803 2024-05-08T18:09:50.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:50.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.843821+0000", 2024-05-08T18:09:50.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000177009 2024-05-08T18:09:50.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.853256+0000", 2024-05-08T18:09:50.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009435077 2024-05-08T18:09:50.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.862994+0000", 2024-05-08T18:09:50.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0097380709999999992 2024-05-08T18:09:50.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.863033+0000", 2024-05-08T18:09:50.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9595999999999998e-05 2024-05-08T18:09:50.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.863069+0000", 2024-05-08T18:09:50.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5284999999999998e-05 2024-05-08T18:09:50.590 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.590 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.590 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.590 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:2139 3.3d e93/20 3:bf4c8f68:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.57:head v 93'12, mlcod=91'10)", 2024-05-08T18:09:50.590 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.599268+0000", 2024-05-08T18:09:50.590 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.906851509999999, 2024-05-08T18:09:50.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019922117999999999, 2024-05-08T18:09:50.590 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.590 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.591 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.591 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.599268+0000", 2024-05-08T18:09:50.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.599268+0000", 2024-05-08T18:09:50.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.599268+0000", 2024-05-08T18:09:50.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0999999999999999e-07 2024-05-08T18:09:50.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.603384+0000", 2024-05-08T18:09:50.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004115723 2024-05-08T18:09:50.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.603422+0000", 2024-05-08T18:09:50.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8206e-05 2024-05-08T18:09:50.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.603440+0000", 2024-05-08T18:09:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8093000000000001e-05 2024-05-08T18:09:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.603574+0000", 2024-05-08T18:09:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013377800000000001 2024-05-08T18:09:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.603616+0000", 2024-05-08T18:09:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1792999999999998e-05 2024-05-08T18:09:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619039+0000", 2024-05-08T18:09:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015423584000000001 2024-05-08T18:09:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.619190+0000", 2024-05-08T18:09:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150431 2024-05-08T18:09:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2148 3.3a 3:5e7eab38:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.umHd6qkh40rxG2J_0Hf4-0RSq48k1ir_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.871806+0000", 2024-05-08T18:09:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.634313294000002, 2024-05-08T18:09:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019799187999999999, 2024-05-08T18:09:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2148 2024-05-08T18:09:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.871806+0000", 2024-05-08T18:09:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.871806+0000", 2024-05-08T18:09:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.871810+0000", 2024-05-08T18:09:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8859999999999997e-06 2024-05-08T18:09:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.875274+0000", 2024-05-08T18:09:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034643429999999999 2024-05-08T18:09:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.875322+0000", 2024-05-08T18:09:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8168999999999999e-05 2024-05-08T18:09:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.875347+0000", 2024-05-08T18:09:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4326000000000001e-05 2024-05-08T18:09:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.875483+0000", 2024-05-08T18:09:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000136897 2024-05-08T18:09:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.875623+0000", 2024-05-08T18:09:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013914900000000001 2024-05-08T18:09:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.875743+0000", 2024-05-08T18:09:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000120593 2024-05-08T18:09:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.890474+0000", 2024-05-08T18:09:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014730853 2024-05-08T18:09:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.891514+0000", 2024-05-08T18:09:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010401919999999999 2024-05-08T18:09:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.891562+0000", 2024-05-08T18:09:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8019000000000002e-05 2024-05-08T18:09:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.891605+0000", 2024-05-08T18:09:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2760999999999999e-05 2024-05-08T18:09:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:2175 3.2d e93/20 3:b44c7524:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.63:head v 93'6, mlcod=92'4)", 2024-05-08T18:09:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.566905+0000", 2024-05-08T18:09:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.939214151000002, 2024-05-08T18:09:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021205742999999999, 2024-05-08T18:09:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.566905+0000", 2024-05-08T18:09:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.566905+0000", 2024-05-08T18:09:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.566907+0000", 2024-05-08T18:09:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0269999999999998e-06 2024-05-08T18:09:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.574211+0000", 2024-05-08T18:09:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073044240000000003 2024-05-08T18:09:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.574244+0000", 2024-05-08T18:09:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2842999999999997e-05 2024-05-08T18:09:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.574261+0000", 2024-05-08T18:09:50.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6523000000000001e-05 2024-05-08T18:09:50.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.574375+0000", 2024-05-08T18:09:50.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114481 2024-05-08T18:09:50.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.574419+0000", 2024-05-08T18:09:50.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4106000000000001e-05 2024-05-08T18:09:50.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.587931+0000", 2024-05-08T18:09:50.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013512045 2024-05-08T18:09:50.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.588111+0000", 2024-05-08T18:09:50.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017929400000000001 2024-05-08T18:09:50.604 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.604 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.604 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.605 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2193 3.f 3:f037a6c5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.66:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:50.605 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:32.033127+0000", 2024-05-08T18:09:50.605 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.472992541, 2024-05-08T18:09:50.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019575115000000001, 2024-05-08T18:09:50.605 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:50.605 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:50.605 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:50.605 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:50.605 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:50.605 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:50.605 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2193 2024-05-08T18:09:50.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.605 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:50.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.033127+0000", 2024-05-08T18:09:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.033127+0000", 2024-05-08T18:09:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.033129+0000", 2024-05-08T18:09:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2460000000000002e-06 2024-05-08T18:09:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.034975+0000", 2024-05-08T18:09:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018464480000000001 2024-05-08T18:09:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.035000+0000", 2024-05-08T18:09:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4481000000000002e-05 2024-05-08T18:09:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.035010+0000", 2024-05-08T18:09:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0531e-05 2024-05-08T18:09:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.035094+0000", 2024-05-08T18:09:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3919999999999996e-05 2024-05-08T18:09:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.035276+0000", 2024-05-08T18:09:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000181991 2024-05-08T18:09:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.035784+0000", 2024-05-08T18:09:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050825200000000005 2024-05-08T18:09:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.045852+0000", 2024-05-08T18:09:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010068002 2024-05-08T18:09:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.052608+0000", 2024-05-08T18:09:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067558389999999996 2024-05-08T18:09:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.052666+0000", 2024-05-08T18:09:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7887999999999999e-05 2024-05-08T18:09:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:32.052702+0000", 2024-05-08T18:09:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5516999999999999e-05 2024-05-08T18:09:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:50.610 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:50.612 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:09:50.612 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-08T18:09:50.612+0000 7f17cb8f6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25271) UID: 0 2024-05-08T18:09:50.625 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T18:09:50.625 DEBUG:teuthology.orchestra.run.smithi080:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-05-08T18:09:50.689 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T18:09:50.689 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-05-08T18:09:50.703 INFO:tasks.thrashosds:joining thrashosds 2024-05-08T18:09:50.796 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:50.797 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:50.797 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-08T18:09:50.797 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:50.811 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:09:50.929 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:50.929 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-08T18:09:50.929 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-08T18:09:50.929 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-08T18:09:50.929 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:50.943 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:09:50.957 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is set 2024-05-08T18:09:51.073 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:09:51.073 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-08T18:09:51.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-08T18:09:51.073 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-08T18:09:51.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.073 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1207 3.15 e85/20 3:a96d965c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_19:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:51.073 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.162095+0000", 2024-05-08T18:09:51.073 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.914837282999997, 2024-05-08T18:09:51.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022218617999999999, 2024-05-08T18:09:51.073 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.073 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.073 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.073 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.162095+0000", 2024-05-08T18:09:51.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.162095+0000", 2024-05-08T18:09:51.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.162096+0000", 2024-05-08T18:09:51.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8899999999999998e-07 2024-05-08T18:09:51.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167032+0000", 2024-05-08T18:09:51.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004936429 2024-05-08T18:09:51.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167062+0000", 2024-05-08T18:09:51.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9422000000000001e-05 2024-05-08T18:09:51.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167075+0000", 2024-05-08T18:09:51.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3436e-05 2024-05-08T18:09:51.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167157+0000", 2024-05-08T18:09:51.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1337999999999999e-05 2024-05-08T18:09:51.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.167180+0000", 2024-05-08T18:09:51.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3816e-05 2024-05-08T18:09:51.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.184267+0000", 2024-05-08T18:09:51.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017086796000000001 2024-05-08T18:09:51.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.184314+0000", 2024-05-08T18:09:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6391999999999999e-05 2024-05-08T18:09:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1219 3.2 3:4068b298:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.575413+0000", 2024-05-08T18:09:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.501519735000002, 2024-05-08T18:09:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.027002252000000001, 2024-05-08T18:09:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.077 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:51.078 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:51.078 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.078 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1219 2024-05-08T18:09:51.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.078 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.575413+0000", 2024-05-08T18:09:51.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.575413+0000", 2024-05-08T18:09:51.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.575416+0000", 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2969999999999999e-06 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.578847+0000", 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003431052 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.580255+0000", 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014079310000000001 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.580271+0000", 2024-05-08T18:09:51.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5637999999999998e-05 2024-05-08T18:09:51.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.580333+0000", 2024-05-08T18:09:51.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2213999999999998e-05 2024-05-08T18:09:51.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.580466+0000", 2024-05-08T18:09:51.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013334800000000001 2024-05-08T18:09:51.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:51.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.580556+0000", 2024-05-08T18:09:51.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0252000000000003e-05 2024-05-08T18:09:51.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:51.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.590619+0000", 2024-05-08T18:09:51.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010062448 2024-05-08T18:09:51.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.602227+0000", 2024-05-08T18:09:51.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011608108000000001 2024-05-08T18:09:51.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.602305+0000", 2024-05-08T18:09:51.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8468999999999997e-05 2024-05-08T18:09:51.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.602415+0000", 2024-05-08T18:09:51.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010949499999999999 2024-05-08T18:09:51.082 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.082 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.082 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.082 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1222 3.38 3:1f451ee1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:51.082 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:07.608041+0000", 2024-05-08T18:09:51.082 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 43.468890821999999, 2024-05-08T18:09:51.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021806477000000001, 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1222 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.608041+0000", 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.608041+0000", 2024-05-08T18:09:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.608046+0000", 2024-05-08T18:09:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2030000000000002e-06 2024-05-08T18:09:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610351+0000", 2024-05-08T18:09:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023056790000000001 2024-05-08T18:09:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610383+0000", 2024-05-08T18:09:51.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1677000000000002e-05 2024-05-08T18:09:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610403+0000", 2024-05-08T18:09:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0429999999999999e-05 2024-05-08T18:09:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610499+0000", 2024-05-08T18:09:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5328999999999995e-05 2024-05-08T18:09:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610642+0000", 2024-05-08T18:09:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000143373 2024-05-08T18:09:51.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.610746+0000", 2024-05-08T18:09:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010428 2024-05-08T18:09:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.617351+0000", 2024-05-08T18:09:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066048000000000001 2024-05-08T18:09:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.629762+0000", 2024-05-08T18:09:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012410796 2024-05-08T18:09:51.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.629802+0000", 2024-05-08T18:09:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9650999999999997e-05 2024-05-08T18:09:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:07.629848+0000", 2024-05-08T18:09:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6258999999999999e-05 2024-05-08T18:09:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1275 3.33 3:ccdf9558:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:09.054484+0000", 2024-05-08T18:09:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.022448697999998, 2024-05-08T18:09:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023576865999999998, 2024-05-08T18:09:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1275 2024-05-08T18:09:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.054484+0000", 2024-05-08T18:09:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.054484+0000", 2024-05-08T18:09:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.054488+0000", 2024-05-08T18:09:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6700000000000002e-06 2024-05-08T18:09:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.056730+0000", 2024-05-08T18:09:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022419359999999999 2024-05-08T18:09:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.056770+0000", 2024-05-08T18:09:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9632999999999998e-05 2024-05-08T18:09:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.056797+0000", 2024-05-08T18:09:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6999999999999999e-05 2024-05-08T18:09:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.056906+0000", 2024-05-08T18:09:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108767 2024-05-08T18:09:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.057107+0000", 2024-05-08T18:09:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020165299999999999 2024-05-08T18:09:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.057290+0000", 2024-05-08T18:09:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018288700000000001 2024-05-08T18:09:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.064104+0000", 2024-05-08T18:09:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.006814095 2024-05-08T18:09:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.077966+0000", 2024-05-08T18:09:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013862129000000001 2024-05-08T18:09:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.078007+0000", 2024-05-08T18:09:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1072999999999998e-05 2024-05-08T18:09:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:09.078060+0000", 2024-05-08T18:09:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3022999999999997e-05 2024-05-08T18:09:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1407 3.7 3:e339c0c4:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:11.904306+0000", 2024-05-08T18:09:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 39.172626776000001, 2024-05-08T18:09:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021916637999999999, 2024-05-08T18:09:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:51.093 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1407 2024-05-08T18:09:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.904306+0000", 2024-05-08T18:09:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.904306+0000", 2024-05-08T18:09:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.904309+0000", 2024-05-08T18:09:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9660000000000001e-06 2024-05-08T18:09:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905531+0000", 2024-05-08T18:09:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012226750000000001 2024-05-08T18:09:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905553+0000", 2024-05-08T18:09:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2272e-05 2024-05-08T18:09:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905568+0000", 2024-05-08T18:09:51.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4328000000000001e-05 2024-05-08T18:09:51.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905654+0000", 2024-05-08T18:09:51.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6296000000000002e-05 2024-05-08T18:09:51.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905798+0000", 2024-05-08T18:09:51.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014352000000000001 2024-05-08T18:09:51.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:51.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.905949+0000", 2024-05-08T18:09:51.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015134799999999999 2024-05-08T18:09:51.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:51.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.916810+0000", 2024-05-08T18:09:51.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010861243 2024-05-08T18:09:51.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.926149+0000", 2024-05-08T18:09:51.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0093391259999999997 2024-05-08T18:09:51.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.926190+0000", 2024-05-08T18:09:51.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0519000000000003e-05 2024-05-08T18:09:51.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:11.926222+0000", 2024-05-08T18:09:51.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2345000000000003e-05 2024-05-08T18:09:51.098 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.098 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.098 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.098 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1427 3.7 3:e0863aef:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:51.099 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.433817+0000", 2024-05-08T18:09:51.099 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.643114953000001, 2024-05-08T18:09:51.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022409645999999998, 2024-05-08T18:09:51.099 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.099 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.099 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.099 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:51.099 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:51.099 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.099 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1427 2024-05-08T18:09:51.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.099 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433817+0000", 2024-05-08T18:09:51.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433817+0000", 2024-05-08T18:09:51.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.433820+0000", 2024-05-08T18:09:51.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5849999999999998e-06 2024-05-08T18:09:51.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.438932+0000", 2024-05-08T18:09:51.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051120439999999996 2024-05-08T18:09:51.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.438984+0000", 2024-05-08T18:09:51.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1972999999999999e-05 2024-05-08T18:09:51.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.439011+0000", 2024-05-08T18:09:51.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7453e-05 2024-05-08T18:09:51.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.439195+0000", 2024-05-08T18:09:51.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018336200000000001 2024-05-08T18:09:51.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.439613+0000", 2024-05-08T18:09:51.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041870399999999999 2024-05-08T18:09:51.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:51.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.440009+0000", 2024-05-08T18:09:51.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039599699999999998 2024-05-08T18:09:51.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.452565+0000", 2024-05-08T18:09:51.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012555199 2024-05-08T18:09:51.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:51.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.455999+0000", 2024-05-08T18:09:51.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034340299999999998 2024-05-08T18:09:51.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.456104+0000", 2024-05-08T18:09:51.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105586 2024-05-08T18:09:51.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.456227+0000", 2024-05-08T18:09:51.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012271299999999999 2024-05-08T18:09:51.104 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.104 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.104 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.104 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1433 3.29 3:97d7b3d1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:51.104 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.543266+0000", 2024-05-08T18:09:51.104 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.53366655, 2024-05-08T18:09:51.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019647787999999999, 2024-05-08T18:09:51.104 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.104 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.104 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.104 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:51.104 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1433 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.543266+0000", 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.543266+0000", 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.543269+0000", 2024-05-08T18:09:51.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4429999999999999e-06 2024-05-08T18:09:51.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.546262+0000", 2024-05-08T18:09:51.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029928540000000001 2024-05-08T18:09:51.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.546301+0000", 2024-05-08T18:09:51.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9005999999999999e-05 2024-05-08T18:09:51.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.546326+0000", 2024-05-08T18:09:51.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5014000000000001e-05 2024-05-08T18:09:51.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.546440+0000", 2024-05-08T18:09:51.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011402 2024-05-08T18:09:51.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.546646+0000", 2024-05-08T18:09:51.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206064 2024-05-08T18:09:51.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:51.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.546852+0000", 2024-05-08T18:09:51.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206207 2024-05-08T18:09:51.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:51.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.554604+0000", 2024-05-08T18:09:51.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0077520419999999998 2024-05-08T18:09:51.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.562703+0000", 2024-05-08T18:09:51.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0080987999999999997 2024-05-08T18:09:51.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.562796+0000", 2024-05-08T18:09:51.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2968999999999997e-05 2024-05-08T18:09:51.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.562914+0000", 2024-05-08T18:09:51.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011736899999999999 2024-05-08T18:09:51.109 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.109 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.109 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.109 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1445 3.2 3:42324995:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:51.109 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:12.811460+0000", 2024-05-08T18:09:51.109 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.265472309000003, 2024-05-08T18:09:51.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01999664, 2024-05-08T18:09:51.109 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.110 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.110 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.110 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:51.110 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:51.110 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.110 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1445 2024-05-08T18:09:51.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.110 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.811460+0000", 2024-05-08T18:09:51.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.811460+0000", 2024-05-08T18:09:51.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.811465+0000", 2024-05-08T18:09:51.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4569999999999996e-06 2024-05-08T18:09:51.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.814389+0000", 2024-05-08T18:09:51.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002923471 2024-05-08T18:09:51.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.814434+0000", 2024-05-08T18:09:51.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4687000000000001e-05 2024-05-08T18:09:51.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.814462+0000", 2024-05-08T18:09:51.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8252999999999999e-05 2024-05-08T18:09:51.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.814599+0000", 2024-05-08T18:09:51.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013708899999999999 2024-05-08T18:09:51.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.814862+0000", 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000263186 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.815111+0000", 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024844999999999999 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.822832+0000", 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007721182 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.831286+0000", 2024-05-08T18:09:51.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008454006 2024-05-08T18:09:51.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.831385+0000", 2024-05-08T18:09:51.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9155999999999997e-05 2024-05-08T18:09:51.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:12.831457+0000", 2024-05-08T18:09:51.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1703000000000001e-05 2024-05-08T18:09:51.114 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.114 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.114 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.115 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1452 3.18 3:1a3be52d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:51.115 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.322360+0000", 2024-05-08T18:09:51.115 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.754572572999997, 2024-05-08T18:09:51.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.026904399999999998, 2024-05-08T18:09:51.115 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.115 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.115 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.115 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:51.115 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:51.115 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.115 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1452 2024-05-08T18:09:51.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.115 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.322360+0000", 2024-05-08T18:09:51.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.322360+0000", 2024-05-08T18:09:51.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.322365+0000", 2024-05-08T18:09:51.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9830000000000004e-06 2024-05-08T18:09:51.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.326727+0000", 2024-05-08T18:09:51.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043627140000000002 2024-05-08T18:09:51.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.326769+0000", 2024-05-08T18:09:51.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1221999999999999e-05 2024-05-08T18:09:51.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.326788+0000", 2024-05-08T18:09:51.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9332999999999999e-05 2024-05-08T18:09:51.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.326963+0000", 2024-05-08T18:09:51.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017518899999999999 2024-05-08T18:09:51.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.327368+0000", 2024-05-08T18:09:51.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040489699999999998 2024-05-08T18:09:51.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:51.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.327794+0000", 2024-05-08T18:09:51.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042616699999999997 2024-05-08T18:09:51.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:51.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.346272+0000", 2024-05-08T18:09:51.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018477413000000002 2024-05-08T18:09:51.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.349007+0000", 2024-05-08T18:09:51.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027350370000000001 2024-05-08T18:09:51.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.349131+0000", 2024-05-08T18:09:51.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012433299999999999 2024-05-08T18:09:51.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.349264+0000", 2024-05-08T18:09:51.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013311200000000001 2024-05-08T18:09:51.120 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.120 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.120 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.120 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1459 3.25 e87/20 3:a5b1b07d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_9:head v 87'3, mlcod=85'1)", 2024-05-08T18:09:51.120 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:13.481986+0000", 2024-05-08T18:09:51.120 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.594946565000001, 2024-05-08T18:09:51.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019426586999999999, 2024-05-08T18:09:51.120 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.120 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.120 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481986+0000", 2024-05-08T18:09:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481986+0000", 2024-05-08T18:09:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.481988+0000", 2024-05-08T18:09:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6469999999999998e-06 2024-05-08T18:09:51.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.484892+0000", 2024-05-08T18:09:51.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029039489999999999 2024-05-08T18:09:51.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.484942+0000", 2024-05-08T18:09:51.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9515999999999998e-05 2024-05-08T18:09:51.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.484968+0000", 2024-05-08T18:09:51.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5724e-05 2024-05-08T18:09:51.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.485136+0000", 2024-05-08T18:09:51.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016837800000000001 2024-05-08T18:09:51.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.485204+0000", 2024-05-08T18:09:51.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8182999999999994e-05 2024-05-08T18:09:51.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.501300+0000", 2024-05-08T18:09:51.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016095841 2024-05-08T18:09:51.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:13.501412+0000", 2024-05-08T18:09:51.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112349 2024-05-08T18:09:51.124 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.124 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.124 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.124 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1895 3.29 3:9474fd59:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.RBnb8Zd5L4hk_iCO6bs_73ee09Q7f1h_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:51.124 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:25.731472+0000", 2024-05-08T18:09:51.124 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.345460738, 2024-05-08T18:09:51.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019414273999999999, 2024-05-08T18:09:51.125 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.125 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.125 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.125 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:51.125 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:51.125 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.125 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1895 2024-05-08T18:09:51.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.125 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:25.731472+0000", 2024-05-08T18:09:51.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:25.731472+0000", 2024-05-08T18:09:51.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:25.731474+0000", 2024-05-08T18:09:51.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:09:51.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:25.732752+0000", 2024-05-08T18:09:51.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012779849999999999 2024-05-08T18:09:51.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:25.732778+0000", 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5675000000000001e-05 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:25.732789+0000", 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1415e-05 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:25.732862+0000", 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2959000000000004e-05 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:25.732982+0000", 2024-05-08T18:09:51.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119716 2024-05-08T18:09:51.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:51.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:25.733089+0000", 2024-05-08T18:09:51.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106865 2024-05-08T18:09:51.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:51.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:25.741277+0000", 2024-05-08T18:09:51.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081885829999999993 2024-05-08T18:09:51.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:25.750808+0000", 2024-05-08T18:09:51.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0095303149999999993 2024-05-08T18:09:51.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:25.750851+0000", 2024-05-08T18:09:51.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3421999999999999e-05 2024-05-08T18:09:51.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:25.750886+0000", 2024-05-08T18:09:51.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4922999999999998e-05 2024-05-08T18:09:51.129 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.129 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.129 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.129 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:1928 3.23 e91/20 3:c76f4655:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.24:head v 91'3, mlcod=87'1)", 2024-05-08T18:09:51.130 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:26.414124+0000", 2024-05-08T18:09:51.130 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.662808779999999, 2024-05-08T18:09:51.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019309048999999998, 2024-05-08T18:09:51.130 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.130 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.130 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.130 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.414124+0000", 2024-05-08T18:09:51.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.414124+0000", 2024-05-08T18:09:51.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.414127+0000", 2024-05-08T18:09:51.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.993e-06 2024-05-08T18:09:51.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.419211+0000", 2024-05-08T18:09:51.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050841259999999996 2024-05-08T18:09:51.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.419250+0000", 2024-05-08T18:09:51.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9388999999999998e-05 2024-05-08T18:09:51.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.419268+0000", 2024-05-08T18:09:51.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8233e-05 2024-05-08T18:09:51.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.419471+0000", 2024-05-08T18:09:51.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020297300000000001 2024-05-08T18:09:51.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.419514+0000", 2024-05-08T18:09:51.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3170000000000002e-05 2024-05-08T18:09:51.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.433334+0000", 2024-05-08T18:09:51.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013819296999999999 2024-05-08T18:09:51.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:26.433433+0000", 2024-05-08T18:09:51.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8868000000000003e-05 2024-05-08T18:09:51.133 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.133 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.133 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.133 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1963 3.7 3:e3d900ce:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.T6G15pXX7S_dOE5DS-1zpsx-YulcasB_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:51.133 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:27.219785+0000", 2024-05-08T18:09:51.134 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.857147700999999, 2024-05-08T18:09:51.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025103579000000001, 2024-05-08T18:09:51.134 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.134 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.134 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.134 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:51.134 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:51.134 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.134 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1963 2024-05-08T18:09:51.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.134 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.219785+0000", 2024-05-08T18:09:51.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.219785+0000", 2024-05-08T18:09:51.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.219788+0000", 2024-05-08T18:09:51.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8630000000000001e-06 2024-05-08T18:09:51.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.224097+0000", 2024-05-08T18:09:51.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043084259999999997 2024-05-08T18:09:51.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.224142+0000", 2024-05-08T18:09:51.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4759000000000003e-05 2024-05-08T18:09:51.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.224161+0000", 2024-05-08T18:09:51.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9556999999999999e-05 2024-05-08T18:09:51.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.224300+0000", 2024-05-08T18:09:51.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013890500000000001 2024-05-08T18:09:51.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.224467+0000", 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016638699999999999 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.224590+0000", 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012375099999999999 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.233846+0000", 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0092553449999999999 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.244789+0000", 2024-05-08T18:09:51.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010943219000000001 2024-05-08T18:09:51.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.244845+0000", 2024-05-08T18:09:51.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5912000000000003e-05 2024-05-08T18:09:51.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.244888+0000", 2024-05-08T18:09:51.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3455000000000003e-05 2024-05-08T18:09:51.138 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.138 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.139 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.139 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:1972 3.38 3:1fee6681:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.31:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:51.139 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:27.376431+0000", 2024-05-08T18:09:51.139 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.70050166, 2024-05-08T18:09:51.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019553602999999999, 2024-05-08T18:09:51.139 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.139 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.139 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.139 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:51.139 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:51.139 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.139 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1972 2024-05-08T18:09:51.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.139 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.376431+0000", 2024-05-08T18:09:51.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.376431+0000", 2024-05-08T18:09:51.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.376433+0000", 2024-05-08T18:09:51.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6960000000000001e-06 2024-05-08T18:09:51.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.378043+0000", 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016092750000000001 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.378083+0000", 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9872e-05 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.378108+0000", 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.512e-05 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.378223+0000", 2024-05-08T18:09:51.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115302 2024-05-08T18:09:51.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.378347+0000", 2024-05-08T18:09:51.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012399199999999999 2024-05-08T18:09:51.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:51.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.378816+0000", 2024-05-08T18:09:51.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00046930600000000001 2024-05-08T18:09:51.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:51.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.389612+0000", 2024-05-08T18:09:51.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010795643000000001 2024-05-08T18:09:51.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.395903+0000", 2024-05-08T18:09:51.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062909819999999997 2024-05-08T18:09:51.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.395952+0000", 2024-05-08T18:09:51.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9301000000000001e-05 2024-05-08T18:09:51.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:27.395984+0000", 2024-05-08T18:09:51.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2113999999999998e-05 2024-05-08T18:09:51.143 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.144 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.144 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.144 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2145 3.38 3:1ea63355:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.58:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:51.144 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.745425+0000", 2024-05-08T18:09:51.144 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.331506849, 2024-05-08T18:09:51.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023936870999999998, 2024-05-08T18:09:51.144 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.144 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.144 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.144 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:51.144 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:51.144 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.144 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2145 2024-05-08T18:09:51.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.145 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.745425+0000", 2024-05-08T18:09:51.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.745425+0000", 2024-05-08T18:09:51.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.745428+0000", 2024-05-08T18:09:51.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9699999999999999e-06 2024-05-08T18:09:51.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.749472+0000", 2024-05-08T18:09:51.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004043212 2024-05-08T18:09:51.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.749520+0000", 2024-05-08T18:09:51.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8575999999999997e-05 2024-05-08T18:09:51.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.749540+0000", 2024-05-08T18:09:51.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0092999999999999e-05 2024-05-08T18:09:51.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.749726+0000", 2024-05-08T18:09:51.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018541299999999999 2024-05-08T18:09:51.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.750015+0000", 2024-05-08T18:09:51.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000289611 2024-05-08T18:09:51.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:51.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.750914+0000", 2024-05-08T18:09:51.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00089911500000000003 2024-05-08T18:09:51.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:51.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.762916+0000", 2024-05-08T18:09:51.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012002008 2024-05-08T18:09:51.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.769166+0000", 2024-05-08T18:09:51.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062499829999999998 2024-05-08T18:09:51.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.769289+0000", 2024-05-08T18:09:51.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000122218 2024-05-08T18:09:51.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.769362+0000", 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3671999999999995e-05 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2151 3.24 3:248185bd:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.59:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:30.896864+0000", 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.180068271, 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020651721000000001, 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.149 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2151 2024-05-08T18:09:51.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.150 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.896864+0000", 2024-05-08T18:09:51.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.896864+0000", 2024-05-08T18:09:51.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.896867+0000", 2024-05-08T18:09:51.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2830000000000002e-06 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.899305+0000", 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024379459999999999 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.899350+0000", 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4273000000000001e-05 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.899368+0000", 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8428999999999999e-05 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.899546+0000", 2024-05-08T18:09:51.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017818399999999999 2024-05-08T18:09:51.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.899969+0000", 2024-05-08T18:09:51.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042248299999999997 2024-05-08T18:09:51.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:51.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.901190+0000", 2024-05-08T18:09:51.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012213180000000001 2024-05-08T18:09:51.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:51.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.915520+0000", 2024-05-08T18:09:51.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0143304 2024-05-08T18:09:51.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.917171+0000", 2024-05-08T18:09:51.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016502450000000001 2024-05-08T18:09:51.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.917376+0000", 2024-05-08T18:09:51.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020536 2024-05-08T18:09:51.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:30.917516+0000", 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013980000000000001 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4388.0:2160 3.28 e93/20 3:1689cc56:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.hQWuBL0eD3qM1_SYCGjPFSw-atfdLo5_1:head v 93'15, mlcod=92'13)", 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.170686+0000", 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.906246297999999, 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021499705000000001, 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.170686+0000", 2024-05-08T18:09:51.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.170686+0000", 2024-05-08T18:09:51.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.170689+0000", 2024-05-08T18:09:51.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8660000000000002e-06 2024-05-08T18:09:51.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.178932+0000", 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008243149 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.178976+0000", 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3921999999999997e-05 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.178995+0000", 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8615999999999999e-05 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.179183+0000", 2024-05-08T18:09:51.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018841299999999999 2024-05-08T18:09:51.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.179246+0000", 2024-05-08T18:09:51.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2782999999999998e-05 2024-05-08T18:09:51.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.192044+0000", 2024-05-08T18:09:51.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012798070999999999 2024-05-08T18:09:51.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.192186+0000", 2024-05-08T18:09:51.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014188499999999999 2024-05-08T18:09:51.157 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.158 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.158 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.158 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2181 3.8 3:12ff5737:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.64:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:51.158 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:31.750081+0000", 2024-05-08T18:09:51.158 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.326851394999998, 2024-05-08T18:09:51.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020987511, 2024-05-08T18:09:51.158 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.158 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.158 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.158 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:51.158 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:51.158 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.158 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2181 2024-05-08T18:09:51.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.159 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.750081+0000", 2024-05-08T18:09:51.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.750081+0000", 2024-05-08T18:09:51.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.750083+0000", 2024-05-08T18:09:51.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.548e-06 2024-05-08T18:09:51.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.751721+0000", 2024-05-08T18:09:51.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016372349999999999 2024-05-08T18:09:51.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.751753+0000", 2024-05-08T18:09:51.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2459000000000002e-05 2024-05-08T18:09:51.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.751768+0000", 2024-05-08T18:09:51.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4456e-05 2024-05-08T18:09:51.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.751851+0000", 2024-05-08T18:09:51.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3125000000000001e-05 2024-05-08T18:09:51.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.752007+0000", 2024-05-08T18:09:51.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015600600000000001 2024-05-08T18:09:51.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:51.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.752538+0000", 2024-05-08T18:09:51.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053095599999999996 2024-05-08T18:09:51.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:51.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.770455+0000", 2024-05-08T18:09:51.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017917737999999999 2024-05-08T18:09:51.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.770931+0000", 2024-05-08T18:09:51.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047550100000000003 2024-05-08T18:09:51.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.771024+0000", 2024-05-08T18:09:51.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3351999999999997e-05 2024-05-08T18:09:51.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:31.771068+0000", 2024-05-08T18:09:51.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4134999999999997e-05 2024-05-08T18:09:51.163 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.163 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.163 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.163 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2398 3.2 3:407d962b:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.KLzuC9jE0dQQ2mbYKDlwZ2FjyZ2USrg_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-05-08T18:09:51.163 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:36.173522+0000", 2024-05-08T18:09:51.163 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.903410496999999, 2024-05-08T18:09:51.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021050192999999998, 2024-05-08T18:09:51.164 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.164 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.164 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.164 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:51.164 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:51.164 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.164 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2398 2024-05-08T18:09:51.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.164 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.173522+0000", 2024-05-08T18:09:51.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.173522+0000", 2024-05-08T18:09:51.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.173524+0000", 2024-05-08T18:09:51.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.492e-06 2024-05-08T18:09:51.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.176224+0000", 2024-05-08T18:09:51.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027001450000000001 2024-05-08T18:09:51.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.176267+0000", 2024-05-08T18:09:51.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2613e-05 2024-05-08T18:09:51.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.176282+0000", 2024-05-08T18:09:51.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5387999999999999e-05 2024-05-08T18:09:51.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.176369+0000", 2024-05-08T18:09:51.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6377000000000003e-05 2024-05-08T18:09:51.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.176553+0000", 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018444199999999999 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.176722+0000", 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016864500000000001 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.185750+0000", 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090278470000000003 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.194491+0000", 2024-05-08T18:09:51.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087415549999999998 2024-05-08T18:09:51.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.194536+0000", 2024-05-08T18:09:51.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4586999999999998e-05 2024-05-08T18:09:51.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.194572+0000", 2024-05-08T18:09:51.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6102000000000001e-05 2024-05-08T18:09:51.168 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.168 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.168 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.169 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4388.0:2401 3.29 3:948ba1e9:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.99:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-05-08T18:09:51.169 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-08T18:09:36.196818+0000", 2024-05-08T18:09:51.169 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.880114505, 2024-05-08T18:09:51.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019393433000000002, 2024-05-08T18:09:51.169 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-08T18:09:51.169 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-08T18:09:51.169 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.169 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-08T18:09:51.169 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4388", 2024-05-08T18:09:51.169 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.169 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2401 2024-05-08T18:09:51.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.169 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-08T18:09:51.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.196818+0000", 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.196818+0000", 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.196819+0000", 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0800000000000003e-07 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.198370+0000", 2024-05-08T18:09:51.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001551371 2024-05-08T18:09:51.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-08T18:09:51.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.198392+0000", 2024-05-08T18:09:51.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2354e-05 2024-05-08T18:09:51.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.198402+0000", 2024-05-08T18:09:51.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7769999999999997e-06 2024-05-08T18:09:51.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-08T18:09:51.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.198459+0000", 2024-05-08T18:09:51.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6975000000000003e-05 2024-05-08T18:09:51.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.198593+0000", 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013419699999999999 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.199002+0000", 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040868399999999998 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.207992+0000", 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089898770000000003 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.216125+0000", 2024-05-08T18:09:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081325600000000005 2024-05-08T18:09:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-08T18:09:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.216175+0000", 2024-05-08T18:09:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0164999999999998e-05 2024-05-08T18:09:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T18:09:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T18:09:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-08T18:09:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-08T18:09:36.216211+0000", 2024-05-08T18:09:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6565e-05 2024-05-08T18:09:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T18:09:51.174 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-08T18:09:51.174 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:09:51.175 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:09:51.307 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:51.307 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:51.307 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:51.307 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:51.321 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:09:51.443 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:51.444 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:51.444 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:51.444 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:51.444 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:51.457 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:09:51.576 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:51.576 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:51.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:51.576 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:51.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.576 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1190 3.31 e85/20 3:8c795880:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_2:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:51.577 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.973668+0000", 2024-05-08T18:09:51.577 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.603355784999998, 2024-05-08T18:09:51.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021568941000000001, 2024-05-08T18:09:51.577 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.577 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.577 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.577 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.973668+0000", 2024-05-08T18:09:51.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.973668+0000", 2024-05-08T18:09:51.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.973671+0000", 2024-05-08T18:09:51.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2100000000000002e-06 2024-05-08T18:09:51.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.980815+0000", 2024-05-08T18:09:51.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071441860000000003 2024-05-08T18:09:51.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.980858+0000", 2024-05-08T18:09:51.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2852000000000002e-05 2024-05-08T18:09:51.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.980879+0000", 2024-05-08T18:09:51.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.107e-05 2024-05-08T18:09:51.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981093+0000", 2024-05-08T18:09:51.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000213857 2024-05-08T18:09:51.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981135+0000", 2024-05-08T18:09:51.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2249999999999997e-05 2024-05-08T18:09:51.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.995097+0000", 2024-05-08T18:09:51.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013961295 2024-05-08T18:09:51.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.995237+0000", 2024-05-08T18:09:51.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000140221 2024-05-08T18:09:51.580 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.580 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.581 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.581 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1191 3.1d e85/20 3:b81eb771:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_3:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:51.581 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.989442+0000", 2024-05-08T18:09:51.581 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.587581368000002, 2024-05-08T18:09:51.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020798275000000001, 2024-05-08T18:09:51.581 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.581 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.581 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.581 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989442+0000", 2024-05-08T18:09:51.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989442+0000", 2024-05-08T18:09:51.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989443+0000", 2024-05-08T18:09:51.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-05-08T18:09:51.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994630+0000", 2024-05-08T18:09:51.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051867930000000003 2024-05-08T18:09:51.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994663+0000", 2024-05-08T18:09:51.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3272000000000003e-05 2024-05-08T18:09:51.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994680+0000", 2024-05-08T18:09:51.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7266999999999999e-05 2024-05-08T18:09:51.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994795+0000", 2024-05-08T18:09:51.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011437799999999999 2024-05-08T18:09:51.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.994836+0000", 2024-05-08T18:09:51.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0686000000000003e-05 2024-05-08T18:09:51.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010110+0000", 2024-05-08T18:09:51.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015274081 2024-05-08T18:09:51.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010241+0000", 2024-05-08T18:09:51.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013107099999999999 2024-05-08T18:09:51.585 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.585 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.585 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.585 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1196 3.9 3:91f0c251:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:51.585 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.036686+0000", 2024-05-08T18:09:51.585 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.540337563000001, 2024-05-08T18:09:51.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019572662000000001, 2024-05-08T18:09:51.585 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.585 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.585 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.585 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:51.585 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:51.585 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.585 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1196 2024-05-08T18:09:51.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.586 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.036686+0000", 2024-05-08T18:09:51.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.036686+0000", 2024-05-08T18:09:51.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.036691+0000", 2024-05-08T18:09:51.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8099999999999997e-06 2024-05-08T18:09:51.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041369+0000", 2024-05-08T18:09:51.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0046777590000000001 2024-05-08T18:09:51.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041413+0000", 2024-05-08T18:09:51.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4297e-05 2024-05-08T18:09:51.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041443+0000", 2024-05-08T18:09:51.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9635999999999999e-05 2024-05-08T18:09:51.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041588+0000", 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014564100000000001 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.041833+0000", 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000244777 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.042054+0000", 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022125399999999999 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:51.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.051316+0000", 2024-05-08T18:09:51.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092614059999999998 2024-05-08T18:09:51.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056067+0000", 2024-05-08T18:09:51.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047512639999999998 2024-05-08T18:09:51.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056171+0000", 2024-05-08T18:09:51.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010425900000000001 2024-05-08T18:09:51.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.056259+0000", 2024-05-08T18:09:51.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7559000000000007e-05 2024-05-08T18:09:51.590 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.590 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.590 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.590 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1202 3.14 3:2a8c8569:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:51.590 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.100310+0000", 2024-05-08T18:09:51.590 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.476713951999997, 2024-05-08T18:09:51.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030670528999999998, 2024-05-08T18:09:51.590 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.590 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.590 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.590 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:51.590 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:51.591 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.591 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1202 2024-05-08T18:09:51.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.591 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.100310+0000", 2024-05-08T18:09:51.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.100310+0000", 2024-05-08T18:09:51.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.100352+0000", 2024-05-08T18:09:51.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2315999999999999e-05 2024-05-08T18:09:51.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.105824+0000", 2024-05-08T18:09:51.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054720649999999999 2024-05-08T18:09:51.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.105863+0000", 2024-05-08T18:09:51.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8649000000000002e-05 2024-05-08T18:09:51.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.105883+0000", 2024-05-08T18:09:51.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0383000000000001e-05 2024-05-08T18:09:51.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106019+0000", 2024-05-08T18:09:51.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013552200000000001 2024-05-08T18:09:51.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106318+0000", 2024-05-08T18:09:51.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029913900000000002 2024-05-08T18:09:51.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:51.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106586+0000", 2024-05-08T18:09:51.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026771299999999999 2024-05-08T18:09:51.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:51.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.128110+0000", 2024-05-08T18:09:51.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021524155 2024-05-08T18:09:51.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130655+0000", 2024-05-08T18:09:51.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025453960000000001 2024-05-08T18:09:51.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130831+0000", 2024-05-08T18:09:51.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017583400000000001 2024-05-08T18:09:51.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130980+0000", 2024-05-08T18:09:51.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149357 2024-05-08T18:09:51.595 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.595 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.595 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.595 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1203 3.1a 3:592e440d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:51.595 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.110063+0000", 2024-05-08T18:09:51.596 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.466960342, 2024-05-08T18:09:51.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023166567999999998, 2024-05-08T18:09:51.596 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.596 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.596 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.596 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:51.596 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:51.596 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.596 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1203 2024-05-08T18:09:51.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.596 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110063+0000", 2024-05-08T18:09:51.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110063+0000", 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110067+0000", 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3629999999999998e-06 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114611+0000", 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00454375 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114653+0000", 2024-05-08T18:09:51.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2549999999999997e-05 2024-05-08T18:09:51.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114681+0000", 2024-05-08T18:09:51.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7878999999999999e-05 2024-05-08T18:09:51.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.114872+0000", 2024-05-08T18:09:51.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019109500000000001 2024-05-08T18:09:51.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.115275+0000", 2024-05-08T18:09:51.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040327700000000001 2024-05-08T18:09:51.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:51.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.115636+0000", 2024-05-08T18:09:51.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036014899999999998 2024-05-08T18:09:51.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:51.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.129938+0000", 2024-05-08T18:09:51.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014302848 2024-05-08T18:09:51.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.133055+0000", 2024-05-08T18:09:51.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00311699 2024-05-08T18:09:51.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.133159+0000", 2024-05-08T18:09:51.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103138 2024-05-08T18:09:51.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.133230+0000", 2024-05-08T18:09:51.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1528999999999999e-05 2024-05-08T18:09:51.600 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.600 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.601 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.601 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1211 3.3 3:c13935f4:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:51.601 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.195183+0000", 2024-05-08T18:09:51.601 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.381840343999997, 2024-05-08T18:09:51.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.026007971000000001, 2024-05-08T18:09:51.601 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.601 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.601 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.601 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:51.601 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:51.601 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.601 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1211 2024-05-08T18:09:51.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.602 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.195183+0000", 2024-05-08T18:09:51.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.195183+0000", 2024-05-08T18:09:51.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.195187+0000", 2024-05-08T18:09:51.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6540000000000001e-06 2024-05-08T18:09:51.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199150+0000", 2024-05-08T18:09:51.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039627719999999998 2024-05-08T18:09:51.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199188+0000", 2024-05-08T18:09:51.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195999999999998e-05 2024-05-08T18:09:51.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199210+0000", 2024-05-08T18:09:51.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2027000000000001e-05 2024-05-08T18:09:51.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199356+0000", 2024-05-08T18:09:51.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014612800000000001 2024-05-08T18:09:51.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199622+0000", 2024-05-08T18:09:51.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026600199999999999 2024-05-08T18:09:51.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:51.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.199846+0000", 2024-05-08T18:09:51.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022389099999999999 2024-05-08T18:09:51.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.213755+0000", 2024-05-08T18:09:51.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013908536000000001 2024-05-08T18:09:51.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:51.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.221024+0000", 2024-05-08T18:09:51.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0072690439999999997 2024-05-08T18:09:51.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.221110+0000", 2024-05-08T18:09:51.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6008999999999996e-05 2024-05-08T18:09:51.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.221191+0000", 2024-05-08T18:09:51.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1712000000000006e-05 2024-05-08T18:09:51.606 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.606 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.606 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.606 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1224 3.13 e85/20 3:c82cef46:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_8:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:51.606 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.644014+0000", 2024-05-08T18:09:51.606 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.933009937000001, 2024-05-08T18:09:51.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019705998999999998, 2024-05-08T18:09:51.606 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.607 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.607 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.607 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.644014+0000", 2024-05-08T18:09:51.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.644014+0000", 2024-05-08T18:09:51.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.644018+0000", 2024-05-08T18:09:51.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6500000000000002e-06 2024-05-08T18:09:51.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651361+0000", 2024-05-08T18:09:51.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073436789999999997 2024-05-08T18:09:51.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651411+0000", 2024-05-08T18:09:51.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9613000000000001e-05 2024-05-08T18:09:51.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651438+0000", 2024-05-08T18:09:51.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6699e-05 2024-05-08T18:09:51.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651567+0000", 2024-05-08T18:09:51.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012993299999999999 2024-05-08T18:09:51.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.651601+0000", 2024-05-08T18:09:51.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3268000000000001e-05 2024-05-08T18:09:51.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663646+0000", 2024-05-08T18:09:51.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012045451 2024-05-08T18:09:51.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663720+0000", 2024-05-08T18:09:51.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3706000000000002e-05 2024-05-08T18:09:51.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.610 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.610 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1226 3.3 3:c18beed9:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:51.610 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.668709+0000", 2024-05-08T18:09:51.610 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.908314482000002, 2024-05-08T18:09:51.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020071530000000001, 2024-05-08T18:09:51.611 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.611 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.611 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.611 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:51.611 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:51.611 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.611 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1226 2024-05-08T18:09:51.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.611 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.668709+0000", 2024-05-08T18:09:51.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.668709+0000", 2024-05-08T18:09:51.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.668717+0000", 2024-05-08T18:09:51.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7100000000000007e-06 2024-05-08T18:09:51.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672764+0000", 2024-05-08T18:09:51.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040465630000000004 2024-05-08T18:09:51.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672791+0000", 2024-05-08T18:09:51.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7636000000000001e-05 2024-05-08T18:09:51.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672804+0000", 2024-05-08T18:09:51.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3009e-05 2024-05-08T18:09:51.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.672905+0000", 2024-05-08T18:09:51.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010105100000000001 2024-05-08T18:09:51.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.673113+0000", 2024-05-08T18:09:51.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000207405 2024-05-08T18:09:51.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:51.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.673300+0000", 2024-05-08T18:09:51.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000186875 2024-05-08T18:09:51.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:51.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.682552+0000", 2024-05-08T18:09:51.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0092519690000000005 2024-05-08T18:09:51.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.688655+0000", 2024-05-08T18:09:51.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061032300000000003 2024-05-08T18:09:51.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.688723+0000", 2024-05-08T18:09:51.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8263999999999996e-05 2024-05-08T18:09:51.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.688781+0000", 2024-05-08T18:09:51.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7818000000000001e-05 2024-05-08T18:09:51.615 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.615 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.616 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.616 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1397 3.34 3:2c6418f0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:51.616 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.790046+0000", 2024-05-08T18:09:51.616 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.786977511000003, 2024-05-08T18:09:51.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035561055000000001, 2024-05-08T18:09:51.616 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.616 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.616 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.616 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:51.616 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:51.616 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.616 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1397 2024-05-08T18:09:51.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.616 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.790046+0000", 2024-05-08T18:09:51.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.790046+0000", 2024-05-08T18:09:51.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.790051+0000", 2024-05-08T18:09:51.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.51e-06 2024-05-08T18:09:51.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795411+0000", 2024-05-08T18:09:51.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0053598880000000002 2024-05-08T18:09:51.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795450+0000", 2024-05-08T18:09:51.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9555999999999999e-05 2024-05-08T18:09:51.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795470+0000", 2024-05-08T18:09:51.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9644e-05 2024-05-08T18:09:51.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795648+0000", 2024-05-08T18:09:51.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017859000000000001 2024-05-08T18:09:51.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:51.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.795661+0000", 2024-05-08T18:09:51.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2116999999999999e-05 2024-05-08T18:09:51.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.801909+0000", 2024-05-08T18:09:51.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0062485969999999998 2024-05-08T18:09:51.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802123+0000", 2024-05-08T18:09:51.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021390100000000001 2024-05-08T18:09:51.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:51.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802378+0000", 2024-05-08T18:09:51.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025494999999999999 2024-05-08T18:09:51.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:51.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822891+0000", 2024-05-08T18:09:51.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020513432000000002 2024-05-08T18:09:51.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825434+0000", 2024-05-08T18:09:51.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025423279999999999 2024-05-08T18:09:51.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825533+0000", 2024-05-08T18:09:51.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9302999999999994e-05 2024-05-08T18:09:51.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825607+0000", 2024-05-08T18:09:51.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4239000000000005e-05 2024-05-08T18:09:51.621 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.621 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.622 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.622 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1399 3.2c e87/20 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head v 87'3, mlcod=85'1)", 2024-05-08T18:09:51.622 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.825958+0000", 2024-05-08T18:09:51.622 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.751066217999998, 2024-05-08T18:09:51.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023463491, 2024-05-08T18:09:51.622 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.622 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.622 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.622 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825958+0000", 2024-05-08T18:09:51.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825958+0000", 2024-05-08T18:09:51.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825959+0000", 2024-05-08T18:09:51.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.68e-06 2024-05-08T18:09:51.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829465+0000", 2024-05-08T18:09:51.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003505949 2024-05-08T18:09:51.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829510+0000", 2024-05-08T18:09:51.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4446000000000001e-05 2024-05-08T18:09:51.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829529+0000", 2024-05-08T18:09:51.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9242999999999999e-05 2024-05-08T18:09:51.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829699+0000", 2024-05-08T18:09:51.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017010500000000001 2024-05-08T18:09:51.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.829767+0000", 2024-05-08T18:09:51.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8422000000000003e-05 2024-05-08T18:09:51.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849237+0000", 2024-05-08T18:09:51.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019469113999999999 2024-05-08T18:09:51.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849421+0000", 2024-05-08T18:09:51.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000184532 2024-05-08T18:09:51.626 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.626 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.626 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.626 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1413 3.9 3:915363b3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:51.626 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.966164+0000", 2024-05-08T18:09:51.626 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.610859798, 2024-05-08T18:09:51.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024879884000000001, 2024-05-08T18:09:51.626 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.626 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.626 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.626 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:51.627 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:51.627 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.627 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1413 2024-05-08T18:09:51.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.627 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.966164+0000", 2024-05-08T18:09:51.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.966164+0000", 2024-05-08T18:09:51.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.966168+0000", 2024-05-08T18:09:51.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0570000000000003e-06 2024-05-08T18:09:51.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.974319+0000", 2024-05-08T18:09:51.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0081509930000000005 2024-05-08T18:09:51.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.974388+0000", 2024-05-08T18:09:51.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9326000000000007e-05 2024-05-08T18:09:51.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.974418+0000", 2024-05-08T18:09:51.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9519e-05 2024-05-08T18:09:51.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.974598+0000", 2024-05-08T18:09:51.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017978199999999999 2024-05-08T18:09:51.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.975002+0000", 2024-05-08T18:09:51.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000404268 2024-05-08T18:09:51.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:51.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.975430+0000", 2024-05-08T18:09:51.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042801100000000001 2024-05-08T18:09:51.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:51.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.988165+0000", 2024-05-08T18:09:51.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012734568 2024-05-08T18:09:51.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.990873+0000", 2024-05-08T18:09:51.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027083559999999999 2024-05-08T18:09:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.990975+0000", 2024-05-08T18:09:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101751 2024-05-08T18:09:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.991044+0000", 2024-05-08T18:09:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9252999999999996e-05 2024-05-08T18:09:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1416 3.2c e87/20 3:345ebd70:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_22:head v 87'4, mlcod=85'2)", 2024-05-08T18:09:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.001257+0000", 2024-05-08T18:09:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.575766786999999, 2024-05-08T18:09:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022070702000000001, 2024-05-08T18:09:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.001257+0000", 2024-05-08T18:09:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.001257+0000", 2024-05-08T18:09:51.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.001259+0000", 2024-05-08T18:09:51.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1859999999999999e-06 2024-05-08T18:09:51.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004209+0000", 2024-05-08T18:09:51.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029502690000000002 2024-05-08T18:09:51.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004244+0000", 2024-05-08T18:09:51.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999998e-05 2024-05-08T18:09:51.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004261+0000", 2024-05-08T18:09:51.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6969999999999998e-05 2024-05-08T18:09:51.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004412+0000", 2024-05-08T18:09:51.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015088800000000001 2024-05-08T18:09:51.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.004454+0000", 2024-05-08T18:09:51.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2076000000000002e-05 2024-05-08T18:09:51.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023211+0000", 2024-05-08T18:09:51.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018757424000000002 2024-05-08T18:09:51.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023328+0000", 2024-05-08T18:09:51.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116519 2024-05-08T18:09:51.635 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.635 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.635 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.636 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1426 3.3 3:c1fceb03:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:51.636 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.418434+0000", 2024-05-08T18:09:51.636 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.158589655999997, 2024-05-08T18:09:51.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.026406447, 2024-05-08T18:09:51.636 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.636 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.636 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.636 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:51.636 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:51.636 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.636 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1426 2024-05-08T18:09:51.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.637 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.418434+0000", 2024-05-08T18:09:51.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.418434+0000", 2024-05-08T18:09:51.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.418437+0000", 2024-05-08T18:09:51.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.751e-06 2024-05-08T18:09:51.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.422567+0000", 2024-05-08T18:09:51.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0041297199999999999 2024-05-08T18:09:51.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.422602+0000", 2024-05-08T18:09:51.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4898999999999999e-05 2024-05-08T18:09:51.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.422623+0000", 2024-05-08T18:09:51.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1203e-05 2024-05-08T18:09:51.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.422783+0000", 2024-05-08T18:09:51.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016033200000000001 2024-05-08T18:09:51.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.423045+0000", 2024-05-08T18:09:51.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026236199999999998 2024-05-08T18:09:51.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:51.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.423283+0000", 2024-05-08T18:09:51.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023804100000000001 2024-05-08T18:09:51.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:51.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.432169+0000", 2024-05-08T18:09:51.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0088858730000000007 2024-05-08T18:09:51.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.444662+0000", 2024-05-08T18:09:51.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012492411 2024-05-08T18:09:51.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.444765+0000", 2024-05-08T18:09:51.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103183 2024-05-08T18:09:51.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.444841+0000", 2024-05-08T18:09:51.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5672000000000003e-05 2024-05-08T18:09:51.641 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.641 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.641 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.641 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1431 3.3 3:c36c40c5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:51.641 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.506262+0000", 2024-05-08T18:09:51.641 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.070762141000003, 2024-05-08T18:09:51.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022453905, 2024-05-08T18:09:51.641 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.641 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.642 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.642 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:51.642 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:51.642 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.642 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1431 2024-05-08T18:09:51.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.642 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.506262+0000", 2024-05-08T18:09:51.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.506262+0000", 2024-05-08T18:09:51.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.506263+0000", 2024-05-08T18:09:51.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.748e-06 2024-05-08T18:09:51.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.509983+0000", 2024-05-08T18:09:51.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037198740000000002 2024-05-08T18:09:51.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510006+0000", 2024-05-08T18:09:51.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2269999999999999e-05 2024-05-08T18:09:51.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510015+0000", 2024-05-08T18:09:51.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6579999999999997e-06 2024-05-08T18:09:51.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510105+0000", 2024-05-08T18:09:51.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9435e-05 2024-05-08T18:09:51.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510321+0000", 2024-05-08T18:09:51.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021608700000000001 2024-05-08T18:09:51.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:51.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.510566+0000", 2024-05-08T18:09:51.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024504600000000001 2024-05-08T18:09:51.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:51.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.518436+0000", 2024-05-08T18:09:51.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078703409999999994 2024-05-08T18:09:51.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.528584+0000", 2024-05-08T18:09:51.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01014817 2024-05-08T18:09:51.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.528659+0000", 2024-05-08T18:09:51.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4328999999999999e-05 2024-05-08T18:09:51.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.528716+0000", 2024-05-08T18:09:51.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6947000000000002e-05 2024-05-08T18:09:51.646 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.646 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.646 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.647 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1454 3.1a 3:5820ba98:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:51.647 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.364586+0000", 2024-05-08T18:09:51.647 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.212437747000003, 2024-05-08T18:09:51.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030504185999999999, 2024-05-08T18:09:51.647 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.647 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.647 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.647 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:51.647 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:51.647 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.647 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1454 2024-05-08T18:09:51.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.648 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.364586+0000", 2024-05-08T18:09:51.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.364586+0000", 2024-05-08T18:09:51.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.364589+0000", 2024-05-08T18:09:51.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.74e-06 2024-05-08T18:09:51.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369474+0000", 2024-05-08T18:09:51.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004885375 2024-05-08T18:09:51.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369507+0000", 2024-05-08T18:09:51.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2591e-05 2024-05-08T18:09:51.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369522+0000", 2024-05-08T18:09:51.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4997000000000001e-05 2024-05-08T18:09:51.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369610+0000", 2024-05-08T18:09:51.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8478000000000002e-05 2024-05-08T18:09:51.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369759+0000", 2024-05-08T18:09:51.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014915100000000001 2024-05-08T18:09:51.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-05-08T18:09:51.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.369895+0000", 2024-05-08T18:09:51.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013564299999999999 2024-05-08T18:09:51.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:51.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.376823+0000", 2024-05-08T18:09:51.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069279820000000001 2024-05-08T18:09:51.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.394937+0000", 2024-05-08T18:09:51.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018114213000000001 2024-05-08T18:09:51.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.395021+0000", 2024-05-08T18:09:51.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3502000000000001e-05 2024-05-08T18:09:51.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.395090+0000", 2024-05-08T18:09:51.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9513999999999999e-05 2024-05-08T18:09:51.652 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.652 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.652 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.652 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:2163 3.1c e93/20 3:3b23b6ce:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.61:head v 93'5, mlcod=92'3)", 2024-05-08T18:09:51.653 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:31.199583+0000", 2024-05-08T18:09:51.653 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 20.377440371999999, 2024-05-08T18:09:51.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020378700999999999, 2024-05-08T18:09:51.653 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.653 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.653 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.653 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.199583+0000", 2024-05-08T18:09:51.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.199583+0000", 2024-05-08T18:09:51.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.199585+0000", 2024-05-08T18:09:51.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8300000000000001e-06 2024-05-08T18:09:51.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.201882+0000", 2024-05-08T18:09:51.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022968630000000001 2024-05-08T18:09:51.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.201914+0000", 2024-05-08T18:09:51.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1718999999999999e-05 2024-05-08T18:09:51.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.201931+0000", 2024-05-08T18:09:51.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6906e-05 2024-05-08T18:09:51.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.202096+0000", 2024-05-08T18:09:51.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016514000000000001 2024-05-08T18:09:51.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.202166+0000", 2024-05-08T18:09:51.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0005000000000005e-05 2024-05-08T18:09:51.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.219837+0000", 2024-05-08T18:09:51.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017670866 2024-05-08T18:09:51.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.219962+0000", 2024-05-08T18:09:51.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012537200000000001 2024-05-08T18:09:51.657 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.657 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.657 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.657 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:2190 3.1 e93/20 3:8364520c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.6cWLHpOdr1veoeL1lcBsJwZn6mj4f5g_1:head v 93'6, mlcod=91'4)", 2024-05-08T18:09:51.657 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:32.003726+0000", 2024-05-08T18:09:51.657 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.573297379, 2024-05-08T18:09:51.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021164260000000001, 2024-05-08T18:09:51.657 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.657 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.657 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.657 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.003726+0000", 2024-05-08T18:09:51.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.003726+0000", 2024-05-08T18:09:51.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.003729+0000", 2024-05-08T18:09:51.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.357e-06 2024-05-08T18:09:51.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.011241+0000", 2024-05-08T18:09:51.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0075126380000000003 2024-05-08T18:09:51.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.011277+0000", 2024-05-08T18:09:51.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5756000000000001e-05 2024-05-08T18:09:51.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.011293+0000", 2024-05-08T18:09:51.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6053e-05 2024-05-08T18:09:51.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.011447+0000", 2024-05-08T18:09:51.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015367899999999999 2024-05-08T18:09:51.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.011492+0000", 2024-05-08T18:09:51.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5456e-05 2024-05-08T18:09:51.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.024764+0000", 2024-05-08T18:09:51.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013272045999999999 2024-05-08T18:09:51.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.024891+0000", 2024-05-08T18:09:51.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012627499999999999 2024-05-08T18:09:51.661 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.661 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.661 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.661 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2215 3.34 3:2d69b5b5:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.ECcZIfjzmPaHWGGr4yam8Fvgpxv0OEo_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:51.661 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:32.551200+0000", 2024-05-08T18:09:51.661 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.025823354, 2024-05-08T18:09:51.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019579551000000001, 2024-05-08T18:09:51.661 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.661 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.661 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.662 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:51.662 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:51.662 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:51.662 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2215 2024-05-08T18:09:51.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.662 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.551200+0000", 2024-05-08T18:09:51.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.551200+0000", 2024-05-08T18:09:51.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.551204+0000", 2024-05-08T18:09:51.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4470000000000002e-06 2024-05-08T18:09:51.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.555260+0000", 2024-05-08T18:09:51.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040564679999999997 2024-05-08T18:09:51.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.555324+0000", 2024-05-08T18:09:51.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3793000000000004e-05 2024-05-08T18:09:51.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.555357+0000", 2024-05-08T18:09:51.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2823000000000001e-05 2024-05-08T18:09:51.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.555564+0000", 2024-05-08T18:09:51.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020699100000000001 2024-05-08T18:09:51.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.556015+0000", 2024-05-08T18:09:51.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00045138300000000003 2024-05-08T18:09:51.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:51.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.556444+0000", 2024-05-08T18:09:51.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000428913 2024-05-08T18:09:51.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:51.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.570555+0000", 2024-05-08T18:09:51.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014110912 2024-05-08T18:09:51.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:51.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.570610+0000", 2024-05-08T18:09:51.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5102999999999997e-05 2024-05-08T18:09:51.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.570706+0000", 2024-05-08T18:09:51.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6065999999999998e-05 2024-05-08T18:09:51.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.570780+0000", 2024-05-08T18:09:51.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3652000000000006e-05 2024-05-08T18:09:51.666 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.666 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.667 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.667 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:2380 3.e e94/20 3:713200a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.N3BoeKsRn7I3GNNh1gsMqBxJl5ACtoq_1:head v 94'9, mlcod=93'7)", 2024-05-08T18:09:51.667 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:35.846176+0000", 2024-05-08T18:09:51.667 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.730847752000001, 2024-05-08T18:09:51.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019862516, 2024-05-08T18:09:51.667 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.667 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.667 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.667 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.846176+0000", 2024-05-08T18:09:51.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.846176+0000", 2024-05-08T18:09:51.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.846178+0000", 2024-05-08T18:09:51.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.525e-06 2024-05-08T18:09:51.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.847942+0000", 2024-05-08T18:09:51.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0017642980000000001 2024-05-08T18:09:51.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.847969+0000", 2024-05-08T18:09:51.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6910000000000002e-05 2024-05-08T18:09:51.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.847980+0000", 2024-05-08T18:09:51.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1049999999999999e-05 2024-05-08T18:09:51.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.848085+0000", 2024-05-08T18:09:51.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105394 2024-05-08T18:09:51.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.848129+0000", 2024-05-08T18:09:51.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4056e-05 2024-05-08T18:09:51.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.865946+0000", 2024-05-08T18:09:51.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017816307999999999 2024-05-08T18:09:51.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866039+0000", 2024-05-08T18:09:51.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2974999999999997e-05 2024-05-08T18:09:51.671 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.671 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.671 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.671 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:2404 3.1 e95/20 3:8218d405:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.bqgynIkQNaRvS-N0e0aQapo0Dh5XrQ2_1:head v 95'9, mlcod=93'7)", 2024-05-08T18:09:51.671 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:36.284494+0000", 2024-05-08T18:09:51.671 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 15.292530255999999, 2024-05-08T18:09:51.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019925821999999999, 2024-05-08T18:09:51.671 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:51.671 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:51.671 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:51.671 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:51.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:51.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:36.284494+0000", 2024-05-08T18:09:51.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:51.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:36.284494+0000", 2024-05-08T18:09:51.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:51.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:51.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:36.284496+0000", 2024-05-08T18:09:51.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1739999999999999e-06 2024-05-08T18:09:51.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:51.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:36.289204+0000", 2024-05-08T18:09:51.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047082089999999997 2024-05-08T18:09:51.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:51.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:36.289252+0000", 2024-05-08T18:09:51.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8365999999999997e-05 2024-05-08T18:09:51.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:51.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:36.289275+0000", 2024-05-08T18:09:51.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3147e-05 2024-05-08T18:09:51.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:51.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:36.289444+0000", 2024-05-08T18:09:51.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000168608 2024-05-08T18:09:51.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:51.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:36.289513+0000", 2024-05-08T18:09:51.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8693000000000001e-05 2024-05-08T18:09:51.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:51.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:36.304341+0000", 2024-05-08T18:09:51.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014828599 2024-05-08T18:09:51.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:51.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:51.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:51.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:36.304419+0000", 2024-05-08T18:09:51.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8026000000000001e-05 2024-05-08T18:09:51.675 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.675 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.675 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.675 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:51.675 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:51.675 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:51.676 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:09:51.808 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:51.808 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:51.808 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:51.808 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:51.822 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:09:51.940 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:51.940 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:51.940 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:51.940 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:51.940 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:51.954 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:09:52.075 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1191 3.1d 3:b81eb771:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.092569816999998, 2024-05-08T18:09:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.029646883999999998, 2024-05-08T18:09:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1191 2024-05-08T18:09:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981330+0000", 2024-05-08T18:09:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981334+0000", 2024-05-08T18:09:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1540000000000004e-06 2024-05-08T18:09:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988180+0000", 2024-05-08T18:09:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068463619999999999 2024-05-08T18:09:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988216+0000", 2024-05-08T18:09:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6293e-05 2024-05-08T18:09:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988236+0000", 2024-05-08T18:09:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9403e-05 2024-05-08T18:09:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988410+0000", 2024-05-08T18:09:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017415400000000001 2024-05-08T18:09:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.988803+0000", 2024-05-08T18:09:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000393271 2024-05-08T18:09:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.989175+0000", 2024-05-08T18:09:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037178899999999997 2024-05-08T18:09:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.006397+0000", 2024-05-08T18:09:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017221744000000001 2024-05-08T18:09:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010666+0000", 2024-05-08T18:09:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042692880000000004 2024-05-08T18:09:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010836+0000", 2024-05-08T18:09:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000169498 2024-05-08T18:09:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.010976+0000", 2024-05-08T18:09:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014092799999999999 2024-05-08T18:09:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1194 3.16 3:6b2325a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.058423898999997, 2024-05-08T18:09:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030556241000000001, 2024-05-08T18:09:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1194 2024-05-08T18:09:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015476+0000", 2024-05-08T18:09:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.015492+0000", 2024-05-08T18:09:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6863000000000001e-05 2024-05-08T18:09:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019937+0000", 2024-05-08T18:09:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044450399999999999 2024-05-08T18:09:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019975+0000", 2024-05-08T18:09:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7676000000000003e-05 2024-05-08T18:09:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.019995+0000", 2024-05-08T18:09:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.969e-05 2024-05-08T18:09:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020165+0000", 2024-05-08T18:09:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017003400000000001 2024-05-08T18:09:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020437+0000", 2024-05-08T18:09:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027198599999999999 2024-05-08T18:09:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020668+0000", 2024-05-08T18:09:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023154 2024-05-08T18:09:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.032879+0000", 2024-05-08T18:09:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012210883000000001 2024-05-08T18:09:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045595+0000", 2024-05-08T18:09:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012716005000000001 2024-05-08T18:09:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.045811+0000", 2024-05-08T18:09:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021556400000000001 2024-05-08T18:09:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.046032+0000", 2024-05-08T18:09:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022096 2024-05-08T18:09:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1218 3.c 3:33b8068a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.511620395999998, 2024-05-08T18:09:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024735007, 2024-05-08T18:09:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1218 2024-05-08T18:09:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562279+0000", 2024-05-08T18:09:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.562282+0000", 2024-05-08T18:09:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7769999999999998e-06 2024-05-08T18:09:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568816+0000", 2024-05-08T18:09:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065338169999999999 2024-05-08T18:09:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568851+0000", 2024-05-08T18:09:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5892999999999997e-05 2024-05-08T18:09:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568871+0000", 2024-05-08T18:09:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9306000000000001e-05 2024-05-08T18:09:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.568992+0000", 2024-05-08T18:09:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120925 2024-05-08T18:09:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.569258+0000", 2024-05-08T18:09:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026655299999999999 2024-05-08T18:09:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.569522+0000", 2024-05-08T18:09:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026331999999999999 2024-05-08T18:09:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584269+0000", 2024-05-08T18:09:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014747454 2024-05-08T18:09:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.586687+0000", 2024-05-08T18:09:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024181770000000001 2024-05-08T18:09:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.586888+0000", 2024-05-08T18:09:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000201137 2024-05-08T18:09:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.587014+0000", 2024-05-08T18:09:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012564799999999999 2024-05-08T18:09:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1220 3.c 3:319326d6:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.488932820999999, 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022305417000000001, 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1220 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584967+0000", 2024-05-08T18:09:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.584971+0000", 2024-05-08T18:09:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0729999999999998e-06 2024-05-08T18:09:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591515+0000", 2024-05-08T18:09:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065448340000000002 2024-05-08T18:09:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591549+0000", 2024-05-08T18:09:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3633000000000001e-05 2024-05-08T18:09:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591574+0000", 2024-05-08T18:09:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4482999999999999e-05 2024-05-08T18:09:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591714+0000", 2024-05-08T18:09:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014048500000000001 2024-05-08T18:09:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.591956+0000", 2024-05-08T18:09:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000241616 2024-05-08T18:09:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.592181+0000", 2024-05-08T18:09:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022565000000000001 2024-05-08T18:09:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.606237+0000", 2024-05-08T18:09:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014055646999999999 2024-05-08T18:09:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607095+0000", 2024-05-08T18:09:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085838199999999998 2024-05-08T18:09:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607189+0000", 2024-05-08T18:09:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3962000000000006e-05 2024-05-08T18:09:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.607272+0000", 2024-05-08T18:09:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2651999999999994e-05 2024-05-08T18:09:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1400 3.1c 3:3bb95565:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.245150207000002, 2024-05-08T18:09:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02650396, 2024-05-08T18:09:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1400 2024-05-08T18:09:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828749+0000", 2024-05-08T18:09:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.828753+0000", 2024-05-08T18:09:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4400000000000001e-06 2024-05-08T18:09:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836255+0000", 2024-05-08T18:09:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0075026379999999998 2024-05-08T18:09:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836312+0000", 2024-05-08T18:09:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6459000000000003e-05 2024-05-08T18:09:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836340+0000", 2024-05-08T18:09:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8183000000000001e-05 2024-05-08T18:09:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836510+0000", 2024-05-08T18:09:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000169805 2024-05-08T18:09:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836763+0000", 2024-05-08T18:09:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025333700000000002 2024-05-08T18:09:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.836995+0000", 2024-05-08T18:09:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023236700000000001 2024-05-08T18:09:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849771+0000", 2024-05-08T18:09:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012775760000000001 2024-05-08T18:09:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855089+0000", 2024-05-08T18:09:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0053173889999999996 2024-05-08T18:09:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855183+0000", 2024-05-08T18:09:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4276000000000003e-05 2024-05-08T18:09:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.855253+0000", 2024-05-08T18:09:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0306000000000001e-05 2024-05-08T18:09:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1405 3.c 3:3166280d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.192583771999999, 2024-05-08T18:09:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023065800000000001, 2024-05-08T18:09:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1405 2024-05-08T18:09:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:52.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881316+0000", 2024-05-08T18:09:52.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.881320+0000", 2024-05-08T18:09:52.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-05-08T18:09:52.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887255+0000", 2024-05-08T18:09:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059351509999999996 2024-05-08T18:09:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887305+0000", 2024-05-08T18:09:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9579000000000001e-05 2024-05-08T18:09:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887332+0000", 2024-05-08T18:09:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7276000000000001e-05 2024-05-08T18:09:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887489+0000", 2024-05-08T18:09:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000156465 2024-05-08T18:09:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887745+0000", 2024-05-08T18:09:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025626700000000002 2024-05-08T18:09:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.887980+0000", 2024-05-08T18:09:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000235107 2024-05-08T18:09:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.896366+0000", 2024-05-08T18:09:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083860870000000004 2024-05-08T18:09:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904214+0000", 2024-05-08T18:09:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078482840000000005 2024-05-08T18:09:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904312+0000", 2024-05-08T18:09:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7901999999999999e-05 2024-05-08T18:09:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904381+0000", 2024-05-08T18:09:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9258999999999995e-05 2024-05-08T18:09:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1410 3.30 3:0e0f1cce:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.139358796000003, 2024-05-08T18:09:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.026130820999999999, 2024-05-08T18:09:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1410 2024-05-08T18:09:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934541+0000", 2024-05-08T18:09:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.934544+0000", 2024-05-08T18:09:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2600000000000001e-06 2024-05-08T18:09:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939363+0000", 2024-05-08T18:09:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048190020000000002 2024-05-08T18:09:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939407+0000", 2024-05-08T18:09:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3999999999999999e-05 2024-05-08T18:09:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939428+0000", 2024-05-08T18:09:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0746000000000001e-05 2024-05-08T18:09:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939637+0000", 2024-05-08T18:09:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000209397 2024-05-08T18:09:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.939894+0000", 2024-05-08T18:09:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025690700000000001 2024-05-08T18:09:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.940133+0000", 2024-05-08T18:09:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023939400000000001 2024-05-08T18:09:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.949842+0000", 2024-05-08T18:09:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0097087570000000002 2024-05-08T18:09:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960494+0000", 2024-05-08T18:09:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01065148 2024-05-08T18:09:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960597+0000", 2024-05-08T18:09:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000103529 2024-05-08T18:09:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.960671+0000", 2024-05-08T18:09:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4349000000000003e-05 2024-05-08T18:09:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1446 3.22 3:44011652:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.ZSSilPg5mlM10rrKg_69M2hHMQEJJdg_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.198977163000002, 2024-05-08T18:09:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024780153999999999, 2024-05-08T18:09:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.116 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1446 2024-05-08T18:09:52.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.116 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:52.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874922+0000", 2024-05-08T18:09:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.874926+0000", 2024-05-08T18:09:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2739999999999999e-06 2024-05-08T18:09:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879812+0000", 2024-05-08T18:09:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048860040000000002 2024-05-08T18:09:52.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879849+0000", 2024-05-08T18:09:52.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7919000000000001e-05 2024-05-08T18:09:52.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.879868+0000", 2024-05-08T18:09:52.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8836999999999999e-05 2024-05-08T18:09:52.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880042+0000", 2024-05-08T18:09:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000173981 2024-05-08T18:09:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880452+0000", 2024-05-08T18:09:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040949200000000002 2024-05-08T18:09:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.880849+0000", 2024-05-08T18:09:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039710499999999997 2024-05-08T18:09:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.892821+0000", 2024-05-08T18:09:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011972287 2024-05-08T18:09:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899596+0000", 2024-05-08T18:09:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067744720000000001 2024-05-08T18:09:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899655+0000", 2024-05-08T18:09:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9119000000000001e-05 2024-05-08T18:09:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.899702+0000", 2024-05-08T18:09:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7664000000000003e-05 2024-05-08T18:09:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1464 3.2f 3:f7dca4bf:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.583146+0000", 2024-05-08T18:09:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.490752927999999, 2024-05-08T18:09:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022519284000000001, 2024-05-08T18:09:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1464 2024-05-08T18:09:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.583146+0000", 2024-05-08T18:09:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.583146+0000", 2024-05-08T18:09:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.583149+0000", 2024-05-08T18:09:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5600000000000001e-06 2024-05-08T18:09:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.586965+0000", 2024-05-08T18:09:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003816131 2024-05-08T18:09:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.586991+0000", 2024-05-08T18:09:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5508e-05 2024-05-08T18:09:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587005+0000", 2024-05-08T18:09:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4029000000000001e-05 2024-05-08T18:09:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587087+0000", 2024-05-08T18:09:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2056000000000002e-05 2024-05-08T18:09:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587293+0000", 2024-05-08T18:09:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020639000000000001 2024-05-08T18:09:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.587503+0000", 2024-05-08T18:09:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020987299999999999 2024-05-08T18:09:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.598739+0000", 2024-05-08T18:09:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011236237 2024-05-08T18:09:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.605521+0000", 2024-05-08T18:09:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067817049999999999 2024-05-08T18:09:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.605602+0000", 2024-05-08T18:09:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1225999999999998e-05 2024-05-08T18:09:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.605666+0000", 2024-05-08T18:09:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3569000000000001e-05 2024-05-08T18:09:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1898 3.22 3:462b78d0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.19:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:25.750111+0000", 2024-05-08T18:09:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.323788836999999, 2024-05-08T18:09:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022823415, 2024-05-08T18:09:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1898 2024-05-08T18:09:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.750111+0000", 2024-05-08T18:09:52.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.750111+0000", 2024-05-08T18:09:52.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.750112+0000", 2024-05-08T18:09:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.781e-06 2024-05-08T18:09:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.753962+0000", 2024-05-08T18:09:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003849917 2024-05-08T18:09:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.753992+0000", 2024-05-08T18:09:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0219999999999999e-05 2024-05-08T18:09:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.754006+0000", 2024-05-08T18:09:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3212e-05 2024-05-08T18:09:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.754119+0000", 2024-05-08T18:09:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113304 2024-05-08T18:09:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.754420+0000", 2024-05-08T18:09:52.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030074300000000002 2024-05-08T18:09:52.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:52.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.755298+0000", 2024-05-08T18:09:52.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00087796700000000001 2024-05-08T18:09:52.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.769345+0000", 2024-05-08T18:09:52.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014047217000000001 2024-05-08T18:09:52.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.772660+0000", 2024-05-08T18:09:52.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033153969999999999 2024-05-08T18:09:52.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.772807+0000", 2024-05-08T18:09:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014637600000000001 2024-05-08T18:09:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.772934+0000", 2024-05-08T18:09:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127281 2024-05-08T18:09:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1969 3.28 3:15258d02:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.BXBsdMhvuUI98ehPeo4Z5Oq1UW9BGOc_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.345635+0000", 2024-05-08T18:09:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 24.728264040999999, 2024-05-08T18:09:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023778058000000001, 2024-05-08T18:09:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1969 2024-05-08T18:09:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.345635+0000", 2024-05-08T18:09:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.345635+0000", 2024-05-08T18:09:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.345639+0000", 2024-05-08T18:09:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3900000000000002e-06 2024-05-08T18:09:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.350203+0000", 2024-05-08T18:09:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045640780000000001 2024-05-08T18:09:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.350241+0000", 2024-05-08T18:09:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8463000000000001e-05 2024-05-08T18:09:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.350260+0000", 2024-05-08T18:09:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8859e-05 2024-05-08T18:09:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.350434+0000", 2024-05-08T18:09:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017434500000000001 2024-05-08T18:09:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.350866+0000", 2024-05-08T18:09:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043187899999999998 2024-05-08T18:09:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.351296+0000", 2024-05-08T18:09:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042929900000000001 2024-05-08T18:09:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.367788+0000", 2024-05-08T18:09:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016492619 2024-05-08T18:09:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.369126+0000", 2024-05-08T18:09:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013372429999999999 2024-05-08T18:09:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.369301+0000", 2024-05-08T18:09:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000175818 2024-05-08T18:09:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.369413+0000", 2024-05-08T18:09:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011206500000000001 2024-05-08T18:09:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1984 3.21 e92/20 3:8684244f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.33:head v 92'6, mlcod=87'4)", 2024-05-08T18:09:52.143 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.630079+0000", 2024-05-08T18:09:52.143 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 24.443820410000001, 2024-05-08T18:09:52.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023425675999999999, 2024-05-08T18:09:52.143 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.143 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.143 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.143 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.630079+0000", 2024-05-08T18:09:52.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.630079+0000", 2024-05-08T18:09:52.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.630080+0000", 2024-05-08T18:09:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:09:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.638640+0000", 2024-05-08T18:09:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0085603220000000004 2024-05-08T18:09:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.638677+0000", 2024-05-08T18:09:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6813000000000001e-05 2024-05-08T18:09:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.638694+0000", 2024-05-08T18:09:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7122999999999999e-05 2024-05-08T18:09:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.638830+0000", 2024-05-08T18:09:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013660500000000001 2024-05-08T18:09:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.638870+0000", 2024-05-08T18:09:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:09:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.653419+0000", 2024-05-08T18:09:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014548574 2024-05-08T18:09:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.653505+0000", 2024-05-08T18:09:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6026000000000006e-05 2024-05-08T18:09:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2160 3.28 3:1689cc56:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.hQWuBL0eD3qM1_SYCGjPFSw-atfdLo5_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:31.158121+0000", 2024-05-08T18:09:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 20.915778831000001, 2024-05-08T18:09:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030749740000000001, 2024-05-08T18:09:52.150 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.150 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.150 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.150 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.150 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.150 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.150 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2160 2024-05-08T18:09:52.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.150 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.158121+0000", 2024-05-08T18:09:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.158121+0000", 2024-05-08T18:09:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.158124+0000", 2024-05-08T18:09:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0879999999999999e-06 2024-05-08T18:09:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.165646+0000", 2024-05-08T18:09:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0075225400000000003 2024-05-08T18:09:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.165692+0000", 2024-05-08T18:09:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5875999999999999e-05 2024-05-08T18:09:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.165712+0000", 2024-05-08T18:09:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0055999999999999e-05 2024-05-08T18:09:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.165837+0000", 2024-05-08T18:09:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012536599999999999 2024-05-08T18:09:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.166047+0000", 2024-05-08T18:09:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020952699999999999 2024-05-08T18:09:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.166323+0000", 2024-05-08T18:09:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027598400000000001 2024-05-08T18:09:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.180354+0000", 2024-05-08T18:09:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014030521000000001 2024-05-08T18:09:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.188560+0000", 2024-05-08T18:09:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082061719999999994 2024-05-08T18:09:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.188746+0000", 2024-05-08T18:09:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018628199999999999 2024-05-08T18:09:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.188870+0000", 2024-05-08T18:09:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012432799999999999 2024-05-08T18:09:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2163 3.1c 3:3b23b6ce:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.61:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:31.193089+0000", 2024-05-08T18:09:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 20.880810018999998, 2024-05-08T18:09:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027377319000000001, 2024-05-08T18:09:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2163 2024-05-08T18:09:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.193089+0000", 2024-05-08T18:09:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.193089+0000", 2024-05-08T18:09:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.193092+0000", 2024-05-08T18:09:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4169999999999999e-06 2024-05-08T18:09:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.197519+0000", 2024-05-08T18:09:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044272699999999996 2024-05-08T18:09:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.197562+0000", 2024-05-08T18:09:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3325000000000003e-05 2024-05-08T18:09:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.197582+0000", 2024-05-08T18:09:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0004e-05 2024-05-08T18:09:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.197747+0000", 2024-05-08T18:09:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016416400000000001 2024-05-08T18:09:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.198181+0000", 2024-05-08T18:09:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043468000000000001 2024-05-08T18:09:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.199374+0000", 2024-05-08T18:09:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001192757 2024-05-08T18:09:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.220254+0000", 2024-05-08T18:09:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020880237999999999 2024-05-08T18:09:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.220278+0000", 2024-05-08T18:09:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4256e-05 2024-05-08T18:09:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.220388+0000", 2024-05-08T18:09:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109689 2024-05-08T18:09:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.220467+0000", 2024-05-08T18:09:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8518999999999998e-05 2024-05-08T18:09:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2178 3.22 3:4570f4c4:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.okjXzGBEswOQmQLG81wOAp-UZhtHvH7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:31.717355+0000", 2024-05-08T18:09:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 20.356544198999998, 2024-05-08T18:09:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025401189000000001, 2024-05-08T18:09:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2178 2024-05-08T18:09:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.717355+0000", 2024-05-08T18:09:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.717355+0000", 2024-05-08T18:09:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.717358+0000", 2024-05-08T18:09:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.847e-06 2024-05-08T18:09:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.722665+0000", 2024-05-08T18:09:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0053066559999999999 2024-05-08T18:09:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.722706+0000", 2024-05-08T18:09:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0915999999999999e-05 2024-05-08T18:09:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.722726+0000", 2024-05-08T18:09:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0183e-05 2024-05-08T18:09:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.722889+0000", 2024-05-08T18:09:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162862 2024-05-08T18:09:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.723159+0000", 2024-05-08T18:09:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026990400000000001 2024-05-08T18:09:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.723425+0000", 2024-05-08T18:09:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026660699999999998 2024-05-08T18:09:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.740251+0000", 2024-05-08T18:09:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016826297 2024-05-08T18:09:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.742477+0000", 2024-05-08T18:09:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022250899999999999 2024-05-08T18:09:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.742625+0000", 2024-05-08T18:09:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014841100000000001 2024-05-08T18:09:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.742756+0000", 2024-05-08T18:09:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000131416 2024-05-08T18:09:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2187 3.16 3:6b0c975a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.65:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:31.883660+0000", 2024-05-08T18:09:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 20.190239059, 2024-05-08T18:09:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023950777999999999, 2024-05-08T18:09:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2187 2024-05-08T18:09:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.883660+0000", 2024-05-08T18:09:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.883660+0000", 2024-05-08T18:09:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.883663+0000", 2024-05-08T18:09:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7970000000000001e-06 2024-05-08T18:09:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.888975+0000", 2024-05-08T18:09:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0053114570000000003 2024-05-08T18:09:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.889017+0000", 2024-05-08T18:09:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2026e-05 2024-05-08T18:09:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.889037+0000", 2024-05-08T18:09:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0803000000000001e-05 2024-05-08T18:09:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.889180+0000", 2024-05-08T18:09:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000142705 2024-05-08T18:09:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.889501+0000", 2024-05-08T18:09:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00032071299999999998 2024-05-08T18:09:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.890441+0000", 2024-05-08T18:09:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00094049400000000005 2024-05-08T18:09:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.907003+0000", 2024-05-08T18:09:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016561672999999999 2024-05-08T18:09:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.907403+0000", 2024-05-08T18:09:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039966600000000002 2024-05-08T18:09:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.907530+0000", 2024-05-08T18:09:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012780499999999999 2024-05-08T18:09:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.907611+0000", 2024-05-08T18:09:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0638999999999998e-05 2024-05-08T18:09:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2202 3.16 3:6b8f2b07:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.iRfSb7b_Mb9pWyJBdZSShCS0gvDvtAQ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:32.301205+0000", 2024-05-08T18:09:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.772694661999999, 2024-05-08T18:09:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025923887, 2024-05-08T18:09:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2202 2024-05-08T18:09:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.301205+0000", 2024-05-08T18:09:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.301205+0000", 2024-05-08T18:09:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.301208+0000", 2024-05-08T18:09:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1669999999999999e-06 2024-05-08T18:09:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.305234+0000", 2024-05-08T18:09:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040259149999999997 2024-05-08T18:09:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.305271+0000", 2024-05-08T18:09:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6730000000000002e-05 2024-05-08T18:09:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.305288+0000", 2024-05-08T18:09:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7317e-05 2024-05-08T18:09:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.305458+0000", 2024-05-08T18:09:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016982100000000001 2024-05-08T18:09:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.305849+0000", 2024-05-08T18:09:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039137699999999999 2024-05-08T18:09:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.306259+0000", 2024-05-08T18:09:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040993300000000002 2024-05-08T18:09:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.326116+0000", 2024-05-08T18:09:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019857419000000001 2024-05-08T18:09:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.326957+0000", 2024-05-08T18:09:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00084070599999999998 2024-05-08T18:09:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.327054+0000", 2024-05-08T18:09:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7221999999999999e-05 2024-05-08T18:09:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.327129+0000", 2024-05-08T18:09:52.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.428e-05 2024-05-08T18:09:52.182 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.182 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.182 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.182 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2371 3.2f 3:f4750fba:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.94:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:52.182 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:35.623593+0000", 2024-05-08T18:09:52.182 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 16.450306352999998, 2024-05-08T18:09:52.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022729437000000002, 2024-05-08T18:09:52.183 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.183 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.183 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.183 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.183 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.183 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.183 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2371 2024-05-08T18:09:52.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.183 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.623593+0000", 2024-05-08T18:09:52.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.623593+0000", 2024-05-08T18:09:52.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.623596+0000", 2024-05-08T18:09:52.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.773e-06 2024-05-08T18:09:52.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.627589+0000", 2024-05-08T18:09:52.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039935359999999998 2024-05-08T18:09:52.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.627633+0000", 2024-05-08T18:09:52.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3192999999999998e-05 2024-05-08T18:09:52.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.627652+0000", 2024-05-08T18:09:52.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.978e-05 2024-05-08T18:09:52.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.627814+0000", 2024-05-08T18:09:52.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016141500000000001 2024-05-08T18:09:52.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.628094+0000", 2024-05-08T18:09:52.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028001099999999999 2024-05-08T18:09:52.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:52.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.629008+0000", 2024-05-08T18:09:52.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00091430199999999997 2024-05-08T18:09:52.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.645456+0000", 2024-05-08T18:09:52.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016448325999999999 2024-05-08T18:09:52.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.646132+0000", 2024-05-08T18:09:52.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00067598199999999999 2024-05-08T18:09:52.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.646240+0000", 2024-05-08T18:09:52.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108021 2024-05-08T18:09:52.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.646322+0000", 2024-05-08T18:09:52.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2097999999999999e-05 2024-05-08T18:09:52.188 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.188 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.188 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.189 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2374 3.16 3:695c3abd:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.bZOT8fXVYEqYoX4kzIRAcQpKCGz8ihc_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:52.189 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:35.718099+0000", 2024-05-08T18:09:52.189 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 16.355800161000001, 2024-05-08T18:09:52.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027203367999999999, 2024-05-08T18:09:52.189 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.189 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.189 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.189 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.189 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.189 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.190 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2374 2024-05-08T18:09:52.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.190 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.718099+0000", 2024-05-08T18:09:52.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.718099+0000", 2024-05-08T18:09:52.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.718102+0000", 2024-05-08T18:09:52.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.05e-06 2024-05-08T18:09:52.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.723027+0000", 2024-05-08T18:09:52.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0049243209999999997 2024-05-08T18:09:52.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.723071+0000", 2024-05-08T18:09:52.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3992999999999997e-05 2024-05-08T18:09:52.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.723090+0000", 2024-05-08T18:09:52.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9616e-05 2024-05-08T18:09:52.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.723290+0000", 2024-05-08T18:09:52.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000199419 2024-05-08T18:09:52.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.723522+0000", 2024-05-08T18:09:52.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023240399999999999 2024-05-08T18:09:52.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:52.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.723746+0000", 2024-05-08T18:09:52.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000223978 2024-05-08T18:09:52.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.744294+0000", 2024-05-08T18:09:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020547526 2024-05-08T18:09:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.745150+0000", 2024-05-08T18:09:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085619299999999999 2024-05-08T18:09:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.745235+0000", 2024-05-08T18:09:52.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5752000000000002e-05 2024-05-08T18:09:52.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.745303+0000", 2024-05-08T18:09:52.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7115999999999999e-05 2024-05-08T18:09:52.195 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.195 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.195 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.195 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2377 3.16 3:6957b894:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.95:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:52.195 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:35.748997+0000", 2024-05-08T18:09:52.195 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 16.324902010999999, 2024-05-08T18:09:52.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023715984999999998, 2024-05-08T18:09:52.196 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.196 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.196 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.196 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.196 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.196 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.196 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2377 2024-05-08T18:09:52.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.196 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.748997+0000", 2024-05-08T18:09:52.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.748997+0000", 2024-05-08T18:09:52.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.749000+0000", 2024-05-08T18:09:52.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8100000000000002e-06 2024-05-08T18:09:52.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.753040+0000", 2024-05-08T18:09:52.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040399750000000003 2024-05-08T18:09:52.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.753075+0000", 2024-05-08T18:09:52.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5269999999999999e-05 2024-05-08T18:09:52.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.753093+0000", 2024-05-08T18:09:52.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7343e-05 2024-05-08T18:09:52.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.753254+0000", 2024-05-08T18:09:52.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016120500000000001 2024-05-08T18:09:52.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.753675+0000", 2024-05-08T18:09:52.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00042143999999999998 2024-05-08T18:09:52.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:52.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.754890+0000", 2024-05-08T18:09:52.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012145859999999999 2024-05-08T18:09:52.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.772322+0000", 2024-05-08T18:09:52.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01743167 2024-05-08T18:09:52.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.772475+0000", 2024-05-08T18:09:52.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015306200000000001 2024-05-08T18:09:52.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.772633+0000", 2024-05-08T18:09:52.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000158455 2024-05-08T18:09:52.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.772713+0000", 2024-05-08T18:09:52.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0168999999999998e-05 2024-05-08T18:09:52.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.201 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.201 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.201 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:52.203 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:09:52.329 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:52.329 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:52.329 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:52.329 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:52.343 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:09:52.466 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:52.466 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:52.466 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:52.466 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:52.466 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:52.480 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:09:52.603 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:52.603 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:52.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:52.603 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:52.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.603 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-08T18:09:52.603 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:52.603 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 149.065784076, 2024-05-08T18:09:52.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.032012946, 2024-05-08T18:09:52.604 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.604 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.604 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.604 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.604 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.604 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.604 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 46 2024-05-08T18:09:52.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.604 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:52.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535481+0000", 2024-05-08T18:09:52.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535484+0000", 2024-05-08T18:09:52.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7929999999999999e-06 2024-05-08T18:09:52.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535500+0000", 2024-05-08T18:09:52.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5226e-05 2024-05-08T18:09:52.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535535+0000", 2024-05-08T18:09:52.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5213000000000003e-05 2024-05-08T18:09:52.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535564+0000", 2024-05-08T18:09:52.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9360999999999999e-05 2024-05-08T18:09:52.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535757+0000", 2024-05-08T18:09:52.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000193229 2024-05-08T18:09:52.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:52.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.535775+0000", 2024-05-08T18:09:52.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7098000000000001e-05 2024-05-08T18:09:52.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556004+0000", 2024-05-08T18:09:52.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020229068999999999 2024-05-08T18:09:52.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:52.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.556036+0000", 2024-05-08T18:09:52.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1943000000000002e-05 2024-05-08T18:09:52.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.564721+0000", 2024-05-08T18:09:52.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0086853320000000005 2024-05-08T18:09:52.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565032+0000", 2024-05-08T18:09:52.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00031121799999999999 2024-05-08T18:09:52.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:52.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.565365+0000", 2024-05-08T18:09:52.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000332744 2024-05-08T18:09:52.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567305+0000", 2024-05-08T18:09:52.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00194016 2024-05-08T18:09:52.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567368+0000", 2024-05-08T18:09:52.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3342000000000004e-05 2024-05-08T18:09:52.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567433+0000", 2024-05-08T18:09:52.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4726000000000003e-05 2024-05-08T18:09:52.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:23.567494+0000", 2024-05-08T18:09:52.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0492000000000003e-05 2024-05-08T18:09:52.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.610 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.610 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1189 3.20 3:054e8a9f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:52.611 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:52.611 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.641094670000001, 2024-05-08T18:09:52.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025093629999999999, 2024-05-08T18:09:52.611 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.611 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.611 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.611 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.611 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.611 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.611 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1189 2024-05-08T18:09:52.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.611 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:52.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960170+0000", 2024-05-08T18:09:52.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.960173+0000", 2024-05-08T18:09:52.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.65e-06 2024-05-08T18:09:52.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965720+0000", 2024-05-08T18:09:52.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055476340000000001 2024-05-08T18:09:52.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965757+0000", 2024-05-08T18:09:52.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6223000000000002e-05 2024-05-08T18:09:52.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965774+0000", 2024-05-08T18:09:52.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6952999999999998e-05 2024-05-08T18:09:52.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.965930+0000", 2024-05-08T18:09:52.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015611800000000001 2024-05-08T18:09:52.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966190+0000", 2024-05-08T18:09:52.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025999399999999999 2024-05-08T18:09:52.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:52.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.966440+0000", 2024-05-08T18:09:52.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025007600000000001 2024-05-08T18:09:52.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.981042+0000", 2024-05-08T18:09:52.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01460257 2024-05-08T18:09:52.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.984969+0000", 2024-05-08T18:09:52.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039265159999999997 2024-05-08T18:09:52.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985135+0000", 2024-05-08T18:09:52.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016630400000000001 2024-05-08T18:09:52.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:06.985264+0000", 2024-05-08T18:09:52.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012859199999999999 2024-05-08T18:09:52.616 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.616 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.616 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.616 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1209 3.35 3:af4c6abe:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:52.616 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:52.616 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.425833023000003, 2024-05-08T18:09:52.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027313356, 2024-05-08T18:09:52.616 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.617 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.617 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.617 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.617 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.617 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.617 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1209 2024-05-08T18:09:52.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.617 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:52.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175432+0000", 2024-05-08T18:09:52.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.175436+0000", 2024-05-08T18:09:52.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3800000000000004e-06 2024-05-08T18:09:52.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179472+0000", 2024-05-08T18:09:52.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040357020000000004 2024-05-08T18:09:52.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179515+0000", 2024-05-08T18:09:52.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2988999999999998e-05 2024-05-08T18:09:52.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179534+0000", 2024-05-08T18:09:52.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8743e-05 2024-05-08T18:09:52.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179673+0000", 2024-05-08T18:09:52.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013983800000000001 2024-05-08T18:09:52.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.179933+0000", 2024-05-08T18:09:52.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025967999999999998 2024-05-08T18:09:52.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:52.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180161+0000", 2024-05-08T18:09:52.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022826300000000001 2024-05-08T18:09:52.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.200613+0000", 2024-05-08T18:09:52.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020451766999999999 2024-05-08T18:09:52.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202567+0000", 2024-05-08T18:09:52.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0019541160000000001 2024-05-08T18:09:52.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202665+0000", 2024-05-08T18:09:52.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8055999999999998e-05 2024-05-08T18:09:52.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.202745+0000", 2024-05-08T18:09:52.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9821999999999996e-05 2024-05-08T18:09:52.622 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.622 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.622 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.622 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1221 3.20 3:071d1257:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:52.622 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:52.622 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.006518147999998, 2024-05-08T18:09:52.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02822473, 2024-05-08T18:09:52.622 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.622 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.622 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.622 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.622 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.623 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.623 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1221 2024-05-08T18:09:52.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.623 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:52.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594747+0000", 2024-05-08T18:09:52.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.594751+0000", 2024-05-08T18:09:52.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3769999999999998e-06 2024-05-08T18:09:52.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600627+0000", 2024-05-08T18:09:52.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0058764389999999998 2024-05-08T18:09:52.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600672+0000", 2024-05-08T18:09:52.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4805999999999998e-05 2024-05-08T18:09:52.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600704+0000", 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2026000000000001e-05 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.600884+0000", 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000179385 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601296+0000", 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041257400000000002 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.601742+0000", 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044585399999999998 2024-05-08T18:09:52.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.617360+0000", 2024-05-08T18:09:52.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015617982000000001 2024-05-08T18:09:52.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622618+0000", 2024-05-08T18:09:52.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052577420000000001 2024-05-08T18:09:52.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622835+0000", 2024-05-08T18:09:52.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021674699999999999 2024-05-08T18:09:52.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.622971+0000", 2024-05-08T18:09:52.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679799999999999 2024-05-08T18:09:52.627 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.627 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.627 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.627 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1275 3.33 e85/20 3:ccdf9558:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_3:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:52.627 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:52.627 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.547675112, 2024-05-08T18:09:52.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020251129, 2024-05-08T18:09:52.627 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.627 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.628 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.628 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:52.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053590+0000", 2024-05-08T18:09:52.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.053592+0000", 2024-05-08T18:09:52.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5189999999999999e-06 2024-05-08T18:09:52.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059662+0000", 2024-05-08T18:09:52.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060699289999999999 2024-05-08T18:09:52.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059680+0000", 2024-05-08T18:09:52.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7558999999999999e-05 2024-05-08T18:09:52.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059689+0000", 2024-05-08T18:09:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2320000000000007e-06 2024-05-08T18:09:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059826+0000", 2024-05-08T18:09:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136792 2024-05-08T18:09:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.059867+0000", 2024-05-08T18:09:52.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1689e-05 2024-05-08T18:09:52.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073728+0000", 2024-05-08T18:09:52.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01386104 2024-05-08T18:09:52.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.073841+0000", 2024-05-08T18:09:52.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011236899999999999 2024-05-08T18:09:52.631 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.631 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.632 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.632 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1286 3.20 3:07ccb256:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:52.632 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:52.632 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.396980497999998, 2024-05-08T18:09:52.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022546805999999999, 2024-05-08T18:09:52.632 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.632 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.632 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.632 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.632 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.632 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.633 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1286 2024-05-08T18:09:52.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.633 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:52.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204284+0000", 2024-05-08T18:09:52.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.204287+0000", 2024-05-08T18:09:52.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8880000000000001e-06 2024-05-08T18:09:52.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208135+0000", 2024-05-08T18:09:52.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038480960000000001 2024-05-08T18:09:52.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208158+0000", 2024-05-08T18:09:52.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2529999999999999e-05 2024-05-08T18:09:52.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208172+0000", 2024-05-08T18:09:52.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4246999999999999e-05 2024-05-08T18:09:52.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208251+0000", 2024-05-08T18:09:52.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8863999999999996e-05 2024-05-08T18:09:52.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208387+0000", 2024-05-08T18:09:52.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013615099999999999 2024-05-08T18:09:52.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:52.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.208488+0000", 2024-05-08T18:09:52.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101366 2024-05-08T18:09:52.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.214533+0000", 2024-05-08T18:09:52.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0060444829999999998 2024-05-08T18:09:52.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226742+0000", 2024-05-08T18:09:52.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012208798 2024-05-08T18:09:52.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226792+0000", 2024-05-08T18:09:52.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0565999999999997e-05 2024-05-08T18:09:52.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.226831+0000", 2024-05-08T18:09:52.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8816999999999998e-05 2024-05-08T18:09:52.637 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.637 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.637 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.637 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1397 3.34 e87/20 3:2c6418f0:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_3:head v 87'2, mlcod=0'0)", 2024-05-08T18:09:52.637 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:52.637 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.798548509, 2024-05-08T18:09:52.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019946450000000001, 2024-05-08T18:09:52.638 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.638 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.638 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.638 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:52.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802716+0000", 2024-05-08T18:09:52.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.802717+0000", 2024-05-08T18:09:52.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0400000000000005e-07 2024-05-08T18:09:52.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807936+0000", 2024-05-08T18:09:52.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052192489999999996 2024-05-08T18:09:52.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807971+0000", 2024-05-08T18:09:52.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4517000000000002e-05 2024-05-08T18:09:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.807993+0000", 2024-05-08T18:09:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2463000000000002e-05 2024-05-08T18:09:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.808151+0000", 2024-05-08T18:09:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015751400000000001 2024-05-08T18:09:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.808197+0000", 2024-05-08T18:09:52.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6637000000000001e-05 2024-05-08T18:09:52.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822537+0000", 2024-05-08T18:09:52.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014339607000000001 2024-05-08T18:09:52.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.822663+0000", 2024-05-08T18:09:52.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125659 2024-05-08T18:09:52.641 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.641 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.641 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.642 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1399 3.2c 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:52.642 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:52.642 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.781836978000001, 2024-05-08T18:09:52.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.030683200000000001, 2024-05-08T18:09:52.642 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.642 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.642 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.642 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.642 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.642 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.642 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1399 2024-05-08T18:09:52.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.642 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:52.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819428+0000", 2024-05-08T18:09:52.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.819432+0000", 2024-05-08T18:09:52.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7759999999999999e-06 2024-05-08T18:09:52.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825021+0000", 2024-05-08T18:09:52.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055895859999999997 2024-05-08T18:09:52.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825052+0000", 2024-05-08T18:09:52.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1047000000000003e-05 2024-05-08T18:09:52.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825068+0000", 2024-05-08T18:09:52.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6138999999999999e-05 2024-05-08T18:09:52.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825218+0000", 2024-05-08T18:09:52.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014997200000000001 2024-05-08T18:09:52.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825490+0000", 2024-05-08T18:09:52.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000271446 2024-05-08T18:09:52.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:52.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.825710+0000", 2024-05-08T18:09:52.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000220354 2024-05-08T18:09:52.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.839642+0000", 2024-05-08T18:09:52.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013932363 2024-05-08T18:09:52.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849813+0000", 2024-05-08T18:09:52.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010170461 2024-05-08T18:09:52.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.849981+0000", 2024-05-08T18:09:52.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016776399999999999 2024-05-08T18:09:52.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.850111+0000", 2024-05-08T18:09:52.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013029200000000001 2024-05-08T18:09:52.647 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.647 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.647 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.647 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1406 3.20 3:05e3d3c1:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:52.647 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:52.647 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.712265866999999, 2024-05-08T18:09:52.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022642778999999998, 2024-05-08T18:09:52.647 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.647 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.647 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.647 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.648 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.648 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.648 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1406 2024-05-08T18:09:52.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.648 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:52.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.888999+0000", 2024-05-08T18:09:52.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.889003+0000", 2024-05-08T18:09:52.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8670000000000004e-06 2024-05-08T18:09:52.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893237+0000", 2024-05-08T18:09:52.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042339999999999999 2024-05-08T18:09:52.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893279+0000", 2024-05-08T18:09:52.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2225999999999999e-05 2024-05-08T18:09:52.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893305+0000", 2024-05-08T18:09:52.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.618e-05 2024-05-08T18:09:52.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893479+0000", 2024-05-08T18:09:52.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017357700000000001 2024-05-08T18:09:52.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893736+0000", 2024-05-08T18:09:52.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025701700000000001 2024-05-08T18:09:52.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:52.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.893993+0000", 2024-05-08T18:09:52.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025750700000000003 2024-05-08T18:09:52.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.904227+0000", 2024-05-08T18:09:52.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010234073 2024-05-08T18:09:52.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911471+0000", 2024-05-08T18:09:52.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0072441909999999997 2024-05-08T18:09:52.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911567+0000", 2024-05-08T18:09:52.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5685000000000003e-05 2024-05-08T18:09:52.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.911642+0000", 2024-05-08T18:09:52.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4456000000000007e-05 2024-05-08T18:09:52.652 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.652 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1416 3.2c 3:345ebd70:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.604894662, 2024-05-08T18:09:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.027523229999999999, 2024-05-08T18:09:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1416 2024-05-08T18:09:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.653 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:52.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996370+0000", 2024-05-08T18:09:52.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.996374+0000", 2024-05-08T18:09:52.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.506e-06 2024-05-08T18:09:52.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000305+0000", 2024-05-08T18:09:52.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003931197 2024-05-08T18:09:52.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000346+0000", 2024-05-08T18:09:52.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1396000000000001e-05 2024-05-08T18:09:52.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000364+0000", 2024-05-08T18:09:52.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.806e-05 2024-05-08T18:09:52.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000490+0000", 2024-05-08T18:09:52.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012581800000000001 2024-05-08T18:09:52.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000755+0000", 2024-05-08T18:09:52.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026484700000000002 2024-05-08T18:09:52.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:52.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.000992+0000", 2024-05-08T18:09:52.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023701700000000001 2024-05-08T18:09:52.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.010465+0000", 2024-05-08T18:09:52.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094726429999999993 2024-05-08T18:09:52.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023679+0000", 2024-05-08T18:09:52.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013214105 2024-05-08T18:09:52.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023776+0000", 2024-05-08T18:09:52.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7258999999999998e-05 2024-05-08T18:09:52.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.023893+0000", 2024-05-08T18:09:52.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000117382 2024-05-08T18:09:52.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.658 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.659 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1451 3.36 3:6da4b5f8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:52.659 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:52.659 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.304222029000002, 2024-05-08T18:09:52.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022119236, 2024-05-08T18:09:52.659 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.659 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.659 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.659 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.659 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.659 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.659 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1451 2024-05-08T18:09:52.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.659 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:52.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297043+0000", 2024-05-08T18:09:52.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.297046+0000", 2024-05-08T18:09:52.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6030000000000001e-06 2024-05-08T18:09:52.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301125+0000", 2024-05-08T18:09:52.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004079058 2024-05-08T18:09:52.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301163+0000", 2024-05-08T18:09:52.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7286000000000002e-05 2024-05-08T18:09:52.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301181+0000", 2024-05-08T18:09:52.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.844e-05 2024-05-08T18:09:52.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301325+0000", 2024-05-08T18:09:52.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144284 2024-05-08T18:09:52.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301602+0000", 2024-05-08T18:09:52.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027665399999999998 2024-05-08T18:09:52.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:52.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.301835+0000", 2024-05-08T18:09:52.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023292699999999999 2024-05-08T18:09:52.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.318166+0000", 2024-05-08T18:09:52.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016331061000000001 2024-05-08T18:09:52.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.318991+0000", 2024-05-08T18:09:52.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000825427 2024-05-08T18:09:52.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.319082+0000", 2024-05-08T18:09:52.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0743999999999997e-05 2024-05-08T18:09:52.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.319162+0000", 2024-05-08T18:09:52.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9752000000000005e-05 2024-05-08T18:09:52.664 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.664 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.664 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.664 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1471 3.26 3:6495ae89:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.-6HSSZsDRIgcEaNF846LtlJ3TkyCP8j_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.904617807999998, 2024-05-08T18:09:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022361453, 2024-05-08T18:09:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1471 2024-05-08T18:09:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:52.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696647+0000", 2024-05-08T18:09:52.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.696650+0000", 2024-05-08T18:09:52.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8839999999999998e-06 2024-05-08T18:09:52.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700528+0000", 2024-05-08T18:09:52.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038783390000000002 2024-05-08T18:09:52.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700554+0000", 2024-05-08T18:09:52.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6106e-05 2024-05-08T18:09:52.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700566+0000", 2024-05-08T18:09:52.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2021000000000001e-05 2024-05-08T18:09:52.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700682+0000", 2024-05-08T18:09:52.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000115457 2024-05-08T18:09:52.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.700951+0000", 2024-05-08T18:09:52.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026891699999999997 2024-05-08T18:09:52.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:52.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.701210+0000", 2024-05-08T18:09:52.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000259017 2024-05-08T18:09:52.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718848+0000", 2024-05-08T18:09:52.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017638132000000001 2024-05-08T18:09:52.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718917+0000", 2024-05-08T18:09:52.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9564e-05 2024-05-08T18:09:52.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.718968+0000", 2024-05-08T18:09:52.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1028e-05 2024-05-08T18:09:52.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:13.719008+0000", 2024-05-08T18:09:52.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9987999999999997e-05 2024-05-08T18:09:52.670 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.670 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.670 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.670 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1669 3.2c 3:36349ad3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_5:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-05-08T18:09:52.670 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:52.670 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.801352704999999, 2024-05-08T18:09:52.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020235185999999999, 2024-05-08T18:09:52.670 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.670 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.671 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-05-08T18:09:52.671 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.671 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.671 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.671 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1669 2024-05-08T18:09:52.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.671 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:52.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799912+0000", 2024-05-08T18:09:52.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799916+0000", 2024-05-08T18:09:52.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7730000000000001e-06 2024-05-08T18:09:52.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799931+0000", 2024-05-08T18:09:52.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5227e-05 2024-05-08T18:09:52.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799969+0000", 2024-05-08T18:09:52.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7883000000000003e-05 2024-05-08T18:09:52.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.799986+0000", 2024-05-08T18:09:52.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6728999999999999e-05 2024-05-08T18:09:52.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.800123+0000", 2024-05-08T18:09:52.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013784600000000001 2024-05-08T18:09:52.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:52.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.800135+0000", 2024-05-08T18:09:52.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1336e-05 2024-05-08T18:09:52.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.805653+0000", 2024-05-08T18:09:52.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055179890000000001 2024-05-08T18:09:52.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.805876+0000", 2024-05-08T18:09:52.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022279 2024-05-08T18:09:52.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:17.820147+0000", 2024-05-08T18:09:52.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014271613000000001 2024-05-08T18:09:52.675 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.675 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.675 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.675 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1910 3.a 3:537830e8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.21:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:52.675 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:25.987700+0000", 2024-05-08T18:09:52.675 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.613564882999999, 2024-05-08T18:09:52.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020512796999999999, 2024-05-08T18:09:52.675 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.676 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.676 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.676 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.676 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.676 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.676 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1910 2024-05-08T18:09:52.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.676 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.676 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.676 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.987700+0000", 2024-05-08T18:09:52.676 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.987700+0000", 2024-05-08T18:09:52.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.987703+0000", 2024-05-08T18:09:52.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1130000000000001e-06 2024-05-08T18:09:52.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991635+0000", 2024-05-08T18:09:52.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039315579999999999 2024-05-08T18:09:52.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991673+0000", 2024-05-08T18:09:52.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8550000000000002e-05 2024-05-08T18:09:52.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991691+0000", 2024-05-08T18:09:52.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.768e-05 2024-05-08T18:09:52.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.991796+0000", 2024-05-08T18:09:52.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105474 2024-05-08T18:09:52.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.992021+0000", 2024-05-08T18:09:52.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022432999999999999 2024-05-08T18:09:52.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:52.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:25.992664+0000", 2024-05-08T18:09:52.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064343099999999997 2024-05-08T18:09:52.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.004478+0000", 2024-05-08T18:09:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011814069 2024-05-08T18:09:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.008061+0000", 2024-05-08T18:09:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035826289999999999 2024-05-08T18:09:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.008129+0000", 2024-05-08T18:09:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8734999999999998e-05 2024-05-08T18:09:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.008213+0000", 2024-05-08T18:09:52.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3227999999999997e-05 2024-05-08T18:09:52.681 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.681 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.681 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.681 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1937 3.35 3:afad9b8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.kKJI4mkViIqglOaR5LKVFjY-f90axEe_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:52.681 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:26.656524+0000", 2024-05-08T18:09:52.681 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.944740508999999, 2024-05-08T18:09:52.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025036721000000001, 2024-05-08T18:09:52.681 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.681 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.681 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.681 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.682 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.682 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.682 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1937 2024-05-08T18:09:52.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.682 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.656524+0000", 2024-05-08T18:09:52.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.656524+0000", 2024-05-08T18:09:52.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.656528+0000", 2024-05-08T18:09:52.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7469999999999999e-06 2024-05-08T18:09:52.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.661958+0000", 2024-05-08T18:09:52.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054303229999999999 2024-05-08T18:09:52.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.662000+0000", 2024-05-08T18:09:52.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1412999999999998e-05 2024-05-08T18:09:52.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.662018+0000", 2024-05-08T18:09:52.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8162999999999999e-05 2024-05-08T18:09:52.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.662193+0000", 2024-05-08T18:09:52.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000175518 2024-05-08T18:09:52.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.662674+0000", 2024-05-08T18:09:52.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048055800000000002 2024-05-08T18:09:52.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:52.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.663088+0000", 2024-05-08T18:09:52.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041393799999999998 2024-05-08T18:09:52.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.680805+0000", 2024-05-08T18:09:52.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017716942999999999 2024-05-08T18:09:52.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.681387+0000", 2024-05-08T18:09:52.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00058174300000000002 2024-05-08T18:09:52.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.681483+0000", 2024-05-08T18:09:52.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6168999999999994e-05 2024-05-08T18:09:52.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.681561+0000", 2024-05-08T18:09:52.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8206000000000003e-05 2024-05-08T18:09:52.687 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.687 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.687 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.687 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1951 3.26 3:66b697c3:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.seZFA2ZEY-Crt1uNfyqRLzirbZGBgqA_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:52.687 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:26.935268+0000", 2024-05-08T18:09:52.687 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.665996608, 2024-05-08T18:09:52.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021970598000000001, 2024-05-08T18:09:52.687 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.687 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.688 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.688 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.688 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.688 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.688 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1951 2024-05-08T18:09:52.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.688 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.935268+0000", 2024-05-08T18:09:52.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.935268+0000", 2024-05-08T18:09:52.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.935271+0000", 2024-05-08T18:09:52.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.943e-06 2024-05-08T18:09:52.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939177+0000", 2024-05-08T18:09:52.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039056239999999999 2024-05-08T18:09:52.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939217+0000", 2024-05-08T18:09:52.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0639000000000002e-05 2024-05-08T18:09:52.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939236+0000", 2024-05-08T18:09:52.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8580000000000002e-05 2024-05-08T18:09:52.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939315+0000", 2024-05-08T18:09:52.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9297999999999999e-05 2024-05-08T18:09:52.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939427+0000", 2024-05-08T18:09:52.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000111999 2024-05-08T18:09:52.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 7", 2024-05-08T18:09:52.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.939520+0000", 2024-05-08T18:09:52.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2717e-05 2024-05-08T18:09:52.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.956451+0000", 2024-05-08T18:09:52.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016931531999999999 2024-05-08T18:09:52.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.957119+0000", 2024-05-08T18:09:52.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00066793099999999997 2024-05-08T18:09:52.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.957190+0000", 2024-05-08T18:09:52.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0894000000000003e-05 2024-05-08T18:09:52.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.957239+0000", 2024-05-08T18:09:52.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8440999999999999e-05 2024-05-08T18:09:52.693 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.693 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.693 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.693 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1978 3.20 3:06c7576f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.32:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:52.693 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.490306+0000", 2024-05-08T18:09:52.693 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.110958428, 2024-05-08T18:09:52.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022573467999999999, 2024-05-08T18:09:52.693 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.693 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.693 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.693 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.693 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.693 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.694 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1978 2024-05-08T18:09:52.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.694 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.490306+0000", 2024-05-08T18:09:52.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.490306+0000", 2024-05-08T18:09:52.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.490308+0000", 2024-05-08T18:09:52.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1440000000000001e-06 2024-05-08T18:09:52.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.494869+0000", 2024-05-08T18:09:52.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045608669999999997 2024-05-08T18:09:52.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.494904+0000", 2024-05-08T18:09:52.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4313000000000002e-05 2024-05-08T18:09:52.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.494924+0000", 2024-05-08T18:09:52.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0322999999999998e-05 2024-05-08T18:09:52.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.495122+0000", 2024-05-08T18:09:52.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019849700000000001 2024-05-08T18:09:52.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.495386+0000", 2024-05-08T18:09:52.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026385100000000001 2024-05-08T18:09:52.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:52.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.496266+0000", 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000880184 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.505362+0000", 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0090952729999999992 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.512528+0000", 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00716593 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.512736+0000", 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020801399999999999 2024-05-08T18:09:52.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.512880+0000", 2024-05-08T18:09:52.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144072 2024-05-08T18:09:52.698 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.698 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.698 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.698 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1981 3.10 3:0ac06fda:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.G5bm6z3gJ2RUQJmZVjgkH_wtdE6Lk0X_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:52.698 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.593918+0000", 2024-05-08T18:09:52.698 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.007346765000001, 2024-05-08T18:09:52.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.03011194, 2024-05-08T18:09:52.698 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.699 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.699 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.699 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.699 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.699 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.699 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1981 2024-05-08T18:09:52.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.699 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.593918+0000", 2024-05-08T18:09:52.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.593918+0000", 2024-05-08T18:09:52.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.593921+0000", 2024-05-08T18:09:52.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.886e-06 2024-05-08T18:09:52.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601287+0000", 2024-05-08T18:09:52.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073666119999999998 2024-05-08T18:09:52.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601352+0000", 2024-05-08T18:09:52.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4949000000000004e-05 2024-05-08T18:09:52.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601387+0000", 2024-05-08T18:09:52.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4422999999999999e-05 2024-05-08T18:09:52.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601621+0000", 2024-05-08T18:09:52.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000234317 2024-05-08T18:09:52.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601892+0000", 2024-05-08T18:09:52.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027052000000000001 2024-05-08T18:09:52.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:52.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.602131+0000", 2024-05-08T18:09:52.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023928799999999999 2024-05-08T18:09:52.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.613758+0000", 2024-05-08T18:09:52.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011626745000000001 2024-05-08T18:09:52.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.623860+0000", 2024-05-08T18:09:52.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010102709 2024-05-08T18:09:52.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.623958+0000", 2024-05-08T18:09:52.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8076000000000001e-05 2024-05-08T18:09:52.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.624030+0000", 2024-05-08T18:09:52.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1415000000000007e-05 2024-05-08T18:09:52.704 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.704 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.704 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.704 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1982 3.2c 3:37eb8330:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.G5bm6z3gJ2RUQJmZVjgkH_wtdE6Lk0X_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:52.704 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.601454+0000", 2024-05-08T18:09:52.704 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 24.999811126000001, 2024-05-08T18:09:52.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022793639000000001, 2024-05-08T18:09:52.704 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.704 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.704 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.705 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.705 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.705 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.705 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1982 2024-05-08T18:09:52.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.705 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601454+0000", 2024-05-08T18:09:52.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601454+0000", 2024-05-08T18:09:52.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.601456+0000", 2024-05-08T18:09:52.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8669999999999998e-06 2024-05-08T18:09:52.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.604859+0000", 2024-05-08T18:09:52.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034024260000000001 2024-05-08T18:09:52.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.604906+0000", 2024-05-08T18:09:52.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7092999999999998e-05 2024-05-08T18:09:52.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.604923+0000", 2024-05-08T18:09:52.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.662e-05 2024-05-08T18:09:52.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.605130+0000", 2024-05-08T18:09:52.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020757100000000001 2024-05-08T18:09:52.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.605526+0000", 2024-05-08T18:09:52.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00039611600000000001 2024-05-08T18:09:52.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:52.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.605857+0000", 2024-05-08T18:09:52.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033062 2024-05-08T18:09:52.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.621816+0000", 2024-05-08T18:09:52.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015958882000000001 2024-05-08T18:09:52.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.623918+0000", 2024-05-08T18:09:52.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021022340000000001 2024-05-08T18:09:52.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.624122+0000", 2024-05-08T18:09:52.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020434500000000001 2024-05-08T18:09:52.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.624247+0000", 2024-05-08T18:09:52.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486499999999999 2024-05-08T18:09:52.709 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.709 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.710 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.710 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2208 3.10 3:08359eaa:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.JvpG1UkgF07tjBx14bFPyAh6Qi9W8uk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:52.710 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:32.430144+0000", 2024-05-08T18:09:52.710 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 20.171120404, 2024-05-08T18:09:52.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022193701, 2024-05-08T18:09:52.710 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:52.710 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:52.710 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:52.710 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:52.710 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:52.710 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:52.710 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2208 2024-05-08T18:09:52.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.711 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:52.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:52.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.430144+0000", 2024-05-08T18:09:52.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:52.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.430144+0000", 2024-05-08T18:09:52.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:52.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:52.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.430147+0000", 2024-05-08T18:09:52.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.016e-06 2024-05-08T18:09:52.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:52.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.434914+0000", 2024-05-08T18:09:52.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047662060000000003 2024-05-08T18:09:52.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:52.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.434954+0000", 2024-05-08T18:09:52.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0565999999999998e-05 2024-05-08T18:09:52.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:52.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.434973+0000", 2024-05-08T18:09:52.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8519999999999999e-05 2024-05-08T18:09:52.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:52.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.435143+0000", 2024-05-08T18:09:52.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017024799999999999 2024-05-08T18:09:52.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:52.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.435414+0000", 2024-05-08T18:09:52.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000271628 2024-05-08T18:09:52.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:52.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.435656+0000", 2024-05-08T18:09:52.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024159800000000001 2024-05-08T18:09:52.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:52.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.451116+0000", 2024-05-08T18:09:52.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015460135999999999 2024-05-08T18:09:52.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:52.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.452109+0000", 2024-05-08T18:09:52.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00099277799999999993 2024-05-08T18:09:52.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:52.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.452209+0000", 2024-05-08T18:09:52.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010048300000000001 2024-05-08T18:09:52.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:52.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:52.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:52.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.452338+0000", 2024-05-08T18:09:52.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128522 2024-05-08T18:09:52.715 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.715 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.715 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.715 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:52.715 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:52.716 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:52.717 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:09:52.845 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:52.845 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:52.845 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-05-08T18:09:52.845 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:52.859 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:09:52.977 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:52.977 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-05-08T18:09:52.977 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-05-08T18:09:52.977 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-05-08T18:09:52.977 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:52.983 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:09:52.992 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:09:53.118 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-05-08T18:09:53.119 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-05-08T18:09:53.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-05-08T18:09:53.119 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-05-08T18:09:53.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.119 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4203.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-05-08T18:09:53.119 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:53.119 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 170.30256732699999, 2024-05-08T18:09:53.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.16213206199999999, 2024-05-08T18:09:53.119 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.119 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.119 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.119 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.119 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4203", 2024-05-08T18:09:53.119 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3468971994", 2024-05-08T18:09:53.119 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1 2024-05-08T18:09:53.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.120 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:53.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814492+0000", 2024-05-08T18:09:53.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814494+0000", 2024-05-08T18:09:53.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:09:53.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814520+0000", 2024-05-08T18:09:53.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-05 2024-05-08T18:09:53.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814543+0000", 2024-05-08T18:09:53.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2353000000000001e-05 2024-05-08T18:09:53.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814563+0000", 2024-05-08T18:09:53.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.048e-05 2024-05-08T18:09:53.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814677+0000", 2024-05-08T18:09:53.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000113632 2024-05-08T18:09:53.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for peered", 2024-05-08T18:09:53.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.814705+0000", 2024-05-08T18:09:53.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8626999999999999e-05 2024-05-08T18:09:53.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971115+0000", 2024-05-08T18:09:53.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.156409825 2024-05-08T18:09:53.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971438+0000", 2024-05-08T18:09:53.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00032289200000000002 2024-05-08T18:09:53.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:53.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.971849+0000", 2024-05-08T18:09:53.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041139300000000002 2024-05-08T18:09:53.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.975364+0000", 2024-05-08T18:09:53.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035148390000000001 2024-05-08T18:09:53.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976474+0000", 2024-05-08T18:09:53.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001110099 2024-05-08T18:09:53.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976564+0000", 2024-05-08T18:09:53.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9522000000000001e-05 2024-05-08T18:09:53.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:07:02.976624+0000", 2024-05-08T18:09:53.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9616e-05 2024-05-08T18:09:53.125 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.125 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.125 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.125 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1194 3.16 e85/20 3:6b2325a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_6:head v 85'1, mlcod=0'0)", 2024-05-08T18:09:53.125 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:53.125 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 46.096165116999998, 2024-05-08T18:09:53.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024064767000000001, 2024-05-08T18:09:53.126 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.126 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.126 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.126 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:53.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020894+0000", 2024-05-08T18:09:53.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.020897+0000", 2024-05-08T18:09:53.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9699999999999999e-06 2024-05-08T18:09:53.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027491+0000", 2024-05-08T18:09:53.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065945229999999997 2024-05-08T18:09:53.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027543+0000", 2024-05-08T18:09:53.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1319000000000001e-05 2024-05-08T18:09:53.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027573+0000", 2024-05-08T18:09:53.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0380000000000001e-05 2024-05-08T18:09:53.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027737+0000", 2024-05-08T18:09:53.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000163871 2024-05-08T18:09:53.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.027782+0000", 2024-05-08T18:09:53.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5519999999999998e-05 2024-05-08T18:09:53.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044819+0000", 2024-05-08T18:09:53.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017036481999999999 2024-05-08T18:09:53.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.044958+0000", 2024-05-08T18:09:53.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013970200000000001 2024-05-08T18:09:53.129 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.129 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.129 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.130 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1202 3.14 e85/20 3:2a8c8569:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_14:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:53.130 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:53.130 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 46.010215049000003, 2024-05-08T18:09:53.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023371860000000001, 2024-05-08T18:09:53.130 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.130 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.130 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.130 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:53.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106844+0000", 2024-05-08T18:09:53.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.106846+0000", 2024-05-08T18:09:53.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:09:53.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110841+0000", 2024-05-08T18:09:53.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039945479999999997 2024-05-08T18:09:53.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110888+0000", 2024-05-08T18:09:53.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7349999999999999e-05 2024-05-08T18:09:53.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.110913+0000", 2024-05-08T18:09:53.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5055999999999999e-05 2024-05-08T18:09:53.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.111067+0000", 2024-05-08T18:09:53.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015329800000000001 2024-05-08T18:09:53.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.111110+0000", 2024-05-08T18:09:53.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3649000000000002e-05 2024-05-08T18:09:53.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130087+0000", 2024-05-08T18:09:53.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018976186999999999 2024-05-08T18:09:53.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.130216+0000", 2024-05-08T18:09:53.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012911199999999999 2024-05-08T18:09:53.133 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.134 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.134 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.134 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1207 3.15 3:a96d965c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.WO1lvRbeqdJq5PUAjoapP4zn5rw2oWa_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:53.134 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:53.134 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.964632774000002, 2024-05-08T18:09:53.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.02864527, 2024-05-08T18:09:53.134 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.134 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.134 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.134 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.134 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:53.134 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:53.134 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1207 2024-05-08T18:09:53.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.135 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:53.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152426+0000", 2024-05-08T18:09:53.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.152430+0000", 2024-05-08T18:09:53.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1230000000000002e-06 2024-05-08T18:09:53.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157227+0000", 2024-05-08T18:09:53.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047968769999999997 2024-05-08T18:09:53.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157268+0000", 2024-05-08T18:09:53.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0673000000000002e-05 2024-05-08T18:09:53.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157293+0000", 2024-05-08T18:09:53.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5469999999999998e-05 2024-05-08T18:09:53.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157483+0000", 2024-05-08T18:09:53.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018973300000000001 2024-05-08T18:09:53.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157750+0000", 2024-05-08T18:09:53.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026736400000000002 2024-05-08T18:09:53.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:53.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.157982+0000", 2024-05-08T18:09:53.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023154299999999999 2024-05-08T18:09:53.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.171224+0000", 2024-05-08T18:09:53.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013242115 2024-05-08T18:09:53.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180801+0000", 2024-05-08T18:09:53.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0095766749999999998 2024-05-08T18:09:53.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.180919+0000", 2024-05-08T18:09:53.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118546 2024-05-08T18:09:53.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.181071+0000", 2024-05-08T18:09:53.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152151 2024-05-08T18:09:53.139 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.139 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.139 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.139 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1224 3.13 3:c82cef46:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.RLksuy7rb_npX9HYTpSr6aJ1bNEc63K_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:53.139 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:53.140 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.478579128, 2024-05-08T18:09:53.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025580821, 2024-05-08T18:09:53.140 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.140 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.140 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.140 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.140 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:53.140 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:53.140 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1224 2024-05-08T18:09:53.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.140 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:53.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638480+0000", 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.638484+0000", 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1989999999999999e-06 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643068+0000", 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045841859999999996 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643099+0000", 2024-05-08T18:09:53.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1331999999999997e-05 2024-05-08T18:09:53.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643117+0000", 2024-05-08T18:09:53.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7176999999999998e-05 2024-05-08T18:09:53.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643262+0000", 2024-05-08T18:09:53.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014521299999999999 2024-05-08T18:09:53.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643523+0000", 2024-05-08T18:09:53.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000260783 2024-05-08T18:09:53.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:53.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.643768+0000", 2024-05-08T18:09:53.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024567399999999998 2024-05-08T18:09:53.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.662501+0000", 2024-05-08T18:09:53.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018732988999999999 2024-05-08T18:09:53.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.663964+0000", 2024-05-08T18:09:53.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001463074 2024-05-08T18:09:53.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.664015+0000", 2024-05-08T18:09:53.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0549e-05 2024-05-08T18:09:53.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:07.664061+0000", 2024-05-08T18:09:53.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5645000000000001e-05 2024-05-08T18:09:53.144 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.144 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.144 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.145 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4388.0:1255 3.12 e85/20 3:48af9d8c:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.hcyZa4VqsLV6_ds0j4l_yGi5nWTxZW-_11:head v 85'2, mlcod=0'0)", 2024-05-08T18:09:53.145 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:53.145 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.635581176000002, 2024-05-08T18:09:53.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021924084999999999, 2024-05-08T18:09:53.145 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.145 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.145 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.145 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:53.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481478+0000", 2024-05-08T18:09:53.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.481479+0000", 2024-05-08T18:09:53.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1999999999999999e-06 2024-05-08T18:09:53.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.485998+0000", 2024-05-08T18:09:53.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045194600000000003 2024-05-08T18:09:53.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486023+0000", 2024-05-08T18:09:53.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4516999999999999e-05 2024-05-08T18:09:53.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486033+0000", 2024-05-08T18:09:53.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0529e-05 2024-05-08T18:09:53.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486172+0000", 2024-05-08T18:09:53.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013829599999999999 2024-05-08T18:09:53.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.486234+0000", 2024-05-08T18:09:53.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2156000000000006e-05 2024-05-08T18:09:53.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.503338+0000", 2024-05-08T18:09:53.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017104346999999999 2024-05-08T18:09:53.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:08.503402+0000", 2024-05-08T18:09:53.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3579999999999998e-05 2024-05-08T18:09:53.149 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.149 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.149 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.149 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1277 3.3f 3:ffe0c8dc:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-08T18:09:53.149 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:53.149 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.031932144000002, 2024-05-08T18:09:53.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025789262, 2024-05-08T18:09:53.149 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.149 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.149 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.149 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.149 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:53.149 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:53.149 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1277 2024-05-08T18:09:53.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.150 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:53.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085127+0000", 2024-05-08T18:09:53.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.085130+0000", 2024-05-08T18:09:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4659999999999999e-06 2024-05-08T18:09:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089237+0000", 2024-05-08T18:09:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004106424 2024-05-08T18:09:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089281+0000", 2024-05-08T18:09:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4053e-05 2024-05-08T18:09:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089300+0000", 2024-05-08T18:09:53.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9057000000000001e-05 2024-05-08T18:09:53.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089467+0000", 2024-05-08T18:09:53.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000167734 2024-05-08T18:09:53.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.089839+0000", 2024-05-08T18:09:53.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037171900000000001 2024-05-08T18:09:53.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:53.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.090206+0000", 2024-05-08T18:09:53.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036716500000000003 2024-05-08T18:09:53.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.105682+0000", 2024-05-08T18:09:53.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015475495000000001 2024-05-08T18:09:53.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110695+0000", 2024-05-08T18:09:53.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050135420000000002 2024-05-08T18:09:53.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110779+0000", 2024-05-08T18:09:53.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3914999999999999e-05 2024-05-08T18:09:53.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.110916+0000", 2024-05-08T18:09:53.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136692 2024-05-08T18:09:53.154 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.154 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.154 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.154 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1283 3.39 3:9ca6d3f9:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.GH9_eQdqJEUykBWJPhSZAeMVq3TgLLu_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-08T18:09:53.154 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:53.154 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.947846560000002, 2024-05-08T18:09:53.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022844218999999999, 2024-05-08T18:09:53.155 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.155 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.155 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.155 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.155 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:53.155 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:53.155 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1283 2024-05-08T18:09:53.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.155 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:53.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169212+0000", 2024-05-08T18:09:53.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.169215+0000", 2024-05-08T18:09:53.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9529999999999999e-06 2024-05-08T18:09:53.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173086+0000", 2024-05-08T18:09:53.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003870582 2024-05-08T18:09:53.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173107+0000", 2024-05-08T18:09:53.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1608999999999999e-05 2024-05-08T18:09:53.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173117+0000", 2024-05-08T18:09:53.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8090000000000004e-06 2024-05-08T18:09:53.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173192+0000", 2024-05-08T18:09:53.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4676000000000001e-05 2024-05-08T18:09:53.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-05-08T18:09:53.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.173197+0000", 2024-05-08T18:09:53.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0710000000000002e-06 2024-05-08T18:09:53.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.175963+0000", 2024-05-08T18:09:53.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027662810000000002 2024-05-08T18:09:53.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.176138+0000", 2024-05-08T18:09:53.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017430500000000001 2024-05-08T18:09:53.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:53.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.176332+0000", 2024-05-08T18:09:53.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019477000000000001 2024-05-08T18:09:53.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.184230+0000", 2024-05-08T18:09:53.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078977630000000004 2024-05-08T18:09:53.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.191962+0000", 2024-05-08T18:09:53.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077315830000000002 2024-05-08T18:09:53.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.192015+0000", 2024-05-08T18:09:53.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2992999999999999e-05 2024-05-08T18:09:53.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:09.192056+0000", 2024-05-08T18:09:53.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1823999999999998e-05 2024-05-08T18:09:53.160 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.160 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.160 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.160 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1412 3.3f 3:fe02d1ba:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1__shadow_.wfr9n2oshndTK5W3Eqc1eNQLfaWSOU-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:53.160 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:53.161 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 41.159394534, 2024-05-08T18:09:53.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023048524000000001, 2024-05-08T18:09:53.161 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.161 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.161 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.161 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.161 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:53.161 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:53.161 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1412 2024-05-08T18:09:53.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.161 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:53.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957664+0000", 2024-05-08T18:09:53.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.957668+0000", 2024-05-08T18:09:53.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8999999999999999e-06 2024-05-08T18:09:53.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963142+0000", 2024-05-08T18:09:53.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005473627 2024-05-08T18:09:53.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963181+0000", 2024-05-08T18:09:53.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.93e-05 2024-05-08T18:09:53.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963199+0000", 2024-05-08T18:09:53.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7866000000000001e-05 2024-05-08T18:09:53.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963347+0000", 2024-05-08T18:09:53.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014816800000000001 2024-05-08T18:09:53.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963603+0000", 2024-05-08T18:09:53.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025623099999999999 2024-05-08T18:09:53.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 6", 2024-05-08T18:09:53.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.963843+0000", 2024-05-08T18:09:53.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00023961699999999999 2024-05-08T18:09:53.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.975743+0000", 2024-05-08T18:09:53.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011899998 2024-05-08T18:09:53.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980533+0000", 2024-05-08T18:09:53.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047898749999999999 2024-05-08T18:09:53.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980638+0000", 2024-05-08T18:09:53.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010527300000000001 2024-05-08T18:09:53.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:11.980713+0000", 2024-05-08T18:09:53.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4668999999999999e-05 2024-05-08T18:09:53.166 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.166 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.166 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.166 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1420 3.e 3:72accb8f:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.8:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:53.166 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:53.166 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 41.081325663999998, 2024-05-08T18:09:53.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025387064000000001, 2024-05-08T18:09:53.166 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.166 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1420 2024-05-08T18:09:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035733+0000", 2024-05-08T18:09:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.035736+0000", 2024-05-08T18:09:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0240000000000002e-06 2024-05-08T18:09:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039738+0000", 2024-05-08T18:09:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004001419 2024-05-08T18:09:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039775+0000", 2024-05-08T18:09:53.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7696e-05 2024-05-08T18:09:53.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039792+0000", 2024-05-08T18:09:53.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7183000000000001e-05 2024-05-08T18:09:53.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.039909+0000", 2024-05-08T18:09:53.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116915 2024-05-08T18:09:53.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.040173+0000", 2024-05-08T18:09:53.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026373100000000001 2024-05-08T18:09:53.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:53.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.041106+0000", 2024-05-08T18:09:53.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093293100000000002 2024-05-08T18:09:53.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060858+0000", 2024-05-08T18:09:53.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019752232000000002 2024-05-08T18:09:53.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.060894+0000", 2024-05-08T18:09:53.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6056000000000002e-05 2024-05-08T18:09:53.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.061023+0000", 2024-05-08T18:09:53.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128849 2024-05-08T18:09:53.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.061120+0000", 2024-05-08T18:09:53.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7027999999999993e-05 2024-05-08T18:09:53.172 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.172 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.172 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.172 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1448 3.15 3:a83ea02a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.1_100Mb.9:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-08T18:09:53.172 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:53.172 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.213137846000002, 2024-05-08T18:09:53.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.021945044, 2024-05-08T18:09:53.172 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.172 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.172 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.172 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.172 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:53.173 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:53.173 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1448 2024-05-08T18:09:53.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.173 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:53.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903921+0000", 2024-05-08T18:09:53.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.903924+0000", 2024-05-08T18:09:53.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5790000000000002e-06 2024-05-08T18:09:53.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907773+0000", 2024-05-08T18:09:53.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038495740000000001 2024-05-08T18:09:53.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907796+0000", 2024-05-08T18:09:53.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3011e-05 2024-05-08T18:09:53.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907806+0000", 2024-05-08T18:09:53.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9729999999999992e-06 2024-05-08T18:09:53.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.907885+0000", 2024-05-08T18:09:53.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8799000000000002e-05 2024-05-08T18:09:53.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.908059+0000", 2024-05-08T18:09:53.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017370100000000001 2024-05-08T18:09:53.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:53.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.908581+0000", 2024-05-08T18:09:53.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052234099999999995 2024-05-08T18:09:53.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.918050+0000", 2024-05-08T18:09:53.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00946871 2024-05-08T18:09:53.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925682+0000", 2024-05-08T18:09:53.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0076326689999999999 2024-05-08T18:09:53.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925817+0000", 2024-05-08T18:09:53.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013451000000000001 2024-05-08T18:09:53.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:12.925866+0000", 2024-05-08T18:09:53.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9177e-05 2024-05-08T18:09:53.177 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.177 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.177 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.178 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1931 3.15 3:a838452a:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.rt8jcH7t-Si0Elu5GsS4JhWyuPnbJ5v_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-05-08T18:09:53.178 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:53.178 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.597147201999999, 2024-05-08T18:09:53.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022148926999999999, 2024-05-08T18:09:53.178 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.178 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.178 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.178 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.178 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:53.178 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:53.178 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1931 2024-05-08T18:09:53.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.179 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:53.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519912+0000", 2024-05-08T18:09:53.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.519915+0000", 2024-05-08T18:09:53.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4070000000000002e-06 2024-05-08T18:09:53.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523840+0000", 2024-05-08T18:09:53.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00392494 2024-05-08T18:09:53.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523881+0000", 2024-05-08T18:09:53.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0729999999999998e-05 2024-05-08T18:09:53.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.523901+0000", 2024-05-08T18:09:53.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9816000000000001e-05 2024-05-08T18:09:53.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524034+0000", 2024-05-08T18:09:53.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013357199999999999 2024-05-08T18:09:53.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524297+0000", 2024-05-08T18:09:53.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000262697 2024-05-08T18:09:53.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:53.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.524555+0000", 2024-05-08T18:09:53.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025802099999999999 2024-05-08T18:09:53.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.535170+0000", 2024-05-08T18:09:53.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010615528000000001 2024-05-08T18:09:53.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.541876+0000", 2024-05-08T18:09:53.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.006705562 2024-05-08T18:09:53.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.541984+0000", 2024-05-08T18:09:53.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108585 2024-05-08T18:09:53.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:26.542061+0000", 2024-05-08T18:09:53.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6069000000000006e-05 2024-05-08T18:09:53.183 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.183 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.183 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.183 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1990 3.2d 3:b4aceac7:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.34:head [create,setxattr user.rgw.idtag (61) in=14b,setxattr user.rgw.tail_tag (61) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:53.184 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.742290+0000", 2024-05-08T18:09:53.184 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.374768542999998, 2024-05-08T18:09:53.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023330152999999999, 2024-05-08T18:09:53.184 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.184 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.184 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.184 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.184 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:53.184 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:53.184 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1990 2024-05-08T18:09:53.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.184 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.742290+0000", 2024-05-08T18:09:53.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.742290+0000", 2024-05-08T18:09:53.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.742293+0000", 2024-05-08T18:09:53.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7369999999999998e-06 2024-05-08T18:09:53.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747757+0000", 2024-05-08T18:09:53.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0054638079999999997 2024-05-08T18:09:53.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747799+0000", 2024-05-08T18:09:53.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2172999999999998e-05 2024-05-08T18:09:53.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747819+0000", 2024-05-08T18:09:53.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0183e-05 2024-05-08T18:09:53.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.747973+0000", 2024-05-08T18:09:53.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015351500000000001 2024-05-08T18:09:53.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.748251+0000", 2024-05-08T18:09:53.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027811699999999998 2024-05-08T18:09:53.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:53.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.749139+0000", 2024-05-08T18:09:53.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00088849299999999997 2024-05-08T18:09:53.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.763612+0000", 2024-05-08T18:09:53.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014472992 2024-05-08T18:09:53.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.765137+0000", 2024-05-08T18:09:53.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001524823 2024-05-08T18:09:53.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.765399+0000", 2024-05-08T18:09:53.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026171700000000002 2024-05-08T18:09:53.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.765620+0000", 2024-05-08T18:09:53.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000221595 2024-05-08T18:09:53.189 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.189 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.189 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.189 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:1999 3.13 3:c81aceb2:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.qFJD7RDtXlCNRHqLIdswZJm3STCASHM_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:09:53.189 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:27.958634+0000", 2024-05-08T18:09:53.189 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.158425094999998, 2024-05-08T18:09:53.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022563374000000001, 2024-05-08T18:09:53.190 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.190 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.190 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.190 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.190 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:53.190 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:53.190 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 1999 2024-05-08T18:09:53.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.190 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.958634+0000", 2024-05-08T18:09:53.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.958634+0000", 2024-05-08T18:09:53.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.958637+0000", 2024-05-08T18:09:53.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2830000000000002e-06 2024-05-08T18:09:53.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.963827+0000", 2024-05-08T18:09:53.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051899609999999999 2024-05-08T18:09:53.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.964764+0000", 2024-05-08T18:09:53.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00093745000000000005 2024-05-08T18:09:53.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.964794+0000", 2024-05-08T18:09:53.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.957e-05 2024-05-08T18:09:53.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.965016+0000", 2024-05-08T18:09:53.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000221671 2024-05-08T18:09:53.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.965297+0000", 2024-05-08T18:09:53.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028171000000000001 2024-05-08T18:09:53.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:53.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.965547+0000", 2024-05-08T18:09:53.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00024940800000000001 2024-05-08T18:09:53.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.979720+0000", 2024-05-08T18:09:53.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01417321 2024-05-08T18:09:53.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.981028+0000", 2024-05-08T18:09:53.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0013080489999999999 2024-05-08T18:09:53.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.981129+0000", 2024-05-08T18:09:53.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010111900000000001 2024-05-08T18:09:53.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:27.981197+0000", 2024-05-08T18:09:53.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7942999999999996e-05 2024-05-08T18:09:53.195 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.195 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.195 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.195 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2130 3.39 3:9f8cf400:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.K7V9dh3caEYHsi9YlGwMWJrNO2rnOUe_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:53.195 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:30.419212+0000", 2024-05-08T18:09:53.195 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.697846582, 2024-05-08T18:09:53.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025593207999999999, 2024-05-08T18:09:53.195 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.196 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.196 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.196 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.196 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:53.196 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:53.196 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2130 2024-05-08T18:09:53.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.196 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.419212+0000", 2024-05-08T18:09:53.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.419212+0000", 2024-05-08T18:09:53.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.419215+0000", 2024-05-08T18:09:53.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0699999999999998e-06 2024-05-08T18:09:53.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423670+0000", 2024-05-08T18:09:53.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0044546990000000003 2024-05-08T18:09:53.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423704+0000", 2024-05-08T18:09:53.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4329999999999998e-05 2024-05-08T18:09:53.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423720+0000", 2024-05-08T18:09:53.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5769000000000001e-05 2024-05-08T18:09:53.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423820+0000", 2024-05-08T18:09:53.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9964999999999996e-05 2024-05-08T18:09:53.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.423947+0000", 2024-05-08T18:09:53.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012709400000000001 2024-05-08T18:09:53.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-05-08T18:09:53.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.424047+0000", 2024-05-08T18:09:53.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9841999999999997e-05 2024-05-08T18:09:53.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.430460+0000", 2024-05-08T18:09:53.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0064128040000000002 2024-05-08T18:09:53.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.444733+0000", 2024-05-08T18:09:53.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014272741 2024-05-08T18:09:53.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.444776+0000", 2024-05-08T18:09:53.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3594000000000003e-05 2024-05-08T18:09:53.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:30.444805+0000", 2024-05-08T18:09:53.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9300000000000001e-05 2024-05-08T18:09:53.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.201 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.201 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2175 3.2d 3:b44c7524:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.63:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:53.201 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:31.556724+0000", 2024-05-08T18:09:53.201 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.560334791999999, 2024-05-08T18:09:53.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.028086578000000001, 2024-05-08T18:09:53.201 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.201 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.202 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.202 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.202 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:53.202 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:53.202 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2175 2024-05-08T18:09:53.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.202 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.556724+0000", 2024-05-08T18:09:53.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.556724+0000", 2024-05-08T18:09:53.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.556727+0000", 2024-05-08T18:09:53.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3239999999999999e-06 2024-05-08T18:09:53.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561115+0000", 2024-05-08T18:09:53.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043878659999999998 2024-05-08T18:09:53.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561151+0000", 2024-05-08T18:09:53.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6247e-05 2024-05-08T18:09:53.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561177+0000", 2024-05-08T18:09:53.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5876000000000001e-05 2024-05-08T18:09:53.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561310+0000", 2024-05-08T18:09:53.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013296200000000001 2024-05-08T18:09:53.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.561658+0000", 2024-05-08T18:09:53.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00034749599999999998 2024-05-08T18:09:53.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-05-08T18:09:53.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.562604+0000", 2024-05-08T18:09:53.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00094605000000000004 2024-05-08T18:09:53.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.574717+0000", 2024-05-08T18:09:53.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012113153999999999 2024-05-08T18:09:53.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.584594+0000", 2024-05-08T18:09:53.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0098766830000000007 2024-05-08T18:09:53.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.584723+0000", 2024-05-08T18:09:53.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012911800000000001 2024-05-08T18:09:53.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:31.584811+0000", 2024-05-08T18:09:53.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7801999999999997e-05 2024-05-08T18:09:53.206 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.206 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.206 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.207 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2199 3.15 3:a8780bcf:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.67:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:53.207 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:32.172858+0000", 2024-05-08T18:09:53.207 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 20.944201243999998, 2024-05-08T18:09:53.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022099601999999999, 2024-05-08T18:09:53.207 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.207 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.207 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.207 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.207 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:53.207 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:53.207 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2199 2024-05-08T18:09:53.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.208 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.172858+0000", 2024-05-08T18:09:53.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.172858+0000", 2024-05-08T18:09:53.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.172861+0000", 2024-05-08T18:09:53.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.337e-06 2024-05-08T18:09:53.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177201+0000", 2024-05-08T18:09:53.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043402989999999997 2024-05-08T18:09:53.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177239+0000", 2024-05-08T18:09:53.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8157000000000001e-05 2024-05-08T18:09:53.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177257+0000", 2024-05-08T18:09:53.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.806e-05 2024-05-08T18:09:53.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177426+0000", 2024-05-08T18:09:53.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016871799999999999 2024-05-08T18:09:53.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.177706+0000", 2024-05-08T18:09:53.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027945800000000001 2024-05-08T18:09:53.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 3", 2024-05-08T18:09:53.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.178615+0000", 2024-05-08T18:09:53.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00090926799999999997 2024-05-08T18:09:53.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.192797+0000", 2024-05-08T18:09:53.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014181724 2024-05-08T18:09:53.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.194761+0000", 2024-05-08T18:09:53.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001963963 2024-05-08T18:09:53.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.194882+0000", 2024-05-08T18:09:53.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120952 2024-05-08T18:09:53.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.194957+0000", 2024-05-08T18:09:53.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5666000000000004e-05 2024-05-08T18:09:53.212 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.212 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.212 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.213 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2205 3.e 3:736fbc51:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2_10Mb.68:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:09:53.213 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:32.330919+0000", 2024-05-08T18:09:53.213 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 20.786140242999998, 2024-05-08T18:09:53.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.024623565, 2024-05-08T18:09:53.213 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.213 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.213 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.213 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.213 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:53.213 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:53.213 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2205 2024-05-08T18:09:53.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.213 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.330919+0000", 2024-05-08T18:09:53.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.330919+0000", 2024-05-08T18:09:53.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.330922+0000", 2024-05-08T18:09:53.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1470000000000001e-06 2024-05-08T18:09:53.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.334876+0000", 2024-05-08T18:09:53.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039544890000000003 2024-05-08T18:09:53.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.334914+0000", 2024-05-08T18:09:53.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7973999999999999e-05 2024-05-08T18:09:53.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.334932+0000", 2024-05-08T18:09:53.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7319000000000001e-05 2024-05-08T18:09:53.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.335093+0000", 2024-05-08T18:09:53.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000161149 2024-05-08T18:09:53.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.335364+0000", 2024-05-08T18:09:53.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027133799999999998 2024-05-08T18:09:53.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:53.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.336278+0000", 2024-05-08T18:09:53.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00091437799999999998 2024-05-08T18:09:53.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.353978+0000", 2024-05-08T18:09:53.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017699914000000001 2024-05-08T18:09:53.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.355343+0000", 2024-05-08T18:09:53.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001364346 2024-05-08T18:09:53.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.355463+0000", 2024-05-08T18:09:53.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120789 2024-05-08T18:09:53.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:32.355542+0000", 2024-05-08T18:09:53.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8721999999999996e-05 2024-05-08T18:09:53.218 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.218 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.218 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.218 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2356 3.d 3:b3bbc07d:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.8wN2GlL8rBYEiTXR4sMZd0wed6qVyrX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:53.218 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:35.353910+0000", 2024-05-08T18:09:53.219 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 17.763149124000002, 2024-05-08T18:09:53.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.023189147, 2024-05-08T18:09:53.219 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.219 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.219 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.219 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.219 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:53.219 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:53.219 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2356 2024-05-08T18:09:53.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.219 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.353910+0000", 2024-05-08T18:09:53.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.353910+0000", 2024-05-08T18:09:53.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.353913+0000", 2024-05-08T18:09:53.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.67e-06 2024-05-08T18:09:53.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358160+0000", 2024-05-08T18:09:53.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042467099999999999 2024-05-08T18:09:53.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358200+0000", 2024-05-08T18:09:53.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0272999999999999e-05 2024-05-08T18:09:53.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358225+0000", 2024-05-08T18:09:53.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5003000000000001e-05 2024-05-08T18:09:53.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358331+0000", 2024-05-08T18:09:53.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00010557599999999999 2024-05-08T18:09:53.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358517+0000", 2024-05-08T18:09:53.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018577200000000001 2024-05-08T18:09:53.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 5", 2024-05-08T18:09:53.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.358677+0000", 2024-05-08T18:09:53.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000160342 2024-05-08T18:09:53.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.368776+0000", 2024-05-08T18:09:53.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010098763 2024-05-08T18:09:53.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.376804+0000", 2024-05-08T18:09:53.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0080286369999999999 2024-05-08T18:09:53.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.376977+0000", 2024-05-08T18:09:53.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000172349 2024-05-08T18:09:53.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.377099+0000", 2024-05-08T18:09:53.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000122052 2024-05-08T18:09:53.224 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.224 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.224 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.224 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4388.0:2380 3.e 3:713200a8:::d0a95a6c-3c84-4d52-915c-e8ea581dfb9b.4388.2__shadow_.N3BoeKsRn7I3GNNh1gsMqBxJl5ACtoq_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-05-08T18:09:53.224 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-05-08T18:09:35.841683+0000", 2024-05-08T18:09:53.225 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 17.275375937, 2024-05-08T18:09:53.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.025074545, 2024-05-08T18:09:53.225 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-05-08T18:09:53.225 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-05-08T18:09:53.225 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:09:53.225 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-05-08T18:09:53.225 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4388", 2024-05-08T18:09:53.225 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.80:0/3014128969", 2024-05-08T18:09:53.225 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2380 2024-05-08T18:09:53.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.225 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-05-08T18:09:53.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-05-08T18:09:53.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.841683+0000", 2024-05-08T18:09:53.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-05-08T18:09:53.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.841683+0000", 2024-05-08T18:09:53.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-05-08T18:09:53.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-05-08T18:09:53.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.841685+0000", 2024-05-08T18:09:53.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3020000000000002e-06 2024-05-08T18:09:53.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-05-08T18:09:53.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845397+0000", 2024-05-08T18:09:53.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0037116240000000002 2024-05-08T18:09:53.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-05-08T18:09:53.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845421+0000", 2024-05-08T18:09:53.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4468e-05 2024-05-08T18:09:53.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-05-08T18:09:53.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845434+0000", 2024-05-08T18:09:53.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2989999999999999e-05 2024-05-08T18:09:53.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-05-08T18:09:53.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845532+0000", 2024-05-08T18:09:53.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7841000000000001e-05 2024-05-08T18:09:53.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-05-08T18:09:53.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845749+0000", 2024-05-08T18:09:53.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021645099999999999 2024-05-08T18:09:53.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 4", 2024-05-08T18:09:53.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.845973+0000", 2024-05-08T18:09:53.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000224744 2024-05-08T18:09:53.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:09:53.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866275+0000", 2024-05-08T18:09:53.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020301471000000001 2024-05-08T18:09:53.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-05-08T18:09:53.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866644+0000", 2024-05-08T18:09:53.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00036915800000000002 2024-05-08T18:09:53.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-05-08T18:09:53.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866704+0000", 2024-05-08T18:09:53.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0495000000000003e-05 2024-05-08T18:09:53.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-05-08T18:09:53.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-05-08T18:09:53.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-05-08T18:09:53.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-05-08T18:09:35.866757+0000", 2024-05-08T18:09:53.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3001000000000003e-05 2024-05-08T18:09:53.230 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.230 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.230 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.230 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-05-08T18:09:53.230 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-05-08T18:09:53.230 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-05-08T18:09:54.001 INFO:teuthology.orchestra.run.smithi080.stderr:noscrub is unset 2024-05-08T18:09:54.028 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:09:54.998 INFO:teuthology.orchestra.run.smithi080.stderr:nodeep-scrub is unset 2024-05-08T18:10:06.908 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-05-08T18:10:07.053 INFO:teuthology.orchestra.run.smithi080.stdout:mon.a: {} 2024-05-08T18:10:07.053 INFO:teuthology.orchestra.run.smithi080.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-08T18:10:07.066 INFO:teuthology.orchestra.run.smithi080.stdout:mon.b: {} 2024-05-08T18:10:07.067 INFO:teuthology.orchestra.run.smithi080.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-08T18:10:07.076 INFO:teuthology.orchestra.run.smithi080.stdout:mon.c: {} 2024-05-08T18:10:07.076 INFO:teuthology.orchestra.run.smithi080.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-08T18:10:07.095 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-08T18:10:07.804 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.0 to 1 (10000) 2024-05-08T18:10:07.829 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-05-08T18:10:08.789 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-05-08T18:10:08.821 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-08T18:10:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.1 to 1 (10000) 2024-05-08T18:10:09.829 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-05-08T18:10:10.828 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-05-08T18:10:10.854 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-08T18:10:11.846 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.2 to 1 (10000) 2024-05-08T18:10:11.871 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-05-08T18:10:12.874 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-05-08T18:10:12.902 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-08T18:10:13.865 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.3 to 1 (10000) 2024-05-08T18:10:13.894 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-05-08T18:10:14.891 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-05-08T18:10:14.918 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-08T18:10:15.910 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.4 to 1 (10000) 2024-05-08T18:10:15.934 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-05-08T18:10:16.914 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-05-08T18:10:16.943 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-08T18:10:17.948 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.5 to 1 (10000) 2024-05-08T18:10:17.972 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-05-08T18:10:18.940 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-05-08T18:10:18.971 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-08T18:10:19.975 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.6 to 1 (10000) 2024-05-08T18:10:19.998 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-05-08T18:10:20.964 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-05-08T18:10:20.994 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-08T18:10:21.980 INFO:teuthology.orchestra.run.smithi080.stderr:reweighted osd.7 to 1 (10000) 2024-05-08T18:10:22.013 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-05-08T18:10:23.008 INFO:teuthology.orchestra.run.smithi080.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-05-08T18:10:23.035 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-05-08T18:10:23.035 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-05-08T18:10:23.035 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-05-08T18:10:23.035 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-05-08T18:10:23.035 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T18:10:23.035 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:10:23.337 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:10:23.337 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":120,"fsid":"0d8284a2-bb69-4df9-9f45-9ef5b469ca40","created":"2024-05-08T18:06:48.916680+0000","modified":"2024-05-08T18:10:23.001291+0000","last_up_change":"2024-05-08T18:07:00.796481+0000","last_in_change":"2024-05-08T18:06:51.530709+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:07:01.699859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:07:07.479756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-08T18:07:14.110093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-08T18:07:15.798248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-08T18:07:17.763573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-08T18:07:19.656809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-08T18:07:21.569514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-08T18:07:23.704646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e14e7bbc-18b8-4961-bcde-109f22cc52e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6812","nonce":3565382691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6817","nonce":3565382691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6823","nonce":3565382691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6821","nonce":3565382691}]},"public_addr":"172.21.15.80:6812/3565382691","cluster_addr":"172.21.15.80:6817/3565382691","heartbeat_back_addr":"172.21.15.80:6823/3565382691","heartbeat_front_addr":"172.21.15.80:6821/3565382691","state":["exists","up"]},{"osd":1,"uuid":"d4ce30c2-52b8-45a3-8a34-b0addc8311dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6801","nonce":3922502534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6803","nonce":3922502534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6807","nonce":3922502534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6805","nonce":3922502534}]},"public_addr":"172.21.15.80:6801/3922502534","cluster_addr":"172.21.15.80:6803/3922502534","heartbeat_back_addr":"172.21.15.80:6807/3922502534","heartbeat_front_addr":"172.21.15.80:6805/3922502534","state":["exists","up"]},{"osd":2,"uuid":"0049cbe1-578f-4202-a572-2328d79f0496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6825","nonce":3474282780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6827","nonce":3474282780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6831","nonce":3474282780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6829","nonce":3474282780}]},"public_addr":"172.21.15.80:6825/3474282780","cluster_addr":"172.21.15.80:6827/3474282780","heartbeat_back_addr":"172.21.15.80:6831/3474282780","heartbeat_front_addr":"172.21.15.80:6829/3474282780","state":["exists","up"]},{"osd":3,"uuid":"3ec754a0-b0ca-4d44-bce0-7c380245ec0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6810","nonce":3525633066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6813","nonce":3525633066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6820","nonce":3525633066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6816","nonce":3525633066}]},"public_addr":"172.21.15.80:6810/3525633066","cluster_addr":"172.21.15.80:6813/3525633066","heartbeat_back_addr":"172.21.15.80:6820/3525633066","heartbeat_front_addr":"172.21.15.80:6816/3525633066","state":["exists","up"]},{"osd":4,"uuid":"1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6817","nonce":4103080494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6821","nonce":4103080494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6827","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6829","nonce":4103080494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6825","nonce":4103080494}]},"public_addr":"172.21.15.115:6817/4103080494","cluster_addr":"172.21.15.115:6821/4103080494","heartbeat_back_addr":"172.21.15.115:6829/4103080494","heartbeat_front_addr":"172.21.15.115:6825/4103080494","state":["exists","up"]},{"osd":5,"uuid":"3dc618ad-e40d-418e-844c-57572043f866","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6820","nonce":87947085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6824","nonce":87947085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6831","nonce":87947085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6828","nonce":87947085}]},"public_addr":"172.21.15.115:6820/87947085","cluster_addr":"172.21.15.115:6824/87947085","heartbeat_back_addr":"172.21.15.115:6831/87947085","heartbeat_front_addr":"172.21.15.115:6828/87947085","state":["exists","up"]},{"osd":6,"uuid":"1f8172c6-5d27-4542-80a6-1c630dddf752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6801","nonce":2090404725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6803","nonce":2090404725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6807","nonce":2090404725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6805","nonce":2090404725}]},"public_addr":"172.21.15.115:6801/2090404725","cluster_addr":"172.21.15.115:6803/2090404725","heartbeat_back_addr":"172.21.15.115:6807/2090404725","heartbeat_front_addr":"172.21.15.115:6805/2090404725","state":["exists","up"]},{"osd":7,"uuid":"e4146a73-11ca-4499-afa7-23e23d70a662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6809","nonce":133828553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6811","nonce":133828553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6815","nonce":133828553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6813","nonce":133828553}]},"public_addr":"172.21.15.115:6809/133828553","cluster_addr":"172.21.15.115:6811/133828553","heartbeat_back_addr":"172.21.15.115:6815/133828553","heartbeat_front_addr":"172.21.15.115:6813/133828553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.936317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.814583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.168294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.751445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.091268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.113133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.054822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.057214+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.3f","osds":[3,7]},{"pgid":"6.c","osds":[1,7]}],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":6,"to":7}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:10:23.356 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T18:10:23.356 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:10:23.650 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:10:23.650 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":120,"fsid":"0d8284a2-bb69-4df9-9f45-9ef5b469ca40","created":"2024-05-08T18:06:48.916680+0000","modified":"2024-05-08T18:10:23.001291+0000","last_up_change":"2024-05-08T18:07:00.796481+0000","last_in_change":"2024-05-08T18:06:51.530709+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:07:01.699859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:07:07.479756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-08T18:07:14.110093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-08T18:07:15.798248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-08T18:07:17.763573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-08T18:07:19.656809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-08T18:07:21.569514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-08T18:07:23.704646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e14e7bbc-18b8-4961-bcde-109f22cc52e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6812","nonce":3565382691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6817","nonce":3565382691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6823","nonce":3565382691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6821","nonce":3565382691}]},"public_addr":"172.21.15.80:6812/3565382691","cluster_addr":"172.21.15.80:6817/3565382691","heartbeat_back_addr":"172.21.15.80:6823/3565382691","heartbeat_front_addr":"172.21.15.80:6821/3565382691","state":["exists","up"]},{"osd":1,"uuid":"d4ce30c2-52b8-45a3-8a34-b0addc8311dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6801","nonce":3922502534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6803","nonce":3922502534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6807","nonce":3922502534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6805","nonce":3922502534}]},"public_addr":"172.21.15.80:6801/3922502534","cluster_addr":"172.21.15.80:6803/3922502534","heartbeat_back_addr":"172.21.15.80:6807/3922502534","heartbeat_front_addr":"172.21.15.80:6805/3922502534","state":["exists","up"]},{"osd":2,"uuid":"0049cbe1-578f-4202-a572-2328d79f0496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6825","nonce":3474282780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6827","nonce":3474282780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6831","nonce":3474282780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6829","nonce":3474282780}]},"public_addr":"172.21.15.80:6825/3474282780","cluster_addr":"172.21.15.80:6827/3474282780","heartbeat_back_addr":"172.21.15.80:6831/3474282780","heartbeat_front_addr":"172.21.15.80:6829/3474282780","state":["exists","up"]},{"osd":3,"uuid":"3ec754a0-b0ca-4d44-bce0-7c380245ec0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6810","nonce":3525633066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6813","nonce":3525633066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6820","nonce":3525633066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6816","nonce":3525633066}]},"public_addr":"172.21.15.80:6810/3525633066","cluster_addr":"172.21.15.80:6813/3525633066","heartbeat_back_addr":"172.21.15.80:6820/3525633066","heartbeat_front_addr":"172.21.15.80:6816/3525633066","state":["exists","up"]},{"osd":4,"uuid":"1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6817","nonce":4103080494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6821","nonce":4103080494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6827","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6829","nonce":4103080494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6825","nonce":4103080494}]},"public_addr":"172.21.15.115:6817/4103080494","cluster_addr":"172.21.15.115:6821/4103080494","heartbeat_back_addr":"172.21.15.115:6829/4103080494","heartbeat_front_addr":"172.21.15.115:6825/4103080494","state":["exists","up"]},{"osd":5,"uuid":"3dc618ad-e40d-418e-844c-57572043f866","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6820","nonce":87947085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6824","nonce":87947085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6831","nonce":87947085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6828","nonce":87947085}]},"public_addr":"172.21.15.115:6820/87947085","cluster_addr":"172.21.15.115:6824/87947085","heartbeat_back_addr":"172.21.15.115:6831/87947085","heartbeat_front_addr":"172.21.15.115:6828/87947085","state":["exists","up"]},{"osd":6,"uuid":"1f8172c6-5d27-4542-80a6-1c630dddf752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6801","nonce":2090404725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6803","nonce":2090404725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6807","nonce":2090404725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6805","nonce":2090404725}]},"public_addr":"172.21.15.115:6801/2090404725","cluster_addr":"172.21.15.115:6803/2090404725","heartbeat_back_addr":"172.21.15.115:6807/2090404725","heartbeat_front_addr":"172.21.15.115:6805/2090404725","state":["exists","up"]},{"osd":7,"uuid":"e4146a73-11ca-4499-afa7-23e23d70a662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6809","nonce":133828553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6811","nonce":133828553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6815","nonce":133828553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6813","nonce":133828553}]},"public_addr":"172.21.15.115:6809/133828553","cluster_addr":"172.21.15.115:6811/133828553","heartbeat_back_addr":"172.21.15.115:6815/133828553","heartbeat_front_addr":"172.21.15.115:6813/133828553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.936317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.814583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.168294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.751445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.091268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.113133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.054822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.057214+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.3f","osds":[3,7]},{"pgid":"6.c","osds":[1,7]}],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":6,"to":7}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:10:23.670 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T18:10:23.670 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T18:10:23.671 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T18:10:23.671 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T18:10:23.672 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-08T18:10:23.672 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-08T18:10:23.672 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-08T18:10:23.673 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-08T18:10:23.937 INFO:teuthology.orchestra.run.smithi080.stdout:55834574891 2024-05-08T18:10:23.938 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T18:10:23.941 INFO:teuthology.orchestra.run.smithi080.stdout:55834574893 2024-05-08T18:10:23.941 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T18:10:23.944 INFO:teuthology.orchestra.run.smithi080.stdout:55834574891 2024-05-08T18:10:23.944 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T18:10:23.945 INFO:teuthology.orchestra.run.smithi080.stdout:55834574893 2024-05-08T18:10:23.945 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T18:10:23.947 INFO:teuthology.orchestra.run.smithi080.stdout:55834574893 2024-05-08T18:10:23.948 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T18:10:23.950 INFO:teuthology.orchestra.run.smithi080.stdout:55834574892 2024-05-08T18:10:23.951 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T18:10:23.957 INFO:teuthology.orchestra.run.smithi080.stdout:55834574892 2024-05-08T18:10:23.958 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T18:10:23.984 INFO:teuthology.orchestra.run.smithi080.stdout:55834574893 2024-05-08T18:10:23.984 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T18:10:24.430 INFO:teuthology.orchestra.run.smithi080.stdout:55834574892 2024-05-08T18:10:24.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.2 2024-05-08T18:10:24.454 INFO:teuthology.orchestra.run.smithi080.stdout:55834574892 2024-05-08T18:10:24.471 INFO:teuthology.orchestra.run.smithi080.stdout:55834574890 2024-05-08T18:10:24.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.0 2024-05-08T18:10:24.479 INFO:teuthology.orchestra.run.smithi080.stdout:55834574890 2024-05-08T18:10:24.490 INFO:teuthology.orchestra.run.smithi080.stdout:55834574891 2024-05-08T18:10:24.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574891 got 55834574890 for osd.5 2024-05-08T18:10:24.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574891 got 55834574890 for osd.7 2024-05-08T18:10:24.507 INFO:teuthology.orchestra.run.smithi080.stdout:55834574892 2024-05-08T18:10:24.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574891 for osd.6 2024-05-08T18:10:24.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.1 2024-05-08T18:10:24.534 INFO:teuthology.orchestra.run.smithi080.stdout:55834574891 2024-05-08T18:10:24.534 INFO:teuthology.orchestra.run.smithi080.stdout:55834574892 2024-05-08T18:10:24.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574891 for osd.3 2024-05-08T18:10:24.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.4 2024-05-08T18:10:25.453 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T18:10:25.480 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T18:10:25.503 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T18:10:25.508 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T18:10:25.516 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T18:10:25.533 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T18:10:25.554 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T18:10:25.554 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T18:10:25.955 INFO:teuthology.orchestra.run.smithi080.stdout:55834574892 2024-05-08T18:10:25.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.2 2024-05-08T18:10:26.002 INFO:teuthology.orchestra.run.smithi080.stdout:55834574892 2024-05-08T18:10:26.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.0 2024-05-08T18:10:26.036 INFO:teuthology.orchestra.run.smithi080.stdout:55834574891 2024-05-08T18:10:26.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574891 got 55834574891 for osd.7 2024-05-08T18:10:26.060 DEBUG:teuthology.parallel:result is None 2024-05-08T18:10:26.062 INFO:teuthology.orchestra.run.smithi080.stdout:55834574891 2024-05-08T18:10:26.063 INFO:teuthology.orchestra.run.smithi080.stdout:55834574893 2024-05-08T18:10:26.076 INFO:teuthology.orchestra.run.smithi080.stdout:55834574892 2024-05-08T18:10:26.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574893 for osd.1 2024-05-08T18:10:26.084 DEBUG:teuthology.parallel:result is None 2024-05-08T18:10:26.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574891 got 55834574891 for osd.5 2024-05-08T18:10:26.085 DEBUG:teuthology.parallel:result is None 2024-05-08T18:10:26.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574892 for osd.6 2024-05-08T18:10:26.095 DEBUG:teuthology.parallel:result is None 2024-05-08T18:10:26.114 INFO:teuthology.orchestra.run.smithi080.stdout:55834574893 2024-05-08T18:10:26.126 INFO:teuthology.orchestra.run.smithi080.stdout:55834574892 2024-05-08T18:10:26.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574893 for osd.4 2024-05-08T18:10:26.134 DEBUG:teuthology.parallel:result is None 2024-05-08T18:10:26.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574892 for osd.3 2024-05-08T18:10:26.144 DEBUG:teuthology.parallel:result is None 2024-05-08T18:10:26.979 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T18:10:27.020 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T18:10:27.282 INFO:teuthology.orchestra.run.smithi080.stdout:55834574893 2024-05-08T18:10:27.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574893 for osd.2 2024-05-08T18:10:27.299 DEBUG:teuthology.parallel:result is None 2024-05-08T18:10:27.310 INFO:teuthology.orchestra.run.smithi080.stdout:55834574893 2024-05-08T18:10:27.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574893 for osd.0 2024-05-08T18:10:27.327 DEBUG:teuthology.parallel:result is None 2024-05-08T18:10:27.327 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-08T18:10:27.327 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:10:27.668 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:10:27.674 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:10:27.685 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-05-08T18:10:25.724515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636613462,"num_objects":637,"num_object_clones":0,"num_object_copies":1274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":3825,"num_read_kb":2050946,"num_write":3270,"num_write_kb":2050294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1933,"ondisk_log_size":1933,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3457348,"kb_used_data":3207880,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":751517372,"statfs":{"total":773094113280,"available":769553788928,"internally_reserved":0,"allocated":3284869120,"data_stored":3279721168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.750902"},"pg_stats":[{"pgid":"3.3f","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676116+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:10:23.676116+0000","last_peered":"2024-05-08T18:10:23.676116+0000","last_clean":"2024-05-08T18:10:23.676116+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:10:23.676116+0000","last_undegraded":"2024-05-08T18:10:23.676116+0000","last_fullsized":"2024-05-08T18:10:23.676116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":34822,"num_write":21,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005921+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:10:23.005921+0000","last_peered":"2024-05-08T18:10:23.005921+0000","last_clean":"2024-05-08T18:10:23.005921+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:10:23.005921+0000","last_undegraded":"2024-05-08T18:10:23.005921+0000","last_fullsized":"2024-05-08T18:10:23.005921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"93'7","reported_seq":218,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.024666+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:10:23.024666+0000","last_peered":"2024-05-08T18:10:23.024666+0000","last_clean":"2024-05-08T18:10:23.024666+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:10:23.024666+0000","last_undegraded":"2024-05-08T18:10:23.024666+0000","last_fullsized":"2024-05-08T18:10:23.024666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674165+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:10:23.674165+0000","last_peered":"2024-05-08T18:10:23.674165+0000","last_clean":"2024-05-08T18:10:23.674165+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:10:23.674165+0000","last_undegraded":"2024-05-08T18:10:23.674165+0000","last_fullsized":"2024-05-08T18:10:23.674165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"101'15","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016426+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:10:23.016426+0000","last_peered":"2024-05-08T18:10:23.016426+0000","last_clean":"2024-05-08T18:10:23.016426+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:10:23.016426+0000","last_undegraded":"2024-05-08T18:10:23.016426+0000","last_fullsized":"2024-05-08T18:10:23.016426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":47116,"num_write":35,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749409+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:10:23.749409+0000","last_peered":"2024-05-08T18:10:23.749409+0000","last_clean":"2024-05-08T18:10:23.749409+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:10:23.749409+0000","last_undegraded":"2024-05-08T18:10:23.749409+0000","last_fullsized":"2024-05-08T18:10:23.749409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"101'13","reported_seq":232,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007371+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:10:23.007371+0000","last_peered":"2024-05-08T18:10:23.007371+0000","last_clean":"2024-05-08T18:10:23.007371+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:10:23.007371+0000","last_undegraded":"2024-05-08T18:10:23.007371+0000","last_fullsized":"2024-05-08T18:10:23.007371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40972,"num_write":33,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014036+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:10:23.014036+0000","last_peered":"2024-05-08T18:10:23.014036+0000","last_clean":"2024-05-08T18:10:23.014036+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:10:23.014036+0000","last_undegraded":"2024-05-08T18:10:23.014036+0000","last_fullsized":"2024-05-08T18:10:23.014036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"101'5","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675565+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:10:23.675565+0000","last_peered":"2024-05-08T18:10:23.675565+0000","last_clean":"2024-05-08T18:10:23.675565+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:10:23.675565+0000","last_undegraded":"2024-05-08T18:10:23.675565+0000","last_fullsized":"2024-05-08T18:10:23.675565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14342,"num_write":15,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021174+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:10:23.021174+0000","last_peered":"2024-05-08T18:10:23.021174+0000","last_clean":"2024-05-08T18:10:23.021174+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:10:23.021174+0000","last_undegraded":"2024-05-08T18:10:23.021174+0000","last_fullsized":"2024-05-08T18:10:23.021174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"101'9","reported_seq":169,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:21.996277+0000","last_change":"2024-05-08T18:07:55.439965+0000","last_active":"2024-05-08T18:10:21.996277+0000","last_peered":"2024-05-08T18:10:21.996277+0000","last_clean":"2024-05-08T18:10:21.996277+0000","last_became_active":"2024-05-08T18:07:55.439578+0000","last_became_peered":"2024-05-08T18:07:55.439578+0000","last_unstale":"2024-05-08T18:10:21.996277+0000","last_undegraded":"2024-05-08T18:10:21.996277+0000","last_fullsized":"2024-05-08T18:10:21.996277+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:30.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":22540,"num_write":29,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"101'86","reported_seq":299,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750093+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:10:23.750093+0000","last_peered":"2024-05-08T18:10:23.750093+0000","last_clean":"2024-05-08T18:10:23.750093+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:10:23.750093+0000","last_undegraded":"2024-05-08T18:10:23.750093+0000","last_fullsized":"2024-05-08T18:10:23.750093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":219,"num_write":126,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"101'9","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674555+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:10:23.674555+0000","last_peered":"2024-05-08T18:10:23.674555+0000","last_clean":"2024-05-08T18:10:23.674555+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:10:23.674555+0000","last_undegraded":"2024-05-08T18:10:23.674555+0000","last_fullsized":"2024-05-08T18:10:23.674555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32774,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007751+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:10:23.007751+0000","last_peered":"2024-05-08T18:10:23.007751+0000","last_clean":"2024-05-08T18:10:23.007751+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:10:23.007751+0000","last_undegraded":"2024-05-08T18:10:23.007751+0000","last_fullsized":"2024-05-08T18:10:23.007751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"101'14","reported_seq":237,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009256+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:10:23.009256+0000","last_peered":"2024-05-08T18:10:23.009256+0000","last_clean":"2024-05-08T18:10:23.009256+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:10:23.009256+0000","last_undegraded":"2024-05-08T18:10:23.009256+0000","last_fullsized":"2024-05-08T18:10:23.009256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":167,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013504+0000","last_change":"2024-05-08T18:07:47.007132+0000","last_active":"2024-05-08T18:10:23.013504+0000","last_peered":"2024-05-08T18:10:23.013504+0000","last_clean":"2024-05-08T18:10:23.013504+0000","last_became_active":"2024-05-08T18:07:47.006744+0000","last_became_peered":"2024-05-08T18:07:47.006744+0000","last_unstale":"2024-05-08T18:10:23.013504+0000","last_undegraded":"2024-05-08T18:10:23.013504+0000","last_fullsized":"2024-05-08T18:10:23.013504+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:32.802677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748681+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:10:23.748681+0000","last_peered":"2024-05-08T18:10:23.748681+0000","last_clean":"2024-05-08T18:10:23.748681+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:10:23.748681+0000","last_undegraded":"2024-05-08T18:10:23.748681+0000","last_fullsized":"2024-05-08T18:10:23.748681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"101'17","reported_seq":243,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676155+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:10:23.676155+0000","last_peered":"2024-05-08T18:10:23.676155+0000","last_clean":"2024-05-08T18:10:23.676155+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:10:23.676155+0000","last_undegraded":"2024-05-08T18:10:23.676155+0000","last_fullsized":"2024-05-08T18:10:23.676155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":33,"num_read_kb":49176,"num_write":57,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674465+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:10:23.674465+0000","last_peered":"2024-05-08T18:10:23.674465+0000","last_clean":"2024-05-08T18:10:23.674465+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:10:23.674465+0000","last_undegraded":"2024-05-08T18:10:23.674465+0000","last_fullsized":"2024-05-08T18:10:23.674465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"94'10","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021892+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:10:23.021892+0000","last_peered":"2024-05-08T18:10:23.021892+0000","last_clean":"2024-05-08T18:10:23.021892+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:10:23.021892+0000","last_undegraded":"2024-05-08T18:10:23.021892+0000","last_fullsized":"2024-05-08T18:10:23.021892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":32768,"num_write":10,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"101'48","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007110+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:10:23.007110+0000","last_peered":"2024-05-08T18:10:23.007110+0000","last_clean":"2024-05-08T18:10:23.007110+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:10:23.007110+0000","last_undegraded":"2024-05-08T18:10:23.007110+0000","last_fullsized":"2024-05-08T18:10:23.007110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":122,"num_write":70,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"101'6","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021580+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:10:23.021580+0000","last_peered":"2024-05-08T18:10:23.021580+0000","last_clean":"2024-05-08T18:10:23.021580+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:10:23.021580+0000","last_undegraded":"2024-05-08T18:10:23.021580+0000","last_fullsized":"2024-05-08T18:10:23.021580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":202,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:22.000271+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:10:22.000271+0000","last_peered":"2024-05-08T18:10:22.000271+0000","last_clean":"2024-05-08T18:10:22.000271+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:10:22.000271+0000","last_undegraded":"2024-05-08T18:10:22.000271+0000","last_fullsized":"2024-05-08T18:10:22.000271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"94'8","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749710+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:10:23.749710+0000","last_peered":"2024-05-08T18:10:23.749710+0000","last_clean":"2024-05-08T18:10:23.749710+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:10:23.749710+0000","last_undegraded":"2024-05-08T18:10:23.749710+0000","last_fullsized":"2024-05-08T18:10:23.749710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":202,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:22.000968+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:10:22.000968+0000","last_peered":"2024-05-08T18:10:22.000968+0000","last_clean":"2024-05-08T18:10:22.000968+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:10:22.000968+0000","last_undegraded":"2024-05-08T18:10:22.000968+0000","last_fullsized":"2024-05-08T18:10:22.000968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"101'6","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012083+0000","last_change":"2024-05-08T18:09:38.328162+0000","last_active":"2024-05-08T18:10:23.012083+0000","last_peered":"2024-05-08T18:10:23.012083+0000","last_clean":"2024-05-08T18:10:23.012083+0000","last_became_active":"2024-05-08T18:09:38.182438+0000","last_became_peered":"2024-05-08T18:09:38.182438+0000","last_unstale":"2024-05-08T18:10:23.012083+0000","last_undegraded":"2024-05-08T18:10:23.012083+0000","last_fullsized":"2024-05-08T18:10:23.012083+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:05.642615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751059+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:10:23.751059+0000","last_peered":"2024-05-08T18:10:23.751059+0000","last_clean":"2024-05-08T18:10:23.751059+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:10:23.751059+0000","last_undegraded":"2024-05-08T18:10:23.751059+0000","last_fullsized":"2024-05-08T18:10:23.751059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"101'9","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013579+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:10:23.013579+0000","last_peered":"2024-05-08T18:10:23.013579+0000","last_clean":"2024-05-08T18:10:23.013579+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:10:23.013579+0000","last_undegraded":"2024-05-08T18:10:23.013579+0000","last_fullsized":"2024-05-08T18:10:23.013579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":28678,"num_write":19,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748132+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:10:23.748132+0000","last_peered":"2024-05-08T18:10:23.748132+0000","last_clean":"2024-05-08T18:10:23.748132+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:10:23.748132+0000","last_undegraded":"2024-05-08T18:10:23.748132+0000","last_fullsized":"2024-05-08T18:10:23.748132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011135+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:10:23.011135+0000","last_peered":"2024-05-08T18:10:23.011135+0000","last_clean":"2024-05-08T18:10:23.011135+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:10:23.011135+0000","last_undegraded":"2024-05-08T18:10:23.011135+0000","last_fullsized":"2024-05-08T18:10:23.011135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"101'12","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675916+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:10:23.675916+0000","last_peered":"2024-05-08T18:10:23.675916+0000","last_clean":"2024-05-08T18:10:23.675916+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:10:23.675916+0000","last_undegraded":"2024-05-08T18:10:23.675916+0000","last_fullsized":"2024-05-08T18:10:23.675916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":36876,"num_write":32,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007061+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:10:23.007061+0000","last_peered":"2024-05-08T18:10:23.007061+0000","last_clean":"2024-05-08T18:10:23.007061+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:10:23.007061+0000","last_undegraded":"2024-05-08T18:10:23.007061+0000","last_fullsized":"2024-05-08T18:10:23.007061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"101'12","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018739+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:10:23.018739+0000","last_peered":"2024-05-08T18:10:23.018739+0000","last_clean":"2024-05-08T18:10:23.018739+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:10:23.018739+0000","last_undegraded":"2024-05-08T18:10:23.018739+0000","last_fullsized":"2024-05-08T18:10:23.018739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675833+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:10:23.675833+0000","last_peered":"2024-05-08T18:10:23.675833+0000","last_clean":"2024-05-08T18:10:23.675833+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:10:23.675833+0000","last_undegraded":"2024-05-08T18:10:23.675833+0000","last_fullsized":"2024-05-08T18:10:23.675833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005832+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:10:23.005832+0000","last_peered":"2024-05-08T18:10:23.005832+0000","last_clean":"2024-05-08T18:10:23.005832+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:10:23.005832+0000","last_undegraded":"2024-05-08T18:10:23.005832+0000","last_fullsized":"2024-05-08T18:10:23.005832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007823+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:10:23.007823+0000","last_peered":"2024-05-08T18:10:23.007823+0000","last_clean":"2024-05-08T18:10:23.007823+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:10:23.007823+0000","last_undegraded":"2024-05-08T18:10:23.007823+0000","last_fullsized":"2024-05-08T18:10:23.007823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013931+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:10:23.013931+0000","last_peered":"2024-05-08T18:10:23.013931+0000","last_clean":"2024-05-08T18:10:23.013931+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:10:23.013931+0000","last_undegraded":"2024-05-08T18:10:23.013931+0000","last_fullsized":"2024-05-08T18:10:23.013931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":30738,"num_write":41,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010902+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:10:23.010902+0000","last_peered":"2024-05-08T18:10:23.010902+0000","last_clean":"2024-05-08T18:10:23.010902+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:10:23.010902+0000","last_undegraded":"2024-05-08T18:10:23.010902+0000","last_fullsized":"2024-05-08T18:10:23.010902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"101'7","reported_seq":206,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750625+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:10:23.750625+0000","last_peered":"2024-05-08T18:10:23.750625+0000","last_clean":"2024-05-08T18:10:23.750625+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:10:23.750625+0000","last_undegraded":"2024-05-08T18:10:23.750625+0000","last_fullsized":"2024-05-08T18:10:23.750625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750086+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:10:23.750086+0000","last_peered":"2024-05-08T18:10:23.750086+0000","last_clean":"2024-05-08T18:10:23.750086+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:10:23.750086+0000","last_undegraded":"2024-05-08T18:10:23.750086+0000","last_fullsized":"2024-05-08T18:10:23.750086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012615+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:10:23.012615+0000","last_peered":"2024-05-08T18:10:23.012615+0000","last_clean":"2024-05-08T18:10:23.012615+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:10:23.012615+0000","last_undegraded":"2024-05-08T18:10:23.012615+0000","last_fullsized":"2024-05-08T18:10:23.012615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"90'6","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019369+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:10:23.019369+0000","last_peered":"2024-05-08T18:10:23.019369+0000","last_clean":"2024-05-08T18:10:23.019369+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:10:23.019369+0000","last_undegraded":"2024-05-08T18:10:23.019369+0000","last_fullsized":"2024-05-08T18:10:23.019369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"101'9","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675435+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:10:23.675435+0000","last_peered":"2024-05-08T18:10:23.675435+0000","last_clean":"2024-05-08T18:10:23.675435+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:10:23.675435+0000","last_undegraded":"2024-05-08T18:10:23.675435+0000","last_fullsized":"2024-05-08T18:10:23.675435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":28684,"num_write":29,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013381+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:10:23.013381+0000","last_peered":"2024-05-08T18:10:23.013381+0000","last_clean":"2024-05-08T18:10:23.013381+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:10:23.013381+0000","last_undegraded":"2024-05-08T18:10:23.013381+0000","last_fullsized":"2024-05-08T18:10:23.013381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":209,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:22.000793+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:10:22.000793+0000","last_peered":"2024-05-08T18:10:22.000793+0000","last_clean":"2024-05-08T18:10:22.000793+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:10:22.000793+0000","last_undegraded":"2024-05-08T18:10:22.000793+0000","last_fullsized":"2024-05-08T18:10:22.000793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"101'14","reported_seq":255,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674736+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:10:23.674736+0000","last_peered":"2024-05-08T18:10:23.674736+0000","last_clean":"2024-05-08T18:10:23.674736+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:10:23.674736+0000","last_undegraded":"2024-05-08T18:10:23.674736+0000","last_fullsized":"2024-05-08T18:10:23.674736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"101'4","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748730+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:10:23.748730+0000","last_peered":"2024-05-08T18:10:23.748730+0000","last_clean":"2024-05-08T18:10:23.748730+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:10:23.748730+0000","last_undegraded":"2024-05-08T18:10:23.748730+0000","last_fullsized":"2024-05-08T18:10:23.748730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012204+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:10:23.012204+0000","last_peered":"2024-05-08T18:10:23.012204+0000","last_clean":"2024-05-08T18:10:23.012204+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:10:23.012204+0000","last_undegraded":"2024-05-08T18:10:23.012204+0000","last_fullsized":"2024-05-08T18:10:23.012204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"101'8","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020021+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:10:23.020021+0000","last_peered":"2024-05-08T18:10:23.020021+0000","last_clean":"2024-05-08T18:10:23.020021+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:10:23.020021+0000","last_undegraded":"2024-05-08T18:10:23.020021+0000","last_fullsized":"2024-05-08T18:10:23.020021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007769+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:10:23.007769+0000","last_peered":"2024-05-08T18:10:23.007769+0000","last_clean":"2024-05-08T18:10:23.007769+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:10:23.007769+0000","last_undegraded":"2024-05-08T18:10:23.007769+0000","last_fullsized":"2024-05-08T18:10:23.007769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"101'12","reported_seq":216,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675041+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:10:23.675041+0000","last_peered":"2024-05-08T18:10:23.675041+0000","last_clean":"2024-05-08T18:10:23.675041+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:10:23.675041+0000","last_undegraded":"2024-05-08T18:10:23.675041+0000","last_fullsized":"2024-05-08T18:10:23.675041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"101'14","reported_seq":243,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009607+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:10:23.009607+0000","last_peered":"2024-05-08T18:10:23.009607+0000","last_clean":"2024-05-08T18:10:23.009607+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:10:23.009607+0000","last_undegraded":"2024-05-08T18:10:23.009607+0000","last_fullsized":"2024-05-08T18:10:23.009607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006408+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:10:23.006408+0000","last_peered":"2024-05-08T18:10:23.006408+0000","last_clean":"2024-05-08T18:10:23.006408+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:10:23.006408+0000","last_undegraded":"2024-05-08T18:10:23.006408+0000","last_fullsized":"2024-05-08T18:10:23.006408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"101'17","reported_seq":186,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:22.001567+0000","last_change":"2024-05-08T18:07:55.357969+0000","last_active":"2024-05-08T18:10:22.001567+0000","last_peered":"2024-05-08T18:10:22.001567+0000","last_clean":"2024-05-08T18:10:22.001567+0000","last_became_active":"2024-05-08T18:07:55.357205+0000","last_became_peered":"2024-05-08T18:07:55.357205+0000","last_unstale":"2024-05-08T18:10:22.001567+0000","last_undegraded":"2024-05-08T18:10:22.001567+0000","last_fullsized":"2024-05-08T18:10:22.001567+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:04.667292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":29,"num_read_kb":51218,"num_write":47,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673147+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:10:23.673147+0000","last_peered":"2024-05-08T18:10:23.673147+0000","last_clean":"2024-05-08T18:10:23.673147+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:10:23.673147+0000","last_undegraded":"2024-05-08T18:10:23.673147+0000","last_fullsized":"2024-05-08T18:10:23.673147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"101'24","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005976+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:10:23.005976+0000","last_peered":"2024-05-08T18:10:23.005976+0000","last_clean":"2024-05-08T18:10:23.005976+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:10:23.005976+0000","last_undegraded":"2024-05-08T18:10:23.005976+0000","last_fullsized":"2024-05-08T18:10:23.005976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5766,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":188,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022992+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:10:23.022992+0000","last_peered":"2024-05-08T18:10:23.022992+0000","last_clean":"2024-05-08T18:10:23.022992+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:10:23.022992+0000","last_undegraded":"2024-05-08T18:10:23.022992+0000","last_fullsized":"2024-05-08T18:10:23.022992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006819+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:10:23.006819+0000","last_peered":"2024-05-08T18:10:23.006819+0000","last_clean":"2024-05-08T18:10:23.006819+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:10:23.006819+0000","last_undegraded":"2024-05-08T18:10:23.006819+0000","last_fullsized":"2024-05-08T18:10:23.006819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"90'2","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748795+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:10:23.748795+0000","last_peered":"2024-05-08T18:10:23.748795+0000","last_clean":"2024-05-08T18:10:23.748795+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:10:23.748795+0000","last_undegraded":"2024-05-08T18:10:23.748795+0000","last_fullsized":"2024-05-08T18:10:23.748795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"101'12","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676002+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:10:23.676002+0000","last_peered":"2024-05-08T18:10:23.676002+0000","last_clean":"2024-05-08T18:10:23.676002+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:10:23.676002+0000","last_undegraded":"2024-05-08T18:10:23.676002+0000","last_fullsized":"2024-05-08T18:10:23.676002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":32792,"num_write":52,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":198,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:21.996017+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:10:21.996017+0000","last_peered":"2024-05-08T18:10:21.996017+0000","last_clean":"2024-05-08T18:10:21.996017+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:10:21.996017+0000","last_undegraded":"2024-05-08T18:10:21.996017+0000","last_fullsized":"2024-05-08T18:10:21.996017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"101'13","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013219+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:10:23.013219+0000","last_peered":"2024-05-08T18:10:23.013219+0000","last_clean":"2024-05-08T18:10:23.013219+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:10:23.013219+0000","last_undegraded":"2024-05-08T18:10:23.013219+0000","last_fullsized":"2024-05-08T18:10:23.013219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009871+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:10:23.009871+0000","last_peered":"2024-05-08T18:10:23.009871+0000","last_clean":"2024-05-08T18:10:23.009871+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:10:23.009871+0000","last_undegraded":"2024-05-08T18:10:23.009871+0000","last_fullsized":"2024-05-08T18:10:23.009871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020405+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:10:23.020405+0000","last_peered":"2024-05-08T18:10:23.020405+0000","last_clean":"2024-05-08T18:10:23.020405+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:10:23.020405+0000","last_undegraded":"2024-05-08T18:10:23.020405+0000","last_fullsized":"2024-05-08T18:10:23.020405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"101'34","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021104+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:10:23.021104+0000","last_peered":"2024-05-08T18:10:23.021104+0000","last_clean":"2024-05-08T18:10:23.021104+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:10:23.021104+0000","last_undegraded":"2024-05-08T18:10:23.021104+0000","last_fullsized":"2024-05-08T18:10:23.021104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"101'6","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676260+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:10:23.676260+0000","last_peered":"2024-05-08T18:10:23.676260+0000","last_clean":"2024-05-08T18:10:23.676260+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:10:23.676260+0000","last_undegraded":"2024-05-08T18:10:23.676260+0000","last_fullsized":"2024-05-08T18:10:23.676260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":198,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:22.000731+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:10:22.000731+0000","last_peered":"2024-05-08T18:10:22.000731+0000","last_clean":"2024-05-08T18:10:22.000731+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:10:22.000731+0000","last_undegraded":"2024-05-08T18:10:22.000731+0000","last_fullsized":"2024-05-08T18:10:22.000731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"101'18","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674346+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:10:23.674346+0000","last_peered":"2024-05-08T18:10:23.674346+0000","last_clean":"2024-05-08T18:10:23.674346+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:10:23.674346+0000","last_undegraded":"2024-05-08T18:10:23.674346+0000","last_fullsized":"2024-05-08T18:10:23.674346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"101'14","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010243+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:10:23.010243+0000","last_peered":"2024-05-08T18:10:23.010243+0000","last_clean":"2024-05-08T18:10:23.010243+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:10:23.010243+0000","last_undegraded":"2024-05-08T18:10:23.010243+0000","last_fullsized":"2024-05-08T18:10:23.010243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"101'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018672+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:10:23.018672+0000","last_peered":"2024-05-08T18:10:23.018672+0000","last_clean":"2024-05-08T18:10:23.018672+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:10:23.018672+0000","last_undegraded":"2024-05-08T18:10:23.018672+0000","last_fullsized":"2024-05-08T18:10:23.018672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015490+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:10:23.015490+0000","last_peered":"2024-05-08T18:10:23.015490+0000","last_clean":"2024-05-08T18:10:23.015490+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:10:23.015490+0000","last_undegraded":"2024-05-08T18:10:23.015490+0000","last_fullsized":"2024-05-08T18:10:23.015490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"101'18","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007808+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:10:23.007808+0000","last_peered":"2024-05-08T18:10:23.007808+0000","last_clean":"2024-05-08T18:10:23.007808+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:10:23.007808+0000","last_undegraded":"2024-05-08T18:10:23.007808+0000","last_fullsized":"2024-05-08T18:10:23.007808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":34,"num_read_kb":55320,"num_write":58,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":198,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:21.996571+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:10:21.996571+0000","last_peered":"2024-05-08T18:10:21.996571+0000","last_clean":"2024-05-08T18:10:21.996571+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:10:21.996571+0000","last_undegraded":"2024-05-08T18:10:21.996571+0000","last_fullsized":"2024-05-08T18:10:21.996571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"101'22","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011471+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:10:23.011471+0000","last_peered":"2024-05-08T18:10:23.011471+0000","last_clean":"2024-05-08T18:10:23.011471+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:10:23.011471+0000","last_undegraded":"2024-05-08T18:10:23.011471+0000","last_fullsized":"2024-05-08T18:10:23.011471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":190,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:21.995795+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:10:21.995795+0000","last_peered":"2024-05-08T18:10:21.995795+0000","last_clean":"2024-05-08T18:10:21.995795+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:10:21.995795+0000","last_undegraded":"2024-05-08T18:10:21.995795+0000","last_fullsized":"2024-05-08T18:10:21.995795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":184,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.024357+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:10:23.024357+0000","last_peered":"2024-05-08T18:10:23.024357+0000","last_clean":"2024-05-08T18:10:23.024357+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:10:23.024357+0000","last_undegraded":"2024-05-08T18:10:23.024357+0000","last_fullsized":"2024-05-08T18:10:23.024357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750534+0000","last_change":"2024-05-08T18:07:55.356946+0000","last_active":"2024-05-08T18:10:23.750534+0000","last_peered":"2024-05-08T18:10:23.750534+0000","last_clean":"2024-05-08T18:10:23.750534+0000","last_became_active":"2024-05-08T18:07:55.355948+0000","last_became_peered":"2024-05-08T18:07:55.355948+0000","last_unstale":"2024-05-08T18:10:23.750534+0000","last_undegraded":"2024-05-08T18:10:23.750534+0000","last_fullsized":"2024-05-08T18:10:23.750534+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:04.163382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"94'9","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011429+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:10:23.011429+0000","last_peered":"2024-05-08T18:10:23.011429+0000","last_clean":"2024-05-08T18:10:23.011429+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:10:23.011429+0000","last_undegraded":"2024-05-08T18:10:23.011429+0000","last_fullsized":"2024-05-08T18:10:23.011429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":198,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:22.000774+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:10:22.000774+0000","last_peered":"2024-05-08T18:10:22.000774+0000","last_clean":"2024-05-08T18:10:22.000774+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:10:22.000774+0000","last_undegraded":"2024-05-08T18:10:22.000774+0000","last_fullsized":"2024-05-08T18:10:22.000774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"104'17","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750330+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:10:23.750330+0000","last_peered":"2024-05-08T18:10:23.750330+0000","last_clean":"2024-05-08T18:10:23.750330+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:10:23.750330+0000","last_undegraded":"2024-05-08T18:10:23.750330+0000","last_fullsized":"2024-05-08T18:10:23.750330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10256,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":24,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017020+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:10:23.017020+0000","last_peered":"2024-05-08T18:10:23.017020+0000","last_clean":"2024-05-08T18:10:23.017020+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:10:23.017020+0000","last_undegraded":"2024-05-08T18:10:23.017020+0000","last_fullsized":"2024-05-08T18:10:23.017020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"90'2","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008384+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:10:23.008384+0000","last_peered":"2024-05-08T18:10:23.008384+0000","last_clean":"2024-05-08T18:10:23.008384+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:10:23.008384+0000","last_undegraded":"2024-05-08T18:10:23.008384+0000","last_fullsized":"2024-05-08T18:10:23.008384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751087+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:10:23.751087+0000","last_peered":"2024-05-08T18:10:23.751087+0000","last_clean":"2024-05-08T18:10:23.751087+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:10:23.751087+0000","last_undegraded":"2024-05-08T18:10:23.751087+0000","last_fullsized":"2024-05-08T18:10:23.751087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"101'6","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021301+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:10:23.021301+0000","last_peered":"2024-05-08T18:10:23.021301+0000","last_clean":"2024-05-08T18:10:23.021301+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:10:23.021301+0000","last_undegraded":"2024-05-08T18:10:23.021301+0000","last_fullsized":"2024-05-08T18:10:23.021301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":16390,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":196,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023377+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:10:23.023377+0000","last_peered":"2024-05-08T18:10:23.023377+0000","last_clean":"2024-05-08T18:10:23.023377+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:10:23.023377+0000","last_undegraded":"2024-05-08T18:10:23.023377+0000","last_fullsized":"2024-05-08T18:10:23.023377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"101'19","reported_seq":223,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:22.001877+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:10:22.001877+0000","last_peered":"2024-05-08T18:10:22.001877+0000","last_clean":"2024-05-08T18:10:22.001877+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:10:22.001877+0000","last_undegraded":"2024-05-08T18:10:22.001877+0000","last_fullsized":"2024-05-08T18:10:22.001877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"101'14","reported_seq":246,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:22.001406+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:10:22.001406+0000","last_peered":"2024-05-08T18:10:22.001406+0000","last_clean":"2024-05-08T18:10:22.001406+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:10:22.001406+0000","last_undegraded":"2024-05-08T18:10:22.001406+0000","last_fullsized":"2024-05-08T18:10:22.001406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":184,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023325+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:10:23.023325+0000","last_peered":"2024-05-08T18:10:23.023325+0000","last_clean":"2024-05-08T18:10:23.023325+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:10:23.023325+0000","last_undegraded":"2024-05-08T18:10:23.023325+0000","last_fullsized":"2024-05-08T18:10:23.023325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"101'42","reported_seq":249,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750723+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:10:23.750723+0000","last_peered":"2024-05-08T18:10:23.750723+0000","last_clean":"2024-05-08T18:10:23.750723+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:10:23.750723+0000","last_undegraded":"2024-05-08T18:10:23.750723+0000","last_fullsized":"2024-05-08T18:10:23.750723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"95'11","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749487+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:10:23.749487+0000","last_peered":"2024-05-08T18:10:23.749487+0000","last_clean":"2024-05-08T18:10:23.749487+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:10:23.749487+0000","last_undegraded":"2024-05-08T18:10:23.749487+0000","last_fullsized":"2024-05-08T18:10:23.749487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":34822,"num_write":21,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":218,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008282+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:10:23.008282+0000","last_peered":"2024-05-08T18:10:23.008282+0000","last_clean":"2024-05-08T18:10:23.008282+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:10:23.008282+0000","last_undegraded":"2024-05-08T18:10:23.008282+0000","last_fullsized":"2024-05-08T18:10:23.008282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":93,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023112+0000","last_change":"2024-05-08T18:09:06.402195+0000","last_active":"2024-05-08T18:10:23.023112+0000","last_peered":"2024-05-08T18:10:23.023112+0000","last_clean":"2024-05-08T18:10:23.023112+0000","last_became_active":"2024-05-08T18:09:06.380401+0000","last_became_peered":"2024-05-08T18:09:06.380401+0000","last_unstale":"2024-05-08T18:10:23.023112+0000","last_undegraded":"2024-05-08T18:10:23.023112+0000","last_fullsized":"2024-05-08T18:10:23.023112+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:36.840412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"101'14","reported_seq":245,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020836+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:10:23.020836+0000","last_peered":"2024-05-08T18:10:23.020836+0000","last_clean":"2024-05-08T18:10:23.020836+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:10:23.020836+0000","last_undegraded":"2024-05-08T18:10:23.020836+0000","last_fullsized":"2024-05-08T18:10:23.020836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749093+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:10:23.749093+0000","last_peered":"2024-05-08T18:10:23.749093+0000","last_clean":"2024-05-08T18:10:23.749093+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:10:23.749093+0000","last_undegraded":"2024-05-08T18:10:23.749093+0000","last_fullsized":"2024-05-08T18:10:23.749093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":200,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.025096+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:10:23.025096+0000","last_peered":"2024-05-08T18:10:23.025096+0000","last_clean":"2024-05-08T18:10:23.025096+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:10:23.025096+0000","last_undegraded":"2024-05-08T18:10:23.025096+0000","last_fullsized":"2024-05-08T18:10:23.025096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"101'13","reported_seq":235,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009532+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:10:23.009532+0000","last_peered":"2024-05-08T18:10:23.009532+0000","last_clean":"2024-05-08T18:10:23.009532+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:10:23.009532+0000","last_undegraded":"2024-05-08T18:10:23.009532+0000","last_fullsized":"2024-05-08T18:10:23.009532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":47110,"num_write":23,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747906+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:10:23.747906+0000","last_peered":"2024-05-08T18:10:23.747906+0000","last_clean":"2024-05-08T18:10:23.747906+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:10:23.747906+0000","last_undegraded":"2024-05-08T18:10:23.747906+0000","last_fullsized":"2024-05-08T18:10:23.747906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"101'21","reported_seq":226,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007012+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:10:23.007012+0000","last_peered":"2024-05-08T18:10:23.007012+0000","last_clean":"2024-05-08T18:10:23.007012+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:10:23.007012+0000","last_undegraded":"2024-05-08T18:10:23.007012+0000","last_fullsized":"2024-05-08T18:10:23.007012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10255,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019992+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:10:23.019992+0000","last_peered":"2024-05-08T18:10:23.019992+0000","last_clean":"2024-05-08T18:10:23.019992+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:10:23.019992+0000","last_undegraded":"2024-05-08T18:10:23.019992+0000","last_fullsized":"2024-05-08T18:10:23.019992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":184,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022870+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:10:23.022870+0000","last_peered":"2024-05-08T18:10:23.022870+0000","last_clean":"2024-05-08T18:10:23.022870+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:10:23.022870+0000","last_undegraded":"2024-05-08T18:10:23.022870+0000","last_fullsized":"2024-05-08T18:10:23.022870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021357+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:10:23.021357+0000","last_peered":"2024-05-08T18:10:23.021357+0000","last_clean":"2024-05-08T18:10:23.021357+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:10:23.021357+0000","last_undegraded":"2024-05-08T18:10:23.021357+0000","last_fullsized":"2024-05-08T18:10:23.021357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":311,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674956+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:10:23.674956+0000","last_peered":"2024-05-08T18:10:23.674956+0000","last_clean":"2024-05-08T18:10:23.674956+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:10:23.674956+0000","last_undegraded":"2024-05-08T18:10:23.674956+0000","last_fullsized":"2024-05-08T18:10:23.674956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007096+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:10:23.007096+0000","last_peered":"2024-05-08T18:10:23.007096+0000","last_clean":"2024-05-08T18:10:23.007096+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:10:23.007096+0000","last_undegraded":"2024-05-08T18:10:23.007096+0000","last_fullsized":"2024-05-08T18:10:23.007096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"101'10","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010661+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:10:23.010661+0000","last_peered":"2024-05-08T18:10:23.010661+0000","last_clean":"2024-05-08T18:10:23.010661+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:10:23.010661+0000","last_undegraded":"2024-05-08T18:10:23.010661+0000","last_fullsized":"2024-05-08T18:10:23.010661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674690+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:10:23.674690+0000","last_peered":"2024-05-08T18:10:23.674690+0000","last_clean":"2024-05-08T18:10:23.674690+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:10:23.674690+0000","last_undegraded":"2024-05-08T18:10:23.674690+0000","last_fullsized":"2024-05-08T18:10:23.674690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"101'24","reported_seq":232,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008559+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:10:23.008559+0000","last_peered":"2024-05-08T18:10:23.008559+0000","last_clean":"2024-05-08T18:10:23.008559+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:10:23.008559+0000","last_undegraded":"2024-05-08T18:10:23.008559+0000","last_fullsized":"2024-05-08T18:10:23.008559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15071,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":35,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018810+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:10:23.018810+0000","last_peered":"2024-05-08T18:10:23.018810+0000","last_clean":"2024-05-08T18:10:23.018810+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:10:23.018810+0000","last_undegraded":"2024-05-08T18:10:23.018810+0000","last_fullsized":"2024-05-08T18:10:23.018810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019671+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:10:23.019671+0000","last_peered":"2024-05-08T18:10:23.019671+0000","last_clean":"2024-05-08T18:10:23.019671+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:10:23.019671+0000","last_undegraded":"2024-05-08T18:10:23.019671+0000","last_fullsized":"2024-05-08T18:10:23.019671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019230+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:10:23.019230+0000","last_peered":"2024-05-08T18:10:23.019230+0000","last_clean":"2024-05-08T18:10:23.019230+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:10:23.019230+0000","last_undegraded":"2024-05-08T18:10:23.019230+0000","last_fullsized":"2024-05-08T18:10:23.019230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674634+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:10:23.674634+0000","last_peered":"2024-05-08T18:10:23.674634+0000","last_clean":"2024-05-08T18:10:23.674634+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:10:23.674634+0000","last_undegraded":"2024-05-08T18:10:23.674634+0000","last_fullsized":"2024-05-08T18:10:23.674634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"101'12","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011857+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:10:23.011857+0000","last_peered":"2024-05-08T18:10:23.011857+0000","last_clean":"2024-05-08T18:10:23.011857+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:10:23.011857+0000","last_undegraded":"2024-05-08T18:10:23.011857+0000","last_fullsized":"2024-05-08T18:10:23.011857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":34834,"num_write":42,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008813+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:10:23.008813+0000","last_peered":"2024-05-08T18:10:23.008813+0000","last_clean":"2024-05-08T18:10:23.008813+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:10:23.008813+0000","last_undegraded":"2024-05-08T18:10:23.008813+0000","last_fullsized":"2024-05-08T18:10:23.008813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"101'60","reported_seq":310,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023103+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:10:23.023103+0000","last_peered":"2024-05-08T18:10:23.023103+0000","last_clean":"2024-05-08T18:10:23.023103+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:10:23.023103+0000","last_undegraded":"2024-05-08T18:10:23.023103+0000","last_fullsized":"2024-05-08T18:10:23.023103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35210,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":100,"num_read_kb":145,"num_write":72,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674917+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:10:23.674917+0000","last_peered":"2024-05-08T18:10:23.674917+0000","last_clean":"2024-05-08T18:10:23.674917+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:10:23.674917+0000","last_undegraded":"2024-05-08T18:10:23.674917+0000","last_fullsized":"2024-05-08T18:10:23.674917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":184,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022727+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:10:23.022727+0000","last_peered":"2024-05-08T18:10:23.022727+0000","last_clean":"2024-05-08T18:10:23.022727+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:10:23.022727+0000","last_undegraded":"2024-05-08T18:10:23.022727+0000","last_fullsized":"2024-05-08T18:10:23.022727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"101'34","reported_seq":237,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.025312+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:10:23.025312+0000","last_peered":"2024-05-08T18:10:23.025312+0000","last_clean":"2024-05-08T18:10:23.025312+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:10:23.025312+0000","last_undegraded":"2024-05-08T18:10:23.025312+0000","last_fullsized":"2024-05-08T18:10:23.025312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":212,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:21.996176+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:10:21.996176+0000","last_peered":"2024-05-08T18:10:21.996176+0000","last_clean":"2024-05-08T18:10:21.996176+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:10:21.996176+0000","last_undegraded":"2024-05-08T18:10:21.996176+0000","last_fullsized":"2024-05-08T18:10:21.996176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"101'10","reported_seq":224,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022823+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:10:23.022823+0000","last_peered":"2024-05-08T18:10:23.022823+0000","last_clean":"2024-05-08T18:10:23.022823+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:10:23.022823+0000","last_undegraded":"2024-05-08T18:10:23.022823+0000","last_fullsized":"2024-05-08T18:10:23.022823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":28678,"num_write":20,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":199,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:22.001593+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:10:22.001593+0000","last_peered":"2024-05-08T18:10:22.001593+0000","last_clean":"2024-05-08T18:10:22.001593+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:10:22.001593+0000","last_undegraded":"2024-05-08T18:10:22.001593+0000","last_fullsized":"2024-05-08T18:10:22.001593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":254,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675535+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:10:23.675535+0000","last_peered":"2024-05-08T18:10:23.675535+0000","last_clean":"2024-05-08T18:10:23.675535+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:10:23.675535+0000","last_undegraded":"2024-05-08T18:10:23.675535+0000","last_fullsized":"2024-05-08T18:10:23.675535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012071+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:10:23.012071+0000","last_peered":"2024-05-08T18:10:23.012071+0000","last_clean":"2024-05-08T18:10:23.012071+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:10:23.012071+0000","last_undegraded":"2024-05-08T18:10:23.012071+0000","last_fullsized":"2024-05-08T18:10:23.012071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012608+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:10:23.012608+0000","last_peered":"2024-05-08T18:10:23.012608+0000","last_clean":"2024-05-08T18:10:23.012608+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:10:23.012608+0000","last_undegraded":"2024-05-08T18:10:23.012608+0000","last_fullsized":"2024-05-08T18:10:23.012608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"90'6","reported_seq":209,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023645+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:10:23.023645+0000","last_peered":"2024-05-08T18:10:23.023645+0000","last_clean":"2024-05-08T18:10:23.023645+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:10:23.023645+0000","last_undegraded":"2024-05-08T18:10:23.023645+0000","last_fullsized":"2024-05-08T18:10:23.023645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007417+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:10:23.007417+0000","last_peered":"2024-05-08T18:10:23.007417+0000","last_clean":"2024-05-08T18:10:23.007417+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:10:23.007417+0000","last_undegraded":"2024-05-08T18:10:23.007417+0000","last_fullsized":"2024-05-08T18:10:23.007417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"101'17","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749372+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:10:23.749372+0000","last_peered":"2024-05-08T18:10:23.749372+0000","last_clean":"2024-05-08T18:10:23.749372+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:10:23.749372+0000","last_undegraded":"2024-05-08T18:10:23.749372+0000","last_fullsized":"2024-05-08T18:10:23.749372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":29,"num_read_kb":55314,"num_write":47,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015883+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:10:23.015883+0000","last_peered":"2024-05-08T18:10:23.015883+0000","last_clean":"2024-05-08T18:10:23.015883+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:10:23.015883+0000","last_undegraded":"2024-05-08T18:10:23.015883+0000","last_fullsized":"2024-05-08T18:10:23.015883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010992+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:10:23.010992+0000","last_peered":"2024-05-08T18:10:23.010992+0000","last_clean":"2024-05-08T18:10:23.010992+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:10:23.010992+0000","last_undegraded":"2024-05-08T18:10:23.010992+0000","last_fullsized":"2024-05-08T18:10:23.010992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022360+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:10:23.022360+0000","last_peered":"2024-05-08T18:10:23.022360+0000","last_clean":"2024-05-08T18:10:23.022360+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:10:23.022360+0000","last_undegraded":"2024-05-08T18:10:23.022360+0000","last_fullsized":"2024-05-08T18:10:23.022360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005558+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:10:23.005558+0000","last_peered":"2024-05-08T18:10:23.005558+0000","last_clean":"2024-05-08T18:10:23.005558+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:10:23.005558+0000","last_undegraded":"2024-05-08T18:10:23.005558+0000","last_fullsized":"2024-05-08T18:10:23.005558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'10","reported_seq":213,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023096+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:10:23.023096+0000","last_peered":"2024-05-08T18:10:23.023096+0000","last_clean":"2024-05-08T18:10:23.023096+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:10:23.023096+0000","last_undegraded":"2024-05-08T18:10:23.023096+0000","last_fullsized":"2024-05-08T18:10:23.023096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"94'7","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008067+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:10:23.008067+0000","last_peered":"2024-05-08T18:10:23.008067+0000","last_clean":"2024-05-08T18:10:23.008067+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:10:23.008067+0000","last_undegraded":"2024-05-08T18:10:23.008067+0000","last_fullsized":"2024-05-08T18:10:23.008067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":22528,"num_write":7,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":210,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023785+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:10:23.023785+0000","last_peered":"2024-05-08T18:10:23.023785+0000","last_clean":"2024-05-08T18:10:23.023785+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:10:23.023785+0000","last_undegraded":"2024-05-08T18:10:23.023785+0000","last_fullsized":"2024-05-08T18:10:23.023785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014445+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:10:23.014445+0000","last_peered":"2024-05-08T18:10:23.014445+0000","last_clean":"2024-05-08T18:10:23.014445+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:10:23.014445+0000","last_undegraded":"2024-05-08T18:10:23.014445+0000","last_fullsized":"2024-05-08T18:10:23.014445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"101'32","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015001+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:10:23.015001+0000","last_peered":"2024-05-08T18:10:23.015001+0000","last_clean":"2024-05-08T18:10:23.015001+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:10:23.015001+0000","last_undegraded":"2024-05-08T18:10:23.015001+0000","last_fullsized":"2024-05-08T18:10:23.015001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13755,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":66,"num_write":40,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748261+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:10:23.748261+0000","last_peered":"2024-05-08T18:10:23.748261+0000","last_clean":"2024-05-08T18:10:23.748261+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:10:23.748261+0000","last_undegraded":"2024-05-08T18:10:23.748261+0000","last_fullsized":"2024-05-08T18:10:23.748261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"90'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016164+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:10:23.016164+0000","last_peered":"2024-05-08T18:10:23.016164+0000","last_clean":"2024-05-08T18:10:23.016164+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:10:23.016164+0000","last_undegraded":"2024-05-08T18:10:23.016164+0000","last_fullsized":"2024-05-08T18:10:23.016164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"101'42","reported_seq":247,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015384+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:10:23.015384+0000","last_peered":"2024-05-08T18:10:23.015384+0000","last_clean":"2024-05-08T18:10:23.015384+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:10:23.015384+0000","last_undegraded":"2024-05-08T18:10:23.015384+0000","last_fullsized":"2024-05-08T18:10:23.015384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"101'11","reported_seq":226,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023617+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:10:23.023617+0000","last_peered":"2024-05-08T18:10:23.023617+0000","last_clean":"2024-05-08T18:10:23.023617+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:10:23.023617+0000","last_undegraded":"2024-05-08T18:10:23.023617+0000","last_fullsized":"2024-05-08T18:10:23.023617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676602+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:10:23.676602+0000","last_peered":"2024-05-08T18:10:23.676602+0000","last_clean":"2024-05-08T18:10:23.676602+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:10:23.676602+0000","last_undegraded":"2024-05-08T18:10:23.676602+0000","last_fullsized":"2024-05-08T18:10:23.676602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020771+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:10:23.020771+0000","last_peered":"2024-05-08T18:10:23.020771+0000","last_clean":"2024-05-08T18:10:23.020771+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:10:23.020771+0000","last_undegraded":"2024-05-08T18:10:23.020771+0000","last_fullsized":"2024-05-08T18:10:23.020771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":213,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022818+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:10:23.022818+0000","last_peered":"2024-05-08T18:10:23.022818+0000","last_clean":"2024-05-08T18:10:23.022818+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:10:23.022818+0000","last_undegraded":"2024-05-08T18:10:23.022818+0000","last_fullsized":"2024-05-08T18:10:23.022818+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"101'14","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006055+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:10:23.006055+0000","last_peered":"2024-05-08T18:10:23.006055+0000","last_clean":"2024-05-08T18:10:23.006055+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:10:23.006055+0000","last_undegraded":"2024-05-08T18:10:23.006055+0000","last_fullsized":"2024-05-08T18:10:23.006055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"101'4","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012889+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:10:23.012889+0000","last_peered":"2024-05-08T18:10:23.012889+0000","last_clean":"2024-05-08T18:10:23.012889+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:10:23.012889+0000","last_undegraded":"2024-05-08T18:10:23.012889+0000","last_fullsized":"2024-05-08T18:10:23.012889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008956+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:10:23.008956+0000","last_peered":"2024-05-08T18:10:23.008956+0000","last_clean":"2024-05-08T18:10:23.008956+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:10:23.008956+0000","last_undegraded":"2024-05-08T18:10:23.008956+0000","last_fullsized":"2024-05-08T18:10:23.008956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"101'10","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011790+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:10:23.011790+0000","last_peered":"2024-05-08T18:10:23.011790+0000","last_clean":"2024-05-08T18:10:23.011790+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:10:23.011790+0000","last_undegraded":"2024-05-08T18:10:23.011790+0000","last_fullsized":"2024-05-08T18:10:23.011790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":210,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.024732+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:10:23.024732+0000","last_peered":"2024-05-08T18:10:23.024732+0000","last_clean":"2024-05-08T18:10:23.024732+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:10:23.024732+0000","last_undegraded":"2024-05-08T18:10:23.024732+0000","last_fullsized":"2024-05-08T18:10:23.024732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747745+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:10:23.747745+0000","last_peered":"2024-05-08T18:10:23.747745+0000","last_clean":"2024-05-08T18:10:23.747745+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:10:23.747745+0000","last_undegraded":"2024-05-08T18:10:23.747745+0000","last_fullsized":"2024-05-08T18:10:23.747745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749424+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:10:23.749424+0000","last_peered":"2024-05-08T18:10:23.749424+0000","last_clean":"2024-05-08T18:10:23.749424+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:10:23.749424+0000","last_undegraded":"2024-05-08T18:10:23.749424+0000","last_fullsized":"2024-05-08T18:10:23.749424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"101'14","reported_seq":259,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014134+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:10:23.014134+0000","last_peered":"2024-05-08T18:10:23.014134+0000","last_clean":"2024-05-08T18:10:23.014134+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:10:23.014134+0000","last_undegraded":"2024-05-08T18:10:23.014134+0000","last_fullsized":"2024-05-08T18:10:23.014134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015918+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:10:23.015918+0000","last_peered":"2024-05-08T18:10:23.015918+0000","last_clean":"2024-05-08T18:10:23.015918+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:10:23.015918+0000","last_undegraded":"2024-05-08T18:10:23.015918+0000","last_fullsized":"2024-05-08T18:10:23.015918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748928+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:10:23.748928+0000","last_peered":"2024-05-08T18:10:23.748928+0000","last_clean":"2024-05-08T18:10:23.748928+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:10:23.748928+0000","last_undegraded":"2024-05-08T18:10:23.748928+0000","last_fullsized":"2024-05-08T18:10:23.748928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"101'17","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019599+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:10:23.019599+0000","last_peered":"2024-05-08T18:10:23.019599+0000","last_clean":"2024-05-08T18:10:23.019599+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:10:23.019599+0000","last_undegraded":"2024-05-08T18:10:23.019599+0000","last_fullsized":"2024-05-08T18:10:23.019599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":40996,"num_write":77,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023317+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:10:23.023317+0000","last_peered":"2024-05-08T18:10:23.023317+0000","last_clean":"2024-05-08T18:10:23.023317+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:10:23.023317+0000","last_undegraded":"2024-05-08T18:10:23.023317+0000","last_fullsized":"2024-05-08T18:10:23.023317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008711+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:10:23.008711+0000","last_peered":"2024-05-08T18:10:23.008711+0000","last_clean":"2024-05-08T18:10:23.008711+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:10:23.008711+0000","last_undegraded":"2024-05-08T18:10:23.008711+0000","last_fullsized":"2024-05-08T18:10:23.008711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"101'42","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674574+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:10:23.674574+0000","last_peered":"2024-05-08T18:10:23.674574+0000","last_clean":"2024-05-08T18:10:23.674574+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:10:23.674574+0000","last_undegraded":"2024-05-08T18:10:23.674574+0000","last_fullsized":"2024-05-08T18:10:23.674574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31839,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":73,"num_read_kb":101,"num_write":56,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010131+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:10:23.010131+0000","last_peered":"2024-05-08T18:10:23.010131+0000","last_clean":"2024-05-08T18:10:23.010131+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:10:23.010131+0000","last_undegraded":"2024-05-08T18:10:23.010131+0000","last_fullsized":"2024-05-08T18:10:23.010131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006701+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:10:23.006701+0000","last_peered":"2024-05-08T18:10:23.006701+0000","last_clean":"2024-05-08T18:10:23.006701+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:10:23.006701+0000","last_undegraded":"2024-05-08T18:10:23.006701+0000","last_fullsized":"2024-05-08T18:10:23.006701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016491+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:10:23.016491+0000","last_peered":"2024-05-08T18:10:23.016491+0000","last_clean":"2024-05-08T18:10:23.016491+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:10:23.016491+0000","last_undegraded":"2024-05-08T18:10:23.016491+0000","last_fullsized":"2024-05-08T18:10:23.016491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"101'34","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749025+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:10:23.749025+0000","last_peered":"2024-05-08T18:10:23.749025+0000","last_clean":"2024-05-08T18:10:23.749025+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:10:23.749025+0000","last_undegraded":"2024-05-08T18:10:23.749025+0000","last_fullsized":"2024-05-08T18:10:23.749025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"101'6","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749652+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:10:23.749652+0000","last_peered":"2024-05-08T18:10:23.749652+0000","last_clean":"2024-05-08T18:10:23.749652+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:10:23.749652+0000","last_undegraded":"2024-05-08T18:10:23.749652+0000","last_fullsized":"2024-05-08T18:10:23.749652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":196,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023166+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:10:23.023166+0000","last_peered":"2024-05-08T18:10:23.023166+0000","last_clean":"2024-05-08T18:10:23.023166+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:10:23.023166+0000","last_undegraded":"2024-05-08T18:10:23.023166+0000","last_fullsized":"2024-05-08T18:10:23.023166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"101'18","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008436+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:10:23.008436+0000","last_peered":"2024-05-08T18:10:23.008436+0000","last_clean":"2024-05-08T18:10:23.008436+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:10:23.008436+0000","last_undegraded":"2024-05-08T18:10:23.008436+0000","last_fullsized":"2024-05-08T18:10:23.008436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008394+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:10:23.008394+0000","last_peered":"2024-05-08T18:10:23.008394+0000","last_clean":"2024-05-08T18:10:23.008394+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:10:23.008394+0000","last_undegraded":"2024-05-08T18:10:23.008394+0000","last_fullsized":"2024-05-08T18:10:23.008394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010335+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:10:23.010335+0000","last_peered":"2024-05-08T18:10:23.010335+0000","last_clean":"2024-05-08T18:10:23.010335+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:10:23.010335+0000","last_undegraded":"2024-05-08T18:10:23.010335+0000","last_fullsized":"2024-05-08T18:10:23.010335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":200,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023006+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:10:23.023006+0000","last_peered":"2024-05-08T18:10:23.023006+0000","last_clean":"2024-05-08T18:10:23.023006+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:10:23.023006+0000","last_undegraded":"2024-05-08T18:10:23.023006+0000","last_fullsized":"2024-05-08T18:10:23.023006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"101'16","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676106+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:10:23.676106+0000","last_peered":"2024-05-08T18:10:23.676106+0000","last_clean":"2024-05-08T18:10:23.676106+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:10:23.676106+0000","last_undegraded":"2024-05-08T18:10:23.676106+0000","last_fullsized":"2024-05-08T18:10:23.676106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":47128,"num_write":56,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012366+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:10:23.012366+0000","last_peered":"2024-05-08T18:10:23.012366+0000","last_clean":"2024-05-08T18:10:23.012366+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:10:23.012366+0000","last_undegraded":"2024-05-08T18:10:23.012366+0000","last_fullsized":"2024-05-08T18:10:23.012366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"48'5","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015264+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:10:23.015264+0000","last_peered":"2024-05-08T18:10:23.015264+0000","last_clean":"2024-05-08T18:10:23.015264+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:10:23.015264+0000","last_undegraded":"2024-05-08T18:10:23.015264+0000","last_fullsized":"2024-05-08T18:10:23.015264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674157+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:10:23.674157+0000","last_peered":"2024-05-08T18:10:23.674157+0000","last_clean":"2024-05-08T18:10:23.674157+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:10:23.674157+0000","last_undegraded":"2024-05-08T18:10:23.674157+0000","last_fullsized":"2024-05-08T18:10:23.674157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"90'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015893+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:10:23.015893+0000","last_peered":"2024-05-08T18:10:23.015893+0000","last_clean":"2024-05-08T18:10:23.015893+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:10:23.015893+0000","last_undegraded":"2024-05-08T18:10:23.015893+0000","last_fullsized":"2024-05-08T18:10:23.015893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009605+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:10:23.009605+0000","last_peered":"2024-05-08T18:10:23.009605+0000","last_clean":"2024-05-08T18:10:23.009605+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:10:23.009605+0000","last_undegraded":"2024-05-08T18:10:23.009605+0000","last_fullsized":"2024-05-08T18:10:23.009605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"101'15","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008271+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:10:23.008271+0000","last_peered":"2024-05-08T18:10:23.008271+0000","last_clean":"2024-05-08T18:10:23.008271+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:10:23.008271+0000","last_undegraded":"2024-05-08T18:10:23.008271+0000","last_fullsized":"2024-05-08T18:10:23.008271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":47122,"num_write":45,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673614+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:10:23.673614+0000","last_peered":"2024-05-08T18:10:23.673614+0000","last_clean":"2024-05-08T18:10:23.673614+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:10:23.673614+0000","last_undegraded":"2024-05-08T18:10:23.673614+0000","last_fullsized":"2024-05-08T18:10:23.673614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"101'16","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011817+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:10:23.011817+0000","last_peered":"2024-05-08T18:10:23.011817+0000","last_clean":"2024-05-08T18:10:23.011817+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:10:23.011817+0000","last_undegraded":"2024-05-08T18:10:23.011817+0000","last_fullsized":"2024-05-08T18:10:23.011817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020690+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:10:23.020690+0000","last_peered":"2024-05-08T18:10:23.020690+0000","last_clean":"2024-05-08T18:10:23.020690+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:10:23.020690+0000","last_undegraded":"2024-05-08T18:10:23.020690+0000","last_fullsized":"2024-05-08T18:10:23.020690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006544+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:10:23.006544+0000","last_peered":"2024-05-08T18:10:23.006544+0000","last_clean":"2024-05-08T18:10:23.006544+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:10:23.006544+0000","last_undegraded":"2024-05-08T18:10:23.006544+0000","last_fullsized":"2024-05-08T18:10:23.006544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009195+0000","last_change":"2024-05-08T18:07:55.359230+0000","last_active":"2024-05-08T18:10:23.009195+0000","last_peered":"2024-05-08T18:10:23.009195+0000","last_clean":"2024-05-08T18:10:23.009195+0000","last_became_active":"2024-05-08T18:07:55.358047+0000","last_became_peered":"2024-05-08T18:07:55.358047+0000","last_unstale":"2024-05-08T18:10:23.009195+0000","last_undegraded":"2024-05-08T18:10:23.009195+0000","last_fullsized":"2024-05-08T18:10:23.009195+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:52.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018330+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:10:23.018330+0000","last_peered":"2024-05-08T18:10:23.018330+0000","last_clean":"2024-05-08T18:10:23.018330+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:10:23.018330+0000","last_undegraded":"2024-05-08T18:10:23.018330+0000","last_fullsized":"2024-05-08T18:10:23.018330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020607+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:10:23.020607+0000","last_peered":"2024-05-08T18:10:23.020607+0000","last_clean":"2024-05-08T18:10:23.020607+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:10:23.020607+0000","last_undegraded":"2024-05-08T18:10:23.020607+0000","last_fullsized":"2024-05-08T18:10:23.020607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"101'15","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674190+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:10:23.674190+0000","last_peered":"2024-05-08T18:10:23.674190+0000","last_clean":"2024-05-08T18:10:23.674190+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:10:23.674190+0000","last_undegraded":"2024-05-08T18:10:23.674190+0000","last_fullsized":"2024-05-08T18:10:23.674190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013395+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:10:23.013395+0000","last_peered":"2024-05-08T18:10:23.013395+0000","last_clean":"2024-05-08T18:10:23.013395+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:10:23.013395+0000","last_undegraded":"2024-05-08T18:10:23.013395+0000","last_fullsized":"2024-05-08T18:10:23.013395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022955+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:10:23.022955+0000","last_peered":"2024-05-08T18:10:23.022955+0000","last_clean":"2024-05-08T18:10:23.022955+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:10:23.022955+0000","last_undegraded":"2024-05-08T18:10:23.022955+0000","last_fullsized":"2024-05-08T18:10:23.022955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009453+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:10:23.009453+0000","last_peered":"2024-05-08T18:10:23.009453+0000","last_clean":"2024-05-08T18:10:23.009453+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:10:23.009453+0000","last_undegraded":"2024-05-08T18:10:23.009453+0000","last_fullsized":"2024-05-08T18:10:23.009453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":208,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019005+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:10:23.019005+0000","last_peered":"2024-05-08T18:10:23.019005+0000","last_clean":"2024-05-08T18:10:23.019005+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:10:23.019005+0000","last_undegraded":"2024-05-08T18:10:23.019005+0000","last_fullsized":"2024-05-08T18:10:23.019005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"101'24","reported_seq":227,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023971+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:10:23.023971+0000","last_peered":"2024-05-08T18:10:23.023971+0000","last_clean":"2024-05-08T18:10:23.023971+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:10:23.023971+0000","last_undegraded":"2024-05-08T18:10:23.023971+0000","last_fullsized":"2024-05-08T18:10:23.023971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12641,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":50,"num_write":30,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007070+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:10:23.007070+0000","last_peered":"2024-05-08T18:10:23.007070+0000","last_clean":"2024-05-08T18:10:23.007070+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:10:23.007070+0000","last_undegraded":"2024-05-08T18:10:23.007070+0000","last_fullsized":"2024-05-08T18:10:23.007070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011163+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:10:23.011163+0000","last_peered":"2024-05-08T18:10:23.011163+0000","last_clean":"2024-05-08T18:10:23.011163+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:10:23.011163+0000","last_undegraded":"2024-05-08T18:10:23.011163+0000","last_fullsized":"2024-05-08T18:10:23.011163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019138+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:10:23.019138+0000","last_peered":"2024-05-08T18:10:23.019138+0000","last_clean":"2024-05-08T18:10:23.019138+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:10:23.019138+0000","last_undegraded":"2024-05-08T18:10:23.019138+0000","last_fullsized":"2024-05-08T18:10:23.019138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"91'3","reported_seq":210,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023654+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:10:23.023654+0000","last_peered":"2024-05-08T18:10:23.023654+0000","last_clean":"2024-05-08T18:10:23.023654+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:10:23.023654+0000","last_undegraded":"2024-05-08T18:10:23.023654+0000","last_fullsized":"2024-05-08T18:10:23.023654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":196,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022596+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:10:23.022596+0000","last_peered":"2024-05-08T18:10:23.022596+0000","last_clean":"2024-05-08T18:10:23.022596+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:10:23.022596+0000","last_undegraded":"2024-05-08T18:10:23.022596+0000","last_fullsized":"2024-05-08T18:10:23.022596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"101'18","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674600+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:10:23.674600+0000","last_peered":"2024-05-08T18:10:23.674600+0000","last_clean":"2024-05-08T18:10:23.674600+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:10:23.674600+0000","last_undegraded":"2024-05-08T18:10:23.674600+0000","last_fullsized":"2024-05-08T18:10:23.674600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":188,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.024037+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:10:23.024037+0000","last_peered":"2024-05-08T18:10:23.024037+0000","last_clean":"2024-05-08T18:10:23.024037+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:10:23.024037+0000","last_undegraded":"2024-05-08T18:10:23.024037+0000","last_fullsized":"2024-05-08T18:10:23.024037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020215+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:10:23.020215+0000","last_peered":"2024-05-08T18:10:23.020215+0000","last_clean":"2024-05-08T18:10:23.020215+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:10:23.020215+0000","last_undegraded":"2024-05-08T18:10:23.020215+0000","last_fullsized":"2024-05-08T18:10:23.020215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010027+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:10:23.010027+0000","last_peered":"2024-05-08T18:10:23.010027+0000","last_clean":"2024-05-08T18:10:23.010027+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:10:23.010027+0000","last_undegraded":"2024-05-08T18:10:23.010027+0000","last_fullsized":"2024-05-08T18:10:23.010027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"101'6","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749937+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:10:23.749937+0000","last_peered":"2024-05-08T18:10:23.749937+0000","last_clean":"2024-05-08T18:10:23.749937+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:10:23.749937+0000","last_undegraded":"2024-05-08T18:10:23.749937+0000","last_fullsized":"2024-05-08T18:10:23.749937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747838+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:10:23.747838+0000","last_peered":"2024-05-08T18:10:23.747838+0000","last_clean":"2024-05-08T18:10:23.747838+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:10:23.747838+0000","last_undegraded":"2024-05-08T18:10:23.747838+0000","last_fullsized":"2024-05-08T18:10:23.747838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"101'15","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013244+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:10:23.013244+0000","last_peered":"2024-05-08T18:10:23.013244+0000","last_clean":"2024-05-08T18:10:23.013244+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:10:23.013244+0000","last_undegraded":"2024-05-08T18:10:23.013244+0000","last_fullsized":"2024-05-08T18:10:23.013244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":188,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.024168+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:10:23.024168+0000","last_peered":"2024-05-08T18:10:23.024168+0000","last_clean":"2024-05-08T18:10:23.024168+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:10:23.024168+0000","last_undegraded":"2024-05-08T18:10:23.024168+0000","last_fullsized":"2024-05-08T18:10:23.024168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005943+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:10:23.005943+0000","last_peered":"2024-05-08T18:10:23.005943+0000","last_clean":"2024-05-08T18:10:23.005943+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:10:23.005943+0000","last_undegraded":"2024-05-08T18:10:23.005943+0000","last_fullsized":"2024-05-08T18:10:23.005943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"90'6","reported_seq":211,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:22.001006+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:10:22.001006+0000","last_peered":"2024-05-08T18:10:22.001006+0000","last_clean":"2024-05-08T18:10:22.001006+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:10:22.001006+0000","last_undegraded":"2024-05-08T18:10:22.001006+0000","last_fullsized":"2024-05-08T18:10:22.001006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"94'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013712+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:10:23.013712+0000","last_peered":"2024-05-08T18:10:23.013712+0000","last_clean":"2024-05-08T18:10:23.013712+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:10:23.013712+0000","last_undegraded":"2024-05-08T18:10:23.013712+0000","last_fullsized":"2024-05-08T18:10:23.013712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":38912,"num_write":11,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":196,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.024294+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:10:23.024294+0000","last_peered":"2024-05-08T18:10:23.024294+0000","last_clean":"2024-05-08T18:10:23.024294+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:10:23.024294+0000","last_undegraded":"2024-05-08T18:10:23.024294+0000","last_fullsized":"2024-05-08T18:10:23.024294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"91'11","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750421+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:10:23.750421+0000","last_peered":"2024-05-08T18:10:23.750421+0000","last_clean":"2024-05-08T18:10:23.750421+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:10:23.750421+0000","last_undegraded":"2024-05-08T18:10:23.750421+0000","last_fullsized":"2024-05-08T18:10:23.750421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"101'14","reported_seq":249,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021936+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:10:23.021936+0000","last_peered":"2024-05-08T18:10:23.021936+0000","last_clean":"2024-05-08T18:10:23.021936+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:10:23.021936+0000","last_undegraded":"2024-05-08T18:10:23.021936+0000","last_fullsized":"2024-05-08T18:10:23.021936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"101'6","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673614+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:10:23.673614+0000","last_peered":"2024-05-08T18:10:23.673614+0000","last_clean":"2024-05-08T18:10:23.673614+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:10:23.673614+0000","last_undegraded":"2024-05-08T18:10:23.673614+0000","last_fullsized":"2024-05-08T18:10:23.673614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748762+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:10:23.748762+0000","last_peered":"2024-05-08T18:10:23.748762+0000","last_clean":"2024-05-08T18:10:23.748762+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:10:23.748762+0000","last_undegraded":"2024-05-08T18:10:23.748762+0000","last_fullsized":"2024-05-08T18:10:23.748762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"101'9","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007512+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:10:23.007512+0000","last_peered":"2024-05-08T18:10:23.007512+0000","last_clean":"2024-05-08T18:10:23.007512+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:10:23.007512+0000","last_undegraded":"2024-05-08T18:10:23.007512+0000","last_fullsized":"2024-05-08T18:10:23.007512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":24594,"num_write":39,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674308+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:10:23.674308+0000","last_peered":"2024-05-08T18:10:23.674308+0000","last_clean":"2024-05-08T18:10:23.674308+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:10:23.674308+0000","last_undegraded":"2024-05-08T18:10:23.674308+0000","last_fullsized":"2024-05-08T18:10:23.674308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"101'19","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006220+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:10:23.006220+0000","last_peered":"2024-05-08T18:10:23.006220+0000","last_clean":"2024-05-08T18:10:23.006220+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:10:23.006220+0000","last_undegraded":"2024-05-08T18:10:23.006220+0000","last_fullsized":"2024-05-08T18:10:23.006220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5206,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014002+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:10:23.014002+0000","last_peered":"2024-05-08T18:10:23.014002+0000","last_clean":"2024-05-08T18:10:23.014002+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:10:23.014002+0000","last_undegraded":"2024-05-08T18:10:23.014002+0000","last_fullsized":"2024-05-08T18:10:23.014002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"101'2","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676327+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:10:23.676327+0000","last_peered":"2024-05-08T18:10:23.676327+0000","last_clean":"2024-05-08T18:10:23.676327+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:10:23.676327+0000","last_undegraded":"2024-05-08T18:10:23.676327+0000","last_fullsized":"2024-05-08T18:10:23.676327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749701+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:10:23.749701+0000","last_peered":"2024-05-08T18:10:23.749701+0000","last_clean":"2024-05-08T18:10:23.749701+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:10:23.749701+0000","last_undegraded":"2024-05-08T18:10:23.749701+0000","last_fullsized":"2024-05-08T18:10:23.749701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"93'4","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007831+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:10:23.007831+0000","last_peered":"2024-05-08T18:10:23.007831+0000","last_clean":"2024-05-08T18:10:23.007831+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:10:23.007831+0000","last_undegraded":"2024-05-08T18:10:23.007831+0000","last_fullsized":"2024-05-08T18:10:23.007831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006829+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:10:23.006829+0000","last_peered":"2024-05-08T18:10:23.006829+0000","last_clean":"2024-05-08T18:10:23.006829+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:10:23.006829+0000","last_undegraded":"2024-05-08T18:10:23.006829+0000","last_fullsized":"2024-05-08T18:10:23.006829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"101'16","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014381+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:10:23.014381+0000","last_peered":"2024-05-08T18:10:23.014381+0000","last_clean":"2024-05-08T18:10:23.014381+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:10:23.014381+0000","last_undegraded":"2024-05-08T18:10:23.014381+0000","last_fullsized":"2024-05-08T18:10:23.014381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020141+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:10:23.020141+0000","last_peered":"2024-05-08T18:10:23.020141+0000","last_clean":"2024-05-08T18:10:23.020141+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:10:23.020141+0000","last_undegraded":"2024-05-08T18:10:23.020141+0000","last_fullsized":"2024-05-08T18:10:23.020141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010595+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:10:23.010595+0000","last_peered":"2024-05-08T18:10:23.010595+0000","last_clean":"2024-05-08T18:10:23.010595+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:10:23.010595+0000","last_undegraded":"2024-05-08T18:10:23.010595+0000","last_fullsized":"2024-05-08T18:10:23.010595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010032+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:10:23.010032+0000","last_peered":"2024-05-08T18:10:23.010032+0000","last_clean":"2024-05-08T18:10:23.010032+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:10:23.010032+0000","last_undegraded":"2024-05-08T18:10:23.010032+0000","last_fullsized":"2024-05-08T18:10:23.010032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"93'10","reported_seq":170,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.024140+0000","last_change":"2024-05-08T18:07:55.439856+0000","last_active":"2024-05-08T18:10:23.024140+0000","last_peered":"2024-05-08T18:10:23.024140+0000","last_clean":"2024-05-08T18:10:23.024140+0000","last_became_active":"2024-05-08T18:07:55.439188+0000","last_became_peered":"2024-05-08T18:07:55.439188+0000","last_unstale":"2024-05-08T18:10:23.024140+0000","last_undegraded":"2024-05-08T18:10:23.024140+0000","last_fullsized":"2024-05-08T18:10:23.024140+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:40.273251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":10,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747721+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:10:23.747721+0000","last_peered":"2024-05-08T18:10:23.747721+0000","last_clean":"2024-05-08T18:10:23.747721+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:10:23.747721+0000","last_undegraded":"2024-05-08T18:10:23.747721+0000","last_fullsized":"2024-05-08T18:10:23.747721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"101'10","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013755+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:10:23.013755+0000","last_peered":"2024-05-08T18:10:23.013755+0000","last_clean":"2024-05-08T18:10:23.013755+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:10:23.013755+0000","last_undegraded":"2024-05-08T18:10:23.013755+0000","last_fullsized":"2024-05-08T18:10:23.013755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10810,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":19,"num_write":12,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748565+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:10:23.748565+0000","last_peered":"2024-05-08T18:10:23.748565+0000","last_clean":"2024-05-08T18:10:23.748565+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:10:23.748565+0000","last_undegraded":"2024-05-08T18:10:23.748565+0000","last_fullsized":"2024-05-08T18:10:23.748565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675169+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:10:23.675169+0000","last_peered":"2024-05-08T18:10:23.675169+0000","last_clean":"2024-05-08T18:10:23.675169+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:10:23.675169+0000","last_undegraded":"2024-05-08T18:10:23.675169+0000","last_fullsized":"2024-05-08T18:10:23.675169+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748961+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:10:23.748961+0000","last_peered":"2024-05-08T18:10:23.748961+0000","last_clean":"2024-05-08T18:10:23.748961+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:10:23.748961+0000","last_undegraded":"2024-05-08T18:10:23.748961+0000","last_fullsized":"2024-05-08T18:10:23.748961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017974+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:10:23.017974+0000","last_peered":"2024-05-08T18:10:23.017974+0000","last_clean":"2024-05-08T18:10:23.017974+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:10:23.017974+0000","last_undegraded":"2024-05-08T18:10:23.017974+0000","last_fullsized":"2024-05-08T18:10:23.017974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":197,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022958+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:10:23.022958+0000","last_peered":"2024-05-08T18:10:23.022958+0000","last_clean":"2024-05-08T18:10:23.022958+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:10:23.022958+0000","last_undegraded":"2024-05-08T18:10:23.022958+0000","last_fullsized":"2024-05-08T18:10:23.022958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"101'14","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748818+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:10:23.748818+0000","last_peered":"2024-05-08T18:10:23.748818+0000","last_clean":"2024-05-08T18:10:23.748818+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:10:23.748818+0000","last_undegraded":"2024-05-08T18:10:23.748818+0000","last_fullsized":"2024-05-08T18:10:23.748818+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013086+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:10:23.013086+0000","last_peered":"2024-05-08T18:10:23.013086+0000","last_clean":"2024-05-08T18:10:23.013086+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:10:23.013086+0000","last_undegraded":"2024-05-08T18:10:23.013086+0000","last_fullsized":"2024-05-08T18:10:23.013086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751046+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:10:23.751046+0000","last_peered":"2024-05-08T18:10:23.751046+0000","last_clean":"2024-05-08T18:10:23.751046+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:10:23.751046+0000","last_undegraded":"2024-05-08T18:10:23.751046+0000","last_fullsized":"2024-05-08T18:10:23.751046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"101'36","reported_seq":242,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.024867+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:10:23.024867+0000","last_peered":"2024-05-08T18:10:23.024867+0000","last_clean":"2024-05-08T18:10:23.024867+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:10:23.024867+0000","last_undegraded":"2024-05-08T18:10:23.024867+0000","last_fullsized":"2024-05-08T18:10:23.024867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":91,"num_write":52,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"101'18","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019864+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:10:23.019864+0000","last_peered":"2024-05-08T18:10:23.019864+0000","last_clean":"2024-05-08T18:10:23.019864+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:10:23.019864+0000","last_undegraded":"2024-05-08T18:10:23.019864+0000","last_fullsized":"2024-05-08T18:10:23.019864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":47134,"num_write":68,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":200,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.024530+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:10:23.024530+0000","last_peered":"2024-05-08T18:10:23.024530+0000","last_clean":"2024-05-08T18:10:23.024530+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:10:23.024530+0000","last_undegraded":"2024-05-08T18:10:23.024530+0000","last_fullsized":"2024-05-08T18:10:23.024530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"101'9","reported_seq":224,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:21.996027+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:10:21.996027+0000","last_peered":"2024-05-08T18:10:21.996027+0000","last_clean":"2024-05-08T18:10:21.996027+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:10:21.996027+0000","last_undegraded":"2024-05-08T18:10:21.996027+0000","last_fullsized":"2024-05-08T18:10:21.996027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":26630,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007320+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:10:23.007320+0000","last_peered":"2024-05-08T18:10:23.007320+0000","last_clean":"2024-05-08T18:10:23.007320+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:10:23.007320+0000","last_undegraded":"2024-05-08T18:10:23.007320+0000","last_fullsized":"2024-05-08T18:10:23.007320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007247+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:10:23.007247+0000","last_peered":"2024-05-08T18:10:23.007247+0000","last_clean":"2024-05-08T18:10:23.007247+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:10:23.007247+0000","last_undegraded":"2024-05-08T18:10:23.007247+0000","last_fullsized":"2024-05-08T18:10:23.007247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":200,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023781+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:10:23.023781+0000","last_peered":"2024-05-08T18:10:23.023781+0000","last_clean":"2024-05-08T18:10:23.023781+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:10:23.023781+0000","last_undegraded":"2024-05-08T18:10:23.023781+0000","last_fullsized":"2024-05-08T18:10:23.023781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"101'5","reported_seq":216,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014337+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:10:23.014337+0000","last_peered":"2024-05-08T18:10:23.014337+0000","last_clean":"2024-05-08T18:10:23.014337+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:10:23.014337+0000","last_undegraded":"2024-05-08T18:10:23.014337+0000","last_fullsized":"2024-05-08T18:10:23.014337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":16390,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012990+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:10:23.012990+0000","last_peered":"2024-05-08T18:10:23.012990+0000","last_clean":"2024-05-08T18:10:23.012990+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:10:23.012990+0000","last_undegraded":"2024-05-08T18:10:23.012990+0000","last_fullsized":"2024-05-08T18:10:23.012990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011842+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:10:23.011842+0000","last_peered":"2024-05-08T18:10:23.011842+0000","last_clean":"2024-05-08T18:10:23.011842+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:10:23.011842+0000","last_undegraded":"2024-05-08T18:10:23.011842+0000","last_fullsized":"2024-05-08T18:10:23.011842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749915+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:10:23.749915+0000","last_peered":"2024-05-08T18:10:23.749915+0000","last_clean":"2024-05-08T18:10:23.749915+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:10:23.749915+0000","last_undegraded":"2024-05-08T18:10:23.749915+0000","last_fullsized":"2024-05-08T18:10:23.749915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"101'11","reported_seq":226,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.024545+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:10:23.024545+0000","last_peered":"2024-05-08T18:10:23.024545+0000","last_clean":"2024-05-08T18:10:23.024545+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:10:23.024545+0000","last_undegraded":"2024-05-08T18:10:23.024545+0000","last_fullsized":"2024-05-08T18:10:23.024545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":32786,"num_write":41,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"101'40","reported_seq":251,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009330+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:10:23.009330+0000","last_peered":"2024-05-08T18:10:23.009330+0000","last_clean":"2024-05-08T18:10:23.009330+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:10:23.009330+0000","last_undegraded":"2024-05-08T18:10:23.009330+0000","last_fullsized":"2024-05-08T18:10:23.009330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":102,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"101'9","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022073+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:10:23.022073+0000","last_peered":"2024-05-08T18:10:23.022073+0000","last_clean":"2024-05-08T18:10:23.022073+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:10:23.022073+0000","last_undegraded":"2024-05-08T18:10:23.022073+0000","last_fullsized":"2024-05-08T18:10:23.022073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"90'12","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019735+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:10:23.019735+0000","last_peered":"2024-05-08T18:10:23.019735+0000","last_clean":"2024-05-08T18:10:23.019735+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:10:23.019735+0000","last_undegraded":"2024-05-08T18:10:23.019735+0000","last_fullsized":"2024-05-08T18:10:23.019735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"91'3","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012624+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:10:23.012624+0000","last_peered":"2024-05-08T18:10:23.012624+0000","last_clean":"2024-05-08T18:10:23.012624+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:10:23.012624+0000","last_undegraded":"2024-05-08T18:10:23.012624+0000","last_fullsized":"2024-05-08T18:10:23.012624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017633+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:10:23.017633+0000","last_peered":"2024-05-08T18:10:23.017633+0000","last_clean":"2024-05-08T18:10:23.017633+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:10:23.017633+0000","last_undegraded":"2024-05-08T18:10:23.017633+0000","last_fullsized":"2024-05-08T18:10:23.017633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"101'18","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006664+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:10:23.006664+0000","last_peered":"2024-05-08T18:10:23.006664+0000","last_clean":"2024-05-08T18:10:23.006664+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:10:23.006664+0000","last_undegraded":"2024-05-08T18:10:23.006664+0000","last_fullsized":"2024-05-08T18:10:23.006664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":30,"num_read_kb":55314,"num_write":48,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750654+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:10:23.750654+0000","last_peered":"2024-05-08T18:10:23.750654+0000","last_clean":"2024-05-08T18:10:23.750654+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:10:23.750654+0000","last_undegraded":"2024-05-08T18:10:23.750654+0000","last_fullsized":"2024-05-08T18:10:23.750654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"101'8","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010297+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:10:23.010297+0000","last_peered":"2024-05-08T18:10:23.010297+0000","last_clean":"2024-05-08T18:10:23.010297+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:10:23.010297+0000","last_undegraded":"2024-05-08T18:10:23.010297+0000","last_fullsized":"2024-05-08T18:10:23.010297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":202,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:22.001276+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:10:22.001276+0000","last_peered":"2024-05-08T18:10:22.001276+0000","last_clean":"2024-05-08T18:10:22.001276+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:10:22.001276+0000","last_undegraded":"2024-05-08T18:10:22.001276+0000","last_fullsized":"2024-05-08T18:10:22.001276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"94'7","reported_seq":166,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:21.996447+0000","last_change":"2024-05-08T18:07:55.445745+0000","last_active":"2024-05-08T18:10:21.996447+0000","last_peered":"2024-05-08T18:10:21.996447+0000","last_clean":"2024-05-08T18:10:21.996447+0000","last_became_active":"2024-05-08T18:07:55.444935+0000","last_became_peered":"2024-05-08T18:07:55.444935+0000","last_unstale":"2024-05-08T18:10:21.996447+0000","last_undegraded":"2024-05-08T18:10:21.996447+0000","last_fullsized":"2024-05-08T18:10:21.996447+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:37.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":22528,"num_write":7,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750539+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:10:23.750539+0000","last_peered":"2024-05-08T18:10:23.750539+0000","last_clean":"2024-05-08T18:10:23.750539+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:10:23.750539+0000","last_undegraded":"2024-05-08T18:10:23.750539+0000","last_fullsized":"2024-05-08T18:10:23.750539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"94'6","reported_seq":218,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014718+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:10:23.014718+0000","last_peered":"2024-05-08T18:10:23.014718+0000","last_clean":"2024-05-08T18:10:23.014718+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:10:23.014718+0000","last_undegraded":"2024-05-08T18:10:23.014718+0000","last_fullsized":"2024-05-08T18:10:23.014718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":16390,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674975+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:10:23.674975+0000","last_peered":"2024-05-08T18:10:23.674975+0000","last_clean":"2024-05-08T18:10:23.674975+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:10:23.674975+0000","last_undegraded":"2024-05-08T18:10:23.674975+0000","last_fullsized":"2024-05-08T18:10:23.674975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"101'9","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021427+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:10:23.021427+0000","last_peered":"2024-05-08T18:10:23.021427+0000","last_clean":"2024-05-08T18:10:23.021427+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:10:23.021427+0000","last_undegraded":"2024-05-08T18:10:23.021427+0000","last_fullsized":"2024-05-08T18:10:23.021427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012285+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:10:23.012285+0000","last_peered":"2024-05-08T18:10:23.012285+0000","last_clean":"2024-05-08T18:10:23.012285+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:10:23.012285+0000","last_undegraded":"2024-05-08T18:10:23.012285+0000","last_fullsized":"2024-05-08T18:10:23.012285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676538+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:10:23.676538+0000","last_peered":"2024-05-08T18:10:23.676538+0000","last_clean":"2024-05-08T18:10:23.676538+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:10:23.676538+0000","last_undegraded":"2024-05-08T18:10:23.676538+0000","last_fullsized":"2024-05-08T18:10:23.676538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":26648,"num_write":51,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"101'46","reported_seq":254,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009047+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:10:23.009047+0000","last_peered":"2024-05-08T18:10:23.009047+0000","last_clean":"2024-05-08T18:10:23.009047+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:10:23.009047+0000","last_undegraded":"2024-05-08T18:10:23.009047+0000","last_fullsized":"2024-05-08T18:10:23.009047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"94'11","reported_seq":228,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:22.001754+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:10:22.001754+0000","last_peered":"2024-05-08T18:10:22.001754+0000","last_clean":"2024-05-08T18:10:22.001754+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:10:22.001754+0000","last_undegraded":"2024-05-08T18:10:22.001754+0000","last_fullsized":"2024-05-08T18:10:22.001754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":45056,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674057+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:10:23.674057+0000","last_peered":"2024-05-08T18:10:23.674057+0000","last_clean":"2024-05-08T18:10:23.674057+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:10:23.674057+0000","last_undegraded":"2024-05-08T18:10:23.674057+0000","last_fullsized":"2024-05-08T18:10:23.674057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"101'9","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008938+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:10:23.008938+0000","last_peered":"2024-05-08T18:10:23.008938+0000","last_clean":"2024-05-08T18:10:23.008938+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:10:23.008938+0000","last_undegraded":"2024-05-08T18:10:23.008938+0000","last_fullsized":"2024-05-08T18:10:23.008938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":26630,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"101'14","reported_seq":234,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006573+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:10:23.006573+0000","last_peered":"2024-05-08T18:10:23.006573+0000","last_clean":"2024-05-08T18:10:23.006573+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:10:23.006573+0000","last_undegraded":"2024-05-08T18:10:23.006573+0000","last_fullsized":"2024-05-08T18:10:23.006573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":18,"num_read_kb":43014,"num_write":24,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017327+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:10:23.017327+0000","last_peered":"2024-05-08T18:10:23.017327+0000","last_clean":"2024-05-08T18:10:23.017327+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:10:23.017327+0000","last_undegraded":"2024-05-08T18:10:23.017327+0000","last_fullsized":"2024-05-08T18:10:23.017327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"101'12","reported_seq":228,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023530+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:10:23.023530+0000","last_peered":"2024-05-08T18:10:23.023530+0000","last_clean":"2024-05-08T18:10:23.023530+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:10:23.023530+0000","last_undegraded":"2024-05-08T18:10:23.023530+0000","last_fullsized":"2024-05-08T18:10:23.023530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":40966,"num_write":22,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008111+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:10:23.008111+0000","last_peered":"2024-05-08T18:10:23.008111+0000","last_clean":"2024-05-08T18:10:23.008111+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:10:23.008111+0000","last_undegraded":"2024-05-08T18:10:23.008111+0000","last_fullsized":"2024-05-08T18:10:23.008111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":242921,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":927,"num_read_kb":920,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":230738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575,"ondisk_log_size":575,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1100,"num_read_kb":2048660,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":446976,"kb_used_data":415792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93924864,"statfs":{"total":96636764160,"available":96179060736,"internally_reserved":0,"allocated":425771008,"data_stored":425096901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":331656,"kb_used_data":300476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94040184,"statfs":{"total":96636764160,"available":96297148416,"internally_reserved":0,"allocated":307687424,"data_stored":307055531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":536544,"kb_used_data":505356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93835296,"statfs":{"total":96636764160,"available":96087343104,"internally_reserved":0,"allocated":517484544,"data_stored":516790953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487260,"kb_used_data":456076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93884580,"statfs":{"total":96636764160,"available":96137809920,"internally_reserved":0,"allocated":467021824,"data_stored":466416579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":524200,"kb_used_data":493016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93847640,"statfs":{"total":96636764160,"available":96099983360,"internally_reserved":0,"allocated":504848384,"data_stored":504193220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":317276,"kb_used_data":286092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94054564,"statfs":{"total":96636764160,"available":96311873536,"internally_reserved":0,"allocated":292958208,"data_stored":292353146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303016,"kb_used_data":271832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94068824,"statfs":{"total":96636764160,"available":96326475776,"internally_reserved":0,"allocated":278355968,"data_stored":277712873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":510420,"kb_used_data":479240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93861420,"statfs":{"total":96636764160,"available":96114094080,"internally_reserved":0,"allocated":490741760,"data_stored":490101965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":488636416,"data_stored":488636416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":276824064,"data_stored":276824064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":291504128,"data_stored":291504128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":503316480,"data_stored":503316480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":465567744,"data_stored":465567744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":515899392,"data_stored":515899392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":306184192,"data_stored":306184192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":423624704,"data_stored":423624704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":27109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":49062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":9271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":29104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":42748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":23703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":41692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:10:27.695 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:10:28.020 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:10:28.029 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:10:28.043 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-05-08T18:10:27.725306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636613462,"num_objects":637,"num_object_clones":0,"num_object_copies":1274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":3825,"num_read_kb":2050946,"num_write":3270,"num_write_kb":2050294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1933,"ondisk_log_size":1933,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3457396,"kb_used_data":3207928,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":751517324,"statfs":{"total":773094113280,"available":769553739776,"internally_reserved":0,"allocated":3284918272,"data_stored":3279752908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.749404"},"pg_stats":[{"pgid":"3.3f","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676116+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:10:23.676116+0000","last_peered":"2024-05-08T18:10:23.676116+0000","last_clean":"2024-05-08T18:10:23.676116+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:10:23.676116+0000","last_undegraded":"2024-05-08T18:10:23.676116+0000","last_fullsized":"2024-05-08T18:10:23.676116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":34822,"num_write":21,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005921+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:10:23.005921+0000","last_peered":"2024-05-08T18:10:23.005921+0000","last_clean":"2024-05-08T18:10:23.005921+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:10:23.005921+0000","last_undegraded":"2024-05-08T18:10:23.005921+0000","last_fullsized":"2024-05-08T18:10:23.005921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"93'7","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.254012+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:10:24.254012+0000","last_peered":"2024-05-08T18:10:24.254012+0000","last_clean":"2024-05-08T18:10:24.254012+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:10:24.254012+0000","last_undegraded":"2024-05-08T18:10:24.254012+0000","last_fullsized":"2024-05-08T18:10:24.254012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674165+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:10:23.674165+0000","last_peered":"2024-05-08T18:10:23.674165+0000","last_clean":"2024-05-08T18:10:23.674165+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:10:23.674165+0000","last_undegraded":"2024-05-08T18:10:23.674165+0000","last_fullsized":"2024-05-08T18:10:23.674165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"101'15","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016426+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:10:23.016426+0000","last_peered":"2024-05-08T18:10:23.016426+0000","last_clean":"2024-05-08T18:10:23.016426+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:10:23.016426+0000","last_undegraded":"2024-05-08T18:10:23.016426+0000","last_fullsized":"2024-05-08T18:10:23.016426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":47116,"num_write":35,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749409+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:10:23.749409+0000","last_peered":"2024-05-08T18:10:23.749409+0000","last_clean":"2024-05-08T18:10:23.749409+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:10:23.749409+0000","last_undegraded":"2024-05-08T18:10:23.749409+0000","last_fullsized":"2024-05-08T18:10:23.749409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"101'13","reported_seq":232,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007371+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:10:23.007371+0000","last_peered":"2024-05-08T18:10:23.007371+0000","last_clean":"2024-05-08T18:10:23.007371+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:10:23.007371+0000","last_undegraded":"2024-05-08T18:10:23.007371+0000","last_fullsized":"2024-05-08T18:10:23.007371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40972,"num_write":33,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014036+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:10:23.014036+0000","last_peered":"2024-05-08T18:10:23.014036+0000","last_clean":"2024-05-08T18:10:23.014036+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:10:23.014036+0000","last_undegraded":"2024-05-08T18:10:23.014036+0000","last_fullsized":"2024-05-08T18:10:23.014036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"101'5","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675565+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:10:23.675565+0000","last_peered":"2024-05-08T18:10:23.675565+0000","last_clean":"2024-05-08T18:10:23.675565+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:10:23.675565+0000","last_undegraded":"2024-05-08T18:10:23.675565+0000","last_fullsized":"2024-05-08T18:10:23.675565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14342,"num_write":15,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021174+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:10:23.021174+0000","last_peered":"2024-05-08T18:10:23.021174+0000","last_clean":"2024-05-08T18:10:23.021174+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:10:23.021174+0000","last_undegraded":"2024-05-08T18:10:23.021174+0000","last_fullsized":"2024-05-08T18:10:23.021174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"101'9","reported_seq":172,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232335+0000","last_change":"2024-05-08T18:07:55.439965+0000","last_active":"2024-05-08T18:10:24.232335+0000","last_peered":"2024-05-08T18:10:24.232335+0000","last_clean":"2024-05-08T18:10:24.232335+0000","last_became_active":"2024-05-08T18:07:55.439578+0000","last_became_peered":"2024-05-08T18:07:55.439578+0000","last_unstale":"2024-05-08T18:10:24.232335+0000","last_undegraded":"2024-05-08T18:10:24.232335+0000","last_fullsized":"2024-05-08T18:10:24.232335+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:30.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":22540,"num_write":29,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"101'86","reported_seq":299,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750093+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:10:23.750093+0000","last_peered":"2024-05-08T18:10:23.750093+0000","last_clean":"2024-05-08T18:10:23.750093+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:10:23.750093+0000","last_undegraded":"2024-05-08T18:10:23.750093+0000","last_fullsized":"2024-05-08T18:10:23.750093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":219,"num_write":126,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"101'9","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674555+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:10:23.674555+0000","last_peered":"2024-05-08T18:10:23.674555+0000","last_clean":"2024-05-08T18:10:23.674555+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:10:23.674555+0000","last_undegraded":"2024-05-08T18:10:23.674555+0000","last_fullsized":"2024-05-08T18:10:23.674555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32774,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007751+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:10:23.007751+0000","last_peered":"2024-05-08T18:10:23.007751+0000","last_clean":"2024-05-08T18:10:23.007751+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:10:23.007751+0000","last_undegraded":"2024-05-08T18:10:23.007751+0000","last_fullsized":"2024-05-08T18:10:23.007751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"101'14","reported_seq":237,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009256+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:10:23.009256+0000","last_peered":"2024-05-08T18:10:23.009256+0000","last_clean":"2024-05-08T18:10:23.009256+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:10:23.009256+0000","last_undegraded":"2024-05-08T18:10:23.009256+0000","last_fullsized":"2024-05-08T18:10:23.009256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":167,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013504+0000","last_change":"2024-05-08T18:07:47.007132+0000","last_active":"2024-05-08T18:10:23.013504+0000","last_peered":"2024-05-08T18:10:23.013504+0000","last_clean":"2024-05-08T18:10:23.013504+0000","last_became_active":"2024-05-08T18:07:47.006744+0000","last_became_peered":"2024-05-08T18:07:47.006744+0000","last_unstale":"2024-05-08T18:10:23.013504+0000","last_undegraded":"2024-05-08T18:10:23.013504+0000","last_fullsized":"2024-05-08T18:10:23.013504+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:32.802677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748681+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:10:23.748681+0000","last_peered":"2024-05-08T18:10:23.748681+0000","last_clean":"2024-05-08T18:10:23.748681+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:10:23.748681+0000","last_undegraded":"2024-05-08T18:10:23.748681+0000","last_fullsized":"2024-05-08T18:10:23.748681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"101'17","reported_seq":243,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676155+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:10:23.676155+0000","last_peered":"2024-05-08T18:10:23.676155+0000","last_clean":"2024-05-08T18:10:23.676155+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:10:23.676155+0000","last_undegraded":"2024-05-08T18:10:23.676155+0000","last_fullsized":"2024-05-08T18:10:23.676155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":33,"num_read_kb":49176,"num_write":57,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674465+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:10:23.674465+0000","last_peered":"2024-05-08T18:10:23.674465+0000","last_clean":"2024-05-08T18:10:23.674465+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:10:23.674465+0000","last_undegraded":"2024-05-08T18:10:23.674465+0000","last_fullsized":"2024-05-08T18:10:23.674465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"94'10","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021892+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:10:23.021892+0000","last_peered":"2024-05-08T18:10:23.021892+0000","last_clean":"2024-05-08T18:10:23.021892+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:10:23.021892+0000","last_undegraded":"2024-05-08T18:10:23.021892+0000","last_fullsized":"2024-05-08T18:10:23.021892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":32768,"num_write":10,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"101'48","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007110+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:10:23.007110+0000","last_peered":"2024-05-08T18:10:23.007110+0000","last_clean":"2024-05-08T18:10:23.007110+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:10:23.007110+0000","last_undegraded":"2024-05-08T18:10:23.007110+0000","last_fullsized":"2024-05-08T18:10:23.007110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":122,"num_write":70,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"101'6","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021580+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:10:23.021580+0000","last_peered":"2024-05-08T18:10:23.021580+0000","last_clean":"2024-05-08T18:10:23.021580+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:10:23.021580+0000","last_undegraded":"2024-05-08T18:10:23.021580+0000","last_fullsized":"2024-05-08T18:10:23.021580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.233381+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:10:24.233381+0000","last_peered":"2024-05-08T18:10:24.233381+0000","last_clean":"2024-05-08T18:10:24.233381+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:10:24.233381+0000","last_undegraded":"2024-05-08T18:10:24.233381+0000","last_fullsized":"2024-05-08T18:10:24.233381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"94'8","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749710+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:10:23.749710+0000","last_peered":"2024-05-08T18:10:23.749710+0000","last_clean":"2024-05-08T18:10:23.749710+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:10:23.749710+0000","last_undegraded":"2024-05-08T18:10:23.749710+0000","last_fullsized":"2024-05-08T18:10:23.749710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232925+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:10:24.232925+0000","last_peered":"2024-05-08T18:10:24.232925+0000","last_clean":"2024-05-08T18:10:24.232925+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:10:24.232925+0000","last_undegraded":"2024-05-08T18:10:24.232925+0000","last_fullsized":"2024-05-08T18:10:24.232925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"101'6","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012083+0000","last_change":"2024-05-08T18:09:38.328162+0000","last_active":"2024-05-08T18:10:23.012083+0000","last_peered":"2024-05-08T18:10:23.012083+0000","last_clean":"2024-05-08T18:10:23.012083+0000","last_became_active":"2024-05-08T18:09:38.182438+0000","last_became_peered":"2024-05-08T18:09:38.182438+0000","last_unstale":"2024-05-08T18:10:23.012083+0000","last_undegraded":"2024-05-08T18:10:23.012083+0000","last_fullsized":"2024-05-08T18:10:23.012083+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:05.642615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751059+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:10:23.751059+0000","last_peered":"2024-05-08T18:10:23.751059+0000","last_clean":"2024-05-08T18:10:23.751059+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:10:23.751059+0000","last_undegraded":"2024-05-08T18:10:23.751059+0000","last_fullsized":"2024-05-08T18:10:23.751059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"101'9","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013579+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:10:23.013579+0000","last_peered":"2024-05-08T18:10:23.013579+0000","last_clean":"2024-05-08T18:10:23.013579+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:10:23.013579+0000","last_undegraded":"2024-05-08T18:10:23.013579+0000","last_fullsized":"2024-05-08T18:10:23.013579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":28678,"num_write":19,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748132+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:10:23.748132+0000","last_peered":"2024-05-08T18:10:23.748132+0000","last_clean":"2024-05-08T18:10:23.748132+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:10:23.748132+0000","last_undegraded":"2024-05-08T18:10:23.748132+0000","last_fullsized":"2024-05-08T18:10:23.748132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011135+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:10:23.011135+0000","last_peered":"2024-05-08T18:10:23.011135+0000","last_clean":"2024-05-08T18:10:23.011135+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:10:23.011135+0000","last_undegraded":"2024-05-08T18:10:23.011135+0000","last_fullsized":"2024-05-08T18:10:23.011135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"101'12","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675916+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:10:23.675916+0000","last_peered":"2024-05-08T18:10:23.675916+0000","last_clean":"2024-05-08T18:10:23.675916+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:10:23.675916+0000","last_undegraded":"2024-05-08T18:10:23.675916+0000","last_fullsized":"2024-05-08T18:10:23.675916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":36876,"num_write":32,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007061+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:10:23.007061+0000","last_peered":"2024-05-08T18:10:23.007061+0000","last_clean":"2024-05-08T18:10:23.007061+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:10:23.007061+0000","last_undegraded":"2024-05-08T18:10:23.007061+0000","last_fullsized":"2024-05-08T18:10:23.007061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"101'12","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018739+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:10:23.018739+0000","last_peered":"2024-05-08T18:10:23.018739+0000","last_clean":"2024-05-08T18:10:23.018739+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:10:23.018739+0000","last_undegraded":"2024-05-08T18:10:23.018739+0000","last_fullsized":"2024-05-08T18:10:23.018739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675833+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:10:23.675833+0000","last_peered":"2024-05-08T18:10:23.675833+0000","last_clean":"2024-05-08T18:10:23.675833+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:10:23.675833+0000","last_undegraded":"2024-05-08T18:10:23.675833+0000","last_fullsized":"2024-05-08T18:10:23.675833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005832+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:10:23.005832+0000","last_peered":"2024-05-08T18:10:23.005832+0000","last_clean":"2024-05-08T18:10:23.005832+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:10:23.005832+0000","last_undegraded":"2024-05-08T18:10:23.005832+0000","last_fullsized":"2024-05-08T18:10:23.005832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007823+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:10:23.007823+0000","last_peered":"2024-05-08T18:10:23.007823+0000","last_clean":"2024-05-08T18:10:23.007823+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:10:23.007823+0000","last_undegraded":"2024-05-08T18:10:23.007823+0000","last_fullsized":"2024-05-08T18:10:23.007823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013931+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:10:23.013931+0000","last_peered":"2024-05-08T18:10:23.013931+0000","last_clean":"2024-05-08T18:10:23.013931+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:10:23.013931+0000","last_undegraded":"2024-05-08T18:10:23.013931+0000","last_fullsized":"2024-05-08T18:10:23.013931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":30738,"num_write":41,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010902+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:10:23.010902+0000","last_peered":"2024-05-08T18:10:23.010902+0000","last_clean":"2024-05-08T18:10:23.010902+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:10:23.010902+0000","last_undegraded":"2024-05-08T18:10:23.010902+0000","last_fullsized":"2024-05-08T18:10:23.010902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"101'7","reported_seq":206,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750625+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:10:23.750625+0000","last_peered":"2024-05-08T18:10:23.750625+0000","last_clean":"2024-05-08T18:10:23.750625+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:10:23.750625+0000","last_undegraded":"2024-05-08T18:10:23.750625+0000","last_fullsized":"2024-05-08T18:10:23.750625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750086+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:10:23.750086+0000","last_peered":"2024-05-08T18:10:23.750086+0000","last_clean":"2024-05-08T18:10:23.750086+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:10:23.750086+0000","last_undegraded":"2024-05-08T18:10:23.750086+0000","last_fullsized":"2024-05-08T18:10:23.750086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012615+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:10:23.012615+0000","last_peered":"2024-05-08T18:10:23.012615+0000","last_clean":"2024-05-08T18:10:23.012615+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:10:23.012615+0000","last_undegraded":"2024-05-08T18:10:23.012615+0000","last_fullsized":"2024-05-08T18:10:23.012615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"90'6","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019369+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:10:23.019369+0000","last_peered":"2024-05-08T18:10:23.019369+0000","last_clean":"2024-05-08T18:10:23.019369+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:10:23.019369+0000","last_undegraded":"2024-05-08T18:10:23.019369+0000","last_fullsized":"2024-05-08T18:10:23.019369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"101'9","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675435+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:10:23.675435+0000","last_peered":"2024-05-08T18:10:23.675435+0000","last_clean":"2024-05-08T18:10:23.675435+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:10:23.675435+0000","last_undegraded":"2024-05-08T18:10:23.675435+0000","last_fullsized":"2024-05-08T18:10:23.675435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":28684,"num_write":29,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013381+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:10:23.013381+0000","last_peered":"2024-05-08T18:10:23.013381+0000","last_clean":"2024-05-08T18:10:23.013381+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:10:23.013381+0000","last_undegraded":"2024-05-08T18:10:23.013381+0000","last_fullsized":"2024-05-08T18:10:23.013381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232567+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:10:24.232567+0000","last_peered":"2024-05-08T18:10:24.232567+0000","last_clean":"2024-05-08T18:10:24.232567+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:10:24.232567+0000","last_undegraded":"2024-05-08T18:10:24.232567+0000","last_fullsized":"2024-05-08T18:10:24.232567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"101'14","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674890+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:10:23.674890+0000","last_peered":"2024-05-08T18:10:23.674890+0000","last_clean":"2024-05-08T18:10:23.674890+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:10:23.674890+0000","last_undegraded":"2024-05-08T18:10:23.674890+0000","last_fullsized":"2024-05-08T18:10:23.674890+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"101'4","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748730+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:10:23.748730+0000","last_peered":"2024-05-08T18:10:23.748730+0000","last_clean":"2024-05-08T18:10:23.748730+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:10:23.748730+0000","last_undegraded":"2024-05-08T18:10:23.748730+0000","last_fullsized":"2024-05-08T18:10:23.748730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012204+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:10:23.012204+0000","last_peered":"2024-05-08T18:10:23.012204+0000","last_clean":"2024-05-08T18:10:23.012204+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:10:23.012204+0000","last_undegraded":"2024-05-08T18:10:23.012204+0000","last_fullsized":"2024-05-08T18:10:23.012204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"101'8","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020021+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:10:23.020021+0000","last_peered":"2024-05-08T18:10:23.020021+0000","last_clean":"2024-05-08T18:10:23.020021+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:10:23.020021+0000","last_undegraded":"2024-05-08T18:10:23.020021+0000","last_fullsized":"2024-05-08T18:10:23.020021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007769+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:10:23.007769+0000","last_peered":"2024-05-08T18:10:23.007769+0000","last_clean":"2024-05-08T18:10:23.007769+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:10:23.007769+0000","last_undegraded":"2024-05-08T18:10:23.007769+0000","last_fullsized":"2024-05-08T18:10:23.007769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"101'12","reported_seq":216,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675041+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:10:23.675041+0000","last_peered":"2024-05-08T18:10:23.675041+0000","last_clean":"2024-05-08T18:10:23.675041+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:10:23.675041+0000","last_undegraded":"2024-05-08T18:10:23.675041+0000","last_fullsized":"2024-05-08T18:10:23.675041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"101'14","reported_seq":244,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012177+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:10:23.012177+0000","last_peered":"2024-05-08T18:10:23.012177+0000","last_clean":"2024-05-08T18:10:23.012177+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:10:23.012177+0000","last_undegraded":"2024-05-08T18:10:23.012177+0000","last_fullsized":"2024-05-08T18:10:23.012177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006408+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:10:23.006408+0000","last_peered":"2024-05-08T18:10:23.006408+0000","last_clean":"2024-05-08T18:10:23.006408+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:10:23.006408+0000","last_undegraded":"2024-05-08T18:10:23.006408+0000","last_fullsized":"2024-05-08T18:10:23.006408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"101'17","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232514+0000","last_change":"2024-05-08T18:07:55.357969+0000","last_active":"2024-05-08T18:10:24.232514+0000","last_peered":"2024-05-08T18:10:24.232514+0000","last_clean":"2024-05-08T18:10:24.232514+0000","last_became_active":"2024-05-08T18:07:55.357205+0000","last_became_peered":"2024-05-08T18:07:55.357205+0000","last_unstale":"2024-05-08T18:10:24.232514+0000","last_undegraded":"2024-05-08T18:10:24.232514+0000","last_fullsized":"2024-05-08T18:10:24.232514+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:04.667292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":29,"num_read_kb":51218,"num_write":47,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673147+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:10:23.673147+0000","last_peered":"2024-05-08T18:10:23.673147+0000","last_clean":"2024-05-08T18:10:23.673147+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:10:23.673147+0000","last_undegraded":"2024-05-08T18:10:23.673147+0000","last_fullsized":"2024-05-08T18:10:23.673147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"101'24","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005976+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:10:23.005976+0000","last_peered":"2024-05-08T18:10:23.005976+0000","last_clean":"2024-05-08T18:10:23.005976+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:10:23.005976+0000","last_undegraded":"2024-05-08T18:10:23.005976+0000","last_fullsized":"2024-05-08T18:10:23.005976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5766,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251690+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:10:24.251690+0000","last_peered":"2024-05-08T18:10:24.251690+0000","last_clean":"2024-05-08T18:10:24.251690+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:10:24.251690+0000","last_undegraded":"2024-05-08T18:10:24.251690+0000","last_fullsized":"2024-05-08T18:10:24.251690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006819+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:10:23.006819+0000","last_peered":"2024-05-08T18:10:23.006819+0000","last_clean":"2024-05-08T18:10:23.006819+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:10:23.006819+0000","last_undegraded":"2024-05-08T18:10:23.006819+0000","last_fullsized":"2024-05-08T18:10:23.006819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"90'2","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748795+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:10:23.748795+0000","last_peered":"2024-05-08T18:10:23.748795+0000","last_clean":"2024-05-08T18:10:23.748795+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:10:23.748795+0000","last_undegraded":"2024-05-08T18:10:23.748795+0000","last_fullsized":"2024-05-08T18:10:23.748795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"101'12","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676002+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:10:23.676002+0000","last_peered":"2024-05-08T18:10:23.676002+0000","last_clean":"2024-05-08T18:10:23.676002+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:10:23.676002+0000","last_undegraded":"2024-05-08T18:10:23.676002+0000","last_fullsized":"2024-05-08T18:10:23.676002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":32792,"num_write":52,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.230736+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:10:24.230736+0000","last_peered":"2024-05-08T18:10:24.230736+0000","last_clean":"2024-05-08T18:10:24.230736+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:10:24.230736+0000","last_undegraded":"2024-05-08T18:10:24.230736+0000","last_fullsized":"2024-05-08T18:10:24.230736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"101'13","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013219+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:10:23.013219+0000","last_peered":"2024-05-08T18:10:23.013219+0000","last_clean":"2024-05-08T18:10:23.013219+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:10:23.013219+0000","last_undegraded":"2024-05-08T18:10:23.013219+0000","last_fullsized":"2024-05-08T18:10:23.013219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009871+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:10:23.009871+0000","last_peered":"2024-05-08T18:10:23.009871+0000","last_clean":"2024-05-08T18:10:23.009871+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:10:23.009871+0000","last_undegraded":"2024-05-08T18:10:23.009871+0000","last_fullsized":"2024-05-08T18:10:23.009871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020405+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:10:23.020405+0000","last_peered":"2024-05-08T18:10:23.020405+0000","last_clean":"2024-05-08T18:10:23.020405+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:10:23.020405+0000","last_undegraded":"2024-05-08T18:10:23.020405+0000","last_fullsized":"2024-05-08T18:10:23.020405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"101'34","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021104+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:10:23.021104+0000","last_peered":"2024-05-08T18:10:23.021104+0000","last_clean":"2024-05-08T18:10:23.021104+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:10:23.021104+0000","last_undegraded":"2024-05-08T18:10:23.021104+0000","last_fullsized":"2024-05-08T18:10:23.021104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"101'6","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676260+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:10:23.676260+0000","last_peered":"2024-05-08T18:10:23.676260+0000","last_clean":"2024-05-08T18:10:23.676260+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:10:23.676260+0000","last_undegraded":"2024-05-08T18:10:23.676260+0000","last_fullsized":"2024-05-08T18:10:23.676260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.231219+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:10:24.231219+0000","last_peered":"2024-05-08T18:10:24.231219+0000","last_clean":"2024-05-08T18:10:24.231219+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:10:24.231219+0000","last_undegraded":"2024-05-08T18:10:24.231219+0000","last_fullsized":"2024-05-08T18:10:24.231219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"101'18","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674346+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:10:23.674346+0000","last_peered":"2024-05-08T18:10:23.674346+0000","last_clean":"2024-05-08T18:10:23.674346+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:10:23.674346+0000","last_undegraded":"2024-05-08T18:10:23.674346+0000","last_fullsized":"2024-05-08T18:10:23.674346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"101'14","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010362+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:10:23.010362+0000","last_peered":"2024-05-08T18:10:23.010362+0000","last_clean":"2024-05-08T18:10:23.010362+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:10:23.010362+0000","last_undegraded":"2024-05-08T18:10:23.010362+0000","last_fullsized":"2024-05-08T18:10:23.010362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"101'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018672+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:10:23.018672+0000","last_peered":"2024-05-08T18:10:23.018672+0000","last_clean":"2024-05-08T18:10:23.018672+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:10:23.018672+0000","last_undegraded":"2024-05-08T18:10:23.018672+0000","last_fullsized":"2024-05-08T18:10:23.018672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015490+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:10:23.015490+0000","last_peered":"2024-05-08T18:10:23.015490+0000","last_clean":"2024-05-08T18:10:23.015490+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:10:23.015490+0000","last_undegraded":"2024-05-08T18:10:23.015490+0000","last_fullsized":"2024-05-08T18:10:23.015490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"101'18","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007808+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:10:23.007808+0000","last_peered":"2024-05-08T18:10:23.007808+0000","last_clean":"2024-05-08T18:10:23.007808+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:10:23.007808+0000","last_undegraded":"2024-05-08T18:10:23.007808+0000","last_fullsized":"2024-05-08T18:10:23.007808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":34,"num_read_kb":55320,"num_write":58,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232646+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:10:24.232646+0000","last_peered":"2024-05-08T18:10:24.232646+0000","last_clean":"2024-05-08T18:10:24.232646+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:10:24.232646+0000","last_undegraded":"2024-05-08T18:10:24.232646+0000","last_fullsized":"2024-05-08T18:10:24.232646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"101'22","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011471+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:10:23.011471+0000","last_peered":"2024-05-08T18:10:23.011471+0000","last_clean":"2024-05-08T18:10:23.011471+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:10:23.011471+0000","last_undegraded":"2024-05-08T18:10:23.011471+0000","last_fullsized":"2024-05-08T18:10:23.011471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.230902+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:10:24.230902+0000","last_peered":"2024-05-08T18:10:24.230902+0000","last_clean":"2024-05-08T18:10:24.230902+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:10:24.230902+0000","last_undegraded":"2024-05-08T18:10:24.230902+0000","last_fullsized":"2024-05-08T18:10:24.230902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253338+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:10:24.253338+0000","last_peered":"2024-05-08T18:10:24.253338+0000","last_clean":"2024-05-08T18:10:24.253338+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:10:24.253338+0000","last_undegraded":"2024-05-08T18:10:24.253338+0000","last_fullsized":"2024-05-08T18:10:24.253338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750534+0000","last_change":"2024-05-08T18:07:55.356946+0000","last_active":"2024-05-08T18:10:23.750534+0000","last_peered":"2024-05-08T18:10:23.750534+0000","last_clean":"2024-05-08T18:10:23.750534+0000","last_became_active":"2024-05-08T18:07:55.355948+0000","last_became_peered":"2024-05-08T18:07:55.355948+0000","last_unstale":"2024-05-08T18:10:23.750534+0000","last_undegraded":"2024-05-08T18:10:23.750534+0000","last_fullsized":"2024-05-08T18:10:23.750534+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:04.163382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"94'9","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011429+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:10:23.011429+0000","last_peered":"2024-05-08T18:10:23.011429+0000","last_clean":"2024-05-08T18:10:23.011429+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:10:23.011429+0000","last_undegraded":"2024-05-08T18:10:23.011429+0000","last_fullsized":"2024-05-08T18:10:23.011429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232927+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:10:24.232927+0000","last_peered":"2024-05-08T18:10:24.232927+0000","last_clean":"2024-05-08T18:10:24.232927+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:10:24.232927+0000","last_undegraded":"2024-05-08T18:10:24.232927+0000","last_fullsized":"2024-05-08T18:10:24.232927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"104'17","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750330+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:10:23.750330+0000","last_peered":"2024-05-08T18:10:23.750330+0000","last_clean":"2024-05-08T18:10:23.750330+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:10:23.750330+0000","last_undegraded":"2024-05-08T18:10:23.750330+0000","last_fullsized":"2024-05-08T18:10:23.750330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10256,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":24,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017020+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:10:23.017020+0000","last_peered":"2024-05-08T18:10:23.017020+0000","last_clean":"2024-05-08T18:10:23.017020+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:10:23.017020+0000","last_undegraded":"2024-05-08T18:10:23.017020+0000","last_fullsized":"2024-05-08T18:10:23.017020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"90'2","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008384+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:10:23.008384+0000","last_peered":"2024-05-08T18:10:23.008384+0000","last_clean":"2024-05-08T18:10:23.008384+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:10:23.008384+0000","last_undegraded":"2024-05-08T18:10:23.008384+0000","last_fullsized":"2024-05-08T18:10:23.008384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751087+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:10:23.751087+0000","last_peered":"2024-05-08T18:10:23.751087+0000","last_clean":"2024-05-08T18:10:23.751087+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:10:23.751087+0000","last_undegraded":"2024-05-08T18:10:23.751087+0000","last_fullsized":"2024-05-08T18:10:23.751087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"101'6","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021301+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:10:23.021301+0000","last_peered":"2024-05-08T18:10:23.021301+0000","last_clean":"2024-05-08T18:10:23.021301+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:10:23.021301+0000","last_undegraded":"2024-05-08T18:10:23.021301+0000","last_fullsized":"2024-05-08T18:10:23.021301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":16390,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251079+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:10:24.251079+0000","last_peered":"2024-05-08T18:10:24.251079+0000","last_clean":"2024-05-08T18:10:24.251079+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:10:24.251079+0000","last_undegraded":"2024-05-08T18:10:24.251079+0000","last_fullsized":"2024-05-08T18:10:24.251079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"101'19","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232755+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:10:24.232755+0000","last_peered":"2024-05-08T18:10:24.232755+0000","last_clean":"2024-05-08T18:10:24.232755+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:10:24.232755+0000","last_undegraded":"2024-05-08T18:10:24.232755+0000","last_fullsized":"2024-05-08T18:10:24.232755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"101'14","reported_seq":249,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232610+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:10:24.232610+0000","last_peered":"2024-05-08T18:10:24.232610+0000","last_clean":"2024-05-08T18:10:24.232610+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:10:24.232610+0000","last_undegraded":"2024-05-08T18:10:24.232610+0000","last_fullsized":"2024-05-08T18:10:24.232610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248023+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:10:24.248023+0000","last_peered":"2024-05-08T18:10:24.248023+0000","last_clean":"2024-05-08T18:10:24.248023+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:10:24.248023+0000","last_undegraded":"2024-05-08T18:10:24.248023+0000","last_fullsized":"2024-05-08T18:10:24.248023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"101'42","reported_seq":249,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750723+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:10:23.750723+0000","last_peered":"2024-05-08T18:10:23.750723+0000","last_clean":"2024-05-08T18:10:23.750723+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:10:23.750723+0000","last_undegraded":"2024-05-08T18:10:23.750723+0000","last_fullsized":"2024-05-08T18:10:23.750723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"95'11","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749487+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:10:23.749487+0000","last_peered":"2024-05-08T18:10:23.749487+0000","last_clean":"2024-05-08T18:10:23.749487+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:10:23.749487+0000","last_undegraded":"2024-05-08T18:10:23.749487+0000","last_fullsized":"2024-05-08T18:10:23.749487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":34822,"num_write":21,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":218,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008282+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:10:23.008282+0000","last_peered":"2024-05-08T18:10:23.008282+0000","last_clean":"2024-05-08T18:10:23.008282+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:10:23.008282+0000","last_undegraded":"2024-05-08T18:10:23.008282+0000","last_fullsized":"2024-05-08T18:10:23.008282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":95,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.250890+0000","last_change":"2024-05-08T18:09:06.402195+0000","last_active":"2024-05-08T18:10:24.250890+0000","last_peered":"2024-05-08T18:10:24.250890+0000","last_clean":"2024-05-08T18:10:24.250890+0000","last_became_active":"2024-05-08T18:09:06.380401+0000","last_became_peered":"2024-05-08T18:09:06.380401+0000","last_unstale":"2024-05-08T18:10:24.250890+0000","last_undegraded":"2024-05-08T18:10:24.250890+0000","last_fullsized":"2024-05-08T18:10:24.250890+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:36.840412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"101'14","reported_seq":246,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020953+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:10:23.020953+0000","last_peered":"2024-05-08T18:10:23.020953+0000","last_clean":"2024-05-08T18:10:23.020953+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:10:23.020953+0000","last_undegraded":"2024-05-08T18:10:23.020953+0000","last_fullsized":"2024-05-08T18:10:23.020953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749093+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:10:23.749093+0000","last_peered":"2024-05-08T18:10:23.749093+0000","last_clean":"2024-05-08T18:10:23.749093+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:10:23.749093+0000","last_undegraded":"2024-05-08T18:10:23.749093+0000","last_fullsized":"2024-05-08T18:10:23.749093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253566+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:10:24.253566+0000","last_peered":"2024-05-08T18:10:24.253566+0000","last_clean":"2024-05-08T18:10:24.253566+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:10:24.253566+0000","last_undegraded":"2024-05-08T18:10:24.253566+0000","last_fullsized":"2024-05-08T18:10:24.253566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"101'13","reported_seq":235,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009532+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:10:23.009532+0000","last_peered":"2024-05-08T18:10:23.009532+0000","last_clean":"2024-05-08T18:10:23.009532+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:10:23.009532+0000","last_undegraded":"2024-05-08T18:10:23.009532+0000","last_fullsized":"2024-05-08T18:10:23.009532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":47110,"num_write":23,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747906+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:10:23.747906+0000","last_peered":"2024-05-08T18:10:23.747906+0000","last_clean":"2024-05-08T18:10:23.747906+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:10:23.747906+0000","last_undegraded":"2024-05-08T18:10:23.747906+0000","last_fullsized":"2024-05-08T18:10:23.747906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"101'21","reported_seq":226,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007012+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:10:23.007012+0000","last_peered":"2024-05-08T18:10:23.007012+0000","last_clean":"2024-05-08T18:10:23.007012+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:10:23.007012+0000","last_undegraded":"2024-05-08T18:10:23.007012+0000","last_fullsized":"2024-05-08T18:10:23.007012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10255,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019992+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:10:23.019992+0000","last_peered":"2024-05-08T18:10:23.019992+0000","last_clean":"2024-05-08T18:10:23.019992+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:10:23.019992+0000","last_undegraded":"2024-05-08T18:10:23.019992+0000","last_fullsized":"2024-05-08T18:10:23.019992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251604+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:10:24.251604+0000","last_peered":"2024-05-08T18:10:24.251604+0000","last_clean":"2024-05-08T18:10:24.251604+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:10:24.251604+0000","last_undegraded":"2024-05-08T18:10:24.251604+0000","last_fullsized":"2024-05-08T18:10:24.251604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021357+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:10:23.021357+0000","last_peered":"2024-05-08T18:10:23.021357+0000","last_clean":"2024-05-08T18:10:23.021357+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:10:23.021357+0000","last_undegraded":"2024-05-08T18:10:23.021357+0000","last_fullsized":"2024-05-08T18:10:23.021357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":311,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674956+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:10:23.674956+0000","last_peered":"2024-05-08T18:10:23.674956+0000","last_clean":"2024-05-08T18:10:23.674956+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:10:23.674956+0000","last_undegraded":"2024-05-08T18:10:23.674956+0000","last_fullsized":"2024-05-08T18:10:23.674956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007096+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:10:23.007096+0000","last_peered":"2024-05-08T18:10:23.007096+0000","last_clean":"2024-05-08T18:10:23.007096+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:10:23.007096+0000","last_undegraded":"2024-05-08T18:10:23.007096+0000","last_fullsized":"2024-05-08T18:10:23.007096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"101'10","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010661+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:10:23.010661+0000","last_peered":"2024-05-08T18:10:23.010661+0000","last_clean":"2024-05-08T18:10:23.010661+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:10:23.010661+0000","last_undegraded":"2024-05-08T18:10:23.010661+0000","last_fullsized":"2024-05-08T18:10:23.010661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674690+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:10:23.674690+0000","last_peered":"2024-05-08T18:10:23.674690+0000","last_clean":"2024-05-08T18:10:23.674690+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:10:23.674690+0000","last_undegraded":"2024-05-08T18:10:23.674690+0000","last_fullsized":"2024-05-08T18:10:23.674690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"101'24","reported_seq":232,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008559+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:10:23.008559+0000","last_peered":"2024-05-08T18:10:23.008559+0000","last_clean":"2024-05-08T18:10:23.008559+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:10:23.008559+0000","last_undegraded":"2024-05-08T18:10:23.008559+0000","last_fullsized":"2024-05-08T18:10:23.008559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15071,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":35,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018810+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:10:23.018810+0000","last_peered":"2024-05-08T18:10:23.018810+0000","last_clean":"2024-05-08T18:10:23.018810+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:10:23.018810+0000","last_undegraded":"2024-05-08T18:10:23.018810+0000","last_fullsized":"2024-05-08T18:10:23.018810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019671+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:10:23.019671+0000","last_peered":"2024-05-08T18:10:23.019671+0000","last_clean":"2024-05-08T18:10:23.019671+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:10:23.019671+0000","last_undegraded":"2024-05-08T18:10:23.019671+0000","last_fullsized":"2024-05-08T18:10:23.019671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019230+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:10:23.019230+0000","last_peered":"2024-05-08T18:10:23.019230+0000","last_clean":"2024-05-08T18:10:23.019230+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:10:23.019230+0000","last_undegraded":"2024-05-08T18:10:23.019230+0000","last_fullsized":"2024-05-08T18:10:23.019230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674634+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:10:23.674634+0000","last_peered":"2024-05-08T18:10:23.674634+0000","last_clean":"2024-05-08T18:10:23.674634+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:10:23.674634+0000","last_undegraded":"2024-05-08T18:10:23.674634+0000","last_fullsized":"2024-05-08T18:10:23.674634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"101'12","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011857+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:10:23.011857+0000","last_peered":"2024-05-08T18:10:23.011857+0000","last_clean":"2024-05-08T18:10:23.011857+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:10:23.011857+0000","last_undegraded":"2024-05-08T18:10:23.011857+0000","last_fullsized":"2024-05-08T18:10:23.011857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":34834,"num_write":42,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008813+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:10:23.008813+0000","last_peered":"2024-05-08T18:10:23.008813+0000","last_clean":"2024-05-08T18:10:23.008813+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:10:23.008813+0000","last_undegraded":"2024-05-08T18:10:23.008813+0000","last_fullsized":"2024-05-08T18:10:23.008813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"101'60","reported_seq":313,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251029+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:10:24.251029+0000","last_peered":"2024-05-08T18:10:24.251029+0000","last_clean":"2024-05-08T18:10:24.251029+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:10:24.251029+0000","last_undegraded":"2024-05-08T18:10:24.251029+0000","last_fullsized":"2024-05-08T18:10:24.251029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35210,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":100,"num_read_kb":145,"num_write":72,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674917+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:10:23.674917+0000","last_peered":"2024-05-08T18:10:23.674917+0000","last_clean":"2024-05-08T18:10:23.674917+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:10:23.674917+0000","last_undegraded":"2024-05-08T18:10:23.674917+0000","last_fullsized":"2024-05-08T18:10:23.674917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248556+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:10:24.248556+0000","last_peered":"2024-05-08T18:10:24.248556+0000","last_clean":"2024-05-08T18:10:24.248556+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:10:24.248556+0000","last_undegraded":"2024-05-08T18:10:24.248556+0000","last_fullsized":"2024-05-08T18:10:24.248556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"101'34","reported_seq":239,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253653+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:10:24.253653+0000","last_peered":"2024-05-08T18:10:24.253653+0000","last_clean":"2024-05-08T18:10:24.253653+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:10:24.253653+0000","last_undegraded":"2024-05-08T18:10:24.253653+0000","last_fullsized":"2024-05-08T18:10:24.253653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232846+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:10:24.232846+0000","last_peered":"2024-05-08T18:10:24.232846+0000","last_clean":"2024-05-08T18:10:24.232846+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:10:24.232846+0000","last_undegraded":"2024-05-08T18:10:24.232846+0000","last_fullsized":"2024-05-08T18:10:24.232846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"101'10","reported_seq":226,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247509+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:10:24.247509+0000","last_peered":"2024-05-08T18:10:24.247509+0000","last_clean":"2024-05-08T18:10:24.247509+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:10:24.247509+0000","last_undegraded":"2024-05-08T18:10:24.247509+0000","last_fullsized":"2024-05-08T18:10:24.247509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":28678,"num_write":20,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.231322+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:10:24.231322+0000","last_peered":"2024-05-08T18:10:24.231322+0000","last_clean":"2024-05-08T18:10:24.231322+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:10:24.231322+0000","last_undegraded":"2024-05-08T18:10:24.231322+0000","last_fullsized":"2024-05-08T18:10:24.231322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":255,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675870+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:10:23.675870+0000","last_peered":"2024-05-08T18:10:23.675870+0000","last_clean":"2024-05-08T18:10:23.675870+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:10:23.675870+0000","last_undegraded":"2024-05-08T18:10:23.675870+0000","last_fullsized":"2024-05-08T18:10:23.675870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012071+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:10:23.012071+0000","last_peered":"2024-05-08T18:10:23.012071+0000","last_clean":"2024-05-08T18:10:23.012071+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:10:23.012071+0000","last_undegraded":"2024-05-08T18:10:23.012071+0000","last_fullsized":"2024-05-08T18:10:23.012071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012608+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:10:23.012608+0000","last_peered":"2024-05-08T18:10:23.012608+0000","last_clean":"2024-05-08T18:10:23.012608+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:10:23.012608+0000","last_undegraded":"2024-05-08T18:10:23.012608+0000","last_fullsized":"2024-05-08T18:10:23.012608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"90'6","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251256+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:10:24.251256+0000","last_peered":"2024-05-08T18:10:24.251256+0000","last_clean":"2024-05-08T18:10:24.251256+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:10:24.251256+0000","last_undegraded":"2024-05-08T18:10:24.251256+0000","last_fullsized":"2024-05-08T18:10:24.251256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007417+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:10:23.007417+0000","last_peered":"2024-05-08T18:10:23.007417+0000","last_clean":"2024-05-08T18:10:23.007417+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:10:23.007417+0000","last_undegraded":"2024-05-08T18:10:23.007417+0000","last_fullsized":"2024-05-08T18:10:23.007417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"101'17","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749372+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:10:23.749372+0000","last_peered":"2024-05-08T18:10:23.749372+0000","last_clean":"2024-05-08T18:10:23.749372+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:10:23.749372+0000","last_undegraded":"2024-05-08T18:10:23.749372+0000","last_fullsized":"2024-05-08T18:10:23.749372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":29,"num_read_kb":55314,"num_write":47,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015883+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:10:23.015883+0000","last_peered":"2024-05-08T18:10:23.015883+0000","last_clean":"2024-05-08T18:10:23.015883+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:10:23.015883+0000","last_undegraded":"2024-05-08T18:10:23.015883+0000","last_fullsized":"2024-05-08T18:10:23.015883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010992+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:10:23.010992+0000","last_peered":"2024-05-08T18:10:23.010992+0000","last_clean":"2024-05-08T18:10:23.010992+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:10:23.010992+0000","last_undegraded":"2024-05-08T18:10:23.010992+0000","last_fullsized":"2024-05-08T18:10:23.010992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022360+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:10:23.022360+0000","last_peered":"2024-05-08T18:10:23.022360+0000","last_clean":"2024-05-08T18:10:23.022360+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:10:23.022360+0000","last_undegraded":"2024-05-08T18:10:23.022360+0000","last_fullsized":"2024-05-08T18:10:23.022360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005558+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:10:23.005558+0000","last_peered":"2024-05-08T18:10:23.005558+0000","last_clean":"2024-05-08T18:10:23.005558+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:10:23.005558+0000","last_undegraded":"2024-05-08T18:10:23.005558+0000","last_fullsized":"2024-05-08T18:10:23.005558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'10","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248864+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:10:24.248864+0000","last_peered":"2024-05-08T18:10:24.248864+0000","last_clean":"2024-05-08T18:10:24.248864+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:10:24.248864+0000","last_undegraded":"2024-05-08T18:10:24.248864+0000","last_fullsized":"2024-05-08T18:10:24.248864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"94'7","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008067+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:10:23.008067+0000","last_peered":"2024-05-08T18:10:23.008067+0000","last_clean":"2024-05-08T18:10:23.008067+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:10:23.008067+0000","last_undegraded":"2024-05-08T18:10:23.008067+0000","last_fullsized":"2024-05-08T18:10:23.008067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":22528,"num_write":7,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251507+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:10:24.251507+0000","last_peered":"2024-05-08T18:10:24.251507+0000","last_clean":"2024-05-08T18:10:24.251507+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:10:24.251507+0000","last_undegraded":"2024-05-08T18:10:24.251507+0000","last_fullsized":"2024-05-08T18:10:24.251507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014445+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:10:23.014445+0000","last_peered":"2024-05-08T18:10:23.014445+0000","last_clean":"2024-05-08T18:10:23.014445+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:10:23.014445+0000","last_undegraded":"2024-05-08T18:10:23.014445+0000","last_fullsized":"2024-05-08T18:10:23.014445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"101'32","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015001+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:10:23.015001+0000","last_peered":"2024-05-08T18:10:23.015001+0000","last_clean":"2024-05-08T18:10:23.015001+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:10:23.015001+0000","last_undegraded":"2024-05-08T18:10:23.015001+0000","last_fullsized":"2024-05-08T18:10:23.015001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13755,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":66,"num_write":40,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748261+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:10:23.748261+0000","last_peered":"2024-05-08T18:10:23.748261+0000","last_clean":"2024-05-08T18:10:23.748261+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:10:23.748261+0000","last_undegraded":"2024-05-08T18:10:23.748261+0000","last_fullsized":"2024-05-08T18:10:23.748261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"90'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016164+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:10:23.016164+0000","last_peered":"2024-05-08T18:10:23.016164+0000","last_clean":"2024-05-08T18:10:23.016164+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:10:23.016164+0000","last_undegraded":"2024-05-08T18:10:23.016164+0000","last_fullsized":"2024-05-08T18:10:23.016164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"101'42","reported_seq":247,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015384+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:10:23.015384+0000","last_peered":"2024-05-08T18:10:23.015384+0000","last_clean":"2024-05-08T18:10:23.015384+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:10:23.015384+0000","last_undegraded":"2024-05-08T18:10:23.015384+0000","last_fullsized":"2024-05-08T18:10:23.015384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251344+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:10:24.251344+0000","last_peered":"2024-05-08T18:10:24.251344+0000","last_clean":"2024-05-08T18:10:24.251344+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:10:24.251344+0000","last_undegraded":"2024-05-08T18:10:24.251344+0000","last_fullsized":"2024-05-08T18:10:24.251344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676602+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:10:23.676602+0000","last_peered":"2024-05-08T18:10:23.676602+0000","last_clean":"2024-05-08T18:10:23.676602+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:10:23.676602+0000","last_undegraded":"2024-05-08T18:10:23.676602+0000","last_fullsized":"2024-05-08T18:10:23.676602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020771+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:10:23.020771+0000","last_peered":"2024-05-08T18:10:23.020771+0000","last_clean":"2024-05-08T18:10:23.020771+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:10:23.020771+0000","last_undegraded":"2024-05-08T18:10:23.020771+0000","last_fullsized":"2024-05-08T18:10:23.020771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247820+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:10:24.247820+0000","last_peered":"2024-05-08T18:10:24.247820+0000","last_clean":"2024-05-08T18:10:24.247820+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:10:24.247820+0000","last_undegraded":"2024-05-08T18:10:24.247820+0000","last_fullsized":"2024-05-08T18:10:24.247820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"101'14","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006399+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:10:23.006399+0000","last_peered":"2024-05-08T18:10:23.006399+0000","last_clean":"2024-05-08T18:10:23.006399+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:10:23.006399+0000","last_undegraded":"2024-05-08T18:10:23.006399+0000","last_fullsized":"2024-05-08T18:10:23.006399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"101'4","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012889+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:10:23.012889+0000","last_peered":"2024-05-08T18:10:23.012889+0000","last_clean":"2024-05-08T18:10:23.012889+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:10:23.012889+0000","last_undegraded":"2024-05-08T18:10:23.012889+0000","last_fullsized":"2024-05-08T18:10:23.012889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008956+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:10:23.008956+0000","last_peered":"2024-05-08T18:10:23.008956+0000","last_clean":"2024-05-08T18:10:23.008956+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:10:23.008956+0000","last_undegraded":"2024-05-08T18:10:23.008956+0000","last_fullsized":"2024-05-08T18:10:23.008956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"101'10","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011790+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:10:23.011790+0000","last_peered":"2024-05-08T18:10:23.011790+0000","last_clean":"2024-05-08T18:10:23.011790+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:10:23.011790+0000","last_undegraded":"2024-05-08T18:10:23.011790+0000","last_fullsized":"2024-05-08T18:10:23.011790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.254105+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:10:24.254105+0000","last_peered":"2024-05-08T18:10:24.254105+0000","last_clean":"2024-05-08T18:10:24.254105+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:10:24.254105+0000","last_undegraded":"2024-05-08T18:10:24.254105+0000","last_fullsized":"2024-05-08T18:10:24.254105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747745+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:10:23.747745+0000","last_peered":"2024-05-08T18:10:23.747745+0000","last_clean":"2024-05-08T18:10:23.747745+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:10:23.747745+0000","last_undegraded":"2024-05-08T18:10:23.747745+0000","last_fullsized":"2024-05-08T18:10:23.747745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749424+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:10:23.749424+0000","last_peered":"2024-05-08T18:10:23.749424+0000","last_clean":"2024-05-08T18:10:23.749424+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:10:23.749424+0000","last_undegraded":"2024-05-08T18:10:23.749424+0000","last_fullsized":"2024-05-08T18:10:23.749424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"101'14","reported_seq":260,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014250+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:10:23.014250+0000","last_peered":"2024-05-08T18:10:23.014250+0000","last_clean":"2024-05-08T18:10:23.014250+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:10:23.014250+0000","last_undegraded":"2024-05-08T18:10:23.014250+0000","last_fullsized":"2024-05-08T18:10:23.014250+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015918+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:10:23.015918+0000","last_peered":"2024-05-08T18:10:23.015918+0000","last_clean":"2024-05-08T18:10:23.015918+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:10:23.015918+0000","last_undegraded":"2024-05-08T18:10:23.015918+0000","last_fullsized":"2024-05-08T18:10:23.015918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748928+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:10:23.748928+0000","last_peered":"2024-05-08T18:10:23.748928+0000","last_clean":"2024-05-08T18:10:23.748928+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:10:23.748928+0000","last_undegraded":"2024-05-08T18:10:23.748928+0000","last_fullsized":"2024-05-08T18:10:23.748928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"101'17","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019599+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:10:23.019599+0000","last_peered":"2024-05-08T18:10:23.019599+0000","last_clean":"2024-05-08T18:10:23.019599+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:10:23.019599+0000","last_undegraded":"2024-05-08T18:10:23.019599+0000","last_fullsized":"2024-05-08T18:10:23.019599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":40996,"num_write":77,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023317+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:10:23.023317+0000","last_peered":"2024-05-08T18:10:23.023317+0000","last_clean":"2024-05-08T18:10:23.023317+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:10:23.023317+0000","last_undegraded":"2024-05-08T18:10:23.023317+0000","last_fullsized":"2024-05-08T18:10:23.023317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008711+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:10:23.008711+0000","last_peered":"2024-05-08T18:10:23.008711+0000","last_clean":"2024-05-08T18:10:23.008711+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:10:23.008711+0000","last_undegraded":"2024-05-08T18:10:23.008711+0000","last_fullsized":"2024-05-08T18:10:23.008711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"101'42","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674574+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:10:23.674574+0000","last_peered":"2024-05-08T18:10:23.674574+0000","last_clean":"2024-05-08T18:10:23.674574+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:10:23.674574+0000","last_undegraded":"2024-05-08T18:10:23.674574+0000","last_fullsized":"2024-05-08T18:10:23.674574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31839,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":73,"num_read_kb":101,"num_write":56,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010131+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:10:23.010131+0000","last_peered":"2024-05-08T18:10:23.010131+0000","last_clean":"2024-05-08T18:10:23.010131+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:10:23.010131+0000","last_undegraded":"2024-05-08T18:10:23.010131+0000","last_fullsized":"2024-05-08T18:10:23.010131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006701+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:10:23.006701+0000","last_peered":"2024-05-08T18:10:23.006701+0000","last_clean":"2024-05-08T18:10:23.006701+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:10:23.006701+0000","last_undegraded":"2024-05-08T18:10:23.006701+0000","last_fullsized":"2024-05-08T18:10:23.006701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016491+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:10:23.016491+0000","last_peered":"2024-05-08T18:10:23.016491+0000","last_clean":"2024-05-08T18:10:23.016491+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:10:23.016491+0000","last_undegraded":"2024-05-08T18:10:23.016491+0000","last_fullsized":"2024-05-08T18:10:23.016491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"101'34","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749025+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:10:23.749025+0000","last_peered":"2024-05-08T18:10:23.749025+0000","last_clean":"2024-05-08T18:10:23.749025+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:10:23.749025+0000","last_undegraded":"2024-05-08T18:10:23.749025+0000","last_fullsized":"2024-05-08T18:10:23.749025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"101'6","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749652+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:10:23.749652+0000","last_peered":"2024-05-08T18:10:23.749652+0000","last_clean":"2024-05-08T18:10:23.749652+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:10:23.749652+0000","last_undegraded":"2024-05-08T18:10:23.749652+0000","last_fullsized":"2024-05-08T18:10:23.749652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248466+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:10:24.248466+0000","last_peered":"2024-05-08T18:10:24.248466+0000","last_clean":"2024-05-08T18:10:24.248466+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:10:24.248466+0000","last_undegraded":"2024-05-08T18:10:24.248466+0000","last_fullsized":"2024-05-08T18:10:24.248466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"101'18","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008436+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:10:23.008436+0000","last_peered":"2024-05-08T18:10:23.008436+0000","last_clean":"2024-05-08T18:10:23.008436+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:10:23.008436+0000","last_undegraded":"2024-05-08T18:10:23.008436+0000","last_fullsized":"2024-05-08T18:10:23.008436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008394+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:10:23.008394+0000","last_peered":"2024-05-08T18:10:23.008394+0000","last_clean":"2024-05-08T18:10:23.008394+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:10:23.008394+0000","last_undegraded":"2024-05-08T18:10:23.008394+0000","last_fullsized":"2024-05-08T18:10:23.008394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010335+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:10:23.010335+0000","last_peered":"2024-05-08T18:10:23.010335+0000","last_clean":"2024-05-08T18:10:23.010335+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:10:23.010335+0000","last_undegraded":"2024-05-08T18:10:23.010335+0000","last_fullsized":"2024-05-08T18:10:23.010335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248784+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:10:24.248784+0000","last_peered":"2024-05-08T18:10:24.248784+0000","last_clean":"2024-05-08T18:10:24.248784+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:10:24.248784+0000","last_undegraded":"2024-05-08T18:10:24.248784+0000","last_fullsized":"2024-05-08T18:10:24.248784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"101'16","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676106+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:10:23.676106+0000","last_peered":"2024-05-08T18:10:23.676106+0000","last_clean":"2024-05-08T18:10:23.676106+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:10:23.676106+0000","last_undegraded":"2024-05-08T18:10:23.676106+0000","last_fullsized":"2024-05-08T18:10:23.676106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":47128,"num_write":56,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012366+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:10:23.012366+0000","last_peered":"2024-05-08T18:10:23.012366+0000","last_clean":"2024-05-08T18:10:23.012366+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:10:23.012366+0000","last_undegraded":"2024-05-08T18:10:23.012366+0000","last_fullsized":"2024-05-08T18:10:23.012366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"48'5","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015264+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:10:23.015264+0000","last_peered":"2024-05-08T18:10:23.015264+0000","last_clean":"2024-05-08T18:10:23.015264+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:10:23.015264+0000","last_undegraded":"2024-05-08T18:10:23.015264+0000","last_fullsized":"2024-05-08T18:10:23.015264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674157+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:10:23.674157+0000","last_peered":"2024-05-08T18:10:23.674157+0000","last_clean":"2024-05-08T18:10:23.674157+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:10:23.674157+0000","last_undegraded":"2024-05-08T18:10:23.674157+0000","last_fullsized":"2024-05-08T18:10:23.674157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"90'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015893+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:10:23.015893+0000","last_peered":"2024-05-08T18:10:23.015893+0000","last_clean":"2024-05-08T18:10:23.015893+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:10:23.015893+0000","last_undegraded":"2024-05-08T18:10:23.015893+0000","last_fullsized":"2024-05-08T18:10:23.015893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009605+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:10:23.009605+0000","last_peered":"2024-05-08T18:10:23.009605+0000","last_clean":"2024-05-08T18:10:23.009605+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:10:23.009605+0000","last_undegraded":"2024-05-08T18:10:23.009605+0000","last_fullsized":"2024-05-08T18:10:23.009605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"101'15","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008271+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:10:23.008271+0000","last_peered":"2024-05-08T18:10:23.008271+0000","last_clean":"2024-05-08T18:10:23.008271+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:10:23.008271+0000","last_undegraded":"2024-05-08T18:10:23.008271+0000","last_fullsized":"2024-05-08T18:10:23.008271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":47122,"num_write":45,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673614+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:10:23.673614+0000","last_peered":"2024-05-08T18:10:23.673614+0000","last_clean":"2024-05-08T18:10:23.673614+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:10:23.673614+0000","last_undegraded":"2024-05-08T18:10:23.673614+0000","last_fullsized":"2024-05-08T18:10:23.673614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"101'16","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011817+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:10:23.011817+0000","last_peered":"2024-05-08T18:10:23.011817+0000","last_clean":"2024-05-08T18:10:23.011817+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:10:23.011817+0000","last_undegraded":"2024-05-08T18:10:23.011817+0000","last_fullsized":"2024-05-08T18:10:23.011817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020690+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:10:23.020690+0000","last_peered":"2024-05-08T18:10:23.020690+0000","last_clean":"2024-05-08T18:10:23.020690+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:10:23.020690+0000","last_undegraded":"2024-05-08T18:10:23.020690+0000","last_fullsized":"2024-05-08T18:10:23.020690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006544+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:10:23.006544+0000","last_peered":"2024-05-08T18:10:23.006544+0000","last_clean":"2024-05-08T18:10:23.006544+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:10:23.006544+0000","last_undegraded":"2024-05-08T18:10:23.006544+0000","last_fullsized":"2024-05-08T18:10:23.006544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009195+0000","last_change":"2024-05-08T18:07:55.359230+0000","last_active":"2024-05-08T18:10:23.009195+0000","last_peered":"2024-05-08T18:10:23.009195+0000","last_clean":"2024-05-08T18:10:23.009195+0000","last_became_active":"2024-05-08T18:07:55.358047+0000","last_became_peered":"2024-05-08T18:07:55.358047+0000","last_unstale":"2024-05-08T18:10:23.009195+0000","last_undegraded":"2024-05-08T18:10:23.009195+0000","last_fullsized":"2024-05-08T18:10:23.009195+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:52.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018330+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:10:23.018330+0000","last_peered":"2024-05-08T18:10:23.018330+0000","last_clean":"2024-05-08T18:10:23.018330+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:10:23.018330+0000","last_undegraded":"2024-05-08T18:10:23.018330+0000","last_fullsized":"2024-05-08T18:10:23.018330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020607+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:10:23.020607+0000","last_peered":"2024-05-08T18:10:23.020607+0000","last_clean":"2024-05-08T18:10:23.020607+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:10:23.020607+0000","last_undegraded":"2024-05-08T18:10:23.020607+0000","last_fullsized":"2024-05-08T18:10:23.020607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"101'15","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674190+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:10:23.674190+0000","last_peered":"2024-05-08T18:10:23.674190+0000","last_clean":"2024-05-08T18:10:23.674190+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:10:23.674190+0000","last_undegraded":"2024-05-08T18:10:23.674190+0000","last_fullsized":"2024-05-08T18:10:23.674190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013395+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:10:23.013395+0000","last_peered":"2024-05-08T18:10:23.013395+0000","last_clean":"2024-05-08T18:10:23.013395+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:10:23.013395+0000","last_undegraded":"2024-05-08T18:10:23.013395+0000","last_fullsized":"2024-05-08T18:10:23.013395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022955+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:10:23.022955+0000","last_peered":"2024-05-08T18:10:23.022955+0000","last_clean":"2024-05-08T18:10:23.022955+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:10:23.022955+0000","last_undegraded":"2024-05-08T18:10:23.022955+0000","last_fullsized":"2024-05-08T18:10:23.022955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009453+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:10:23.009453+0000","last_peered":"2024-05-08T18:10:23.009453+0000","last_clean":"2024-05-08T18:10:23.009453+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:10:23.009453+0000","last_undegraded":"2024-05-08T18:10:23.009453+0000","last_fullsized":"2024-05-08T18:10:23.009453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":208,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019005+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:10:23.019005+0000","last_peered":"2024-05-08T18:10:23.019005+0000","last_clean":"2024-05-08T18:10:23.019005+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:10:23.019005+0000","last_undegraded":"2024-05-08T18:10:23.019005+0000","last_fullsized":"2024-05-08T18:10:23.019005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"101'24","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252394+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:10:24.252394+0000","last_peered":"2024-05-08T18:10:24.252394+0000","last_clean":"2024-05-08T18:10:24.252394+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:10:24.252394+0000","last_undegraded":"2024-05-08T18:10:24.252394+0000","last_fullsized":"2024-05-08T18:10:24.252394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12641,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":50,"num_write":30,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007070+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:10:23.007070+0000","last_peered":"2024-05-08T18:10:23.007070+0000","last_clean":"2024-05-08T18:10:23.007070+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:10:23.007070+0000","last_undegraded":"2024-05-08T18:10:23.007070+0000","last_fullsized":"2024-05-08T18:10:23.007070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011163+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:10:23.011163+0000","last_peered":"2024-05-08T18:10:23.011163+0000","last_clean":"2024-05-08T18:10:23.011163+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:10:23.011163+0000","last_undegraded":"2024-05-08T18:10:23.011163+0000","last_fullsized":"2024-05-08T18:10:23.011163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019138+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:10:23.019138+0000","last_peered":"2024-05-08T18:10:23.019138+0000","last_clean":"2024-05-08T18:10:23.019138+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:10:23.019138+0000","last_undegraded":"2024-05-08T18:10:23.019138+0000","last_fullsized":"2024-05-08T18:10:23.019138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"91'3","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248368+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:10:24.248368+0000","last_peered":"2024-05-08T18:10:24.248368+0000","last_clean":"2024-05-08T18:10:24.248368+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:10:24.248368+0000","last_undegraded":"2024-05-08T18:10:24.248368+0000","last_fullsized":"2024-05-08T18:10:24.248368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":196,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022596+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:10:23.022596+0000","last_peered":"2024-05-08T18:10:23.022596+0000","last_clean":"2024-05-08T18:10:23.022596+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:10:23.022596+0000","last_undegraded":"2024-05-08T18:10:23.022596+0000","last_fullsized":"2024-05-08T18:10:23.022596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"101'18","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674600+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:10:23.674600+0000","last_peered":"2024-05-08T18:10:23.674600+0000","last_clean":"2024-05-08T18:10:23.674600+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:10:23.674600+0000","last_undegraded":"2024-05-08T18:10:23.674600+0000","last_fullsized":"2024-05-08T18:10:23.674600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252484+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:10:24.252484+0000","last_peered":"2024-05-08T18:10:24.252484+0000","last_clean":"2024-05-08T18:10:24.252484+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:10:24.252484+0000","last_undegraded":"2024-05-08T18:10:24.252484+0000","last_fullsized":"2024-05-08T18:10:24.252484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020215+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:10:23.020215+0000","last_peered":"2024-05-08T18:10:23.020215+0000","last_clean":"2024-05-08T18:10:23.020215+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:10:23.020215+0000","last_undegraded":"2024-05-08T18:10:23.020215+0000","last_fullsized":"2024-05-08T18:10:23.020215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010027+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:10:23.010027+0000","last_peered":"2024-05-08T18:10:23.010027+0000","last_clean":"2024-05-08T18:10:23.010027+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:10:23.010027+0000","last_undegraded":"2024-05-08T18:10:23.010027+0000","last_fullsized":"2024-05-08T18:10:23.010027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"101'6","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749937+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:10:23.749937+0000","last_peered":"2024-05-08T18:10:23.749937+0000","last_clean":"2024-05-08T18:10:23.749937+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:10:23.749937+0000","last_undegraded":"2024-05-08T18:10:23.749937+0000","last_fullsized":"2024-05-08T18:10:23.749937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747838+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:10:23.747838+0000","last_peered":"2024-05-08T18:10:23.747838+0000","last_clean":"2024-05-08T18:10:23.747838+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:10:23.747838+0000","last_undegraded":"2024-05-08T18:10:23.747838+0000","last_fullsized":"2024-05-08T18:10:23.747838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"101'15","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013244+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:10:23.013244+0000","last_peered":"2024-05-08T18:10:23.013244+0000","last_clean":"2024-05-08T18:10:23.013244+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:10:23.013244+0000","last_undegraded":"2024-05-08T18:10:23.013244+0000","last_fullsized":"2024-05-08T18:10:23.013244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247314+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:10:24.247314+0000","last_peered":"2024-05-08T18:10:24.247314+0000","last_clean":"2024-05-08T18:10:24.247314+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:10:24.247314+0000","last_undegraded":"2024-05-08T18:10:24.247314+0000","last_fullsized":"2024-05-08T18:10:24.247314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005943+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:10:23.005943+0000","last_peered":"2024-05-08T18:10:23.005943+0000","last_clean":"2024-05-08T18:10:23.005943+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:10:23.005943+0000","last_undegraded":"2024-05-08T18:10:23.005943+0000","last_fullsized":"2024-05-08T18:10:23.005943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"90'6","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232830+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:10:24.232830+0000","last_peered":"2024-05-08T18:10:24.232830+0000","last_clean":"2024-05-08T18:10:24.232830+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:10:24.232830+0000","last_undegraded":"2024-05-08T18:10:24.232830+0000","last_fullsized":"2024-05-08T18:10:24.232830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"94'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013712+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:10:23.013712+0000","last_peered":"2024-05-08T18:10:23.013712+0000","last_clean":"2024-05-08T18:10:23.013712+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:10:23.013712+0000","last_undegraded":"2024-05-08T18:10:23.013712+0000","last_fullsized":"2024-05-08T18:10:23.013712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":38912,"num_write":11,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252691+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:10:24.252691+0000","last_peered":"2024-05-08T18:10:24.252691+0000","last_clean":"2024-05-08T18:10:24.252691+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:10:24.252691+0000","last_undegraded":"2024-05-08T18:10:24.252691+0000","last_fullsized":"2024-05-08T18:10:24.252691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"91'11","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750421+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:10:23.750421+0000","last_peered":"2024-05-08T18:10:23.750421+0000","last_clean":"2024-05-08T18:10:23.750421+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:10:23.750421+0000","last_undegraded":"2024-05-08T18:10:23.750421+0000","last_fullsized":"2024-05-08T18:10:23.750421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"101'14","reported_seq":250,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022068+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:10:23.022068+0000","last_peered":"2024-05-08T18:10:23.022068+0000","last_clean":"2024-05-08T18:10:23.022068+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:10:23.022068+0000","last_undegraded":"2024-05-08T18:10:23.022068+0000","last_fullsized":"2024-05-08T18:10:23.022068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"101'6","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673614+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:10:23.673614+0000","last_peered":"2024-05-08T18:10:23.673614+0000","last_clean":"2024-05-08T18:10:23.673614+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:10:23.673614+0000","last_undegraded":"2024-05-08T18:10:23.673614+0000","last_fullsized":"2024-05-08T18:10:23.673614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748762+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:10:23.748762+0000","last_peered":"2024-05-08T18:10:23.748762+0000","last_clean":"2024-05-08T18:10:23.748762+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:10:23.748762+0000","last_undegraded":"2024-05-08T18:10:23.748762+0000","last_fullsized":"2024-05-08T18:10:23.748762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"101'9","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007512+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:10:23.007512+0000","last_peered":"2024-05-08T18:10:23.007512+0000","last_clean":"2024-05-08T18:10:23.007512+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:10:23.007512+0000","last_undegraded":"2024-05-08T18:10:23.007512+0000","last_fullsized":"2024-05-08T18:10:23.007512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":24594,"num_write":39,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674308+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:10:23.674308+0000","last_peered":"2024-05-08T18:10:23.674308+0000","last_clean":"2024-05-08T18:10:23.674308+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:10:23.674308+0000","last_undegraded":"2024-05-08T18:10:23.674308+0000","last_fullsized":"2024-05-08T18:10:23.674308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"101'19","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006220+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:10:23.006220+0000","last_peered":"2024-05-08T18:10:23.006220+0000","last_clean":"2024-05-08T18:10:23.006220+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:10:23.006220+0000","last_undegraded":"2024-05-08T18:10:23.006220+0000","last_fullsized":"2024-05-08T18:10:23.006220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5206,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014002+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:10:23.014002+0000","last_peered":"2024-05-08T18:10:23.014002+0000","last_clean":"2024-05-08T18:10:23.014002+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:10:23.014002+0000","last_undegraded":"2024-05-08T18:10:23.014002+0000","last_fullsized":"2024-05-08T18:10:23.014002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"101'2","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676327+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:10:23.676327+0000","last_peered":"2024-05-08T18:10:23.676327+0000","last_clean":"2024-05-08T18:10:23.676327+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:10:23.676327+0000","last_undegraded":"2024-05-08T18:10:23.676327+0000","last_fullsized":"2024-05-08T18:10:23.676327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749701+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:10:23.749701+0000","last_peered":"2024-05-08T18:10:23.749701+0000","last_clean":"2024-05-08T18:10:23.749701+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:10:23.749701+0000","last_undegraded":"2024-05-08T18:10:23.749701+0000","last_fullsized":"2024-05-08T18:10:23.749701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"93'4","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007831+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:10:23.007831+0000","last_peered":"2024-05-08T18:10:23.007831+0000","last_clean":"2024-05-08T18:10:23.007831+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:10:23.007831+0000","last_undegraded":"2024-05-08T18:10:23.007831+0000","last_fullsized":"2024-05-08T18:10:23.007831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006829+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:10:23.006829+0000","last_peered":"2024-05-08T18:10:23.006829+0000","last_clean":"2024-05-08T18:10:23.006829+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:10:23.006829+0000","last_undegraded":"2024-05-08T18:10:23.006829+0000","last_fullsized":"2024-05-08T18:10:23.006829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"101'16","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014381+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:10:23.014381+0000","last_peered":"2024-05-08T18:10:23.014381+0000","last_clean":"2024-05-08T18:10:23.014381+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:10:23.014381+0000","last_undegraded":"2024-05-08T18:10:23.014381+0000","last_fullsized":"2024-05-08T18:10:23.014381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020141+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:10:23.020141+0000","last_peered":"2024-05-08T18:10:23.020141+0000","last_clean":"2024-05-08T18:10:23.020141+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:10:23.020141+0000","last_undegraded":"2024-05-08T18:10:23.020141+0000","last_fullsized":"2024-05-08T18:10:23.020141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010595+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:10:23.010595+0000","last_peered":"2024-05-08T18:10:23.010595+0000","last_clean":"2024-05-08T18:10:23.010595+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:10:23.010595+0000","last_undegraded":"2024-05-08T18:10:23.010595+0000","last_fullsized":"2024-05-08T18:10:23.010595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010032+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:10:23.010032+0000","last_peered":"2024-05-08T18:10:23.010032+0000","last_clean":"2024-05-08T18:10:23.010032+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:10:23.010032+0000","last_undegraded":"2024-05-08T18:10:23.010032+0000","last_fullsized":"2024-05-08T18:10:23.010032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"93'10","reported_seq":172,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247195+0000","last_change":"2024-05-08T18:07:55.439856+0000","last_active":"2024-05-08T18:10:24.247195+0000","last_peered":"2024-05-08T18:10:24.247195+0000","last_clean":"2024-05-08T18:10:24.247195+0000","last_became_active":"2024-05-08T18:07:55.439188+0000","last_became_peered":"2024-05-08T18:07:55.439188+0000","last_unstale":"2024-05-08T18:10:24.247195+0000","last_undegraded":"2024-05-08T18:10:24.247195+0000","last_fullsized":"2024-05-08T18:10:24.247195+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:40.273251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":10,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747721+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:10:23.747721+0000","last_peered":"2024-05-08T18:10:23.747721+0000","last_clean":"2024-05-08T18:10:23.747721+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:10:23.747721+0000","last_undegraded":"2024-05-08T18:10:23.747721+0000","last_fullsized":"2024-05-08T18:10:23.747721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"101'10","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013755+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:10:23.013755+0000","last_peered":"2024-05-08T18:10:23.013755+0000","last_clean":"2024-05-08T18:10:23.013755+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:10:23.013755+0000","last_undegraded":"2024-05-08T18:10:23.013755+0000","last_fullsized":"2024-05-08T18:10:23.013755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10810,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":19,"num_write":12,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748565+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:10:23.748565+0000","last_peered":"2024-05-08T18:10:23.748565+0000","last_clean":"2024-05-08T18:10:23.748565+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:10:23.748565+0000","last_undegraded":"2024-05-08T18:10:23.748565+0000","last_fullsized":"2024-05-08T18:10:23.748565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675169+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:10:23.675169+0000","last_peered":"2024-05-08T18:10:23.675169+0000","last_clean":"2024-05-08T18:10:23.675169+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:10:23.675169+0000","last_undegraded":"2024-05-08T18:10:23.675169+0000","last_fullsized":"2024-05-08T18:10:23.675169+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748961+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:10:23.748961+0000","last_peered":"2024-05-08T18:10:23.748961+0000","last_clean":"2024-05-08T18:10:23.748961+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:10:23.748961+0000","last_undegraded":"2024-05-08T18:10:23.748961+0000","last_fullsized":"2024-05-08T18:10:23.748961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017974+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:10:23.017974+0000","last_peered":"2024-05-08T18:10:23.017974+0000","last_clean":"2024-05-08T18:10:23.017974+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:10:23.017974+0000","last_undegraded":"2024-05-08T18:10:23.017974+0000","last_fullsized":"2024-05-08T18:10:23.017974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247662+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:10:24.247662+0000","last_peered":"2024-05-08T18:10:24.247662+0000","last_clean":"2024-05-08T18:10:24.247662+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:10:24.247662+0000","last_undegraded":"2024-05-08T18:10:24.247662+0000","last_fullsized":"2024-05-08T18:10:24.247662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"101'14","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748818+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:10:23.748818+0000","last_peered":"2024-05-08T18:10:23.748818+0000","last_clean":"2024-05-08T18:10:23.748818+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:10:23.748818+0000","last_undegraded":"2024-05-08T18:10:23.748818+0000","last_fullsized":"2024-05-08T18:10:23.748818+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013086+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:10:23.013086+0000","last_peered":"2024-05-08T18:10:23.013086+0000","last_clean":"2024-05-08T18:10:23.013086+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:10:23.013086+0000","last_undegraded":"2024-05-08T18:10:23.013086+0000","last_fullsized":"2024-05-08T18:10:23.013086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751046+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:10:23.751046+0000","last_peered":"2024-05-08T18:10:23.751046+0000","last_clean":"2024-05-08T18:10:23.751046+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:10:23.751046+0000","last_undegraded":"2024-05-08T18:10:23.751046+0000","last_fullsized":"2024-05-08T18:10:23.751046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"101'36","reported_seq":244,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253470+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:10:24.253470+0000","last_peered":"2024-05-08T18:10:24.253470+0000","last_clean":"2024-05-08T18:10:24.253470+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:10:24.253470+0000","last_undegraded":"2024-05-08T18:10:24.253470+0000","last_fullsized":"2024-05-08T18:10:24.253470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":91,"num_write":52,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"101'18","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019864+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:10:23.019864+0000","last_peered":"2024-05-08T18:10:23.019864+0000","last_clean":"2024-05-08T18:10:23.019864+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:10:23.019864+0000","last_undegraded":"2024-05-08T18:10:23.019864+0000","last_fullsized":"2024-05-08T18:10:23.019864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":47134,"num_write":68,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253866+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:10:24.253866+0000","last_peered":"2024-05-08T18:10:24.253866+0000","last_clean":"2024-05-08T18:10:24.253866+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:10:24.253866+0000","last_undegraded":"2024-05-08T18:10:24.253866+0000","last_fullsized":"2024-05-08T18:10:24.253866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"101'9","reported_seq":226,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.230815+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:10:24.230815+0000","last_peered":"2024-05-08T18:10:24.230815+0000","last_clean":"2024-05-08T18:10:24.230815+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:10:24.230815+0000","last_undegraded":"2024-05-08T18:10:24.230815+0000","last_fullsized":"2024-05-08T18:10:24.230815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":26630,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007320+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:10:23.007320+0000","last_peered":"2024-05-08T18:10:23.007320+0000","last_clean":"2024-05-08T18:10:23.007320+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:10:23.007320+0000","last_undegraded":"2024-05-08T18:10:23.007320+0000","last_fullsized":"2024-05-08T18:10:23.007320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007247+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:10:23.007247+0000","last_peered":"2024-05-08T18:10:23.007247+0000","last_clean":"2024-05-08T18:10:23.007247+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:10:23.007247+0000","last_undegraded":"2024-05-08T18:10:23.007247+0000","last_fullsized":"2024-05-08T18:10:23.007247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251429+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:10:24.251429+0000","last_peered":"2024-05-08T18:10:24.251429+0000","last_clean":"2024-05-08T18:10:24.251429+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:10:24.251429+0000","last_undegraded":"2024-05-08T18:10:24.251429+0000","last_fullsized":"2024-05-08T18:10:24.251429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"101'5","reported_seq":216,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014337+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:10:23.014337+0000","last_peered":"2024-05-08T18:10:23.014337+0000","last_clean":"2024-05-08T18:10:23.014337+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:10:23.014337+0000","last_undegraded":"2024-05-08T18:10:23.014337+0000","last_fullsized":"2024-05-08T18:10:23.014337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":16390,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012990+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:10:23.012990+0000","last_peered":"2024-05-08T18:10:23.012990+0000","last_clean":"2024-05-08T18:10:23.012990+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:10:23.012990+0000","last_undegraded":"2024-05-08T18:10:23.012990+0000","last_fullsized":"2024-05-08T18:10:23.012990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011842+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:10:23.011842+0000","last_peered":"2024-05-08T18:10:23.011842+0000","last_clean":"2024-05-08T18:10:23.011842+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:10:23.011842+0000","last_undegraded":"2024-05-08T18:10:23.011842+0000","last_fullsized":"2024-05-08T18:10:23.011842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749915+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:10:23.749915+0000","last_peered":"2024-05-08T18:10:23.749915+0000","last_clean":"2024-05-08T18:10:23.749915+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:10:23.749915+0000","last_undegraded":"2024-05-08T18:10:23.749915+0000","last_fullsized":"2024-05-08T18:10:23.749915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252920+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:10:24.252920+0000","last_peered":"2024-05-08T18:10:24.252920+0000","last_clean":"2024-05-08T18:10:24.252920+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:10:24.252920+0000","last_undegraded":"2024-05-08T18:10:24.252920+0000","last_fullsized":"2024-05-08T18:10:24.252920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":32786,"num_write":41,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"101'40","reported_seq":251,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009330+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:10:23.009330+0000","last_peered":"2024-05-08T18:10:23.009330+0000","last_clean":"2024-05-08T18:10:23.009330+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:10:23.009330+0000","last_undegraded":"2024-05-08T18:10:23.009330+0000","last_fullsized":"2024-05-08T18:10:23.009330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":102,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"101'9","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022073+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:10:23.022073+0000","last_peered":"2024-05-08T18:10:23.022073+0000","last_clean":"2024-05-08T18:10:23.022073+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:10:23.022073+0000","last_undegraded":"2024-05-08T18:10:23.022073+0000","last_fullsized":"2024-05-08T18:10:23.022073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"90'12","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019735+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:10:23.019735+0000","last_peered":"2024-05-08T18:10:23.019735+0000","last_clean":"2024-05-08T18:10:23.019735+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:10:23.019735+0000","last_undegraded":"2024-05-08T18:10:23.019735+0000","last_fullsized":"2024-05-08T18:10:23.019735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"91'3","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012624+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:10:23.012624+0000","last_peered":"2024-05-08T18:10:23.012624+0000","last_clean":"2024-05-08T18:10:23.012624+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:10:23.012624+0000","last_undegraded":"2024-05-08T18:10:23.012624+0000","last_fullsized":"2024-05-08T18:10:23.012624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017633+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:10:23.017633+0000","last_peered":"2024-05-08T18:10:23.017633+0000","last_clean":"2024-05-08T18:10:23.017633+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:10:23.017633+0000","last_undegraded":"2024-05-08T18:10:23.017633+0000","last_fullsized":"2024-05-08T18:10:23.017633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"101'18","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006664+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:10:23.006664+0000","last_peered":"2024-05-08T18:10:23.006664+0000","last_clean":"2024-05-08T18:10:23.006664+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:10:23.006664+0000","last_undegraded":"2024-05-08T18:10:23.006664+0000","last_fullsized":"2024-05-08T18:10:23.006664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":30,"num_read_kb":55314,"num_write":48,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750654+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:10:23.750654+0000","last_peered":"2024-05-08T18:10:23.750654+0000","last_clean":"2024-05-08T18:10:23.750654+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:10:23.750654+0000","last_undegraded":"2024-05-08T18:10:23.750654+0000","last_fullsized":"2024-05-08T18:10:23.750654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"101'8","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010297+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:10:23.010297+0000","last_peered":"2024-05-08T18:10:23.010297+0000","last_clean":"2024-05-08T18:10:23.010297+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:10:23.010297+0000","last_undegraded":"2024-05-08T18:10:23.010297+0000","last_fullsized":"2024-05-08T18:10:23.010297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.233065+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:10:24.233065+0000","last_peered":"2024-05-08T18:10:24.233065+0000","last_clean":"2024-05-08T18:10:24.233065+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:10:24.233065+0000","last_undegraded":"2024-05-08T18:10:24.233065+0000","last_fullsized":"2024-05-08T18:10:24.233065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"94'7","reported_seq":168,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232504+0000","last_change":"2024-05-08T18:07:55.445745+0000","last_active":"2024-05-08T18:10:24.232504+0000","last_peered":"2024-05-08T18:10:24.232504+0000","last_clean":"2024-05-08T18:10:24.232504+0000","last_became_active":"2024-05-08T18:07:55.444935+0000","last_became_peered":"2024-05-08T18:07:55.444935+0000","last_unstale":"2024-05-08T18:10:24.232504+0000","last_undegraded":"2024-05-08T18:10:24.232504+0000","last_fullsized":"2024-05-08T18:10:24.232504+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:37.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":22528,"num_write":7,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750539+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:10:23.750539+0000","last_peered":"2024-05-08T18:10:23.750539+0000","last_clean":"2024-05-08T18:10:23.750539+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:10:23.750539+0000","last_undegraded":"2024-05-08T18:10:23.750539+0000","last_fullsized":"2024-05-08T18:10:23.750539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"94'6","reported_seq":218,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014718+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:10:23.014718+0000","last_peered":"2024-05-08T18:10:23.014718+0000","last_clean":"2024-05-08T18:10:23.014718+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:10:23.014718+0000","last_undegraded":"2024-05-08T18:10:23.014718+0000","last_fullsized":"2024-05-08T18:10:23.014718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":16390,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674975+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:10:23.674975+0000","last_peered":"2024-05-08T18:10:23.674975+0000","last_clean":"2024-05-08T18:10:23.674975+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:10:23.674975+0000","last_undegraded":"2024-05-08T18:10:23.674975+0000","last_fullsized":"2024-05-08T18:10:23.674975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"101'9","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021427+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:10:23.021427+0000","last_peered":"2024-05-08T18:10:23.021427+0000","last_clean":"2024-05-08T18:10:23.021427+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:10:23.021427+0000","last_undegraded":"2024-05-08T18:10:23.021427+0000","last_fullsized":"2024-05-08T18:10:23.021427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012285+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:10:23.012285+0000","last_peered":"2024-05-08T18:10:23.012285+0000","last_clean":"2024-05-08T18:10:23.012285+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:10:23.012285+0000","last_undegraded":"2024-05-08T18:10:23.012285+0000","last_fullsized":"2024-05-08T18:10:23.012285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676538+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:10:23.676538+0000","last_peered":"2024-05-08T18:10:23.676538+0000","last_clean":"2024-05-08T18:10:23.676538+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:10:23.676538+0000","last_undegraded":"2024-05-08T18:10:23.676538+0000","last_fullsized":"2024-05-08T18:10:23.676538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":26648,"num_write":51,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"101'46","reported_seq":254,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009047+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:10:23.009047+0000","last_peered":"2024-05-08T18:10:23.009047+0000","last_clean":"2024-05-08T18:10:23.009047+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:10:23.009047+0000","last_undegraded":"2024-05-08T18:10:23.009047+0000","last_fullsized":"2024-05-08T18:10:23.009047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"94'11","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232833+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:10:24.232833+0000","last_peered":"2024-05-08T18:10:24.232833+0000","last_clean":"2024-05-08T18:10:24.232833+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:10:24.232833+0000","last_undegraded":"2024-05-08T18:10:24.232833+0000","last_fullsized":"2024-05-08T18:10:24.232833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":45056,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674057+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:10:23.674057+0000","last_peered":"2024-05-08T18:10:23.674057+0000","last_clean":"2024-05-08T18:10:23.674057+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:10:23.674057+0000","last_undegraded":"2024-05-08T18:10:23.674057+0000","last_fullsized":"2024-05-08T18:10:23.674057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"101'9","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008938+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:10:23.008938+0000","last_peered":"2024-05-08T18:10:23.008938+0000","last_clean":"2024-05-08T18:10:23.008938+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:10:23.008938+0000","last_undegraded":"2024-05-08T18:10:23.008938+0000","last_fullsized":"2024-05-08T18:10:23.008938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":26630,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"101'14","reported_seq":234,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006573+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:10:23.006573+0000","last_peered":"2024-05-08T18:10:23.006573+0000","last_clean":"2024-05-08T18:10:23.006573+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:10:23.006573+0000","last_undegraded":"2024-05-08T18:10:23.006573+0000","last_fullsized":"2024-05-08T18:10:23.006573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":18,"num_read_kb":43014,"num_write":24,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017327+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:10:23.017327+0000","last_peered":"2024-05-08T18:10:23.017327+0000","last_clean":"2024-05-08T18:10:23.017327+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:10:23.017327+0000","last_undegraded":"2024-05-08T18:10:23.017327+0000","last_fullsized":"2024-05-08T18:10:23.017327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"101'12","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248214+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:10:24.248214+0000","last_peered":"2024-05-08T18:10:24.248214+0000","last_clean":"2024-05-08T18:10:24.248214+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:10:24.248214+0000","last_undegraded":"2024-05-08T18:10:24.248214+0000","last_fullsized":"2024-05-08T18:10:24.248214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":40966,"num_write":22,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008111+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:10:23.008111+0000","last_peered":"2024-05-08T18:10:23.008111+0000","last_clean":"2024-05-08T18:10:23.008111+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:10:23.008111+0000","last_undegraded":"2024-05-08T18:10:23.008111+0000","last_fullsized":"2024-05-08T18:10:23.008111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":242921,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":927,"num_read_kb":920,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":230738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575,"ondisk_log_size":575,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1100,"num_read_kb":2048660,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":446992,"kb_used_data":415804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93924848,"statfs":{"total":96636764160,"available":96179044352,"internally_reserved":0,"allocated":425783296,"data_stored":425104836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":331656,"kb_used_data":300476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94040184,"statfs":{"total":96636764160,"available":96297148416,"internally_reserved":0,"allocated":307687424,"data_stored":307055531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":536544,"kb_used_data":505356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93835296,"statfs":{"total":96636764160,"available":96087343104,"internally_reserved":0,"allocated":517484544,"data_stored":516790953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487276,"kb_used_data":456088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93884564,"statfs":{"total":96636764160,"available":96137793536,"internally_reserved":0,"allocated":467034112,"data_stored":466424514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":524200,"kb_used_data":493016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93847640,"statfs":{"total":96636764160,"available":96099983360,"internally_reserved":0,"allocated":504848384,"data_stored":504193220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":317284,"kb_used_data":286104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94054556,"statfs":{"total":96636764160,"available":96311865344,"internally_reserved":0,"allocated":292970496,"data_stored":292361081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303024,"kb_used_data":271844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94068816,"statfs":{"total":96636764160,"available":96326467584,"internally_reserved":0,"allocated":278368256,"data_stored":277720808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":510420,"kb_used_data":479240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93861420,"statfs":{"total":96636764160,"available":96114094080,"internally_reserved":0,"allocated":490741760,"data_stored":490101965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":488636416,"data_stored":488636416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":276824064,"data_stored":276824064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":291504128,"data_stored":291504128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":503316480,"data_stored":503316480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":465567744,"data_stored":465567744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":515899392,"data_stored":515899392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":306184192,"data_stored":306184192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":423624704,"data_stored":423624704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":27109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":49062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":9271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":29104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":42748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":23703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":41692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:10:28.051 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-08T18:10:28.052 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-05-08T18:10:28.384 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-05-08T18:10:28.394 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-05-08T18:10:28.394 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:10:28.396 INFO:tasks.rgw.client.0.smithi080.stdout:2024-05-08T18:10:28.399+0000 7f317287e640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 31685) UID: 0 2024-05-08T18:10:28.396 INFO:tasks.rgw.client.0.smithi080.stdout:2024-05-08T18:10:28.399+0000 7f31760c6a40 -1 shutting down 2024-05-08T18:10:31.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-05-08T18:10:34.496 INFO:tasks.rgw.client.0:Stopped 2024-05-08T18:10:34.497 DEBUG:teuthology.orchestra.run.smithi080:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-05-08T18:10:34.503 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /etc/ceph/vault-root-token 2024-05-08T18:10:34.559 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-05-08T18:10:34.618 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-05-08T18:10:34.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-05-08T18:10:34.618 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-05-08T18:10:35.627 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-08T18:10:35.641 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T18:10:35.641 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:10:35.989 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:10:35.995 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:10:36.011 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2024-05-08T18:10:35.729697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636613462,"num_objects":637,"num_object_clones":0,"num_object_copies":1274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":3825,"num_read_kb":2050946,"num_write":3270,"num_write_kb":2050294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1943,"ondisk_log_size":1943,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3457352,"kb_used_data":3207928,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":751517368,"statfs":{"total":773094113280,"available":769553784832,"internally_reserved":0,"allocated":3284918272,"data_stored":3279752908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005639"},"pg_stats":[{"pgid":"3.3f","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676116+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:10:23.676116+0000","last_peered":"2024-05-08T18:10:23.676116+0000","last_clean":"2024-05-08T18:10:23.676116+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:10:23.676116+0000","last_undegraded":"2024-05-08T18:10:23.676116+0000","last_fullsized":"2024-05-08T18:10:23.676116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":34822,"num_write":21,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005921+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:10:23.005921+0000","last_peered":"2024-05-08T18:10:23.005921+0000","last_clean":"2024-05-08T18:10:23.005921+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:10:23.005921+0000","last_undegraded":"2024-05-08T18:10:23.005921+0000","last_fullsized":"2024-05-08T18:10:23.005921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"93'7","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.254012+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:10:24.254012+0000","last_peered":"2024-05-08T18:10:24.254012+0000","last_clean":"2024-05-08T18:10:24.254012+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:10:24.254012+0000","last_undegraded":"2024-05-08T18:10:24.254012+0000","last_fullsized":"2024-05-08T18:10:24.254012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674165+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:10:23.674165+0000","last_peered":"2024-05-08T18:10:23.674165+0000","last_clean":"2024-05-08T18:10:23.674165+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:10:23.674165+0000","last_undegraded":"2024-05-08T18:10:23.674165+0000","last_fullsized":"2024-05-08T18:10:23.674165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"101'15","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016426+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:10:23.016426+0000","last_peered":"2024-05-08T18:10:23.016426+0000","last_clean":"2024-05-08T18:10:23.016426+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:10:23.016426+0000","last_undegraded":"2024-05-08T18:10:23.016426+0000","last_fullsized":"2024-05-08T18:10:23.016426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":47116,"num_write":35,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749409+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:10:23.749409+0000","last_peered":"2024-05-08T18:10:23.749409+0000","last_clean":"2024-05-08T18:10:23.749409+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:10:23.749409+0000","last_undegraded":"2024-05-08T18:10:23.749409+0000","last_fullsized":"2024-05-08T18:10:23.749409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"101'13","reported_seq":232,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007371+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:10:23.007371+0000","last_peered":"2024-05-08T18:10:23.007371+0000","last_clean":"2024-05-08T18:10:23.007371+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:10:23.007371+0000","last_undegraded":"2024-05-08T18:10:23.007371+0000","last_fullsized":"2024-05-08T18:10:23.007371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40972,"num_write":33,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014036+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:10:23.014036+0000","last_peered":"2024-05-08T18:10:23.014036+0000","last_clean":"2024-05-08T18:10:23.014036+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:10:23.014036+0000","last_undegraded":"2024-05-08T18:10:23.014036+0000","last_fullsized":"2024-05-08T18:10:23.014036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"101'5","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675565+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:10:23.675565+0000","last_peered":"2024-05-08T18:10:23.675565+0000","last_clean":"2024-05-08T18:10:23.675565+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:10:23.675565+0000","last_undegraded":"2024-05-08T18:10:23.675565+0000","last_fullsized":"2024-05-08T18:10:23.675565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14342,"num_write":15,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021174+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:10:23.021174+0000","last_peered":"2024-05-08T18:10:23.021174+0000","last_clean":"2024-05-08T18:10:23.021174+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:10:23.021174+0000","last_undegraded":"2024-05-08T18:10:23.021174+0000","last_fullsized":"2024-05-08T18:10:23.021174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"101'9","reported_seq":172,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232335+0000","last_change":"2024-05-08T18:07:55.439965+0000","last_active":"2024-05-08T18:10:24.232335+0000","last_peered":"2024-05-08T18:10:24.232335+0000","last_clean":"2024-05-08T18:10:24.232335+0000","last_became_active":"2024-05-08T18:07:55.439578+0000","last_became_peered":"2024-05-08T18:07:55.439578+0000","last_unstale":"2024-05-08T18:10:24.232335+0000","last_undegraded":"2024-05-08T18:10:24.232335+0000","last_fullsized":"2024-05-08T18:10:24.232335+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:30.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":22540,"num_write":29,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"101'86","reported_seq":299,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750093+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:10:23.750093+0000","last_peered":"2024-05-08T18:10:23.750093+0000","last_clean":"2024-05-08T18:10:23.750093+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:10:23.750093+0000","last_undegraded":"2024-05-08T18:10:23.750093+0000","last_fullsized":"2024-05-08T18:10:23.750093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":219,"num_write":126,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"101'9","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674555+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:10:23.674555+0000","last_peered":"2024-05-08T18:10:23.674555+0000","last_clean":"2024-05-08T18:10:23.674555+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:10:23.674555+0000","last_undegraded":"2024-05-08T18:10:23.674555+0000","last_fullsized":"2024-05-08T18:10:23.674555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32774,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007751+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:10:23.007751+0000","last_peered":"2024-05-08T18:10:23.007751+0000","last_clean":"2024-05-08T18:10:23.007751+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:10:23.007751+0000","last_undegraded":"2024-05-08T18:10:23.007751+0000","last_fullsized":"2024-05-08T18:10:23.007751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"101'14","reported_seq":237,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009256+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:10:23.009256+0000","last_peered":"2024-05-08T18:10:23.009256+0000","last_clean":"2024-05-08T18:10:23.009256+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:10:23.009256+0000","last_undegraded":"2024-05-08T18:10:23.009256+0000","last_fullsized":"2024-05-08T18:10:23.009256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":167,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013504+0000","last_change":"2024-05-08T18:07:47.007132+0000","last_active":"2024-05-08T18:10:23.013504+0000","last_peered":"2024-05-08T18:10:23.013504+0000","last_clean":"2024-05-08T18:10:23.013504+0000","last_became_active":"2024-05-08T18:07:47.006744+0000","last_became_peered":"2024-05-08T18:07:47.006744+0000","last_unstale":"2024-05-08T18:10:23.013504+0000","last_undegraded":"2024-05-08T18:10:23.013504+0000","last_fullsized":"2024-05-08T18:10:23.013504+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:32.802677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748681+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:10:23.748681+0000","last_peered":"2024-05-08T18:10:23.748681+0000","last_clean":"2024-05-08T18:10:23.748681+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:10:23.748681+0000","last_undegraded":"2024-05-08T18:10:23.748681+0000","last_fullsized":"2024-05-08T18:10:23.748681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"101'17","reported_seq":243,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676155+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:10:23.676155+0000","last_peered":"2024-05-08T18:10:23.676155+0000","last_clean":"2024-05-08T18:10:23.676155+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:10:23.676155+0000","last_undegraded":"2024-05-08T18:10:23.676155+0000","last_fullsized":"2024-05-08T18:10:23.676155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":33,"num_read_kb":49176,"num_write":57,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674465+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:10:23.674465+0000","last_peered":"2024-05-08T18:10:23.674465+0000","last_clean":"2024-05-08T18:10:23.674465+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:10:23.674465+0000","last_undegraded":"2024-05-08T18:10:23.674465+0000","last_fullsized":"2024-05-08T18:10:23.674465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"94'10","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021892+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:10:23.021892+0000","last_peered":"2024-05-08T18:10:23.021892+0000","last_clean":"2024-05-08T18:10:23.021892+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:10:23.021892+0000","last_undegraded":"2024-05-08T18:10:23.021892+0000","last_fullsized":"2024-05-08T18:10:23.021892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":32768,"num_write":10,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"101'48","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007110+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:10:23.007110+0000","last_peered":"2024-05-08T18:10:23.007110+0000","last_clean":"2024-05-08T18:10:23.007110+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:10:23.007110+0000","last_undegraded":"2024-05-08T18:10:23.007110+0000","last_fullsized":"2024-05-08T18:10:23.007110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":122,"num_write":70,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"101'6","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021580+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:10:23.021580+0000","last_peered":"2024-05-08T18:10:23.021580+0000","last_clean":"2024-05-08T18:10:23.021580+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:10:23.021580+0000","last_undegraded":"2024-05-08T18:10:23.021580+0000","last_fullsized":"2024-05-08T18:10:23.021580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.233381+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:10:24.233381+0000","last_peered":"2024-05-08T18:10:24.233381+0000","last_clean":"2024-05-08T18:10:24.233381+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:10:24.233381+0000","last_undegraded":"2024-05-08T18:10:24.233381+0000","last_fullsized":"2024-05-08T18:10:24.233381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"94'8","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749710+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:10:23.749710+0000","last_peered":"2024-05-08T18:10:23.749710+0000","last_clean":"2024-05-08T18:10:23.749710+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:10:23.749710+0000","last_undegraded":"2024-05-08T18:10:23.749710+0000","last_fullsized":"2024-05-08T18:10:23.749710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232925+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:10:24.232925+0000","last_peered":"2024-05-08T18:10:24.232925+0000","last_clean":"2024-05-08T18:10:24.232925+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:10:24.232925+0000","last_undegraded":"2024-05-08T18:10:24.232925+0000","last_fullsized":"2024-05-08T18:10:24.232925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"101'6","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012083+0000","last_change":"2024-05-08T18:09:38.328162+0000","last_active":"2024-05-08T18:10:23.012083+0000","last_peered":"2024-05-08T18:10:23.012083+0000","last_clean":"2024-05-08T18:10:23.012083+0000","last_became_active":"2024-05-08T18:09:38.182438+0000","last_became_peered":"2024-05-08T18:09:38.182438+0000","last_unstale":"2024-05-08T18:10:23.012083+0000","last_undegraded":"2024-05-08T18:10:23.012083+0000","last_fullsized":"2024-05-08T18:10:23.012083+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:05.642615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751059+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:10:23.751059+0000","last_peered":"2024-05-08T18:10:23.751059+0000","last_clean":"2024-05-08T18:10:23.751059+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:10:23.751059+0000","last_undegraded":"2024-05-08T18:10:23.751059+0000","last_fullsized":"2024-05-08T18:10:23.751059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"101'9","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013579+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:10:23.013579+0000","last_peered":"2024-05-08T18:10:23.013579+0000","last_clean":"2024-05-08T18:10:23.013579+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:10:23.013579+0000","last_undegraded":"2024-05-08T18:10:23.013579+0000","last_fullsized":"2024-05-08T18:10:23.013579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":28678,"num_write":19,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748132+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:10:23.748132+0000","last_peered":"2024-05-08T18:10:23.748132+0000","last_clean":"2024-05-08T18:10:23.748132+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:10:23.748132+0000","last_undegraded":"2024-05-08T18:10:23.748132+0000","last_fullsized":"2024-05-08T18:10:23.748132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011135+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:10:23.011135+0000","last_peered":"2024-05-08T18:10:23.011135+0000","last_clean":"2024-05-08T18:10:23.011135+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:10:23.011135+0000","last_undegraded":"2024-05-08T18:10:23.011135+0000","last_fullsized":"2024-05-08T18:10:23.011135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"101'12","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675916+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:10:23.675916+0000","last_peered":"2024-05-08T18:10:23.675916+0000","last_clean":"2024-05-08T18:10:23.675916+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:10:23.675916+0000","last_undegraded":"2024-05-08T18:10:23.675916+0000","last_fullsized":"2024-05-08T18:10:23.675916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":36876,"num_write":32,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007061+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:10:23.007061+0000","last_peered":"2024-05-08T18:10:23.007061+0000","last_clean":"2024-05-08T18:10:23.007061+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:10:23.007061+0000","last_undegraded":"2024-05-08T18:10:23.007061+0000","last_fullsized":"2024-05-08T18:10:23.007061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"101'12","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018739+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:10:23.018739+0000","last_peered":"2024-05-08T18:10:23.018739+0000","last_clean":"2024-05-08T18:10:23.018739+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:10:23.018739+0000","last_undegraded":"2024-05-08T18:10:23.018739+0000","last_fullsized":"2024-05-08T18:10:23.018739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675833+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:10:23.675833+0000","last_peered":"2024-05-08T18:10:23.675833+0000","last_clean":"2024-05-08T18:10:23.675833+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:10:23.675833+0000","last_undegraded":"2024-05-08T18:10:23.675833+0000","last_fullsized":"2024-05-08T18:10:23.675833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005832+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:10:23.005832+0000","last_peered":"2024-05-08T18:10:23.005832+0000","last_clean":"2024-05-08T18:10:23.005832+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:10:23.005832+0000","last_undegraded":"2024-05-08T18:10:23.005832+0000","last_fullsized":"2024-05-08T18:10:23.005832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007823+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:10:23.007823+0000","last_peered":"2024-05-08T18:10:23.007823+0000","last_clean":"2024-05-08T18:10:23.007823+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:10:23.007823+0000","last_undegraded":"2024-05-08T18:10:23.007823+0000","last_fullsized":"2024-05-08T18:10:23.007823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013931+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:10:23.013931+0000","last_peered":"2024-05-08T18:10:23.013931+0000","last_clean":"2024-05-08T18:10:23.013931+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:10:23.013931+0000","last_undegraded":"2024-05-08T18:10:23.013931+0000","last_fullsized":"2024-05-08T18:10:23.013931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":30738,"num_write":41,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010902+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:10:23.010902+0000","last_peered":"2024-05-08T18:10:23.010902+0000","last_clean":"2024-05-08T18:10:23.010902+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:10:23.010902+0000","last_undegraded":"2024-05-08T18:10:23.010902+0000","last_fullsized":"2024-05-08T18:10:23.010902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"101'7","reported_seq":206,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750625+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:10:23.750625+0000","last_peered":"2024-05-08T18:10:23.750625+0000","last_clean":"2024-05-08T18:10:23.750625+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:10:23.750625+0000","last_undegraded":"2024-05-08T18:10:23.750625+0000","last_fullsized":"2024-05-08T18:10:23.750625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750086+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:10:23.750086+0000","last_peered":"2024-05-08T18:10:23.750086+0000","last_clean":"2024-05-08T18:10:23.750086+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:10:23.750086+0000","last_undegraded":"2024-05-08T18:10:23.750086+0000","last_fullsized":"2024-05-08T18:10:23.750086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012615+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:10:23.012615+0000","last_peered":"2024-05-08T18:10:23.012615+0000","last_clean":"2024-05-08T18:10:23.012615+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:10:23.012615+0000","last_undegraded":"2024-05-08T18:10:23.012615+0000","last_fullsized":"2024-05-08T18:10:23.012615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"90'6","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019369+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:10:23.019369+0000","last_peered":"2024-05-08T18:10:23.019369+0000","last_clean":"2024-05-08T18:10:23.019369+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:10:23.019369+0000","last_undegraded":"2024-05-08T18:10:23.019369+0000","last_fullsized":"2024-05-08T18:10:23.019369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"101'9","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675435+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:10:23.675435+0000","last_peered":"2024-05-08T18:10:23.675435+0000","last_clean":"2024-05-08T18:10:23.675435+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:10:23.675435+0000","last_undegraded":"2024-05-08T18:10:23.675435+0000","last_fullsized":"2024-05-08T18:10:23.675435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":28684,"num_write":29,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013381+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:10:23.013381+0000","last_peered":"2024-05-08T18:10:23.013381+0000","last_clean":"2024-05-08T18:10:23.013381+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:10:23.013381+0000","last_undegraded":"2024-05-08T18:10:23.013381+0000","last_fullsized":"2024-05-08T18:10:23.013381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232567+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:10:24.232567+0000","last_peered":"2024-05-08T18:10:24.232567+0000","last_clean":"2024-05-08T18:10:24.232567+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:10:24.232567+0000","last_undegraded":"2024-05-08T18:10:24.232567+0000","last_fullsized":"2024-05-08T18:10:24.232567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"120'15","reported_seq":257,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.761766+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:10:24.761766+0000","last_peered":"2024-05-08T18:10:24.761766+0000","last_clean":"2024-05-08T18:10:24.761766+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:10:24.761766+0000","last_undegraded":"2024-05-08T18:10:24.761766+0000","last_fullsized":"2024-05-08T18:10:24.761766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"101'4","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748730+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:10:23.748730+0000","last_peered":"2024-05-08T18:10:23.748730+0000","last_clean":"2024-05-08T18:10:23.748730+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:10:23.748730+0000","last_undegraded":"2024-05-08T18:10:23.748730+0000","last_fullsized":"2024-05-08T18:10:23.748730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012204+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:10:23.012204+0000","last_peered":"2024-05-08T18:10:23.012204+0000","last_clean":"2024-05-08T18:10:23.012204+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:10:23.012204+0000","last_undegraded":"2024-05-08T18:10:23.012204+0000","last_fullsized":"2024-05-08T18:10:23.012204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"101'8","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020021+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:10:23.020021+0000","last_peered":"2024-05-08T18:10:23.020021+0000","last_clean":"2024-05-08T18:10:23.020021+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:10:23.020021+0000","last_undegraded":"2024-05-08T18:10:23.020021+0000","last_fullsized":"2024-05-08T18:10:23.020021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007769+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:10:23.007769+0000","last_peered":"2024-05-08T18:10:23.007769+0000","last_clean":"2024-05-08T18:10:23.007769+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:10:23.007769+0000","last_undegraded":"2024-05-08T18:10:23.007769+0000","last_fullsized":"2024-05-08T18:10:23.007769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"101'12","reported_seq":216,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675041+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:10:23.675041+0000","last_peered":"2024-05-08T18:10:23.675041+0000","last_clean":"2024-05-08T18:10:23.675041+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:10:23.675041+0000","last_undegraded":"2024-05-08T18:10:23.675041+0000","last_fullsized":"2024-05-08T18:10:23.675041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"120'15","reported_seq":245,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.765274+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:10:24.765274+0000","last_peered":"2024-05-08T18:10:24.765274+0000","last_clean":"2024-05-08T18:10:24.765274+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:10:24.765274+0000","last_undegraded":"2024-05-08T18:10:24.765274+0000","last_fullsized":"2024-05-08T18:10:24.765274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006408+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:10:23.006408+0000","last_peered":"2024-05-08T18:10:23.006408+0000","last_clean":"2024-05-08T18:10:23.006408+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:10:23.006408+0000","last_undegraded":"2024-05-08T18:10:23.006408+0000","last_fullsized":"2024-05-08T18:10:23.006408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"101'17","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232514+0000","last_change":"2024-05-08T18:07:55.357969+0000","last_active":"2024-05-08T18:10:24.232514+0000","last_peered":"2024-05-08T18:10:24.232514+0000","last_clean":"2024-05-08T18:10:24.232514+0000","last_became_active":"2024-05-08T18:07:55.357205+0000","last_became_peered":"2024-05-08T18:07:55.357205+0000","last_unstale":"2024-05-08T18:10:24.232514+0000","last_undegraded":"2024-05-08T18:10:24.232514+0000","last_fullsized":"2024-05-08T18:10:24.232514+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:04.667292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":29,"num_read_kb":51218,"num_write":47,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673147+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:10:23.673147+0000","last_peered":"2024-05-08T18:10:23.673147+0000","last_clean":"2024-05-08T18:10:23.673147+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:10:23.673147+0000","last_undegraded":"2024-05-08T18:10:23.673147+0000","last_fullsized":"2024-05-08T18:10:23.673147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"101'24","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005976+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:10:23.005976+0000","last_peered":"2024-05-08T18:10:23.005976+0000","last_clean":"2024-05-08T18:10:23.005976+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:10:23.005976+0000","last_undegraded":"2024-05-08T18:10:23.005976+0000","last_fullsized":"2024-05-08T18:10:23.005976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5766,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251690+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:10:24.251690+0000","last_peered":"2024-05-08T18:10:24.251690+0000","last_clean":"2024-05-08T18:10:24.251690+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:10:24.251690+0000","last_undegraded":"2024-05-08T18:10:24.251690+0000","last_fullsized":"2024-05-08T18:10:24.251690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006819+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:10:23.006819+0000","last_peered":"2024-05-08T18:10:23.006819+0000","last_clean":"2024-05-08T18:10:23.006819+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:10:23.006819+0000","last_undegraded":"2024-05-08T18:10:23.006819+0000","last_fullsized":"2024-05-08T18:10:23.006819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"90'2","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748795+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:10:23.748795+0000","last_peered":"2024-05-08T18:10:23.748795+0000","last_clean":"2024-05-08T18:10:23.748795+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:10:23.748795+0000","last_undegraded":"2024-05-08T18:10:23.748795+0000","last_fullsized":"2024-05-08T18:10:23.748795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"101'12","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676002+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:10:23.676002+0000","last_peered":"2024-05-08T18:10:23.676002+0000","last_clean":"2024-05-08T18:10:23.676002+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:10:23.676002+0000","last_undegraded":"2024-05-08T18:10:23.676002+0000","last_fullsized":"2024-05-08T18:10:23.676002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":32792,"num_write":52,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.230736+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:10:24.230736+0000","last_peered":"2024-05-08T18:10:24.230736+0000","last_clean":"2024-05-08T18:10:24.230736+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:10:24.230736+0000","last_undegraded":"2024-05-08T18:10:24.230736+0000","last_fullsized":"2024-05-08T18:10:24.230736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"101'13","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013219+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:10:23.013219+0000","last_peered":"2024-05-08T18:10:23.013219+0000","last_clean":"2024-05-08T18:10:23.013219+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:10:23.013219+0000","last_undegraded":"2024-05-08T18:10:23.013219+0000","last_fullsized":"2024-05-08T18:10:23.013219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009871+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:10:23.009871+0000","last_peered":"2024-05-08T18:10:23.009871+0000","last_clean":"2024-05-08T18:10:23.009871+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:10:23.009871+0000","last_undegraded":"2024-05-08T18:10:23.009871+0000","last_fullsized":"2024-05-08T18:10:23.009871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020405+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:10:23.020405+0000","last_peered":"2024-05-08T18:10:23.020405+0000","last_clean":"2024-05-08T18:10:23.020405+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:10:23.020405+0000","last_undegraded":"2024-05-08T18:10:23.020405+0000","last_fullsized":"2024-05-08T18:10:23.020405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"101'34","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021104+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:10:23.021104+0000","last_peered":"2024-05-08T18:10:23.021104+0000","last_clean":"2024-05-08T18:10:23.021104+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:10:23.021104+0000","last_undegraded":"2024-05-08T18:10:23.021104+0000","last_fullsized":"2024-05-08T18:10:23.021104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"101'6","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676260+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:10:23.676260+0000","last_peered":"2024-05-08T18:10:23.676260+0000","last_clean":"2024-05-08T18:10:23.676260+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:10:23.676260+0000","last_undegraded":"2024-05-08T18:10:23.676260+0000","last_fullsized":"2024-05-08T18:10:23.676260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.231219+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:10:24.231219+0000","last_peered":"2024-05-08T18:10:24.231219+0000","last_clean":"2024-05-08T18:10:24.231219+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:10:24.231219+0000","last_undegraded":"2024-05-08T18:10:24.231219+0000","last_fullsized":"2024-05-08T18:10:24.231219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"101'18","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674346+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:10:23.674346+0000","last_peered":"2024-05-08T18:10:23.674346+0000","last_clean":"2024-05-08T18:10:23.674346+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:10:23.674346+0000","last_undegraded":"2024-05-08T18:10:23.674346+0000","last_fullsized":"2024-05-08T18:10:23.674346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"120'15","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.765543+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:10:24.765543+0000","last_peered":"2024-05-08T18:10:24.765543+0000","last_clean":"2024-05-08T18:10:24.765543+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:10:24.765543+0000","last_undegraded":"2024-05-08T18:10:24.765543+0000","last_fullsized":"2024-05-08T18:10:24.765543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"101'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018672+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:10:23.018672+0000","last_peered":"2024-05-08T18:10:23.018672+0000","last_clean":"2024-05-08T18:10:23.018672+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:10:23.018672+0000","last_undegraded":"2024-05-08T18:10:23.018672+0000","last_fullsized":"2024-05-08T18:10:23.018672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015490+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:10:23.015490+0000","last_peered":"2024-05-08T18:10:23.015490+0000","last_clean":"2024-05-08T18:10:23.015490+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:10:23.015490+0000","last_undegraded":"2024-05-08T18:10:23.015490+0000","last_fullsized":"2024-05-08T18:10:23.015490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"101'18","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007808+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:10:23.007808+0000","last_peered":"2024-05-08T18:10:23.007808+0000","last_clean":"2024-05-08T18:10:23.007808+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:10:23.007808+0000","last_undegraded":"2024-05-08T18:10:23.007808+0000","last_fullsized":"2024-05-08T18:10:23.007808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":34,"num_read_kb":55320,"num_write":58,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232646+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:10:24.232646+0000","last_peered":"2024-05-08T18:10:24.232646+0000","last_clean":"2024-05-08T18:10:24.232646+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:10:24.232646+0000","last_undegraded":"2024-05-08T18:10:24.232646+0000","last_fullsized":"2024-05-08T18:10:24.232646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"101'22","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011471+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:10:23.011471+0000","last_peered":"2024-05-08T18:10:23.011471+0000","last_clean":"2024-05-08T18:10:23.011471+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:10:23.011471+0000","last_undegraded":"2024-05-08T18:10:23.011471+0000","last_fullsized":"2024-05-08T18:10:23.011471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.230902+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:10:24.230902+0000","last_peered":"2024-05-08T18:10:24.230902+0000","last_clean":"2024-05-08T18:10:24.230902+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:10:24.230902+0000","last_undegraded":"2024-05-08T18:10:24.230902+0000","last_fullsized":"2024-05-08T18:10:24.230902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253338+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:10:24.253338+0000","last_peered":"2024-05-08T18:10:24.253338+0000","last_clean":"2024-05-08T18:10:24.253338+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:10:24.253338+0000","last_undegraded":"2024-05-08T18:10:24.253338+0000","last_fullsized":"2024-05-08T18:10:24.253338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750534+0000","last_change":"2024-05-08T18:07:55.356946+0000","last_active":"2024-05-08T18:10:23.750534+0000","last_peered":"2024-05-08T18:10:23.750534+0000","last_clean":"2024-05-08T18:10:23.750534+0000","last_became_active":"2024-05-08T18:07:55.355948+0000","last_became_peered":"2024-05-08T18:07:55.355948+0000","last_unstale":"2024-05-08T18:10:23.750534+0000","last_undegraded":"2024-05-08T18:10:23.750534+0000","last_fullsized":"2024-05-08T18:10:23.750534+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:04.163382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"94'9","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011429+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:10:23.011429+0000","last_peered":"2024-05-08T18:10:23.011429+0000","last_clean":"2024-05-08T18:10:23.011429+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:10:23.011429+0000","last_undegraded":"2024-05-08T18:10:23.011429+0000","last_fullsized":"2024-05-08T18:10:23.011429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232927+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:10:24.232927+0000","last_peered":"2024-05-08T18:10:24.232927+0000","last_clean":"2024-05-08T18:10:24.232927+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:10:24.232927+0000","last_undegraded":"2024-05-08T18:10:24.232927+0000","last_fullsized":"2024-05-08T18:10:24.232927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"104'17","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750330+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:10:23.750330+0000","last_peered":"2024-05-08T18:10:23.750330+0000","last_clean":"2024-05-08T18:10:23.750330+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:10:23.750330+0000","last_undegraded":"2024-05-08T18:10:23.750330+0000","last_fullsized":"2024-05-08T18:10:23.750330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10256,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":24,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017020+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:10:23.017020+0000","last_peered":"2024-05-08T18:10:23.017020+0000","last_clean":"2024-05-08T18:10:23.017020+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:10:23.017020+0000","last_undegraded":"2024-05-08T18:10:23.017020+0000","last_fullsized":"2024-05-08T18:10:23.017020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"90'2","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008384+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:10:23.008384+0000","last_peered":"2024-05-08T18:10:23.008384+0000","last_clean":"2024-05-08T18:10:23.008384+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:10:23.008384+0000","last_undegraded":"2024-05-08T18:10:23.008384+0000","last_fullsized":"2024-05-08T18:10:23.008384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751087+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:10:23.751087+0000","last_peered":"2024-05-08T18:10:23.751087+0000","last_clean":"2024-05-08T18:10:23.751087+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:10:23.751087+0000","last_undegraded":"2024-05-08T18:10:23.751087+0000","last_fullsized":"2024-05-08T18:10:23.751087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"101'6","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021301+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:10:23.021301+0000","last_peered":"2024-05-08T18:10:23.021301+0000","last_clean":"2024-05-08T18:10:23.021301+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:10:23.021301+0000","last_undegraded":"2024-05-08T18:10:23.021301+0000","last_fullsized":"2024-05-08T18:10:23.021301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":16390,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251079+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:10:24.251079+0000","last_peered":"2024-05-08T18:10:24.251079+0000","last_clean":"2024-05-08T18:10:24.251079+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:10:24.251079+0000","last_undegraded":"2024-05-08T18:10:24.251079+0000","last_fullsized":"2024-05-08T18:10:24.251079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"101'19","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232755+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:10:24.232755+0000","last_peered":"2024-05-08T18:10:24.232755+0000","last_clean":"2024-05-08T18:10:24.232755+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:10:24.232755+0000","last_undegraded":"2024-05-08T18:10:24.232755+0000","last_fullsized":"2024-05-08T18:10:24.232755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"120'15","reported_seq":250,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.765590+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:10:24.765590+0000","last_peered":"2024-05-08T18:10:24.765590+0000","last_clean":"2024-05-08T18:10:24.765590+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:10:24.765590+0000","last_undegraded":"2024-05-08T18:10:24.765590+0000","last_fullsized":"2024-05-08T18:10:24.765590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248023+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:10:24.248023+0000","last_peered":"2024-05-08T18:10:24.248023+0000","last_clean":"2024-05-08T18:10:24.248023+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:10:24.248023+0000","last_undegraded":"2024-05-08T18:10:24.248023+0000","last_fullsized":"2024-05-08T18:10:24.248023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"101'42","reported_seq":249,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750723+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:10:23.750723+0000","last_peered":"2024-05-08T18:10:23.750723+0000","last_clean":"2024-05-08T18:10:23.750723+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:10:23.750723+0000","last_undegraded":"2024-05-08T18:10:23.750723+0000","last_fullsized":"2024-05-08T18:10:23.750723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"95'11","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749487+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:10:23.749487+0000","last_peered":"2024-05-08T18:10:23.749487+0000","last_clean":"2024-05-08T18:10:23.749487+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:10:23.749487+0000","last_undegraded":"2024-05-08T18:10:23.749487+0000","last_fullsized":"2024-05-08T18:10:23.749487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":34822,"num_write":21,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":218,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008282+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:10:23.008282+0000","last_peered":"2024-05-08T18:10:23.008282+0000","last_clean":"2024-05-08T18:10:23.008282+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:10:23.008282+0000","last_undegraded":"2024-05-08T18:10:23.008282+0000","last_fullsized":"2024-05-08T18:10:23.008282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":95,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.250890+0000","last_change":"2024-05-08T18:09:06.402195+0000","last_active":"2024-05-08T18:10:24.250890+0000","last_peered":"2024-05-08T18:10:24.250890+0000","last_clean":"2024-05-08T18:10:24.250890+0000","last_became_active":"2024-05-08T18:09:06.380401+0000","last_became_peered":"2024-05-08T18:09:06.380401+0000","last_unstale":"2024-05-08T18:10:24.250890+0000","last_undegraded":"2024-05-08T18:10:24.250890+0000","last_fullsized":"2024-05-08T18:10:24.250890+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:36.840412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"120'15","reported_seq":247,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.761836+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:10:24.761836+0000","last_peered":"2024-05-08T18:10:24.761836+0000","last_clean":"2024-05-08T18:10:24.761836+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:10:24.761836+0000","last_undegraded":"2024-05-08T18:10:24.761836+0000","last_fullsized":"2024-05-08T18:10:24.761836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749093+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:10:23.749093+0000","last_peered":"2024-05-08T18:10:23.749093+0000","last_clean":"2024-05-08T18:10:23.749093+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:10:23.749093+0000","last_undegraded":"2024-05-08T18:10:23.749093+0000","last_fullsized":"2024-05-08T18:10:23.749093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253566+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:10:24.253566+0000","last_peered":"2024-05-08T18:10:24.253566+0000","last_clean":"2024-05-08T18:10:24.253566+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:10:24.253566+0000","last_undegraded":"2024-05-08T18:10:24.253566+0000","last_fullsized":"2024-05-08T18:10:24.253566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"101'13","reported_seq":235,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009532+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:10:23.009532+0000","last_peered":"2024-05-08T18:10:23.009532+0000","last_clean":"2024-05-08T18:10:23.009532+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:10:23.009532+0000","last_undegraded":"2024-05-08T18:10:23.009532+0000","last_fullsized":"2024-05-08T18:10:23.009532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":47110,"num_write":23,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747906+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:10:23.747906+0000","last_peered":"2024-05-08T18:10:23.747906+0000","last_clean":"2024-05-08T18:10:23.747906+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:10:23.747906+0000","last_undegraded":"2024-05-08T18:10:23.747906+0000","last_fullsized":"2024-05-08T18:10:23.747906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"101'21","reported_seq":226,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007012+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:10:23.007012+0000","last_peered":"2024-05-08T18:10:23.007012+0000","last_clean":"2024-05-08T18:10:23.007012+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:10:23.007012+0000","last_undegraded":"2024-05-08T18:10:23.007012+0000","last_fullsized":"2024-05-08T18:10:23.007012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10255,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019992+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:10:23.019992+0000","last_peered":"2024-05-08T18:10:23.019992+0000","last_clean":"2024-05-08T18:10:23.019992+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:10:23.019992+0000","last_undegraded":"2024-05-08T18:10:23.019992+0000","last_fullsized":"2024-05-08T18:10:23.019992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251604+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:10:24.251604+0000","last_peered":"2024-05-08T18:10:24.251604+0000","last_clean":"2024-05-08T18:10:24.251604+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:10:24.251604+0000","last_undegraded":"2024-05-08T18:10:24.251604+0000","last_fullsized":"2024-05-08T18:10:24.251604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021357+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:10:23.021357+0000","last_peered":"2024-05-08T18:10:23.021357+0000","last_clean":"2024-05-08T18:10:23.021357+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:10:23.021357+0000","last_undegraded":"2024-05-08T18:10:23.021357+0000","last_fullsized":"2024-05-08T18:10:23.021357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":311,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674956+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:10:23.674956+0000","last_peered":"2024-05-08T18:10:23.674956+0000","last_clean":"2024-05-08T18:10:23.674956+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:10:23.674956+0000","last_undegraded":"2024-05-08T18:10:23.674956+0000","last_fullsized":"2024-05-08T18:10:23.674956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007096+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:10:23.007096+0000","last_peered":"2024-05-08T18:10:23.007096+0000","last_clean":"2024-05-08T18:10:23.007096+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:10:23.007096+0000","last_undegraded":"2024-05-08T18:10:23.007096+0000","last_fullsized":"2024-05-08T18:10:23.007096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"101'10","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010661+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:10:23.010661+0000","last_peered":"2024-05-08T18:10:23.010661+0000","last_clean":"2024-05-08T18:10:23.010661+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:10:23.010661+0000","last_undegraded":"2024-05-08T18:10:23.010661+0000","last_fullsized":"2024-05-08T18:10:23.010661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674690+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:10:23.674690+0000","last_peered":"2024-05-08T18:10:23.674690+0000","last_clean":"2024-05-08T18:10:23.674690+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:10:23.674690+0000","last_undegraded":"2024-05-08T18:10:23.674690+0000","last_fullsized":"2024-05-08T18:10:23.674690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"101'24","reported_seq":232,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008559+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:10:23.008559+0000","last_peered":"2024-05-08T18:10:23.008559+0000","last_clean":"2024-05-08T18:10:23.008559+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:10:23.008559+0000","last_undegraded":"2024-05-08T18:10:23.008559+0000","last_fullsized":"2024-05-08T18:10:23.008559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15071,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":35,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018810+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:10:23.018810+0000","last_peered":"2024-05-08T18:10:23.018810+0000","last_clean":"2024-05-08T18:10:23.018810+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:10:23.018810+0000","last_undegraded":"2024-05-08T18:10:23.018810+0000","last_fullsized":"2024-05-08T18:10:23.018810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019671+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:10:23.019671+0000","last_peered":"2024-05-08T18:10:23.019671+0000","last_clean":"2024-05-08T18:10:23.019671+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:10:23.019671+0000","last_undegraded":"2024-05-08T18:10:23.019671+0000","last_fullsized":"2024-05-08T18:10:23.019671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019230+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:10:23.019230+0000","last_peered":"2024-05-08T18:10:23.019230+0000","last_clean":"2024-05-08T18:10:23.019230+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:10:23.019230+0000","last_undegraded":"2024-05-08T18:10:23.019230+0000","last_fullsized":"2024-05-08T18:10:23.019230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674634+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:10:23.674634+0000","last_peered":"2024-05-08T18:10:23.674634+0000","last_clean":"2024-05-08T18:10:23.674634+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:10:23.674634+0000","last_undegraded":"2024-05-08T18:10:23.674634+0000","last_fullsized":"2024-05-08T18:10:23.674634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"101'12","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011857+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:10:23.011857+0000","last_peered":"2024-05-08T18:10:23.011857+0000","last_clean":"2024-05-08T18:10:23.011857+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:10:23.011857+0000","last_undegraded":"2024-05-08T18:10:23.011857+0000","last_fullsized":"2024-05-08T18:10:23.011857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":34834,"num_write":42,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008813+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:10:23.008813+0000","last_peered":"2024-05-08T18:10:23.008813+0000","last_clean":"2024-05-08T18:10:23.008813+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:10:23.008813+0000","last_undegraded":"2024-05-08T18:10:23.008813+0000","last_fullsized":"2024-05-08T18:10:23.008813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"120'61","reported_seq":314,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.766098+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:10:24.766098+0000","last_peered":"2024-05-08T18:10:24.766098+0000","last_clean":"2024-05-08T18:10:24.766098+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:10:24.766098+0000","last_undegraded":"2024-05-08T18:10:24.766098+0000","last_fullsized":"2024-05-08T18:10:24.766098+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35210,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":100,"num_read_kb":145,"num_write":72,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674917+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:10:23.674917+0000","last_peered":"2024-05-08T18:10:23.674917+0000","last_clean":"2024-05-08T18:10:23.674917+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:10:23.674917+0000","last_undegraded":"2024-05-08T18:10:23.674917+0000","last_fullsized":"2024-05-08T18:10:23.674917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248556+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:10:24.248556+0000","last_peered":"2024-05-08T18:10:24.248556+0000","last_clean":"2024-05-08T18:10:24.248556+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:10:24.248556+0000","last_undegraded":"2024-05-08T18:10:24.248556+0000","last_fullsized":"2024-05-08T18:10:24.248556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"101'34","reported_seq":239,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253653+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:10:24.253653+0000","last_peered":"2024-05-08T18:10:24.253653+0000","last_clean":"2024-05-08T18:10:24.253653+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:10:24.253653+0000","last_undegraded":"2024-05-08T18:10:24.253653+0000","last_fullsized":"2024-05-08T18:10:24.253653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232846+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:10:24.232846+0000","last_peered":"2024-05-08T18:10:24.232846+0000","last_clean":"2024-05-08T18:10:24.232846+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:10:24.232846+0000","last_undegraded":"2024-05-08T18:10:24.232846+0000","last_fullsized":"2024-05-08T18:10:24.232846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"101'10","reported_seq":226,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247509+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:10:24.247509+0000","last_peered":"2024-05-08T18:10:24.247509+0000","last_clean":"2024-05-08T18:10:24.247509+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:10:24.247509+0000","last_undegraded":"2024-05-08T18:10:24.247509+0000","last_fullsized":"2024-05-08T18:10:24.247509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":28678,"num_write":20,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.231322+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:10:24.231322+0000","last_peered":"2024-05-08T18:10:24.231322+0000","last_clean":"2024-05-08T18:10:24.231322+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:10:24.231322+0000","last_undegraded":"2024-05-08T18:10:24.231322+0000","last_fullsized":"2024-05-08T18:10:24.231322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"120'16","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.761812+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:10:24.761812+0000","last_peered":"2024-05-08T18:10:24.761812+0000","last_clean":"2024-05-08T18:10:24.761812+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:10:24.761812+0000","last_undegraded":"2024-05-08T18:10:24.761812+0000","last_fullsized":"2024-05-08T18:10:24.761812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012071+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:10:23.012071+0000","last_peered":"2024-05-08T18:10:23.012071+0000","last_clean":"2024-05-08T18:10:23.012071+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:10:23.012071+0000","last_undegraded":"2024-05-08T18:10:23.012071+0000","last_fullsized":"2024-05-08T18:10:23.012071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012608+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:10:23.012608+0000","last_peered":"2024-05-08T18:10:23.012608+0000","last_clean":"2024-05-08T18:10:23.012608+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:10:23.012608+0000","last_undegraded":"2024-05-08T18:10:23.012608+0000","last_fullsized":"2024-05-08T18:10:23.012608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"90'6","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251256+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:10:24.251256+0000","last_peered":"2024-05-08T18:10:24.251256+0000","last_clean":"2024-05-08T18:10:24.251256+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:10:24.251256+0000","last_undegraded":"2024-05-08T18:10:24.251256+0000","last_fullsized":"2024-05-08T18:10:24.251256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007417+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:10:23.007417+0000","last_peered":"2024-05-08T18:10:23.007417+0000","last_clean":"2024-05-08T18:10:23.007417+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:10:23.007417+0000","last_undegraded":"2024-05-08T18:10:23.007417+0000","last_fullsized":"2024-05-08T18:10:23.007417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"101'17","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749372+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:10:23.749372+0000","last_peered":"2024-05-08T18:10:23.749372+0000","last_clean":"2024-05-08T18:10:23.749372+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:10:23.749372+0000","last_undegraded":"2024-05-08T18:10:23.749372+0000","last_fullsized":"2024-05-08T18:10:23.749372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":29,"num_read_kb":55314,"num_write":47,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015883+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:10:23.015883+0000","last_peered":"2024-05-08T18:10:23.015883+0000","last_clean":"2024-05-08T18:10:23.015883+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:10:23.015883+0000","last_undegraded":"2024-05-08T18:10:23.015883+0000","last_fullsized":"2024-05-08T18:10:23.015883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010992+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:10:23.010992+0000","last_peered":"2024-05-08T18:10:23.010992+0000","last_clean":"2024-05-08T18:10:23.010992+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:10:23.010992+0000","last_undegraded":"2024-05-08T18:10:23.010992+0000","last_fullsized":"2024-05-08T18:10:23.010992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022360+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:10:23.022360+0000","last_peered":"2024-05-08T18:10:23.022360+0000","last_clean":"2024-05-08T18:10:23.022360+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:10:23.022360+0000","last_undegraded":"2024-05-08T18:10:23.022360+0000","last_fullsized":"2024-05-08T18:10:23.022360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005558+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:10:23.005558+0000","last_peered":"2024-05-08T18:10:23.005558+0000","last_clean":"2024-05-08T18:10:23.005558+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:10:23.005558+0000","last_undegraded":"2024-05-08T18:10:23.005558+0000","last_fullsized":"2024-05-08T18:10:23.005558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'10","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248864+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:10:24.248864+0000","last_peered":"2024-05-08T18:10:24.248864+0000","last_clean":"2024-05-08T18:10:24.248864+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:10:24.248864+0000","last_undegraded":"2024-05-08T18:10:24.248864+0000","last_fullsized":"2024-05-08T18:10:24.248864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"94'7","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008067+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:10:23.008067+0000","last_peered":"2024-05-08T18:10:23.008067+0000","last_clean":"2024-05-08T18:10:23.008067+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:10:23.008067+0000","last_undegraded":"2024-05-08T18:10:23.008067+0000","last_fullsized":"2024-05-08T18:10:23.008067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":22528,"num_write":7,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251507+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:10:24.251507+0000","last_peered":"2024-05-08T18:10:24.251507+0000","last_clean":"2024-05-08T18:10:24.251507+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:10:24.251507+0000","last_undegraded":"2024-05-08T18:10:24.251507+0000","last_fullsized":"2024-05-08T18:10:24.251507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014445+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:10:23.014445+0000","last_peered":"2024-05-08T18:10:23.014445+0000","last_clean":"2024-05-08T18:10:23.014445+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:10:23.014445+0000","last_undegraded":"2024-05-08T18:10:23.014445+0000","last_fullsized":"2024-05-08T18:10:23.014445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"101'32","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015001+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:10:23.015001+0000","last_peered":"2024-05-08T18:10:23.015001+0000","last_clean":"2024-05-08T18:10:23.015001+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:10:23.015001+0000","last_undegraded":"2024-05-08T18:10:23.015001+0000","last_fullsized":"2024-05-08T18:10:23.015001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13755,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":66,"num_write":40,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748261+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:10:23.748261+0000","last_peered":"2024-05-08T18:10:23.748261+0000","last_clean":"2024-05-08T18:10:23.748261+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:10:23.748261+0000","last_undegraded":"2024-05-08T18:10:23.748261+0000","last_fullsized":"2024-05-08T18:10:23.748261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"90'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016164+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:10:23.016164+0000","last_peered":"2024-05-08T18:10:23.016164+0000","last_clean":"2024-05-08T18:10:23.016164+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:10:23.016164+0000","last_undegraded":"2024-05-08T18:10:23.016164+0000","last_fullsized":"2024-05-08T18:10:23.016164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"101'42","reported_seq":247,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015384+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:10:23.015384+0000","last_peered":"2024-05-08T18:10:23.015384+0000","last_clean":"2024-05-08T18:10:23.015384+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:10:23.015384+0000","last_undegraded":"2024-05-08T18:10:23.015384+0000","last_fullsized":"2024-05-08T18:10:23.015384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251344+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:10:24.251344+0000","last_peered":"2024-05-08T18:10:24.251344+0000","last_clean":"2024-05-08T18:10:24.251344+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:10:24.251344+0000","last_undegraded":"2024-05-08T18:10:24.251344+0000","last_fullsized":"2024-05-08T18:10:24.251344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676602+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:10:23.676602+0000","last_peered":"2024-05-08T18:10:23.676602+0000","last_clean":"2024-05-08T18:10:23.676602+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:10:23.676602+0000","last_undegraded":"2024-05-08T18:10:23.676602+0000","last_fullsized":"2024-05-08T18:10:23.676602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020771+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:10:23.020771+0000","last_peered":"2024-05-08T18:10:23.020771+0000","last_clean":"2024-05-08T18:10:23.020771+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:10:23.020771+0000","last_undegraded":"2024-05-08T18:10:23.020771+0000","last_fullsized":"2024-05-08T18:10:23.020771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247820+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:10:24.247820+0000","last_peered":"2024-05-08T18:10:24.247820+0000","last_clean":"2024-05-08T18:10:24.247820+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:10:24.247820+0000","last_undegraded":"2024-05-08T18:10:24.247820+0000","last_fullsized":"2024-05-08T18:10:24.247820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"120'15","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.762235+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:10:24.762235+0000","last_peered":"2024-05-08T18:10:24.762235+0000","last_clean":"2024-05-08T18:10:24.762235+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:10:24.762235+0000","last_undegraded":"2024-05-08T18:10:24.762235+0000","last_fullsized":"2024-05-08T18:10:24.762235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"101'4","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012889+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:10:23.012889+0000","last_peered":"2024-05-08T18:10:23.012889+0000","last_clean":"2024-05-08T18:10:23.012889+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:10:23.012889+0000","last_undegraded":"2024-05-08T18:10:23.012889+0000","last_fullsized":"2024-05-08T18:10:23.012889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008956+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:10:23.008956+0000","last_peered":"2024-05-08T18:10:23.008956+0000","last_clean":"2024-05-08T18:10:23.008956+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:10:23.008956+0000","last_undegraded":"2024-05-08T18:10:23.008956+0000","last_fullsized":"2024-05-08T18:10:23.008956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"101'10","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011790+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:10:23.011790+0000","last_peered":"2024-05-08T18:10:23.011790+0000","last_clean":"2024-05-08T18:10:23.011790+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:10:23.011790+0000","last_undegraded":"2024-05-08T18:10:23.011790+0000","last_fullsized":"2024-05-08T18:10:23.011790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.254105+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:10:24.254105+0000","last_peered":"2024-05-08T18:10:24.254105+0000","last_clean":"2024-05-08T18:10:24.254105+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:10:24.254105+0000","last_undegraded":"2024-05-08T18:10:24.254105+0000","last_fullsized":"2024-05-08T18:10:24.254105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747745+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:10:23.747745+0000","last_peered":"2024-05-08T18:10:23.747745+0000","last_clean":"2024-05-08T18:10:23.747745+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:10:23.747745+0000","last_undegraded":"2024-05-08T18:10:23.747745+0000","last_fullsized":"2024-05-08T18:10:23.747745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749424+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:10:23.749424+0000","last_peered":"2024-05-08T18:10:23.749424+0000","last_clean":"2024-05-08T18:10:23.749424+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:10:23.749424+0000","last_undegraded":"2024-05-08T18:10:23.749424+0000","last_fullsized":"2024-05-08T18:10:23.749424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"120'15","reported_seq":261,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.765325+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:10:24.765325+0000","last_peered":"2024-05-08T18:10:24.765325+0000","last_clean":"2024-05-08T18:10:24.765325+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:10:24.765325+0000","last_undegraded":"2024-05-08T18:10:24.765325+0000","last_fullsized":"2024-05-08T18:10:24.765325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015918+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:10:23.015918+0000","last_peered":"2024-05-08T18:10:23.015918+0000","last_clean":"2024-05-08T18:10:23.015918+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:10:23.015918+0000","last_undegraded":"2024-05-08T18:10:23.015918+0000","last_fullsized":"2024-05-08T18:10:23.015918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748928+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:10:23.748928+0000","last_peered":"2024-05-08T18:10:23.748928+0000","last_clean":"2024-05-08T18:10:23.748928+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:10:23.748928+0000","last_undegraded":"2024-05-08T18:10:23.748928+0000","last_fullsized":"2024-05-08T18:10:23.748928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"101'17","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019599+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:10:23.019599+0000","last_peered":"2024-05-08T18:10:23.019599+0000","last_clean":"2024-05-08T18:10:23.019599+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:10:23.019599+0000","last_undegraded":"2024-05-08T18:10:23.019599+0000","last_fullsized":"2024-05-08T18:10:23.019599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":40996,"num_write":77,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023317+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:10:23.023317+0000","last_peered":"2024-05-08T18:10:23.023317+0000","last_clean":"2024-05-08T18:10:23.023317+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:10:23.023317+0000","last_undegraded":"2024-05-08T18:10:23.023317+0000","last_fullsized":"2024-05-08T18:10:23.023317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008711+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:10:23.008711+0000","last_peered":"2024-05-08T18:10:23.008711+0000","last_clean":"2024-05-08T18:10:23.008711+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:10:23.008711+0000","last_undegraded":"2024-05-08T18:10:23.008711+0000","last_fullsized":"2024-05-08T18:10:23.008711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"101'42","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674574+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:10:23.674574+0000","last_peered":"2024-05-08T18:10:23.674574+0000","last_clean":"2024-05-08T18:10:23.674574+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:10:23.674574+0000","last_undegraded":"2024-05-08T18:10:23.674574+0000","last_fullsized":"2024-05-08T18:10:23.674574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31839,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":73,"num_read_kb":101,"num_write":56,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010131+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:10:23.010131+0000","last_peered":"2024-05-08T18:10:23.010131+0000","last_clean":"2024-05-08T18:10:23.010131+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:10:23.010131+0000","last_undegraded":"2024-05-08T18:10:23.010131+0000","last_fullsized":"2024-05-08T18:10:23.010131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006701+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:10:23.006701+0000","last_peered":"2024-05-08T18:10:23.006701+0000","last_clean":"2024-05-08T18:10:23.006701+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:10:23.006701+0000","last_undegraded":"2024-05-08T18:10:23.006701+0000","last_fullsized":"2024-05-08T18:10:23.006701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016491+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:10:23.016491+0000","last_peered":"2024-05-08T18:10:23.016491+0000","last_clean":"2024-05-08T18:10:23.016491+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:10:23.016491+0000","last_undegraded":"2024-05-08T18:10:23.016491+0000","last_fullsized":"2024-05-08T18:10:23.016491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"101'34","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749025+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:10:23.749025+0000","last_peered":"2024-05-08T18:10:23.749025+0000","last_clean":"2024-05-08T18:10:23.749025+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:10:23.749025+0000","last_undegraded":"2024-05-08T18:10:23.749025+0000","last_fullsized":"2024-05-08T18:10:23.749025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"101'6","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749652+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:10:23.749652+0000","last_peered":"2024-05-08T18:10:23.749652+0000","last_clean":"2024-05-08T18:10:23.749652+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:10:23.749652+0000","last_undegraded":"2024-05-08T18:10:23.749652+0000","last_fullsized":"2024-05-08T18:10:23.749652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248466+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:10:24.248466+0000","last_peered":"2024-05-08T18:10:24.248466+0000","last_clean":"2024-05-08T18:10:24.248466+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:10:24.248466+0000","last_undegraded":"2024-05-08T18:10:24.248466+0000","last_fullsized":"2024-05-08T18:10:24.248466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"101'18","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008436+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:10:23.008436+0000","last_peered":"2024-05-08T18:10:23.008436+0000","last_clean":"2024-05-08T18:10:23.008436+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:10:23.008436+0000","last_undegraded":"2024-05-08T18:10:23.008436+0000","last_fullsized":"2024-05-08T18:10:23.008436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008394+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:10:23.008394+0000","last_peered":"2024-05-08T18:10:23.008394+0000","last_clean":"2024-05-08T18:10:23.008394+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:10:23.008394+0000","last_undegraded":"2024-05-08T18:10:23.008394+0000","last_fullsized":"2024-05-08T18:10:23.008394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010335+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:10:23.010335+0000","last_peered":"2024-05-08T18:10:23.010335+0000","last_clean":"2024-05-08T18:10:23.010335+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:10:23.010335+0000","last_undegraded":"2024-05-08T18:10:23.010335+0000","last_fullsized":"2024-05-08T18:10:23.010335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248784+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:10:24.248784+0000","last_peered":"2024-05-08T18:10:24.248784+0000","last_clean":"2024-05-08T18:10:24.248784+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:10:24.248784+0000","last_undegraded":"2024-05-08T18:10:24.248784+0000","last_fullsized":"2024-05-08T18:10:24.248784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"101'16","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676106+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:10:23.676106+0000","last_peered":"2024-05-08T18:10:23.676106+0000","last_clean":"2024-05-08T18:10:23.676106+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:10:23.676106+0000","last_undegraded":"2024-05-08T18:10:23.676106+0000","last_fullsized":"2024-05-08T18:10:23.676106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":47128,"num_write":56,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012366+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:10:23.012366+0000","last_peered":"2024-05-08T18:10:23.012366+0000","last_clean":"2024-05-08T18:10:23.012366+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:10:23.012366+0000","last_undegraded":"2024-05-08T18:10:23.012366+0000","last_fullsized":"2024-05-08T18:10:23.012366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"48'5","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015264+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:10:23.015264+0000","last_peered":"2024-05-08T18:10:23.015264+0000","last_clean":"2024-05-08T18:10:23.015264+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:10:23.015264+0000","last_undegraded":"2024-05-08T18:10:23.015264+0000","last_fullsized":"2024-05-08T18:10:23.015264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674157+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:10:23.674157+0000","last_peered":"2024-05-08T18:10:23.674157+0000","last_clean":"2024-05-08T18:10:23.674157+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:10:23.674157+0000","last_undegraded":"2024-05-08T18:10:23.674157+0000","last_fullsized":"2024-05-08T18:10:23.674157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"90'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015893+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:10:23.015893+0000","last_peered":"2024-05-08T18:10:23.015893+0000","last_clean":"2024-05-08T18:10:23.015893+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:10:23.015893+0000","last_undegraded":"2024-05-08T18:10:23.015893+0000","last_fullsized":"2024-05-08T18:10:23.015893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009605+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:10:23.009605+0000","last_peered":"2024-05-08T18:10:23.009605+0000","last_clean":"2024-05-08T18:10:23.009605+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:10:23.009605+0000","last_undegraded":"2024-05-08T18:10:23.009605+0000","last_fullsized":"2024-05-08T18:10:23.009605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"101'15","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008271+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:10:23.008271+0000","last_peered":"2024-05-08T18:10:23.008271+0000","last_clean":"2024-05-08T18:10:23.008271+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:10:23.008271+0000","last_undegraded":"2024-05-08T18:10:23.008271+0000","last_fullsized":"2024-05-08T18:10:23.008271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":47122,"num_write":45,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673614+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:10:23.673614+0000","last_peered":"2024-05-08T18:10:23.673614+0000","last_clean":"2024-05-08T18:10:23.673614+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:10:23.673614+0000","last_undegraded":"2024-05-08T18:10:23.673614+0000","last_fullsized":"2024-05-08T18:10:23.673614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"101'16","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011817+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:10:23.011817+0000","last_peered":"2024-05-08T18:10:23.011817+0000","last_clean":"2024-05-08T18:10:23.011817+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:10:23.011817+0000","last_undegraded":"2024-05-08T18:10:23.011817+0000","last_fullsized":"2024-05-08T18:10:23.011817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020690+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:10:23.020690+0000","last_peered":"2024-05-08T18:10:23.020690+0000","last_clean":"2024-05-08T18:10:23.020690+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:10:23.020690+0000","last_undegraded":"2024-05-08T18:10:23.020690+0000","last_fullsized":"2024-05-08T18:10:23.020690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006544+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:10:23.006544+0000","last_peered":"2024-05-08T18:10:23.006544+0000","last_clean":"2024-05-08T18:10:23.006544+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:10:23.006544+0000","last_undegraded":"2024-05-08T18:10:23.006544+0000","last_fullsized":"2024-05-08T18:10:23.006544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009195+0000","last_change":"2024-05-08T18:07:55.359230+0000","last_active":"2024-05-08T18:10:23.009195+0000","last_peered":"2024-05-08T18:10:23.009195+0000","last_clean":"2024-05-08T18:10:23.009195+0000","last_became_active":"2024-05-08T18:07:55.358047+0000","last_became_peered":"2024-05-08T18:07:55.358047+0000","last_unstale":"2024-05-08T18:10:23.009195+0000","last_undegraded":"2024-05-08T18:10:23.009195+0000","last_fullsized":"2024-05-08T18:10:23.009195+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:52.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018330+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:10:23.018330+0000","last_peered":"2024-05-08T18:10:23.018330+0000","last_clean":"2024-05-08T18:10:23.018330+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:10:23.018330+0000","last_undegraded":"2024-05-08T18:10:23.018330+0000","last_fullsized":"2024-05-08T18:10:23.018330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020607+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:10:23.020607+0000","last_peered":"2024-05-08T18:10:23.020607+0000","last_clean":"2024-05-08T18:10:23.020607+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:10:23.020607+0000","last_undegraded":"2024-05-08T18:10:23.020607+0000","last_fullsized":"2024-05-08T18:10:23.020607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"101'15","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674190+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:10:23.674190+0000","last_peered":"2024-05-08T18:10:23.674190+0000","last_clean":"2024-05-08T18:10:23.674190+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:10:23.674190+0000","last_undegraded":"2024-05-08T18:10:23.674190+0000","last_fullsized":"2024-05-08T18:10:23.674190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013395+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:10:23.013395+0000","last_peered":"2024-05-08T18:10:23.013395+0000","last_clean":"2024-05-08T18:10:23.013395+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:10:23.013395+0000","last_undegraded":"2024-05-08T18:10:23.013395+0000","last_fullsized":"2024-05-08T18:10:23.013395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022955+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:10:23.022955+0000","last_peered":"2024-05-08T18:10:23.022955+0000","last_clean":"2024-05-08T18:10:23.022955+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:10:23.022955+0000","last_undegraded":"2024-05-08T18:10:23.022955+0000","last_fullsized":"2024-05-08T18:10:23.022955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009453+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:10:23.009453+0000","last_peered":"2024-05-08T18:10:23.009453+0000","last_clean":"2024-05-08T18:10:23.009453+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:10:23.009453+0000","last_undegraded":"2024-05-08T18:10:23.009453+0000","last_fullsized":"2024-05-08T18:10:23.009453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":208,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019005+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:10:23.019005+0000","last_peered":"2024-05-08T18:10:23.019005+0000","last_clean":"2024-05-08T18:10:23.019005+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:10:23.019005+0000","last_undegraded":"2024-05-08T18:10:23.019005+0000","last_fullsized":"2024-05-08T18:10:23.019005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"101'24","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252394+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:10:24.252394+0000","last_peered":"2024-05-08T18:10:24.252394+0000","last_clean":"2024-05-08T18:10:24.252394+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:10:24.252394+0000","last_undegraded":"2024-05-08T18:10:24.252394+0000","last_fullsized":"2024-05-08T18:10:24.252394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12641,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":50,"num_write":30,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007070+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:10:23.007070+0000","last_peered":"2024-05-08T18:10:23.007070+0000","last_clean":"2024-05-08T18:10:23.007070+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:10:23.007070+0000","last_undegraded":"2024-05-08T18:10:23.007070+0000","last_fullsized":"2024-05-08T18:10:23.007070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011163+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:10:23.011163+0000","last_peered":"2024-05-08T18:10:23.011163+0000","last_clean":"2024-05-08T18:10:23.011163+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:10:23.011163+0000","last_undegraded":"2024-05-08T18:10:23.011163+0000","last_fullsized":"2024-05-08T18:10:23.011163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019138+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:10:23.019138+0000","last_peered":"2024-05-08T18:10:23.019138+0000","last_clean":"2024-05-08T18:10:23.019138+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:10:23.019138+0000","last_undegraded":"2024-05-08T18:10:23.019138+0000","last_fullsized":"2024-05-08T18:10:23.019138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"91'3","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248368+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:10:24.248368+0000","last_peered":"2024-05-08T18:10:24.248368+0000","last_clean":"2024-05-08T18:10:24.248368+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:10:24.248368+0000","last_undegraded":"2024-05-08T18:10:24.248368+0000","last_fullsized":"2024-05-08T18:10:24.248368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":196,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022596+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:10:23.022596+0000","last_peered":"2024-05-08T18:10:23.022596+0000","last_clean":"2024-05-08T18:10:23.022596+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:10:23.022596+0000","last_undegraded":"2024-05-08T18:10:23.022596+0000","last_fullsized":"2024-05-08T18:10:23.022596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"101'18","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674600+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:10:23.674600+0000","last_peered":"2024-05-08T18:10:23.674600+0000","last_clean":"2024-05-08T18:10:23.674600+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:10:23.674600+0000","last_undegraded":"2024-05-08T18:10:23.674600+0000","last_fullsized":"2024-05-08T18:10:23.674600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252484+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:10:24.252484+0000","last_peered":"2024-05-08T18:10:24.252484+0000","last_clean":"2024-05-08T18:10:24.252484+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:10:24.252484+0000","last_undegraded":"2024-05-08T18:10:24.252484+0000","last_fullsized":"2024-05-08T18:10:24.252484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020215+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:10:23.020215+0000","last_peered":"2024-05-08T18:10:23.020215+0000","last_clean":"2024-05-08T18:10:23.020215+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:10:23.020215+0000","last_undegraded":"2024-05-08T18:10:23.020215+0000","last_fullsized":"2024-05-08T18:10:23.020215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010027+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:10:23.010027+0000","last_peered":"2024-05-08T18:10:23.010027+0000","last_clean":"2024-05-08T18:10:23.010027+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:10:23.010027+0000","last_undegraded":"2024-05-08T18:10:23.010027+0000","last_fullsized":"2024-05-08T18:10:23.010027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"101'6","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749937+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:10:23.749937+0000","last_peered":"2024-05-08T18:10:23.749937+0000","last_clean":"2024-05-08T18:10:23.749937+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:10:23.749937+0000","last_undegraded":"2024-05-08T18:10:23.749937+0000","last_fullsized":"2024-05-08T18:10:23.749937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747838+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:10:23.747838+0000","last_peered":"2024-05-08T18:10:23.747838+0000","last_clean":"2024-05-08T18:10:23.747838+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:10:23.747838+0000","last_undegraded":"2024-05-08T18:10:23.747838+0000","last_fullsized":"2024-05-08T18:10:23.747838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"101'15","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013244+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:10:23.013244+0000","last_peered":"2024-05-08T18:10:23.013244+0000","last_clean":"2024-05-08T18:10:23.013244+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:10:23.013244+0000","last_undegraded":"2024-05-08T18:10:23.013244+0000","last_fullsized":"2024-05-08T18:10:23.013244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247314+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:10:24.247314+0000","last_peered":"2024-05-08T18:10:24.247314+0000","last_clean":"2024-05-08T18:10:24.247314+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:10:24.247314+0000","last_undegraded":"2024-05-08T18:10:24.247314+0000","last_fullsized":"2024-05-08T18:10:24.247314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005943+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:10:23.005943+0000","last_peered":"2024-05-08T18:10:23.005943+0000","last_clean":"2024-05-08T18:10:23.005943+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:10:23.005943+0000","last_undegraded":"2024-05-08T18:10:23.005943+0000","last_fullsized":"2024-05-08T18:10:23.005943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"90'6","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232830+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:10:24.232830+0000","last_peered":"2024-05-08T18:10:24.232830+0000","last_clean":"2024-05-08T18:10:24.232830+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:10:24.232830+0000","last_undegraded":"2024-05-08T18:10:24.232830+0000","last_fullsized":"2024-05-08T18:10:24.232830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"94'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013712+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:10:23.013712+0000","last_peered":"2024-05-08T18:10:23.013712+0000","last_clean":"2024-05-08T18:10:23.013712+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:10:23.013712+0000","last_undegraded":"2024-05-08T18:10:23.013712+0000","last_fullsized":"2024-05-08T18:10:23.013712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":38912,"num_write":11,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252691+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:10:24.252691+0000","last_peered":"2024-05-08T18:10:24.252691+0000","last_clean":"2024-05-08T18:10:24.252691+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:10:24.252691+0000","last_undegraded":"2024-05-08T18:10:24.252691+0000","last_fullsized":"2024-05-08T18:10:24.252691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"91'11","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750421+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:10:23.750421+0000","last_peered":"2024-05-08T18:10:23.750421+0000","last_clean":"2024-05-08T18:10:23.750421+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:10:23.750421+0000","last_undegraded":"2024-05-08T18:10:23.750421+0000","last_fullsized":"2024-05-08T18:10:23.750421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"120'15","reported_seq":251,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.762151+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:10:24.762151+0000","last_peered":"2024-05-08T18:10:24.762151+0000","last_clean":"2024-05-08T18:10:24.762151+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:10:24.762151+0000","last_undegraded":"2024-05-08T18:10:24.762151+0000","last_fullsized":"2024-05-08T18:10:24.762151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"101'6","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673614+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:10:23.673614+0000","last_peered":"2024-05-08T18:10:23.673614+0000","last_clean":"2024-05-08T18:10:23.673614+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:10:23.673614+0000","last_undegraded":"2024-05-08T18:10:23.673614+0000","last_fullsized":"2024-05-08T18:10:23.673614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748762+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:10:23.748762+0000","last_peered":"2024-05-08T18:10:23.748762+0000","last_clean":"2024-05-08T18:10:23.748762+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:10:23.748762+0000","last_undegraded":"2024-05-08T18:10:23.748762+0000","last_fullsized":"2024-05-08T18:10:23.748762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"101'9","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007512+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:10:23.007512+0000","last_peered":"2024-05-08T18:10:23.007512+0000","last_clean":"2024-05-08T18:10:23.007512+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:10:23.007512+0000","last_undegraded":"2024-05-08T18:10:23.007512+0000","last_fullsized":"2024-05-08T18:10:23.007512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":24594,"num_write":39,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674308+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:10:23.674308+0000","last_peered":"2024-05-08T18:10:23.674308+0000","last_clean":"2024-05-08T18:10:23.674308+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:10:23.674308+0000","last_undegraded":"2024-05-08T18:10:23.674308+0000","last_fullsized":"2024-05-08T18:10:23.674308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"101'19","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006220+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:10:23.006220+0000","last_peered":"2024-05-08T18:10:23.006220+0000","last_clean":"2024-05-08T18:10:23.006220+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:10:23.006220+0000","last_undegraded":"2024-05-08T18:10:23.006220+0000","last_fullsized":"2024-05-08T18:10:23.006220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5206,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014002+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:10:23.014002+0000","last_peered":"2024-05-08T18:10:23.014002+0000","last_clean":"2024-05-08T18:10:23.014002+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:10:23.014002+0000","last_undegraded":"2024-05-08T18:10:23.014002+0000","last_fullsized":"2024-05-08T18:10:23.014002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"101'2","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676327+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:10:23.676327+0000","last_peered":"2024-05-08T18:10:23.676327+0000","last_clean":"2024-05-08T18:10:23.676327+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:10:23.676327+0000","last_undegraded":"2024-05-08T18:10:23.676327+0000","last_fullsized":"2024-05-08T18:10:23.676327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749701+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:10:23.749701+0000","last_peered":"2024-05-08T18:10:23.749701+0000","last_clean":"2024-05-08T18:10:23.749701+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:10:23.749701+0000","last_undegraded":"2024-05-08T18:10:23.749701+0000","last_fullsized":"2024-05-08T18:10:23.749701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"93'4","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007831+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:10:23.007831+0000","last_peered":"2024-05-08T18:10:23.007831+0000","last_clean":"2024-05-08T18:10:23.007831+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:10:23.007831+0000","last_undegraded":"2024-05-08T18:10:23.007831+0000","last_fullsized":"2024-05-08T18:10:23.007831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006829+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:10:23.006829+0000","last_peered":"2024-05-08T18:10:23.006829+0000","last_clean":"2024-05-08T18:10:23.006829+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:10:23.006829+0000","last_undegraded":"2024-05-08T18:10:23.006829+0000","last_fullsized":"2024-05-08T18:10:23.006829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"101'16","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014381+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:10:23.014381+0000","last_peered":"2024-05-08T18:10:23.014381+0000","last_clean":"2024-05-08T18:10:23.014381+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:10:23.014381+0000","last_undegraded":"2024-05-08T18:10:23.014381+0000","last_fullsized":"2024-05-08T18:10:23.014381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020141+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:10:23.020141+0000","last_peered":"2024-05-08T18:10:23.020141+0000","last_clean":"2024-05-08T18:10:23.020141+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:10:23.020141+0000","last_undegraded":"2024-05-08T18:10:23.020141+0000","last_fullsized":"2024-05-08T18:10:23.020141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010595+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:10:23.010595+0000","last_peered":"2024-05-08T18:10:23.010595+0000","last_clean":"2024-05-08T18:10:23.010595+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:10:23.010595+0000","last_undegraded":"2024-05-08T18:10:23.010595+0000","last_fullsized":"2024-05-08T18:10:23.010595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010032+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:10:23.010032+0000","last_peered":"2024-05-08T18:10:23.010032+0000","last_clean":"2024-05-08T18:10:23.010032+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:10:23.010032+0000","last_undegraded":"2024-05-08T18:10:23.010032+0000","last_fullsized":"2024-05-08T18:10:23.010032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"93'10","reported_seq":172,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247195+0000","last_change":"2024-05-08T18:07:55.439856+0000","last_active":"2024-05-08T18:10:24.247195+0000","last_peered":"2024-05-08T18:10:24.247195+0000","last_clean":"2024-05-08T18:10:24.247195+0000","last_became_active":"2024-05-08T18:07:55.439188+0000","last_became_peered":"2024-05-08T18:07:55.439188+0000","last_unstale":"2024-05-08T18:10:24.247195+0000","last_undegraded":"2024-05-08T18:10:24.247195+0000","last_fullsized":"2024-05-08T18:10:24.247195+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:40.273251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":10,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747721+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:10:23.747721+0000","last_peered":"2024-05-08T18:10:23.747721+0000","last_clean":"2024-05-08T18:10:23.747721+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:10:23.747721+0000","last_undegraded":"2024-05-08T18:10:23.747721+0000","last_fullsized":"2024-05-08T18:10:23.747721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"101'10","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013755+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:10:23.013755+0000","last_peered":"2024-05-08T18:10:23.013755+0000","last_clean":"2024-05-08T18:10:23.013755+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:10:23.013755+0000","last_undegraded":"2024-05-08T18:10:23.013755+0000","last_fullsized":"2024-05-08T18:10:23.013755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10810,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":19,"num_write":12,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748565+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:10:23.748565+0000","last_peered":"2024-05-08T18:10:23.748565+0000","last_clean":"2024-05-08T18:10:23.748565+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:10:23.748565+0000","last_undegraded":"2024-05-08T18:10:23.748565+0000","last_fullsized":"2024-05-08T18:10:23.748565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675169+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:10:23.675169+0000","last_peered":"2024-05-08T18:10:23.675169+0000","last_clean":"2024-05-08T18:10:23.675169+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:10:23.675169+0000","last_undegraded":"2024-05-08T18:10:23.675169+0000","last_fullsized":"2024-05-08T18:10:23.675169+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748961+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:10:23.748961+0000","last_peered":"2024-05-08T18:10:23.748961+0000","last_clean":"2024-05-08T18:10:23.748961+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:10:23.748961+0000","last_undegraded":"2024-05-08T18:10:23.748961+0000","last_fullsized":"2024-05-08T18:10:23.748961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017974+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:10:23.017974+0000","last_peered":"2024-05-08T18:10:23.017974+0000","last_clean":"2024-05-08T18:10:23.017974+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:10:23.017974+0000","last_undegraded":"2024-05-08T18:10:23.017974+0000","last_fullsized":"2024-05-08T18:10:23.017974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247662+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:10:24.247662+0000","last_peered":"2024-05-08T18:10:24.247662+0000","last_clean":"2024-05-08T18:10:24.247662+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:10:24.247662+0000","last_undegraded":"2024-05-08T18:10:24.247662+0000","last_fullsized":"2024-05-08T18:10:24.247662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"101'14","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748818+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:10:23.748818+0000","last_peered":"2024-05-08T18:10:23.748818+0000","last_clean":"2024-05-08T18:10:23.748818+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:10:23.748818+0000","last_undegraded":"2024-05-08T18:10:23.748818+0000","last_fullsized":"2024-05-08T18:10:23.748818+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013086+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:10:23.013086+0000","last_peered":"2024-05-08T18:10:23.013086+0000","last_clean":"2024-05-08T18:10:23.013086+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:10:23.013086+0000","last_undegraded":"2024-05-08T18:10:23.013086+0000","last_fullsized":"2024-05-08T18:10:23.013086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751046+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:10:23.751046+0000","last_peered":"2024-05-08T18:10:23.751046+0000","last_clean":"2024-05-08T18:10:23.751046+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:10:23.751046+0000","last_undegraded":"2024-05-08T18:10:23.751046+0000","last_fullsized":"2024-05-08T18:10:23.751046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"101'36","reported_seq":244,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253470+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:10:24.253470+0000","last_peered":"2024-05-08T18:10:24.253470+0000","last_clean":"2024-05-08T18:10:24.253470+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:10:24.253470+0000","last_undegraded":"2024-05-08T18:10:24.253470+0000","last_fullsized":"2024-05-08T18:10:24.253470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":91,"num_write":52,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"101'18","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019864+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:10:23.019864+0000","last_peered":"2024-05-08T18:10:23.019864+0000","last_clean":"2024-05-08T18:10:23.019864+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:10:23.019864+0000","last_undegraded":"2024-05-08T18:10:23.019864+0000","last_fullsized":"2024-05-08T18:10:23.019864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":47134,"num_write":68,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253866+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:10:24.253866+0000","last_peered":"2024-05-08T18:10:24.253866+0000","last_clean":"2024-05-08T18:10:24.253866+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:10:24.253866+0000","last_undegraded":"2024-05-08T18:10:24.253866+0000","last_fullsized":"2024-05-08T18:10:24.253866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"101'9","reported_seq":226,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.230815+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:10:24.230815+0000","last_peered":"2024-05-08T18:10:24.230815+0000","last_clean":"2024-05-08T18:10:24.230815+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:10:24.230815+0000","last_undegraded":"2024-05-08T18:10:24.230815+0000","last_fullsized":"2024-05-08T18:10:24.230815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":26630,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007320+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:10:23.007320+0000","last_peered":"2024-05-08T18:10:23.007320+0000","last_clean":"2024-05-08T18:10:23.007320+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:10:23.007320+0000","last_undegraded":"2024-05-08T18:10:23.007320+0000","last_fullsized":"2024-05-08T18:10:23.007320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007247+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:10:23.007247+0000","last_peered":"2024-05-08T18:10:23.007247+0000","last_clean":"2024-05-08T18:10:23.007247+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:10:23.007247+0000","last_undegraded":"2024-05-08T18:10:23.007247+0000","last_fullsized":"2024-05-08T18:10:23.007247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251429+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:10:24.251429+0000","last_peered":"2024-05-08T18:10:24.251429+0000","last_clean":"2024-05-08T18:10:24.251429+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:10:24.251429+0000","last_undegraded":"2024-05-08T18:10:24.251429+0000","last_fullsized":"2024-05-08T18:10:24.251429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"101'5","reported_seq":216,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014337+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:10:23.014337+0000","last_peered":"2024-05-08T18:10:23.014337+0000","last_clean":"2024-05-08T18:10:23.014337+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:10:23.014337+0000","last_undegraded":"2024-05-08T18:10:23.014337+0000","last_fullsized":"2024-05-08T18:10:23.014337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":16390,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012990+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:10:23.012990+0000","last_peered":"2024-05-08T18:10:23.012990+0000","last_clean":"2024-05-08T18:10:23.012990+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:10:23.012990+0000","last_undegraded":"2024-05-08T18:10:23.012990+0000","last_fullsized":"2024-05-08T18:10:23.012990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011842+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:10:23.011842+0000","last_peered":"2024-05-08T18:10:23.011842+0000","last_clean":"2024-05-08T18:10:23.011842+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:10:23.011842+0000","last_undegraded":"2024-05-08T18:10:23.011842+0000","last_fullsized":"2024-05-08T18:10:23.011842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749915+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:10:23.749915+0000","last_peered":"2024-05-08T18:10:23.749915+0000","last_clean":"2024-05-08T18:10:23.749915+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:10:23.749915+0000","last_undegraded":"2024-05-08T18:10:23.749915+0000","last_fullsized":"2024-05-08T18:10:23.749915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252920+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:10:24.252920+0000","last_peered":"2024-05-08T18:10:24.252920+0000","last_clean":"2024-05-08T18:10:24.252920+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:10:24.252920+0000","last_undegraded":"2024-05-08T18:10:24.252920+0000","last_fullsized":"2024-05-08T18:10:24.252920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":32786,"num_write":41,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"101'40","reported_seq":251,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009330+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:10:23.009330+0000","last_peered":"2024-05-08T18:10:23.009330+0000","last_clean":"2024-05-08T18:10:23.009330+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:10:23.009330+0000","last_undegraded":"2024-05-08T18:10:23.009330+0000","last_fullsized":"2024-05-08T18:10:23.009330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":102,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"101'9","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022073+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:10:23.022073+0000","last_peered":"2024-05-08T18:10:23.022073+0000","last_clean":"2024-05-08T18:10:23.022073+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:10:23.022073+0000","last_undegraded":"2024-05-08T18:10:23.022073+0000","last_fullsized":"2024-05-08T18:10:23.022073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"90'12","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019735+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:10:23.019735+0000","last_peered":"2024-05-08T18:10:23.019735+0000","last_clean":"2024-05-08T18:10:23.019735+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:10:23.019735+0000","last_undegraded":"2024-05-08T18:10:23.019735+0000","last_fullsized":"2024-05-08T18:10:23.019735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"91'3","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012624+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:10:23.012624+0000","last_peered":"2024-05-08T18:10:23.012624+0000","last_clean":"2024-05-08T18:10:23.012624+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:10:23.012624+0000","last_undegraded":"2024-05-08T18:10:23.012624+0000","last_fullsized":"2024-05-08T18:10:23.012624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017633+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:10:23.017633+0000","last_peered":"2024-05-08T18:10:23.017633+0000","last_clean":"2024-05-08T18:10:23.017633+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:10:23.017633+0000","last_undegraded":"2024-05-08T18:10:23.017633+0000","last_fullsized":"2024-05-08T18:10:23.017633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"101'18","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006664+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:10:23.006664+0000","last_peered":"2024-05-08T18:10:23.006664+0000","last_clean":"2024-05-08T18:10:23.006664+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:10:23.006664+0000","last_undegraded":"2024-05-08T18:10:23.006664+0000","last_fullsized":"2024-05-08T18:10:23.006664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":30,"num_read_kb":55314,"num_write":48,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750654+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:10:23.750654+0000","last_peered":"2024-05-08T18:10:23.750654+0000","last_clean":"2024-05-08T18:10:23.750654+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:10:23.750654+0000","last_undegraded":"2024-05-08T18:10:23.750654+0000","last_fullsized":"2024-05-08T18:10:23.750654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"101'8","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010297+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:10:23.010297+0000","last_peered":"2024-05-08T18:10:23.010297+0000","last_clean":"2024-05-08T18:10:23.010297+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:10:23.010297+0000","last_undegraded":"2024-05-08T18:10:23.010297+0000","last_fullsized":"2024-05-08T18:10:23.010297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.233065+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:10:24.233065+0000","last_peered":"2024-05-08T18:10:24.233065+0000","last_clean":"2024-05-08T18:10:24.233065+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:10:24.233065+0000","last_undegraded":"2024-05-08T18:10:24.233065+0000","last_fullsized":"2024-05-08T18:10:24.233065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"94'7","reported_seq":168,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232504+0000","last_change":"2024-05-08T18:07:55.445745+0000","last_active":"2024-05-08T18:10:24.232504+0000","last_peered":"2024-05-08T18:10:24.232504+0000","last_clean":"2024-05-08T18:10:24.232504+0000","last_became_active":"2024-05-08T18:07:55.444935+0000","last_became_peered":"2024-05-08T18:07:55.444935+0000","last_unstale":"2024-05-08T18:10:24.232504+0000","last_undegraded":"2024-05-08T18:10:24.232504+0000","last_fullsized":"2024-05-08T18:10:24.232504+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:37.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":22528,"num_write":7,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750539+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:10:23.750539+0000","last_peered":"2024-05-08T18:10:23.750539+0000","last_clean":"2024-05-08T18:10:23.750539+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:10:23.750539+0000","last_undegraded":"2024-05-08T18:10:23.750539+0000","last_fullsized":"2024-05-08T18:10:23.750539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"94'6","reported_seq":218,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014718+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:10:23.014718+0000","last_peered":"2024-05-08T18:10:23.014718+0000","last_clean":"2024-05-08T18:10:23.014718+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:10:23.014718+0000","last_undegraded":"2024-05-08T18:10:23.014718+0000","last_fullsized":"2024-05-08T18:10:23.014718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":16390,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674975+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:10:23.674975+0000","last_peered":"2024-05-08T18:10:23.674975+0000","last_clean":"2024-05-08T18:10:23.674975+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:10:23.674975+0000","last_undegraded":"2024-05-08T18:10:23.674975+0000","last_fullsized":"2024-05-08T18:10:23.674975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"101'9","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021427+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:10:23.021427+0000","last_peered":"2024-05-08T18:10:23.021427+0000","last_clean":"2024-05-08T18:10:23.021427+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:10:23.021427+0000","last_undegraded":"2024-05-08T18:10:23.021427+0000","last_fullsized":"2024-05-08T18:10:23.021427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012285+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:10:23.012285+0000","last_peered":"2024-05-08T18:10:23.012285+0000","last_clean":"2024-05-08T18:10:23.012285+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:10:23.012285+0000","last_undegraded":"2024-05-08T18:10:23.012285+0000","last_fullsized":"2024-05-08T18:10:23.012285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676538+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:10:23.676538+0000","last_peered":"2024-05-08T18:10:23.676538+0000","last_clean":"2024-05-08T18:10:23.676538+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:10:23.676538+0000","last_undegraded":"2024-05-08T18:10:23.676538+0000","last_fullsized":"2024-05-08T18:10:23.676538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":26648,"num_write":51,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"101'46","reported_seq":254,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009047+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:10:23.009047+0000","last_peered":"2024-05-08T18:10:23.009047+0000","last_clean":"2024-05-08T18:10:23.009047+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:10:23.009047+0000","last_undegraded":"2024-05-08T18:10:23.009047+0000","last_fullsized":"2024-05-08T18:10:23.009047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"94'11","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232833+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:10:24.232833+0000","last_peered":"2024-05-08T18:10:24.232833+0000","last_clean":"2024-05-08T18:10:24.232833+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:10:24.232833+0000","last_undegraded":"2024-05-08T18:10:24.232833+0000","last_fullsized":"2024-05-08T18:10:24.232833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":45056,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674057+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:10:23.674057+0000","last_peered":"2024-05-08T18:10:23.674057+0000","last_clean":"2024-05-08T18:10:23.674057+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:10:23.674057+0000","last_undegraded":"2024-05-08T18:10:23.674057+0000","last_fullsized":"2024-05-08T18:10:23.674057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"101'9","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008938+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:10:23.008938+0000","last_peered":"2024-05-08T18:10:23.008938+0000","last_clean":"2024-05-08T18:10:23.008938+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:10:23.008938+0000","last_undegraded":"2024-05-08T18:10:23.008938+0000","last_fullsized":"2024-05-08T18:10:23.008938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":26630,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"101'14","reported_seq":234,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006573+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:10:23.006573+0000","last_peered":"2024-05-08T18:10:23.006573+0000","last_clean":"2024-05-08T18:10:23.006573+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:10:23.006573+0000","last_undegraded":"2024-05-08T18:10:23.006573+0000","last_fullsized":"2024-05-08T18:10:23.006573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":18,"num_read_kb":43014,"num_write":24,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017327+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:10:23.017327+0000","last_peered":"2024-05-08T18:10:23.017327+0000","last_clean":"2024-05-08T18:10:23.017327+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:10:23.017327+0000","last_undegraded":"2024-05-08T18:10:23.017327+0000","last_fullsized":"2024-05-08T18:10:23.017327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"101'12","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248214+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:10:24.248214+0000","last_peered":"2024-05-08T18:10:24.248214+0000","last_clean":"2024-05-08T18:10:24.248214+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:10:24.248214+0000","last_undegraded":"2024-05-08T18:10:24.248214+0000","last_fullsized":"2024-05-08T18:10:24.248214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":40966,"num_write":22,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008111+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:10:23.008111+0000","last_peered":"2024-05-08T18:10:23.008111+0000","last_clean":"2024-05-08T18:10:23.008111+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:10:23.008111+0000","last_undegraded":"2024-05-08T18:10:23.008111+0000","last_fullsized":"2024-05-08T18:10:23.008111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":242921,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":927,"num_read_kb":920,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":230738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":577,"ondisk_log_size":577,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1100,"num_read_kb":2048660,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":446980,"kb_used_data":415804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93924860,"statfs":{"total":96636764160,"available":96179056640,"internally_reserved":0,"allocated":425783296,"data_stored":425104836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":331652,"kb_used_data":300476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94040188,"statfs":{"total":96636764160,"available":96297152512,"internally_reserved":0,"allocated":307687424,"data_stored":307055531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":536532,"kb_used_data":505356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93835308,"statfs":{"total":96636764160,"available":96087355392,"internally_reserved":0,"allocated":517484544,"data_stored":516790953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487276,"kb_used_data":456088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93884564,"statfs":{"total":96636764160,"available":96137793536,"internally_reserved":0,"allocated":467034112,"data_stored":466424514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":524192,"kb_used_data":493016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93847648,"statfs":{"total":96636764160,"available":96099991552,"internally_reserved":0,"allocated":504848384,"data_stored":504193220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":317280,"kb_used_data":286104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94054560,"statfs":{"total":96636764160,"available":96311869440,"internally_reserved":0,"allocated":292970496,"data_stored":292361081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303020,"kb_used_data":271844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94068820,"statfs":{"total":96636764160,"available":96326471680,"internally_reserved":0,"allocated":278368256,"data_stored":277720808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":510420,"kb_used_data":479240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93861420,"statfs":{"total":96636764160,"available":96114094080,"internally_reserved":0,"allocated":490741760,"data_stored":490101965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":488636416,"data_stored":488636416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":276824064,"data_stored":276824064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":291504128,"data_stored":291504128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":503316480,"data_stored":503316480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":465567744,"data_stored":465567744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":515899392,"data_stored":515899392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":306184192,"data_stored":306184192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":423624704,"data_stored":423624704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":27109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":49062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":9271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":29104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":42748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":23703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":41692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:10:36.021 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:10:36.376 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:10:36.382 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:10:36.396 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2024-05-08T18:10:35.729697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636613462,"num_objects":637,"num_object_clones":0,"num_object_copies":1274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":3825,"num_read_kb":2050946,"num_write":3270,"num_write_kb":2050294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1943,"ondisk_log_size":1943,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3457352,"kb_used_data":3207928,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":751517368,"statfs":{"total":773094113280,"available":769553784832,"internally_reserved":0,"allocated":3284918272,"data_stored":3279752908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005639"},"pg_stats":[{"pgid":"3.3f","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676116+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:10:23.676116+0000","last_peered":"2024-05-08T18:10:23.676116+0000","last_clean":"2024-05-08T18:10:23.676116+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:10:23.676116+0000","last_undegraded":"2024-05-08T18:10:23.676116+0000","last_fullsized":"2024-05-08T18:10:23.676116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":34822,"num_write":21,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005921+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:10:23.005921+0000","last_peered":"2024-05-08T18:10:23.005921+0000","last_clean":"2024-05-08T18:10:23.005921+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:10:23.005921+0000","last_undegraded":"2024-05-08T18:10:23.005921+0000","last_fullsized":"2024-05-08T18:10:23.005921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"93'7","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.254012+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:10:24.254012+0000","last_peered":"2024-05-08T18:10:24.254012+0000","last_clean":"2024-05-08T18:10:24.254012+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:10:24.254012+0000","last_undegraded":"2024-05-08T18:10:24.254012+0000","last_fullsized":"2024-05-08T18:10:24.254012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674165+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:10:23.674165+0000","last_peered":"2024-05-08T18:10:23.674165+0000","last_clean":"2024-05-08T18:10:23.674165+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:10:23.674165+0000","last_undegraded":"2024-05-08T18:10:23.674165+0000","last_fullsized":"2024-05-08T18:10:23.674165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"101'15","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016426+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:10:23.016426+0000","last_peered":"2024-05-08T18:10:23.016426+0000","last_clean":"2024-05-08T18:10:23.016426+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:10:23.016426+0000","last_undegraded":"2024-05-08T18:10:23.016426+0000","last_fullsized":"2024-05-08T18:10:23.016426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":47116,"num_write":35,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749409+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:10:23.749409+0000","last_peered":"2024-05-08T18:10:23.749409+0000","last_clean":"2024-05-08T18:10:23.749409+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:10:23.749409+0000","last_undegraded":"2024-05-08T18:10:23.749409+0000","last_fullsized":"2024-05-08T18:10:23.749409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"101'13","reported_seq":232,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007371+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:10:23.007371+0000","last_peered":"2024-05-08T18:10:23.007371+0000","last_clean":"2024-05-08T18:10:23.007371+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:10:23.007371+0000","last_undegraded":"2024-05-08T18:10:23.007371+0000","last_fullsized":"2024-05-08T18:10:23.007371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40972,"num_write":33,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014036+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:10:23.014036+0000","last_peered":"2024-05-08T18:10:23.014036+0000","last_clean":"2024-05-08T18:10:23.014036+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:10:23.014036+0000","last_undegraded":"2024-05-08T18:10:23.014036+0000","last_fullsized":"2024-05-08T18:10:23.014036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"101'5","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675565+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:10:23.675565+0000","last_peered":"2024-05-08T18:10:23.675565+0000","last_clean":"2024-05-08T18:10:23.675565+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:10:23.675565+0000","last_undegraded":"2024-05-08T18:10:23.675565+0000","last_fullsized":"2024-05-08T18:10:23.675565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14342,"num_write":15,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021174+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:10:23.021174+0000","last_peered":"2024-05-08T18:10:23.021174+0000","last_clean":"2024-05-08T18:10:23.021174+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:10:23.021174+0000","last_undegraded":"2024-05-08T18:10:23.021174+0000","last_fullsized":"2024-05-08T18:10:23.021174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"101'9","reported_seq":172,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232335+0000","last_change":"2024-05-08T18:07:55.439965+0000","last_active":"2024-05-08T18:10:24.232335+0000","last_peered":"2024-05-08T18:10:24.232335+0000","last_clean":"2024-05-08T18:10:24.232335+0000","last_became_active":"2024-05-08T18:07:55.439578+0000","last_became_peered":"2024-05-08T18:07:55.439578+0000","last_unstale":"2024-05-08T18:10:24.232335+0000","last_undegraded":"2024-05-08T18:10:24.232335+0000","last_fullsized":"2024-05-08T18:10:24.232335+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:30.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":22540,"num_write":29,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"101'86","reported_seq":299,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750093+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:10:23.750093+0000","last_peered":"2024-05-08T18:10:23.750093+0000","last_clean":"2024-05-08T18:10:23.750093+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:10:23.750093+0000","last_undegraded":"2024-05-08T18:10:23.750093+0000","last_fullsized":"2024-05-08T18:10:23.750093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":219,"num_write":126,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"101'9","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674555+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:10:23.674555+0000","last_peered":"2024-05-08T18:10:23.674555+0000","last_clean":"2024-05-08T18:10:23.674555+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:10:23.674555+0000","last_undegraded":"2024-05-08T18:10:23.674555+0000","last_fullsized":"2024-05-08T18:10:23.674555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32774,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007751+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:10:23.007751+0000","last_peered":"2024-05-08T18:10:23.007751+0000","last_clean":"2024-05-08T18:10:23.007751+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:10:23.007751+0000","last_undegraded":"2024-05-08T18:10:23.007751+0000","last_fullsized":"2024-05-08T18:10:23.007751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"101'14","reported_seq":237,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009256+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:10:23.009256+0000","last_peered":"2024-05-08T18:10:23.009256+0000","last_clean":"2024-05-08T18:10:23.009256+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:10:23.009256+0000","last_undegraded":"2024-05-08T18:10:23.009256+0000","last_fullsized":"2024-05-08T18:10:23.009256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":167,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013504+0000","last_change":"2024-05-08T18:07:47.007132+0000","last_active":"2024-05-08T18:10:23.013504+0000","last_peered":"2024-05-08T18:10:23.013504+0000","last_clean":"2024-05-08T18:10:23.013504+0000","last_became_active":"2024-05-08T18:07:47.006744+0000","last_became_peered":"2024-05-08T18:07:47.006744+0000","last_unstale":"2024-05-08T18:10:23.013504+0000","last_undegraded":"2024-05-08T18:10:23.013504+0000","last_fullsized":"2024-05-08T18:10:23.013504+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:32.802677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748681+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:10:23.748681+0000","last_peered":"2024-05-08T18:10:23.748681+0000","last_clean":"2024-05-08T18:10:23.748681+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:10:23.748681+0000","last_undegraded":"2024-05-08T18:10:23.748681+0000","last_fullsized":"2024-05-08T18:10:23.748681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"101'17","reported_seq":243,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676155+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:10:23.676155+0000","last_peered":"2024-05-08T18:10:23.676155+0000","last_clean":"2024-05-08T18:10:23.676155+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:10:23.676155+0000","last_undegraded":"2024-05-08T18:10:23.676155+0000","last_fullsized":"2024-05-08T18:10:23.676155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":33,"num_read_kb":49176,"num_write":57,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674465+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:10:23.674465+0000","last_peered":"2024-05-08T18:10:23.674465+0000","last_clean":"2024-05-08T18:10:23.674465+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:10:23.674465+0000","last_undegraded":"2024-05-08T18:10:23.674465+0000","last_fullsized":"2024-05-08T18:10:23.674465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"94'10","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021892+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:10:23.021892+0000","last_peered":"2024-05-08T18:10:23.021892+0000","last_clean":"2024-05-08T18:10:23.021892+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:10:23.021892+0000","last_undegraded":"2024-05-08T18:10:23.021892+0000","last_fullsized":"2024-05-08T18:10:23.021892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":32768,"num_write":10,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"101'48","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007110+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:10:23.007110+0000","last_peered":"2024-05-08T18:10:23.007110+0000","last_clean":"2024-05-08T18:10:23.007110+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:10:23.007110+0000","last_undegraded":"2024-05-08T18:10:23.007110+0000","last_fullsized":"2024-05-08T18:10:23.007110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":122,"num_write":70,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"101'6","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021580+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:10:23.021580+0000","last_peered":"2024-05-08T18:10:23.021580+0000","last_clean":"2024-05-08T18:10:23.021580+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:10:23.021580+0000","last_undegraded":"2024-05-08T18:10:23.021580+0000","last_fullsized":"2024-05-08T18:10:23.021580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.233381+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:10:24.233381+0000","last_peered":"2024-05-08T18:10:24.233381+0000","last_clean":"2024-05-08T18:10:24.233381+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:10:24.233381+0000","last_undegraded":"2024-05-08T18:10:24.233381+0000","last_fullsized":"2024-05-08T18:10:24.233381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"94'8","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749710+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:10:23.749710+0000","last_peered":"2024-05-08T18:10:23.749710+0000","last_clean":"2024-05-08T18:10:23.749710+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:10:23.749710+0000","last_undegraded":"2024-05-08T18:10:23.749710+0000","last_fullsized":"2024-05-08T18:10:23.749710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232925+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:10:24.232925+0000","last_peered":"2024-05-08T18:10:24.232925+0000","last_clean":"2024-05-08T18:10:24.232925+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:10:24.232925+0000","last_undegraded":"2024-05-08T18:10:24.232925+0000","last_fullsized":"2024-05-08T18:10:24.232925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"101'6","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012083+0000","last_change":"2024-05-08T18:09:38.328162+0000","last_active":"2024-05-08T18:10:23.012083+0000","last_peered":"2024-05-08T18:10:23.012083+0000","last_clean":"2024-05-08T18:10:23.012083+0000","last_became_active":"2024-05-08T18:09:38.182438+0000","last_became_peered":"2024-05-08T18:09:38.182438+0000","last_unstale":"2024-05-08T18:10:23.012083+0000","last_undegraded":"2024-05-08T18:10:23.012083+0000","last_fullsized":"2024-05-08T18:10:23.012083+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:05.642615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751059+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:10:23.751059+0000","last_peered":"2024-05-08T18:10:23.751059+0000","last_clean":"2024-05-08T18:10:23.751059+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:10:23.751059+0000","last_undegraded":"2024-05-08T18:10:23.751059+0000","last_fullsized":"2024-05-08T18:10:23.751059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"101'9","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013579+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:10:23.013579+0000","last_peered":"2024-05-08T18:10:23.013579+0000","last_clean":"2024-05-08T18:10:23.013579+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:10:23.013579+0000","last_undegraded":"2024-05-08T18:10:23.013579+0000","last_fullsized":"2024-05-08T18:10:23.013579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":28678,"num_write":19,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748132+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:10:23.748132+0000","last_peered":"2024-05-08T18:10:23.748132+0000","last_clean":"2024-05-08T18:10:23.748132+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:10:23.748132+0000","last_undegraded":"2024-05-08T18:10:23.748132+0000","last_fullsized":"2024-05-08T18:10:23.748132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011135+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:10:23.011135+0000","last_peered":"2024-05-08T18:10:23.011135+0000","last_clean":"2024-05-08T18:10:23.011135+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:10:23.011135+0000","last_undegraded":"2024-05-08T18:10:23.011135+0000","last_fullsized":"2024-05-08T18:10:23.011135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"101'12","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675916+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:10:23.675916+0000","last_peered":"2024-05-08T18:10:23.675916+0000","last_clean":"2024-05-08T18:10:23.675916+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:10:23.675916+0000","last_undegraded":"2024-05-08T18:10:23.675916+0000","last_fullsized":"2024-05-08T18:10:23.675916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":36876,"num_write":32,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007061+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:10:23.007061+0000","last_peered":"2024-05-08T18:10:23.007061+0000","last_clean":"2024-05-08T18:10:23.007061+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:10:23.007061+0000","last_undegraded":"2024-05-08T18:10:23.007061+0000","last_fullsized":"2024-05-08T18:10:23.007061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"101'12","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018739+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:10:23.018739+0000","last_peered":"2024-05-08T18:10:23.018739+0000","last_clean":"2024-05-08T18:10:23.018739+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:10:23.018739+0000","last_undegraded":"2024-05-08T18:10:23.018739+0000","last_fullsized":"2024-05-08T18:10:23.018739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675833+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:10:23.675833+0000","last_peered":"2024-05-08T18:10:23.675833+0000","last_clean":"2024-05-08T18:10:23.675833+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:10:23.675833+0000","last_undegraded":"2024-05-08T18:10:23.675833+0000","last_fullsized":"2024-05-08T18:10:23.675833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005832+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:10:23.005832+0000","last_peered":"2024-05-08T18:10:23.005832+0000","last_clean":"2024-05-08T18:10:23.005832+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:10:23.005832+0000","last_undegraded":"2024-05-08T18:10:23.005832+0000","last_fullsized":"2024-05-08T18:10:23.005832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007823+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:10:23.007823+0000","last_peered":"2024-05-08T18:10:23.007823+0000","last_clean":"2024-05-08T18:10:23.007823+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:10:23.007823+0000","last_undegraded":"2024-05-08T18:10:23.007823+0000","last_fullsized":"2024-05-08T18:10:23.007823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013931+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:10:23.013931+0000","last_peered":"2024-05-08T18:10:23.013931+0000","last_clean":"2024-05-08T18:10:23.013931+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:10:23.013931+0000","last_undegraded":"2024-05-08T18:10:23.013931+0000","last_fullsized":"2024-05-08T18:10:23.013931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":30738,"num_write":41,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010902+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:10:23.010902+0000","last_peered":"2024-05-08T18:10:23.010902+0000","last_clean":"2024-05-08T18:10:23.010902+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:10:23.010902+0000","last_undegraded":"2024-05-08T18:10:23.010902+0000","last_fullsized":"2024-05-08T18:10:23.010902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"101'7","reported_seq":206,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750625+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:10:23.750625+0000","last_peered":"2024-05-08T18:10:23.750625+0000","last_clean":"2024-05-08T18:10:23.750625+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:10:23.750625+0000","last_undegraded":"2024-05-08T18:10:23.750625+0000","last_fullsized":"2024-05-08T18:10:23.750625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750086+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:10:23.750086+0000","last_peered":"2024-05-08T18:10:23.750086+0000","last_clean":"2024-05-08T18:10:23.750086+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:10:23.750086+0000","last_undegraded":"2024-05-08T18:10:23.750086+0000","last_fullsized":"2024-05-08T18:10:23.750086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012615+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:10:23.012615+0000","last_peered":"2024-05-08T18:10:23.012615+0000","last_clean":"2024-05-08T18:10:23.012615+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:10:23.012615+0000","last_undegraded":"2024-05-08T18:10:23.012615+0000","last_fullsized":"2024-05-08T18:10:23.012615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"90'6","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019369+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:10:23.019369+0000","last_peered":"2024-05-08T18:10:23.019369+0000","last_clean":"2024-05-08T18:10:23.019369+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:10:23.019369+0000","last_undegraded":"2024-05-08T18:10:23.019369+0000","last_fullsized":"2024-05-08T18:10:23.019369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"101'9","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675435+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:10:23.675435+0000","last_peered":"2024-05-08T18:10:23.675435+0000","last_clean":"2024-05-08T18:10:23.675435+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:10:23.675435+0000","last_undegraded":"2024-05-08T18:10:23.675435+0000","last_fullsized":"2024-05-08T18:10:23.675435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":28684,"num_write":29,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013381+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:10:23.013381+0000","last_peered":"2024-05-08T18:10:23.013381+0000","last_clean":"2024-05-08T18:10:23.013381+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:10:23.013381+0000","last_undegraded":"2024-05-08T18:10:23.013381+0000","last_fullsized":"2024-05-08T18:10:23.013381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232567+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:10:24.232567+0000","last_peered":"2024-05-08T18:10:24.232567+0000","last_clean":"2024-05-08T18:10:24.232567+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:10:24.232567+0000","last_undegraded":"2024-05-08T18:10:24.232567+0000","last_fullsized":"2024-05-08T18:10:24.232567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"120'15","reported_seq":257,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.761766+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:10:24.761766+0000","last_peered":"2024-05-08T18:10:24.761766+0000","last_clean":"2024-05-08T18:10:24.761766+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:10:24.761766+0000","last_undegraded":"2024-05-08T18:10:24.761766+0000","last_fullsized":"2024-05-08T18:10:24.761766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"101'4","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748730+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:10:23.748730+0000","last_peered":"2024-05-08T18:10:23.748730+0000","last_clean":"2024-05-08T18:10:23.748730+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:10:23.748730+0000","last_undegraded":"2024-05-08T18:10:23.748730+0000","last_fullsized":"2024-05-08T18:10:23.748730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012204+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:10:23.012204+0000","last_peered":"2024-05-08T18:10:23.012204+0000","last_clean":"2024-05-08T18:10:23.012204+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:10:23.012204+0000","last_undegraded":"2024-05-08T18:10:23.012204+0000","last_fullsized":"2024-05-08T18:10:23.012204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"101'8","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020021+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:10:23.020021+0000","last_peered":"2024-05-08T18:10:23.020021+0000","last_clean":"2024-05-08T18:10:23.020021+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:10:23.020021+0000","last_undegraded":"2024-05-08T18:10:23.020021+0000","last_fullsized":"2024-05-08T18:10:23.020021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007769+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:10:23.007769+0000","last_peered":"2024-05-08T18:10:23.007769+0000","last_clean":"2024-05-08T18:10:23.007769+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:10:23.007769+0000","last_undegraded":"2024-05-08T18:10:23.007769+0000","last_fullsized":"2024-05-08T18:10:23.007769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"101'12","reported_seq":216,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675041+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:10:23.675041+0000","last_peered":"2024-05-08T18:10:23.675041+0000","last_clean":"2024-05-08T18:10:23.675041+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:10:23.675041+0000","last_undegraded":"2024-05-08T18:10:23.675041+0000","last_fullsized":"2024-05-08T18:10:23.675041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"120'15","reported_seq":245,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.765274+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:10:24.765274+0000","last_peered":"2024-05-08T18:10:24.765274+0000","last_clean":"2024-05-08T18:10:24.765274+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:10:24.765274+0000","last_undegraded":"2024-05-08T18:10:24.765274+0000","last_fullsized":"2024-05-08T18:10:24.765274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006408+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:10:23.006408+0000","last_peered":"2024-05-08T18:10:23.006408+0000","last_clean":"2024-05-08T18:10:23.006408+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:10:23.006408+0000","last_undegraded":"2024-05-08T18:10:23.006408+0000","last_fullsized":"2024-05-08T18:10:23.006408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"101'17","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232514+0000","last_change":"2024-05-08T18:07:55.357969+0000","last_active":"2024-05-08T18:10:24.232514+0000","last_peered":"2024-05-08T18:10:24.232514+0000","last_clean":"2024-05-08T18:10:24.232514+0000","last_became_active":"2024-05-08T18:07:55.357205+0000","last_became_peered":"2024-05-08T18:07:55.357205+0000","last_unstale":"2024-05-08T18:10:24.232514+0000","last_undegraded":"2024-05-08T18:10:24.232514+0000","last_fullsized":"2024-05-08T18:10:24.232514+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:04.667292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":29,"num_read_kb":51218,"num_write":47,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673147+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:10:23.673147+0000","last_peered":"2024-05-08T18:10:23.673147+0000","last_clean":"2024-05-08T18:10:23.673147+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:10:23.673147+0000","last_undegraded":"2024-05-08T18:10:23.673147+0000","last_fullsized":"2024-05-08T18:10:23.673147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"101'24","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005976+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:10:23.005976+0000","last_peered":"2024-05-08T18:10:23.005976+0000","last_clean":"2024-05-08T18:10:23.005976+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:10:23.005976+0000","last_undegraded":"2024-05-08T18:10:23.005976+0000","last_fullsized":"2024-05-08T18:10:23.005976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5766,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251690+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:10:24.251690+0000","last_peered":"2024-05-08T18:10:24.251690+0000","last_clean":"2024-05-08T18:10:24.251690+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:10:24.251690+0000","last_undegraded":"2024-05-08T18:10:24.251690+0000","last_fullsized":"2024-05-08T18:10:24.251690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006819+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:10:23.006819+0000","last_peered":"2024-05-08T18:10:23.006819+0000","last_clean":"2024-05-08T18:10:23.006819+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:10:23.006819+0000","last_undegraded":"2024-05-08T18:10:23.006819+0000","last_fullsized":"2024-05-08T18:10:23.006819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"90'2","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748795+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:10:23.748795+0000","last_peered":"2024-05-08T18:10:23.748795+0000","last_clean":"2024-05-08T18:10:23.748795+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:10:23.748795+0000","last_undegraded":"2024-05-08T18:10:23.748795+0000","last_fullsized":"2024-05-08T18:10:23.748795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"101'12","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676002+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:10:23.676002+0000","last_peered":"2024-05-08T18:10:23.676002+0000","last_clean":"2024-05-08T18:10:23.676002+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:10:23.676002+0000","last_undegraded":"2024-05-08T18:10:23.676002+0000","last_fullsized":"2024-05-08T18:10:23.676002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":32792,"num_write":52,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.230736+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:10:24.230736+0000","last_peered":"2024-05-08T18:10:24.230736+0000","last_clean":"2024-05-08T18:10:24.230736+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:10:24.230736+0000","last_undegraded":"2024-05-08T18:10:24.230736+0000","last_fullsized":"2024-05-08T18:10:24.230736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"101'13","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013219+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:10:23.013219+0000","last_peered":"2024-05-08T18:10:23.013219+0000","last_clean":"2024-05-08T18:10:23.013219+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:10:23.013219+0000","last_undegraded":"2024-05-08T18:10:23.013219+0000","last_fullsized":"2024-05-08T18:10:23.013219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009871+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:10:23.009871+0000","last_peered":"2024-05-08T18:10:23.009871+0000","last_clean":"2024-05-08T18:10:23.009871+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:10:23.009871+0000","last_undegraded":"2024-05-08T18:10:23.009871+0000","last_fullsized":"2024-05-08T18:10:23.009871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020405+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:10:23.020405+0000","last_peered":"2024-05-08T18:10:23.020405+0000","last_clean":"2024-05-08T18:10:23.020405+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:10:23.020405+0000","last_undegraded":"2024-05-08T18:10:23.020405+0000","last_fullsized":"2024-05-08T18:10:23.020405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"101'34","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021104+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:10:23.021104+0000","last_peered":"2024-05-08T18:10:23.021104+0000","last_clean":"2024-05-08T18:10:23.021104+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:10:23.021104+0000","last_undegraded":"2024-05-08T18:10:23.021104+0000","last_fullsized":"2024-05-08T18:10:23.021104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"101'6","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676260+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:10:23.676260+0000","last_peered":"2024-05-08T18:10:23.676260+0000","last_clean":"2024-05-08T18:10:23.676260+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:10:23.676260+0000","last_undegraded":"2024-05-08T18:10:23.676260+0000","last_fullsized":"2024-05-08T18:10:23.676260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.231219+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:10:24.231219+0000","last_peered":"2024-05-08T18:10:24.231219+0000","last_clean":"2024-05-08T18:10:24.231219+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:10:24.231219+0000","last_undegraded":"2024-05-08T18:10:24.231219+0000","last_fullsized":"2024-05-08T18:10:24.231219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"101'18","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674346+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:10:23.674346+0000","last_peered":"2024-05-08T18:10:23.674346+0000","last_clean":"2024-05-08T18:10:23.674346+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:10:23.674346+0000","last_undegraded":"2024-05-08T18:10:23.674346+0000","last_fullsized":"2024-05-08T18:10:23.674346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"120'15","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.765543+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:10:24.765543+0000","last_peered":"2024-05-08T18:10:24.765543+0000","last_clean":"2024-05-08T18:10:24.765543+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:10:24.765543+0000","last_undegraded":"2024-05-08T18:10:24.765543+0000","last_fullsized":"2024-05-08T18:10:24.765543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"101'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018672+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:10:23.018672+0000","last_peered":"2024-05-08T18:10:23.018672+0000","last_clean":"2024-05-08T18:10:23.018672+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:10:23.018672+0000","last_undegraded":"2024-05-08T18:10:23.018672+0000","last_fullsized":"2024-05-08T18:10:23.018672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015490+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:10:23.015490+0000","last_peered":"2024-05-08T18:10:23.015490+0000","last_clean":"2024-05-08T18:10:23.015490+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:10:23.015490+0000","last_undegraded":"2024-05-08T18:10:23.015490+0000","last_fullsized":"2024-05-08T18:10:23.015490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"101'18","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007808+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:10:23.007808+0000","last_peered":"2024-05-08T18:10:23.007808+0000","last_clean":"2024-05-08T18:10:23.007808+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:10:23.007808+0000","last_undegraded":"2024-05-08T18:10:23.007808+0000","last_fullsized":"2024-05-08T18:10:23.007808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":34,"num_read_kb":55320,"num_write":58,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232646+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:10:24.232646+0000","last_peered":"2024-05-08T18:10:24.232646+0000","last_clean":"2024-05-08T18:10:24.232646+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:10:24.232646+0000","last_undegraded":"2024-05-08T18:10:24.232646+0000","last_fullsized":"2024-05-08T18:10:24.232646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"101'22","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011471+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:10:23.011471+0000","last_peered":"2024-05-08T18:10:23.011471+0000","last_clean":"2024-05-08T18:10:23.011471+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:10:23.011471+0000","last_undegraded":"2024-05-08T18:10:23.011471+0000","last_fullsized":"2024-05-08T18:10:23.011471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.230902+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:10:24.230902+0000","last_peered":"2024-05-08T18:10:24.230902+0000","last_clean":"2024-05-08T18:10:24.230902+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:10:24.230902+0000","last_undegraded":"2024-05-08T18:10:24.230902+0000","last_fullsized":"2024-05-08T18:10:24.230902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253338+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:10:24.253338+0000","last_peered":"2024-05-08T18:10:24.253338+0000","last_clean":"2024-05-08T18:10:24.253338+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:10:24.253338+0000","last_undegraded":"2024-05-08T18:10:24.253338+0000","last_fullsized":"2024-05-08T18:10:24.253338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750534+0000","last_change":"2024-05-08T18:07:55.356946+0000","last_active":"2024-05-08T18:10:23.750534+0000","last_peered":"2024-05-08T18:10:23.750534+0000","last_clean":"2024-05-08T18:10:23.750534+0000","last_became_active":"2024-05-08T18:07:55.355948+0000","last_became_peered":"2024-05-08T18:07:55.355948+0000","last_unstale":"2024-05-08T18:10:23.750534+0000","last_undegraded":"2024-05-08T18:10:23.750534+0000","last_fullsized":"2024-05-08T18:10:23.750534+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:04.163382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"94'9","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011429+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:10:23.011429+0000","last_peered":"2024-05-08T18:10:23.011429+0000","last_clean":"2024-05-08T18:10:23.011429+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:10:23.011429+0000","last_undegraded":"2024-05-08T18:10:23.011429+0000","last_fullsized":"2024-05-08T18:10:23.011429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232927+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:10:24.232927+0000","last_peered":"2024-05-08T18:10:24.232927+0000","last_clean":"2024-05-08T18:10:24.232927+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:10:24.232927+0000","last_undegraded":"2024-05-08T18:10:24.232927+0000","last_fullsized":"2024-05-08T18:10:24.232927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"104'17","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750330+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:10:23.750330+0000","last_peered":"2024-05-08T18:10:23.750330+0000","last_clean":"2024-05-08T18:10:23.750330+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:10:23.750330+0000","last_undegraded":"2024-05-08T18:10:23.750330+0000","last_fullsized":"2024-05-08T18:10:23.750330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10256,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":24,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017020+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:10:23.017020+0000","last_peered":"2024-05-08T18:10:23.017020+0000","last_clean":"2024-05-08T18:10:23.017020+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:10:23.017020+0000","last_undegraded":"2024-05-08T18:10:23.017020+0000","last_fullsized":"2024-05-08T18:10:23.017020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"90'2","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008384+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:10:23.008384+0000","last_peered":"2024-05-08T18:10:23.008384+0000","last_clean":"2024-05-08T18:10:23.008384+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:10:23.008384+0000","last_undegraded":"2024-05-08T18:10:23.008384+0000","last_fullsized":"2024-05-08T18:10:23.008384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751087+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:10:23.751087+0000","last_peered":"2024-05-08T18:10:23.751087+0000","last_clean":"2024-05-08T18:10:23.751087+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:10:23.751087+0000","last_undegraded":"2024-05-08T18:10:23.751087+0000","last_fullsized":"2024-05-08T18:10:23.751087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"101'6","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021301+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:10:23.021301+0000","last_peered":"2024-05-08T18:10:23.021301+0000","last_clean":"2024-05-08T18:10:23.021301+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:10:23.021301+0000","last_undegraded":"2024-05-08T18:10:23.021301+0000","last_fullsized":"2024-05-08T18:10:23.021301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":16390,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251079+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:10:24.251079+0000","last_peered":"2024-05-08T18:10:24.251079+0000","last_clean":"2024-05-08T18:10:24.251079+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:10:24.251079+0000","last_undegraded":"2024-05-08T18:10:24.251079+0000","last_fullsized":"2024-05-08T18:10:24.251079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"101'19","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232755+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:10:24.232755+0000","last_peered":"2024-05-08T18:10:24.232755+0000","last_clean":"2024-05-08T18:10:24.232755+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:10:24.232755+0000","last_undegraded":"2024-05-08T18:10:24.232755+0000","last_fullsized":"2024-05-08T18:10:24.232755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"120'15","reported_seq":250,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.765590+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:10:24.765590+0000","last_peered":"2024-05-08T18:10:24.765590+0000","last_clean":"2024-05-08T18:10:24.765590+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:10:24.765590+0000","last_undegraded":"2024-05-08T18:10:24.765590+0000","last_fullsized":"2024-05-08T18:10:24.765590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248023+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:10:24.248023+0000","last_peered":"2024-05-08T18:10:24.248023+0000","last_clean":"2024-05-08T18:10:24.248023+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:10:24.248023+0000","last_undegraded":"2024-05-08T18:10:24.248023+0000","last_fullsized":"2024-05-08T18:10:24.248023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"101'42","reported_seq":249,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750723+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:10:23.750723+0000","last_peered":"2024-05-08T18:10:23.750723+0000","last_clean":"2024-05-08T18:10:23.750723+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:10:23.750723+0000","last_undegraded":"2024-05-08T18:10:23.750723+0000","last_fullsized":"2024-05-08T18:10:23.750723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"95'11","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749487+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:10:23.749487+0000","last_peered":"2024-05-08T18:10:23.749487+0000","last_clean":"2024-05-08T18:10:23.749487+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:10:23.749487+0000","last_undegraded":"2024-05-08T18:10:23.749487+0000","last_fullsized":"2024-05-08T18:10:23.749487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":34822,"num_write":21,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":218,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008282+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:10:23.008282+0000","last_peered":"2024-05-08T18:10:23.008282+0000","last_clean":"2024-05-08T18:10:23.008282+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:10:23.008282+0000","last_undegraded":"2024-05-08T18:10:23.008282+0000","last_fullsized":"2024-05-08T18:10:23.008282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":95,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.250890+0000","last_change":"2024-05-08T18:09:06.402195+0000","last_active":"2024-05-08T18:10:24.250890+0000","last_peered":"2024-05-08T18:10:24.250890+0000","last_clean":"2024-05-08T18:10:24.250890+0000","last_became_active":"2024-05-08T18:09:06.380401+0000","last_became_peered":"2024-05-08T18:09:06.380401+0000","last_unstale":"2024-05-08T18:10:24.250890+0000","last_undegraded":"2024-05-08T18:10:24.250890+0000","last_fullsized":"2024-05-08T18:10:24.250890+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:36.840412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"120'15","reported_seq":247,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.761836+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:10:24.761836+0000","last_peered":"2024-05-08T18:10:24.761836+0000","last_clean":"2024-05-08T18:10:24.761836+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:10:24.761836+0000","last_undegraded":"2024-05-08T18:10:24.761836+0000","last_fullsized":"2024-05-08T18:10:24.761836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749093+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:10:23.749093+0000","last_peered":"2024-05-08T18:10:23.749093+0000","last_clean":"2024-05-08T18:10:23.749093+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:10:23.749093+0000","last_undegraded":"2024-05-08T18:10:23.749093+0000","last_fullsized":"2024-05-08T18:10:23.749093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253566+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:10:24.253566+0000","last_peered":"2024-05-08T18:10:24.253566+0000","last_clean":"2024-05-08T18:10:24.253566+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:10:24.253566+0000","last_undegraded":"2024-05-08T18:10:24.253566+0000","last_fullsized":"2024-05-08T18:10:24.253566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"101'13","reported_seq":235,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009532+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:10:23.009532+0000","last_peered":"2024-05-08T18:10:23.009532+0000","last_clean":"2024-05-08T18:10:23.009532+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:10:23.009532+0000","last_undegraded":"2024-05-08T18:10:23.009532+0000","last_fullsized":"2024-05-08T18:10:23.009532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":47110,"num_write":23,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747906+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:10:23.747906+0000","last_peered":"2024-05-08T18:10:23.747906+0000","last_clean":"2024-05-08T18:10:23.747906+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:10:23.747906+0000","last_undegraded":"2024-05-08T18:10:23.747906+0000","last_fullsized":"2024-05-08T18:10:23.747906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"101'21","reported_seq":226,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007012+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:10:23.007012+0000","last_peered":"2024-05-08T18:10:23.007012+0000","last_clean":"2024-05-08T18:10:23.007012+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:10:23.007012+0000","last_undegraded":"2024-05-08T18:10:23.007012+0000","last_fullsized":"2024-05-08T18:10:23.007012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10255,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019992+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:10:23.019992+0000","last_peered":"2024-05-08T18:10:23.019992+0000","last_clean":"2024-05-08T18:10:23.019992+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:10:23.019992+0000","last_undegraded":"2024-05-08T18:10:23.019992+0000","last_fullsized":"2024-05-08T18:10:23.019992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251604+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:10:24.251604+0000","last_peered":"2024-05-08T18:10:24.251604+0000","last_clean":"2024-05-08T18:10:24.251604+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:10:24.251604+0000","last_undegraded":"2024-05-08T18:10:24.251604+0000","last_fullsized":"2024-05-08T18:10:24.251604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021357+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:10:23.021357+0000","last_peered":"2024-05-08T18:10:23.021357+0000","last_clean":"2024-05-08T18:10:23.021357+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:10:23.021357+0000","last_undegraded":"2024-05-08T18:10:23.021357+0000","last_fullsized":"2024-05-08T18:10:23.021357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":311,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674956+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:10:23.674956+0000","last_peered":"2024-05-08T18:10:23.674956+0000","last_clean":"2024-05-08T18:10:23.674956+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:10:23.674956+0000","last_undegraded":"2024-05-08T18:10:23.674956+0000","last_fullsized":"2024-05-08T18:10:23.674956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007096+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:10:23.007096+0000","last_peered":"2024-05-08T18:10:23.007096+0000","last_clean":"2024-05-08T18:10:23.007096+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:10:23.007096+0000","last_undegraded":"2024-05-08T18:10:23.007096+0000","last_fullsized":"2024-05-08T18:10:23.007096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"101'10","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010661+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:10:23.010661+0000","last_peered":"2024-05-08T18:10:23.010661+0000","last_clean":"2024-05-08T18:10:23.010661+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:10:23.010661+0000","last_undegraded":"2024-05-08T18:10:23.010661+0000","last_fullsized":"2024-05-08T18:10:23.010661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674690+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:10:23.674690+0000","last_peered":"2024-05-08T18:10:23.674690+0000","last_clean":"2024-05-08T18:10:23.674690+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:10:23.674690+0000","last_undegraded":"2024-05-08T18:10:23.674690+0000","last_fullsized":"2024-05-08T18:10:23.674690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"101'24","reported_seq":232,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008559+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:10:23.008559+0000","last_peered":"2024-05-08T18:10:23.008559+0000","last_clean":"2024-05-08T18:10:23.008559+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:10:23.008559+0000","last_undegraded":"2024-05-08T18:10:23.008559+0000","last_fullsized":"2024-05-08T18:10:23.008559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15071,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":35,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018810+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:10:23.018810+0000","last_peered":"2024-05-08T18:10:23.018810+0000","last_clean":"2024-05-08T18:10:23.018810+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:10:23.018810+0000","last_undegraded":"2024-05-08T18:10:23.018810+0000","last_fullsized":"2024-05-08T18:10:23.018810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019671+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:10:23.019671+0000","last_peered":"2024-05-08T18:10:23.019671+0000","last_clean":"2024-05-08T18:10:23.019671+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:10:23.019671+0000","last_undegraded":"2024-05-08T18:10:23.019671+0000","last_fullsized":"2024-05-08T18:10:23.019671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019230+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:10:23.019230+0000","last_peered":"2024-05-08T18:10:23.019230+0000","last_clean":"2024-05-08T18:10:23.019230+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:10:23.019230+0000","last_undegraded":"2024-05-08T18:10:23.019230+0000","last_fullsized":"2024-05-08T18:10:23.019230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674634+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:10:23.674634+0000","last_peered":"2024-05-08T18:10:23.674634+0000","last_clean":"2024-05-08T18:10:23.674634+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:10:23.674634+0000","last_undegraded":"2024-05-08T18:10:23.674634+0000","last_fullsized":"2024-05-08T18:10:23.674634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"101'12","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011857+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:10:23.011857+0000","last_peered":"2024-05-08T18:10:23.011857+0000","last_clean":"2024-05-08T18:10:23.011857+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:10:23.011857+0000","last_undegraded":"2024-05-08T18:10:23.011857+0000","last_fullsized":"2024-05-08T18:10:23.011857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":34834,"num_write":42,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008813+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:10:23.008813+0000","last_peered":"2024-05-08T18:10:23.008813+0000","last_clean":"2024-05-08T18:10:23.008813+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:10:23.008813+0000","last_undegraded":"2024-05-08T18:10:23.008813+0000","last_fullsized":"2024-05-08T18:10:23.008813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"120'61","reported_seq":314,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.766098+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:10:24.766098+0000","last_peered":"2024-05-08T18:10:24.766098+0000","last_clean":"2024-05-08T18:10:24.766098+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:10:24.766098+0000","last_undegraded":"2024-05-08T18:10:24.766098+0000","last_fullsized":"2024-05-08T18:10:24.766098+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35210,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":100,"num_read_kb":145,"num_write":72,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674917+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:10:23.674917+0000","last_peered":"2024-05-08T18:10:23.674917+0000","last_clean":"2024-05-08T18:10:23.674917+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:10:23.674917+0000","last_undegraded":"2024-05-08T18:10:23.674917+0000","last_fullsized":"2024-05-08T18:10:23.674917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248556+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:10:24.248556+0000","last_peered":"2024-05-08T18:10:24.248556+0000","last_clean":"2024-05-08T18:10:24.248556+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:10:24.248556+0000","last_undegraded":"2024-05-08T18:10:24.248556+0000","last_fullsized":"2024-05-08T18:10:24.248556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"101'34","reported_seq":239,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253653+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:10:24.253653+0000","last_peered":"2024-05-08T18:10:24.253653+0000","last_clean":"2024-05-08T18:10:24.253653+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:10:24.253653+0000","last_undegraded":"2024-05-08T18:10:24.253653+0000","last_fullsized":"2024-05-08T18:10:24.253653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232846+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:10:24.232846+0000","last_peered":"2024-05-08T18:10:24.232846+0000","last_clean":"2024-05-08T18:10:24.232846+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:10:24.232846+0000","last_undegraded":"2024-05-08T18:10:24.232846+0000","last_fullsized":"2024-05-08T18:10:24.232846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"101'10","reported_seq":226,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247509+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:10:24.247509+0000","last_peered":"2024-05-08T18:10:24.247509+0000","last_clean":"2024-05-08T18:10:24.247509+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:10:24.247509+0000","last_undegraded":"2024-05-08T18:10:24.247509+0000","last_fullsized":"2024-05-08T18:10:24.247509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":28678,"num_write":20,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.231322+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:10:24.231322+0000","last_peered":"2024-05-08T18:10:24.231322+0000","last_clean":"2024-05-08T18:10:24.231322+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:10:24.231322+0000","last_undegraded":"2024-05-08T18:10:24.231322+0000","last_fullsized":"2024-05-08T18:10:24.231322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"120'16","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.761812+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:10:24.761812+0000","last_peered":"2024-05-08T18:10:24.761812+0000","last_clean":"2024-05-08T18:10:24.761812+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:10:24.761812+0000","last_undegraded":"2024-05-08T18:10:24.761812+0000","last_fullsized":"2024-05-08T18:10:24.761812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012071+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:10:23.012071+0000","last_peered":"2024-05-08T18:10:23.012071+0000","last_clean":"2024-05-08T18:10:23.012071+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:10:23.012071+0000","last_undegraded":"2024-05-08T18:10:23.012071+0000","last_fullsized":"2024-05-08T18:10:23.012071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012608+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:10:23.012608+0000","last_peered":"2024-05-08T18:10:23.012608+0000","last_clean":"2024-05-08T18:10:23.012608+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:10:23.012608+0000","last_undegraded":"2024-05-08T18:10:23.012608+0000","last_fullsized":"2024-05-08T18:10:23.012608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"90'6","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251256+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:10:24.251256+0000","last_peered":"2024-05-08T18:10:24.251256+0000","last_clean":"2024-05-08T18:10:24.251256+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:10:24.251256+0000","last_undegraded":"2024-05-08T18:10:24.251256+0000","last_fullsized":"2024-05-08T18:10:24.251256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007417+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:10:23.007417+0000","last_peered":"2024-05-08T18:10:23.007417+0000","last_clean":"2024-05-08T18:10:23.007417+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:10:23.007417+0000","last_undegraded":"2024-05-08T18:10:23.007417+0000","last_fullsized":"2024-05-08T18:10:23.007417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"101'17","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749372+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:10:23.749372+0000","last_peered":"2024-05-08T18:10:23.749372+0000","last_clean":"2024-05-08T18:10:23.749372+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:10:23.749372+0000","last_undegraded":"2024-05-08T18:10:23.749372+0000","last_fullsized":"2024-05-08T18:10:23.749372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":29,"num_read_kb":55314,"num_write":47,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015883+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:10:23.015883+0000","last_peered":"2024-05-08T18:10:23.015883+0000","last_clean":"2024-05-08T18:10:23.015883+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:10:23.015883+0000","last_undegraded":"2024-05-08T18:10:23.015883+0000","last_fullsized":"2024-05-08T18:10:23.015883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010992+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:10:23.010992+0000","last_peered":"2024-05-08T18:10:23.010992+0000","last_clean":"2024-05-08T18:10:23.010992+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:10:23.010992+0000","last_undegraded":"2024-05-08T18:10:23.010992+0000","last_fullsized":"2024-05-08T18:10:23.010992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022360+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:10:23.022360+0000","last_peered":"2024-05-08T18:10:23.022360+0000","last_clean":"2024-05-08T18:10:23.022360+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:10:23.022360+0000","last_undegraded":"2024-05-08T18:10:23.022360+0000","last_fullsized":"2024-05-08T18:10:23.022360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005558+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:10:23.005558+0000","last_peered":"2024-05-08T18:10:23.005558+0000","last_clean":"2024-05-08T18:10:23.005558+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:10:23.005558+0000","last_undegraded":"2024-05-08T18:10:23.005558+0000","last_fullsized":"2024-05-08T18:10:23.005558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'10","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248864+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:10:24.248864+0000","last_peered":"2024-05-08T18:10:24.248864+0000","last_clean":"2024-05-08T18:10:24.248864+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:10:24.248864+0000","last_undegraded":"2024-05-08T18:10:24.248864+0000","last_fullsized":"2024-05-08T18:10:24.248864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"94'7","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008067+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:10:23.008067+0000","last_peered":"2024-05-08T18:10:23.008067+0000","last_clean":"2024-05-08T18:10:23.008067+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:10:23.008067+0000","last_undegraded":"2024-05-08T18:10:23.008067+0000","last_fullsized":"2024-05-08T18:10:23.008067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":22528,"num_write":7,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251507+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:10:24.251507+0000","last_peered":"2024-05-08T18:10:24.251507+0000","last_clean":"2024-05-08T18:10:24.251507+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:10:24.251507+0000","last_undegraded":"2024-05-08T18:10:24.251507+0000","last_fullsized":"2024-05-08T18:10:24.251507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014445+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:10:23.014445+0000","last_peered":"2024-05-08T18:10:23.014445+0000","last_clean":"2024-05-08T18:10:23.014445+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:10:23.014445+0000","last_undegraded":"2024-05-08T18:10:23.014445+0000","last_fullsized":"2024-05-08T18:10:23.014445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"101'32","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015001+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:10:23.015001+0000","last_peered":"2024-05-08T18:10:23.015001+0000","last_clean":"2024-05-08T18:10:23.015001+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:10:23.015001+0000","last_undegraded":"2024-05-08T18:10:23.015001+0000","last_fullsized":"2024-05-08T18:10:23.015001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13755,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":66,"num_write":40,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748261+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:10:23.748261+0000","last_peered":"2024-05-08T18:10:23.748261+0000","last_clean":"2024-05-08T18:10:23.748261+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:10:23.748261+0000","last_undegraded":"2024-05-08T18:10:23.748261+0000","last_fullsized":"2024-05-08T18:10:23.748261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"90'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016164+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:10:23.016164+0000","last_peered":"2024-05-08T18:10:23.016164+0000","last_clean":"2024-05-08T18:10:23.016164+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:10:23.016164+0000","last_undegraded":"2024-05-08T18:10:23.016164+0000","last_fullsized":"2024-05-08T18:10:23.016164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"101'42","reported_seq":247,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015384+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:10:23.015384+0000","last_peered":"2024-05-08T18:10:23.015384+0000","last_clean":"2024-05-08T18:10:23.015384+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:10:23.015384+0000","last_undegraded":"2024-05-08T18:10:23.015384+0000","last_fullsized":"2024-05-08T18:10:23.015384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251344+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:10:24.251344+0000","last_peered":"2024-05-08T18:10:24.251344+0000","last_clean":"2024-05-08T18:10:24.251344+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:10:24.251344+0000","last_undegraded":"2024-05-08T18:10:24.251344+0000","last_fullsized":"2024-05-08T18:10:24.251344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676602+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:10:23.676602+0000","last_peered":"2024-05-08T18:10:23.676602+0000","last_clean":"2024-05-08T18:10:23.676602+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:10:23.676602+0000","last_undegraded":"2024-05-08T18:10:23.676602+0000","last_fullsized":"2024-05-08T18:10:23.676602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020771+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:10:23.020771+0000","last_peered":"2024-05-08T18:10:23.020771+0000","last_clean":"2024-05-08T18:10:23.020771+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:10:23.020771+0000","last_undegraded":"2024-05-08T18:10:23.020771+0000","last_fullsized":"2024-05-08T18:10:23.020771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247820+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:10:24.247820+0000","last_peered":"2024-05-08T18:10:24.247820+0000","last_clean":"2024-05-08T18:10:24.247820+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:10:24.247820+0000","last_undegraded":"2024-05-08T18:10:24.247820+0000","last_fullsized":"2024-05-08T18:10:24.247820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"120'15","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.762235+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:10:24.762235+0000","last_peered":"2024-05-08T18:10:24.762235+0000","last_clean":"2024-05-08T18:10:24.762235+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:10:24.762235+0000","last_undegraded":"2024-05-08T18:10:24.762235+0000","last_fullsized":"2024-05-08T18:10:24.762235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"101'4","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012889+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:10:23.012889+0000","last_peered":"2024-05-08T18:10:23.012889+0000","last_clean":"2024-05-08T18:10:23.012889+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:10:23.012889+0000","last_undegraded":"2024-05-08T18:10:23.012889+0000","last_fullsized":"2024-05-08T18:10:23.012889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008956+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:10:23.008956+0000","last_peered":"2024-05-08T18:10:23.008956+0000","last_clean":"2024-05-08T18:10:23.008956+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:10:23.008956+0000","last_undegraded":"2024-05-08T18:10:23.008956+0000","last_fullsized":"2024-05-08T18:10:23.008956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"101'10","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011790+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:10:23.011790+0000","last_peered":"2024-05-08T18:10:23.011790+0000","last_clean":"2024-05-08T18:10:23.011790+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:10:23.011790+0000","last_undegraded":"2024-05-08T18:10:23.011790+0000","last_fullsized":"2024-05-08T18:10:23.011790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.254105+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:10:24.254105+0000","last_peered":"2024-05-08T18:10:24.254105+0000","last_clean":"2024-05-08T18:10:24.254105+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:10:24.254105+0000","last_undegraded":"2024-05-08T18:10:24.254105+0000","last_fullsized":"2024-05-08T18:10:24.254105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747745+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:10:23.747745+0000","last_peered":"2024-05-08T18:10:23.747745+0000","last_clean":"2024-05-08T18:10:23.747745+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:10:23.747745+0000","last_undegraded":"2024-05-08T18:10:23.747745+0000","last_fullsized":"2024-05-08T18:10:23.747745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749424+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:10:23.749424+0000","last_peered":"2024-05-08T18:10:23.749424+0000","last_clean":"2024-05-08T18:10:23.749424+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:10:23.749424+0000","last_undegraded":"2024-05-08T18:10:23.749424+0000","last_fullsized":"2024-05-08T18:10:23.749424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"120'15","reported_seq":261,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.765325+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:10:24.765325+0000","last_peered":"2024-05-08T18:10:24.765325+0000","last_clean":"2024-05-08T18:10:24.765325+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:10:24.765325+0000","last_undegraded":"2024-05-08T18:10:24.765325+0000","last_fullsized":"2024-05-08T18:10:24.765325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015918+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:10:23.015918+0000","last_peered":"2024-05-08T18:10:23.015918+0000","last_clean":"2024-05-08T18:10:23.015918+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:10:23.015918+0000","last_undegraded":"2024-05-08T18:10:23.015918+0000","last_fullsized":"2024-05-08T18:10:23.015918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748928+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:10:23.748928+0000","last_peered":"2024-05-08T18:10:23.748928+0000","last_clean":"2024-05-08T18:10:23.748928+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:10:23.748928+0000","last_undegraded":"2024-05-08T18:10:23.748928+0000","last_fullsized":"2024-05-08T18:10:23.748928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"101'17","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019599+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:10:23.019599+0000","last_peered":"2024-05-08T18:10:23.019599+0000","last_clean":"2024-05-08T18:10:23.019599+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:10:23.019599+0000","last_undegraded":"2024-05-08T18:10:23.019599+0000","last_fullsized":"2024-05-08T18:10:23.019599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":40996,"num_write":77,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023317+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:10:23.023317+0000","last_peered":"2024-05-08T18:10:23.023317+0000","last_clean":"2024-05-08T18:10:23.023317+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:10:23.023317+0000","last_undegraded":"2024-05-08T18:10:23.023317+0000","last_fullsized":"2024-05-08T18:10:23.023317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008711+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:10:23.008711+0000","last_peered":"2024-05-08T18:10:23.008711+0000","last_clean":"2024-05-08T18:10:23.008711+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:10:23.008711+0000","last_undegraded":"2024-05-08T18:10:23.008711+0000","last_fullsized":"2024-05-08T18:10:23.008711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"101'42","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674574+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:10:23.674574+0000","last_peered":"2024-05-08T18:10:23.674574+0000","last_clean":"2024-05-08T18:10:23.674574+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:10:23.674574+0000","last_undegraded":"2024-05-08T18:10:23.674574+0000","last_fullsized":"2024-05-08T18:10:23.674574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31839,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":73,"num_read_kb":101,"num_write":56,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010131+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:10:23.010131+0000","last_peered":"2024-05-08T18:10:23.010131+0000","last_clean":"2024-05-08T18:10:23.010131+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:10:23.010131+0000","last_undegraded":"2024-05-08T18:10:23.010131+0000","last_fullsized":"2024-05-08T18:10:23.010131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006701+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:10:23.006701+0000","last_peered":"2024-05-08T18:10:23.006701+0000","last_clean":"2024-05-08T18:10:23.006701+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:10:23.006701+0000","last_undegraded":"2024-05-08T18:10:23.006701+0000","last_fullsized":"2024-05-08T18:10:23.006701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016491+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:10:23.016491+0000","last_peered":"2024-05-08T18:10:23.016491+0000","last_clean":"2024-05-08T18:10:23.016491+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:10:23.016491+0000","last_undegraded":"2024-05-08T18:10:23.016491+0000","last_fullsized":"2024-05-08T18:10:23.016491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"101'34","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749025+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:10:23.749025+0000","last_peered":"2024-05-08T18:10:23.749025+0000","last_clean":"2024-05-08T18:10:23.749025+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:10:23.749025+0000","last_undegraded":"2024-05-08T18:10:23.749025+0000","last_fullsized":"2024-05-08T18:10:23.749025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"101'6","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749652+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:10:23.749652+0000","last_peered":"2024-05-08T18:10:23.749652+0000","last_clean":"2024-05-08T18:10:23.749652+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:10:23.749652+0000","last_undegraded":"2024-05-08T18:10:23.749652+0000","last_fullsized":"2024-05-08T18:10:23.749652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248466+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:10:24.248466+0000","last_peered":"2024-05-08T18:10:24.248466+0000","last_clean":"2024-05-08T18:10:24.248466+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:10:24.248466+0000","last_undegraded":"2024-05-08T18:10:24.248466+0000","last_fullsized":"2024-05-08T18:10:24.248466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"101'18","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008436+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:10:23.008436+0000","last_peered":"2024-05-08T18:10:23.008436+0000","last_clean":"2024-05-08T18:10:23.008436+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:10:23.008436+0000","last_undegraded":"2024-05-08T18:10:23.008436+0000","last_fullsized":"2024-05-08T18:10:23.008436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008394+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:10:23.008394+0000","last_peered":"2024-05-08T18:10:23.008394+0000","last_clean":"2024-05-08T18:10:23.008394+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:10:23.008394+0000","last_undegraded":"2024-05-08T18:10:23.008394+0000","last_fullsized":"2024-05-08T18:10:23.008394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010335+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:10:23.010335+0000","last_peered":"2024-05-08T18:10:23.010335+0000","last_clean":"2024-05-08T18:10:23.010335+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:10:23.010335+0000","last_undegraded":"2024-05-08T18:10:23.010335+0000","last_fullsized":"2024-05-08T18:10:23.010335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248784+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:10:24.248784+0000","last_peered":"2024-05-08T18:10:24.248784+0000","last_clean":"2024-05-08T18:10:24.248784+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:10:24.248784+0000","last_undegraded":"2024-05-08T18:10:24.248784+0000","last_fullsized":"2024-05-08T18:10:24.248784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"101'16","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676106+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:10:23.676106+0000","last_peered":"2024-05-08T18:10:23.676106+0000","last_clean":"2024-05-08T18:10:23.676106+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:10:23.676106+0000","last_undegraded":"2024-05-08T18:10:23.676106+0000","last_fullsized":"2024-05-08T18:10:23.676106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":47128,"num_write":56,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012366+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:10:23.012366+0000","last_peered":"2024-05-08T18:10:23.012366+0000","last_clean":"2024-05-08T18:10:23.012366+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:10:23.012366+0000","last_undegraded":"2024-05-08T18:10:23.012366+0000","last_fullsized":"2024-05-08T18:10:23.012366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"48'5","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015264+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:10:23.015264+0000","last_peered":"2024-05-08T18:10:23.015264+0000","last_clean":"2024-05-08T18:10:23.015264+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:10:23.015264+0000","last_undegraded":"2024-05-08T18:10:23.015264+0000","last_fullsized":"2024-05-08T18:10:23.015264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674157+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:10:23.674157+0000","last_peered":"2024-05-08T18:10:23.674157+0000","last_clean":"2024-05-08T18:10:23.674157+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:10:23.674157+0000","last_undegraded":"2024-05-08T18:10:23.674157+0000","last_fullsized":"2024-05-08T18:10:23.674157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"90'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015893+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:10:23.015893+0000","last_peered":"2024-05-08T18:10:23.015893+0000","last_clean":"2024-05-08T18:10:23.015893+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:10:23.015893+0000","last_undegraded":"2024-05-08T18:10:23.015893+0000","last_fullsized":"2024-05-08T18:10:23.015893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009605+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:10:23.009605+0000","last_peered":"2024-05-08T18:10:23.009605+0000","last_clean":"2024-05-08T18:10:23.009605+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:10:23.009605+0000","last_undegraded":"2024-05-08T18:10:23.009605+0000","last_fullsized":"2024-05-08T18:10:23.009605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"101'15","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008271+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:10:23.008271+0000","last_peered":"2024-05-08T18:10:23.008271+0000","last_clean":"2024-05-08T18:10:23.008271+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:10:23.008271+0000","last_undegraded":"2024-05-08T18:10:23.008271+0000","last_fullsized":"2024-05-08T18:10:23.008271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":47122,"num_write":45,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673614+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:10:23.673614+0000","last_peered":"2024-05-08T18:10:23.673614+0000","last_clean":"2024-05-08T18:10:23.673614+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:10:23.673614+0000","last_undegraded":"2024-05-08T18:10:23.673614+0000","last_fullsized":"2024-05-08T18:10:23.673614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"101'16","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011817+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:10:23.011817+0000","last_peered":"2024-05-08T18:10:23.011817+0000","last_clean":"2024-05-08T18:10:23.011817+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:10:23.011817+0000","last_undegraded":"2024-05-08T18:10:23.011817+0000","last_fullsized":"2024-05-08T18:10:23.011817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020690+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:10:23.020690+0000","last_peered":"2024-05-08T18:10:23.020690+0000","last_clean":"2024-05-08T18:10:23.020690+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:10:23.020690+0000","last_undegraded":"2024-05-08T18:10:23.020690+0000","last_fullsized":"2024-05-08T18:10:23.020690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006544+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:10:23.006544+0000","last_peered":"2024-05-08T18:10:23.006544+0000","last_clean":"2024-05-08T18:10:23.006544+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:10:23.006544+0000","last_undegraded":"2024-05-08T18:10:23.006544+0000","last_fullsized":"2024-05-08T18:10:23.006544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009195+0000","last_change":"2024-05-08T18:07:55.359230+0000","last_active":"2024-05-08T18:10:23.009195+0000","last_peered":"2024-05-08T18:10:23.009195+0000","last_clean":"2024-05-08T18:10:23.009195+0000","last_became_active":"2024-05-08T18:07:55.358047+0000","last_became_peered":"2024-05-08T18:07:55.358047+0000","last_unstale":"2024-05-08T18:10:23.009195+0000","last_undegraded":"2024-05-08T18:10:23.009195+0000","last_fullsized":"2024-05-08T18:10:23.009195+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:52.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018330+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:10:23.018330+0000","last_peered":"2024-05-08T18:10:23.018330+0000","last_clean":"2024-05-08T18:10:23.018330+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:10:23.018330+0000","last_undegraded":"2024-05-08T18:10:23.018330+0000","last_fullsized":"2024-05-08T18:10:23.018330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020607+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:10:23.020607+0000","last_peered":"2024-05-08T18:10:23.020607+0000","last_clean":"2024-05-08T18:10:23.020607+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:10:23.020607+0000","last_undegraded":"2024-05-08T18:10:23.020607+0000","last_fullsized":"2024-05-08T18:10:23.020607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"101'15","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674190+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:10:23.674190+0000","last_peered":"2024-05-08T18:10:23.674190+0000","last_clean":"2024-05-08T18:10:23.674190+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:10:23.674190+0000","last_undegraded":"2024-05-08T18:10:23.674190+0000","last_fullsized":"2024-05-08T18:10:23.674190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013395+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:10:23.013395+0000","last_peered":"2024-05-08T18:10:23.013395+0000","last_clean":"2024-05-08T18:10:23.013395+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:10:23.013395+0000","last_undegraded":"2024-05-08T18:10:23.013395+0000","last_fullsized":"2024-05-08T18:10:23.013395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022955+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:10:23.022955+0000","last_peered":"2024-05-08T18:10:23.022955+0000","last_clean":"2024-05-08T18:10:23.022955+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:10:23.022955+0000","last_undegraded":"2024-05-08T18:10:23.022955+0000","last_fullsized":"2024-05-08T18:10:23.022955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009453+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:10:23.009453+0000","last_peered":"2024-05-08T18:10:23.009453+0000","last_clean":"2024-05-08T18:10:23.009453+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:10:23.009453+0000","last_undegraded":"2024-05-08T18:10:23.009453+0000","last_fullsized":"2024-05-08T18:10:23.009453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":208,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019005+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:10:23.019005+0000","last_peered":"2024-05-08T18:10:23.019005+0000","last_clean":"2024-05-08T18:10:23.019005+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:10:23.019005+0000","last_undegraded":"2024-05-08T18:10:23.019005+0000","last_fullsized":"2024-05-08T18:10:23.019005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"101'24","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252394+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:10:24.252394+0000","last_peered":"2024-05-08T18:10:24.252394+0000","last_clean":"2024-05-08T18:10:24.252394+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:10:24.252394+0000","last_undegraded":"2024-05-08T18:10:24.252394+0000","last_fullsized":"2024-05-08T18:10:24.252394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12641,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":50,"num_write":30,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007070+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:10:23.007070+0000","last_peered":"2024-05-08T18:10:23.007070+0000","last_clean":"2024-05-08T18:10:23.007070+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:10:23.007070+0000","last_undegraded":"2024-05-08T18:10:23.007070+0000","last_fullsized":"2024-05-08T18:10:23.007070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011163+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:10:23.011163+0000","last_peered":"2024-05-08T18:10:23.011163+0000","last_clean":"2024-05-08T18:10:23.011163+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:10:23.011163+0000","last_undegraded":"2024-05-08T18:10:23.011163+0000","last_fullsized":"2024-05-08T18:10:23.011163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019138+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:10:23.019138+0000","last_peered":"2024-05-08T18:10:23.019138+0000","last_clean":"2024-05-08T18:10:23.019138+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:10:23.019138+0000","last_undegraded":"2024-05-08T18:10:23.019138+0000","last_fullsized":"2024-05-08T18:10:23.019138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"91'3","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248368+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:10:24.248368+0000","last_peered":"2024-05-08T18:10:24.248368+0000","last_clean":"2024-05-08T18:10:24.248368+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:10:24.248368+0000","last_undegraded":"2024-05-08T18:10:24.248368+0000","last_fullsized":"2024-05-08T18:10:24.248368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":196,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022596+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:10:23.022596+0000","last_peered":"2024-05-08T18:10:23.022596+0000","last_clean":"2024-05-08T18:10:23.022596+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:10:23.022596+0000","last_undegraded":"2024-05-08T18:10:23.022596+0000","last_fullsized":"2024-05-08T18:10:23.022596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"101'18","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674600+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:10:23.674600+0000","last_peered":"2024-05-08T18:10:23.674600+0000","last_clean":"2024-05-08T18:10:23.674600+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:10:23.674600+0000","last_undegraded":"2024-05-08T18:10:23.674600+0000","last_fullsized":"2024-05-08T18:10:23.674600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252484+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:10:24.252484+0000","last_peered":"2024-05-08T18:10:24.252484+0000","last_clean":"2024-05-08T18:10:24.252484+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:10:24.252484+0000","last_undegraded":"2024-05-08T18:10:24.252484+0000","last_fullsized":"2024-05-08T18:10:24.252484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020215+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:10:23.020215+0000","last_peered":"2024-05-08T18:10:23.020215+0000","last_clean":"2024-05-08T18:10:23.020215+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:10:23.020215+0000","last_undegraded":"2024-05-08T18:10:23.020215+0000","last_fullsized":"2024-05-08T18:10:23.020215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010027+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:10:23.010027+0000","last_peered":"2024-05-08T18:10:23.010027+0000","last_clean":"2024-05-08T18:10:23.010027+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:10:23.010027+0000","last_undegraded":"2024-05-08T18:10:23.010027+0000","last_fullsized":"2024-05-08T18:10:23.010027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"101'6","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749937+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:10:23.749937+0000","last_peered":"2024-05-08T18:10:23.749937+0000","last_clean":"2024-05-08T18:10:23.749937+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:10:23.749937+0000","last_undegraded":"2024-05-08T18:10:23.749937+0000","last_fullsized":"2024-05-08T18:10:23.749937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747838+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:10:23.747838+0000","last_peered":"2024-05-08T18:10:23.747838+0000","last_clean":"2024-05-08T18:10:23.747838+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:10:23.747838+0000","last_undegraded":"2024-05-08T18:10:23.747838+0000","last_fullsized":"2024-05-08T18:10:23.747838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"101'15","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013244+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:10:23.013244+0000","last_peered":"2024-05-08T18:10:23.013244+0000","last_clean":"2024-05-08T18:10:23.013244+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:10:23.013244+0000","last_undegraded":"2024-05-08T18:10:23.013244+0000","last_fullsized":"2024-05-08T18:10:23.013244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247314+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:10:24.247314+0000","last_peered":"2024-05-08T18:10:24.247314+0000","last_clean":"2024-05-08T18:10:24.247314+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:10:24.247314+0000","last_undegraded":"2024-05-08T18:10:24.247314+0000","last_fullsized":"2024-05-08T18:10:24.247314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005943+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:10:23.005943+0000","last_peered":"2024-05-08T18:10:23.005943+0000","last_clean":"2024-05-08T18:10:23.005943+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:10:23.005943+0000","last_undegraded":"2024-05-08T18:10:23.005943+0000","last_fullsized":"2024-05-08T18:10:23.005943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"90'6","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232830+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:10:24.232830+0000","last_peered":"2024-05-08T18:10:24.232830+0000","last_clean":"2024-05-08T18:10:24.232830+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:10:24.232830+0000","last_undegraded":"2024-05-08T18:10:24.232830+0000","last_fullsized":"2024-05-08T18:10:24.232830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"94'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013712+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:10:23.013712+0000","last_peered":"2024-05-08T18:10:23.013712+0000","last_clean":"2024-05-08T18:10:23.013712+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:10:23.013712+0000","last_undegraded":"2024-05-08T18:10:23.013712+0000","last_fullsized":"2024-05-08T18:10:23.013712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":38912,"num_write":11,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252691+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:10:24.252691+0000","last_peered":"2024-05-08T18:10:24.252691+0000","last_clean":"2024-05-08T18:10:24.252691+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:10:24.252691+0000","last_undegraded":"2024-05-08T18:10:24.252691+0000","last_fullsized":"2024-05-08T18:10:24.252691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"91'11","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750421+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:10:23.750421+0000","last_peered":"2024-05-08T18:10:23.750421+0000","last_clean":"2024-05-08T18:10:23.750421+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:10:23.750421+0000","last_undegraded":"2024-05-08T18:10:23.750421+0000","last_fullsized":"2024-05-08T18:10:23.750421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"120'15","reported_seq":251,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.762151+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:10:24.762151+0000","last_peered":"2024-05-08T18:10:24.762151+0000","last_clean":"2024-05-08T18:10:24.762151+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:10:24.762151+0000","last_undegraded":"2024-05-08T18:10:24.762151+0000","last_fullsized":"2024-05-08T18:10:24.762151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"101'6","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673614+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:10:23.673614+0000","last_peered":"2024-05-08T18:10:23.673614+0000","last_clean":"2024-05-08T18:10:23.673614+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:10:23.673614+0000","last_undegraded":"2024-05-08T18:10:23.673614+0000","last_fullsized":"2024-05-08T18:10:23.673614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748762+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:10:23.748762+0000","last_peered":"2024-05-08T18:10:23.748762+0000","last_clean":"2024-05-08T18:10:23.748762+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:10:23.748762+0000","last_undegraded":"2024-05-08T18:10:23.748762+0000","last_fullsized":"2024-05-08T18:10:23.748762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"101'9","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007512+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:10:23.007512+0000","last_peered":"2024-05-08T18:10:23.007512+0000","last_clean":"2024-05-08T18:10:23.007512+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:10:23.007512+0000","last_undegraded":"2024-05-08T18:10:23.007512+0000","last_fullsized":"2024-05-08T18:10:23.007512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":24594,"num_write":39,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674308+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:10:23.674308+0000","last_peered":"2024-05-08T18:10:23.674308+0000","last_clean":"2024-05-08T18:10:23.674308+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:10:23.674308+0000","last_undegraded":"2024-05-08T18:10:23.674308+0000","last_fullsized":"2024-05-08T18:10:23.674308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"101'19","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006220+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:10:23.006220+0000","last_peered":"2024-05-08T18:10:23.006220+0000","last_clean":"2024-05-08T18:10:23.006220+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:10:23.006220+0000","last_undegraded":"2024-05-08T18:10:23.006220+0000","last_fullsized":"2024-05-08T18:10:23.006220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5206,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014002+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:10:23.014002+0000","last_peered":"2024-05-08T18:10:23.014002+0000","last_clean":"2024-05-08T18:10:23.014002+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:10:23.014002+0000","last_undegraded":"2024-05-08T18:10:23.014002+0000","last_fullsized":"2024-05-08T18:10:23.014002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"101'2","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676327+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:10:23.676327+0000","last_peered":"2024-05-08T18:10:23.676327+0000","last_clean":"2024-05-08T18:10:23.676327+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:10:23.676327+0000","last_undegraded":"2024-05-08T18:10:23.676327+0000","last_fullsized":"2024-05-08T18:10:23.676327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749701+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:10:23.749701+0000","last_peered":"2024-05-08T18:10:23.749701+0000","last_clean":"2024-05-08T18:10:23.749701+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:10:23.749701+0000","last_undegraded":"2024-05-08T18:10:23.749701+0000","last_fullsized":"2024-05-08T18:10:23.749701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"93'4","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007831+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:10:23.007831+0000","last_peered":"2024-05-08T18:10:23.007831+0000","last_clean":"2024-05-08T18:10:23.007831+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:10:23.007831+0000","last_undegraded":"2024-05-08T18:10:23.007831+0000","last_fullsized":"2024-05-08T18:10:23.007831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006829+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:10:23.006829+0000","last_peered":"2024-05-08T18:10:23.006829+0000","last_clean":"2024-05-08T18:10:23.006829+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:10:23.006829+0000","last_undegraded":"2024-05-08T18:10:23.006829+0000","last_fullsized":"2024-05-08T18:10:23.006829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"101'16","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014381+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:10:23.014381+0000","last_peered":"2024-05-08T18:10:23.014381+0000","last_clean":"2024-05-08T18:10:23.014381+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:10:23.014381+0000","last_undegraded":"2024-05-08T18:10:23.014381+0000","last_fullsized":"2024-05-08T18:10:23.014381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020141+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:10:23.020141+0000","last_peered":"2024-05-08T18:10:23.020141+0000","last_clean":"2024-05-08T18:10:23.020141+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:10:23.020141+0000","last_undegraded":"2024-05-08T18:10:23.020141+0000","last_fullsized":"2024-05-08T18:10:23.020141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010595+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:10:23.010595+0000","last_peered":"2024-05-08T18:10:23.010595+0000","last_clean":"2024-05-08T18:10:23.010595+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:10:23.010595+0000","last_undegraded":"2024-05-08T18:10:23.010595+0000","last_fullsized":"2024-05-08T18:10:23.010595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010032+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:10:23.010032+0000","last_peered":"2024-05-08T18:10:23.010032+0000","last_clean":"2024-05-08T18:10:23.010032+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:10:23.010032+0000","last_undegraded":"2024-05-08T18:10:23.010032+0000","last_fullsized":"2024-05-08T18:10:23.010032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"93'10","reported_seq":172,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247195+0000","last_change":"2024-05-08T18:07:55.439856+0000","last_active":"2024-05-08T18:10:24.247195+0000","last_peered":"2024-05-08T18:10:24.247195+0000","last_clean":"2024-05-08T18:10:24.247195+0000","last_became_active":"2024-05-08T18:07:55.439188+0000","last_became_peered":"2024-05-08T18:07:55.439188+0000","last_unstale":"2024-05-08T18:10:24.247195+0000","last_undegraded":"2024-05-08T18:10:24.247195+0000","last_fullsized":"2024-05-08T18:10:24.247195+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:40.273251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":10,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747721+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:10:23.747721+0000","last_peered":"2024-05-08T18:10:23.747721+0000","last_clean":"2024-05-08T18:10:23.747721+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:10:23.747721+0000","last_undegraded":"2024-05-08T18:10:23.747721+0000","last_fullsized":"2024-05-08T18:10:23.747721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"101'10","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013755+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:10:23.013755+0000","last_peered":"2024-05-08T18:10:23.013755+0000","last_clean":"2024-05-08T18:10:23.013755+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:10:23.013755+0000","last_undegraded":"2024-05-08T18:10:23.013755+0000","last_fullsized":"2024-05-08T18:10:23.013755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10810,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":19,"num_write":12,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748565+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:10:23.748565+0000","last_peered":"2024-05-08T18:10:23.748565+0000","last_clean":"2024-05-08T18:10:23.748565+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:10:23.748565+0000","last_undegraded":"2024-05-08T18:10:23.748565+0000","last_fullsized":"2024-05-08T18:10:23.748565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675169+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:10:23.675169+0000","last_peered":"2024-05-08T18:10:23.675169+0000","last_clean":"2024-05-08T18:10:23.675169+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:10:23.675169+0000","last_undegraded":"2024-05-08T18:10:23.675169+0000","last_fullsized":"2024-05-08T18:10:23.675169+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748961+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:10:23.748961+0000","last_peered":"2024-05-08T18:10:23.748961+0000","last_clean":"2024-05-08T18:10:23.748961+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:10:23.748961+0000","last_undegraded":"2024-05-08T18:10:23.748961+0000","last_fullsized":"2024-05-08T18:10:23.748961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017974+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:10:23.017974+0000","last_peered":"2024-05-08T18:10:23.017974+0000","last_clean":"2024-05-08T18:10:23.017974+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:10:23.017974+0000","last_undegraded":"2024-05-08T18:10:23.017974+0000","last_fullsized":"2024-05-08T18:10:23.017974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247662+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:10:24.247662+0000","last_peered":"2024-05-08T18:10:24.247662+0000","last_clean":"2024-05-08T18:10:24.247662+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:10:24.247662+0000","last_undegraded":"2024-05-08T18:10:24.247662+0000","last_fullsized":"2024-05-08T18:10:24.247662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"101'14","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748818+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:10:23.748818+0000","last_peered":"2024-05-08T18:10:23.748818+0000","last_clean":"2024-05-08T18:10:23.748818+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:10:23.748818+0000","last_undegraded":"2024-05-08T18:10:23.748818+0000","last_fullsized":"2024-05-08T18:10:23.748818+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013086+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:10:23.013086+0000","last_peered":"2024-05-08T18:10:23.013086+0000","last_clean":"2024-05-08T18:10:23.013086+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:10:23.013086+0000","last_undegraded":"2024-05-08T18:10:23.013086+0000","last_fullsized":"2024-05-08T18:10:23.013086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751046+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:10:23.751046+0000","last_peered":"2024-05-08T18:10:23.751046+0000","last_clean":"2024-05-08T18:10:23.751046+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:10:23.751046+0000","last_undegraded":"2024-05-08T18:10:23.751046+0000","last_fullsized":"2024-05-08T18:10:23.751046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"101'36","reported_seq":244,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253470+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:10:24.253470+0000","last_peered":"2024-05-08T18:10:24.253470+0000","last_clean":"2024-05-08T18:10:24.253470+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:10:24.253470+0000","last_undegraded":"2024-05-08T18:10:24.253470+0000","last_fullsized":"2024-05-08T18:10:24.253470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":91,"num_write":52,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"101'18","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019864+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:10:23.019864+0000","last_peered":"2024-05-08T18:10:23.019864+0000","last_clean":"2024-05-08T18:10:23.019864+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:10:23.019864+0000","last_undegraded":"2024-05-08T18:10:23.019864+0000","last_fullsized":"2024-05-08T18:10:23.019864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":47134,"num_write":68,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253866+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:10:24.253866+0000","last_peered":"2024-05-08T18:10:24.253866+0000","last_clean":"2024-05-08T18:10:24.253866+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:10:24.253866+0000","last_undegraded":"2024-05-08T18:10:24.253866+0000","last_fullsized":"2024-05-08T18:10:24.253866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"101'9","reported_seq":226,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.230815+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:10:24.230815+0000","last_peered":"2024-05-08T18:10:24.230815+0000","last_clean":"2024-05-08T18:10:24.230815+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:10:24.230815+0000","last_undegraded":"2024-05-08T18:10:24.230815+0000","last_fullsized":"2024-05-08T18:10:24.230815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":26630,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007320+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:10:23.007320+0000","last_peered":"2024-05-08T18:10:23.007320+0000","last_clean":"2024-05-08T18:10:23.007320+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:10:23.007320+0000","last_undegraded":"2024-05-08T18:10:23.007320+0000","last_fullsized":"2024-05-08T18:10:23.007320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007247+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:10:23.007247+0000","last_peered":"2024-05-08T18:10:23.007247+0000","last_clean":"2024-05-08T18:10:23.007247+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:10:23.007247+0000","last_undegraded":"2024-05-08T18:10:23.007247+0000","last_fullsized":"2024-05-08T18:10:23.007247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251429+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:10:24.251429+0000","last_peered":"2024-05-08T18:10:24.251429+0000","last_clean":"2024-05-08T18:10:24.251429+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:10:24.251429+0000","last_undegraded":"2024-05-08T18:10:24.251429+0000","last_fullsized":"2024-05-08T18:10:24.251429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"101'5","reported_seq":216,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014337+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:10:23.014337+0000","last_peered":"2024-05-08T18:10:23.014337+0000","last_clean":"2024-05-08T18:10:23.014337+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:10:23.014337+0000","last_undegraded":"2024-05-08T18:10:23.014337+0000","last_fullsized":"2024-05-08T18:10:23.014337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":16390,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012990+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:10:23.012990+0000","last_peered":"2024-05-08T18:10:23.012990+0000","last_clean":"2024-05-08T18:10:23.012990+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:10:23.012990+0000","last_undegraded":"2024-05-08T18:10:23.012990+0000","last_fullsized":"2024-05-08T18:10:23.012990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011842+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:10:23.011842+0000","last_peered":"2024-05-08T18:10:23.011842+0000","last_clean":"2024-05-08T18:10:23.011842+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:10:23.011842+0000","last_undegraded":"2024-05-08T18:10:23.011842+0000","last_fullsized":"2024-05-08T18:10:23.011842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749915+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:10:23.749915+0000","last_peered":"2024-05-08T18:10:23.749915+0000","last_clean":"2024-05-08T18:10:23.749915+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:10:23.749915+0000","last_undegraded":"2024-05-08T18:10:23.749915+0000","last_fullsized":"2024-05-08T18:10:23.749915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252920+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:10:24.252920+0000","last_peered":"2024-05-08T18:10:24.252920+0000","last_clean":"2024-05-08T18:10:24.252920+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:10:24.252920+0000","last_undegraded":"2024-05-08T18:10:24.252920+0000","last_fullsized":"2024-05-08T18:10:24.252920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":32786,"num_write":41,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"101'40","reported_seq":251,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009330+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:10:23.009330+0000","last_peered":"2024-05-08T18:10:23.009330+0000","last_clean":"2024-05-08T18:10:23.009330+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:10:23.009330+0000","last_undegraded":"2024-05-08T18:10:23.009330+0000","last_fullsized":"2024-05-08T18:10:23.009330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":102,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"101'9","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022073+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:10:23.022073+0000","last_peered":"2024-05-08T18:10:23.022073+0000","last_clean":"2024-05-08T18:10:23.022073+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:10:23.022073+0000","last_undegraded":"2024-05-08T18:10:23.022073+0000","last_fullsized":"2024-05-08T18:10:23.022073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"90'12","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019735+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:10:23.019735+0000","last_peered":"2024-05-08T18:10:23.019735+0000","last_clean":"2024-05-08T18:10:23.019735+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:10:23.019735+0000","last_undegraded":"2024-05-08T18:10:23.019735+0000","last_fullsized":"2024-05-08T18:10:23.019735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"91'3","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012624+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:10:23.012624+0000","last_peered":"2024-05-08T18:10:23.012624+0000","last_clean":"2024-05-08T18:10:23.012624+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:10:23.012624+0000","last_undegraded":"2024-05-08T18:10:23.012624+0000","last_fullsized":"2024-05-08T18:10:23.012624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017633+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:10:23.017633+0000","last_peered":"2024-05-08T18:10:23.017633+0000","last_clean":"2024-05-08T18:10:23.017633+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:10:23.017633+0000","last_undegraded":"2024-05-08T18:10:23.017633+0000","last_fullsized":"2024-05-08T18:10:23.017633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"101'18","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006664+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:10:23.006664+0000","last_peered":"2024-05-08T18:10:23.006664+0000","last_clean":"2024-05-08T18:10:23.006664+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:10:23.006664+0000","last_undegraded":"2024-05-08T18:10:23.006664+0000","last_fullsized":"2024-05-08T18:10:23.006664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":30,"num_read_kb":55314,"num_write":48,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750654+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:10:23.750654+0000","last_peered":"2024-05-08T18:10:23.750654+0000","last_clean":"2024-05-08T18:10:23.750654+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:10:23.750654+0000","last_undegraded":"2024-05-08T18:10:23.750654+0000","last_fullsized":"2024-05-08T18:10:23.750654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"101'8","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010297+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:10:23.010297+0000","last_peered":"2024-05-08T18:10:23.010297+0000","last_clean":"2024-05-08T18:10:23.010297+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:10:23.010297+0000","last_undegraded":"2024-05-08T18:10:23.010297+0000","last_fullsized":"2024-05-08T18:10:23.010297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.233065+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:10:24.233065+0000","last_peered":"2024-05-08T18:10:24.233065+0000","last_clean":"2024-05-08T18:10:24.233065+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:10:24.233065+0000","last_undegraded":"2024-05-08T18:10:24.233065+0000","last_fullsized":"2024-05-08T18:10:24.233065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"94'7","reported_seq":168,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232504+0000","last_change":"2024-05-08T18:07:55.445745+0000","last_active":"2024-05-08T18:10:24.232504+0000","last_peered":"2024-05-08T18:10:24.232504+0000","last_clean":"2024-05-08T18:10:24.232504+0000","last_became_active":"2024-05-08T18:07:55.444935+0000","last_became_peered":"2024-05-08T18:07:55.444935+0000","last_unstale":"2024-05-08T18:10:24.232504+0000","last_undegraded":"2024-05-08T18:10:24.232504+0000","last_fullsized":"2024-05-08T18:10:24.232504+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:37.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":22528,"num_write":7,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750539+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:10:23.750539+0000","last_peered":"2024-05-08T18:10:23.750539+0000","last_clean":"2024-05-08T18:10:23.750539+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:10:23.750539+0000","last_undegraded":"2024-05-08T18:10:23.750539+0000","last_fullsized":"2024-05-08T18:10:23.750539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"94'6","reported_seq":218,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014718+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:10:23.014718+0000","last_peered":"2024-05-08T18:10:23.014718+0000","last_clean":"2024-05-08T18:10:23.014718+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:10:23.014718+0000","last_undegraded":"2024-05-08T18:10:23.014718+0000","last_fullsized":"2024-05-08T18:10:23.014718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":16390,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674975+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:10:23.674975+0000","last_peered":"2024-05-08T18:10:23.674975+0000","last_clean":"2024-05-08T18:10:23.674975+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:10:23.674975+0000","last_undegraded":"2024-05-08T18:10:23.674975+0000","last_fullsized":"2024-05-08T18:10:23.674975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"101'9","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021427+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:10:23.021427+0000","last_peered":"2024-05-08T18:10:23.021427+0000","last_clean":"2024-05-08T18:10:23.021427+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:10:23.021427+0000","last_undegraded":"2024-05-08T18:10:23.021427+0000","last_fullsized":"2024-05-08T18:10:23.021427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012285+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:10:23.012285+0000","last_peered":"2024-05-08T18:10:23.012285+0000","last_clean":"2024-05-08T18:10:23.012285+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:10:23.012285+0000","last_undegraded":"2024-05-08T18:10:23.012285+0000","last_fullsized":"2024-05-08T18:10:23.012285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676538+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:10:23.676538+0000","last_peered":"2024-05-08T18:10:23.676538+0000","last_clean":"2024-05-08T18:10:23.676538+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:10:23.676538+0000","last_undegraded":"2024-05-08T18:10:23.676538+0000","last_fullsized":"2024-05-08T18:10:23.676538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":26648,"num_write":51,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"101'46","reported_seq":254,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009047+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:10:23.009047+0000","last_peered":"2024-05-08T18:10:23.009047+0000","last_clean":"2024-05-08T18:10:23.009047+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:10:23.009047+0000","last_undegraded":"2024-05-08T18:10:23.009047+0000","last_fullsized":"2024-05-08T18:10:23.009047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"94'11","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232833+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:10:24.232833+0000","last_peered":"2024-05-08T18:10:24.232833+0000","last_clean":"2024-05-08T18:10:24.232833+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:10:24.232833+0000","last_undegraded":"2024-05-08T18:10:24.232833+0000","last_fullsized":"2024-05-08T18:10:24.232833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":45056,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674057+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:10:23.674057+0000","last_peered":"2024-05-08T18:10:23.674057+0000","last_clean":"2024-05-08T18:10:23.674057+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:10:23.674057+0000","last_undegraded":"2024-05-08T18:10:23.674057+0000","last_fullsized":"2024-05-08T18:10:23.674057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"101'9","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008938+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:10:23.008938+0000","last_peered":"2024-05-08T18:10:23.008938+0000","last_clean":"2024-05-08T18:10:23.008938+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:10:23.008938+0000","last_undegraded":"2024-05-08T18:10:23.008938+0000","last_fullsized":"2024-05-08T18:10:23.008938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":26630,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"101'14","reported_seq":234,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006573+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:10:23.006573+0000","last_peered":"2024-05-08T18:10:23.006573+0000","last_clean":"2024-05-08T18:10:23.006573+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:10:23.006573+0000","last_undegraded":"2024-05-08T18:10:23.006573+0000","last_fullsized":"2024-05-08T18:10:23.006573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":18,"num_read_kb":43014,"num_write":24,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017327+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:10:23.017327+0000","last_peered":"2024-05-08T18:10:23.017327+0000","last_clean":"2024-05-08T18:10:23.017327+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:10:23.017327+0000","last_undegraded":"2024-05-08T18:10:23.017327+0000","last_fullsized":"2024-05-08T18:10:23.017327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"101'12","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248214+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:10:24.248214+0000","last_peered":"2024-05-08T18:10:24.248214+0000","last_clean":"2024-05-08T18:10:24.248214+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:10:24.248214+0000","last_undegraded":"2024-05-08T18:10:24.248214+0000","last_fullsized":"2024-05-08T18:10:24.248214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":40966,"num_write":22,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008111+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:10:23.008111+0000","last_peered":"2024-05-08T18:10:23.008111+0000","last_clean":"2024-05-08T18:10:23.008111+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:10:23.008111+0000","last_undegraded":"2024-05-08T18:10:23.008111+0000","last_fullsized":"2024-05-08T18:10:23.008111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":242921,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":927,"num_read_kb":920,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":230738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":577,"ondisk_log_size":577,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1100,"num_read_kb":2048660,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":446980,"kb_used_data":415804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93924860,"statfs":{"total":96636764160,"available":96179056640,"internally_reserved":0,"allocated":425783296,"data_stored":425104836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":331652,"kb_used_data":300476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94040188,"statfs":{"total":96636764160,"available":96297152512,"internally_reserved":0,"allocated":307687424,"data_stored":307055531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":536532,"kb_used_data":505356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93835308,"statfs":{"total":96636764160,"available":96087355392,"internally_reserved":0,"allocated":517484544,"data_stored":516790953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487276,"kb_used_data":456088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93884564,"statfs":{"total":96636764160,"available":96137793536,"internally_reserved":0,"allocated":467034112,"data_stored":466424514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":524192,"kb_used_data":493016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93847648,"statfs":{"total":96636764160,"available":96099991552,"internally_reserved":0,"allocated":504848384,"data_stored":504193220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":317280,"kb_used_data":286104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94054560,"statfs":{"total":96636764160,"available":96311869440,"internally_reserved":0,"allocated":292970496,"data_stored":292361081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303020,"kb_used_data":271844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94068820,"statfs":{"total":96636764160,"available":96326471680,"internally_reserved":0,"allocated":278368256,"data_stored":277720808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":510420,"kb_used_data":479240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93861420,"statfs":{"total":96636764160,"available":96114094080,"internally_reserved":0,"allocated":490741760,"data_stored":490101965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":488636416,"data_stored":488636416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":276824064,"data_stored":276824064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":291504128,"data_stored":291504128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":503316480,"data_stored":503316480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":465567744,"data_stored":465567744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":515899392,"data_stored":515899392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":306184192,"data_stored":306184192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":423624704,"data_stored":423624704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":27109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":49062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":9271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":29104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":42748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":23703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":41692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:10:36.406 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T18:10:36.406 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:10:36.793 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:10:36.800 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:10:36.813 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2024-05-08T18:10:35.729697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636613462,"num_objects":637,"num_object_clones":0,"num_object_copies":1274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":3825,"num_read_kb":2050946,"num_write":3270,"num_write_kb":2050294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1943,"ondisk_log_size":1943,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3457352,"kb_used_data":3207928,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":751517368,"statfs":{"total":773094113280,"available":769553784832,"internally_reserved":0,"allocated":3284918272,"data_stored":3279752908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005639"},"pg_stats":[{"pgid":"3.3f","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676116+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:10:23.676116+0000","last_peered":"2024-05-08T18:10:23.676116+0000","last_clean":"2024-05-08T18:10:23.676116+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:10:23.676116+0000","last_undegraded":"2024-05-08T18:10:23.676116+0000","last_fullsized":"2024-05-08T18:10:23.676116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":34822,"num_write":21,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005921+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:10:23.005921+0000","last_peered":"2024-05-08T18:10:23.005921+0000","last_clean":"2024-05-08T18:10:23.005921+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:10:23.005921+0000","last_undegraded":"2024-05-08T18:10:23.005921+0000","last_fullsized":"2024-05-08T18:10:23.005921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"93'7","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.254012+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:10:24.254012+0000","last_peered":"2024-05-08T18:10:24.254012+0000","last_clean":"2024-05-08T18:10:24.254012+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:10:24.254012+0000","last_undegraded":"2024-05-08T18:10:24.254012+0000","last_fullsized":"2024-05-08T18:10:24.254012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674165+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:10:23.674165+0000","last_peered":"2024-05-08T18:10:23.674165+0000","last_clean":"2024-05-08T18:10:23.674165+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:10:23.674165+0000","last_undegraded":"2024-05-08T18:10:23.674165+0000","last_fullsized":"2024-05-08T18:10:23.674165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"101'15","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016426+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:10:23.016426+0000","last_peered":"2024-05-08T18:10:23.016426+0000","last_clean":"2024-05-08T18:10:23.016426+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:10:23.016426+0000","last_undegraded":"2024-05-08T18:10:23.016426+0000","last_fullsized":"2024-05-08T18:10:23.016426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":47116,"num_write":35,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749409+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:10:23.749409+0000","last_peered":"2024-05-08T18:10:23.749409+0000","last_clean":"2024-05-08T18:10:23.749409+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:10:23.749409+0000","last_undegraded":"2024-05-08T18:10:23.749409+0000","last_fullsized":"2024-05-08T18:10:23.749409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"101'13","reported_seq":232,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007371+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:10:23.007371+0000","last_peered":"2024-05-08T18:10:23.007371+0000","last_clean":"2024-05-08T18:10:23.007371+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:10:23.007371+0000","last_undegraded":"2024-05-08T18:10:23.007371+0000","last_fullsized":"2024-05-08T18:10:23.007371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40972,"num_write":33,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014036+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:10:23.014036+0000","last_peered":"2024-05-08T18:10:23.014036+0000","last_clean":"2024-05-08T18:10:23.014036+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:10:23.014036+0000","last_undegraded":"2024-05-08T18:10:23.014036+0000","last_fullsized":"2024-05-08T18:10:23.014036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"101'5","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675565+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:10:23.675565+0000","last_peered":"2024-05-08T18:10:23.675565+0000","last_clean":"2024-05-08T18:10:23.675565+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:10:23.675565+0000","last_undegraded":"2024-05-08T18:10:23.675565+0000","last_fullsized":"2024-05-08T18:10:23.675565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14342,"num_write":15,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021174+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:10:23.021174+0000","last_peered":"2024-05-08T18:10:23.021174+0000","last_clean":"2024-05-08T18:10:23.021174+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:10:23.021174+0000","last_undegraded":"2024-05-08T18:10:23.021174+0000","last_fullsized":"2024-05-08T18:10:23.021174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"101'9","reported_seq":172,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232335+0000","last_change":"2024-05-08T18:07:55.439965+0000","last_active":"2024-05-08T18:10:24.232335+0000","last_peered":"2024-05-08T18:10:24.232335+0000","last_clean":"2024-05-08T18:10:24.232335+0000","last_became_active":"2024-05-08T18:07:55.439578+0000","last_became_peered":"2024-05-08T18:07:55.439578+0000","last_unstale":"2024-05-08T18:10:24.232335+0000","last_undegraded":"2024-05-08T18:10:24.232335+0000","last_fullsized":"2024-05-08T18:10:24.232335+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:30.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":22540,"num_write":29,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"101'86","reported_seq":299,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750093+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:10:23.750093+0000","last_peered":"2024-05-08T18:10:23.750093+0000","last_clean":"2024-05-08T18:10:23.750093+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:10:23.750093+0000","last_undegraded":"2024-05-08T18:10:23.750093+0000","last_fullsized":"2024-05-08T18:10:23.750093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":219,"num_write":126,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"101'9","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674555+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:10:23.674555+0000","last_peered":"2024-05-08T18:10:23.674555+0000","last_clean":"2024-05-08T18:10:23.674555+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:10:23.674555+0000","last_undegraded":"2024-05-08T18:10:23.674555+0000","last_fullsized":"2024-05-08T18:10:23.674555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32774,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007751+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:10:23.007751+0000","last_peered":"2024-05-08T18:10:23.007751+0000","last_clean":"2024-05-08T18:10:23.007751+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:10:23.007751+0000","last_undegraded":"2024-05-08T18:10:23.007751+0000","last_fullsized":"2024-05-08T18:10:23.007751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"101'14","reported_seq":237,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009256+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:10:23.009256+0000","last_peered":"2024-05-08T18:10:23.009256+0000","last_clean":"2024-05-08T18:10:23.009256+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:10:23.009256+0000","last_undegraded":"2024-05-08T18:10:23.009256+0000","last_fullsized":"2024-05-08T18:10:23.009256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":167,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013504+0000","last_change":"2024-05-08T18:07:47.007132+0000","last_active":"2024-05-08T18:10:23.013504+0000","last_peered":"2024-05-08T18:10:23.013504+0000","last_clean":"2024-05-08T18:10:23.013504+0000","last_became_active":"2024-05-08T18:07:47.006744+0000","last_became_peered":"2024-05-08T18:07:47.006744+0000","last_unstale":"2024-05-08T18:10:23.013504+0000","last_undegraded":"2024-05-08T18:10:23.013504+0000","last_fullsized":"2024-05-08T18:10:23.013504+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:32.802677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748681+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:10:23.748681+0000","last_peered":"2024-05-08T18:10:23.748681+0000","last_clean":"2024-05-08T18:10:23.748681+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:10:23.748681+0000","last_undegraded":"2024-05-08T18:10:23.748681+0000","last_fullsized":"2024-05-08T18:10:23.748681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"101'17","reported_seq":243,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676155+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:10:23.676155+0000","last_peered":"2024-05-08T18:10:23.676155+0000","last_clean":"2024-05-08T18:10:23.676155+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:10:23.676155+0000","last_undegraded":"2024-05-08T18:10:23.676155+0000","last_fullsized":"2024-05-08T18:10:23.676155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":33,"num_read_kb":49176,"num_write":57,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674465+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:10:23.674465+0000","last_peered":"2024-05-08T18:10:23.674465+0000","last_clean":"2024-05-08T18:10:23.674465+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:10:23.674465+0000","last_undegraded":"2024-05-08T18:10:23.674465+0000","last_fullsized":"2024-05-08T18:10:23.674465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"94'10","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021892+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:10:23.021892+0000","last_peered":"2024-05-08T18:10:23.021892+0000","last_clean":"2024-05-08T18:10:23.021892+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:10:23.021892+0000","last_undegraded":"2024-05-08T18:10:23.021892+0000","last_fullsized":"2024-05-08T18:10:23.021892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":32768,"num_write":10,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"101'48","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007110+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:10:23.007110+0000","last_peered":"2024-05-08T18:10:23.007110+0000","last_clean":"2024-05-08T18:10:23.007110+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:10:23.007110+0000","last_undegraded":"2024-05-08T18:10:23.007110+0000","last_fullsized":"2024-05-08T18:10:23.007110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":122,"num_write":70,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"101'6","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021580+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:10:23.021580+0000","last_peered":"2024-05-08T18:10:23.021580+0000","last_clean":"2024-05-08T18:10:23.021580+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:10:23.021580+0000","last_undegraded":"2024-05-08T18:10:23.021580+0000","last_fullsized":"2024-05-08T18:10:23.021580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.233381+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:10:24.233381+0000","last_peered":"2024-05-08T18:10:24.233381+0000","last_clean":"2024-05-08T18:10:24.233381+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:10:24.233381+0000","last_undegraded":"2024-05-08T18:10:24.233381+0000","last_fullsized":"2024-05-08T18:10:24.233381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"94'8","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749710+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:10:23.749710+0000","last_peered":"2024-05-08T18:10:23.749710+0000","last_clean":"2024-05-08T18:10:23.749710+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:10:23.749710+0000","last_undegraded":"2024-05-08T18:10:23.749710+0000","last_fullsized":"2024-05-08T18:10:23.749710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232925+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:10:24.232925+0000","last_peered":"2024-05-08T18:10:24.232925+0000","last_clean":"2024-05-08T18:10:24.232925+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:10:24.232925+0000","last_undegraded":"2024-05-08T18:10:24.232925+0000","last_fullsized":"2024-05-08T18:10:24.232925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"101'6","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012083+0000","last_change":"2024-05-08T18:09:38.328162+0000","last_active":"2024-05-08T18:10:23.012083+0000","last_peered":"2024-05-08T18:10:23.012083+0000","last_clean":"2024-05-08T18:10:23.012083+0000","last_became_active":"2024-05-08T18:09:38.182438+0000","last_became_peered":"2024-05-08T18:09:38.182438+0000","last_unstale":"2024-05-08T18:10:23.012083+0000","last_undegraded":"2024-05-08T18:10:23.012083+0000","last_fullsized":"2024-05-08T18:10:23.012083+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:05.642615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751059+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:10:23.751059+0000","last_peered":"2024-05-08T18:10:23.751059+0000","last_clean":"2024-05-08T18:10:23.751059+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:10:23.751059+0000","last_undegraded":"2024-05-08T18:10:23.751059+0000","last_fullsized":"2024-05-08T18:10:23.751059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"101'9","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013579+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:10:23.013579+0000","last_peered":"2024-05-08T18:10:23.013579+0000","last_clean":"2024-05-08T18:10:23.013579+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:10:23.013579+0000","last_undegraded":"2024-05-08T18:10:23.013579+0000","last_fullsized":"2024-05-08T18:10:23.013579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":28678,"num_write":19,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748132+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:10:23.748132+0000","last_peered":"2024-05-08T18:10:23.748132+0000","last_clean":"2024-05-08T18:10:23.748132+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:10:23.748132+0000","last_undegraded":"2024-05-08T18:10:23.748132+0000","last_fullsized":"2024-05-08T18:10:23.748132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011135+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:10:23.011135+0000","last_peered":"2024-05-08T18:10:23.011135+0000","last_clean":"2024-05-08T18:10:23.011135+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:10:23.011135+0000","last_undegraded":"2024-05-08T18:10:23.011135+0000","last_fullsized":"2024-05-08T18:10:23.011135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"101'12","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675916+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:10:23.675916+0000","last_peered":"2024-05-08T18:10:23.675916+0000","last_clean":"2024-05-08T18:10:23.675916+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:10:23.675916+0000","last_undegraded":"2024-05-08T18:10:23.675916+0000","last_fullsized":"2024-05-08T18:10:23.675916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":36876,"num_write":32,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007061+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:10:23.007061+0000","last_peered":"2024-05-08T18:10:23.007061+0000","last_clean":"2024-05-08T18:10:23.007061+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:10:23.007061+0000","last_undegraded":"2024-05-08T18:10:23.007061+0000","last_fullsized":"2024-05-08T18:10:23.007061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"101'12","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018739+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:10:23.018739+0000","last_peered":"2024-05-08T18:10:23.018739+0000","last_clean":"2024-05-08T18:10:23.018739+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:10:23.018739+0000","last_undegraded":"2024-05-08T18:10:23.018739+0000","last_fullsized":"2024-05-08T18:10:23.018739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675833+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:10:23.675833+0000","last_peered":"2024-05-08T18:10:23.675833+0000","last_clean":"2024-05-08T18:10:23.675833+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:10:23.675833+0000","last_undegraded":"2024-05-08T18:10:23.675833+0000","last_fullsized":"2024-05-08T18:10:23.675833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005832+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:10:23.005832+0000","last_peered":"2024-05-08T18:10:23.005832+0000","last_clean":"2024-05-08T18:10:23.005832+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:10:23.005832+0000","last_undegraded":"2024-05-08T18:10:23.005832+0000","last_fullsized":"2024-05-08T18:10:23.005832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007823+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:10:23.007823+0000","last_peered":"2024-05-08T18:10:23.007823+0000","last_clean":"2024-05-08T18:10:23.007823+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:10:23.007823+0000","last_undegraded":"2024-05-08T18:10:23.007823+0000","last_fullsized":"2024-05-08T18:10:23.007823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013931+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:10:23.013931+0000","last_peered":"2024-05-08T18:10:23.013931+0000","last_clean":"2024-05-08T18:10:23.013931+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:10:23.013931+0000","last_undegraded":"2024-05-08T18:10:23.013931+0000","last_fullsized":"2024-05-08T18:10:23.013931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":30738,"num_write":41,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010902+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:10:23.010902+0000","last_peered":"2024-05-08T18:10:23.010902+0000","last_clean":"2024-05-08T18:10:23.010902+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:10:23.010902+0000","last_undegraded":"2024-05-08T18:10:23.010902+0000","last_fullsized":"2024-05-08T18:10:23.010902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"101'7","reported_seq":206,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750625+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:10:23.750625+0000","last_peered":"2024-05-08T18:10:23.750625+0000","last_clean":"2024-05-08T18:10:23.750625+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:10:23.750625+0000","last_undegraded":"2024-05-08T18:10:23.750625+0000","last_fullsized":"2024-05-08T18:10:23.750625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750086+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:10:23.750086+0000","last_peered":"2024-05-08T18:10:23.750086+0000","last_clean":"2024-05-08T18:10:23.750086+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:10:23.750086+0000","last_undegraded":"2024-05-08T18:10:23.750086+0000","last_fullsized":"2024-05-08T18:10:23.750086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012615+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:10:23.012615+0000","last_peered":"2024-05-08T18:10:23.012615+0000","last_clean":"2024-05-08T18:10:23.012615+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:10:23.012615+0000","last_undegraded":"2024-05-08T18:10:23.012615+0000","last_fullsized":"2024-05-08T18:10:23.012615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"90'6","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019369+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:10:23.019369+0000","last_peered":"2024-05-08T18:10:23.019369+0000","last_clean":"2024-05-08T18:10:23.019369+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:10:23.019369+0000","last_undegraded":"2024-05-08T18:10:23.019369+0000","last_fullsized":"2024-05-08T18:10:23.019369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"101'9","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675435+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:10:23.675435+0000","last_peered":"2024-05-08T18:10:23.675435+0000","last_clean":"2024-05-08T18:10:23.675435+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:10:23.675435+0000","last_undegraded":"2024-05-08T18:10:23.675435+0000","last_fullsized":"2024-05-08T18:10:23.675435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":28684,"num_write":29,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013381+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:10:23.013381+0000","last_peered":"2024-05-08T18:10:23.013381+0000","last_clean":"2024-05-08T18:10:23.013381+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:10:23.013381+0000","last_undegraded":"2024-05-08T18:10:23.013381+0000","last_fullsized":"2024-05-08T18:10:23.013381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232567+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:10:24.232567+0000","last_peered":"2024-05-08T18:10:24.232567+0000","last_clean":"2024-05-08T18:10:24.232567+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:10:24.232567+0000","last_undegraded":"2024-05-08T18:10:24.232567+0000","last_fullsized":"2024-05-08T18:10:24.232567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"120'15","reported_seq":257,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.761766+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:10:24.761766+0000","last_peered":"2024-05-08T18:10:24.761766+0000","last_clean":"2024-05-08T18:10:24.761766+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:10:24.761766+0000","last_undegraded":"2024-05-08T18:10:24.761766+0000","last_fullsized":"2024-05-08T18:10:24.761766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"101'4","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748730+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:10:23.748730+0000","last_peered":"2024-05-08T18:10:23.748730+0000","last_clean":"2024-05-08T18:10:23.748730+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:10:23.748730+0000","last_undegraded":"2024-05-08T18:10:23.748730+0000","last_fullsized":"2024-05-08T18:10:23.748730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012204+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:10:23.012204+0000","last_peered":"2024-05-08T18:10:23.012204+0000","last_clean":"2024-05-08T18:10:23.012204+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:10:23.012204+0000","last_undegraded":"2024-05-08T18:10:23.012204+0000","last_fullsized":"2024-05-08T18:10:23.012204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"101'8","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020021+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:10:23.020021+0000","last_peered":"2024-05-08T18:10:23.020021+0000","last_clean":"2024-05-08T18:10:23.020021+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:10:23.020021+0000","last_undegraded":"2024-05-08T18:10:23.020021+0000","last_fullsized":"2024-05-08T18:10:23.020021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007769+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:10:23.007769+0000","last_peered":"2024-05-08T18:10:23.007769+0000","last_clean":"2024-05-08T18:10:23.007769+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:10:23.007769+0000","last_undegraded":"2024-05-08T18:10:23.007769+0000","last_fullsized":"2024-05-08T18:10:23.007769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"101'12","reported_seq":216,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675041+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:10:23.675041+0000","last_peered":"2024-05-08T18:10:23.675041+0000","last_clean":"2024-05-08T18:10:23.675041+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:10:23.675041+0000","last_undegraded":"2024-05-08T18:10:23.675041+0000","last_fullsized":"2024-05-08T18:10:23.675041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"120'15","reported_seq":245,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.765274+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:10:24.765274+0000","last_peered":"2024-05-08T18:10:24.765274+0000","last_clean":"2024-05-08T18:10:24.765274+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:10:24.765274+0000","last_undegraded":"2024-05-08T18:10:24.765274+0000","last_fullsized":"2024-05-08T18:10:24.765274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006408+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:10:23.006408+0000","last_peered":"2024-05-08T18:10:23.006408+0000","last_clean":"2024-05-08T18:10:23.006408+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:10:23.006408+0000","last_undegraded":"2024-05-08T18:10:23.006408+0000","last_fullsized":"2024-05-08T18:10:23.006408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"101'17","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232514+0000","last_change":"2024-05-08T18:07:55.357969+0000","last_active":"2024-05-08T18:10:24.232514+0000","last_peered":"2024-05-08T18:10:24.232514+0000","last_clean":"2024-05-08T18:10:24.232514+0000","last_became_active":"2024-05-08T18:07:55.357205+0000","last_became_peered":"2024-05-08T18:07:55.357205+0000","last_unstale":"2024-05-08T18:10:24.232514+0000","last_undegraded":"2024-05-08T18:10:24.232514+0000","last_fullsized":"2024-05-08T18:10:24.232514+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:04.667292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":29,"num_read_kb":51218,"num_write":47,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673147+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:10:23.673147+0000","last_peered":"2024-05-08T18:10:23.673147+0000","last_clean":"2024-05-08T18:10:23.673147+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:10:23.673147+0000","last_undegraded":"2024-05-08T18:10:23.673147+0000","last_fullsized":"2024-05-08T18:10:23.673147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"101'24","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005976+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:10:23.005976+0000","last_peered":"2024-05-08T18:10:23.005976+0000","last_clean":"2024-05-08T18:10:23.005976+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:10:23.005976+0000","last_undegraded":"2024-05-08T18:10:23.005976+0000","last_fullsized":"2024-05-08T18:10:23.005976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5766,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251690+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:10:24.251690+0000","last_peered":"2024-05-08T18:10:24.251690+0000","last_clean":"2024-05-08T18:10:24.251690+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:10:24.251690+0000","last_undegraded":"2024-05-08T18:10:24.251690+0000","last_fullsized":"2024-05-08T18:10:24.251690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006819+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:10:23.006819+0000","last_peered":"2024-05-08T18:10:23.006819+0000","last_clean":"2024-05-08T18:10:23.006819+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:10:23.006819+0000","last_undegraded":"2024-05-08T18:10:23.006819+0000","last_fullsized":"2024-05-08T18:10:23.006819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"90'2","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748795+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:10:23.748795+0000","last_peered":"2024-05-08T18:10:23.748795+0000","last_clean":"2024-05-08T18:10:23.748795+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:10:23.748795+0000","last_undegraded":"2024-05-08T18:10:23.748795+0000","last_fullsized":"2024-05-08T18:10:23.748795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"101'12","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676002+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:10:23.676002+0000","last_peered":"2024-05-08T18:10:23.676002+0000","last_clean":"2024-05-08T18:10:23.676002+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:10:23.676002+0000","last_undegraded":"2024-05-08T18:10:23.676002+0000","last_fullsized":"2024-05-08T18:10:23.676002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":32792,"num_write":52,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.230736+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:10:24.230736+0000","last_peered":"2024-05-08T18:10:24.230736+0000","last_clean":"2024-05-08T18:10:24.230736+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:10:24.230736+0000","last_undegraded":"2024-05-08T18:10:24.230736+0000","last_fullsized":"2024-05-08T18:10:24.230736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"101'13","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013219+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:10:23.013219+0000","last_peered":"2024-05-08T18:10:23.013219+0000","last_clean":"2024-05-08T18:10:23.013219+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:10:23.013219+0000","last_undegraded":"2024-05-08T18:10:23.013219+0000","last_fullsized":"2024-05-08T18:10:23.013219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009871+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:10:23.009871+0000","last_peered":"2024-05-08T18:10:23.009871+0000","last_clean":"2024-05-08T18:10:23.009871+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:10:23.009871+0000","last_undegraded":"2024-05-08T18:10:23.009871+0000","last_fullsized":"2024-05-08T18:10:23.009871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020405+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:10:23.020405+0000","last_peered":"2024-05-08T18:10:23.020405+0000","last_clean":"2024-05-08T18:10:23.020405+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:10:23.020405+0000","last_undegraded":"2024-05-08T18:10:23.020405+0000","last_fullsized":"2024-05-08T18:10:23.020405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"101'34","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021104+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:10:23.021104+0000","last_peered":"2024-05-08T18:10:23.021104+0000","last_clean":"2024-05-08T18:10:23.021104+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:10:23.021104+0000","last_undegraded":"2024-05-08T18:10:23.021104+0000","last_fullsized":"2024-05-08T18:10:23.021104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"101'6","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676260+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:10:23.676260+0000","last_peered":"2024-05-08T18:10:23.676260+0000","last_clean":"2024-05-08T18:10:23.676260+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:10:23.676260+0000","last_undegraded":"2024-05-08T18:10:23.676260+0000","last_fullsized":"2024-05-08T18:10:23.676260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.231219+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:10:24.231219+0000","last_peered":"2024-05-08T18:10:24.231219+0000","last_clean":"2024-05-08T18:10:24.231219+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:10:24.231219+0000","last_undegraded":"2024-05-08T18:10:24.231219+0000","last_fullsized":"2024-05-08T18:10:24.231219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"101'18","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674346+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:10:23.674346+0000","last_peered":"2024-05-08T18:10:23.674346+0000","last_clean":"2024-05-08T18:10:23.674346+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:10:23.674346+0000","last_undegraded":"2024-05-08T18:10:23.674346+0000","last_fullsized":"2024-05-08T18:10:23.674346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"120'15","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.765543+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:10:24.765543+0000","last_peered":"2024-05-08T18:10:24.765543+0000","last_clean":"2024-05-08T18:10:24.765543+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:10:24.765543+0000","last_undegraded":"2024-05-08T18:10:24.765543+0000","last_fullsized":"2024-05-08T18:10:24.765543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"101'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018672+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:10:23.018672+0000","last_peered":"2024-05-08T18:10:23.018672+0000","last_clean":"2024-05-08T18:10:23.018672+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:10:23.018672+0000","last_undegraded":"2024-05-08T18:10:23.018672+0000","last_fullsized":"2024-05-08T18:10:23.018672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015490+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:10:23.015490+0000","last_peered":"2024-05-08T18:10:23.015490+0000","last_clean":"2024-05-08T18:10:23.015490+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:10:23.015490+0000","last_undegraded":"2024-05-08T18:10:23.015490+0000","last_fullsized":"2024-05-08T18:10:23.015490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"101'18","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007808+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:10:23.007808+0000","last_peered":"2024-05-08T18:10:23.007808+0000","last_clean":"2024-05-08T18:10:23.007808+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:10:23.007808+0000","last_undegraded":"2024-05-08T18:10:23.007808+0000","last_fullsized":"2024-05-08T18:10:23.007808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":34,"num_read_kb":55320,"num_write":58,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232646+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:10:24.232646+0000","last_peered":"2024-05-08T18:10:24.232646+0000","last_clean":"2024-05-08T18:10:24.232646+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:10:24.232646+0000","last_undegraded":"2024-05-08T18:10:24.232646+0000","last_fullsized":"2024-05-08T18:10:24.232646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"101'22","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011471+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:10:23.011471+0000","last_peered":"2024-05-08T18:10:23.011471+0000","last_clean":"2024-05-08T18:10:23.011471+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:10:23.011471+0000","last_undegraded":"2024-05-08T18:10:23.011471+0000","last_fullsized":"2024-05-08T18:10:23.011471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.230902+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:10:24.230902+0000","last_peered":"2024-05-08T18:10:24.230902+0000","last_clean":"2024-05-08T18:10:24.230902+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:10:24.230902+0000","last_undegraded":"2024-05-08T18:10:24.230902+0000","last_fullsized":"2024-05-08T18:10:24.230902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253338+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:10:24.253338+0000","last_peered":"2024-05-08T18:10:24.253338+0000","last_clean":"2024-05-08T18:10:24.253338+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:10:24.253338+0000","last_undegraded":"2024-05-08T18:10:24.253338+0000","last_fullsized":"2024-05-08T18:10:24.253338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750534+0000","last_change":"2024-05-08T18:07:55.356946+0000","last_active":"2024-05-08T18:10:23.750534+0000","last_peered":"2024-05-08T18:10:23.750534+0000","last_clean":"2024-05-08T18:10:23.750534+0000","last_became_active":"2024-05-08T18:07:55.355948+0000","last_became_peered":"2024-05-08T18:07:55.355948+0000","last_unstale":"2024-05-08T18:10:23.750534+0000","last_undegraded":"2024-05-08T18:10:23.750534+0000","last_fullsized":"2024-05-08T18:10:23.750534+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:04.163382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"94'9","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011429+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:10:23.011429+0000","last_peered":"2024-05-08T18:10:23.011429+0000","last_clean":"2024-05-08T18:10:23.011429+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:10:23.011429+0000","last_undegraded":"2024-05-08T18:10:23.011429+0000","last_fullsized":"2024-05-08T18:10:23.011429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232927+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:10:24.232927+0000","last_peered":"2024-05-08T18:10:24.232927+0000","last_clean":"2024-05-08T18:10:24.232927+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:10:24.232927+0000","last_undegraded":"2024-05-08T18:10:24.232927+0000","last_fullsized":"2024-05-08T18:10:24.232927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"104'17","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750330+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:10:23.750330+0000","last_peered":"2024-05-08T18:10:23.750330+0000","last_clean":"2024-05-08T18:10:23.750330+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:10:23.750330+0000","last_undegraded":"2024-05-08T18:10:23.750330+0000","last_fullsized":"2024-05-08T18:10:23.750330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10256,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":24,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017020+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:10:23.017020+0000","last_peered":"2024-05-08T18:10:23.017020+0000","last_clean":"2024-05-08T18:10:23.017020+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:10:23.017020+0000","last_undegraded":"2024-05-08T18:10:23.017020+0000","last_fullsized":"2024-05-08T18:10:23.017020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"90'2","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008384+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:10:23.008384+0000","last_peered":"2024-05-08T18:10:23.008384+0000","last_clean":"2024-05-08T18:10:23.008384+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:10:23.008384+0000","last_undegraded":"2024-05-08T18:10:23.008384+0000","last_fullsized":"2024-05-08T18:10:23.008384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751087+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:10:23.751087+0000","last_peered":"2024-05-08T18:10:23.751087+0000","last_clean":"2024-05-08T18:10:23.751087+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:10:23.751087+0000","last_undegraded":"2024-05-08T18:10:23.751087+0000","last_fullsized":"2024-05-08T18:10:23.751087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"101'6","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021301+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:10:23.021301+0000","last_peered":"2024-05-08T18:10:23.021301+0000","last_clean":"2024-05-08T18:10:23.021301+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:10:23.021301+0000","last_undegraded":"2024-05-08T18:10:23.021301+0000","last_fullsized":"2024-05-08T18:10:23.021301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":16390,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251079+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:10:24.251079+0000","last_peered":"2024-05-08T18:10:24.251079+0000","last_clean":"2024-05-08T18:10:24.251079+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:10:24.251079+0000","last_undegraded":"2024-05-08T18:10:24.251079+0000","last_fullsized":"2024-05-08T18:10:24.251079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"101'19","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232755+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:10:24.232755+0000","last_peered":"2024-05-08T18:10:24.232755+0000","last_clean":"2024-05-08T18:10:24.232755+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:10:24.232755+0000","last_undegraded":"2024-05-08T18:10:24.232755+0000","last_fullsized":"2024-05-08T18:10:24.232755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"120'15","reported_seq":250,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.765590+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:10:24.765590+0000","last_peered":"2024-05-08T18:10:24.765590+0000","last_clean":"2024-05-08T18:10:24.765590+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:10:24.765590+0000","last_undegraded":"2024-05-08T18:10:24.765590+0000","last_fullsized":"2024-05-08T18:10:24.765590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248023+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:10:24.248023+0000","last_peered":"2024-05-08T18:10:24.248023+0000","last_clean":"2024-05-08T18:10:24.248023+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:10:24.248023+0000","last_undegraded":"2024-05-08T18:10:24.248023+0000","last_fullsized":"2024-05-08T18:10:24.248023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"101'42","reported_seq":249,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750723+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:10:23.750723+0000","last_peered":"2024-05-08T18:10:23.750723+0000","last_clean":"2024-05-08T18:10:23.750723+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:10:23.750723+0000","last_undegraded":"2024-05-08T18:10:23.750723+0000","last_fullsized":"2024-05-08T18:10:23.750723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"95'11","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749487+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:10:23.749487+0000","last_peered":"2024-05-08T18:10:23.749487+0000","last_clean":"2024-05-08T18:10:23.749487+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:10:23.749487+0000","last_undegraded":"2024-05-08T18:10:23.749487+0000","last_fullsized":"2024-05-08T18:10:23.749487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":34822,"num_write":21,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":218,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008282+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:10:23.008282+0000","last_peered":"2024-05-08T18:10:23.008282+0000","last_clean":"2024-05-08T18:10:23.008282+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:10:23.008282+0000","last_undegraded":"2024-05-08T18:10:23.008282+0000","last_fullsized":"2024-05-08T18:10:23.008282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":95,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.250890+0000","last_change":"2024-05-08T18:09:06.402195+0000","last_active":"2024-05-08T18:10:24.250890+0000","last_peered":"2024-05-08T18:10:24.250890+0000","last_clean":"2024-05-08T18:10:24.250890+0000","last_became_active":"2024-05-08T18:09:06.380401+0000","last_became_peered":"2024-05-08T18:09:06.380401+0000","last_unstale":"2024-05-08T18:10:24.250890+0000","last_undegraded":"2024-05-08T18:10:24.250890+0000","last_fullsized":"2024-05-08T18:10:24.250890+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:36.840412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"120'15","reported_seq":247,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.761836+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:10:24.761836+0000","last_peered":"2024-05-08T18:10:24.761836+0000","last_clean":"2024-05-08T18:10:24.761836+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:10:24.761836+0000","last_undegraded":"2024-05-08T18:10:24.761836+0000","last_fullsized":"2024-05-08T18:10:24.761836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749093+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:10:23.749093+0000","last_peered":"2024-05-08T18:10:23.749093+0000","last_clean":"2024-05-08T18:10:23.749093+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:10:23.749093+0000","last_undegraded":"2024-05-08T18:10:23.749093+0000","last_fullsized":"2024-05-08T18:10:23.749093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253566+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:10:24.253566+0000","last_peered":"2024-05-08T18:10:24.253566+0000","last_clean":"2024-05-08T18:10:24.253566+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:10:24.253566+0000","last_undegraded":"2024-05-08T18:10:24.253566+0000","last_fullsized":"2024-05-08T18:10:24.253566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"101'13","reported_seq":235,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009532+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:10:23.009532+0000","last_peered":"2024-05-08T18:10:23.009532+0000","last_clean":"2024-05-08T18:10:23.009532+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:10:23.009532+0000","last_undegraded":"2024-05-08T18:10:23.009532+0000","last_fullsized":"2024-05-08T18:10:23.009532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":47110,"num_write":23,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747906+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:10:23.747906+0000","last_peered":"2024-05-08T18:10:23.747906+0000","last_clean":"2024-05-08T18:10:23.747906+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:10:23.747906+0000","last_undegraded":"2024-05-08T18:10:23.747906+0000","last_fullsized":"2024-05-08T18:10:23.747906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"101'21","reported_seq":226,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007012+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:10:23.007012+0000","last_peered":"2024-05-08T18:10:23.007012+0000","last_clean":"2024-05-08T18:10:23.007012+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:10:23.007012+0000","last_undegraded":"2024-05-08T18:10:23.007012+0000","last_fullsized":"2024-05-08T18:10:23.007012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10255,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019992+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:10:23.019992+0000","last_peered":"2024-05-08T18:10:23.019992+0000","last_clean":"2024-05-08T18:10:23.019992+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:10:23.019992+0000","last_undegraded":"2024-05-08T18:10:23.019992+0000","last_fullsized":"2024-05-08T18:10:23.019992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251604+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:10:24.251604+0000","last_peered":"2024-05-08T18:10:24.251604+0000","last_clean":"2024-05-08T18:10:24.251604+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:10:24.251604+0000","last_undegraded":"2024-05-08T18:10:24.251604+0000","last_fullsized":"2024-05-08T18:10:24.251604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021357+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:10:23.021357+0000","last_peered":"2024-05-08T18:10:23.021357+0000","last_clean":"2024-05-08T18:10:23.021357+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:10:23.021357+0000","last_undegraded":"2024-05-08T18:10:23.021357+0000","last_fullsized":"2024-05-08T18:10:23.021357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":311,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674956+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:10:23.674956+0000","last_peered":"2024-05-08T18:10:23.674956+0000","last_clean":"2024-05-08T18:10:23.674956+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:10:23.674956+0000","last_undegraded":"2024-05-08T18:10:23.674956+0000","last_fullsized":"2024-05-08T18:10:23.674956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007096+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:10:23.007096+0000","last_peered":"2024-05-08T18:10:23.007096+0000","last_clean":"2024-05-08T18:10:23.007096+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:10:23.007096+0000","last_undegraded":"2024-05-08T18:10:23.007096+0000","last_fullsized":"2024-05-08T18:10:23.007096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"101'10","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010661+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:10:23.010661+0000","last_peered":"2024-05-08T18:10:23.010661+0000","last_clean":"2024-05-08T18:10:23.010661+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:10:23.010661+0000","last_undegraded":"2024-05-08T18:10:23.010661+0000","last_fullsized":"2024-05-08T18:10:23.010661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674690+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:10:23.674690+0000","last_peered":"2024-05-08T18:10:23.674690+0000","last_clean":"2024-05-08T18:10:23.674690+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:10:23.674690+0000","last_undegraded":"2024-05-08T18:10:23.674690+0000","last_fullsized":"2024-05-08T18:10:23.674690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"101'24","reported_seq":232,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008559+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:10:23.008559+0000","last_peered":"2024-05-08T18:10:23.008559+0000","last_clean":"2024-05-08T18:10:23.008559+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:10:23.008559+0000","last_undegraded":"2024-05-08T18:10:23.008559+0000","last_fullsized":"2024-05-08T18:10:23.008559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15071,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":35,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018810+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:10:23.018810+0000","last_peered":"2024-05-08T18:10:23.018810+0000","last_clean":"2024-05-08T18:10:23.018810+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:10:23.018810+0000","last_undegraded":"2024-05-08T18:10:23.018810+0000","last_fullsized":"2024-05-08T18:10:23.018810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019671+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:10:23.019671+0000","last_peered":"2024-05-08T18:10:23.019671+0000","last_clean":"2024-05-08T18:10:23.019671+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:10:23.019671+0000","last_undegraded":"2024-05-08T18:10:23.019671+0000","last_fullsized":"2024-05-08T18:10:23.019671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019230+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:10:23.019230+0000","last_peered":"2024-05-08T18:10:23.019230+0000","last_clean":"2024-05-08T18:10:23.019230+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:10:23.019230+0000","last_undegraded":"2024-05-08T18:10:23.019230+0000","last_fullsized":"2024-05-08T18:10:23.019230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674634+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:10:23.674634+0000","last_peered":"2024-05-08T18:10:23.674634+0000","last_clean":"2024-05-08T18:10:23.674634+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:10:23.674634+0000","last_undegraded":"2024-05-08T18:10:23.674634+0000","last_fullsized":"2024-05-08T18:10:23.674634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"101'12","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011857+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:10:23.011857+0000","last_peered":"2024-05-08T18:10:23.011857+0000","last_clean":"2024-05-08T18:10:23.011857+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:10:23.011857+0000","last_undegraded":"2024-05-08T18:10:23.011857+0000","last_fullsized":"2024-05-08T18:10:23.011857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":34834,"num_write":42,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008813+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:10:23.008813+0000","last_peered":"2024-05-08T18:10:23.008813+0000","last_clean":"2024-05-08T18:10:23.008813+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:10:23.008813+0000","last_undegraded":"2024-05-08T18:10:23.008813+0000","last_fullsized":"2024-05-08T18:10:23.008813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"120'61","reported_seq":314,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.766098+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:10:24.766098+0000","last_peered":"2024-05-08T18:10:24.766098+0000","last_clean":"2024-05-08T18:10:24.766098+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:10:24.766098+0000","last_undegraded":"2024-05-08T18:10:24.766098+0000","last_fullsized":"2024-05-08T18:10:24.766098+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35210,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":100,"num_read_kb":145,"num_write":72,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674917+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:10:23.674917+0000","last_peered":"2024-05-08T18:10:23.674917+0000","last_clean":"2024-05-08T18:10:23.674917+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:10:23.674917+0000","last_undegraded":"2024-05-08T18:10:23.674917+0000","last_fullsized":"2024-05-08T18:10:23.674917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248556+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:10:24.248556+0000","last_peered":"2024-05-08T18:10:24.248556+0000","last_clean":"2024-05-08T18:10:24.248556+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:10:24.248556+0000","last_undegraded":"2024-05-08T18:10:24.248556+0000","last_fullsized":"2024-05-08T18:10:24.248556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"101'34","reported_seq":239,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253653+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:10:24.253653+0000","last_peered":"2024-05-08T18:10:24.253653+0000","last_clean":"2024-05-08T18:10:24.253653+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:10:24.253653+0000","last_undegraded":"2024-05-08T18:10:24.253653+0000","last_fullsized":"2024-05-08T18:10:24.253653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232846+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:10:24.232846+0000","last_peered":"2024-05-08T18:10:24.232846+0000","last_clean":"2024-05-08T18:10:24.232846+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:10:24.232846+0000","last_undegraded":"2024-05-08T18:10:24.232846+0000","last_fullsized":"2024-05-08T18:10:24.232846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"101'10","reported_seq":226,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247509+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:10:24.247509+0000","last_peered":"2024-05-08T18:10:24.247509+0000","last_clean":"2024-05-08T18:10:24.247509+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:10:24.247509+0000","last_undegraded":"2024-05-08T18:10:24.247509+0000","last_fullsized":"2024-05-08T18:10:24.247509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":28678,"num_write":20,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.231322+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:10:24.231322+0000","last_peered":"2024-05-08T18:10:24.231322+0000","last_clean":"2024-05-08T18:10:24.231322+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:10:24.231322+0000","last_undegraded":"2024-05-08T18:10:24.231322+0000","last_fullsized":"2024-05-08T18:10:24.231322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"120'16","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.761812+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:10:24.761812+0000","last_peered":"2024-05-08T18:10:24.761812+0000","last_clean":"2024-05-08T18:10:24.761812+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:10:24.761812+0000","last_undegraded":"2024-05-08T18:10:24.761812+0000","last_fullsized":"2024-05-08T18:10:24.761812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012071+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:10:23.012071+0000","last_peered":"2024-05-08T18:10:23.012071+0000","last_clean":"2024-05-08T18:10:23.012071+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:10:23.012071+0000","last_undegraded":"2024-05-08T18:10:23.012071+0000","last_fullsized":"2024-05-08T18:10:23.012071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012608+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:10:23.012608+0000","last_peered":"2024-05-08T18:10:23.012608+0000","last_clean":"2024-05-08T18:10:23.012608+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:10:23.012608+0000","last_undegraded":"2024-05-08T18:10:23.012608+0000","last_fullsized":"2024-05-08T18:10:23.012608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"90'6","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251256+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:10:24.251256+0000","last_peered":"2024-05-08T18:10:24.251256+0000","last_clean":"2024-05-08T18:10:24.251256+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:10:24.251256+0000","last_undegraded":"2024-05-08T18:10:24.251256+0000","last_fullsized":"2024-05-08T18:10:24.251256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007417+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:10:23.007417+0000","last_peered":"2024-05-08T18:10:23.007417+0000","last_clean":"2024-05-08T18:10:23.007417+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:10:23.007417+0000","last_undegraded":"2024-05-08T18:10:23.007417+0000","last_fullsized":"2024-05-08T18:10:23.007417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"101'17","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749372+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:10:23.749372+0000","last_peered":"2024-05-08T18:10:23.749372+0000","last_clean":"2024-05-08T18:10:23.749372+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:10:23.749372+0000","last_undegraded":"2024-05-08T18:10:23.749372+0000","last_fullsized":"2024-05-08T18:10:23.749372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":29,"num_read_kb":55314,"num_write":47,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015883+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:10:23.015883+0000","last_peered":"2024-05-08T18:10:23.015883+0000","last_clean":"2024-05-08T18:10:23.015883+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:10:23.015883+0000","last_undegraded":"2024-05-08T18:10:23.015883+0000","last_fullsized":"2024-05-08T18:10:23.015883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010992+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:10:23.010992+0000","last_peered":"2024-05-08T18:10:23.010992+0000","last_clean":"2024-05-08T18:10:23.010992+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:10:23.010992+0000","last_undegraded":"2024-05-08T18:10:23.010992+0000","last_fullsized":"2024-05-08T18:10:23.010992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022360+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:10:23.022360+0000","last_peered":"2024-05-08T18:10:23.022360+0000","last_clean":"2024-05-08T18:10:23.022360+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:10:23.022360+0000","last_undegraded":"2024-05-08T18:10:23.022360+0000","last_fullsized":"2024-05-08T18:10:23.022360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005558+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:10:23.005558+0000","last_peered":"2024-05-08T18:10:23.005558+0000","last_clean":"2024-05-08T18:10:23.005558+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:10:23.005558+0000","last_undegraded":"2024-05-08T18:10:23.005558+0000","last_fullsized":"2024-05-08T18:10:23.005558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'10","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248864+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:10:24.248864+0000","last_peered":"2024-05-08T18:10:24.248864+0000","last_clean":"2024-05-08T18:10:24.248864+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:10:24.248864+0000","last_undegraded":"2024-05-08T18:10:24.248864+0000","last_fullsized":"2024-05-08T18:10:24.248864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"94'7","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008067+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:10:23.008067+0000","last_peered":"2024-05-08T18:10:23.008067+0000","last_clean":"2024-05-08T18:10:23.008067+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:10:23.008067+0000","last_undegraded":"2024-05-08T18:10:23.008067+0000","last_fullsized":"2024-05-08T18:10:23.008067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":22528,"num_write":7,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251507+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:10:24.251507+0000","last_peered":"2024-05-08T18:10:24.251507+0000","last_clean":"2024-05-08T18:10:24.251507+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:10:24.251507+0000","last_undegraded":"2024-05-08T18:10:24.251507+0000","last_fullsized":"2024-05-08T18:10:24.251507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014445+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:10:23.014445+0000","last_peered":"2024-05-08T18:10:23.014445+0000","last_clean":"2024-05-08T18:10:23.014445+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:10:23.014445+0000","last_undegraded":"2024-05-08T18:10:23.014445+0000","last_fullsized":"2024-05-08T18:10:23.014445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"101'32","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015001+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:10:23.015001+0000","last_peered":"2024-05-08T18:10:23.015001+0000","last_clean":"2024-05-08T18:10:23.015001+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:10:23.015001+0000","last_undegraded":"2024-05-08T18:10:23.015001+0000","last_fullsized":"2024-05-08T18:10:23.015001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13755,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":54,"num_read_kb":66,"num_write":40,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748261+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:10:23.748261+0000","last_peered":"2024-05-08T18:10:23.748261+0000","last_clean":"2024-05-08T18:10:23.748261+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:10:23.748261+0000","last_undegraded":"2024-05-08T18:10:23.748261+0000","last_fullsized":"2024-05-08T18:10:23.748261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"90'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016164+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:10:23.016164+0000","last_peered":"2024-05-08T18:10:23.016164+0000","last_clean":"2024-05-08T18:10:23.016164+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:10:23.016164+0000","last_undegraded":"2024-05-08T18:10:23.016164+0000","last_fullsized":"2024-05-08T18:10:23.016164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"101'42","reported_seq":247,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015384+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:10:23.015384+0000","last_peered":"2024-05-08T18:10:23.015384+0000","last_clean":"2024-05-08T18:10:23.015384+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:10:23.015384+0000","last_undegraded":"2024-05-08T18:10:23.015384+0000","last_fullsized":"2024-05-08T18:10:23.015384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251344+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:10:24.251344+0000","last_peered":"2024-05-08T18:10:24.251344+0000","last_clean":"2024-05-08T18:10:24.251344+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:10:24.251344+0000","last_undegraded":"2024-05-08T18:10:24.251344+0000","last_fullsized":"2024-05-08T18:10:24.251344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676602+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:10:23.676602+0000","last_peered":"2024-05-08T18:10:23.676602+0000","last_clean":"2024-05-08T18:10:23.676602+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:10:23.676602+0000","last_undegraded":"2024-05-08T18:10:23.676602+0000","last_fullsized":"2024-05-08T18:10:23.676602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020771+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:10:23.020771+0000","last_peered":"2024-05-08T18:10:23.020771+0000","last_clean":"2024-05-08T18:10:23.020771+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:10:23.020771+0000","last_undegraded":"2024-05-08T18:10:23.020771+0000","last_fullsized":"2024-05-08T18:10:23.020771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247820+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:10:24.247820+0000","last_peered":"2024-05-08T18:10:24.247820+0000","last_clean":"2024-05-08T18:10:24.247820+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:10:24.247820+0000","last_undegraded":"2024-05-08T18:10:24.247820+0000","last_fullsized":"2024-05-08T18:10:24.247820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"120'15","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.762235+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:10:24.762235+0000","last_peered":"2024-05-08T18:10:24.762235+0000","last_clean":"2024-05-08T18:10:24.762235+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:10:24.762235+0000","last_undegraded":"2024-05-08T18:10:24.762235+0000","last_fullsized":"2024-05-08T18:10:24.762235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"101'4","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012889+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:10:23.012889+0000","last_peered":"2024-05-08T18:10:23.012889+0000","last_clean":"2024-05-08T18:10:23.012889+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:10:23.012889+0000","last_undegraded":"2024-05-08T18:10:23.012889+0000","last_fullsized":"2024-05-08T18:10:23.012889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008956+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:10:23.008956+0000","last_peered":"2024-05-08T18:10:23.008956+0000","last_clean":"2024-05-08T18:10:23.008956+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:10:23.008956+0000","last_undegraded":"2024-05-08T18:10:23.008956+0000","last_fullsized":"2024-05-08T18:10:23.008956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"101'10","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011790+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:10:23.011790+0000","last_peered":"2024-05-08T18:10:23.011790+0000","last_clean":"2024-05-08T18:10:23.011790+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:10:23.011790+0000","last_undegraded":"2024-05-08T18:10:23.011790+0000","last_fullsized":"2024-05-08T18:10:23.011790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.254105+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:10:24.254105+0000","last_peered":"2024-05-08T18:10:24.254105+0000","last_clean":"2024-05-08T18:10:24.254105+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:10:24.254105+0000","last_undegraded":"2024-05-08T18:10:24.254105+0000","last_fullsized":"2024-05-08T18:10:24.254105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747745+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:10:23.747745+0000","last_peered":"2024-05-08T18:10:23.747745+0000","last_clean":"2024-05-08T18:10:23.747745+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:10:23.747745+0000","last_undegraded":"2024-05-08T18:10:23.747745+0000","last_fullsized":"2024-05-08T18:10:23.747745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749424+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:10:23.749424+0000","last_peered":"2024-05-08T18:10:23.749424+0000","last_clean":"2024-05-08T18:10:23.749424+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:10:23.749424+0000","last_undegraded":"2024-05-08T18:10:23.749424+0000","last_fullsized":"2024-05-08T18:10:23.749424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"120'15","reported_seq":261,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.765325+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:10:24.765325+0000","last_peered":"2024-05-08T18:10:24.765325+0000","last_clean":"2024-05-08T18:10:24.765325+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:10:24.765325+0000","last_undegraded":"2024-05-08T18:10:24.765325+0000","last_fullsized":"2024-05-08T18:10:24.765325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015918+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:10:23.015918+0000","last_peered":"2024-05-08T18:10:23.015918+0000","last_clean":"2024-05-08T18:10:23.015918+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:10:23.015918+0000","last_undegraded":"2024-05-08T18:10:23.015918+0000","last_fullsized":"2024-05-08T18:10:23.015918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748928+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:10:23.748928+0000","last_peered":"2024-05-08T18:10:23.748928+0000","last_clean":"2024-05-08T18:10:23.748928+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:10:23.748928+0000","last_undegraded":"2024-05-08T18:10:23.748928+0000","last_fullsized":"2024-05-08T18:10:23.748928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"101'17","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019599+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:10:23.019599+0000","last_peered":"2024-05-08T18:10:23.019599+0000","last_clean":"2024-05-08T18:10:23.019599+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:10:23.019599+0000","last_undegraded":"2024-05-08T18:10:23.019599+0000","last_fullsized":"2024-05-08T18:10:23.019599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":40996,"num_write":77,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023317+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:10:23.023317+0000","last_peered":"2024-05-08T18:10:23.023317+0000","last_clean":"2024-05-08T18:10:23.023317+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:10:23.023317+0000","last_undegraded":"2024-05-08T18:10:23.023317+0000","last_fullsized":"2024-05-08T18:10:23.023317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008711+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:10:23.008711+0000","last_peered":"2024-05-08T18:10:23.008711+0000","last_clean":"2024-05-08T18:10:23.008711+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:10:23.008711+0000","last_undegraded":"2024-05-08T18:10:23.008711+0000","last_fullsized":"2024-05-08T18:10:23.008711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"101'42","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674574+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:10:23.674574+0000","last_peered":"2024-05-08T18:10:23.674574+0000","last_clean":"2024-05-08T18:10:23.674574+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:10:23.674574+0000","last_undegraded":"2024-05-08T18:10:23.674574+0000","last_fullsized":"2024-05-08T18:10:23.674574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31839,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":73,"num_read_kb":101,"num_write":56,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010131+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:10:23.010131+0000","last_peered":"2024-05-08T18:10:23.010131+0000","last_clean":"2024-05-08T18:10:23.010131+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:10:23.010131+0000","last_undegraded":"2024-05-08T18:10:23.010131+0000","last_fullsized":"2024-05-08T18:10:23.010131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006701+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:10:23.006701+0000","last_peered":"2024-05-08T18:10:23.006701+0000","last_clean":"2024-05-08T18:10:23.006701+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:10:23.006701+0000","last_undegraded":"2024-05-08T18:10:23.006701+0000","last_fullsized":"2024-05-08T18:10:23.006701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016491+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:10:23.016491+0000","last_peered":"2024-05-08T18:10:23.016491+0000","last_clean":"2024-05-08T18:10:23.016491+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:10:23.016491+0000","last_undegraded":"2024-05-08T18:10:23.016491+0000","last_fullsized":"2024-05-08T18:10:23.016491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"101'34","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749025+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:10:23.749025+0000","last_peered":"2024-05-08T18:10:23.749025+0000","last_clean":"2024-05-08T18:10:23.749025+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:10:23.749025+0000","last_undegraded":"2024-05-08T18:10:23.749025+0000","last_fullsized":"2024-05-08T18:10:23.749025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"101'6","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749652+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:10:23.749652+0000","last_peered":"2024-05-08T18:10:23.749652+0000","last_clean":"2024-05-08T18:10:23.749652+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:10:23.749652+0000","last_undegraded":"2024-05-08T18:10:23.749652+0000","last_fullsized":"2024-05-08T18:10:23.749652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248466+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:10:24.248466+0000","last_peered":"2024-05-08T18:10:24.248466+0000","last_clean":"2024-05-08T18:10:24.248466+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:10:24.248466+0000","last_undegraded":"2024-05-08T18:10:24.248466+0000","last_fullsized":"2024-05-08T18:10:24.248466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"101'18","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008436+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:10:23.008436+0000","last_peered":"2024-05-08T18:10:23.008436+0000","last_clean":"2024-05-08T18:10:23.008436+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:10:23.008436+0000","last_undegraded":"2024-05-08T18:10:23.008436+0000","last_fullsized":"2024-05-08T18:10:23.008436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008394+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:10:23.008394+0000","last_peered":"2024-05-08T18:10:23.008394+0000","last_clean":"2024-05-08T18:10:23.008394+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:10:23.008394+0000","last_undegraded":"2024-05-08T18:10:23.008394+0000","last_fullsized":"2024-05-08T18:10:23.008394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010335+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:10:23.010335+0000","last_peered":"2024-05-08T18:10:23.010335+0000","last_clean":"2024-05-08T18:10:23.010335+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:10:23.010335+0000","last_undegraded":"2024-05-08T18:10:23.010335+0000","last_fullsized":"2024-05-08T18:10:23.010335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248784+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:10:24.248784+0000","last_peered":"2024-05-08T18:10:24.248784+0000","last_clean":"2024-05-08T18:10:24.248784+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:10:24.248784+0000","last_undegraded":"2024-05-08T18:10:24.248784+0000","last_fullsized":"2024-05-08T18:10:24.248784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"101'16","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676106+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:10:23.676106+0000","last_peered":"2024-05-08T18:10:23.676106+0000","last_clean":"2024-05-08T18:10:23.676106+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:10:23.676106+0000","last_undegraded":"2024-05-08T18:10:23.676106+0000","last_fullsized":"2024-05-08T18:10:23.676106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":47128,"num_write":56,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012366+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:10:23.012366+0000","last_peered":"2024-05-08T18:10:23.012366+0000","last_clean":"2024-05-08T18:10:23.012366+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:10:23.012366+0000","last_undegraded":"2024-05-08T18:10:23.012366+0000","last_fullsized":"2024-05-08T18:10:23.012366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"48'5","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015264+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:10:23.015264+0000","last_peered":"2024-05-08T18:10:23.015264+0000","last_clean":"2024-05-08T18:10:23.015264+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:10:23.015264+0000","last_undegraded":"2024-05-08T18:10:23.015264+0000","last_fullsized":"2024-05-08T18:10:23.015264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674157+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:10:23.674157+0000","last_peered":"2024-05-08T18:10:23.674157+0000","last_clean":"2024-05-08T18:10:23.674157+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:10:23.674157+0000","last_undegraded":"2024-05-08T18:10:23.674157+0000","last_fullsized":"2024-05-08T18:10:23.674157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"90'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015893+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:10:23.015893+0000","last_peered":"2024-05-08T18:10:23.015893+0000","last_clean":"2024-05-08T18:10:23.015893+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:10:23.015893+0000","last_undegraded":"2024-05-08T18:10:23.015893+0000","last_fullsized":"2024-05-08T18:10:23.015893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009605+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:10:23.009605+0000","last_peered":"2024-05-08T18:10:23.009605+0000","last_clean":"2024-05-08T18:10:23.009605+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:10:23.009605+0000","last_undegraded":"2024-05-08T18:10:23.009605+0000","last_fullsized":"2024-05-08T18:10:23.009605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"101'15","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008271+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:10:23.008271+0000","last_peered":"2024-05-08T18:10:23.008271+0000","last_clean":"2024-05-08T18:10:23.008271+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:10:23.008271+0000","last_undegraded":"2024-05-08T18:10:23.008271+0000","last_fullsized":"2024-05-08T18:10:23.008271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":47122,"num_write":45,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673614+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:10:23.673614+0000","last_peered":"2024-05-08T18:10:23.673614+0000","last_clean":"2024-05-08T18:10:23.673614+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:10:23.673614+0000","last_undegraded":"2024-05-08T18:10:23.673614+0000","last_fullsized":"2024-05-08T18:10:23.673614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"101'16","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011817+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:10:23.011817+0000","last_peered":"2024-05-08T18:10:23.011817+0000","last_clean":"2024-05-08T18:10:23.011817+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:10:23.011817+0000","last_undegraded":"2024-05-08T18:10:23.011817+0000","last_fullsized":"2024-05-08T18:10:23.011817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020690+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:10:23.020690+0000","last_peered":"2024-05-08T18:10:23.020690+0000","last_clean":"2024-05-08T18:10:23.020690+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:10:23.020690+0000","last_undegraded":"2024-05-08T18:10:23.020690+0000","last_fullsized":"2024-05-08T18:10:23.020690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006544+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:10:23.006544+0000","last_peered":"2024-05-08T18:10:23.006544+0000","last_clean":"2024-05-08T18:10:23.006544+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:10:23.006544+0000","last_undegraded":"2024-05-08T18:10:23.006544+0000","last_fullsized":"2024-05-08T18:10:23.006544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009195+0000","last_change":"2024-05-08T18:07:55.359230+0000","last_active":"2024-05-08T18:10:23.009195+0000","last_peered":"2024-05-08T18:10:23.009195+0000","last_clean":"2024-05-08T18:10:23.009195+0000","last_became_active":"2024-05-08T18:07:55.358047+0000","last_became_peered":"2024-05-08T18:07:55.358047+0000","last_unstale":"2024-05-08T18:10:23.009195+0000","last_undegraded":"2024-05-08T18:10:23.009195+0000","last_fullsized":"2024-05-08T18:10:23.009195+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:52.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018330+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:10:23.018330+0000","last_peered":"2024-05-08T18:10:23.018330+0000","last_clean":"2024-05-08T18:10:23.018330+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:10:23.018330+0000","last_undegraded":"2024-05-08T18:10:23.018330+0000","last_fullsized":"2024-05-08T18:10:23.018330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020607+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:10:23.020607+0000","last_peered":"2024-05-08T18:10:23.020607+0000","last_clean":"2024-05-08T18:10:23.020607+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:10:23.020607+0000","last_undegraded":"2024-05-08T18:10:23.020607+0000","last_fullsized":"2024-05-08T18:10:23.020607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"101'15","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674190+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:10:23.674190+0000","last_peered":"2024-05-08T18:10:23.674190+0000","last_clean":"2024-05-08T18:10:23.674190+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:10:23.674190+0000","last_undegraded":"2024-05-08T18:10:23.674190+0000","last_fullsized":"2024-05-08T18:10:23.674190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013395+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:10:23.013395+0000","last_peered":"2024-05-08T18:10:23.013395+0000","last_clean":"2024-05-08T18:10:23.013395+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:10:23.013395+0000","last_undegraded":"2024-05-08T18:10:23.013395+0000","last_fullsized":"2024-05-08T18:10:23.013395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022955+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:10:23.022955+0000","last_peered":"2024-05-08T18:10:23.022955+0000","last_clean":"2024-05-08T18:10:23.022955+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:10:23.022955+0000","last_undegraded":"2024-05-08T18:10:23.022955+0000","last_fullsized":"2024-05-08T18:10:23.022955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009453+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:10:23.009453+0000","last_peered":"2024-05-08T18:10:23.009453+0000","last_clean":"2024-05-08T18:10:23.009453+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:10:23.009453+0000","last_undegraded":"2024-05-08T18:10:23.009453+0000","last_fullsized":"2024-05-08T18:10:23.009453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":208,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019005+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:10:23.019005+0000","last_peered":"2024-05-08T18:10:23.019005+0000","last_clean":"2024-05-08T18:10:23.019005+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:10:23.019005+0000","last_undegraded":"2024-05-08T18:10:23.019005+0000","last_fullsized":"2024-05-08T18:10:23.019005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"101'24","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252394+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:10:24.252394+0000","last_peered":"2024-05-08T18:10:24.252394+0000","last_clean":"2024-05-08T18:10:24.252394+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:10:24.252394+0000","last_undegraded":"2024-05-08T18:10:24.252394+0000","last_fullsized":"2024-05-08T18:10:24.252394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12641,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":50,"num_write":30,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007070+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:10:23.007070+0000","last_peered":"2024-05-08T18:10:23.007070+0000","last_clean":"2024-05-08T18:10:23.007070+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:10:23.007070+0000","last_undegraded":"2024-05-08T18:10:23.007070+0000","last_fullsized":"2024-05-08T18:10:23.007070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011163+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:10:23.011163+0000","last_peered":"2024-05-08T18:10:23.011163+0000","last_clean":"2024-05-08T18:10:23.011163+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:10:23.011163+0000","last_undegraded":"2024-05-08T18:10:23.011163+0000","last_fullsized":"2024-05-08T18:10:23.011163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019138+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:10:23.019138+0000","last_peered":"2024-05-08T18:10:23.019138+0000","last_clean":"2024-05-08T18:10:23.019138+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:10:23.019138+0000","last_undegraded":"2024-05-08T18:10:23.019138+0000","last_fullsized":"2024-05-08T18:10:23.019138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"91'3","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248368+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:10:24.248368+0000","last_peered":"2024-05-08T18:10:24.248368+0000","last_clean":"2024-05-08T18:10:24.248368+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:10:24.248368+0000","last_undegraded":"2024-05-08T18:10:24.248368+0000","last_fullsized":"2024-05-08T18:10:24.248368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":196,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022596+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:10:23.022596+0000","last_peered":"2024-05-08T18:10:23.022596+0000","last_clean":"2024-05-08T18:10:23.022596+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:10:23.022596+0000","last_undegraded":"2024-05-08T18:10:23.022596+0000","last_fullsized":"2024-05-08T18:10:23.022596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"101'18","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674600+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:10:23.674600+0000","last_peered":"2024-05-08T18:10:23.674600+0000","last_clean":"2024-05-08T18:10:23.674600+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:10:23.674600+0000","last_undegraded":"2024-05-08T18:10:23.674600+0000","last_fullsized":"2024-05-08T18:10:23.674600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252484+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:10:24.252484+0000","last_peered":"2024-05-08T18:10:24.252484+0000","last_clean":"2024-05-08T18:10:24.252484+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:10:24.252484+0000","last_undegraded":"2024-05-08T18:10:24.252484+0000","last_fullsized":"2024-05-08T18:10:24.252484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020215+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:10:23.020215+0000","last_peered":"2024-05-08T18:10:23.020215+0000","last_clean":"2024-05-08T18:10:23.020215+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:10:23.020215+0000","last_undegraded":"2024-05-08T18:10:23.020215+0000","last_fullsized":"2024-05-08T18:10:23.020215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010027+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:10:23.010027+0000","last_peered":"2024-05-08T18:10:23.010027+0000","last_clean":"2024-05-08T18:10:23.010027+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:10:23.010027+0000","last_undegraded":"2024-05-08T18:10:23.010027+0000","last_fullsized":"2024-05-08T18:10:23.010027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"101'6","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749937+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:10:23.749937+0000","last_peered":"2024-05-08T18:10:23.749937+0000","last_clean":"2024-05-08T18:10:23.749937+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:10:23.749937+0000","last_undegraded":"2024-05-08T18:10:23.749937+0000","last_fullsized":"2024-05-08T18:10:23.749937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747838+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:10:23.747838+0000","last_peered":"2024-05-08T18:10:23.747838+0000","last_clean":"2024-05-08T18:10:23.747838+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:10:23.747838+0000","last_undegraded":"2024-05-08T18:10:23.747838+0000","last_fullsized":"2024-05-08T18:10:23.747838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"101'15","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013244+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:10:23.013244+0000","last_peered":"2024-05-08T18:10:23.013244+0000","last_clean":"2024-05-08T18:10:23.013244+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:10:23.013244+0000","last_undegraded":"2024-05-08T18:10:23.013244+0000","last_fullsized":"2024-05-08T18:10:23.013244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247314+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:10:24.247314+0000","last_peered":"2024-05-08T18:10:24.247314+0000","last_clean":"2024-05-08T18:10:24.247314+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:10:24.247314+0000","last_undegraded":"2024-05-08T18:10:24.247314+0000","last_fullsized":"2024-05-08T18:10:24.247314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005943+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:10:23.005943+0000","last_peered":"2024-05-08T18:10:23.005943+0000","last_clean":"2024-05-08T18:10:23.005943+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:10:23.005943+0000","last_undegraded":"2024-05-08T18:10:23.005943+0000","last_fullsized":"2024-05-08T18:10:23.005943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"90'6","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232830+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:10:24.232830+0000","last_peered":"2024-05-08T18:10:24.232830+0000","last_clean":"2024-05-08T18:10:24.232830+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:10:24.232830+0000","last_undegraded":"2024-05-08T18:10:24.232830+0000","last_fullsized":"2024-05-08T18:10:24.232830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"94'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013712+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:10:23.013712+0000","last_peered":"2024-05-08T18:10:23.013712+0000","last_clean":"2024-05-08T18:10:23.013712+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:10:23.013712+0000","last_undegraded":"2024-05-08T18:10:23.013712+0000","last_fullsized":"2024-05-08T18:10:23.013712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":38912,"num_write":11,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252691+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:10:24.252691+0000","last_peered":"2024-05-08T18:10:24.252691+0000","last_clean":"2024-05-08T18:10:24.252691+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:10:24.252691+0000","last_undegraded":"2024-05-08T18:10:24.252691+0000","last_fullsized":"2024-05-08T18:10:24.252691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"91'11","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750421+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:10:23.750421+0000","last_peered":"2024-05-08T18:10:23.750421+0000","last_clean":"2024-05-08T18:10:23.750421+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:10:23.750421+0000","last_undegraded":"2024-05-08T18:10:23.750421+0000","last_fullsized":"2024-05-08T18:10:23.750421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"120'15","reported_seq":251,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.762151+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:10:24.762151+0000","last_peered":"2024-05-08T18:10:24.762151+0000","last_clean":"2024-05-08T18:10:24.762151+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:10:24.762151+0000","last_undegraded":"2024-05-08T18:10:24.762151+0000","last_fullsized":"2024-05-08T18:10:24.762151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"101'6","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673614+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:10:23.673614+0000","last_peered":"2024-05-08T18:10:23.673614+0000","last_clean":"2024-05-08T18:10:23.673614+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:10:23.673614+0000","last_undegraded":"2024-05-08T18:10:23.673614+0000","last_fullsized":"2024-05-08T18:10:23.673614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748762+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:10:23.748762+0000","last_peered":"2024-05-08T18:10:23.748762+0000","last_clean":"2024-05-08T18:10:23.748762+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:10:23.748762+0000","last_undegraded":"2024-05-08T18:10:23.748762+0000","last_fullsized":"2024-05-08T18:10:23.748762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"101'9","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007512+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:10:23.007512+0000","last_peered":"2024-05-08T18:10:23.007512+0000","last_clean":"2024-05-08T18:10:23.007512+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:10:23.007512+0000","last_undegraded":"2024-05-08T18:10:23.007512+0000","last_fullsized":"2024-05-08T18:10:23.007512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":24594,"num_write":39,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674308+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:10:23.674308+0000","last_peered":"2024-05-08T18:10:23.674308+0000","last_clean":"2024-05-08T18:10:23.674308+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:10:23.674308+0000","last_undegraded":"2024-05-08T18:10:23.674308+0000","last_fullsized":"2024-05-08T18:10:23.674308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"101'19","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006220+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:10:23.006220+0000","last_peered":"2024-05-08T18:10:23.006220+0000","last_clean":"2024-05-08T18:10:23.006220+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:10:23.006220+0000","last_undegraded":"2024-05-08T18:10:23.006220+0000","last_fullsized":"2024-05-08T18:10:23.006220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5206,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014002+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:10:23.014002+0000","last_peered":"2024-05-08T18:10:23.014002+0000","last_clean":"2024-05-08T18:10:23.014002+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:10:23.014002+0000","last_undegraded":"2024-05-08T18:10:23.014002+0000","last_fullsized":"2024-05-08T18:10:23.014002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"101'2","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676327+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:10:23.676327+0000","last_peered":"2024-05-08T18:10:23.676327+0000","last_clean":"2024-05-08T18:10:23.676327+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:10:23.676327+0000","last_undegraded":"2024-05-08T18:10:23.676327+0000","last_fullsized":"2024-05-08T18:10:23.676327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749701+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:10:23.749701+0000","last_peered":"2024-05-08T18:10:23.749701+0000","last_clean":"2024-05-08T18:10:23.749701+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:10:23.749701+0000","last_undegraded":"2024-05-08T18:10:23.749701+0000","last_fullsized":"2024-05-08T18:10:23.749701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"93'4","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007831+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:10:23.007831+0000","last_peered":"2024-05-08T18:10:23.007831+0000","last_clean":"2024-05-08T18:10:23.007831+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:10:23.007831+0000","last_undegraded":"2024-05-08T18:10:23.007831+0000","last_fullsized":"2024-05-08T18:10:23.007831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006829+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:10:23.006829+0000","last_peered":"2024-05-08T18:10:23.006829+0000","last_clean":"2024-05-08T18:10:23.006829+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:10:23.006829+0000","last_undegraded":"2024-05-08T18:10:23.006829+0000","last_fullsized":"2024-05-08T18:10:23.006829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"101'16","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014381+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:10:23.014381+0000","last_peered":"2024-05-08T18:10:23.014381+0000","last_clean":"2024-05-08T18:10:23.014381+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:10:23.014381+0000","last_undegraded":"2024-05-08T18:10:23.014381+0000","last_fullsized":"2024-05-08T18:10:23.014381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020141+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:10:23.020141+0000","last_peered":"2024-05-08T18:10:23.020141+0000","last_clean":"2024-05-08T18:10:23.020141+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:10:23.020141+0000","last_undegraded":"2024-05-08T18:10:23.020141+0000","last_fullsized":"2024-05-08T18:10:23.020141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010595+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:10:23.010595+0000","last_peered":"2024-05-08T18:10:23.010595+0000","last_clean":"2024-05-08T18:10:23.010595+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:10:23.010595+0000","last_undegraded":"2024-05-08T18:10:23.010595+0000","last_fullsized":"2024-05-08T18:10:23.010595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010032+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:10:23.010032+0000","last_peered":"2024-05-08T18:10:23.010032+0000","last_clean":"2024-05-08T18:10:23.010032+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:10:23.010032+0000","last_undegraded":"2024-05-08T18:10:23.010032+0000","last_fullsized":"2024-05-08T18:10:23.010032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"93'10","reported_seq":172,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247195+0000","last_change":"2024-05-08T18:07:55.439856+0000","last_active":"2024-05-08T18:10:24.247195+0000","last_peered":"2024-05-08T18:10:24.247195+0000","last_clean":"2024-05-08T18:10:24.247195+0000","last_became_active":"2024-05-08T18:07:55.439188+0000","last_became_peered":"2024-05-08T18:07:55.439188+0000","last_unstale":"2024-05-08T18:10:24.247195+0000","last_undegraded":"2024-05-08T18:10:24.247195+0000","last_fullsized":"2024-05-08T18:10:24.247195+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:40.273251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":10,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747721+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:10:23.747721+0000","last_peered":"2024-05-08T18:10:23.747721+0000","last_clean":"2024-05-08T18:10:23.747721+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:10:23.747721+0000","last_undegraded":"2024-05-08T18:10:23.747721+0000","last_fullsized":"2024-05-08T18:10:23.747721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"101'10","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013755+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:10:23.013755+0000","last_peered":"2024-05-08T18:10:23.013755+0000","last_clean":"2024-05-08T18:10:23.013755+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:10:23.013755+0000","last_undegraded":"2024-05-08T18:10:23.013755+0000","last_fullsized":"2024-05-08T18:10:23.013755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10810,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":19,"num_write":12,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748565+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:10:23.748565+0000","last_peered":"2024-05-08T18:10:23.748565+0000","last_clean":"2024-05-08T18:10:23.748565+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:10:23.748565+0000","last_undegraded":"2024-05-08T18:10:23.748565+0000","last_fullsized":"2024-05-08T18:10:23.748565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675169+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:10:23.675169+0000","last_peered":"2024-05-08T18:10:23.675169+0000","last_clean":"2024-05-08T18:10:23.675169+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:10:23.675169+0000","last_undegraded":"2024-05-08T18:10:23.675169+0000","last_fullsized":"2024-05-08T18:10:23.675169+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748961+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:10:23.748961+0000","last_peered":"2024-05-08T18:10:23.748961+0000","last_clean":"2024-05-08T18:10:23.748961+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:10:23.748961+0000","last_undegraded":"2024-05-08T18:10:23.748961+0000","last_fullsized":"2024-05-08T18:10:23.748961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017974+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:10:23.017974+0000","last_peered":"2024-05-08T18:10:23.017974+0000","last_clean":"2024-05-08T18:10:23.017974+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:10:23.017974+0000","last_undegraded":"2024-05-08T18:10:23.017974+0000","last_fullsized":"2024-05-08T18:10:23.017974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247662+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:10:24.247662+0000","last_peered":"2024-05-08T18:10:24.247662+0000","last_clean":"2024-05-08T18:10:24.247662+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:10:24.247662+0000","last_undegraded":"2024-05-08T18:10:24.247662+0000","last_fullsized":"2024-05-08T18:10:24.247662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"101'14","reported_seq":217,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748818+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:10:23.748818+0000","last_peered":"2024-05-08T18:10:23.748818+0000","last_clean":"2024-05-08T18:10:23.748818+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:10:23.748818+0000","last_undegraded":"2024-05-08T18:10:23.748818+0000","last_fullsized":"2024-05-08T18:10:23.748818+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013086+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:10:23.013086+0000","last_peered":"2024-05-08T18:10:23.013086+0000","last_clean":"2024-05-08T18:10:23.013086+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:10:23.013086+0000","last_undegraded":"2024-05-08T18:10:23.013086+0000","last_fullsized":"2024-05-08T18:10:23.013086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751046+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:10:23.751046+0000","last_peered":"2024-05-08T18:10:23.751046+0000","last_clean":"2024-05-08T18:10:23.751046+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:10:23.751046+0000","last_undegraded":"2024-05-08T18:10:23.751046+0000","last_fullsized":"2024-05-08T18:10:23.751046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"101'36","reported_seq":244,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253470+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:10:24.253470+0000","last_peered":"2024-05-08T18:10:24.253470+0000","last_clean":"2024-05-08T18:10:24.253470+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:10:24.253470+0000","last_undegraded":"2024-05-08T18:10:24.253470+0000","last_fullsized":"2024-05-08T18:10:24.253470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":91,"num_write":52,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"101'18","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019864+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:10:23.019864+0000","last_peered":"2024-05-08T18:10:23.019864+0000","last_clean":"2024-05-08T18:10:23.019864+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:10:23.019864+0000","last_undegraded":"2024-05-08T18:10:23.019864+0000","last_fullsized":"2024-05-08T18:10:23.019864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":47134,"num_write":68,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253866+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:10:24.253866+0000","last_peered":"2024-05-08T18:10:24.253866+0000","last_clean":"2024-05-08T18:10:24.253866+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:10:24.253866+0000","last_undegraded":"2024-05-08T18:10:24.253866+0000","last_fullsized":"2024-05-08T18:10:24.253866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"101'9","reported_seq":226,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.230815+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:10:24.230815+0000","last_peered":"2024-05-08T18:10:24.230815+0000","last_clean":"2024-05-08T18:10:24.230815+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:10:24.230815+0000","last_undegraded":"2024-05-08T18:10:24.230815+0000","last_fullsized":"2024-05-08T18:10:24.230815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":26630,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007320+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:10:23.007320+0000","last_peered":"2024-05-08T18:10:23.007320+0000","last_clean":"2024-05-08T18:10:23.007320+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:10:23.007320+0000","last_undegraded":"2024-05-08T18:10:23.007320+0000","last_fullsized":"2024-05-08T18:10:23.007320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007247+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:10:23.007247+0000","last_peered":"2024-05-08T18:10:23.007247+0000","last_clean":"2024-05-08T18:10:23.007247+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:10:23.007247+0000","last_undegraded":"2024-05-08T18:10:23.007247+0000","last_fullsized":"2024-05-08T18:10:23.007247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251429+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:10:24.251429+0000","last_peered":"2024-05-08T18:10:24.251429+0000","last_clean":"2024-05-08T18:10:24.251429+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:10:24.251429+0000","last_undegraded":"2024-05-08T18:10:24.251429+0000","last_fullsized":"2024-05-08T18:10:24.251429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"101'5","reported_seq":216,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014337+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:10:23.014337+0000","last_peered":"2024-05-08T18:10:23.014337+0000","last_clean":"2024-05-08T18:10:23.014337+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:10:23.014337+0000","last_undegraded":"2024-05-08T18:10:23.014337+0000","last_fullsized":"2024-05-08T18:10:23.014337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":16390,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012990+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:10:23.012990+0000","last_peered":"2024-05-08T18:10:23.012990+0000","last_clean":"2024-05-08T18:10:23.012990+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:10:23.012990+0000","last_undegraded":"2024-05-08T18:10:23.012990+0000","last_fullsized":"2024-05-08T18:10:23.012990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011842+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:10:23.011842+0000","last_peered":"2024-05-08T18:10:23.011842+0000","last_clean":"2024-05-08T18:10:23.011842+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:10:23.011842+0000","last_undegraded":"2024-05-08T18:10:23.011842+0000","last_fullsized":"2024-05-08T18:10:23.011842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749915+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:10:23.749915+0000","last_peered":"2024-05-08T18:10:23.749915+0000","last_clean":"2024-05-08T18:10:23.749915+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:10:23.749915+0000","last_undegraded":"2024-05-08T18:10:23.749915+0000","last_fullsized":"2024-05-08T18:10:23.749915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"101'11","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252920+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:10:24.252920+0000","last_peered":"2024-05-08T18:10:24.252920+0000","last_clean":"2024-05-08T18:10:24.252920+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:10:24.252920+0000","last_undegraded":"2024-05-08T18:10:24.252920+0000","last_fullsized":"2024-05-08T18:10:24.252920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":32786,"num_write":41,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"101'40","reported_seq":251,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009330+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:10:23.009330+0000","last_peered":"2024-05-08T18:10:23.009330+0000","last_clean":"2024-05-08T18:10:23.009330+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:10:23.009330+0000","last_undegraded":"2024-05-08T18:10:23.009330+0000","last_fullsized":"2024-05-08T18:10:23.009330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":102,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"101'9","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022073+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:10:23.022073+0000","last_peered":"2024-05-08T18:10:23.022073+0000","last_clean":"2024-05-08T18:10:23.022073+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:10:23.022073+0000","last_undegraded":"2024-05-08T18:10:23.022073+0000","last_fullsized":"2024-05-08T18:10:23.022073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"90'12","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019735+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:10:23.019735+0000","last_peered":"2024-05-08T18:10:23.019735+0000","last_clean":"2024-05-08T18:10:23.019735+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:10:23.019735+0000","last_undegraded":"2024-05-08T18:10:23.019735+0000","last_fullsized":"2024-05-08T18:10:23.019735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"91'3","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012624+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:10:23.012624+0000","last_peered":"2024-05-08T18:10:23.012624+0000","last_clean":"2024-05-08T18:10:23.012624+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:10:23.012624+0000","last_undegraded":"2024-05-08T18:10:23.012624+0000","last_fullsized":"2024-05-08T18:10:23.012624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017633+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:10:23.017633+0000","last_peered":"2024-05-08T18:10:23.017633+0000","last_clean":"2024-05-08T18:10:23.017633+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:10:23.017633+0000","last_undegraded":"2024-05-08T18:10:23.017633+0000","last_fullsized":"2024-05-08T18:10:23.017633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"101'18","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006664+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:10:23.006664+0000","last_peered":"2024-05-08T18:10:23.006664+0000","last_clean":"2024-05-08T18:10:23.006664+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:10:23.006664+0000","last_undegraded":"2024-05-08T18:10:23.006664+0000","last_fullsized":"2024-05-08T18:10:23.006664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":30,"num_read_kb":55314,"num_write":48,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750654+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:10:23.750654+0000","last_peered":"2024-05-08T18:10:23.750654+0000","last_clean":"2024-05-08T18:10:23.750654+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:10:23.750654+0000","last_undegraded":"2024-05-08T18:10:23.750654+0000","last_fullsized":"2024-05-08T18:10:23.750654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"101'8","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010297+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:10:23.010297+0000","last_peered":"2024-05-08T18:10:23.010297+0000","last_clean":"2024-05-08T18:10:23.010297+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:10:23.010297+0000","last_undegraded":"2024-05-08T18:10:23.010297+0000","last_fullsized":"2024-05-08T18:10:23.010297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.233065+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:10:24.233065+0000","last_peered":"2024-05-08T18:10:24.233065+0000","last_clean":"2024-05-08T18:10:24.233065+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:10:24.233065+0000","last_undegraded":"2024-05-08T18:10:24.233065+0000","last_fullsized":"2024-05-08T18:10:24.233065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"94'7","reported_seq":168,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232504+0000","last_change":"2024-05-08T18:07:55.445745+0000","last_active":"2024-05-08T18:10:24.232504+0000","last_peered":"2024-05-08T18:10:24.232504+0000","last_clean":"2024-05-08T18:10:24.232504+0000","last_became_active":"2024-05-08T18:07:55.444935+0000","last_became_peered":"2024-05-08T18:07:55.444935+0000","last_unstale":"2024-05-08T18:10:24.232504+0000","last_undegraded":"2024-05-08T18:10:24.232504+0000","last_fullsized":"2024-05-08T18:10:24.232504+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:37.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":22528,"num_write":7,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750539+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:10:23.750539+0000","last_peered":"2024-05-08T18:10:23.750539+0000","last_clean":"2024-05-08T18:10:23.750539+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:10:23.750539+0000","last_undegraded":"2024-05-08T18:10:23.750539+0000","last_fullsized":"2024-05-08T18:10:23.750539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"94'6","reported_seq":218,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014718+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:10:23.014718+0000","last_peered":"2024-05-08T18:10:23.014718+0000","last_clean":"2024-05-08T18:10:23.014718+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:10:23.014718+0000","last_undegraded":"2024-05-08T18:10:23.014718+0000","last_fullsized":"2024-05-08T18:10:23.014718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":16390,"num_write":16,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674975+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:10:23.674975+0000","last_peered":"2024-05-08T18:10:23.674975+0000","last_clean":"2024-05-08T18:10:23.674975+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:10:23.674975+0000","last_undegraded":"2024-05-08T18:10:23.674975+0000","last_fullsized":"2024-05-08T18:10:23.674975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"101'9","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021427+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:10:23.021427+0000","last_peered":"2024-05-08T18:10:23.021427+0000","last_clean":"2024-05-08T18:10:23.021427+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:10:23.021427+0000","last_undegraded":"2024-05-08T18:10:23.021427+0000","last_fullsized":"2024-05-08T18:10:23.021427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012285+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:10:23.012285+0000","last_peered":"2024-05-08T18:10:23.012285+0000","last_clean":"2024-05-08T18:10:23.012285+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:10:23.012285+0000","last_undegraded":"2024-05-08T18:10:23.012285+0000","last_fullsized":"2024-05-08T18:10:23.012285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"101'11","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676538+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:10:23.676538+0000","last_peered":"2024-05-08T18:10:23.676538+0000","last_clean":"2024-05-08T18:10:23.676538+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:10:23.676538+0000","last_undegraded":"2024-05-08T18:10:23.676538+0000","last_fullsized":"2024-05-08T18:10:23.676538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":26648,"num_write":51,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"101'46","reported_seq":254,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009047+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:10:23.009047+0000","last_peered":"2024-05-08T18:10:23.009047+0000","last_clean":"2024-05-08T18:10:23.009047+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:10:23.009047+0000","last_undegraded":"2024-05-08T18:10:23.009047+0000","last_fullsized":"2024-05-08T18:10:23.009047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"94'11","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232833+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:10:24.232833+0000","last_peered":"2024-05-08T18:10:24.232833+0000","last_clean":"2024-05-08T18:10:24.232833+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:10:24.232833+0000","last_undegraded":"2024-05-08T18:10:24.232833+0000","last_fullsized":"2024-05-08T18:10:24.232833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":45056,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674057+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:10:23.674057+0000","last_peered":"2024-05-08T18:10:23.674057+0000","last_clean":"2024-05-08T18:10:23.674057+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:10:23.674057+0000","last_undegraded":"2024-05-08T18:10:23.674057+0000","last_fullsized":"2024-05-08T18:10:23.674057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"101'9","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008938+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:10:23.008938+0000","last_peered":"2024-05-08T18:10:23.008938+0000","last_clean":"2024-05-08T18:10:23.008938+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:10:23.008938+0000","last_undegraded":"2024-05-08T18:10:23.008938+0000","last_fullsized":"2024-05-08T18:10:23.008938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":26630,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"101'14","reported_seq":234,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006573+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:10:23.006573+0000","last_peered":"2024-05-08T18:10:23.006573+0000","last_clean":"2024-05-08T18:10:23.006573+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:10:23.006573+0000","last_undegraded":"2024-05-08T18:10:23.006573+0000","last_fullsized":"2024-05-08T18:10:23.006573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":18,"num_read_kb":43014,"num_write":24,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017327+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:10:23.017327+0000","last_peered":"2024-05-08T18:10:23.017327+0000","last_clean":"2024-05-08T18:10:23.017327+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:10:23.017327+0000","last_undegraded":"2024-05-08T18:10:23.017327+0000","last_fullsized":"2024-05-08T18:10:23.017327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"101'12","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248214+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:10:24.248214+0000","last_peered":"2024-05-08T18:10:24.248214+0000","last_clean":"2024-05-08T18:10:24.248214+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:10:24.248214+0000","last_undegraded":"2024-05-08T18:10:24.248214+0000","last_fullsized":"2024-05-08T18:10:24.248214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":40966,"num_write":22,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008111+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:10:23.008111+0000","last_peered":"2024-05-08T18:10:23.008111+0000","last_clean":"2024-05-08T18:10:23.008111+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:10:23.008111+0000","last_undegraded":"2024-05-08T18:10:23.008111+0000","last_fullsized":"2024-05-08T18:10:23.008111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":242921,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":927,"num_read_kb":920,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":230738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":577,"ondisk_log_size":577,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1100,"num_read_kb":2048660,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":446980,"kb_used_data":415804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93924860,"statfs":{"total":96636764160,"available":96179056640,"internally_reserved":0,"allocated":425783296,"data_stored":425104836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":331652,"kb_used_data":300476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94040188,"statfs":{"total":96636764160,"available":96297152512,"internally_reserved":0,"allocated":307687424,"data_stored":307055531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":536532,"kb_used_data":505356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93835308,"statfs":{"total":96636764160,"available":96087355392,"internally_reserved":0,"allocated":517484544,"data_stored":516790953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487276,"kb_used_data":456088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93884564,"statfs":{"total":96636764160,"available":96137793536,"internally_reserved":0,"allocated":467034112,"data_stored":466424514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":524192,"kb_used_data":493016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93847648,"statfs":{"total":96636764160,"available":96099991552,"internally_reserved":0,"allocated":504848384,"data_stored":504193220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":317280,"kb_used_data":286104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94054560,"statfs":{"total":96636764160,"available":96311869440,"internally_reserved":0,"allocated":292970496,"data_stored":292361081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303020,"kb_used_data":271844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94068820,"statfs":{"total":96636764160,"available":96326471680,"internally_reserved":0,"allocated":278368256,"data_stored":277720808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":510420,"kb_used_data":479240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93861420,"statfs":{"total":96636764160,"available":96114094080,"internally_reserved":0,"allocated":490741760,"data_stored":490101965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":488636416,"data_stored":488636416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":276824064,"data_stored":276824064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":291504128,"data_stored":291504128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":503316480,"data_stored":503316480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":465567744,"data_stored":465567744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":515899392,"data_stored":515899392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":306184192,"data_stored":306184192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":423624704,"data_stored":423624704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":27109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":49062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":9271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":29104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":42748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":23703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":41692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:10:36.821 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:10:37.156 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:10:37.156 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":120,"fsid":"0d8284a2-bb69-4df9-9f45-9ef5b469ca40","created":"2024-05-08T18:06:48.916680+0000","modified":"2024-05-08T18:10:23.001291+0000","last_up_change":"2024-05-08T18:07:00.796481+0000","last_in_change":"2024-05-08T18:06:51.530709+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:07:01.699859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:07:07.479756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-08T18:07:14.110093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-08T18:07:15.798248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-08T18:07:17.763573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-08T18:07:19.656809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-08T18:07:21.569514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-08T18:07:23.704646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e14e7bbc-18b8-4961-bcde-109f22cc52e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6812","nonce":3565382691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6817","nonce":3565382691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6823","nonce":3565382691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":3565382691},{"type":"v1","addr":"172.21.15.80:6821","nonce":3565382691}]},"public_addr":"172.21.15.80:6812/3565382691","cluster_addr":"172.21.15.80:6817/3565382691","heartbeat_back_addr":"172.21.15.80:6823/3565382691","heartbeat_front_addr":"172.21.15.80:6821/3565382691","state":["exists","up"]},{"osd":1,"uuid":"d4ce30c2-52b8-45a3-8a34-b0addc8311dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6801","nonce":3922502534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6803","nonce":3922502534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6807","nonce":3922502534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":3922502534},{"type":"v1","addr":"172.21.15.80:6805","nonce":3922502534}]},"public_addr":"172.21.15.80:6801/3922502534","cluster_addr":"172.21.15.80:6803/3922502534","heartbeat_back_addr":"172.21.15.80:6807/3922502534","heartbeat_front_addr":"172.21.15.80:6805/3922502534","state":["exists","up"]},{"osd":2,"uuid":"0049cbe1-578f-4202-a572-2328d79f0496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6825","nonce":3474282780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6827","nonce":3474282780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6831","nonce":3474282780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3474282780},{"type":"v1","addr":"172.21.15.80:6829","nonce":3474282780}]},"public_addr":"172.21.15.80:6825/3474282780","cluster_addr":"172.21.15.80:6827/3474282780","heartbeat_back_addr":"172.21.15.80:6831/3474282780","heartbeat_front_addr":"172.21.15.80:6829/3474282780","state":["exists","up"]},{"osd":3,"uuid":"3ec754a0-b0ca-4d44-bce0-7c380245ec0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6810","nonce":3525633066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6813","nonce":3525633066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6820","nonce":3525633066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":3525633066},{"type":"v1","addr":"172.21.15.80:6816","nonce":3525633066}]},"public_addr":"172.21.15.80:6810/3525633066","cluster_addr":"172.21.15.80:6813/3525633066","heartbeat_back_addr":"172.21.15.80:6820/3525633066","heartbeat_front_addr":"172.21.15.80:6816/3525633066","state":["exists","up"]},{"osd":4,"uuid":"1ab2531a-d5f1-45b9-bcfb-b67ca2c68f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6817","nonce":4103080494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6821","nonce":4103080494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6827","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6829","nonce":4103080494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":4103080494},{"type":"v1","addr":"172.21.15.115:6825","nonce":4103080494}]},"public_addr":"172.21.15.115:6817/4103080494","cluster_addr":"172.21.15.115:6821/4103080494","heartbeat_back_addr":"172.21.15.115:6829/4103080494","heartbeat_front_addr":"172.21.15.115:6825/4103080494","state":["exists","up"]},{"osd":5,"uuid":"3dc618ad-e40d-418e-844c-57572043f866","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6820","nonce":87947085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6824","nonce":87947085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6831","nonce":87947085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":87947085},{"type":"v1","addr":"172.21.15.115:6828","nonce":87947085}]},"public_addr":"172.21.15.115:6820/87947085","cluster_addr":"172.21.15.115:6824/87947085","heartbeat_back_addr":"172.21.15.115:6831/87947085","heartbeat_front_addr":"172.21.15.115:6828/87947085","state":["exists","up"]},{"osd":6,"uuid":"1f8172c6-5d27-4542-80a6-1c630dddf752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6801","nonce":2090404725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6803","nonce":2090404725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6807","nonce":2090404725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2090404725},{"type":"v1","addr":"172.21.15.115:6805","nonce":2090404725}]},"public_addr":"172.21.15.115:6801/2090404725","cluster_addr":"172.21.15.115:6803/2090404725","heartbeat_back_addr":"172.21.15.115:6807/2090404725","heartbeat_front_addr":"172.21.15.115:6805/2090404725","state":["exists","up"]},{"osd":7,"uuid":"e4146a73-11ca-4499-afa7-23e23d70a662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6809","nonce":133828553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6811","nonce":133828553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6815","nonce":133828553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":133828553},{"type":"v1","addr":"172.21.15.115:6813","nonce":133828553}]},"public_addr":"172.21.15.115:6809/133828553","cluster_addr":"172.21.15.115:6811/133828553","heartbeat_back_addr":"172.21.15.115:6815/133828553","heartbeat_front_addr":"172.21.15.115:6813/133828553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.936317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.814583+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.168294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:56.751445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.091268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.113133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.054822+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:06:57.057214+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.3f","osds":[3,7]},{"pgid":"6.c","osds":[1,7]}],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":6,"to":7}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:10:37.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-05-08T18:10:38.176 INFO:tasks.ceph:Scrubbing osd.0 2024-05-08T18:10:38.177 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:10:38.338 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:10:38.338 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:10:38.339 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:10:38.355 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-08T18:10:38.647 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 0 to deep-scrub 2024-05-08T18:10:38.667 INFO:tasks.ceph:Scrubbing osd.1 2024-05-08T18:10:38.667 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:10:38.812 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:10:38.812 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:10:38.812 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:10:38.827 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-08T18:10:39.091 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 1 to deep-scrub 2024-05-08T18:10:39.109 INFO:tasks.ceph:Scrubbing osd.2 2024-05-08T18:10:39.109 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:10:39.245 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:10:39.245 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:10:39.245 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:10:39.260 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-08T18:10:39.557 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 2 to deep-scrub 2024-05-08T18:10:39.573 INFO:tasks.ceph:Scrubbing osd.3 2024-05-08T18:10:39.573 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:10:39.708 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:10:39.708 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:10:39.708 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:10:39.723 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-08T18:10:39.994 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 3 to deep-scrub 2024-05-08T18:10:40.012 INFO:tasks.ceph:Scrubbing osd.4 2024-05-08T18:10:40.012 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:10:40.161 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:10:40.161 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:10:40.161 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:10:40.177 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-08T18:10:40.442 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 4 to deep-scrub 2024-05-08T18:10:40.459 INFO:tasks.ceph:Scrubbing osd.5 2024-05-08T18:10:40.460 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:10:40.598 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:10:40.598 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:10:40.598 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:10:40.613 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-08T18:10:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 5 to deep-scrub 2024-05-08T18:10:40.900 INFO:tasks.ceph:Scrubbing osd.6 2024-05-08T18:10:40.900 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:10:41.035 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:10:41.036 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:10:41.036 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:10:41.050 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-08T18:10:41.335 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 6 to deep-scrub 2024-05-08T18:10:41.354 INFO:tasks.ceph:Scrubbing osd.7 2024-05-08T18:10:41.354 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:10:41.495 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T18:10:41.495 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:10:41.495 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T18:10:41.510 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-08T18:10:41.802 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 7 to deep-scrub 2024-05-08T18:10:41.823 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:10:42.143 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:10:42.149 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:10:42.162 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2024-05-08T18:10:41.732259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":723235,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":4566,"num_read_kb":2051631,"num_write":3838,"num_write_kb":2050326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2537,"ondisk_log_size":2537,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262396,"kb_used_data":12680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712324,"statfs":{"total":773094113280,"available":772825419776,"internally_reserved":0,"allocated":12984320,"data_stored":7972454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1635890227,"num_objects":-440,"num_object_clones":0,"num_object_copies":-880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-440,"num_whiteouts":0,"num_read":741,"num_read_kb":685,"num_write":568,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005435"},"pg_stats":[{"pgid":"3.3f","version":"120'20","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.436717+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:10:35.436717+0000","last_peered":"2024-05-08T18:10:35.436717+0000","last_clean":"2024-05-08T18:10:35.436717+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:10:35.436717+0000","last_undegraded":"2024-05-08T18:10:35.436717+0000","last_fullsized":"2024-05-08T18:10:35.436717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":34822,"num_write":30,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005921+0000","last_change":"2024-05-08T18:07:17.520133+0000","last_active":"2024-05-08T18:10:23.005921+0000","last_peered":"2024-05-08T18:10:23.005921+0000","last_clean":"2024-05-08T18:10:23.005921+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:10:23.005921+0000","last_undegraded":"2024-05-08T18:10:23.005921+0000","last_fullsized":"2024-05-08T18:10:23.005921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"120'12","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.343089+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:10:35.343089+0000","last_peered":"2024-05-08T18:10:35.343089+0000","last_clean":"2024-05-08T18:10:35.343089+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:10:35.343089+0000","last_undegraded":"2024-05-08T18:10:35.343089+0000","last_fullsized":"2024-05-08T18:10:35.343089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20486,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674165+0000","last_change":"2024-05-08T18:07:17.533735+0000","last_active":"2024-05-08T18:10:23.674165+0000","last_peered":"2024-05-08T18:10:23.674165+0000","last_clean":"2024-05-08T18:10:23.674165+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:10:23.674165+0000","last_undegraded":"2024-05-08T18:10:23.674165+0000","last_fullsized":"2024-05-08T18:10:23.674165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"120'26","reported_seq":247,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.470143+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:10:35.470143+0000","last_peered":"2024-05-08T18:10:35.470143+0000","last_clean":"2024-05-08T18:10:35.470143+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:10:35.470143+0000","last_undegraded":"2024-05-08T18:10:35.470143+0000","last_fullsized":"2024-05-08T18:10:35.470143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":47116,"num_write":46,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749409+0000","last_change":"2024-05-08T18:07:17.511846+0000","last_active":"2024-05-08T18:10:23.749409+0000","last_peered":"2024-05-08T18:10:23.749409+0000","last_clean":"2024-05-08T18:10:23.749409+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:10:23.749409+0000","last_undegraded":"2024-05-08T18:10:23.749409+0000","last_fullsized":"2024-05-08T18:10:23.749409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"120'22","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.467961+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:10:35.467961+0000","last_peered":"2024-05-08T18:10:35.467961+0000","last_clean":"2024-05-08T18:10:35.467961+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:10:35.467961+0000","last_undegraded":"2024-05-08T18:10:35.467961+0000","last_fullsized":"2024-05-08T18:10:35.467961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":40972,"num_write":42,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014036+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:10:23.014036+0000","last_peered":"2024-05-08T18:10:23.014036+0000","last_clean":"2024-05-08T18:10:23.014036+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:10:23.014036+0000","last_undegraded":"2024-05-08T18:10:23.014036+0000","last_fullsized":"2024-05-08T18:10:23.014036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"120'8","reported_seq":222,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.062858+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:10:35.062858+0000","last_peered":"2024-05-08T18:10:35.062858+0000","last_clean":"2024-05-08T18:10:35.062858+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:10:35.062858+0000","last_undegraded":"2024-05-08T18:10:35.062858+0000","last_fullsized":"2024-05-08T18:10:35.062858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14342,"num_write":18,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021174+0000","last_change":"2024-05-08T18:07:17.514570+0000","last_active":"2024-05-08T18:10:23.021174+0000","last_peered":"2024-05-08T18:10:23.021174+0000","last_clean":"2024-05-08T18:10:23.021174+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:10:23.021174+0000","last_undegraded":"2024-05-08T18:10:23.021174+0000","last_fullsized":"2024-05-08T18:10:23.021174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.823089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"120'14","reported_seq":177,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.504567+0000","last_change":"2024-05-08T18:07:55.439965+0000","last_active":"2024-05-08T18:10:35.504567+0000","last_peered":"2024-05-08T18:10:35.504567+0000","last_clean":"2024-05-08T18:10:35.504567+0000","last_became_active":"2024-05-08T18:07:55.439578+0000","last_became_peered":"2024-05-08T18:07:55.439578+0000","last_unstale":"2024-05-08T18:10:35.504567+0000","last_undegraded":"2024-05-08T18:10:35.504567+0000","last_fullsized":"2024-05-08T18:10:35.504567+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:30.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22540,"num_write":34,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"101'86","reported_seq":299,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750093+0000","last_change":"2024-05-08T18:07:17.510386+0000","last_active":"2024-05-08T18:10:23.750093+0000","last_peered":"2024-05-08T18:10:23.750093+0000","last_clean":"2024-05-08T18:10:23.750093+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:10:23.750093+0000","last_undegraded":"2024-05-08T18:10:23.750093+0000","last_fullsized":"2024-05-08T18:10:23.750093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":219,"num_write":126,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"120'16","reported_seq":234,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.515786+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:10:35.515786+0000","last_peered":"2024-05-08T18:10:35.515786+0000","last_clean":"2024-05-08T18:10:35.515786+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:10:35.515786+0000","last_undegraded":"2024-05-08T18:10:35.515786+0000","last_fullsized":"2024-05-08T18:10:35.515786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32774,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007751+0000","last_change":"2024-05-08T18:07:17.518326+0000","last_active":"2024-05-08T18:10:23.007751+0000","last_peered":"2024-05-08T18:10:23.007751+0000","last_clean":"2024-05-08T18:10:23.007751+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:10:23.007751+0000","last_undegraded":"2024-05-08T18:10:23.007751+0000","last_fullsized":"2024-05-08T18:10:23.007751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"120'22","reported_seq":245,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.563893+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:10:35.563893+0000","last_peered":"2024-05-08T18:10:35.563893+0000","last_clean":"2024-05-08T18:10:35.563893+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:10:35.563893+0000","last_undegraded":"2024-05-08T18:10:35.563893+0000","last_fullsized":"2024-05-08T18:10:35.563893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":43026,"num_write":52,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":167,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013504+0000","last_change":"2024-05-08T18:07:47.007132+0000","last_active":"2024-05-08T18:10:23.013504+0000","last_peered":"2024-05-08T18:10:23.013504+0000","last_clean":"2024-05-08T18:10:23.013504+0000","last_became_active":"2024-05-08T18:07:47.006744+0000","last_became_peered":"2024-05-08T18:07:47.006744+0000","last_unstale":"2024-05-08T18:10:23.013504+0000","last_undegraded":"2024-05-08T18:10:23.013504+0000","last_fullsized":"2024-05-08T18:10:23.013504+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:32.802677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748681+0000","last_change":"2024-05-08T18:07:17.513157+0000","last_active":"2024-05-08T18:10:23.748681+0000","last_peered":"2024-05-08T18:10:23.748681+0000","last_clean":"2024-05-08T18:10:23.748681+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:10:23.748681+0000","last_undegraded":"2024-05-08T18:10:23.748681+0000","last_fullsized":"2024-05-08T18:10:23.748681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"120'26","reported_seq":252,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.486506+0000","last_change":"2024-05-08T18:07:15.514896+0000","last_active":"2024-05-08T18:10:35.486506+0000","last_peered":"2024-05-08T18:10:35.486506+0000","last_clean":"2024-05-08T18:10:35.486506+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:10:35.486506+0000","last_undegraded":"2024-05-08T18:10:35.486506+0000","last_fullsized":"2024-05-08T18:10:35.486506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":49176,"num_write":66,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674465+0000","last_change":"2024-05-08T18:07:17.533852+0000","last_active":"2024-05-08T18:10:23.674465+0000","last_peered":"2024-05-08T18:10:23.674465+0000","last_clean":"2024-05-08T18:10:23.674465+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:10:23.674465+0000","last_undegraded":"2024-05-08T18:10:23.674465+0000","last_fullsized":"2024-05-08T18:10:23.674465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"120'20","reported_seq":235,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.483389+0000","last_change":"2024-05-08T18:07:15.487765+0000","last_active":"2024-05-08T18:10:35.483389+0000","last_peered":"2024-05-08T18:10:35.483389+0000","last_clean":"2024-05-08T18:10:35.483389+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:10:35.483389+0000","last_undegraded":"2024-05-08T18:10:35.483389+0000","last_fullsized":"2024-05-08T18:10:35.483389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32768,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"101'48","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007110+0000","last_change":"2024-05-08T18:07:17.520477+0000","last_active":"2024-05-08T18:10:23.007110+0000","last_peered":"2024-05-08T18:10:23.007110+0000","last_clean":"2024-05-08T18:10:23.007110+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:10:23.007110+0000","last_undegraded":"2024-05-08T18:10:23.007110+0000","last_fullsized":"2024-05-08T18:10:23.007110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":122,"num_write":70,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"120'10","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.312514+0000","last_change":"2024-05-08T18:07:15.491170+0000","last_active":"2024-05-08T18:10:35.312514+0000","last_peered":"2024-05-08T18:10:35.312514+0000","last_clean":"2024-05-08T18:10:35.312514+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:10:35.312514+0000","last_undegraded":"2024-05-08T18:10:35.312514+0000","last_fullsized":"2024-05-08T18:10:35.312514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.233381+0000","last_change":"2024-05-08T18:07:17.508095+0000","last_active":"2024-05-08T18:10:24.233381+0000","last_peered":"2024-05-08T18:10:24.233381+0000","last_clean":"2024-05-08T18:10:24.233381+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:10:24.233381+0000","last_undegraded":"2024-05-08T18:10:24.233381+0000","last_fullsized":"2024-05-08T18:10:24.233381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:43.527777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"120'16","reported_seq":232,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.514577+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:10:35.514577+0000","last_peered":"2024-05-08T18:10:35.514577+0000","last_clean":"2024-05-08T18:10:35.514577+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:10:35.514577+0000","last_undegraded":"2024-05-08T18:10:35.514577+0000","last_fullsized":"2024-05-08T18:10:35.514577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:58.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232925+0000","last_change":"2024-05-08T18:07:17.519048+0000","last_active":"2024-05-08T18:10:24.232925+0000","last_peered":"2024-05-08T18:10:24.232925+0000","last_clean":"2024-05-08T18:10:24.232925+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:10:24.232925+0000","last_undegraded":"2024-05-08T18:10:24.232925+0000","last_fullsized":"2024-05-08T18:10:24.232925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:13.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"120'10","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.410812+0000","last_change":"2024-05-08T18:09:38.328162+0000","last_active":"2024-05-08T18:10:35.410812+0000","last_peered":"2024-05-08T18:10:35.410812+0000","last_clean":"2024-05-08T18:10:35.410812+0000","last_became_active":"2024-05-08T18:09:38.182438+0000","last_became_peered":"2024-05-08T18:09:38.182438+0000","last_unstale":"2024-05-08T18:10:35.410812+0000","last_undegraded":"2024-05-08T18:10:35.410812+0000","last_fullsized":"2024-05-08T18:10:35.410812+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:05.642615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751059+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:10:23.751059+0000","last_peered":"2024-05-08T18:10:23.751059+0000","last_clean":"2024-05-08T18:10:23.751059+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:10:23.751059+0000","last_undegraded":"2024-05-08T18:10:23.751059+0000","last_fullsized":"2024-05-08T18:10:23.751059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"120'16","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.379072+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:10:35.379072+0000","last_peered":"2024-05-08T18:10:35.379072+0000","last_clean":"2024-05-08T18:10:35.379072+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:10:35.379072+0000","last_undegraded":"2024-05-08T18:10:35.379072+0000","last_fullsized":"2024-05-08T18:10:35.379072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":28678,"num_write":26,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748132+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:10:23.748132+0000","last_peered":"2024-05-08T18:10:23.748132+0000","last_clean":"2024-05-08T18:10:23.748132+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:10:23.748132+0000","last_undegraded":"2024-05-08T18:10:23.748132+0000","last_fullsized":"2024-05-08T18:10:23.748132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011135+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:10:23.011135+0000","last_peered":"2024-05-08T18:10:23.011135+0000","last_clean":"2024-05-08T18:10:23.011135+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:10:23.011135+0000","last_undegraded":"2024-05-08T18:10:23.011135+0000","last_fullsized":"2024-05-08T18:10:23.011135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"120'20","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.542904+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:10:35.542904+0000","last_peered":"2024-05-08T18:10:35.542904+0000","last_clean":"2024-05-08T18:10:35.542904+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:10:35.542904+0000","last_undegraded":"2024-05-08T18:10:35.542904+0000","last_fullsized":"2024-05-08T18:10:35.542904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":36876,"num_write":40,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007061+0000","last_change":"2024-05-08T18:07:19.527615+0000","last_active":"2024-05-08T18:10:23.007061+0000","last_peered":"2024-05-08T18:10:23.007061+0000","last_clean":"2024-05-08T18:10:23.007061+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:10:23.007061+0000","last_undegraded":"2024-05-08T18:10:23.007061+0000","last_fullsized":"2024-05-08T18:10:23.007061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"120'16","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.398017+0000","last_change":"2024-05-08T18:07:21.554559+0000","last_active":"2024-05-08T18:10:35.398017+0000","last_peered":"2024-05-08T18:10:35.398017+0000","last_clean":"2024-05-08T18:10:35.398017+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:10:35.398017+0000","last_undegraded":"2024-05-08T18:10:35.398017+0000","last_fullsized":"2024-05-08T18:10:35.398017+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675833+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:10:23.675833+0000","last_peered":"2024-05-08T18:10:23.675833+0000","last_clean":"2024-05-08T18:10:23.675833+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:10:23.675833+0000","last_undegraded":"2024-05-08T18:10:23.675833+0000","last_fullsized":"2024-05-08T18:10:23.675833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005832+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:10:23.005832+0000","last_peered":"2024-05-08T18:10:23.005832+0000","last_clean":"2024-05-08T18:10:23.005832+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:10:23.005832+0000","last_undegraded":"2024-05-08T18:10:23.005832+0000","last_fullsized":"2024-05-08T18:10:23.005832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007823+0000","last_change":"2024-05-08T18:07:17.535013+0000","last_active":"2024-05-08T18:10:23.007823+0000","last_peered":"2024-05-08T18:10:23.007823+0000","last_clean":"2024-05-08T18:10:23.007823+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:10:23.007823+0000","last_undegraded":"2024-05-08T18:10:23.007823+0000","last_fullsized":"2024-05-08T18:10:23.007823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"120'16","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.083847+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:10:35.083847+0000","last_peered":"2024-05-08T18:10:35.083847+0000","last_clean":"2024-05-08T18:10:35.083847+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:10:35.083847+0000","last_undegraded":"2024-05-08T18:10:35.083847+0000","last_fullsized":"2024-05-08T18:10:35.083847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":30738,"num_write":46,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010902+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:10:23.010902+0000","last_peered":"2024-05-08T18:10:23.010902+0000","last_clean":"2024-05-08T18:10:23.010902+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:10:23.010902+0000","last_undegraded":"2024-05-08T18:10:23.010902+0000","last_fullsized":"2024-05-08T18:10:23.010902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"101'7","reported_seq":206,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750625+0000","last_change":"2024-05-08T18:07:21.548732+0000","last_active":"2024-05-08T18:10:23.750625+0000","last_peered":"2024-05-08T18:10:23.750625+0000","last_clean":"2024-05-08T18:10:23.750625+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:10:23.750625+0000","last_undegraded":"2024-05-08T18:10:23.750625+0000","last_fullsized":"2024-05-08T18:10:23.750625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750086+0000","last_change":"2024-05-08T18:07:23.544710+0000","last_active":"2024-05-08T18:10:23.750086+0000","last_peered":"2024-05-08T18:10:23.750086+0000","last_clean":"2024-05-08T18:10:23.750086+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:10:23.750086+0000","last_undegraded":"2024-05-08T18:10:23.750086+0000","last_fullsized":"2024-05-08T18:10:23.750086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012615+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:10:23.012615+0000","last_peered":"2024-05-08T18:10:23.012615+0000","last_clean":"2024-05-08T18:10:23.012615+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:10:23.012615+0000","last_undegraded":"2024-05-08T18:10:23.012615+0000","last_fullsized":"2024-05-08T18:10:23.012615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"90'6","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019369+0000","last_change":"2024-05-08T18:07:17.512350+0000","last_active":"2024-05-08T18:10:23.019369+0000","last_peered":"2024-05-08T18:10:23.019369+0000","last_clean":"2024-05-08T18:10:23.019369+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:10:23.019369+0000","last_undegraded":"2024-05-08T18:10:23.019369+0000","last_fullsized":"2024-05-08T18:10:23.019369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"120'14","reported_seq":232,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.530296+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:10:35.530296+0000","last_peered":"2024-05-08T18:10:35.530296+0000","last_clean":"2024-05-08T18:10:35.530296+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:10:35.530296+0000","last_undegraded":"2024-05-08T18:10:35.530296+0000","last_fullsized":"2024-05-08T18:10:35.530296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:06.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":28684,"num_write":34,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013381+0000","last_change":"2024-05-08T18:07:19.528782+0000","last_active":"2024-05-08T18:10:23.013381+0000","last_peered":"2024-05-08T18:10:23.013381+0000","last_clean":"2024-05-08T18:10:23.013381+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:10:23.013381+0000","last_undegraded":"2024-05-08T18:10:23.013381+0000","last_fullsized":"2024-05-08T18:10:23.013381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232567+0000","last_change":"2024-05-08T18:07:21.552816+0000","last_active":"2024-05-08T18:10:24.232567+0000","last_peered":"2024-05-08T18:10:24.232567+0000","last_clean":"2024-05-08T18:10:24.232567+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:10:24.232567+0000","last_undegraded":"2024-05-08T18:10:24.232567+0000","last_fullsized":"2024-05-08T18:10:24.232567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:31.798315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"120'18","reported_seq":260,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:34.779049+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:10:34.779049+0000","last_peered":"2024-05-08T18:10:34.779049+0000","last_clean":"2024-05-08T18:10:34.779049+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:10:34.779049+0000","last_undegraded":"2024-05-08T18:10:34.779049+0000","last_fullsized":"2024-05-08T18:10:34.779049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:59.801751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"101'4","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748730+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:10:23.748730+0000","last_peered":"2024-05-08T18:10:23.748730+0000","last_clean":"2024-05-08T18:10:23.748730+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:10:23.748730+0000","last_undegraded":"2024-05-08T18:10:23.748730+0000","last_fullsized":"2024-05-08T18:10:23.748730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:31.034810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012204+0000","last_change":"2024-05-08T18:07:17.522712+0000","last_active":"2024-05-08T18:10:23.012204+0000","last_peered":"2024-05-08T18:10:23.012204+0000","last_clean":"2024-05-08T18:10:23.012204+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:10:23.012204+0000","last_undegraded":"2024-05-08T18:10:23.012204+0000","last_fullsized":"2024-05-08T18:10:23.012204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:09.361906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"120'12","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.435689+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:10:35.435689+0000","last_peered":"2024-05-08T18:10:35.435689+0000","last_clean":"2024-05-08T18:10:35.435689+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:10:35.435689+0000","last_undegraded":"2024-05-08T18:10:35.435689+0000","last_fullsized":"2024-05-08T18:10:35.435689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24588,"num_write":32,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007769+0000","last_change":"2024-05-08T18:07:19.533880+0000","last_active":"2024-05-08T18:10:23.007769+0000","last_peered":"2024-05-08T18:10:23.007769+0000","last_clean":"2024-05-08T18:10:23.007769+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:10:23.007769+0000","last_undegraded":"2024-05-08T18:10:23.007769+0000","last_fullsized":"2024-05-08T18:10:23.007769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"120'16","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.266595+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:10:35.266595+0000","last_peered":"2024-05-08T18:10:35.266595+0000","last_clean":"2024-05-08T18:10:35.266595+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:10:35.266595+0000","last_undegraded":"2024-05-08T18:10:35.266595+0000","last_fullsized":"2024-05-08T18:10:35.266595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"120'18","reported_seq":248,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:34.793777+0000","last_change":"2024-05-08T18:07:23.552304+0000","last_active":"2024-05-08T18:10:34.793777+0000","last_peered":"2024-05-08T18:10:34.793777+0000","last_clean":"2024-05-08T18:10:34.793777+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:10:34.793777+0000","last_undegraded":"2024-05-08T18:10:34.793777+0000","last_fullsized":"2024-05-08T18:10:34.793777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:01.463818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006408+0000","last_change":"2024-05-08T18:07:17.517560+0000","last_active":"2024-05-08T18:10:23.006408+0000","last_peered":"2024-05-08T18:10:23.006408+0000","last_clean":"2024-05-08T18:10:23.006408+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:10:23.006408+0000","last_undegraded":"2024-05-08T18:10:23.006408+0000","last_fullsized":"2024-05-08T18:10:23.006408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"120'28","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.540631+0000","last_change":"2024-05-08T18:07:55.357969+0000","last_active":"2024-05-08T18:10:35.540631+0000","last_peered":"2024-05-08T18:10:35.540631+0000","last_clean":"2024-05-08T18:10:35.540631+0000","last_became_active":"2024-05-08T18:07:55.357205+0000","last_became_peered":"2024-05-08T18:07:55.357205+0000","last_unstale":"2024-05-08T18:10:35.540631+0000","last_undegraded":"2024-05-08T18:10:35.540631+0000","last_fullsized":"2024-05-08T18:10:35.540631+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:04.667292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":51218,"num_write":58,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673147+0000","last_change":"2024-05-08T18:07:19.548938+0000","last_active":"2024-05-08T18:10:23.673147+0000","last_peered":"2024-05-08T18:10:23.673147+0000","last_clean":"2024-05-08T18:10:23.673147+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:10:23.673147+0000","last_undegraded":"2024-05-08T18:10:23.673147+0000","last_fullsized":"2024-05-08T18:10:23.673147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:56.935031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"120'28","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.470289+0000","last_change":"2024-05-08T18:07:21.542960+0000","last_active":"2024-05-08T18:10:35.470289+0000","last_peered":"2024-05-08T18:10:35.470289+0000","last_clean":"2024-05-08T18:10:35.470289+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:10:35.470289+0000","last_undegraded":"2024-05-08T18:10:35.470289+0000","last_fullsized":"2024-05-08T18:10:35.470289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":47,"num_read_kb":50,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251690+0000","last_change":"2024-05-08T18:07:23.551108+0000","last_active":"2024-05-08T18:10:24.251690+0000","last_peered":"2024-05-08T18:10:24.251690+0000","last_clean":"2024-05-08T18:10:24.251690+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:10:24.251690+0000","last_undegraded":"2024-05-08T18:10:24.251690+0000","last_fullsized":"2024-05-08T18:10:24.251690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:10.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006819+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:10:23.006819+0000","last_peered":"2024-05-08T18:10:23.006819+0000","last_clean":"2024-05-08T18:10:23.006819+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:10:23.006819+0000","last_undegraded":"2024-05-08T18:10:23.006819+0000","last_fullsized":"2024-05-08T18:10:23.006819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"90'2","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748795+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:10:23.748795+0000","last_peered":"2024-05-08T18:10:23.748795+0000","last_clean":"2024-05-08T18:10:23.748795+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:10:23.748795+0000","last_undegraded":"2024-05-08T18:10:23.748795+0000","last_fullsized":"2024-05-08T18:10:23.748795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"120'16","reported_seq":237,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.497212+0000","last_change":"2024-05-08T18:07:15.515252+0000","last_active":"2024-05-08T18:10:35.497212+0000","last_peered":"2024-05-08T18:10:35.497212+0000","last_clean":"2024-05-08T18:10:35.497212+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:10:35.497212+0000","last_undegraded":"2024-05-08T18:10:35.497212+0000","last_fullsized":"2024-05-08T18:10:35.497212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32792,"num_write":56,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.230736+0000","last_change":"2024-05-08T18:07:19.534540+0000","last_active":"2024-05-08T18:10:24.230736+0000","last_peered":"2024-05-08T18:10:24.230736+0000","last_clean":"2024-05-08T18:10:24.230736+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:10:24.230736+0000","last_undegraded":"2024-05-08T18:10:24.230736+0000","last_fullsized":"2024-05-08T18:10:24.230736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:41.854855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"120'17","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.023755+0000","last_change":"2024-05-08T18:07:21.558066+0000","last_active":"2024-05-08T18:10:35.023755+0000","last_peered":"2024-05-08T18:10:35.023755+0000","last_clean":"2024-05-08T18:10:35.023755+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:10:35.023755+0000","last_undegraded":"2024-05-08T18:10:35.023755+0000","last_fullsized":"2024-05-08T18:10:35.023755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:57.795649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009871+0000","last_change":"2024-05-08T18:07:23.550520+0000","last_active":"2024-05-08T18:10:23.009871+0000","last_peered":"2024-05-08T18:10:23.009871+0000","last_clean":"2024-05-08T18:10:23.009871+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:10:23.009871+0000","last_undegraded":"2024-05-08T18:10:23.009871+0000","last_fullsized":"2024-05-08T18:10:23.009871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:29.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020405+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:10:23.020405+0000","last_peered":"2024-05-08T18:10:23.020405+0000","last_clean":"2024-05-08T18:10:23.020405+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:10:23.020405+0000","last_undegraded":"2024-05-08T18:10:23.020405+0000","last_fullsized":"2024-05-08T18:10:23.020405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:12.574608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"101'34","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021104+0000","last_change":"2024-05-08T18:07:17.521904+0000","last_active":"2024-05-08T18:10:23.021104+0000","last_peered":"2024-05-08T18:10:23.021104+0000","last_clean":"2024-05-08T18:10:23.021104+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:10:23.021104+0000","last_undegraded":"2024-05-08T18:10:23.021104+0000","last_fullsized":"2024-05-08T18:10:23.021104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:17.054953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"120'8","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:34.892919+0000","last_change":"2024-05-08T18:07:15.515803+0000","last_active":"2024-05-08T18:10:34.892919+0000","last_peered":"2024-05-08T18:10:34.892919+0000","last_clean":"2024-05-08T18:10:34.892919+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:10:34.892919+0000","last_undegraded":"2024-05-08T18:10:34.892919+0000","last_fullsized":"2024-05-08T18:10:34.892919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:38.695944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16396,"num_write":28,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.231219+0000","last_change":"2024-05-08T18:07:19.537349+0000","last_active":"2024-05-08T18:10:24.231219+0000","last_peered":"2024-05-08T18:10:24.231219+0000","last_clean":"2024-05-08T18:10:24.231219+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:10:24.231219+0000","last_undegraded":"2024-05-08T18:10:24.231219+0000","last_fullsized":"2024-05-08T18:10:24.231219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:10.776188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"120'22","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.517838+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:10:35.517838+0000","last_peered":"2024-05-08T18:10:35.517838+0000","last_clean":"2024-05-08T18:10:35.517838+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:10:35.517838+0000","last_undegraded":"2024-05-08T18:10:35.517838+0000","last_fullsized":"2024-05-08T18:10:35.517838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"120'18","reported_seq":245,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:34.796352+0000","last_change":"2024-05-08T18:07:23.557535+0000","last_active":"2024-05-08T18:10:34.796352+0000","last_peered":"2024-05-08T18:10:34.796352+0000","last_clean":"2024-05-08T18:10:34.796352+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:10:34.796352+0000","last_undegraded":"2024-05-08T18:10:34.796352+0000","last_fullsized":"2024-05-08T18:10:34.796352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"101'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018672+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:10:23.018672+0000","last_peered":"2024-05-08T18:10:23.018672+0000","last_clean":"2024-05-08T18:10:23.018672+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:10:23.018672+0000","last_undegraded":"2024-05-08T18:10:23.018672+0000","last_fullsized":"2024-05-08T18:10:23.018672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:14.418227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015490+0000","last_change":"2024-05-08T18:07:17.514540+0000","last_active":"2024-05-08T18:10:23.015490+0000","last_peered":"2024-05-08T18:10:23.015490+0000","last_clean":"2024-05-08T18:10:23.015490+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:10:23.015490+0000","last_undegraded":"2024-05-08T18:10:23.015490+0000","last_fullsized":"2024-05-08T18:10:23.015490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"120'28","reported_seq":252,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.503509+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:10:35.503509+0000","last_peered":"2024-05-08T18:10:35.503509+0000","last_clean":"2024-05-08T18:10:35.503509+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:10:35.503509+0000","last_undegraded":"2024-05-08T18:10:35.503509+0000","last_fullsized":"2024-05-08T18:10:35.503509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":55320,"num_write":68,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232646+0000","last_change":"2024-05-08T18:07:19.535262+0000","last_active":"2024-05-08T18:10:24.232646+0000","last_peered":"2024-05-08T18:10:24.232646+0000","last_clean":"2024-05-08T18:10:24.232646+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:10:24.232646+0000","last_undegraded":"2024-05-08T18:10:24.232646+0000","last_fullsized":"2024-05-08T18:10:24.232646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:19.086719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"120'30","reported_seq":243,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.570125+0000","last_change":"2024-05-08T18:07:21.554675+0000","last_active":"2024-05-08T18:10:35.570125+0000","last_peered":"2024-05-08T18:10:35.570125+0000","last_clean":"2024-05-08T18:10:35.570125+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:10:35.570125+0000","last_undegraded":"2024-05-08T18:10:35.570125+0000","last_fullsized":"2024-05-08T18:10:35.570125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:13.473082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":74,"num_write":34,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.230902+0000","last_change":"2024-05-08T18:07:23.560135+0000","last_active":"2024-05-08T18:10:24.230902+0000","last_peered":"2024-05-08T18:10:24.230902+0000","last_clean":"2024-05-08T18:10:24.230902+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:10:24.230902+0000","last_undegraded":"2024-05-08T18:10:24.230902+0000","last_fullsized":"2024-05-08T18:10:24.230902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:53.168124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253338+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:10:24.253338+0000","last_peered":"2024-05-08T18:10:24.253338+0000","last_clean":"2024-05-08T18:10:24.253338+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:10:24.253338+0000","last_undegraded":"2024-05-08T18:10:24.253338+0000","last_fullsized":"2024-05-08T18:10:24.253338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:54.642104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750534+0000","last_change":"2024-05-08T18:07:55.356946+0000","last_active":"2024-05-08T18:10:23.750534+0000","last_peered":"2024-05-08T18:10:23.750534+0000","last_clean":"2024-05-08T18:10:23.750534+0000","last_became_active":"2024-05-08T18:07:55.355948+0000","last_became_peered":"2024-05-08T18:07:55.355948+0000","last_unstale":"2024-05-08T18:10:23.750534+0000","last_undegraded":"2024-05-08T18:10:23.750534+0000","last_fullsized":"2024-05-08T18:10:23.750534+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:04.163382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"120'18","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.373153+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:10:35.373153+0000","last_peered":"2024-05-08T18:10:35.373153+0000","last_clean":"2024-05-08T18:10:35.373153+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:10:35.373153+0000","last_undegraded":"2024-05-08T18:10:35.373153+0000","last_fullsized":"2024-05-08T18:10:35.373153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32768,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232927+0000","last_change":"2024-05-08T18:07:19.540536+0000","last_active":"2024-05-08T18:10:24.232927+0000","last_peered":"2024-05-08T18:10:24.232927+0000","last_clean":"2024-05-08T18:10:24.232927+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:10:24.232927+0000","last_undegraded":"2024-05-08T18:10:24.232927+0000","last_fullsized":"2024-05-08T18:10:24.232927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:04.629141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"120'21","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.157994+0000","last_change":"2024-05-08T18:07:21.549341+0000","last_active":"2024-05-08T18:10:35.157994+0000","last_peered":"2024-05-08T18:10:35.157994+0000","last_clean":"2024-05-08T18:10:35.157994+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:10:35.157994+0000","last_undegraded":"2024-05-08T18:10:35.157994+0000","last_fullsized":"2024-05-08T18:10:35.157994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":51,"num_write":28,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017020+0000","last_change":"2024-05-08T18:07:23.546759+0000","last_active":"2024-05-08T18:10:23.017020+0000","last_peered":"2024-05-08T18:10:23.017020+0000","last_clean":"2024-05-08T18:10:23.017020+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:10:23.017020+0000","last_undegraded":"2024-05-08T18:10:23.017020+0000","last_fullsized":"2024-05-08T18:10:23.017020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:34.727720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"90'2","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008384+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:10:23.008384+0000","last_peered":"2024-05-08T18:10:23.008384+0000","last_clean":"2024-05-08T18:10:23.008384+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:10:23.008384+0000","last_undegraded":"2024-05-08T18:10:23.008384+0000","last_fullsized":"2024-05-08T18:10:23.008384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:07.111241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751087+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:10:23.751087+0000","last_peered":"2024-05-08T18:10:23.751087+0000","last_clean":"2024-05-08T18:10:23.751087+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:10:23.751087+0000","last_undegraded":"2024-05-08T18:10:23.751087+0000","last_fullsized":"2024-05-08T18:10:23.751087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"120'10","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.435773+0000","last_change":"2024-05-08T18:07:15.490889+0000","last_active":"2024-05-08T18:10:35.435773+0000","last_peered":"2024-05-08T18:10:35.435773+0000","last_clean":"2024-05-08T18:10:35.435773+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:10:35.435773+0000","last_undegraded":"2024-05-08T18:10:35.435773+0000","last_fullsized":"2024-05-08T18:10:35.435773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16390,"num_write":20,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251079+0000","last_change":"2024-05-08T18:07:19.528407+0000","last_active":"2024-05-08T18:10:24.251079+0000","last_peered":"2024-05-08T18:10:24.251079+0000","last_clean":"2024-05-08T18:10:24.251079+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:10:24.251079+0000","last_undegraded":"2024-05-08T18:10:24.251079+0000","last_fullsized":"2024-05-08T18:10:24.251079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:14.464519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"120'23","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:34.949905+0000","last_change":"2024-05-08T18:07:21.541812+0000","last_active":"2024-05-08T18:10:34.949905+0000","last_peered":"2024-05-08T18:10:34.949905+0000","last_clean":"2024-05-08T18:10:34.949905+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:10:34.949905+0000","last_undegraded":"2024-05-08T18:10:34.949905+0000","last_fullsized":"2024-05-08T18:10:34.949905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:27.606252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"120'18","reported_seq":253,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:34.784348+0000","last_change":"2024-05-08T18:07:23.550917+0000","last_active":"2024-05-08T18:10:34.784348+0000","last_peered":"2024-05-08T18:10:34.784348+0000","last_clean":"2024-05-08T18:10:34.784348+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:10:34.784348+0000","last_undegraded":"2024-05-08T18:10:34.784348+0000","last_fullsized":"2024-05-08T18:10:34.784348+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:22.985375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248023+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:10:24.248023+0000","last_peered":"2024-05-08T18:10:24.248023+0000","last_clean":"2024-05-08T18:10:24.248023+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:10:24.248023+0000","last_undegraded":"2024-05-08T18:10:24.248023+0000","last_fullsized":"2024-05-08T18:10:24.248023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:47.543830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"101'42","reported_seq":249,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750723+0000","last_change":"2024-05-08T18:07:17.518119+0000","last_active":"2024-05-08T18:10:23.750723+0000","last_peered":"2024-05-08T18:10:23.750723+0000","last_clean":"2024-05-08T18:10:23.750723+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:10:23.750723+0000","last_undegraded":"2024-05-08T18:10:23.750723+0000","last_fullsized":"2024-05-08T18:10:23.750723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"120'20","reported_seq":239,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.406913+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:10:35.406913+0000","last_peered":"2024-05-08T18:10:35.406913+0000","last_clean":"2024-05-08T18:10:35.406913+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:10:35.406913+0000","last_undegraded":"2024-05-08T18:10:35.406913+0000","last_fullsized":"2024-05-08T18:10:35.406913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":34822,"num_write":30,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":222,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:34.746130+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:10:34.746130+0000","last_peered":"2024-05-08T18:10:34.746130+0000","last_clean":"2024-05-08T18:10:34.746130+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:10:34.746130+0000","last_undegraded":"2024-05-08T18:10:34.746130+0000","last_fullsized":"2024-05-08T18:10:34.746130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:10.882440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":95,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.250890+0000","last_change":"2024-05-08T18:09:06.402195+0000","last_active":"2024-05-08T18:10:24.250890+0000","last_peered":"2024-05-08T18:10:24.250890+0000","last_clean":"2024-05-08T18:10:24.250890+0000","last_became_active":"2024-05-08T18:09:06.380401+0000","last_became_peered":"2024-05-08T18:09:06.380401+0000","last_unstale":"2024-05-08T18:10:24.250890+0000","last_undegraded":"2024-05-08T18:10:24.250890+0000","last_fullsized":"2024-05-08T18:10:24.250890+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:36.840412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"120'18","reported_seq":250,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:34.782784+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:10:34.782784+0000","last_peered":"2024-05-08T18:10:34.782784+0000","last_clean":"2024-05-08T18:10:34.782784+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:10:34.782784+0000","last_undegraded":"2024-05-08T18:10:34.782784+0000","last_fullsized":"2024-05-08T18:10:34.782784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:15.405744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749093+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:10:23.749093+0000","last_peered":"2024-05-08T18:10:23.749093+0000","last_clean":"2024-05-08T18:10:23.749093+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:10:23.749093+0000","last_undegraded":"2024-05-08T18:10:23.749093+0000","last_fullsized":"2024-05-08T18:10:23.749093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253566+0000","last_change":"2024-05-08T18:07:17.495579+0000","last_active":"2024-05-08T18:10:24.253566+0000","last_peered":"2024-05-08T18:10:24.253566+0000","last_clean":"2024-05-08T18:10:24.253566+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:10:24.253566+0000","last_undegraded":"2024-05-08T18:10:24.253566+0000","last_fullsized":"2024-05-08T18:10:24.253566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"120'24","reported_seq":246,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.362864+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:10:35.362864+0000","last_peered":"2024-05-08T18:10:35.362864+0000","last_clean":"2024-05-08T18:10:35.362864+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:10:35.362864+0000","last_undegraded":"2024-05-08T18:10:35.362864+0000","last_fullsized":"2024-05-08T18:10:35.362864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":47110,"num_write":34,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:34.731790+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:10:34.731790+0000","last_peered":"2024-05-08T18:10:34.731790+0000","last_clean":"2024-05-08T18:10:34.731790+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:10:34.731790+0000","last_undegraded":"2024-05-08T18:10:34.731790+0000","last_fullsized":"2024-05-08T18:10:34.731790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:52.695904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"120'25","reported_seq":234,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.423484+0000","last_change":"2024-05-08T18:07:21.546901+0000","last_active":"2024-05-08T18:10:35.423484+0000","last_peered":"2024-05-08T18:10:35.423484+0000","last_clean":"2024-05-08T18:10:35.423484+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:10:35.423484+0000","last_undegraded":"2024-05-08T18:10:35.423484+0000","last_fullsized":"2024-05-08T18:10:35.423484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:20.493445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":42,"num_read_kb":53,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019992+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:10:23.019992+0000","last_peered":"2024-05-08T18:10:23.019992+0000","last_clean":"2024-05-08T18:10:23.019992+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:10:23.019992+0000","last_undegraded":"2024-05-08T18:10:23.019992+0000","last_fullsized":"2024-05-08T18:10:23.019992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:53.367846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251604+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:10:24.251604+0000","last_peered":"2024-05-08T18:10:24.251604+0000","last_clean":"2024-05-08T18:10:24.251604+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:10:24.251604+0000","last_undegraded":"2024-05-08T18:10:24.251604+0000","last_fullsized":"2024-05-08T18:10:24.251604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:24.506535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.021357+0000","last_change":"2024-05-08T18:07:17.529331+0000","last_active":"2024-05-08T18:10:23.021357+0000","last_peered":"2024-05-08T18:10:23.021357+0000","last_clean":"2024-05-08T18:10:23.021357+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:10:23.021357+0000","last_undegraded":"2024-05-08T18:10:23.021357+0000","last_fullsized":"2024-05-08T18:10:23.021357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:08.744422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":311,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674956+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:10:23.674956+0000","last_peered":"2024-05-08T18:10:23.674956+0000","last_clean":"2024-05-08T18:10:23.674956+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:10:23.674956+0000","last_undegraded":"2024-05-08T18:10:23.674956+0000","last_fullsized":"2024-05-08T18:10:23.674956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:48.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007096+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:10:23.007096+0000","last_peered":"2024-05-08T18:10:23.007096+0000","last_clean":"2024-05-08T18:10:23.007096+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:10:23.007096+0000","last_undegraded":"2024-05-08T18:10:23.007096+0000","last_fullsized":"2024-05-08T18:10:23.007096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"120'16","reported_seq":235,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.378680+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:10:35.378680+0000","last_peered":"2024-05-08T18:10:35.378680+0000","last_clean":"2024-05-08T18:10:35.378680+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:10:35.378680+0000","last_undegraded":"2024-05-08T18:10:35.378680+0000","last_fullsized":"2024-05-08T18:10:35.378680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32780,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674690+0000","last_change":"2024-05-08T18:07:19.544635+0000","last_active":"2024-05-08T18:10:23.674690+0000","last_peered":"2024-05-08T18:10:23.674690+0000","last_clean":"2024-05-08T18:10:23.674690+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:10:23.674690+0000","last_undegraded":"2024-05-08T18:10:23.674690+0000","last_fullsized":"2024-05-08T18:10:23.674690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"120'36","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.456741+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:10:35.456741+0000","last_peered":"2024-05-08T18:10:35.456741+0000","last_clean":"2024-05-08T18:10:35.456741+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:10:35.456741+0000","last_undegraded":"2024-05-08T18:10:35.456741+0000","last_fullsized":"2024-05-08T18:10:35.456741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":84,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018810+0000","last_change":"2024-05-08T18:07:23.547818+0000","last_active":"2024-05-08T18:10:23.018810+0000","last_peered":"2024-05-08T18:10:23.018810+0000","last_clean":"2024-05-08T18:10:23.018810+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:10:23.018810+0000","last_undegraded":"2024-05-08T18:10:23.018810+0000","last_fullsized":"2024-05-08T18:10:23.018810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:13.243042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019671+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:10:23.019671+0000","last_peered":"2024-05-08T18:10:23.019671+0000","last_clean":"2024-05-08T18:10:23.019671+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:10:23.019671+0000","last_undegraded":"2024-05-08T18:10:23.019671+0000","last_fullsized":"2024-05-08T18:10:23.019671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:58.714964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019230+0000","last_change":"2024-05-08T18:07:17.516534+0000","last_active":"2024-05-08T18:10:23.019230+0000","last_peered":"2024-05-08T18:10:23.019230+0000","last_clean":"2024-05-08T18:10:23.019230+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:10:23.019230+0000","last_undegraded":"2024-05-08T18:10:23.019230+0000","last_fullsized":"2024-05-08T18:10:23.019230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:30.002555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674634+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:10:23.674634+0000","last_peered":"2024-05-08T18:10:23.674634+0000","last_clean":"2024-05-08T18:10:23.674634+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:10:23.674634+0000","last_undegraded":"2024-05-08T18:10:23.674634+0000","last_fullsized":"2024-05-08T18:10:23.674634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:17.513681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"120'18","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.502184+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:10:35.502184+0000","last_peered":"2024-05-08T18:10:35.502184+0000","last_clean":"2024-05-08T18:10:35.502184+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:10:35.502184+0000","last_undegraded":"2024-05-08T18:10:35.502184+0000","last_fullsized":"2024-05-08T18:10:35.502184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":34834,"num_write":48,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008813+0000","last_change":"2024-05-08T18:07:19.536017+0000","last_active":"2024-05-08T18:10:23.008813+0000","last_peered":"2024-05-08T18:10:23.008813+0000","last_clean":"2024-05-08T18:10:23.008813+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:10:23.008813+0000","last_undegraded":"2024-05-08T18:10:23.008813+0000","last_fullsized":"2024-05-08T18:10:23.008813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:06.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"120'75","reported_seq":341,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.450186+0000","last_change":"2024-05-08T18:07:21.540131+0000","last_active":"2024-05-08T18:10:35.450186+0000","last_peered":"2024-05-08T18:10:35.450186+0000","last_clean":"2024-05-08T18:10:35.450186+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:10:35.450186+0000","last_undegraded":"2024-05-08T18:10:35.450186+0000","last_fullsized":"2024-05-08T18:10:35.450186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:10.736963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":130,"num_read_kb":233,"num_write":84,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674917+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:10:23.674917+0000","last_peered":"2024-05-08T18:10:23.674917+0000","last_clean":"2024-05-08T18:10:23.674917+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:10:23.674917+0000","last_undegraded":"2024-05-08T18:10:23.674917+0000","last_fullsized":"2024-05-08T18:10:23.674917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248556+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:10:24.248556+0000","last_peered":"2024-05-08T18:10:24.248556+0000","last_clean":"2024-05-08T18:10:24.248556+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:10:24.248556+0000","last_undegraded":"2024-05-08T18:10:24.248556+0000","last_fullsized":"2024-05-08T18:10:24.248556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:53.034086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"101'34","reported_seq":239,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253653+0000","last_change":"2024-05-08T18:07:17.511185+0000","last_active":"2024-05-08T18:10:24.253653+0000","last_peered":"2024-05-08T18:10:24.253653+0000","last_clean":"2024-05-08T18:10:24.253653+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:10:24.253653+0000","last_undegraded":"2024-05-08T18:10:24.253653+0000","last_fullsized":"2024-05-08T18:10:24.253653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232846+0000","last_change":"2024-05-08T18:07:09.429961+0000","last_active":"2024-05-08T18:10:24.232846+0000","last_peered":"2024-05-08T18:10:24.232846+0000","last_clean":"2024-05-08T18:10:24.232846+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:10:24.232846+0000","last_undegraded":"2024-05-08T18:10:24.232846+0000","last_fullsized":"2024-05-08T18:10:24.232846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:32.801799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"120'18","reported_seq":234,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.469605+0000","last_change":"2024-05-08T18:07:15.477946+0000","last_active":"2024-05-08T18:10:35.469605+0000","last_peered":"2024-05-08T18:10:35.469605+0000","last_clean":"2024-05-08T18:10:35.469605+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:10:35.469605+0000","last_undegraded":"2024-05-08T18:10:35.469605+0000","last_fullsized":"2024-05-08T18:10:35.469605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:08.150668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":28678,"num_write":28,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.231322+0000","last_change":"2024-05-08T18:07:19.541356+0000","last_active":"2024-05-08T18:10:24.231322+0000","last_peered":"2024-05-08T18:10:24.231322+0000","last_clean":"2024-05-08T18:10:24.231322+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:10:24.231322+0000","last_undegraded":"2024-05-08T18:10:24.231322+0000","last_fullsized":"2024-05-08T18:10:24.231322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:42.759645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"120'16","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.761812+0000","last_change":"2024-05-08T18:07:21.552924+0000","last_active":"2024-05-08T18:10:24.761812+0000","last_peered":"2024-05-08T18:10:24.761812+0000","last_clean":"2024-05-08T18:10:24.761812+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:10:24.761812+0000","last_undegraded":"2024-05-08T18:10:24.761812+0000","last_fullsized":"2024-05-08T18:10:24.761812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:00.835678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012071+0000","last_change":"2024-05-08T18:07:23.546679+0000","last_active":"2024-05-08T18:10:23.012071+0000","last_peered":"2024-05-08T18:10:23.012071+0000","last_clean":"2024-05-08T18:10:23.012071+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:10:23.012071+0000","last_undegraded":"2024-05-08T18:10:23.012071+0000","last_fullsized":"2024-05-08T18:10:23.012071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:22.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012608+0000","last_change":"2024-05-08T18:07:25.553817+0000","last_active":"2024-05-08T18:10:23.012608+0000","last_peered":"2024-05-08T18:10:23.012608+0000","last_clean":"2024-05-08T18:10:23.012608+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:10:23.012608+0000","last_undegraded":"2024-05-08T18:10:23.012608+0000","last_fullsized":"2024-05-08T18:10:23.012608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:47.438902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"90'6","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251256+0000","last_change":"2024-05-08T18:07:17.510790+0000","last_active":"2024-05-08T18:10:24.251256+0000","last_peered":"2024-05-08T18:10:24.251256+0000","last_clean":"2024-05-08T18:10:24.251256+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:10:24.251256+0000","last_undegraded":"2024-05-08T18:10:24.251256+0000","last_fullsized":"2024-05-08T18:10:24.251256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007417+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:10:23.007417+0000","last_peered":"2024-05-08T18:10:23.007417+0000","last_clean":"2024-05-08T18:10:23.007417+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:10:23.007417+0000","last_undegraded":"2024-05-08T18:10:23.007417+0000","last_fullsized":"2024-05-08T18:10:23.007417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"120'28","reported_seq":253,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.483517+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:10:35.483517+0000","last_peered":"2024-05-08T18:10:35.483517+0000","last_clean":"2024-05-08T18:10:35.483517+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:10:35.483517+0000","last_undegraded":"2024-05-08T18:10:35.483517+0000","last_fullsized":"2024-05-08T18:10:35.483517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:58:48.056248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":55314,"num_write":58,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015883+0000","last_change":"2024-05-08T18:07:19.534582+0000","last_active":"2024-05-08T18:10:23.015883+0000","last_peered":"2024-05-08T18:10:23.015883+0000","last_clean":"2024-05-08T18:10:23.015883+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:10:23.015883+0000","last_undegraded":"2024-05-08T18:10:23.015883+0000","last_fullsized":"2024-05-08T18:10:23.015883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010992+0000","last_change":"2024-05-08T18:07:21.550812+0000","last_active":"2024-05-08T18:10:23.010992+0000","last_peered":"2024-05-08T18:10:23.010992+0000","last_clean":"2024-05-08T18:10:23.010992+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:10:23.010992+0000","last_undegraded":"2024-05-08T18:10:23.010992+0000","last_fullsized":"2024-05-08T18:10:23.010992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:26.045022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022360+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:10:23.022360+0000","last_peered":"2024-05-08T18:10:23.022360+0000","last_clean":"2024-05-08T18:10:23.022360+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:10:23.022360+0000","last_undegraded":"2024-05-08T18:10:23.022360+0000","last_fullsized":"2024-05-08T18:10:23.022360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:12.743065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005558+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:10:23.005558+0000","last_peered":"2024-05-08T18:10:23.005558+0000","last_clean":"2024-05-08T18:10:23.005558+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:10:23.005558+0000","last_undegraded":"2024-05-08T18:10:23.005558+0000","last_fullsized":"2024-05-08T18:10:23.005558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:13.241841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'10","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248864+0000","last_change":"2024-05-08T18:07:17.510384+0000","last_active":"2024-05-08T18:10:24.248864+0000","last_peered":"2024-05-08T18:10:24.248864+0000","last_clean":"2024-05-08T18:10:24.248864+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:10:24.248864+0000","last_undegraded":"2024-05-08T18:10:24.248864+0000","last_fullsized":"2024-05-08T18:10:24.248864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"120'14","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.379509+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:10:35.379509+0000","last_peered":"2024-05-08T18:10:35.379509+0000","last_clean":"2024-05-08T18:10:35.379509+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:10:35.379509+0000","last_undegraded":"2024-05-08T18:10:35.379509+0000","last_fullsized":"2024-05-08T18:10:35.379509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:00.565441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":22528,"num_write":14,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251507+0000","last_change":"2024-05-08T18:07:09.435759+0000","last_active":"2024-05-08T18:10:24.251507+0000","last_peered":"2024-05-08T18:10:24.251507+0000","last_clean":"2024-05-08T18:10:24.251507+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:10:24.251507+0000","last_undegraded":"2024-05-08T18:10:24.251507+0000","last_fullsized":"2024-05-08T18:10:24.251507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014445+0000","last_change":"2024-05-08T18:07:19.547703+0000","last_active":"2024-05-08T18:10:23.014445+0000","last_peered":"2024-05-08T18:10:23.014445+0000","last_clean":"2024-05-08T18:10:23.014445+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:10:23.014445+0000","last_undegraded":"2024-05-08T18:10:23.014445+0000","last_fullsized":"2024-05-08T18:10:23.014445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:49.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"120'40","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.289053+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:10:35.289053+0000","last_peered":"2024-05-08T18:10:35.289053+0000","last_clean":"2024-05-08T18:10:35.289053+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:10:35.289053+0000","last_undegraded":"2024-05-08T18:10:35.289053+0000","last_fullsized":"2024-05-08T18:10:35.289053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":72,"num_read_kb":104,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748261+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:10:23.748261+0000","last_peered":"2024-05-08T18:10:23.748261+0000","last_clean":"2024-05-08T18:10:23.748261+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:10:23.748261+0000","last_undegraded":"2024-05-08T18:10:23.748261+0000","last_fullsized":"2024-05-08T18:10:23.748261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"90'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016164+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:10:23.016164+0000","last_peered":"2024-05-08T18:10:23.016164+0000","last_clean":"2024-05-08T18:10:23.016164+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:10:23.016164+0000","last_undegraded":"2024-05-08T18:10:23.016164+0000","last_fullsized":"2024-05-08T18:10:23.016164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:19.057721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"101'42","reported_seq":247,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015384+0000","last_change":"2024-05-08T18:07:17.514878+0000","last_active":"2024-05-08T18:10:23.015384+0000","last_peered":"2024-05-08T18:10:23.015384+0000","last_clean":"2024-05-08T18:10:23.015384+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:10:23.015384+0000","last_undegraded":"2024-05-08T18:10:23.015384+0000","last_fullsized":"2024-05-08T18:10:23.015384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:23.568516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"120'18","reported_seq":235,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.417632+0000","last_change":"2024-05-08T18:07:15.476555+0000","last_active":"2024-05-08T18:10:35.417632+0000","last_peered":"2024-05-08T18:10:35.417632+0000","last_clean":"2024-05-08T18:10:35.417632+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:10:35.417632+0000","last_undegraded":"2024-05-08T18:10:35.417632+0000","last_fullsized":"2024-05-08T18:10:35.417632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676602+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:10:23.676602+0000","last_peered":"2024-05-08T18:10:23.676602+0000","last_clean":"2024-05-08T18:10:23.676602+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:10:23.676602+0000","last_undegraded":"2024-05-08T18:10:23.676602+0000","last_fullsized":"2024-05-08T18:10:23.676602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:01.750427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020771+0000","last_change":"2024-05-08T18:07:19.541722+0000","last_active":"2024-05-08T18:10:23.020771+0000","last_peered":"2024-05-08T18:10:23.020771+0000","last_clean":"2024-05-08T18:10:23.020771+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:10:23.020771+0000","last_undegraded":"2024-05-08T18:10:23.020771+0000","last_fullsized":"2024-05-08T18:10:23.020771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:46:25.600282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247820+0000","last_change":"2024-05-08T18:07:21.528274+0000","last_active":"2024-05-08T18:10:24.247820+0000","last_peered":"2024-05-08T18:10:24.247820+0000","last_clean":"2024-05-08T18:10:24.247820+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:10:24.247820+0000","last_undegraded":"2024-05-08T18:10:24.247820+0000","last_fullsized":"2024-05-08T18:10:24.247820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:51.361744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"120'18","reported_seq":245,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:34.777148+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:10:34.777148+0000","last_peered":"2024-05-08T18:10:34.777148+0000","last_clean":"2024-05-08T18:10:34.777148+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:10:34.777148+0000","last_undegraded":"2024-05-08T18:10:34.777148+0000","last_fullsized":"2024-05-08T18:10:34.777148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:08.848444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"101'4","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012889+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:10:23.012889+0000","last_peered":"2024-05-08T18:10:23.012889+0000","last_clean":"2024-05-08T18:10:23.012889+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:10:23.012889+0000","last_undegraded":"2024-05-08T18:10:23.012889+0000","last_fullsized":"2024-05-08T18:10:23.012889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:29.436889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008956+0000","last_change":"2024-05-08T18:07:17.510163+0000","last_active":"2024-05-08T18:10:23.008956+0000","last_peered":"2024-05-08T18:10:23.008956+0000","last_clean":"2024-05-08T18:10:23.008956+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:10:23.008956+0000","last_undegraded":"2024-05-08T18:10:23.008956+0000","last_fullsized":"2024-05-08T18:10:23.008956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"120'18","reported_seq":237,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.489142+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:10:35.489142+0000","last_peered":"2024-05-08T18:10:35.489142+0000","last_clean":"2024-05-08T18:10:35.489142+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:10:35.489142+0000","last_undegraded":"2024-05-08T18:10:35.489142+0000","last_fullsized":"2024-05-08T18:10:35.489142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32774,"num_write":28,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.254105+0000","last_change":"2024-05-08T18:07:09.432696+0000","last_active":"2024-05-08T18:10:24.254105+0000","last_peered":"2024-05-08T18:10:24.254105+0000","last_clean":"2024-05-08T18:10:24.254105+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:10:24.254105+0000","last_undegraded":"2024-05-08T18:10:24.254105+0000","last_fullsized":"2024-05-08T18:10:24.254105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.132316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747745+0000","last_change":"2024-05-08T18:07:19.524706+0000","last_active":"2024-05-08T18:10:23.747745+0000","last_peered":"2024-05-08T18:10:23.747745+0000","last_clean":"2024-05-08T18:10:23.747745+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:10:23.747745+0000","last_undegraded":"2024-05-08T18:10:23.747745+0000","last_fullsized":"2024-05-08T18:10:23.747745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749424+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:10:23.749424+0000","last_peered":"2024-05-08T18:10:23.749424+0000","last_clean":"2024-05-08T18:10:23.749424+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:10:23.749424+0000","last_undegraded":"2024-05-08T18:10:23.749424+0000","last_fullsized":"2024-05-08T18:10:23.749424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"120'18","reported_seq":264,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:34.788532+0000","last_change":"2024-05-08T18:07:23.555759+0000","last_active":"2024-05-08T18:10:34.788532+0000","last_peered":"2024-05-08T18:10:34.788532+0000","last_clean":"2024-05-08T18:10:34.788532+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:10:34.788532+0000","last_undegraded":"2024-05-08T18:10:34.788532+0000","last_fullsized":"2024-05-08T18:10:34.788532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:11.234853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015918+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:10:23.015918+0000","last_peered":"2024-05-08T18:10:23.015918+0000","last_clean":"2024-05-08T18:10:23.015918+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:10:23.015918+0000","last_undegraded":"2024-05-08T18:10:23.015918+0000","last_fullsized":"2024-05-08T18:10:23.015918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:26.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748928+0000","last_change":"2024-05-08T18:07:17.508815+0000","last_active":"2024-05-08T18:10:23.748928+0000","last_peered":"2024-05-08T18:10:23.748928+0000","last_clean":"2024-05-08T18:10:23.748928+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:10:23.748928+0000","last_undegraded":"2024-05-08T18:10:23.748928+0000","last_fullsized":"2024-05-08T18:10:23.748928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"120'22","reported_seq":245,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.372694+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:10:35.372694+0000","last_peered":"2024-05-08T18:10:35.372694+0000","last_clean":"2024-05-08T18:10:35.372694+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:10:35.372694+0000","last_undegraded":"2024-05-08T18:10:35.372694+0000","last_fullsized":"2024-05-08T18:10:35.372694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:11.775648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":40996,"num_write":82,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.023317+0000","last_change":"2024-05-08T18:07:09.434817+0000","last_active":"2024-05-08T18:10:23.023317+0000","last_peered":"2024-05-08T18:10:23.023317+0000","last_clean":"2024-05-08T18:10:23.023317+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:10:23.023317+0000","last_undegraded":"2024-05-08T18:10:23.023317+0000","last_fullsized":"2024-05-08T18:10:23.023317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:29.389140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008711+0000","last_change":"2024-05-08T18:07:19.525852+0000","last_active":"2024-05-08T18:10:23.008711+0000","last_peered":"2024-05-08T18:10:23.008711+0000","last_clean":"2024-05-08T18:10:23.008711+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:10:23.008711+0000","last_undegraded":"2024-05-08T18:10:23.008711+0000","last_fullsized":"2024-05-08T18:10:23.008711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"120'54","reported_seq":280,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.383274+0000","last_change":"2024-05-08T18:07:21.557058+0000","last_active":"2024-05-08T18:10:35.383274+0000","last_peered":"2024-05-08T18:10:35.383274+0000","last_clean":"2024-05-08T18:10:35.383274+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:10:35.383274+0000","last_undegraded":"2024-05-08T18:10:35.383274+0000","last_fullsized":"2024-05-08T18:10:35.383274+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":100,"num_read_kb":182,"num_write":68,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010131+0000","last_change":"2024-05-08T18:07:23.546052+0000","last_active":"2024-05-08T18:10:23.010131+0000","last_peered":"2024-05-08T18:10:23.010131+0000","last_clean":"2024-05-08T18:10:23.010131+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:10:23.010131+0000","last_undegraded":"2024-05-08T18:10:23.010131+0000","last_fullsized":"2024-05-08T18:10:23.010131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:22.529752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006701+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:10:23.006701+0000","last_peered":"2024-05-08T18:10:23.006701+0000","last_clean":"2024-05-08T18:10:23.006701+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:10:23.006701+0000","last_undegraded":"2024-05-08T18:10:23.006701+0000","last_fullsized":"2024-05-08T18:10:23.006701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016491+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:10:23.016491+0000","last_peered":"2024-05-08T18:10:23.016491+0000","last_clean":"2024-05-08T18:10:23.016491+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:10:23.016491+0000","last_undegraded":"2024-05-08T18:10:23.016491+0000","last_fullsized":"2024-05-08T18:10:23.016491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:19.249124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"101'34","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749025+0000","last_change":"2024-05-08T18:07:17.524351+0000","last_active":"2024-05-08T18:10:23.749025+0000","last_peered":"2024-05-08T18:10:23.749025+0000","last_clean":"2024-05-08T18:10:23.749025+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:10:23.749025+0000","last_undegraded":"2024-05-08T18:10:23.749025+0000","last_fullsized":"2024-05-08T18:10:23.749025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"120'10","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.310813+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:10:35.310813+0000","last_peered":"2024-05-08T18:10:35.310813+0000","last_clean":"2024-05-08T18:10:35.310813+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:10:35.310813+0000","last_undegraded":"2024-05-08T18:10:35.310813+0000","last_fullsized":"2024-05-08T18:10:35.310813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:56.868546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":18438,"num_write":20,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248466+0000","last_change":"2024-05-08T18:07:19.530101+0000","last_active":"2024-05-08T18:10:24.248466+0000","last_peered":"2024-05-08T18:10:24.248466+0000","last_clean":"2024-05-08T18:10:24.248466+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:10:24.248466+0000","last_undegraded":"2024-05-08T18:10:24.248466+0000","last_fullsized":"2024-05-08T18:10:24.248466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:03.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"120'22","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.509977+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:10:35.509977+0000","last_peered":"2024-05-08T18:10:35.509977+0000","last_clean":"2024-05-08T18:10:35.509977+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:10:35.509977+0000","last_undegraded":"2024-05-08T18:10:35.509977+0000","last_fullsized":"2024-05-08T18:10:35.509977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":64,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008394+0000","last_change":"2024-05-08T18:07:23.550543+0000","last_active":"2024-05-08T18:10:23.008394+0000","last_peered":"2024-05-08T18:10:23.008394+0000","last_clean":"2024-05-08T18:10:23.008394+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:10:23.008394+0000","last_undegraded":"2024-05-08T18:10:23.008394+0000","last_fullsized":"2024-05-08T18:10:23.008394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:51.676026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010335+0000","last_change":"2024-05-08T18:07:25.564960+0000","last_active":"2024-05-08T18:10:23.010335+0000","last_peered":"2024-05-08T18:10:23.010335+0000","last_clean":"2024-05-08T18:10:23.010335+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:10:23.010335+0000","last_undegraded":"2024-05-08T18:10:23.010335+0000","last_fullsized":"2024-05-08T18:10:23.010335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:12.214208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248784+0000","last_change":"2024-05-08T18:07:17.518258+0000","last_active":"2024-05-08T18:10:24.248784+0000","last_peered":"2024-05-08T18:10:24.248784+0000","last_clean":"2024-05-08T18:10:24.248784+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:10:24.248784+0000","last_undegraded":"2024-05-08T18:10:24.248784+0000","last_fullsized":"2024-05-08T18:10:24.248784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"120'24","reported_seq":249,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.414681+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:10:35.414681+0000","last_peered":"2024-05-08T18:10:35.414681+0000","last_clean":"2024-05-08T18:10:35.414681+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:10:35.414681+0000","last_undegraded":"2024-05-08T18:10:35.414681+0000","last_fullsized":"2024-05-08T18:10:35.414681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":47128,"num_write":64,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012366+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:10:23.012366+0000","last_peered":"2024-05-08T18:10:23.012366+0000","last_clean":"2024-05-08T18:10:23.012366+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:10:23.012366+0000","last_undegraded":"2024-05-08T18:10:23.012366+0000","last_fullsized":"2024-05-08T18:10:23.012366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"48'5","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015264+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:10:23.015264+0000","last_peered":"2024-05-08T18:10:23.015264+0000","last_clean":"2024-05-08T18:10:23.015264+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:10:23.015264+0000","last_undegraded":"2024-05-08T18:10:23.015264+0000","last_fullsized":"2024-05-08T18:10:23.015264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:18.054681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674157+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:10:23.674157+0000","last_peered":"2024-05-08T18:10:23.674157+0000","last_clean":"2024-05-08T18:10:23.674157+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:10:23.674157+0000","last_undegraded":"2024-05-08T18:10:23.674157+0000","last_fullsized":"2024-05-08T18:10:23.674157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:52.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"90'2","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015893+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:10:23.015893+0000","last_peered":"2024-05-08T18:10:23.015893+0000","last_clean":"2024-05-08T18:10:23.015893+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:10:23.015893+0000","last_undegraded":"2024-05-08T18:10:23.015893+0000","last_fullsized":"2024-05-08T18:10:23.015893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:40.224371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009605+0000","last_change":"2024-05-08T18:07:17.512676+0000","last_active":"2024-05-08T18:10:23.009605+0000","last_peered":"2024-05-08T18:10:23.009605+0000","last_clean":"2024-05-08T18:10:23.009605+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:10:23.009605+0000","last_undegraded":"2024-05-08T18:10:23.009605+0000","last_fullsized":"2024-05-08T18:10:23.009605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"120'24","reported_seq":245,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.361154+0000","last_change":"2024-05-08T18:07:15.500394+0000","last_active":"2024-05-08T18:10:35.361154+0000","last_peered":"2024-05-08T18:10:35.361154+0000","last_clean":"2024-05-08T18:10:35.361154+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:10:35.361154+0000","last_undegraded":"2024-05-08T18:10:35.361154+0000","last_fullsized":"2024-05-08T18:10:35.361154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":47122,"num_write":54,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673614+0000","last_change":"2024-05-08T18:07:19.549888+0000","last_active":"2024-05-08T18:10:23.673614+0000","last_peered":"2024-05-08T18:10:23.673614+0000","last_clean":"2024-05-08T18:10:23.673614+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:10:23.673614+0000","last_undegraded":"2024-05-08T18:10:23.673614+0000","last_fullsized":"2024-05-08T18:10:23.673614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"120'20","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.256513+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:10:35.256513+0000","last_peered":"2024-05-08T18:10:35.256513+0000","last_clean":"2024-05-08T18:10:35.256513+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:10:35.256513+0000","last_undegraded":"2024-05-08T18:10:35.256513+0000","last_fullsized":"2024-05-08T18:10:35.256513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:28.449673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":42,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020690+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:10:23.020690+0000","last_peered":"2024-05-08T18:10:23.020690+0000","last_clean":"2024-05-08T18:10:23.020690+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:10:23.020690+0000","last_undegraded":"2024-05-08T18:10:23.020690+0000","last_fullsized":"2024-05-08T18:10:23.020690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:36.135403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006544+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:10:23.006544+0000","last_peered":"2024-05-08T18:10:23.006544+0000","last_clean":"2024-05-08T18:10:23.006544+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:10:23.006544+0000","last_undegraded":"2024-05-08T18:10:23.006544+0000","last_fullsized":"2024-05-08T18:10:23.006544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:26.140505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009195+0000","last_change":"2024-05-08T18:07:55.359230+0000","last_active":"2024-05-08T18:10:23.009195+0000","last_peered":"2024-05-08T18:10:23.009195+0000","last_clean":"2024-05-08T18:10:23.009195+0000","last_became_active":"2024-05-08T18:07:55.358047+0000","last_became_peered":"2024-05-08T18:07:55.358047+0000","last_unstale":"2024-05-08T18:10:23.009195+0000","last_undegraded":"2024-05-08T18:10:23.009195+0000","last_fullsized":"2024-05-08T18:10:23.009195+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:52.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"120'18","reported_seq":235,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.343261+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:10:35.343261+0000","last_peered":"2024-05-08T18:10:35.343261+0000","last_clean":"2024-05-08T18:10:35.343261+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:10:35.343261+0000","last_undegraded":"2024-05-08T18:10:35.343261+0000","last_fullsized":"2024-05-08T18:10:35.343261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32780,"num_write":38,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020607+0000","last_change":"2024-05-08T18:07:19.542060+0000","last_active":"2024-05-08T18:10:23.020607+0000","last_peered":"2024-05-08T18:10:23.020607+0000","last_clean":"2024-05-08T18:10:23.020607+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:10:23.020607+0000","last_undegraded":"2024-05-08T18:10:23.020607+0000","last_fullsized":"2024-05-08T18:10:23.020607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:29.792345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"120'19","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.208503+0000","last_change":"2024-05-08T18:07:21.552764+0000","last_active":"2024-05-08T18:10:35.208503+0000","last_peered":"2024-05-08T18:10:35.208503+0000","last_clean":"2024-05-08T18:10:35.208503+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:10:35.208503+0000","last_undegraded":"2024-05-08T18:10:35.208503+0000","last_fullsized":"2024-05-08T18:10:35.208503+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":57,"num_write":22,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013395+0000","last_change":"2024-05-08T18:07:23.545182+0000","last_active":"2024-05-08T18:10:23.013395+0000","last_peered":"2024-05-08T18:10:23.013395+0000","last_clean":"2024-05-08T18:10:23.013395+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:10:23.013395+0000","last_undegraded":"2024-05-08T18:10:23.013395+0000","last_fullsized":"2024-05-08T18:10:23.013395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022955+0000","last_change":"2024-05-08T18:07:17.522632+0000","last_active":"2024-05-08T18:10:23.022955+0000","last_peered":"2024-05-08T18:10:23.022955+0000","last_clean":"2024-05-08T18:10:23.022955+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:10:23.022955+0000","last_undegraded":"2024-05-08T18:10:23.022955+0000","last_fullsized":"2024-05-08T18:10:23.022955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:02.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"120'18","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.413153+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:10:35.413153+0000","last_peered":"2024-05-08T18:10:35.413153+0000","last_clean":"2024-05-08T18:10:35.413153+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:10:35.413153+0000","last_undegraded":"2024-05-08T18:10:35.413153+0000","last_fullsized":"2024-05-08T18:10:35.413153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"25'1","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:34.737025+0000","last_change":"2024-05-08T18:07:19.540507+0000","last_active":"2024-05-08T18:10:34.737025+0000","last_peered":"2024-05-08T18:10:34.737025+0000","last_clean":"2024-05-08T18:10:34.737025+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:10:34.737025+0000","last_undegraded":"2024-05-08T18:10:34.737025+0000","last_fullsized":"2024-05-08T18:10:34.737025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:59.180846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"120'32","reported_seq":245,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.175704+0000","last_change":"2024-05-08T18:07:21.539827+0000","last_active":"2024-05-08T18:10:35.175704+0000","last_peered":"2024-05-08T18:10:35.175704+0000","last_clean":"2024-05-08T18:10:35.175704+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:10:35.175704+0000","last_undegraded":"2024-05-08T18:10:35.175704+0000","last_fullsized":"2024-05-08T18:10:35.175704+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:15.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":59,"num_read_kb":88,"num_write":38,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007070+0000","last_change":"2024-05-08T18:07:23.549937+0000","last_active":"2024-05-08T18:10:23.007070+0000","last_peered":"2024-05-08T18:10:23.007070+0000","last_clean":"2024-05-08T18:10:23.007070+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:10:23.007070+0000","last_undegraded":"2024-05-08T18:10:23.007070+0000","last_fullsized":"2024-05-08T18:10:23.007070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011163+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:10:23.011163+0000","last_peered":"2024-05-08T18:10:23.011163+0000","last_clean":"2024-05-08T18:10:23.011163+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:10:23.011163+0000","last_undegraded":"2024-05-08T18:10:23.011163+0000","last_fullsized":"2024-05-08T18:10:23.011163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:11.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019138+0000","last_change":"2024-05-08T18:07:17.514516+0000","last_active":"2024-05-08T18:10:23.019138+0000","last_peered":"2024-05-08T18:10:23.019138+0000","last_clean":"2024-05-08T18:10:23.019138+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:10:23.019138+0000","last_undegraded":"2024-05-08T18:10:23.019138+0000","last_fullsized":"2024-05-08T18:10:23.019138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"120'6","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.313043+0000","last_change":"2024-05-08T18:07:15.472673+0000","last_active":"2024-05-08T18:10:35.313043+0000","last_peered":"2024-05-08T18:10:35.313043+0000","last_clean":"2024-05-08T18:10:35.313043+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:10:35.313043+0000","last_undegraded":"2024-05-08T18:10:35.313043+0000","last_fullsized":"2024-05-08T18:10:35.313043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":196,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022596+0000","last_change":"2024-05-08T18:07:19.543828+0000","last_active":"2024-05-08T18:10:23.022596+0000","last_peered":"2024-05-08T18:10:23.022596+0000","last_clean":"2024-05-08T18:10:23.022596+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:10:23.022596+0000","last_undegraded":"2024-05-08T18:10:23.022596+0000","last_fullsized":"2024-05-08T18:10:23.022596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:55.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"120'22","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.221809+0000","last_change":"2024-05-08T18:07:21.556888+0000","last_active":"2024-05-08T18:10:35.221809+0000","last_peered":"2024-05-08T18:10:35.221809+0000","last_clean":"2024-05-08T18:10:35.221809+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:10:35.221809+0000","last_undegraded":"2024-05-08T18:10:35.221809+0000","last_fullsized":"2024-05-08T18:10:35.221809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:08.561518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252484+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:10:24.252484+0000","last_peered":"2024-05-08T18:10:24.252484+0000","last_clean":"2024-05-08T18:10:24.252484+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:10:24.252484+0000","last_undegraded":"2024-05-08T18:10:24.252484+0000","last_fullsized":"2024-05-08T18:10:24.252484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:20.060783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":185,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020215+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:10:23.020215+0000","last_peered":"2024-05-08T18:10:23.020215+0000","last_clean":"2024-05-08T18:10:23.020215+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:10:23.020215+0000","last_undegraded":"2024-05-08T18:10:23.020215+0000","last_fullsized":"2024-05-08T18:10:23.020215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:16.901500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010027+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:10:23.010027+0000","last_peered":"2024-05-08T18:10:23.010027+0000","last_clean":"2024-05-08T18:10:23.010027+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:10:23.010027+0000","last_undegraded":"2024-05-08T18:10:23.010027+0000","last_fullsized":"2024-05-08T18:10:23.010027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"120'10","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.279498+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:10:35.279498+0000","last_peered":"2024-05-08T18:10:35.279498+0000","last_clean":"2024-05-08T18:10:35.279498+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:10:35.279498+0000","last_undegraded":"2024-05-08T18:10:35.279498+0000","last_fullsized":"2024-05-08T18:10:35.279498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":18438,"num_write":20,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747838+0000","last_change":"2024-05-08T18:07:19.526141+0000","last_active":"2024-05-08T18:10:23.747838+0000","last_peered":"2024-05-08T18:10:23.747838+0000","last_clean":"2024-05-08T18:10:23.747838+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:10:23.747838+0000","last_undegraded":"2024-05-08T18:10:23.747838+0000","last_fullsized":"2024-05-08T18:10:23.747838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.419244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"120'19","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.582319+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:10:35.582319+0000","last_peered":"2024-05-08T18:10:35.582319+0000","last_clean":"2024-05-08T18:10:35.582319+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:10:35.582319+0000","last_undegraded":"2024-05-08T18:10:35.582319+0000","last_fullsized":"2024-05-08T18:10:35.582319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:06.842342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":37,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247314+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:10:24.247314+0000","last_peered":"2024-05-08T18:10:24.247314+0000","last_clean":"2024-05-08T18:10:24.247314+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:10:24.247314+0000","last_undegraded":"2024-05-08T18:10:24.247314+0000","last_fullsized":"2024-05-08T18:10:24.247314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:14.894512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005943+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:10:23.005943+0000","last_peered":"2024-05-08T18:10:23.005943+0000","last_clean":"2024-05-08T18:10:23.005943+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:10:23.005943+0000","last_undegraded":"2024-05-08T18:10:23.005943+0000","last_fullsized":"2024-05-08T18:10:23.005943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:24.536740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"90'6","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.232830+0000","last_change":"2024-05-08T18:07:17.516846+0000","last_active":"2024-05-08T18:10:24.232830+0000","last_peered":"2024-05-08T18:10:24.232830+0000","last_clean":"2024-05-08T18:10:24.232830+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:10:24.232830+0000","last_undegraded":"2024-05-08T18:10:24.232830+0000","last_fullsized":"2024-05-08T18:10:24.232830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:30.897159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"120'22","reported_seq":239,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.543269+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:10:35.543269+0000","last_peered":"2024-05-08T18:10:35.543269+0000","last_clean":"2024-05-08T18:10:35.543269+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:10:35.543269+0000","last_undegraded":"2024-05-08T18:10:35.543269+0000","last_fullsized":"2024-05-08T18:10:35.543269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":38912,"num_write":22,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252691+0000","last_change":"2024-05-08T18:07:19.526194+0000","last_active":"2024-05-08T18:10:24.252691+0000","last_peered":"2024-05-08T18:10:24.252691+0000","last_clean":"2024-05-08T18:10:24.252691+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:10:24.252691+0000","last_undegraded":"2024-05-08T18:10:24.252691+0000","last_fullsized":"2024-05-08T18:10:24.252691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:32.123331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"91'11","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750421+0000","last_change":"2024-05-08T18:07:21.551226+0000","last_active":"2024-05-08T18:10:23.750421+0000","last_peered":"2024-05-08T18:10:23.750421+0000","last_clean":"2024-05-08T18:10:23.750421+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:10:23.750421+0000","last_undegraded":"2024-05-08T18:10:23.750421+0000","last_fullsized":"2024-05-08T18:10:23.750421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:49.020996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"120'18","reported_seq":254,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:34.775396+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:10:34.775396+0000","last_peered":"2024-05-08T18:10:34.775396+0000","last_clean":"2024-05-08T18:10:34.775396+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:10:34.775396+0000","last_undegraded":"2024-05-08T18:10:34.775396+0000","last_fullsized":"2024-05-08T18:10:34.775396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:03.192918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"101'6","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673614+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:10:23.673614+0000","last_peered":"2024-05-08T18:10:23.673614+0000","last_clean":"2024-05-08T18:10:23.673614+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:10:23.673614+0000","last_undegraded":"2024-05-08T18:10:23.673614+0000","last_fullsized":"2024-05-08T18:10:23.673614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:15.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748762+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:10:23.748762+0000","last_peered":"2024-05-08T18:10:23.748762+0000","last_clean":"2024-05-08T18:10:23.748762+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:10:23.748762+0000","last_undegraded":"2024-05-08T18:10:23.748762+0000","last_fullsized":"2024-05-08T18:10:23.748762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"120'12","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.281128+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:10:35.281128+0000","last_peered":"2024-05-08T18:10:35.281128+0000","last_clean":"2024-05-08T18:10:35.281128+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:10:35.281128+0000","last_undegraded":"2024-05-08T18:10:35.281128+0000","last_fullsized":"2024-05-08T18:10:35.281128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:12.249848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24594,"num_write":42,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674308+0000","last_change":"2024-05-08T18:07:19.552154+0000","last_active":"2024-05-08T18:10:23.674308+0000","last_peered":"2024-05-08T18:10:23.674308+0000","last_clean":"2024-05-08T18:10:23.674308+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:10:23.674308+0000","last_undegraded":"2024-05-08T18:10:23.674308+0000","last_fullsized":"2024-05-08T18:10:23.674308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:11.393672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"120'23","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:34.961039+0000","last_change":"2024-05-08T18:07:21.546257+0000","last_active":"2024-05-08T18:10:34.961039+0000","last_peered":"2024-05-08T18:10:34.961039+0000","last_clean":"2024-05-08T18:10:34.961039+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:10:34.961039+0000","last_undegraded":"2024-05-08T18:10:34.961039+0000","last_fullsized":"2024-05-08T18:10:34.961039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:37.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014002+0000","last_change":"2024-05-08T18:07:23.553840+0000","last_active":"2024-05-08T18:10:23.014002+0000","last_peered":"2024-05-08T18:10:23.014002+0000","last_clean":"2024-05-08T18:10:23.014002+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:10:23.014002+0000","last_undegraded":"2024-05-08T18:10:23.014002+0000","last_fullsized":"2024-05-08T18:10:23.014002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:28.051124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"101'2","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676327+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:10:23.676327+0000","last_peered":"2024-05-08T18:10:23.676327+0000","last_clean":"2024-05-08T18:10:23.676327+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:10:23.676327+0000","last_undegraded":"2024-05-08T18:10:23.676327+0000","last_fullsized":"2024-05-08T18:10:23.676327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.356012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749701+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:10:23.749701+0000","last_peered":"2024-05-08T18:10:23.749701+0000","last_clean":"2024-05-08T18:10:23.749701+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:10:23.749701+0000","last_undegraded":"2024-05-08T18:10:23.749701+0000","last_fullsized":"2024-05-08T18:10:23.749701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:53.772466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"120'8","reported_seq":218,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.441566+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:10:35.441566+0000","last_peered":"2024-05-08T18:10:35.441566+0000","last_clean":"2024-05-08T18:10:35.441566+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:10:35.441566+0000","last_undegraded":"2024-05-08T18:10:35.441566+0000","last_fullsized":"2024-05-08T18:10:35.441566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:37.791155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006829+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:10:23.006829+0000","last_peered":"2024-05-08T18:10:23.006829+0000","last_clean":"2024-05-08T18:10:23.006829+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:10:23.006829+0000","last_undegraded":"2024-05-08T18:10:23.006829+0000","last_fullsized":"2024-05-08T18:10:23.006829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.899933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"120'20","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.009803+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:10:35.009803+0000","last_peered":"2024-05-08T18:10:35.009803+0000","last_clean":"2024-05-08T18:10:35.009803+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:10:35.009803+0000","last_undegraded":"2024-05-08T18:10:35.009803+0000","last_fullsized":"2024-05-08T18:10:35.009803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:12.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":57,"num_write":22,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020141+0000","last_change":"2024-05-08T18:07:23.552784+0000","last_active":"2024-05-08T18:10:23.020141+0000","last_peered":"2024-05-08T18:10:23.020141+0000","last_clean":"2024-05-08T18:10:23.020141+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:10:23.020141+0000","last_undegraded":"2024-05-08T18:10:23.020141+0000","last_fullsized":"2024-05-08T18:10:23.020141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:00.947103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010595+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:10:23.010595+0000","last_peered":"2024-05-08T18:10:23.010595+0000","last_clean":"2024-05-08T18:10:23.010595+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:10:23.010595+0000","last_undegraded":"2024-05-08T18:10:23.010595+0000","last_fullsized":"2024-05-08T18:10:23.010595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:55.638728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010032+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:10:23.010032+0000","last_peered":"2024-05-08T18:10:23.010032+0000","last_clean":"2024-05-08T18:10:23.010032+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:10:23.010032+0000","last_undegraded":"2024-05-08T18:10:23.010032+0000","last_fullsized":"2024-05-08T18:10:23.010032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:16:30.091565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"120'20","reported_seq":182,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.532803+0000","last_change":"2024-05-08T18:07:55.439856+0000","last_active":"2024-05-08T18:10:35.532803+0000","last_peered":"2024-05-08T18:10:35.532803+0000","last_clean":"2024-05-08T18:10:35.532803+0000","last_became_active":"2024-05-08T18:07:55.439188+0000","last_became_peered":"2024-05-08T18:07:55.439188+0000","last_unstale":"2024-05-08T18:10:35.532803+0000","last_undegraded":"2024-05-08T18:10:35.532803+0000","last_fullsized":"2024-05-08T18:10:35.532803+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:40.273251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":36864,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747721+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:10:23.747721+0000","last_peered":"2024-05-08T18:10:23.747721+0000","last_clean":"2024-05-08T18:10:23.747721+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:10:23.747721+0000","last_undegraded":"2024-05-08T18:10:23.747721+0000","last_fullsized":"2024-05-08T18:10:23.747721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:34.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"120'14","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.554347+0000","last_change":"2024-05-08T18:07:21.552448+0000","last_active":"2024-05-08T18:10:35.554347+0000","last_peered":"2024-05-08T18:10:35.554347+0000","last_clean":"2024-05-08T18:10:35.554347+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:10:35.554347+0000","last_undegraded":"2024-05-08T18:10:35.554347+0000","last_fullsized":"2024-05-08T18:10:35.554347+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":46,"num_write":16,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748565+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:10:23.748565+0000","last_peered":"2024-05-08T18:10:23.748565+0000","last_clean":"2024-05-08T18:10:23.748565+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:10:23.748565+0000","last_undegraded":"2024-05-08T18:10:23.748565+0000","last_fullsized":"2024-05-08T18:10:23.748565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:28.522379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675169+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:10:23.675169+0000","last_peered":"2024-05-08T18:10:23.675169+0000","last_clean":"2024-05-08T18:10:23.675169+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:10:23.675169+0000","last_undegraded":"2024-05-08T18:10:23.675169+0000","last_fullsized":"2024-05-08T18:10:23.675169+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:20.350217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748961+0000","last_change":"2024-05-08T18:07:17.526703+0000","last_active":"2024-05-08T18:10:23.748961+0000","last_peered":"2024-05-08T18:10:23.748961+0000","last_clean":"2024-05-08T18:10:23.748961+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:10:23.748961+0000","last_undegraded":"2024-05-08T18:10:23.748961+0000","last_fullsized":"2024-05-08T18:10:23.748961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"120'18","reported_seq":235,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.381711+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:10:35.381711+0000","last_peered":"2024-05-08T18:10:35.381711+0000","last_clean":"2024-05-08T18:10:35.381711+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:10:35.381711+0000","last_undegraded":"2024-05-08T18:10:35.381711+0000","last_fullsized":"2024-05-08T18:10:35.381711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32780,"num_write":38,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247662+0000","last_change":"2024-05-08T18:07:19.537190+0000","last_active":"2024-05-08T18:10:24.247662+0000","last_peered":"2024-05-08T18:10:24.247662+0000","last_clean":"2024-05-08T18:10:24.247662+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:10:24.247662+0000","last_undegraded":"2024-05-08T18:10:24.247662+0000","last_fullsized":"2024-05-08T18:10:24.247662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:22.773973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"120'18","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.593168+0000","last_change":"2024-05-08T18:07:21.551027+0000","last_active":"2024-05-08T18:10:35.593168+0000","last_peered":"2024-05-08T18:10:35.593168+0000","last_clean":"2024-05-08T18:10:35.593168+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:10:35.593168+0000","last_undegraded":"2024-05-08T18:10:35.593168+0000","last_fullsized":"2024-05-08T18:10:35.593168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":40,"num_write":20,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013086+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:10:23.013086+0000","last_peered":"2024-05-08T18:10:23.013086+0000","last_clean":"2024-05-08T18:10:23.013086+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:10:23.013086+0000","last_undegraded":"2024-05-08T18:10:23.013086+0000","last_fullsized":"2024-05-08T18:10:23.013086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:30.455775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":188,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751046+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:10:23.751046+0000","last_peered":"2024-05-08T18:10:23.751046+0000","last_clean":"2024-05-08T18:10:23.751046+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:10:23.751046+0000","last_undegraded":"2024-05-08T18:10:23.751046+0000","last_fullsized":"2024-05-08T18:10:23.751046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:08:03.470806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"101'36","reported_seq":244,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253470+0000","last_change":"2024-05-08T18:07:17.517750+0000","last_active":"2024-05-08T18:10:24.253470+0000","last_peered":"2024-05-08T18:10:24.253470+0000","last_clean":"2024-05-08T18:10:24.253470+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:10:24.253470+0000","last_undegraded":"2024-05-08T18:10:24.253470+0000","last_fullsized":"2024-05-08T18:10:24.253470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":91,"num_write":52,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"120'26","reported_seq":249,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.416859+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:10:35.416859+0000","last_peered":"2024-05-08T18:10:35.416859+0000","last_clean":"2024-05-08T18:10:35.416859+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:10:35.416859+0000","last_undegraded":"2024-05-08T18:10:35.416859+0000","last_fullsized":"2024-05-08T18:10:35.416859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:23.787705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":47134,"num_write":76,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253866+0000","last_change":"2024-05-08T18:07:17.513834+0000","last_active":"2024-05-08T18:10:24.253866+0000","last_peered":"2024-05-08T18:10:24.253866+0000","last_clean":"2024-05-08T18:10:24.253866+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:10:24.253866+0000","last_undegraded":"2024-05-08T18:10:24.253866+0000","last_fullsized":"2024-05-08T18:10:24.253866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:40.727879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"120'16","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.498827+0000","last_change":"2024-05-08T18:07:15.474896+0000","last_active":"2024-05-08T18:10:35.498827+0000","last_peered":"2024-05-08T18:10:35.498827+0000","last_clean":"2024-05-08T18:10:35.498827+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:10:35.498827+0000","last_undegraded":"2024-05-08T18:10:35.498827+0000","last_fullsized":"2024-05-08T18:10:35.498827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:37.885576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":26630,"num_write":26,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007320+0000","last_change":"2024-05-08T18:07:17.534972+0000","last_active":"2024-05-08T18:10:23.007320+0000","last_peered":"2024-05-08T18:10:23.007320+0000","last_clean":"2024-05-08T18:10:23.007320+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:10:23.007320+0000","last_undegraded":"2024-05-08T18:10:23.007320+0000","last_fullsized":"2024-05-08T18:10:23.007320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"120'18","reported_seq":235,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.532020+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:10:35.532020+0000","last_peered":"2024-05-08T18:10:35.532020+0000","last_clean":"2024-05-08T18:10:35.532020+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:10:35.532020+0000","last_undegraded":"2024-05-08T18:10:35.532020+0000","last_fullsized":"2024-05-08T18:10:35.532020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:57.133409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32780,"num_write":38,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251429+0000","last_change":"2024-05-08T18:07:17.526772+0000","last_active":"2024-05-08T18:10:24.251429+0000","last_peered":"2024-05-08T18:10:24.251429+0000","last_clean":"2024-05-08T18:10:24.251429+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:10:24.251429+0000","last_undegraded":"2024-05-08T18:10:24.251429+0000","last_fullsized":"2024-05-08T18:10:24.251429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:32.781912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"120'8","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.020403+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:10:35.020403+0000","last_peered":"2024-05-08T18:10:35.020403+0000","last_clean":"2024-05-08T18:10:35.020403+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:10:35.020403+0000","last_undegraded":"2024-05-08T18:10:35.020403+0000","last_fullsized":"2024-05-08T18:10:35.020403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":16390,"num_write":18,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012990+0000","last_change":"2024-05-08T18:07:17.531643+0000","last_active":"2024-05-08T18:10:23.012990+0000","last_peered":"2024-05-08T18:10:23.012990+0000","last_clean":"2024-05-08T18:10:23.012990+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:10:23.012990+0000","last_undegraded":"2024-05-08T18:10:23.012990+0000","last_fullsized":"2024-05-08T18:10:23.012990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:20.742207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"120'18","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.363754+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:10:35.363754+0000","last_peered":"2024-05-08T18:10:35.363754+0000","last_clean":"2024-05-08T18:10:35.363754+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:10:35.363754+0000","last_undegraded":"2024-05-08T18:10:35.363754+0000","last_fullsized":"2024-05-08T18:10:35.363754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32780,"num_write":38,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749915+0000","last_change":"2024-05-08T18:07:17.527049+0000","last_active":"2024-05-08T18:10:23.749915+0000","last_peered":"2024-05-08T18:10:23.749915+0000","last_clean":"2024-05-08T18:10:23.749915+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:10:23.749915+0000","last_undegraded":"2024-05-08T18:10:23.749915+0000","last_fullsized":"2024-05-08T18:10:23.749915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"120'16","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.047706+0000","last_change":"2024-05-08T18:07:15.473151+0000","last_active":"2024-05-08T18:10:35.047706+0000","last_peered":"2024-05-08T18:10:35.047706+0000","last_clean":"2024-05-08T18:10:35.047706+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:10:35.047706+0000","last_undegraded":"2024-05-08T18:10:35.047706+0000","last_fullsized":"2024-05-08T18:10:35.047706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:11.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":32786,"num_write":46,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"101'40","reported_seq":251,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009330+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:10:23.009330+0000","last_peered":"2024-05-08T18:10:23.009330+0000","last_clean":"2024-05-08T18:10:23.009330+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:10:23.009330+0000","last_undegraded":"2024-05-08T18:10:23.009330+0000","last_fullsized":"2024-05-08T18:10:23.009330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:01.190925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":102,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"120'16","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.092473+0000","last_change":"2024-05-08T18:07:15.494253+0000","last_active":"2024-05-08T18:10:35.092473+0000","last_peered":"2024-05-08T18:10:35.092473+0000","last_clean":"2024-05-08T18:10:35.092473+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:10:35.092473+0000","last_undegraded":"2024-05-08T18:10:35.092473+0000","last_fullsized":"2024-05-08T18:10:35.092473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:28.865224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"90'12","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019735+0000","last_change":"2024-05-08T18:07:17.523020+0000","last_active":"2024-05-08T18:10:23.019735+0000","last_peered":"2024-05-08T18:10:23.019735+0000","last_clean":"2024-05-08T18:10:23.019735+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:10:23.019735+0000","last_undegraded":"2024-05-08T18:10:23.019735+0000","last_fullsized":"2024-05-08T18:10:23.019735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:11.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"120'6","reported_seq":218,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.330136+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:10:35.330136+0000","last_peered":"2024-05-08T18:10:35.330136+0000","last_clean":"2024-05-08T18:10:35.330136+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:10:35.330136+0000","last_undegraded":"2024-05-08T18:10:35.330136+0000","last_fullsized":"2024-05-08T18:10:35.330136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:32.944572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017633+0000","last_change":"2024-05-08T18:07:17.511939+0000","last_active":"2024-05-08T18:10:23.017633+0000","last_peered":"2024-05-08T18:10:23.017633+0000","last_clean":"2024-05-08T18:10:23.017633+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:10:23.017633+0000","last_undegraded":"2024-05-08T18:10:23.017633+0000","last_fullsized":"2024-05-08T18:10:23.017633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"120'30","reported_seq":254,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.504164+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:10:35.504164+0000","last_peered":"2024-05-08T18:10:35.504164+0000","last_clean":"2024-05-08T18:10:35.504164+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:10:35.504164+0000","last_undegraded":"2024-05-08T18:10:35.504164+0000","last_fullsized":"2024-05-08T18:10:35.504164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:09.574631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":55314,"num_write":60,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750654+0000","last_change":"2024-05-08T18:07:17.506840+0000","last_active":"2024-05-08T18:10:23.750654+0000","last_peered":"2024-05-08T18:10:23.750654+0000","last_clean":"2024-05-08T18:10:23.750654+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:10:23.750654+0000","last_undegraded":"2024-05-08T18:10:23.750654+0000","last_fullsized":"2024-05-08T18:10:23.750654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:12.432754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"120'12","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.371579+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:10:35.371579+0000","last_peered":"2024-05-08T18:10:35.371579+0000","last_clean":"2024-05-08T18:10:35.371579+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:10:35.371579+0000","last_undegraded":"2024-05-08T18:10:35.371579+0000","last_fullsized":"2024-05-08T18:10:35.371579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24588,"num_write":32,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.233065+0000","last_change":"2024-05-08T18:07:17.518638+0000","last_active":"2024-05-08T18:10:24.233065+0000","last_peered":"2024-05-08T18:10:24.233065+0000","last_clean":"2024-05-08T18:10:24.233065+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:10:24.233065+0000","last_undegraded":"2024-05-08T18:10:24.233065+0000","last_fullsized":"2024-05-08T18:10:24.233065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:13.807583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"120'14","reported_seq":175,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.421840+0000","last_change":"2024-05-08T18:07:55.445745+0000","last_active":"2024-05-08T18:10:35.421840+0000","last_peered":"2024-05-08T18:10:35.421840+0000","last_clean":"2024-05-08T18:10:35.421840+0000","last_became_active":"2024-05-08T18:07:55.444935+0000","last_became_peered":"2024-05-08T18:07:55.444935+0000","last_unstale":"2024-05-08T18:10:35.421840+0000","last_undegraded":"2024-05-08T18:10:35.421840+0000","last_fullsized":"2024-05-08T18:10:35.421840+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:37.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":22528,"num_write":14,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750539+0000","last_change":"2024-05-08T18:07:17.519983+0000","last_active":"2024-05-08T18:10:23.750539+0000","last_peered":"2024-05-08T18:10:23.750539+0000","last_clean":"2024-05-08T18:10:23.750539+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:10:23.750539+0000","last_undegraded":"2024-05-08T18:10:23.750539+0000","last_fullsized":"2024-05-08T18:10:23.750539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"120'10","reported_seq":222,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.383441+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:10:35.383441+0000","last_peered":"2024-05-08T18:10:35.383441+0000","last_clean":"2024-05-08T18:10:35.383441+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:10:35.383441+0000","last_undegraded":"2024-05-08T18:10:35.383441+0000","last_fullsized":"2024-05-08T18:10:35.383441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:59.272232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16390,"num_write":20,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674975+0000","last_change":"2024-05-08T18:07:17.531897+0000","last_active":"2024-05-08T18:10:23.674975+0000","last_peered":"2024-05-08T18:10:23.674975+0000","last_clean":"2024-05-08T18:10:23.674975+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:10:23.674975+0000","last_undegraded":"2024-05-08T18:10:23.674975+0000","last_fullsized":"2024-05-08T18:10:23.674975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:08:53.494288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"120'16","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.496938+0000","last_change":"2024-05-08T18:07:15.490878+0000","last_active":"2024-05-08T18:10:35.496938+0000","last_peered":"2024-05-08T18:10:35.496938+0000","last_clean":"2024-05-08T18:10:35.496938+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:10:35.496938+0000","last_undegraded":"2024-05-08T18:10:35.496938+0000","last_fullsized":"2024-05-08T18:10:35.496938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:06.859049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012285+0000","last_change":"2024-05-08T18:07:17.514018+0000","last_active":"2024-05-08T18:10:23.012285+0000","last_peered":"2024-05-08T18:10:23.012285+0000","last_clean":"2024-05-08T18:10:23.012285+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:10:23.012285+0000","last_undegraded":"2024-05-08T18:10:23.012285+0000","last_fullsized":"2024-05-08T18:10:23.012285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:27.760579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"120'14","reported_seq":234,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.278845+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:10:35.278845+0000","last_peered":"2024-05-08T18:10:35.278845+0000","last_clean":"2024-05-08T18:10:35.278845+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:10:35.278845+0000","last_undegraded":"2024-05-08T18:10:35.278845+0000","last_fullsized":"2024-05-08T18:10:35.278845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:15.023018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26648,"num_write":54,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"101'46","reported_seq":254,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009047+0000","last_change":"2024-05-08T18:07:17.511934+0000","last_active":"2024-05-08T18:10:23.009047+0000","last_peered":"2024-05-08T18:10:23.009047+0000","last_clean":"2024-05-08T18:10:23.009047+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:10:23.009047+0000","last_undegraded":"2024-05-08T18:10:23.009047+0000","last_fullsized":"2024-05-08T18:10:23.009047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:16.941537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"120'22","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.498634+0000","last_change":"2024-05-08T18:07:15.488364+0000","last_active":"2024-05-08T18:10:35.498634+0000","last_peered":"2024-05-08T18:10:35.498634+0000","last_clean":"2024-05-08T18:10:35.498634+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:10:35.498634+0000","last_undegraded":"2024-05-08T18:10:35.498634+0000","last_fullsized":"2024-05-08T18:10:35.498634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:11.757292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":45056,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674057+0000","last_change":"2024-05-08T18:07:17.531457+0000","last_active":"2024-05-08T18:10:23.674057+0000","last_peered":"2024-05-08T18:10:23.674057+0000","last_clean":"2024-05-08T18:10:23.674057+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:10:23.674057+0000","last_undegraded":"2024-05-08T18:10:23.674057+0000","last_fullsized":"2024-05-08T18:10:23.674057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:47.124286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"120'16","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.417736+0000","last_change":"2024-05-08T18:07:15.509528+0000","last_active":"2024-05-08T18:10:35.417736+0000","last_peered":"2024-05-08T18:10:35.417736+0000","last_clean":"2024-05-08T18:10:35.417736+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:10:35.417736+0000","last_undegraded":"2024-05-08T18:10:35.417736+0000","last_fullsized":"2024-05-08T18:10:35.417736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:43.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":26630,"num_write":26,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"120'26","reported_seq":246,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.547942+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:10:35.547942+0000","last_peered":"2024-05-08T18:10:35.547942+0000","last_clean":"2024-05-08T18:10:35.547942+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:10:35.547942+0000","last_undegraded":"2024-05-08T18:10:35.547942+0000","last_fullsized":"2024-05-08T18:10:35.547942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:47.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":43014,"num_write":36,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.017327+0000","last_change":"2024-05-08T18:07:17.512175+0000","last_active":"2024-05-08T18:10:23.017327+0000","last_peered":"2024-05-08T18:10:23.017327+0000","last_clean":"2024-05-08T18:10:23.017327+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:10:23.017327+0000","last_undegraded":"2024-05-08T18:10:23.017327+0000","last_fullsized":"2024-05-08T18:10:23.017327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.683590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"120'22","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.548483+0000","last_change":"2024-05-08T18:07:15.481986+0000","last_active":"2024-05-08T18:10:35.548483+0000","last_peered":"2024-05-08T18:10:35.548483+0000","last_clean":"2024-05-08T18:10:35.548483+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:10:35.548483+0000","last_undegraded":"2024-05-08T18:10:35.548483+0000","last_fullsized":"2024-05-08T18:10:35.548483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:47:41.495842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40966,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008111+0000","last_change":"2024-05-08T18:07:17.512433+0000","last_active":"2024-05-08T18:10:23.008111+0000","last_peered":"2024-05-08T18:10:23.008111+0000","last_clean":"2024-05-08T18:10:23.008111+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:10:23.008111+0000","last_undegraded":"2024-05-08T18:10:23.008111+0000","last_fullsized":"2024-05-08T18:10:23.008111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:54.903266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":131254,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":1218,"num_read_kb":1595,"num_write":779,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":707,"ondisk_log_size":707,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1540,"num_read_kb":2048660,"num_write":2200,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33284,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338556,"statfs":{"total":96636764160,"available":96602681344,"internally_reserved":0,"allocated":2084864,"data_stored":1439914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32644,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339196,"statfs":{"total":96636764160,"available":96603336704,"internally_reserved":0,"allocated":1462272,"data_stored":848450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1511424,"data_stored":850271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1454080,"data_stored":848941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1478656,"data_stored":848846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1449984,"data_stored":848012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1478656,"data_stored":848700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33232,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338608,"statfs":{"total":96636764160,"available":96602734592,"internally_reserved":0,"allocated":2064384,"data_stored":1439320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:10:42.174 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.175 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.175 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.175 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.175 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.175 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.175 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.175 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.175 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.175 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.176 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.176 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.176 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.176 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.176 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.176 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.176 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.176 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.177 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.177 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.177 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.177 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.177 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.177 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.177 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.177 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.177 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.177 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.178 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.178 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.178 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.178 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.178 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.178 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.178 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.178 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.178 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.179 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.179 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.179 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.179 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.179 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.179 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.179 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.179 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.180 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.180 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.180 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.180 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.180 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.180 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.180 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.180 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.180 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.180 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.181 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.181 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.181 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.181 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.181 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.181 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.181 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.181 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.181 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.182 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.182 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.182 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.182 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.182 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.182 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.182 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.182 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.182 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.183 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.183 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.183 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.183 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.183 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.183 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.183 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.183 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.183 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.183 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.184 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.184 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.184 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.184 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.184 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.184 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.184 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.184 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.184 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.184 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.185 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.185 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.185 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.185 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.185 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.185 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.185 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.185 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.185 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T18:07:01.799268+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.186 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T18:07:08.398607+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.186 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.186 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.186 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.186 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.186 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.186 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.186 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T18:07:08.398607+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.186 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.187 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.187 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.187 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.187 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.187 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.187 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T18:07:08.398607+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.187 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.187 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.187 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.188 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.188 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.188 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.188 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T18:07:08.398607+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.188 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.188 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.188 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.188 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.188 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.189 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.189 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.189 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T18:07:08.398607+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.189 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.189 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.189 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.189 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.189 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.189 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.190 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T18:07:08.398607+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.190 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.190 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.190 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.190 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.190 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.190 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.190 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T18:07:08.398607+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.191 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.191 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.191 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.191 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.191 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.191 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.191 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T18:07:08.398607+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.191 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.191 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.191 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.192 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.192 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.192 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.192 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.192 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.192 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.192 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.192 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.192 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.193 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.193 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.193 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.193 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.193 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.193 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.193 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.193 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.193 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.194 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.194 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.194 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.194 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.194 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.194 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.194 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.194 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.194 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.195 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.195 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.195 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.195 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.195 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.195 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.195 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.195 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.195 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.196 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.196 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.196 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.196 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.196 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.196 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.196 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.196 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.196 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.196 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.197 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.197 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.197 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.197 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.197 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.197 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.197 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.197 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.197 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.197 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.198 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.198 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.198 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.198 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.198 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.198 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.198 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.198 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.198 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.199 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.199 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.199 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.199 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.199 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.199 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.199 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.199 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.199 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.199 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.200 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.200 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.200 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.200 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.200 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.200 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.200 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.200 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.200 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.201 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.201 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.201 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.201 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.201 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.201 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.201 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.201 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.201 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.202 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.202 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.202 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.202 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.202 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.202 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.202 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.202 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.202 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.203 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.203 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.203 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.203 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.203 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.203 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.203 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:10:42.203 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:11:02.205 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:11:02.557 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:11:02.564 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:11:02.581 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2024-05-08T18:11:01.743156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":723235,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":4566,"num_read_kb":2051631,"num_write":3838,"num_write_kb":2050326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1712,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2642,"ondisk_log_size":2642,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262088,"kb_used_data":12680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712632,"statfs":{"total":773094113280,"available":772825735168,"internally_reserved":0,"allocated":12984320,"data_stored":7972454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006436"},"pg_stats":[{"pgid":"3.3f","version":"120'20","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.590804+0000","last_change":"2024-05-08T18:07:15.511343+0000","last_active":"2024-05-08T18:10:35.590804+0000","last_peered":"2024-05-08T18:10:35.590804+0000","last_clean":"2024-05-08T18:10:35.590804+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:10:35.590804+0000","last_undegraded":"2024-05-08T18:10:35.590804+0000","last_fullsized":"2024-05-08T18:10:35.590804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":34822,"num_write":30,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.981764+0000","last_change":"2024-05-08T18:10:45.981823+0000","last_active":"2024-05-08T18:10:45.981764+0000","last_peered":"2024-05-08T18:10:45.981764+0000","last_clean":"2024-05-08T18:10:45.981764+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:10:45.981764+0000","last_undegraded":"2024-05-08T18:10:45.981764+0000","last_fullsized":"2024-05-08T18:10:45.981764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:45.981566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:45.981566+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.981566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:39.508771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"120'12","reported_seq":226,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.383186+0000","last_change":"2024-05-08T18:07:15.497419+0000","last_active":"2024-05-08T18:10:35.383186+0000","last_peered":"2024-05-08T18:10:35.383186+0000","last_clean":"2024-05-08T18:10:35.383186+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:10:35.383186+0000","last_undegraded":"2024-05-08T18:10:35.383186+0000","last_fullsized":"2024-05-08T18:10:35.383186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20486,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:44.820900+0000","last_change":"2024-05-08T18:10:44.821038+0000","last_active":"2024-05-08T18:10:44.820900+0000","last_peered":"2024-05-08T18:10:44.820900+0000","last_clean":"2024-05-08T18:10:44.820900+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:10:44.820900+0000","last_undegraded":"2024-05-08T18:10:44.820900+0000","last_fullsized":"2024-05-08T18:10:44.820900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:44.820657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:44.820657+0000","last_clean_scrub_stamp":"2024-05-08T18:10:44.820657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:06.184408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"120'26","reported_seq":248,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.534902+0000","last_change":"2024-05-08T18:07:15.479126+0000","last_active":"2024-05-08T18:10:35.534902+0000","last_peered":"2024-05-08T18:10:35.534902+0000","last_clean":"2024-05-08T18:10:35.534902+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:10:35.534902+0000","last_undegraded":"2024-05-08T18:10:35.534902+0000","last_fullsized":"2024-05-08T18:10:35.534902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":47116,"num_write":46,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:48.811156+0000","last_change":"2024-05-08T18:10:48.811210+0000","last_active":"2024-05-08T18:10:48.811156+0000","last_peered":"2024-05-08T18:10:48.811156+0000","last_clean":"2024-05-08T18:10:48.811156+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:10:48.811156+0000","last_undegraded":"2024-05-08T18:10:48.811156+0000","last_fullsized":"2024-05-08T18:10:48.811156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:48.810969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:48.810969+0000","last_clean_scrub_stamp":"2024-05-08T18:10:48.810969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:55:35.811928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"120'22","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.548756+0000","last_change":"2024-05-08T18:07:15.479680+0000","last_active":"2024-05-08T18:10:35.548756+0000","last_peered":"2024-05-08T18:10:35.548756+0000","last_clean":"2024-05-08T18:10:35.548756+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:10:35.548756+0000","last_undegraded":"2024-05-08T18:10:35.548756+0000","last_fullsized":"2024-05-08T18:10:35.548756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":40972,"num_write":42,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":203,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.014199+0000","last_change":"2024-05-08T18:07:17.511833+0000","last_active":"2024-05-08T18:10:23.014199+0000","last_peered":"2024-05-08T18:10:23.014199+0000","last_clean":"2024-05-08T18:10:23.014199+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:10:23.014199+0000","last_undegraded":"2024-05-08T18:10:23.014199+0000","last_fullsized":"2024-05-08T18:10:23.014199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"120'8","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.481956+0000","last_change":"2024-05-08T18:07:15.508095+0000","last_active":"2024-05-08T18:10:35.481956+0000","last_peered":"2024-05-08T18:10:35.481956+0000","last_clean":"2024-05-08T18:10:35.481956+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:10:35.481956+0000","last_undegraded":"2024-05-08T18:10:35.481956+0000","last_fullsized":"2024-05-08T18:10:35.481956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14342,"num_write":18,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.283648+0000","last_change":"2024-05-08T18:10:50.283752+0000","last_active":"2024-05-08T18:10:50.283648+0000","last_peered":"2024-05-08T18:10:50.283648+0000","last_clean":"2024-05-08T18:10:50.283648+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:10:50.283648+0000","last_undegraded":"2024-05-08T18:10:50.283648+0000","last_fullsized":"2024-05-08T18:10:50.283648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:50.283416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:50.283416+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.283416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:53:48.547244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"120'14","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.874975+0000","last_change":"2024-05-08T18:10:56.875043+0000","last_active":"2024-05-08T18:10:56.874975+0000","last_peered":"2024-05-08T18:10:56.874975+0000","last_clean":"2024-05-08T18:10:56.874975+0000","last_became_active":"2024-05-08T18:07:55.439578+0000","last_became_peered":"2024-05-08T18:07:55.439578+0000","last_unstale":"2024-05-08T18:10:56.874975+0000","last_undegraded":"2024-05-08T18:10:56.874975+0000","last_fullsized":"2024-05-08T18:10:56.874975+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'14","last_scrub_stamp":"2024-05-08T18:10:56.874767+0000","last_deep_scrub":"120'14","last_deep_scrub_stamp":"2024-05-08T18:10:56.874767+0000","last_clean_scrub_stamp":"2024-05-08T18:10:56.874767+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:06:26.203470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22540,"num_write":34,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"101'86","reported_seq":308,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:52.721895+0000","last_change":"2024-05-08T18:10:52.721958+0000","last_active":"2024-05-08T18:10:52.721895+0000","last_peered":"2024-05-08T18:10:52.721895+0000","last_clean":"2024-05-08T18:10:52.721895+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:10:52.721895+0000","last_undegraded":"2024-05-08T18:10:52.721895+0000","last_fullsized":"2024-05-08T18:10:52.721895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'86","last_scrub_stamp":"2024-05-08T18:10:52.721690+0000","last_deep_scrub":"101'86","last_deep_scrub_stamp":"2024-05-08T18:10:52.721690+0000","last_clean_scrub_stamp":"2024-05-08T18:10:52.721690+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:27:41.726212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":219,"num_write":126,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"120'16","reported_seq":235,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.548768+0000","last_change":"2024-05-08T18:07:15.507836+0000","last_active":"2024-05-08T18:10:35.548768+0000","last_peered":"2024-05-08T18:10:35.548768+0000","last_clean":"2024-05-08T18:10:35.548768+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:10:35.548768+0000","last_undegraded":"2024-05-08T18:10:35.548768+0000","last_fullsized":"2024-05-08T18:10:35.548768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32774,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.995033+0000","last_change":"2024-05-08T18:10:47.995086+0000","last_active":"2024-05-08T18:10:47.995033+0000","last_peered":"2024-05-08T18:10:47.995033+0000","last_clean":"2024-05-08T18:10:47.995033+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:10:47.995033+0000","last_undegraded":"2024-05-08T18:10:47.995033+0000","last_fullsized":"2024-05-08T18:10:47.995033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:47.994837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:47.994837+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.994837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:27.685008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"120'22","reported_seq":246,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.580444+0000","last_change":"2024-05-08T18:07:15.492154+0000","last_active":"2024-05-08T18:10:35.580444+0000","last_peered":"2024-05-08T18:10:35.580444+0000","last_clean":"2024-05-08T18:10:35.580444+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:10:35.580444+0000","last_undegraded":"2024-05-08T18:10:35.580444+0000","last_fullsized":"2024-05-08T18:10:35.580444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":43026,"num_write":52,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":168,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013555+0000","last_change":"2024-05-08T18:07:47.007132+0000","last_active":"2024-05-08T18:10:23.013555+0000","last_peered":"2024-05-08T18:10:23.013555+0000","last_clean":"2024-05-08T18:10:23.013555+0000","last_became_active":"2024-05-08T18:07:47.006744+0000","last_became_peered":"2024-05-08T18:07:47.006744+0000","last_unstale":"2024-05-08T18:10:23.013555+0000","last_undegraded":"2024-05-08T18:10:23.013555+0000","last_fullsized":"2024-05-08T18:10:23.013555+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.771058+0000","last_change":"2024-05-08T18:10:50.771120+0000","last_active":"2024-05-08T18:10:50.771058+0000","last_peered":"2024-05-08T18:10:50.771058+0000","last_clean":"2024-05-08T18:10:50.771058+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:10:50.771058+0000","last_undegraded":"2024-05-08T18:10:50.771058+0000","last_fullsized":"2024-05-08T18:10:50.771058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:50.770876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:50.770876+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.770876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:50.517866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"120'26","reported_seq":261,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:54.969676+0000","last_change":"2024-05-08T18:10:54.969853+0000","last_active":"2024-05-08T18:10:54.969676+0000","last_peered":"2024-05-08T18:10:54.969676+0000","last_clean":"2024-05-08T18:10:54.969676+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:10:54.969676+0000","last_undegraded":"2024-05-08T18:10:54.969676+0000","last_fullsized":"2024-05-08T18:10:54.969676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'26","last_scrub_stamp":"2024-05-08T18:10:54.969433+0000","last_deep_scrub":"120'26","last_deep_scrub_stamp":"2024-05-08T18:10:54.969433+0000","last_clean_scrub_stamp":"2024-05-08T18:10:54.969433+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:45.920711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":49176,"num_write":66,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:43.816924+0000","last_change":"2024-05-08T18:10:43.817027+0000","last_active":"2024-05-08T18:10:43.816924+0000","last_peered":"2024-05-08T18:10:43.816924+0000","last_clean":"2024-05-08T18:10:43.816924+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:10:43.816924+0000","last_undegraded":"2024-05-08T18:10:43.816924+0000","last_fullsized":"2024-05-08T18:10:43.816924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:43.816653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:43.816653+0000","last_clean_scrub_stamp":"2024-05-08T18:10:43.816653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:54.649488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"120'20","reported_seq":244,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:52.308930+0000","last_change":"2024-05-08T18:10:52.309059+0000","last_active":"2024-05-08T18:10:52.308930+0000","last_peered":"2024-05-08T18:10:52.308930+0000","last_clean":"2024-05-08T18:10:52.308930+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:10:52.308930+0000","last_undegraded":"2024-05-08T18:10:52.308930+0000","last_fullsized":"2024-05-08T18:10:52.308930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'20","last_scrub_stamp":"2024-05-08T18:10:52.308664+0000","last_deep_scrub":"120'20","last_deep_scrub_stamp":"2024-05-08T18:10:52.308664+0000","last_clean_scrub_stamp":"2024-05-08T18:10:52.308664+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:58:40.563646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32768,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"101'48","reported_seq":265,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.025237+0000","last_change":"2024-05-08T18:10:45.025302+0000","last_active":"2024-05-08T18:10:45.025237+0000","last_peered":"2024-05-08T18:10:45.025237+0000","last_clean":"2024-05-08T18:10:45.025237+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:10:45.025237+0000","last_undegraded":"2024-05-08T18:10:45.025237+0000","last_fullsized":"2024-05-08T18:10:45.025237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'48","last_scrub_stamp":"2024-05-08T18:10:45.025035+0000","last_deep_scrub":"101'48","last_deep_scrub_stamp":"2024-05-08T18:10:45.025035+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.025035+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:32:10.710960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":122,"num_write":70,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"120'10","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:53.319042+0000","last_change":"2024-05-08T18:10:53.319108+0000","last_active":"2024-05-08T18:10:53.319042+0000","last_peered":"2024-05-08T18:10:53.319042+0000","last_clean":"2024-05-08T18:10:53.319042+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:10:53.319042+0000","last_undegraded":"2024-05-08T18:10:53.319042+0000","last_fullsized":"2024-05-08T18:10:53.319042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'10","last_scrub_stamp":"2024-05-08T18:10:53.318839+0000","last_deep_scrub":"120'10","last_deep_scrub_stamp":"2024-05-08T18:10:53.318839+0000","last_clean_scrub_stamp":"2024-05-08T18:10:53.318839+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:04.151674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.118954+0000","last_change":"2024-05-08T18:10:46.119012+0000","last_active":"2024-05-08T18:10:46.118954+0000","last_peered":"2024-05-08T18:10:46.118954+0000","last_clean":"2024-05-08T18:10:46.118954+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:10:46.118954+0000","last_undegraded":"2024-05-08T18:10:46.118954+0000","last_fullsized":"2024-05-08T18:10:46.118954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:46.118746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:46.118746+0000","last_clean_scrub_stamp":"2024-05-08T18:10:46.118746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:56.649641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"120'16","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.576088+0000","last_change":"2024-05-08T18:07:15.495964+0000","last_active":"2024-05-08T18:10:35.576088+0000","last_peered":"2024-05-08T18:10:35.576088+0000","last_clean":"2024-05-08T18:10:35.576088+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:10:35.576088+0000","last_undegraded":"2024-05-08T18:10:35.576088+0000","last_fullsized":"2024-05-08T18:10:35.576088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.057538+0000","last_change":"2024-05-08T18:10:49.057593+0000","last_active":"2024-05-08T18:10:49.057538+0000","last_peered":"2024-05-08T18:10:49.057538+0000","last_clean":"2024-05-08T18:10:49.057538+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:10:49.057538+0000","last_undegraded":"2024-05-08T18:10:49.057538+0000","last_fullsized":"2024-05-08T18:10:49.057538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:49.057339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:49.057339+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.057339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:53.618091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"120'10","reported_seq":243,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.533427+0000","last_change":"2024-05-08T18:09:38.328162+0000","last_active":"2024-05-08T18:10:35.533427+0000","last_peered":"2024-05-08T18:10:35.533427+0000","last_clean":"2024-05-08T18:10:35.533427+0000","last_became_active":"2024-05-08T18:09:38.182438+0000","last_became_peered":"2024-05-08T18:09:38.182438+0000","last_unstale":"2024-05-08T18:10:35.533427+0000","last_undegraded":"2024-05-08T18:10:35.533427+0000","last_fullsized":"2024-05-08T18:10:35.533427+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751171+0000","last_change":"2024-05-08T18:07:17.498261+0000","last_active":"2024-05-08T18:10:23.751171+0000","last_peered":"2024-05-08T18:10:23.751171+0000","last_clean":"2024-05-08T18:10:23.751171+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:10:23.751171+0000","last_undegraded":"2024-05-08T18:10:23.751171+0000","last_fullsized":"2024-05-08T18:10:23.751171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"120'16","reported_seq":232,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.533250+0000","last_change":"2024-05-08T18:07:15.487031+0000","last_active":"2024-05-08T18:10:35.533250+0000","last_peered":"2024-05-08T18:10:35.533250+0000","last_clean":"2024-05-08T18:10:35.533250+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:10:35.533250+0000","last_undegraded":"2024-05-08T18:10:35.533250+0000","last_fullsized":"2024-05-08T18:10:35.533250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":28678,"num_write":26,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748266+0000","last_change":"2024-05-08T18:07:25.549934+0000","last_active":"2024-05-08T18:10:23.748266+0000","last_peered":"2024-05-08T18:10:23.748266+0000","last_clean":"2024-05-08T18:10:23.748266+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:10:23.748266+0000","last_undegraded":"2024-05-08T18:10:23.748266+0000","last_fullsized":"2024-05-08T18:10:23.748266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":206,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011246+0000","last_change":"2024-05-08T18:07:17.499561+0000","last_active":"2024-05-08T18:10:23.011246+0000","last_peered":"2024-05-08T18:10:23.011246+0000","last_clean":"2024-05-08T18:10:23.011246+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:10:23.011246+0000","last_undegraded":"2024-05-08T18:10:23.011246+0000","last_fullsized":"2024-05-08T18:10:23.011246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"120'20","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.543842+0000","last_change":"2024-05-08T18:07:15.511832+0000","last_active":"2024-05-08T18:10:35.543842+0000","last_peered":"2024-05-08T18:10:35.543842+0000","last_clean":"2024-05-08T18:10:35.543842+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:10:35.543842+0000","last_undegraded":"2024-05-08T18:10:35.543842+0000","last_fullsized":"2024-05-08T18:10:35.543842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":36876,"num_write":40,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.959121+0000","last_change":"2024-05-08T18:10:50.959177+0000","last_active":"2024-05-08T18:10:50.959121+0000","last_peered":"2024-05-08T18:10:50.959121+0000","last_clean":"2024-05-08T18:10:50.959121+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:10:50.959121+0000","last_undegraded":"2024-05-08T18:10:50.959121+0000","last_fullsized":"2024-05-08T18:10:50.959121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:50.958927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:50.958927+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.958927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:50.705916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"120'19","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.644181+0000","last_change":"2024-05-08T18:10:45.644279+0000","last_active":"2024-05-08T18:10:45.644181+0000","last_peered":"2024-05-08T18:10:45.644181+0000","last_clean":"2024-05-08T18:10:45.644181+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:10:45.644181+0000","last_undegraded":"2024-05-08T18:10:45.644181+0000","last_fullsized":"2024-05-08T18:10:45.644181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'19","last_scrub_stamp":"2024-05-08T18:10:45.644007+0000","last_deep_scrub":"120'19","last_deep_scrub_stamp":"2024-05-08T18:10:45.644007+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.644007+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:26.768150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":194,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675943+0000","last_change":"2024-05-08T18:07:23.550517+0000","last_active":"2024-05-08T18:10:23.675943+0000","last_peered":"2024-05-08T18:10:23.675943+0000","last_clean":"2024-05-08T18:10:23.675943+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:10:23.675943+0000","last_undegraded":"2024-05-08T18:10:23.675943+0000","last_fullsized":"2024-05-08T18:10:23.675943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005970+0000","last_change":"2024-05-08T18:07:25.579004+0000","last_active":"2024-05-08T18:10:23.005970+0000","last_peered":"2024-05-08T18:10:23.005970+0000","last_clean":"2024-05-08T18:10:23.005970+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:10:23.005970+0000","last_undegraded":"2024-05-08T18:10:23.005970+0000","last_fullsized":"2024-05-08T18:10:23.005970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.038103+0000","last_change":"2024-05-08T18:10:49.038158+0000","last_active":"2024-05-08T18:10:49.038103+0000","last_peered":"2024-05-08T18:10:49.038103+0000","last_clean":"2024-05-08T18:10:49.038103+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:10:49.038103+0000","last_undegraded":"2024-05-08T18:10:49.038103+0000","last_fullsized":"2024-05-08T18:10:49.038103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:49.037910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:49.037910+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.037910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:55:36.038869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"120'16","reported_seq":234,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.199272+0000","last_change":"2024-05-08T18:07:15.508465+0000","last_active":"2024-05-08T18:10:35.199272+0000","last_peered":"2024-05-08T18:10:35.199272+0000","last_clean":"2024-05-08T18:10:35.199272+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:10:35.199272+0000","last_undegraded":"2024-05-08T18:10:35.199272+0000","last_fullsized":"2024-05-08T18:10:35.199272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":30738,"num_write":46,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011008+0000","last_change":"2024-05-08T18:07:19.538626+0000","last_active":"2024-05-08T18:10:23.011008+0000","last_peered":"2024-05-08T18:10:23.011008+0000","last_clean":"2024-05-08T18:10:23.011008+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:10:23.011008+0000","last_undegraded":"2024-05-08T18:10:23.011008+0000","last_fullsized":"2024-05-08T18:10:23.011008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"120'10","reported_seq":218,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:44.677418+0000","last_change":"2024-05-08T18:10:44.677500+0000","last_active":"2024-05-08T18:10:44.677418+0000","last_peered":"2024-05-08T18:10:44.677418+0000","last_clean":"2024-05-08T18:10:44.677418+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:10:44.677418+0000","last_undegraded":"2024-05-08T18:10:44.677418+0000","last_fullsized":"2024-05-08T18:10:44.677418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'10","last_scrub_stamp":"2024-05-08T18:10:44.677200+0000","last_deep_scrub":"120'10","last_deep_scrub_stamp":"2024-05-08T18:10:44.677200+0000","last_clean_scrub_stamp":"2024-05-08T18:10:44.677200+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:32:10.363124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:43.709104+0000","last_change":"2024-05-08T18:10:43.709210+0000","last_active":"2024-05-08T18:10:43.709104+0000","last_peered":"2024-05-08T18:10:43.709104+0000","last_clean":"2024-05-08T18:10:43.709104+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:10:43.709104+0000","last_undegraded":"2024-05-08T18:10:43.709104+0000","last_fullsized":"2024-05-08T18:10:43.709104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:43.708804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:43.708804+0000","last_clean_scrub_stamp":"2024-05-08T18:10:43.708804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:02.662451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012717+0000","last_change":"2024-05-08T18:07:25.572347+0000","last_active":"2024-05-08T18:10:23.012717+0000","last_peered":"2024-05-08T18:10:23.012717+0000","last_clean":"2024-05-08T18:10:23.012717+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:10:23.012717+0000","last_undegraded":"2024-05-08T18:10:23.012717+0000","last_fullsized":"2024-05-08T18:10:23.012717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"90'6","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.615953+0000","last_change":"2024-05-08T18:10:51.616010+0000","last_active":"2024-05-08T18:10:51.615953+0000","last_peered":"2024-05-08T18:10:51.615953+0000","last_clean":"2024-05-08T18:10:51.615953+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:10:51.615953+0000","last_undegraded":"2024-05-08T18:10:51.615953+0000","last_fullsized":"2024-05-08T18:10:51.615953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-05-08T18:10:51.615751+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-05-08T18:10:51.615751+0000","last_clean_scrub_stamp":"2024-05-08T18:10:51.615751+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:29.172267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"120'14","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.542851+0000","last_change":"2024-05-08T18:07:15.512062+0000","last_active":"2024-05-08T18:10:35.542851+0000","last_peered":"2024-05-08T18:10:35.542851+0000","last_clean":"2024-05-08T18:10:35.542851+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:10:35.542851+0000","last_undegraded":"2024-05-08T18:10:35.542851+0000","last_fullsized":"2024-05-08T18:10:35.542851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":28684,"num_write":34,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.662300+0000","last_change":"2024-05-08T18:10:56.662353+0000","last_active":"2024-05-08T18:10:56.662300+0000","last_peered":"2024-05-08T18:10:56.662300+0000","last_clean":"2024-05-08T18:10:56.662300+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:10:56.662300+0000","last_undegraded":"2024-05-08T18:10:56.662300+0000","last_fullsized":"2024-05-08T18:10:56.662300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:56.662113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:56.662113+0000","last_clean_scrub_stamp":"2024-05-08T18:10:56.662113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:03.334393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"120'15","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:52.955163+0000","last_change":"2024-05-08T18:10:52.955241+0000","last_active":"2024-05-08T18:10:52.955163+0000","last_peered":"2024-05-08T18:10:52.955163+0000","last_clean":"2024-05-08T18:10:52.955163+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:10:52.955163+0000","last_undegraded":"2024-05-08T18:10:52.955163+0000","last_fullsized":"2024-05-08T18:10:52.955163+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'15","last_scrub_stamp":"2024-05-08T18:10:52.954959+0000","last_deep_scrub":"120'15","last_deep_scrub_stamp":"2024-05-08T18:10:52.954959+0000","last_clean_scrub_stamp":"2024-05-08T18:10:52.954959+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:00.265767+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"120'18","reported_seq":261,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.604400+0000","last_change":"2024-05-08T18:07:23.563819+0000","last_active":"2024-05-08T18:10:35.604400+0000","last_peered":"2024-05-08T18:10:35.604400+0000","last_clean":"2024-05-08T18:10:35.604400+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:10:35.604400+0000","last_undegraded":"2024-05-08T18:10:35.604400+0000","last_fullsized":"2024-05-08T18:10:35.604400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"101'4","reported_seq":194,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748892+0000","last_change":"2024-05-08T18:07:25.657151+0000","last_active":"2024-05-08T18:10:23.748892+0000","last_peered":"2024-05-08T18:10:23.748892+0000","last_clean":"2024-05-08T18:10:23.748892+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:10:23.748892+0000","last_undegraded":"2024-05-08T18:10:23.748892+0000","last_fullsized":"2024-05-08T18:10:23.748892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.655445+0000","last_change":"2024-05-08T18:10:50.655498+0000","last_active":"2024-05-08T18:10:50.655445+0000","last_peered":"2024-05-08T18:10:50.655445+0000","last_clean":"2024-05-08T18:10:50.655445+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:10:50.655445+0000","last_undegraded":"2024-05-08T18:10:50.655445+0000","last_fullsized":"2024-05-08T18:10:50.655445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:50.655250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:50.655250+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.655250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:45.330675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"120'12","reported_seq":226,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.467556+0000","last_change":"2024-05-08T18:07:15.503594+0000","last_active":"2024-05-08T18:10:35.467556+0000","last_peered":"2024-05-08T18:10:35.467556+0000","last_clean":"2024-05-08T18:10:35.467556+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:10:35.467556+0000","last_undegraded":"2024-05-08T18:10:35.467556+0000","last_fullsized":"2024-05-08T18:10:35.467556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24588,"num_write":32,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:52.957359+0000","last_change":"2024-05-08T18:10:52.957436+0000","last_active":"2024-05-08T18:10:52.957359+0000","last_peered":"2024-05-08T18:10:52.957359+0000","last_clean":"2024-05-08T18:10:52.957359+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:10:52.957359+0000","last_undegraded":"2024-05-08T18:10:52.957359+0000","last_fullsized":"2024-05-08T18:10:52.957359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:52.957157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:52.957157+0000","last_clean_scrub_stamp":"2024-05-08T18:10:52.957157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:32.163416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"120'16","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.269129+0000","last_change":"2024-05-08T18:07:21.552978+0000","last_active":"2024-05-08T18:10:35.269129+0000","last_peered":"2024-05-08T18:10:35.269129+0000","last_clean":"2024-05-08T18:10:35.269129+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:10:35.269129+0000","last_undegraded":"2024-05-08T18:10:35.269129+0000","last_fullsized":"2024-05-08T18:10:35.269129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"120'18","reported_seq":257,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:41.760172+0000","last_change":"2024-05-08T18:10:41.760234+0000","last_active":"2024-05-08T18:10:41.760172+0000","last_peered":"2024-05-08T18:10:41.760172+0000","last_clean":"2024-05-08T18:10:41.760172+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:10:41.760172+0000","last_undegraded":"2024-05-08T18:10:41.760172+0000","last_fullsized":"2024-05-08T18:10:41.760172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:10:41.759986+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:10:41.759986+0000","last_clean_scrub_stamp":"2024-05-08T18:10:41.759986+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:55:28.760945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.989045+0000","last_change":"2024-05-08T18:10:49.989102+0000","last_active":"2024-05-08T18:10:49.989045+0000","last_peered":"2024-05-08T18:10:49.989045+0000","last_clean":"2024-05-08T18:10:49.989045+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:10:49.989045+0000","last_undegraded":"2024-05-08T18:10:49.989045+0000","last_fullsized":"2024-05-08T18:10:49.989045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:49.988838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:49.988838+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.988838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:38.233002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"120'28","reported_seq":208,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:55.902640+0000","last_change":"2024-05-08T18:10:55.902706+0000","last_active":"2024-05-08T18:10:55.902640+0000","last_peered":"2024-05-08T18:10:55.902640+0000","last_clean":"2024-05-08T18:10:55.902640+0000","last_became_active":"2024-05-08T18:07:55.357205+0000","last_became_peered":"2024-05-08T18:07:55.357205+0000","last_unstale":"2024-05-08T18:10:55.902640+0000","last_undegraded":"2024-05-08T18:10:55.902640+0000","last_fullsized":"2024-05-08T18:10:55.902640+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'28","last_scrub_stamp":"2024-05-08T18:10:55.902329+0000","last_deep_scrub":"120'28","last_deep_scrub_stamp":"2024-05-08T18:10:55.902329+0000","last_clean_scrub_stamp":"2024-05-08T18:10:55.902329+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:14.750024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":51218,"num_write":58,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.829231+0000","last_change":"2024-05-08T18:10:47.829290+0000","last_active":"2024-05-08T18:10:47.829231+0000","last_peered":"2024-05-08T18:10:47.829231+0000","last_clean":"2024-05-08T18:10:47.829231+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:10:47.829231+0000","last_undegraded":"2024-05-08T18:10:47.829231+0000","last_fullsized":"2024-05-08T18:10:47.829231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:47.829028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:47.829028+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.829028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:52.806824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"120'36","reported_seq":255,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:44.066705+0000","last_change":"2024-05-08T18:10:44.066787+0000","last_active":"2024-05-08T18:10:44.066705+0000","last_peered":"2024-05-08T18:10:44.066705+0000","last_clean":"2024-05-08T18:10:44.066705+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:10:44.066705+0000","last_undegraded":"2024-05-08T18:10:44.066705+0000","last_fullsized":"2024-05-08T18:10:44.066705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'36","last_scrub_stamp":"2024-05-08T18:10:44.066497+0000","last_deep_scrub":"120'36","last_deep_scrub_stamp":"2024-05-08T18:10:44.066497+0000","last_clean_scrub_stamp":"2024-05-08T18:10:44.066497+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:03.020144+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":47,"num_read_kb":50,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:53.084261+0000","last_change":"2024-05-08T18:10:53.084318+0000","last_active":"2024-05-08T18:10:53.084261+0000","last_peered":"2024-05-08T18:10:53.084261+0000","last_clean":"2024-05-08T18:10:53.084261+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:10:53.084261+0000","last_undegraded":"2024-05-08T18:10:53.084261+0000","last_fullsized":"2024-05-08T18:10:53.084261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:53.084044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:53.084044+0000","last_clean_scrub_stamp":"2024-05-08T18:10:53.084044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:02:04.140806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006938+0000","last_change":"2024-05-08T18:07:25.572591+0000","last_active":"2024-05-08T18:10:23.006938+0000","last_peered":"2024-05-08T18:10:23.006938+0000","last_clean":"2024-05-08T18:10:23.006938+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:10:23.006938+0000","last_undegraded":"2024-05-08T18:10:23.006938+0000","last_fullsized":"2024-05-08T18:10:23.006938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"90'2","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748955+0000","last_change":"2024-05-08T18:07:17.503949+0000","last_active":"2024-05-08T18:10:23.748955+0000","last_peered":"2024-05-08T18:10:23.748955+0000","last_clean":"2024-05-08T18:10:23.748955+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:10:23.748955+0000","last_undegraded":"2024-05-08T18:10:23.748955+0000","last_fullsized":"2024-05-08T18:10:23.748955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"120'16","reported_seq":246,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:52.937718+0000","last_change":"2024-05-08T18:10:52.937780+0000","last_active":"2024-05-08T18:10:52.937718+0000","last_peered":"2024-05-08T18:10:52.937718+0000","last_clean":"2024-05-08T18:10:52.937718+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:10:52.937718+0000","last_undegraded":"2024-05-08T18:10:52.937718+0000","last_fullsized":"2024-05-08T18:10:52.937718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:10:52.937521+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:10:52.937521+0000","last_clean_scrub_stamp":"2024-05-08T18:10:52.937521+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:41.181685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32792,"num_write":56,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.035324+0000","last_change":"2024-05-08T18:10:50.035382+0000","last_active":"2024-05-08T18:10:50.035324+0000","last_peered":"2024-05-08T18:10:50.035324+0000","last_clean":"2024-05-08T18:10:50.035324+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:10:50.035324+0000","last_undegraded":"2024-05-08T18:10:50.035324+0000","last_fullsized":"2024-05-08T18:10:50.035324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:50.035116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:50.035116+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.035116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:56.991745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"120'20","reported_seq":237,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.637112+0000","last_change":"2024-05-08T18:10:46.637181+0000","last_active":"2024-05-08T18:10:46.637112+0000","last_peered":"2024-05-08T18:10:46.637112+0000","last_clean":"2024-05-08T18:10:46.637112+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:10:46.637112+0000","last_undegraded":"2024-05-08T18:10:46.637112+0000","last_fullsized":"2024-05-08T18:10:46.637112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'20","last_scrub_stamp":"2024-05-08T18:10:46.636931+0000","last_deep_scrub":"120'20","last_deep_scrub_stamp":"2024-05-08T18:10:46.636931+0000","last_clean_scrub_stamp":"2024-05-08T18:10:46.636931+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:21.321322+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:43.693133+0000","last_change":"2024-05-08T18:10:43.693189+0000","last_active":"2024-05-08T18:10:43.693133+0000","last_peered":"2024-05-08T18:10:43.693133+0000","last_clean":"2024-05-08T18:10:43.693133+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:10:43.693133+0000","last_undegraded":"2024-05-08T18:10:43.693133+0000","last_fullsized":"2024-05-08T18:10:43.693133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:43.692927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:43.692927+0000","last_clean_scrub_stamp":"2024-05-08T18:10:43.692927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:30.200920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020531+0000","last_change":"2024-05-08T18:07:25.568412+0000","last_active":"2024-05-08T18:10:23.020531+0000","last_peered":"2024-05-08T18:10:23.020531+0000","last_clean":"2024-05-08T18:10:23.020531+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:10:23.020531+0000","last_undegraded":"2024-05-08T18:10:23.020531+0000","last_fullsized":"2024-05-08T18:10:23.020531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"101'34","reported_seq":247,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:48.301182+0000","last_change":"2024-05-08T18:10:48.301243+0000","last_active":"2024-05-08T18:10:48.301182+0000","last_peered":"2024-05-08T18:10:48.301182+0000","last_clean":"2024-05-08T18:10:48.301182+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:10:48.301182+0000","last_undegraded":"2024-05-08T18:10:48.301182+0000","last_fullsized":"2024-05-08T18:10:48.301182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'34","last_scrub_stamp":"2024-05-08T18:10:48.300972+0000","last_deep_scrub":"101'34","last_deep_scrub_stamp":"2024-05-08T18:10:48.300972+0000","last_clean_scrub_stamp":"2024-05-08T18:10:48.300972+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:36.096578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"120'8","reported_seq":232,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.847344+0000","last_change":"2024-05-08T18:10:50.847482+0000","last_active":"2024-05-08T18:10:50.847344+0000","last_peered":"2024-05-08T18:10:50.847344+0000","last_clean":"2024-05-08T18:10:50.847344+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:10:50.847344+0000","last_undegraded":"2024-05-08T18:10:50.847344+0000","last_fullsized":"2024-05-08T18:10:50.847344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'8","last_scrub_stamp":"2024-05-08T18:10:50.847067+0000","last_deep_scrub":"120'8","last_deep_scrub_stamp":"2024-05-08T18:10:50.847067+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.847067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.108222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16396,"num_write":28,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:40.169012+0000","last_change":"2024-05-08T18:10:40.169046+0000","last_active":"2024-05-08T18:10:40.169012+0000","last_peered":"2024-05-08T18:10:40.169012+0000","last_clean":"2024-05-08T18:10:40.169012+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:10:40.169012+0000","last_undegraded":"2024-05-08T18:10:40.169012+0000","last_fullsized":"2024-05-08T18:10:40.169012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:40.168913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:40.168913+0000","last_clean_scrub_stamp":"2024-05-08T18:10:40.168913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:34.549853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"120'22","reported_seq":234,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.519488+0000","last_change":"2024-05-08T18:07:21.556927+0000","last_active":"2024-05-08T18:10:35.519488+0000","last_peered":"2024-05-08T18:10:35.519488+0000","last_clean":"2024-05-08T18:10:35.519488+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:10:35.519488+0000","last_undegraded":"2024-05-08T18:10:35.519488+0000","last_fullsized":"2024-05-08T18:10:35.519488+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"120'18","reported_seq":254,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:44.675627+0000","last_change":"2024-05-08T18:10:44.675780+0000","last_active":"2024-05-08T18:10:44.675627+0000","last_peered":"2024-05-08T18:10:44.675627+0000","last_clean":"2024-05-08T18:10:44.675627+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:10:44.675627+0000","last_undegraded":"2024-05-08T18:10:44.675627+0000","last_fullsized":"2024-05-08T18:10:44.675627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:10:44.675336+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:10:44.675336+0000","last_clean_scrub_stamp":"2024-05-08T18:10:44.675336+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:55.732097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"101'2","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.018718+0000","last_change":"2024-05-08T18:07:25.573324+0000","last_active":"2024-05-08T18:10:23.018718+0000","last_peered":"2024-05-08T18:10:23.018718+0000","last_clean":"2024-05-08T18:10:23.018718+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:10:23.018718+0000","last_undegraded":"2024-05-08T18:10:23.018718+0000","last_fullsized":"2024-05-08T18:10:23.018718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.605550+0000","last_change":"2024-05-08T18:10:46.605605+0000","last_active":"2024-05-08T18:10:46.605550+0000","last_peered":"2024-05-08T18:10:46.605550+0000","last_clean":"2024-05-08T18:10:46.605550+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:10:46.605550+0000","last_undegraded":"2024-05-08T18:10:46.605550+0000","last_fullsized":"2024-05-08T18:10:46.605550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:46.605317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:46.605317+0000","last_clean_scrub_stamp":"2024-05-08T18:10:46.605317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:33.113309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"120'28","reported_seq":253,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.530935+0000","last_change":"2024-05-08T18:07:15.475556+0000","last_active":"2024-05-08T18:10:35.530935+0000","last_peered":"2024-05-08T18:10:35.530935+0000","last_clean":"2024-05-08T18:10:35.530935+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:10:35.530935+0000","last_undegraded":"2024-05-08T18:10:35.530935+0000","last_fullsized":"2024-05-08T18:10:35.530935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":55320,"num_write":68,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:42.142094+0000","last_change":"2024-05-08T18:10:42.142154+0000","last_active":"2024-05-08T18:10:42.142094+0000","last_peered":"2024-05-08T18:10:42.142094+0000","last_clean":"2024-05-08T18:10:42.142094+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:10:42.142094+0000","last_undegraded":"2024-05-08T18:10:42.142094+0000","last_fullsized":"2024-05-08T18:10:42.142094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:42.141887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:42.141887+0000","last_clean_scrub_stamp":"2024-05-08T18:10:42.141887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:47.022471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"120'33","reported_seq":255,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:43.669807+0000","last_change":"2024-05-08T18:10:43.669983+0000","last_active":"2024-05-08T18:10:43.669807+0000","last_peered":"2024-05-08T18:10:43.669807+0000","last_clean":"2024-05-08T18:10:43.669807+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:10:43.669807+0000","last_undegraded":"2024-05-08T18:10:43.669807+0000","last_fullsized":"2024-05-08T18:10:43.669807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'33","last_scrub_stamp":"2024-05-08T18:10:43.669562+0000","last_deep_scrub":"120'33","last_deep_scrub_stamp":"2024-05-08T18:10:43.669562+0000","last_clean_scrub_stamp":"2024-05-08T18:10:43.669562+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:38.530464+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":74,"num_write":34,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:54.929509+0000","last_change":"2024-05-08T18:10:54.929567+0000","last_active":"2024-05-08T18:10:54.929509+0000","last_peered":"2024-05-08T18:10:54.929509+0000","last_clean":"2024-05-08T18:10:54.929509+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:10:54.929509+0000","last_undegraded":"2024-05-08T18:10:54.929509+0000","last_fullsized":"2024-05-08T18:10:54.929509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:54.929291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:54.929291+0000","last_clean_scrub_stamp":"2024-05-08T18:10:54.929291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:14.814611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.253386+0000","last_change":"2024-05-08T18:07:25.552503+0000","last_active":"2024-05-08T18:10:24.253386+0000","last_peered":"2024-05-08T18:10:24.253386+0000","last_clean":"2024-05-08T18:10:24.253386+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:10:24.253386+0000","last_undegraded":"2024-05-08T18:10:24.253386+0000","last_fullsized":"2024-05-08T18:10:24.253386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.750657+0000","last_change":"2024-05-08T18:07:55.356946+0000","last_active":"2024-05-08T18:10:23.750657+0000","last_peered":"2024-05-08T18:10:23.750657+0000","last_clean":"2024-05-08T18:10:23.750657+0000","last_became_active":"2024-05-08T18:07:55.355948+0000","last_became_peered":"2024-05-08T18:07:55.355948+0000","last_unstale":"2024-05-08T18:10:23.750657+0000","last_undegraded":"2024-05-08T18:10:23.750657+0000","last_fullsized":"2024-05-08T18:10:23.750657+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"120'18","reported_seq":237,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.417494+0000","last_change":"2024-05-08T18:07:15.499785+0000","last_active":"2024-05-08T18:10:35.417494+0000","last_peered":"2024-05-08T18:10:35.417494+0000","last_clean":"2024-05-08T18:10:35.417494+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:10:35.417494+0000","last_undegraded":"2024-05-08T18:10:35.417494+0000","last_fullsized":"2024-05-08T18:10:35.417494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32768,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:41.153697+0000","last_change":"2024-05-08T18:10:41.153748+0000","last_active":"2024-05-08T18:10:41.153697+0000","last_peered":"2024-05-08T18:10:41.153697+0000","last_clean":"2024-05-08T18:10:41.153697+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:10:41.153697+0000","last_undegraded":"2024-05-08T18:10:41.153697+0000","last_fullsized":"2024-05-08T18:10:41.153697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:41.153512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:41.153512+0000","last_clean_scrub_stamp":"2024-05-08T18:10:41.153512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:27.965929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"120'26","reported_seq":243,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:42.710247+0000","last_change":"2024-05-08T18:10:42.710330+0000","last_active":"2024-05-08T18:10:42.710247+0000","last_peered":"2024-05-08T18:10:42.710247+0000","last_clean":"2024-05-08T18:10:42.710247+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:10:42.710247+0000","last_undegraded":"2024-05-08T18:10:42.710247+0000","last_fullsized":"2024-05-08T18:10:42.710247+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'26","last_scrub_stamp":"2024-05-08T18:10:42.710059+0000","last_deep_scrub":"120'26","last_deep_scrub_stamp":"2024-05-08T18:10:42.710059+0000","last_clean_scrub_stamp":"2024-05-08T18:10:42.710059+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:39.006061+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":51,"num_write":28,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":856,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:38.717184+0000","last_change":"2024-05-08T18:10:38.717208+0000","last_active":"2024-05-08T18:10:38.717184+0000","last_peered":"2024-05-08T18:10:38.717184+0000","last_clean":"2024-05-08T18:10:38.717184+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:10:38.717184+0000","last_undegraded":"2024-05-08T18:10:38.717184+0000","last_fullsized":"2024-05-08T18:10:38.717184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:38.717080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:38.717080+0000","last_clean_scrub_stamp":"2024-05-08T18:10:38.717080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:15.527527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"90'2","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.008553+0000","last_change":"2024-05-08T18:07:25.569185+0000","last_active":"2024-05-08T18:10:23.008553+0000","last_peered":"2024-05-08T18:10:23.008553+0000","last_clean":"2024-05-08T18:10:23.008553+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:10:23.008553+0000","last_undegraded":"2024-05-08T18:10:23.008553+0000","last_fullsized":"2024-05-08T18:10:23.008553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751147+0000","last_change":"2024-05-08T18:07:17.506491+0000","last_active":"2024-05-08T18:10:23.751147+0000","last_peered":"2024-05-08T18:10:23.751147+0000","last_clean":"2024-05-08T18:10:23.751147+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:10:23.751147+0000","last_undegraded":"2024-05-08T18:10:23.751147+0000","last_fullsized":"2024-05-08T18:10:23.751147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"120'10","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:55.288786+0000","last_change":"2024-05-08T18:10:55.288853+0000","last_active":"2024-05-08T18:10:55.288786+0000","last_peered":"2024-05-08T18:10:55.288786+0000","last_clean":"2024-05-08T18:10:55.288786+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:10:55.288786+0000","last_undegraded":"2024-05-08T18:10:55.288786+0000","last_fullsized":"2024-05-08T18:10:55.288786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'10","last_scrub_stamp":"2024-05-08T18:10:55.288580+0000","last_deep_scrub":"120'10","last_deep_scrub_stamp":"2024-05-08T18:10:55.288580+0000","last_clean_scrub_stamp":"2024-05-08T18:10:55.288580+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:51.584582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16390,"num_write":20,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:41.236373+0000","last_change":"2024-05-08T18:10:41.236424+0000","last_active":"2024-05-08T18:10:41.236373+0000","last_peered":"2024-05-08T18:10:41.236373+0000","last_clean":"2024-05-08T18:10:41.236373+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:10:41.236373+0000","last_undegraded":"2024-05-08T18:10:41.236373+0000","last_fullsized":"2024-05-08T18:10:41.236373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:41.236170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:41.236170+0000","last_clean_scrub_stamp":"2024-05-08T18:10:41.236170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:45:34.619434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"120'29","reported_seq":248,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.952107+0000","last_change":"2024-05-08T18:10:51.952197+0000","last_active":"2024-05-08T18:10:51.952107+0000","last_peered":"2024-05-08T18:10:51.952107+0000","last_clean":"2024-05-08T18:10:51.952107+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:10:51.952107+0000","last_undegraded":"2024-05-08T18:10:51.952107+0000","last_fullsized":"2024-05-08T18:10:51.952107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'29","last_scrub_stamp":"2024-05-08T18:10:51.951907+0000","last_deep_scrub":"120'29","last_deep_scrub_stamp":"2024-05-08T18:10:51.951907+0000","last_clean_scrub_stamp":"2024-05-08T18:10:51.951907+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:45.366594+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"120'18","reported_seq":262,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:53.971401+0000","last_change":"2024-05-08T18:10:53.971467+0000","last_active":"2024-05-08T18:10:53.971401+0000","last_peered":"2024-05-08T18:10:53.971401+0000","last_clean":"2024-05-08T18:10:53.971401+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:10:53.971401+0000","last_undegraded":"2024-05-08T18:10:53.971401+0000","last_fullsized":"2024-05-08T18:10:53.971401+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:10:53.971204+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:10:53.971204+0000","last_clean_scrub_stamp":"2024-05-08T18:10:53.971204+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:48.094409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248065+0000","last_change":"2024-05-08T18:07:25.568334+0000","last_active":"2024-05-08T18:10:24.248065+0000","last_peered":"2024-05-08T18:10:24.248065+0000","last_clean":"2024-05-08T18:10:24.248065+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:10:24.248065+0000","last_undegraded":"2024-05-08T18:10:24.248065+0000","last_fullsized":"2024-05-08T18:10:24.248065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"101'42","reported_seq":258,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.763976+0000","last_change":"2024-05-08T18:10:46.764148+0000","last_active":"2024-05-08T18:10:46.763976+0000","last_peered":"2024-05-08T18:10:46.763976+0000","last_clean":"2024-05-08T18:10:46.763976+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:10:46.763976+0000","last_undegraded":"2024-05-08T18:10:46.763976+0000","last_fullsized":"2024-05-08T18:10:46.763976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'42","last_scrub_stamp":"2024-05-08T18:10:46.763716+0000","last_deep_scrub":"101'42","last_deep_scrub_stamp":"2024-05-08T18:10:46.763716+0000","last_clean_scrub_stamp":"2024-05-08T18:10:46.763716+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:16.610184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"120'20","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.543471+0000","last_change":"2024-05-08T18:07:15.484080+0000","last_active":"2024-05-08T18:10:35.543471+0000","last_peered":"2024-05-08T18:10:35.543471+0000","last_clean":"2024-05-08T18:10:35.543471+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:10:35.543471+0000","last_undegraded":"2024-05-08T18:10:35.543471+0000","last_fullsized":"2024-05-08T18:10:35.543471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":34822,"num_write":30,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:34.768311+0000","last_change":"2024-05-08T18:07:19.538886+0000","last_active":"2024-05-08T18:10:34.768311+0000","last_peered":"2024-05-08T18:10:34.768311+0000","last_clean":"2024-05-08T18:10:34.768311+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:10:34.768311+0000","last_undegraded":"2024-05-08T18:10:34.768311+0000","last_fullsized":"2024-05-08T18:10:34.768311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":96,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.250935+0000","last_change":"2024-05-08T18:09:06.402195+0000","last_active":"2024-05-08T18:10:24.250935+0000","last_peered":"2024-05-08T18:10:24.250935+0000","last_clean":"2024-05-08T18:10:24.250935+0000","last_became_active":"2024-05-08T18:09:06.380401+0000","last_became_peered":"2024-05-08T18:09:06.380401+0000","last_unstale":"2024-05-08T18:10:24.250935+0000","last_undegraded":"2024-05-08T18:10:24.250935+0000","last_fullsized":"2024-05-08T18:10:24.250935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"120'18","reported_seq":251,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.608125+0000","last_change":"2024-05-08T18:07:23.566974+0000","last_active":"2024-05-08T18:10:35.608125+0000","last_peered":"2024-05-08T18:10:35.608125+0000","last_clean":"2024-05-08T18:10:35.608125+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:10:35.608125+0000","last_undegraded":"2024-05-08T18:10:35.608125+0000","last_fullsized":"2024-05-08T18:10:35.608125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749222+0000","last_change":"2024-05-08T18:07:25.569195+0000","last_active":"2024-05-08T18:10:23.749222+0000","last_peered":"2024-05-08T18:10:23.749222+0000","last_clean":"2024-05-08T18:10:23.749222+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:10:23.749222+0000","last_undegraded":"2024-05-08T18:10:23.749222+0000","last_fullsized":"2024-05-08T18:10:23.749222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:54.131810+0000","last_change":"2024-05-08T18:10:54.131873+0000","last_active":"2024-05-08T18:10:54.131810+0000","last_peered":"2024-05-08T18:10:54.131810+0000","last_clean":"2024-05-08T18:10:54.131810+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:10:54.131810+0000","last_undegraded":"2024-05-08T18:10:54.131810+0000","last_fullsized":"2024-05-08T18:10:54.131810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:54.131615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:54.131615+0000","last_clean_scrub_stamp":"2024-05-08T18:10:54.131615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:35.255758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"120'24","reported_seq":247,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.411151+0000","last_change":"2024-05-08T18:07:15.475528+0000","last_active":"2024-05-08T18:10:35.411151+0000","last_peered":"2024-05-08T18:10:35.411151+0000","last_clean":"2024-05-08T18:10:35.411151+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:10:35.411151+0000","last_undegraded":"2024-05-08T18:10:35.411151+0000","last_fullsized":"2024-05-08T18:10:35.411151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":47110,"num_write":34,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"25'1","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:34.748034+0000","last_change":"2024-05-08T18:07:19.531645+0000","last_active":"2024-05-08T18:10:34.748034+0000","last_peered":"2024-05-08T18:10:34.748034+0000","last_clean":"2024-05-08T18:10:34.748034+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:10:34.748034+0000","last_undegraded":"2024-05-08T18:10:34.748034+0000","last_fullsized":"2024-05-08T18:10:34.748034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"120'32","reported_seq":250,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:41.132848+0000","last_change":"2024-05-08T18:10:41.133011+0000","last_active":"2024-05-08T18:10:41.132848+0000","last_peered":"2024-05-08T18:10:41.132848+0000","last_clean":"2024-05-08T18:10:41.132848+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:10:41.132848+0000","last_undegraded":"2024-05-08T18:10:41.132848+0000","last_fullsized":"2024-05-08T18:10:41.132848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'32","last_scrub_stamp":"2024-05-08T18:10:41.132626+0000","last_deep_scrub":"120'32","last_deep_scrub_stamp":"2024-05-08T18:10:41.132626+0000","last_clean_scrub_stamp":"2024-05-08T18:10:41.132626+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:09.028435+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":42,"num_read_kb":53,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020902+0000","last_change":"2024-05-08T18:07:23.554172+0000","last_active":"2024-05-08T18:10:23.020902+0000","last_peered":"2024-05-08T18:10:23.020902+0000","last_clean":"2024-05-08T18:10:23.020902+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:10:23.020902+0000","last_undegraded":"2024-05-08T18:10:23.020902+0000","last_fullsized":"2024-05-08T18:10:23.020902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.251644+0000","last_change":"2024-05-08T18:07:25.574464+0000","last_active":"2024-05-08T18:10:24.251644+0000","last_peered":"2024-05-08T18:10:24.251644+0000","last_clean":"2024-05-08T18:10:24.251644+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:10:24.251644+0000","last_undegraded":"2024-05-08T18:10:24.251644+0000","last_fullsized":"2024-05-08T18:10:24.251644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:42.348086+0000","last_change":"2024-05-08T18:10:42.348154+0000","last_active":"2024-05-08T18:10:42.348086+0000","last_peered":"2024-05-08T18:10:42.348086+0000","last_clean":"2024-05-08T18:10:42.348086+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:10:42.348086+0000","last_undegraded":"2024-05-08T18:10:42.348086+0000","last_fullsized":"2024-05-08T18:10:42.348086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:42.347898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:42.347898+0000","last_clean_scrub_stamp":"2024-05-08T18:10:42.347898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:57.794595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":312,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675088+0000","last_change":"2024-05-08T18:07:02.974897+0000","last_active":"2024-05-08T18:10:23.675088+0000","last_peered":"2024-05-08T18:10:23.675088+0000","last_clean":"2024-05-08T18:10:23.675088+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:10:23.675088+0000","last_undegraded":"2024-05-08T18:10:23.675088+0000","last_fullsized":"2024-05-08T18:10:23.675088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:01.799268+0000","last_clean_scrub_stamp":"2024-05-08T18:07:01.799268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007203+0000","last_change":"2024-05-08T18:07:09.431643+0000","last_active":"2024-05-08T18:10:23.007203+0000","last_peered":"2024-05-08T18:10:23.007203+0000","last_clean":"2024-05-08T18:10:23.007203+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:10:23.007203+0000","last_undegraded":"2024-05-08T18:10:23.007203+0000","last_fullsized":"2024-05-08T18:10:23.007203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"120'16","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.506936+0000","last_change":"2024-05-08T18:07:15.494969+0000","last_active":"2024-05-08T18:10:35.506936+0000","last_peered":"2024-05-08T18:10:35.506936+0000","last_clean":"2024-05-08T18:10:35.506936+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:10:35.506936+0000","last_undegraded":"2024-05-08T18:10:35.506936+0000","last_fullsized":"2024-05-08T18:10:35.506936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32780,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.840399+0000","last_change":"2024-05-08T18:10:45.840454+0000","last_active":"2024-05-08T18:10:45.840399+0000","last_peered":"2024-05-08T18:10:45.840399+0000","last_clean":"2024-05-08T18:10:45.840399+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:10:45.840399+0000","last_undegraded":"2024-05-08T18:10:45.840399+0000","last_fullsized":"2024-05-08T18:10:45.840399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:45.840208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:45.840208+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.840208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:42.136210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"120'36","reported_seq":257,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.458429+0000","last_change":"2024-05-08T18:07:21.538642+0000","last_active":"2024-05-08T18:10:35.458429+0000","last_peered":"2024-05-08T18:10:35.458429+0000","last_clean":"2024-05-08T18:10:35.458429+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:10:35.458429+0000","last_undegraded":"2024-05-08T18:10:35.458429+0000","last_fullsized":"2024-05-08T18:10:35.458429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":84,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:39.694970+0000","last_change":"2024-05-08T18:10:39.694996+0000","last_active":"2024-05-08T18:10:39.694970+0000","last_peered":"2024-05-08T18:10:39.694970+0000","last_clean":"2024-05-08T18:10:39.694970+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:10:39.694970+0000","last_undegraded":"2024-05-08T18:10:39.694970+0000","last_fullsized":"2024-05-08T18:10:39.694970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:39.694876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:39.694876+0000","last_clean_scrub_stamp":"2024-05-08T18:10:39.694876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:36.136416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.019812+0000","last_change":"2024-05-08T18:07:25.582429+0000","last_active":"2024-05-08T18:10:23.019812+0000","last_peered":"2024-05-08T18:10:23.019812+0000","last_clean":"2024-05-08T18:10:23.019812+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:10:23.019812+0000","last_undegraded":"2024-05-08T18:10:23.019812+0000","last_fullsized":"2024-05-08T18:10:23.019812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.634056+0000","last_change":"2024-05-08T18:10:50.634110+0000","last_active":"2024-05-08T18:10:50.634056+0000","last_peered":"2024-05-08T18:10:50.634056+0000","last_clean":"2024-05-08T18:10:50.634056+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:10:50.634056+0000","last_undegraded":"2024-05-08T18:10:50.634056+0000","last_fullsized":"2024-05-08T18:10:50.634056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:50.633857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:50.633857+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.633857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:52.571780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":216,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675559+0000","last_change":"2024-05-08T18:07:09.431225+0000","last_active":"2024-05-08T18:10:23.675559+0000","last_peered":"2024-05-08T18:10:23.675559+0000","last_clean":"2024-05-08T18:10:23.675559+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:10:23.675559+0000","last_undegraded":"2024-05-08T18:10:23.675559+0000","last_fullsized":"2024-05-08T18:10:23.675559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"120'18","reported_seq":237,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.506639+0000","last_change":"2024-05-08T18:07:15.490780+0000","last_active":"2024-05-08T18:10:35.506639+0000","last_peered":"2024-05-08T18:10:35.506639+0000","last_clean":"2024-05-08T18:10:35.506639+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:10:35.506639+0000","last_undegraded":"2024-05-08T18:10:35.506639+0000","last_fullsized":"2024-05-08T18:10:35.506639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":34834,"num_write":48,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:54.903726+0000","last_change":"2024-05-08T18:10:54.903784+0000","last_active":"2024-05-08T18:10:54.903726+0000","last_peered":"2024-05-08T18:10:54.903726+0000","last_clean":"2024-05-08T18:10:54.903726+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:10:54.903726+0000","last_undegraded":"2024-05-08T18:10:54.903726+0000","last_fullsized":"2024-05-08T18:10:54.903726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:54.903506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:54.903506+0000","last_clean_scrub_stamp":"2024-05-08T18:10:54.903506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:56.841429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"120'81","reported_seq":356,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.112502+0000","last_change":"2024-05-08T18:10:51.112665+0000","last_active":"2024-05-08T18:10:51.112502+0000","last_peered":"2024-05-08T18:10:51.112502+0000","last_clean":"2024-05-08T18:10:51.112502+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:10:51.112502+0000","last_undegraded":"2024-05-08T18:10:51.112502+0000","last_fullsized":"2024-05-08T18:10:51.112502+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'81","last_scrub_stamp":"2024-05-08T18:10:51.112295+0000","last_deep_scrub":"120'81","last_deep_scrub_stamp":"2024-05-08T18:10:51.112295+0000","last_clean_scrub_stamp":"2024-05-08T18:10:51.112295+0000","objects_scrubbed":10,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:30.802466+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":130,"num_read_kb":233,"num_write":84,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":194,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675035+0000","last_change":"2024-05-08T18:07:23.553881+0000","last_active":"2024-05-08T18:10:23.675035+0000","last_peered":"2024-05-08T18:10:23.675035+0000","last_clean":"2024-05-08T18:10:23.675035+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:10:23.675035+0000","last_undegraded":"2024-05-08T18:10:23.675035+0000","last_fullsized":"2024-05-08T18:10:23.675035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.248596+0000","last_change":"2024-05-08T18:07:25.654358+0000","last_active":"2024-05-08T18:10:24.248596+0000","last_peered":"2024-05-08T18:10:24.248596+0000","last_clean":"2024-05-08T18:10:24.248596+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:10:24.248596+0000","last_undegraded":"2024-05-08T18:10:24.248596+0000","last_fullsized":"2024-05-08T18:10:24.248596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"101'34","reported_seq":248,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.140672+0000","last_change":"2024-05-08T18:10:50.140737+0000","last_active":"2024-05-08T18:10:50.140672+0000","last_peered":"2024-05-08T18:10:50.140672+0000","last_clean":"2024-05-08T18:10:50.140672+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:10:50.140672+0000","last_undegraded":"2024-05-08T18:10:50.140672+0000","last_fullsized":"2024-05-08T18:10:50.140672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'34","last_scrub_stamp":"2024-05-08T18:10:50.140470+0000","last_deep_scrub":"101'34","last_deep_scrub_stamp":"2024-05-08T18:10:50.140470+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.140470+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:43.667675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:43.138228+0000","last_change":"2024-05-08T18:10:43.138289+0000","last_active":"2024-05-08T18:10:43.138228+0000","last_peered":"2024-05-08T18:10:43.138228+0000","last_clean":"2024-05-08T18:10:43.138228+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:10:43.138228+0000","last_undegraded":"2024-05-08T18:10:43.138228+0000","last_fullsized":"2024-05-08T18:10:43.138228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:43.138023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:43.138023+0000","last_clean_scrub_stamp":"2024-05-08T18:10:43.138023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:03.721891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"120'18","reported_seq":243,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:00.084179+0000","last_change":"2024-05-08T18:11:00.084257+0000","last_active":"2024-05-08T18:11:00.084179+0000","last_peered":"2024-05-08T18:11:00.084179+0000","last_clean":"2024-05-08T18:11:00.084179+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:11:00.084179+0000","last_undegraded":"2024-05-08T18:11:00.084179+0000","last_fullsized":"2024-05-08T18:11:00.084179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:11:00.083982+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:11:00.083982+0000","last_clean_scrub_stamp":"2024-05-08T18:11:00.083982+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:37.640499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":28678,"num_write":28,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"120'2","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.992993+0000","last_change":"2024-05-08T18:10:50.993068+0000","last_active":"2024-05-08T18:10:50.992993+0000","last_peered":"2024-05-08T18:10:50.992993+0000","last_clean":"2024-05-08T18:10:50.992993+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:10:50.992993+0000","last_undegraded":"2024-05-08T18:10:50.992993+0000","last_fullsized":"2024-05-08T18:10:50.992993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'2","last_scrub_stamp":"2024-05-08T18:10:50.992795+0000","last_deep_scrub":"120'2","last_deep_scrub_stamp":"2024-05-08T18:10:50.992795+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.992795+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:11:03.808140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"120'23","reported_seq":272,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:55.953009+0000","last_change":"2024-05-08T18:10:55.953097+0000","last_active":"2024-05-08T18:10:55.953009+0000","last_peered":"2024-05-08T18:10:55.953009+0000","last_clean":"2024-05-08T18:10:55.953009+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:10:55.953009+0000","last_undegraded":"2024-05-08T18:10:55.953009+0000","last_fullsized":"2024-05-08T18:10:55.953009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'23","last_scrub_stamp":"2024-05-08T18:10:55.952816+0000","last_deep_scrub":"120'23","last_deep_scrub_stamp":"2024-05-08T18:10:55.952816+0000","last_clean_scrub_stamp":"2024-05-08T18:10:55.952816+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:27:44.957338+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:41.697919+0000","last_change":"2024-05-08T18:10:41.697959+0000","last_active":"2024-05-08T18:10:41.697919+0000","last_peered":"2024-05-08T18:10:41.697919+0000","last_clean":"2024-05-08T18:10:41.697919+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:10:41.697919+0000","last_undegraded":"2024-05-08T18:10:41.697919+0000","last_fullsized":"2024-05-08T18:10:41.697919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:41.697770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:41.697770+0000","last_clean_scrub_stamp":"2024-05-08T18:10:41.697770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.224976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:44.647296+0000","last_change":"2024-05-08T18:10:44.647461+0000","last_active":"2024-05-08T18:10:44.647296+0000","last_peered":"2024-05-08T18:10:44.647296+0000","last_clean":"2024-05-08T18:10:44.647296+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:10:44.647296+0000","last_undegraded":"2024-05-08T18:10:44.647296+0000","last_fullsized":"2024-05-08T18:10:44.647296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:44.647052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:44.647052+0000","last_clean_scrub_stamp":"2024-05-08T18:10:44.647052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:35.598330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"90'6","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:48.108424+0000","last_change":"2024-05-08T18:10:48.108484+0000","last_active":"2024-05-08T18:10:48.108424+0000","last_peered":"2024-05-08T18:10:48.108424+0000","last_clean":"2024-05-08T18:10:48.108424+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:10:48.108424+0000","last_undegraded":"2024-05-08T18:10:48.108424+0000","last_fullsized":"2024-05-08T18:10:48.108424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-05-08T18:10:48.108173+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-05-08T18:10:48.108173+0000","last_clean_scrub_stamp":"2024-05-08T18:10:48.108173+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:44.549713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.007558+0000","last_change":"2024-05-08T18:07:09.429127+0000","last_active":"2024-05-08T18:10:23.007558+0000","last_peered":"2024-05-08T18:10:23.007558+0000","last_clean":"2024-05-08T18:10:23.007558+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:10:23.007558+0000","last_undegraded":"2024-05-08T18:10:23.007558+0000","last_fullsized":"2024-05-08T18:10:23.007558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"120'28","reported_seq":254,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.483941+0000","last_change":"2024-05-08T18:07:15.500536+0000","last_active":"2024-05-08T18:10:35.483941+0000","last_peered":"2024-05-08T18:10:35.483941+0000","last_clean":"2024-05-08T18:10:35.483941+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:10:35.483941+0000","last_undegraded":"2024-05-08T18:10:35.483941+0000","last_fullsized":"2024-05-08T18:10:35.483941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":55314,"num_write":58,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:52.620824+0000","last_change":"2024-05-08T18:10:52.620876+0000","last_active":"2024-05-08T18:10:52.620824+0000","last_peered":"2024-05-08T18:10:52.620824+0000","last_clean":"2024-05-08T18:10:52.620824+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:10:52.620824+0000","last_undegraded":"2024-05-08T18:10:52.620824+0000","last_fullsized":"2024-05-08T18:10:52.620824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:52.620633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:52.620633+0000","last_clean_scrub_stamp":"2024-05-08T18:10:52.620633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:49.130797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"120'18","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.673713+0000","last_change":"2024-05-08T18:10:49.673808+0000","last_active":"2024-05-08T18:10:49.673713+0000","last_peered":"2024-05-08T18:10:49.673713+0000","last_clean":"2024-05-08T18:10:49.673713+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:10:49.673713+0000","last_undegraded":"2024-05-08T18:10:49.673713+0000","last_fullsized":"2024-05-08T18:10:49.673713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:10:49.673510+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:10:49.673510+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.673510+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:47.685064+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.022480+0000","last_change":"2024-05-08T18:07:23.563072+0000","last_active":"2024-05-08T18:10:23.022480+0000","last_peered":"2024-05-08T18:10:23.022480+0000","last_clean":"2024-05-08T18:10:23.022480+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:10:23.022480+0000","last_undegraded":"2024-05-08T18:10:23.022480+0000","last_fullsized":"2024-05-08T18:10:23.022480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.005688+0000","last_change":"2024-05-08T18:07:25.574613+0000","last_active":"2024-05-08T18:10:23.005688+0000","last_peered":"2024-05-08T18:10:23.005688+0000","last_clean":"2024-05-08T18:10:23.005688+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:10:23.005688+0000","last_undegraded":"2024-05-08T18:10:23.005688+0000","last_fullsized":"2024-05-08T18:10:23.005688+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'10","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:52.124026+0000","last_change":"2024-05-08T18:10:52.124191+0000","last_active":"2024-05-08T18:10:52.124026+0000","last_peered":"2024-05-08T18:10:52.124026+0000","last_clean":"2024-05-08T18:10:52.124026+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:10:52.124026+0000","last_undegraded":"2024-05-08T18:10:52.124026+0000","last_fullsized":"2024-05-08T18:10:52.124026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'10","last_scrub_stamp":"2024-05-08T18:10:52.123792+0000","last_deep_scrub":"90'10","last_deep_scrub_stamp":"2024-05-08T18:10:52.123792+0000","last_clean_scrub_stamp":"2024-05-08T18:10:52.123792+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:46.984693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"120'14","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.538595+0000","last_change":"2024-05-08T18:07:15.477654+0000","last_active":"2024-05-08T18:10:35.538595+0000","last_peered":"2024-05-08T18:10:35.538595+0000","last_clean":"2024-05-08T18:10:35.538595+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:10:35.538595+0000","last_undegraded":"2024-05-08T18:10:35.538595+0000","last_fullsized":"2024-05-08T18:10:35.538595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":22528,"num_write":14,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.119701+0000","last_change":"2024-05-08T18:10:56.119757+0000","last_active":"2024-05-08T18:10:56.119701+0000","last_peered":"2024-05-08T18:10:56.119701+0000","last_clean":"2024-05-08T18:10:56.119701+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:10:56.119701+0000","last_undegraded":"2024-05-08T18:10:56.119701+0000","last_fullsized":"2024-05-08T18:10:56.119701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:56.119502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:56.119502+0000","last_clean_scrub_stamp":"2024-05-08T18:10:56.119502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:47.070779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.552272+0000","last_change":"2024-05-08T18:10:56.552364+0000","last_active":"2024-05-08T18:10:56.552272+0000","last_peered":"2024-05-08T18:10:56.552272+0000","last_clean":"2024-05-08T18:10:56.552272+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:10:56.552272+0000","last_undegraded":"2024-05-08T18:10:56.552272+0000","last_fullsized":"2024-05-08T18:10:56.552272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:56.552062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:56.552062+0000","last_clean_scrub_stamp":"2024-05-08T18:10:56.552062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:20.119295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"120'40","reported_seq":257,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.290937+0000","last_change":"2024-05-08T18:07:21.545502+0000","last_active":"2024-05-08T18:10:35.290937+0000","last_peered":"2024-05-08T18:10:35.290937+0000","last_clean":"2024-05-08T18:10:35.290937+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:10:35.290937+0000","last_undegraded":"2024-05-08T18:10:35.290937+0000","last_fullsized":"2024-05-08T18:10:35.290937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":72,"num_read_kb":104,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748393+0000","last_change":"2024-05-08T18:07:23.546639+0000","last_active":"2024-05-08T18:10:23.748393+0000","last_peered":"2024-05-08T18:10:23.748393+0000","last_clean":"2024-05-08T18:10:23.748393+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:10:23.748393+0000","last_undegraded":"2024-05-08T18:10:23.748393+0000","last_fullsized":"2024-05-08T18:10:23.748393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"90'2","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016210+0000","last_change":"2024-05-08T18:07:25.658274+0000","last_active":"2024-05-08T18:10:23.016210+0000","last_peered":"2024-05-08T18:10:23.016210+0000","last_clean":"2024-05-08T18:10:23.016210+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:10:23.016210+0000","last_undegraded":"2024-05-08T18:10:23.016210+0000","last_fullsized":"2024-05-08T18:10:23.016210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"101'42","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:48.610164+0000","last_change":"2024-05-08T18:10:48.610229+0000","last_active":"2024-05-08T18:10:48.610164+0000","last_peered":"2024-05-08T18:10:48.610164+0000","last_clean":"2024-05-08T18:10:48.610164+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:10:48.610164+0000","last_undegraded":"2024-05-08T18:10:48.610164+0000","last_fullsized":"2024-05-08T18:10:48.610164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'42","last_scrub_stamp":"2024-05-08T18:10:48.609963+0000","last_deep_scrub":"101'42","last_deep_scrub_stamp":"2024-05-08T18:10:48.609963+0000","last_clean_scrub_stamp":"2024-05-08T18:10:48.609963+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:27.816221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"120'18","reported_seq":244,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.034924+0000","last_change":"2024-05-08T18:10:59.034994+0000","last_active":"2024-05-08T18:10:59.034924+0000","last_peered":"2024-05-08T18:10:59.034924+0000","last_clean":"2024-05-08T18:10:59.034924+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:10:59.034924+0000","last_undegraded":"2024-05-08T18:10:59.034924+0000","last_fullsized":"2024-05-08T18:10:59.034924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:10:59.034708+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:10:59.034708+0000","last_clean_scrub_stamp":"2024-05-08T18:10:59.034708+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:00.972632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":216,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676699+0000","last_change":"2024-05-08T18:07:09.435618+0000","last_active":"2024-05-08T18:10:23.676699+0000","last_peered":"2024-05-08T18:10:23.676699+0000","last_clean":"2024-05-08T18:10:23.676699+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:10:23.676699+0000","last_undegraded":"2024-05-08T18:10:23.676699+0000","last_fullsized":"2024-05-08T18:10:23.676699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:08.398607+0000","last_clean_scrub_stamp":"2024-05-08T18:07:08.398607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":206,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:43.304395+0000","last_change":"2024-05-08T18:10:43.304449+0000","last_active":"2024-05-08T18:10:43.304395+0000","last_peered":"2024-05-08T18:10:43.304395+0000","last_clean":"2024-05-08T18:10:43.304395+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:10:43.304395+0000","last_undegraded":"2024-05-08T18:10:43.304395+0000","last_fullsized":"2024-05-08T18:10:43.304395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:43.304196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:43.304196+0000","last_clean_scrub_stamp":"2024-05-08T18:10:43.304196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:32.179673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"120'21","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.165427+0000","last_change":"2024-05-08T18:10:47.165506+0000","last_active":"2024-05-08T18:10:47.165427+0000","last_peered":"2024-05-08T18:10:47.165427+0000","last_clean":"2024-05-08T18:10:47.165427+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:10:47.165427+0000","last_undegraded":"2024-05-08T18:10:47.165427+0000","last_fullsized":"2024-05-08T18:10:47.165427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'21","last_scrub_stamp":"2024-05-08T18:10:47.165223+0000","last_deep_scrub":"120'21","last_deep_scrub_stamp":"2024-05-08T18:10:47.165223+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.165223+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:43.461225+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"120'18","reported_seq":246,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.602388+0000","last_change":"2024-05-08T18:07:23.550067+0000","last_active":"2024-05-08T18:10:35.602388+0000","last_peered":"2024-05-08T18:10:35.602388+0000","last_clean":"2024-05-08T18:10:35.602388+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:10:35.602388+0000","last_undegraded":"2024-05-08T18:10:35.602388+0000","last_fullsized":"2024-05-08T18:10:35.602388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"101'4","reported_seq":196,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013018+0000","last_change":"2024-05-08T18:07:25.654042+0000","last_active":"2024-05-08T18:10:23.013018+0000","last_peered":"2024-05-08T18:10:23.013018+0000","last_clean":"2024-05-08T18:10:23.013018+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:10:23.013018+0000","last_undegraded":"2024-05-08T18:10:23.013018+0000","last_fullsized":"2024-05-08T18:10:23.013018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:55.622485+0000","last_change":"2024-05-08T18:10:55.622539+0000","last_active":"2024-05-08T18:10:55.622485+0000","last_peered":"2024-05-08T18:10:55.622485+0000","last_clean":"2024-05-08T18:10:55.622485+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:10:55.622485+0000","last_undegraded":"2024-05-08T18:10:55.622485+0000","last_fullsized":"2024-05-08T18:10:55.622485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:55.622289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:55.622289+0000","last_clean_scrub_stamp":"2024-05-08T18:10:55.622289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:10:12.808947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"120'18","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.507957+0000","last_change":"2024-05-08T18:07:15.508489+0000","last_active":"2024-05-08T18:10:35.507957+0000","last_peered":"2024-05-08T18:10:35.507957+0000","last_clean":"2024-05-08T18:10:35.507957+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:10:35.507957+0000","last_undegraded":"2024-05-08T18:10:35.507957+0000","last_fullsized":"2024-05-08T18:10:35.507957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32774,"num_write":28,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:55.133292+0000","last_change":"2024-05-08T18:10:55.133344+0000","last_active":"2024-05-08T18:10:55.133292+0000","last_peered":"2024-05-08T18:10:55.133292+0000","last_clean":"2024-05-08T18:10:55.133292+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:10:55.133292+0000","last_undegraded":"2024-05-08T18:10:55.133292+0000","last_fullsized":"2024-05-08T18:10:55.133292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:55.133101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:55.133101+0000","last_clean_scrub_stamp":"2024-05-08T18:10:55.133101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:41.641093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:53.752564+0000","last_change":"2024-05-08T18:10:53.752668+0000","last_active":"2024-05-08T18:10:53.752564+0000","last_peered":"2024-05-08T18:10:53.752564+0000","last_clean":"2024-05-08T18:10:53.752564+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:10:53.752564+0000","last_undegraded":"2024-05-08T18:10:53.752564+0000","last_fullsized":"2024-05-08T18:10:53.752564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:53.752242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:53.752242+0000","last_clean_scrub_stamp":"2024-05-08T18:10:53.752242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:53.589599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749543+0000","last_change":"2024-05-08T18:07:21.548122+0000","last_active":"2024-05-08T18:10:23.749543+0000","last_peered":"2024-05-08T18:10:23.749543+0000","last_clean":"2024-05-08T18:10:23.749543+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:10:23.749543+0000","last_undegraded":"2024-05-08T18:10:23.749543+0000","last_fullsized":"2024-05-08T18:10:23.749543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"120'18","reported_seq":273,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:40.714243+0000","last_change":"2024-05-08T18:10:40.714283+0000","last_active":"2024-05-08T18:10:40.714243+0000","last_peered":"2024-05-08T18:10:40.714243+0000","last_clean":"2024-05-08T18:10:40.714243+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:10:40.714243+0000","last_undegraded":"2024-05-08T18:10:40.714243+0000","last_fullsized":"2024-05-08T18:10:40.714243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:10:40.714154+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:10:40.714154+0000","last_clean_scrub_stamp":"2024-05-08T18:10:40.714154+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:03.975309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016053+0000","last_change":"2024-05-08T18:07:25.566464+0000","last_active":"2024-05-08T18:10:23.016053+0000","last_peered":"2024-05-08T18:10:23.016053+0000","last_clean":"2024-05-08T18:10:23.016053+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:10:23.016053+0000","last_undegraded":"2024-05-08T18:10:23.016053+0000","last_fullsized":"2024-05-08T18:10:23.016053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:54.716189+0000","last_change":"2024-05-08T18:10:54.716247+0000","last_active":"2024-05-08T18:10:54.716189+0000","last_peered":"2024-05-08T18:10:54.716189+0000","last_clean":"2024-05-08T18:10:54.716189+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:10:54.716189+0000","last_undegraded":"2024-05-08T18:10:54.716189+0000","last_fullsized":"2024-05-08T18:10:54.716189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:54.715997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:54.715997+0000","last_clean_scrub_stamp":"2024-05-08T18:10:54.715997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:56.653920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"120'22","reported_seq":246,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.435525+0000","last_change":"2024-05-08T18:07:15.498984+0000","last_active":"2024-05-08T18:10:35.435525+0000","last_peered":"2024-05-08T18:10:35.435525+0000","last_clean":"2024-05-08T18:10:35.435525+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:10:35.435525+0000","last_undegraded":"2024-05-08T18:10:35.435525+0000","last_fullsized":"2024-05-08T18:10:35.435525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":40996,"num_write":82,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.301961+0000","last_change":"2024-05-08T18:10:51.302073+0000","last_active":"2024-05-08T18:10:51.301961+0000","last_peered":"2024-05-08T18:10:51.301961+0000","last_clean":"2024-05-08T18:10:51.301961+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:10:51.301961+0000","last_undegraded":"2024-05-08T18:10:51.301961+0000","last_fullsized":"2024-05-08T18:10:51.301961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:51.301730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:51.301730+0000","last_clean_scrub_stamp":"2024-05-08T18:10:51.301730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:42.506018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:54.658500+0000","last_change":"2024-05-08T18:10:54.658560+0000","last_active":"2024-05-08T18:10:54.658500+0000","last_peered":"2024-05-08T18:10:54.658500+0000","last_clean":"2024-05-08T18:10:54.658500+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:10:54.658500+0000","last_undegraded":"2024-05-08T18:10:54.658500+0000","last_fullsized":"2024-05-08T18:10:54.658500+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:54.658256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:54.658256+0000","last_clean_scrub_stamp":"2024-05-08T18:10:54.658256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:47.419080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"120'59","reported_seq":294,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:42.811402+0000","last_change":"2024-05-08T18:10:42.811545+0000","last_active":"2024-05-08T18:10:42.811402+0000","last_peered":"2024-05-08T18:10:42.811402+0000","last_clean":"2024-05-08T18:10:42.811402+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:10:42.811402+0000","last_undegraded":"2024-05-08T18:10:42.811402+0000","last_fullsized":"2024-05-08T18:10:42.811402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'59","last_scrub_stamp":"2024-05-08T18:10:42.811173+0000","last_deep_scrub":"120'59","last_deep_scrub_stamp":"2024-05-08T18:10:42.811173+0000","last_clean_scrub_stamp":"2024-05-08T18:10:42.811173+0000","objects_scrubbed":8,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:58:31.066154+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":100,"num_read_kb":182,"num_write":68,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.628667+0000","last_change":"2024-05-08T18:10:45.628728+0000","last_active":"2024-05-08T18:10:45.628667+0000","last_peered":"2024-05-08T18:10:45.628667+0000","last_clean":"2024-05-08T18:10:45.628667+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:10:45.628667+0000","last_undegraded":"2024-05-08T18:10:45.628667+0000","last_fullsized":"2024-05-08T18:10:45.628667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:45.628470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:45.628470+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.628470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:27:34.632992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006902+0000","last_change":"2024-05-08T18:07:25.580653+0000","last_active":"2024-05-08T18:10:23.006902+0000","last_peered":"2024-05-08T18:10:23.006902+0000","last_clean":"2024-05-08T18:10:23.006902+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:10:23.006902+0000","last_undegraded":"2024-05-08T18:10:23.006902+0000","last_fullsized":"2024-05-08T18:10:23.006902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.016597+0000","last_change":"2024-05-08T18:07:25.582055+0000","last_active":"2024-05-08T18:10:23.016597+0000","last_peered":"2024-05-08T18:10:23.016597+0000","last_clean":"2024-05-08T18:10:23.016597+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:10:23.016597+0000","last_undegraded":"2024-05-08T18:10:23.016597+0000","last_fullsized":"2024-05-08T18:10:23.016597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"101'34","reported_seq":250,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.802940+0000","last_change":"2024-05-08T18:10:47.803077+0000","last_active":"2024-05-08T18:10:47.802940+0000","last_peered":"2024-05-08T18:10:47.802940+0000","last_clean":"2024-05-08T18:10:47.802940+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:10:47.802940+0000","last_undegraded":"2024-05-08T18:10:47.802940+0000","last_fullsized":"2024-05-08T18:10:47.802940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'34","last_scrub_stamp":"2024-05-08T18:10:47.802675+0000","last_deep_scrub":"101'34","last_deep_scrub_stamp":"2024-05-08T18:10:47.802675+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.802675+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:27.492846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"120'10","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.547727+0000","last_change":"2024-05-08T18:07:15.513555+0000","last_active":"2024-05-08T18:10:35.547727+0000","last_peered":"2024-05-08T18:10:35.547727+0000","last_clean":"2024-05-08T18:10:35.547727+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:10:35.547727+0000","last_undegraded":"2024-05-08T18:10:35.547727+0000","last_fullsized":"2024-05-08T18:10:35.547727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":18438,"num_write":20,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:43.189403+0000","last_change":"2024-05-08T18:10:43.189513+0000","last_active":"2024-05-08T18:10:43.189403+0000","last_peered":"2024-05-08T18:10:43.189403+0000","last_clean":"2024-05-08T18:10:43.189403+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:10:43.189403+0000","last_undegraded":"2024-05-08T18:10:43.189403+0000","last_fullsized":"2024-05-08T18:10:43.189403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:43.189176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:43.189176+0000","last_clean_scrub_stamp":"2024-05-08T18:10:43.189176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:34.393464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"120'22","reported_seq":232,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.511521+0000","last_change":"2024-05-08T18:07:21.542286+0000","last_active":"2024-05-08T18:10:35.511521+0000","last_peered":"2024-05-08T18:10:35.511521+0000","last_clean":"2024-05-08T18:10:35.511521+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:10:35.511521+0000","last_undegraded":"2024-05-08T18:10:35.511521+0000","last_fullsized":"2024-05-08T18:10:35.511521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":64,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:42.737564+0000","last_change":"2024-05-08T18:10:42.737622+0000","last_active":"2024-05-08T18:10:42.737564+0000","last_peered":"2024-05-08T18:10:42.737564+0000","last_clean":"2024-05-08T18:10:42.737564+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:10:42.737564+0000","last_undegraded":"2024-05-08T18:10:42.737564+0000","last_fullsized":"2024-05-08T18:10:42.737564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:42.737373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:42.737373+0000","last_clean_scrub_stamp":"2024-05-08T18:10:42.737373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:30.981538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:48.617400+0000","last_change":"2024-05-08T18:10:48.617458+0000","last_active":"2024-05-08T18:10:48.617400+0000","last_peered":"2024-05-08T18:10:48.617400+0000","last_clean":"2024-05-08T18:10:48.617400+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:10:48.617400+0000","last_undegraded":"2024-05-08T18:10:48.617400+0000","last_fullsized":"2024-05-08T18:10:48.617400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:48.617200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:48.617200+0000","last_clean_scrub_stamp":"2024-05-08T18:10:48.617200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:09.818307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:42.198774+0000","last_change":"2024-05-08T18:10:42.198795+0000","last_active":"2024-05-08T18:10:42.198774+0000","last_peered":"2024-05-08T18:10:42.198774+0000","last_clean":"2024-05-08T18:10:42.198774+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:10:42.198774+0000","last_undegraded":"2024-05-08T18:10:42.198774+0000","last_fullsized":"2024-05-08T18:10:42.198774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:42.198695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:42.198695+0000","last_clean_scrub_stamp":"2024-05-08T18:10:42.198695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:53:40.462523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"120'24","reported_seq":250,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.576667+0000","last_change":"2024-05-08T18:07:15.508391+0000","last_active":"2024-05-08T18:10:35.576667+0000","last_peered":"2024-05-08T18:10:35.576667+0000","last_clean":"2024-05-08T18:10:35.576667+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:10:35.576667+0000","last_undegraded":"2024-05-08T18:10:35.576667+0000","last_fullsized":"2024-05-08T18:10:35.576667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":47128,"num_write":64,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012483+0000","last_change":"2024-05-08T18:07:19.538421+0000","last_active":"2024-05-08T18:10:23.012483+0000","last_peered":"2024-05-08T18:10:23.012483+0000","last_clean":"2024-05-08T18:10:23.012483+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:10:23.012483+0000","last_undegraded":"2024-05-08T18:10:23.012483+0000","last_fullsized":"2024-05-08T18:10:23.012483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"48'5","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015385+0000","last_change":"2024-05-08T18:07:21.547586+0000","last_active":"2024-05-08T18:10:23.015385+0000","last_peered":"2024-05-08T18:10:23.015385+0000","last_clean":"2024-05-08T18:10:23.015385+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:10:23.015385+0000","last_undegraded":"2024-05-08T18:10:23.015385+0000","last_fullsized":"2024-05-08T18:10:23.015385+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":194,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.674279+0000","last_change":"2024-05-08T18:07:23.558519+0000","last_active":"2024-05-08T18:10:23.674279+0000","last_peered":"2024-05-08T18:10:23.674279+0000","last_clean":"2024-05-08T18:10:23.674279+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:10:23.674279+0000","last_undegraded":"2024-05-08T18:10:23.674279+0000","last_fullsized":"2024-05-08T18:10:23.674279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"90'2","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.015955+0000","last_change":"2024-05-08T18:07:25.563698+0000","last_active":"2024-05-08T18:10:23.015955+0000","last_peered":"2024-05-08T18:10:23.015955+0000","last_clean":"2024-05-08T18:10:23.015955+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:10:23.015955+0000","last_undegraded":"2024-05-08T18:10:23.015955+0000","last_fullsized":"2024-05-08T18:10:23.015955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.621439+0000","last_change":"2024-05-08T18:10:51.621494+0000","last_active":"2024-05-08T18:10:51.621439+0000","last_peered":"2024-05-08T18:10:51.621439+0000","last_clean":"2024-05-08T18:10:51.621439+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:10:51.621439+0000","last_undegraded":"2024-05-08T18:10:51.621439+0000","last_fullsized":"2024-05-08T18:10:51.621439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:51.621249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:51.621249+0000","last_clean_scrub_stamp":"2024-05-08T18:10:51.621249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:11.645771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"120'24","reported_seq":254,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:55.909564+0000","last_change":"2024-05-08T18:10:55.909625+0000","last_active":"2024-05-08T18:10:55.909564+0000","last_peered":"2024-05-08T18:10:55.909564+0000","last_clean":"2024-05-08T18:10:55.909564+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:10:55.909564+0000","last_undegraded":"2024-05-08T18:10:55.909564+0000","last_fullsized":"2024-05-08T18:10:55.909564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'24","last_scrub_stamp":"2024-05-08T18:10:55.909373+0000","last_deep_scrub":"120'24","last_deep_scrub_stamp":"2024-05-08T18:10:55.909373+0000","last_clean_scrub_stamp":"2024-05-08T18:10:55.909373+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:33.465890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":47122,"num_write":54,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.881814+0000","last_change":"2024-05-08T18:10:49.881874+0000","last_active":"2024-05-08T18:10:49.881814+0000","last_peered":"2024-05-08T18:10:49.881814+0000","last_clean":"2024-05-08T18:10:49.881814+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:10:49.881814+0000","last_undegraded":"2024-05-08T18:10:49.881814+0000","last_fullsized":"2024-05-08T18:10:49.881814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:49.881604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:49.881604+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.881604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:56.224174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"120'20","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.258739+0000","last_change":"2024-05-08T18:07:21.544328+0000","last_active":"2024-05-08T18:10:35.258739+0000","last_peered":"2024-05-08T18:10:35.258739+0000","last_clean":"2024-05-08T18:10:35.258739+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:10:35.258739+0000","last_undegraded":"2024-05-08T18:10:35.258739+0000","last_fullsized":"2024-05-08T18:10:35.258739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":42,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020799+0000","last_change":"2024-05-08T18:07:23.557856+0000","last_active":"2024-05-08T18:10:23.020799+0000","last_peered":"2024-05-08T18:10:23.020799+0000","last_clean":"2024-05-08T18:10:23.020799+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:10:23.020799+0000","last_undegraded":"2024-05-08T18:10:23.020799+0000","last_fullsized":"2024-05-08T18:10:23.020799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006687+0000","last_change":"2024-05-08T18:07:25.583470+0000","last_active":"2024-05-08T18:10:23.006687+0000","last_peered":"2024-05-08T18:10:23.006687+0000","last_clean":"2024-05-08T18:10:23.006687+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:10:23.006687+0000","last_undegraded":"2024-05-08T18:10:23.006687+0000","last_fullsized":"2024-05-08T18:10:23.006687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009310+0000","last_change":"2024-05-08T18:07:55.359230+0000","last_active":"2024-05-08T18:10:23.009310+0000","last_peered":"2024-05-08T18:10:23.009310+0000","last_clean":"2024-05-08T18:10:23.009310+0000","last_became_active":"2024-05-08T18:07:55.358047+0000","last_became_peered":"2024-05-08T18:07:55.358047+0000","last_unstale":"2024-05-08T18:10:23.009310+0000","last_undegraded":"2024-05-08T18:10:23.009310+0000","last_fullsized":"2024-05-08T18:10:23.009310+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"120'18","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.567914+0000","last_change":"2024-05-08T18:07:15.498033+0000","last_active":"2024-05-08T18:10:35.567914+0000","last_peered":"2024-05-08T18:10:35.567914+0000","last_clean":"2024-05-08T18:10:35.567914+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:10:35.567914+0000","last_undegraded":"2024-05-08T18:10:35.567914+0000","last_fullsized":"2024-05-08T18:10:35.567914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32780,"num_write":38,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":206,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.263084+0000","last_change":"2024-05-08T18:10:45.263141+0000","last_active":"2024-05-08T18:10:45.263084+0000","last_peered":"2024-05-08T18:10:45.263084+0000","last_clean":"2024-05-08T18:10:45.263084+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:10:45.263084+0000","last_undegraded":"2024-05-08T18:10:45.263084+0000","last_fullsized":"2024-05-08T18:10:45.263084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:45.262891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:45.262891+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.262891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:52.219520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"120'22","reported_seq":239,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:53.953520+0000","last_change":"2024-05-08T18:10:53.953594+0000","last_active":"2024-05-08T18:10:53.953520+0000","last_peered":"2024-05-08T18:10:53.953520+0000","last_clean":"2024-05-08T18:10:53.953520+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:10:53.953520+0000","last_undegraded":"2024-05-08T18:10:53.953520+0000","last_fullsized":"2024-05-08T18:10:53.953520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'22","last_scrub_stamp":"2024-05-08T18:10:53.953336+0000","last_deep_scrub":"120'22","last_deep_scrub_stamp":"2024-05-08T18:10:53.953336+0000","last_clean_scrub_stamp":"2024-05-08T18:10:53.953336+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:40.461328+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":57,"num_write":22,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:42.681449+0000","last_change":"2024-05-08T18:10:42.681510+0000","last_active":"2024-05-08T18:10:42.681449+0000","last_peered":"2024-05-08T18:10:42.681449+0000","last_clean":"2024-05-08T18:10:42.681449+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:10:42.681449+0000","last_undegraded":"2024-05-08T18:10:42.681449+0000","last_fullsized":"2024-05-08T18:10:42.681449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:42.681220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:42.681220+0000","last_clean_scrub_stamp":"2024-05-08T18:10:42.681220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:22.371391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.295388+0000","last_change":"2024-05-08T18:10:46.295488+0000","last_active":"2024-05-08T18:10:46.295388+0000","last_peered":"2024-05-08T18:10:46.295388+0000","last_clean":"2024-05-08T18:10:46.295388+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:10:46.295388+0000","last_undegraded":"2024-05-08T18:10:46.295388+0000","last_fullsized":"2024-05-08T18:10:46.295388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:46.295155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:46.295155+0000","last_clean_scrub_stamp":"2024-05-08T18:10:46.295155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:10:59.110500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"120'18","reported_seq":239,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.593072+0000","last_change":"2024-05-08T18:07:15.491415+0000","last_active":"2024-05-08T18:10:35.593072+0000","last_peered":"2024-05-08T18:10:35.593072+0000","last_clean":"2024-05-08T18:10:35.593072+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:10:35.593072+0000","last_undegraded":"2024-05-08T18:10:35.593072+0000","last_fullsized":"2024-05-08T18:10:35.593072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"120'2","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:54.578278+0000","last_change":"2024-05-08T18:10:54.578340+0000","last_active":"2024-05-08T18:10:54.578278+0000","last_peered":"2024-05-08T18:10:54.578278+0000","last_clean":"2024-05-08T18:10:54.578278+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:10:54.578278+0000","last_undegraded":"2024-05-08T18:10:54.578278+0000","last_fullsized":"2024-05-08T18:10:54.578278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'2","last_scrub_stamp":"2024-05-08T18:10:54.578075+0000","last_deep_scrub":"120'2","last_deep_scrub_stamp":"2024-05-08T18:10:54.578075+0000","last_clean_scrub_stamp":"2024-05-08T18:10:54.578075+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:54.231297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"120'35","reported_seq":257,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.147306+0000","last_change":"2024-05-08T18:10:49.147382+0000","last_active":"2024-05-08T18:10:49.147306+0000","last_peered":"2024-05-08T18:10:49.147306+0000","last_clean":"2024-05-08T18:10:49.147306+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:10:49.147306+0000","last_undegraded":"2024-05-08T18:10:49.147306+0000","last_fullsized":"2024-05-08T18:10:49.147306+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'35","last_scrub_stamp":"2024-05-08T18:10:49.147125+0000","last_deep_scrub":"120'35","last_deep_scrub_stamp":"2024-05-08T18:10:49.147125+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.147125+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:28:12.661503+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":59,"num_read_kb":88,"num_write":38,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:43.051970+0000","last_change":"2024-05-08T18:10:43.052027+0000","last_active":"2024-05-08T18:10:43.051970+0000","last_peered":"2024-05-08T18:10:43.051970+0000","last_clean":"2024-05-08T18:10:43.051970+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:10:43.051970+0000","last_undegraded":"2024-05-08T18:10:43.051970+0000","last_fullsized":"2024-05-08T18:10:43.051970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:43.051770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:43.051770+0000","last_clean_scrub_stamp":"2024-05-08T18:10:43.051770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:39.347772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.011291+0000","last_change":"2024-05-08T18:07:25.653712+0000","last_active":"2024-05-08T18:10:23.011291+0000","last_peered":"2024-05-08T18:10:23.011291+0000","last_clean":"2024-05-08T18:10:23.011291+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:10:23.011291+0000","last_undegraded":"2024-05-08T18:10:23.011291+0000","last_fullsized":"2024-05-08T18:10:23.011291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.573972+0000","last_change":"2024-05-08T18:10:47.574130+0000","last_active":"2024-05-08T18:10:47.573972+0000","last_peered":"2024-05-08T18:10:47.573972+0000","last_clean":"2024-05-08T18:10:47.573972+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:10:47.573972+0000","last_undegraded":"2024-05-08T18:10:47.573972+0000","last_fullsized":"2024-05-08T18:10:47.573972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:47.573733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:47.573733+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.573733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:38.525011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"120'6","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.092911+0000","last_change":"2024-05-08T18:10:57.092978+0000","last_active":"2024-05-08T18:10:57.092911+0000","last_peered":"2024-05-08T18:10:57.092911+0000","last_clean":"2024-05-08T18:10:57.092911+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:10:57.092911+0000","last_undegraded":"2024-05-08T18:10:57.092911+0000","last_fullsized":"2024-05-08T18:10:57.092911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'6","last_scrub_stamp":"2024-05-08T18:10:57.092694+0000","last_deep_scrub":"120'6","last_deep_scrub_stamp":"2024-05-08T18:10:57.092694+0000","last_clean_scrub_stamp":"2024-05-08T18:10:57.092694+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:36.298953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.299953+0000","last_change":"2024-05-08T18:10:47.300006+0000","last_active":"2024-05-08T18:10:47.299953+0000","last_peered":"2024-05-08T18:10:47.299953+0000","last_clean":"2024-05-08T18:10:47.299953+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:10:47.299953+0000","last_undegraded":"2024-05-08T18:10:47.299953+0000","last_fullsized":"2024-05-08T18:10:47.299953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:47.299766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:47.299766+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.299766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:40.714453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"120'28","reported_seq":248,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:41.858994+0000","last_change":"2024-05-08T18:10:41.859077+0000","last_active":"2024-05-08T18:10:41.858994+0000","last_peered":"2024-05-08T18:10:41.858994+0000","last_clean":"2024-05-08T18:10:41.858994+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:10:41.858994+0000","last_undegraded":"2024-05-08T18:10:41.858994+0000","last_fullsized":"2024-05-08T18:10:41.858994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'28","last_scrub_stamp":"2024-05-08T18:10:41.858807+0000","last_deep_scrub":"120'28","last_deep_scrub_stamp":"2024-05-08T18:10:41.858807+0000","last_clean_scrub_stamp":"2024-05-08T18:10:41.858807+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:00.706502+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.252520+0000","last_change":"2024-05-08T18:07:23.563906+0000","last_active":"2024-05-08T18:10:24.252520+0000","last_peered":"2024-05-08T18:10:24.252520+0000","last_clean":"2024-05-08T18:10:24.252520+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:10:24.252520+0000","last_undegraded":"2024-05-08T18:10:24.252520+0000","last_fullsized":"2024-05-08T18:10:24.252520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.020336+0000","last_change":"2024-05-08T18:07:25.568484+0000","last_active":"2024-05-08T18:10:23.020336+0000","last_peered":"2024-05-08T18:10:23.020336+0000","last_clean":"2024-05-08T18:10:23.020336+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:10:23.020336+0000","last_undegraded":"2024-05-08T18:10:23.020336+0000","last_fullsized":"2024-05-08T18:10:23.020336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":206,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.012364+0000","last_change":"2024-05-08T18:07:17.499751+0000","last_active":"2024-05-08T18:10:23.012364+0000","last_peered":"2024-05-08T18:10:23.012364+0000","last_clean":"2024-05-08T18:10:23.012364+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:10:23.012364+0000","last_undegraded":"2024-05-08T18:10:23.012364+0000","last_fullsized":"2024-05-08T18:10:23.012364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"120'10","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.310708+0000","last_change":"2024-05-08T18:07:15.478324+0000","last_active":"2024-05-08T18:10:35.310708+0000","last_peered":"2024-05-08T18:10:35.310708+0000","last_clean":"2024-05-08T18:10:35.310708+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:10:35.310708+0000","last_undegraded":"2024-05-08T18:10:35.310708+0000","last_fullsized":"2024-05-08T18:10:35.310708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":18438,"num_write":20,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:55.709148+0000","last_change":"2024-05-08T18:10:55.709206+0000","last_active":"2024-05-08T18:10:55.709148+0000","last_peered":"2024-05-08T18:10:55.709148+0000","last_clean":"2024-05-08T18:10:55.709148+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:10:55.709148+0000","last_undegraded":"2024-05-08T18:10:55.709148+0000","last_fullsized":"2024-05-08T18:10:55.709148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:55.708944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:55.708944+0000","last_clean_scrub_stamp":"2024-05-08T18:10:55.708944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:53.942850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"120'19","reported_seq":229,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.584635+0000","last_change":"2024-05-08T18:07:21.536542+0000","last_active":"2024-05-08T18:10:35.584635+0000","last_peered":"2024-05-08T18:10:35.584635+0000","last_clean":"2024-05-08T18:10:35.584635+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:10:35.584635+0000","last_undegraded":"2024-05-08T18:10:35.584635+0000","last_fullsized":"2024-05-08T18:10:35.584635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":37,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:24.247353+0000","last_change":"2024-05-08T18:07:23.551403+0000","last_active":"2024-05-08T18:10:24.247353+0000","last_peered":"2024-05-08T18:10:24.247353+0000","last_clean":"2024-05-08T18:10:24.247353+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:10:24.247353+0000","last_undegraded":"2024-05-08T18:10:24.247353+0000","last_fullsized":"2024-05-08T18:10:24.247353+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006076+0000","last_change":"2024-05-08T18:07:25.572710+0000","last_active":"2024-05-08T18:10:23.006076+0000","last_peered":"2024-05-08T18:10:23.006076+0000","last_clean":"2024-05-08T18:10:23.006076+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:10:23.006076+0000","last_undegraded":"2024-05-08T18:10:23.006076+0000","last_fullsized":"2024-05-08T18:10:23.006076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"90'6","reported_seq":222,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.117205+0000","last_change":"2024-05-08T18:10:47.117265+0000","last_active":"2024-05-08T18:10:47.117205+0000","last_peered":"2024-05-08T18:10:47.117205+0000","last_clean":"2024-05-08T18:10:47.117205+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:10:47.117205+0000","last_undegraded":"2024-05-08T18:10:47.117205+0000","last_fullsized":"2024-05-08T18:10:47.117205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-05-08T18:10:47.116999+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-05-08T18:10:47.116999+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.116999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:16.159448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"120'22","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.579471+0000","last_change":"2024-05-08T18:07:15.493255+0000","last_active":"2024-05-08T18:10:35.579471+0000","last_peered":"2024-05-08T18:10:35.579471+0000","last_clean":"2024-05-08T18:10:35.579471+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:10:35.579471+0000","last_undegraded":"2024-05-08T18:10:35.579471+0000","last_fullsized":"2024-05-08T18:10:35.579471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":38912,"num_write":22,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:39.234077+0000","last_change":"2024-05-08T18:10:39.234129+0000","last_active":"2024-05-08T18:10:39.234077+0000","last_peered":"2024-05-08T18:10:39.234077+0000","last_clean":"2024-05-08T18:10:39.234077+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:10:39.234077+0000","last_undegraded":"2024-05-08T18:10:39.234077+0000","last_fullsized":"2024-05-08T18:10:39.234077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:39.233967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:39.233967+0000","last_clean_scrub_stamp":"2024-05-08T18:10:39.233967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:32.648654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"120'17","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:40.778524+0000","last_change":"2024-05-08T18:10:40.778610+0000","last_active":"2024-05-08T18:10:40.778524+0000","last_peered":"2024-05-08T18:10:40.778524+0000","last_clean":"2024-05-08T18:10:40.778524+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:10:40.778524+0000","last_undegraded":"2024-05-08T18:10:40.778524+0000","last_fullsized":"2024-05-08T18:10:40.778524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'17","last_scrub_stamp":"2024-05-08T18:10:40.778316+0000","last_deep_scrub":"120'17","last_deep_scrub_stamp":"2024-05-08T18:10:40.778316+0000","last_clean_scrub_stamp":"2024-05-08T18:10:40.778316+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:08.674124+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":856,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"120'18","reported_seq":255,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.600328+0000","last_change":"2024-05-08T18:07:23.564257+0000","last_active":"2024-05-08T18:10:35.600328+0000","last_peered":"2024-05-08T18:10:35.600328+0000","last_clean":"2024-05-08T18:10:35.600328+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:10:35.600328+0000","last_undegraded":"2024-05-08T18:10:35.600328+0000","last_fullsized":"2024-05-08T18:10:35.600328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"101'6","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.673820+0000","last_change":"2024-05-08T18:07:25.581296+0000","last_active":"2024-05-08T18:10:23.673820+0000","last_peered":"2024-05-08T18:10:23.673820+0000","last_clean":"2024-05-08T18:10:23.673820+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:10:23.673820+0000","last_undegraded":"2024-05-08T18:10:23.673820+0000","last_fullsized":"2024-05-08T18:10:23.673820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748885+0000","last_change":"2024-05-08T18:07:17.496182+0000","last_active":"2024-05-08T18:10:23.748885+0000","last_peered":"2024-05-08T18:10:23.748885+0000","last_clean":"2024-05-08T18:10:23.748885+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:10:23.748885+0000","last_undegraded":"2024-05-08T18:10:23.748885+0000","last_fullsized":"2024-05-08T18:10:23.748885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"120'12","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.360709+0000","last_change":"2024-05-08T18:07:15.483533+0000","last_active":"2024-05-08T18:10:35.360709+0000","last_peered":"2024-05-08T18:10:35.360709+0000","last_clean":"2024-05-08T18:10:35.360709+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:10:35.360709+0000","last_undegraded":"2024-05-08T18:10:35.360709+0000","last_fullsized":"2024-05-08T18:10:35.360709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24594,"num_write":42,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.887569+0000","last_change":"2024-05-08T18:10:51.887625+0000","last_active":"2024-05-08T18:10:51.887569+0000","last_peered":"2024-05-08T18:10:51.887569+0000","last_clean":"2024-05-08T18:10:51.887569+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:10:51.887569+0000","last_undegraded":"2024-05-08T18:10:51.887569+0000","last_fullsized":"2024-05-08T18:10:51.887569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:51.887380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:51.887380+0000","last_clean_scrub_stamp":"2024-05-08T18:10:51.887380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:55:38.888339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"120'29","reported_seq":246,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:42.102013+0000","last_change":"2024-05-08T18:10:42.102101+0000","last_active":"2024-05-08T18:10:42.102013+0000","last_peered":"2024-05-08T18:10:42.102013+0000","last_clean":"2024-05-08T18:10:42.102013+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:10:42.102013+0000","last_undegraded":"2024-05-08T18:10:42.102013+0000","last_fullsized":"2024-05-08T18:10:42.102013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'29","last_scrub_stamp":"2024-05-08T18:10:42.101817+0000","last_deep_scrub":"120'29","last_deep_scrub_stamp":"2024-05-08T18:10:42.101817+0000","last_clean_scrub_stamp":"2024-05-08T18:10:42.101817+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:03.465567+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:40.722792+0000","last_change":"2024-05-08T18:10:40.722887+0000","last_active":"2024-05-08T18:10:40.722792+0000","last_peered":"2024-05-08T18:10:40.722792+0000","last_clean":"2024-05-08T18:10:40.722792+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:10:40.722792+0000","last_undegraded":"2024-05-08T18:10:40.722792+0000","last_fullsized":"2024-05-08T18:10:40.722792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:40.722565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:40.722565+0000","last_clean_scrub_stamp":"2024-05-08T18:10:40.722565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:28:04.236944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"101'2","reported_seq":192,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.676404+0000","last_change":"2024-05-08T18:07:25.571436+0000","last_active":"2024-05-08T18:10:23.676404+0000","last_peered":"2024-05-08T18:10:23.676404+0000","last_clean":"2024-05-08T18:10:23.676404+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:10:23.676404+0000","last_undegraded":"2024-05-08T18:10:23.676404+0000","last_fullsized":"2024-05-08T18:10:23.676404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.749772+0000","last_change":"2024-05-08T18:07:17.495103+0000","last_active":"2024-05-08T18:10:23.749772+0000","last_peered":"2024-05-08T18:10:23.749772+0000","last_clean":"2024-05-08T18:10:23.749772+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:10:23.749772+0000","last_undegraded":"2024-05-08T18:10:23.749772+0000","last_fullsized":"2024-05-08T18:10:23.749772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"120'8","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.485367+0000","last_change":"2024-05-08T18:07:15.479908+0000","last_active":"2024-05-08T18:10:35.485367+0000","last_peered":"2024-05-08T18:10:35.485367+0000","last_clean":"2024-05-08T18:10:35.485367+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:10:35.485367+0000","last_undegraded":"2024-05-08T18:10:35.485367+0000","last_fullsized":"2024-05-08T18:10:35.485367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.006952+0000","last_change":"2024-05-08T18:07:19.542124+0000","last_active":"2024-05-08T18:10:23.006952+0000","last_peered":"2024-05-08T18:10:23.006952+0000","last_clean":"2024-05-08T18:10:23.006952+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:10:23.006952+0000","last_undegraded":"2024-05-08T18:10:23.006952+0000","last_fullsized":"2024-05-08T18:10:23.006952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"120'20","reported_seq":226,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.011553+0000","last_change":"2024-05-08T18:07:21.550374+0000","last_active":"2024-05-08T18:10:35.011553+0000","last_peered":"2024-05-08T18:10:35.011553+0000","last_clean":"2024-05-08T18:10:35.011553+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:10:35.011553+0000","last_undegraded":"2024-05-08T18:10:35.011553+0000","last_fullsized":"2024-05-08T18:10:35.011553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:20.507998+0000","last_clean_scrub_stamp":"2024-05-08T18:07:20.507998+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":57,"num_write":22,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.307202+0000","last_change":"2024-05-08T18:10:49.307259+0000","last_active":"2024-05-08T18:10:49.307202+0000","last_peered":"2024-05-08T18:10:49.307202+0000","last_clean":"2024-05-08T18:10:49.307202+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:10:49.307202+0000","last_undegraded":"2024-05-08T18:10:49.307202+0000","last_fullsized":"2024-05-08T18:10:49.307202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:49.306956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:49.306956+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.306956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:43.430160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010711+0000","last_change":"2024-05-08T18:07:25.658844+0000","last_active":"2024-05-08T18:10:23.010711+0000","last_peered":"2024-05-08T18:10:23.010711+0000","last_clean":"2024-05-08T18:10:23.010711+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:10:23.010711+0000","last_undegraded":"2024-05-08T18:10:23.010711+0000","last_fullsized":"2024-05-08T18:10:23.010711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":206,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.010164+0000","last_change":"2024-05-08T18:07:17.503416+0000","last_active":"2024-05-08T18:10:23.010164+0000","last_peered":"2024-05-08T18:10:23.010164+0000","last_clean":"2024-05-08T18:10:23.010164+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:10:23.010164+0000","last_undegraded":"2024-05-08T18:10:23.010164+0000","last_fullsized":"2024-05-08T18:10:23.010164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"120'20","reported_seq":183,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.594517+0000","last_change":"2024-05-08T18:07:55.439856+0000","last_active":"2024-05-08T18:10:35.594517+0000","last_peered":"2024-05-08T18:10:35.594517+0000","last_clean":"2024-05-08T18:10:35.594517+0000","last_became_active":"2024-05-08T18:07:55.439188+0000","last_became_peered":"2024-05-08T18:07:55.439188+0000","last_unstale":"2024-05-08T18:10:35.594517+0000","last_undegraded":"2024-05-08T18:10:35.594517+0000","last_fullsized":"2024-05-08T18:10:35.594517+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":36864,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.747831+0000","last_change":"2024-05-08T18:07:19.546812+0000","last_active":"2024-05-08T18:10:23.747831+0000","last_peered":"2024-05-08T18:10:23.747831+0000","last_clean":"2024-05-08T18:10:23.747831+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:10:23.747831+0000","last_undegraded":"2024-05-08T18:10:23.747831+0000","last_fullsized":"2024-05-08T18:10:23.747831+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:18.502027+0000","last_clean_scrub_stamp":"2024-05-08T18:07:18.502027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"120'15","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.616293+0000","last_change":"2024-05-08T18:10:47.616363+0000","last_active":"2024-05-08T18:10:47.616293+0000","last_peered":"2024-05-08T18:10:47.616293+0000","last_clean":"2024-05-08T18:10:47.616293+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:10:47.616293+0000","last_undegraded":"2024-05-08T18:10:47.616293+0000","last_fullsized":"2024-05-08T18:10:47.616293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'15","last_scrub_stamp":"2024-05-08T18:10:47.616077+0000","last_deep_scrub":"120'15","last_deep_scrub_stamp":"2024-05-08T18:10:47.616077+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.616077+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:54.718144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":46,"num_write":16,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":193,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.748682+0000","last_change":"2024-05-08T18:07:23.560768+0000","last_active":"2024-05-08T18:10:23.748682+0000","last_peered":"2024-05-08T18:10:23.748682+0000","last_clean":"2024-05-08T18:10:23.748682+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:10:23.748682+0000","last_undegraded":"2024-05-08T18:10:23.748682+0000","last_fullsized":"2024-05-08T18:10:23.748682+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":190,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.675338+0000","last_change":"2024-05-08T18:07:25.564079+0000","last_active":"2024-05-08T18:10:23.675338+0000","last_peered":"2024-05-08T18:10:23.675338+0000","last_clean":"2024-05-08T18:10:23.675338+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:10:23.675338+0000","last_undegraded":"2024-05-08T18:10:23.675338+0000","last_fullsized":"2024-05-08T18:10:23.675338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.789112+0000","last_change":"2024-05-08T18:10:49.789175+0000","last_active":"2024-05-08T18:10:49.789112+0000","last_peered":"2024-05-08T18:10:49.789112+0000","last_clean":"2024-05-08T18:10:49.789112+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:10:49.789112+0000","last_undegraded":"2024-05-08T18:10:49.789112+0000","last_fullsized":"2024-05-08T18:10:49.789112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:49.788910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:49.788910+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.788910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:38.033075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"120'18","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.439969+0000","last_change":"2024-05-08T18:07:15.497612+0000","last_active":"2024-05-08T18:10:35.439969+0000","last_peered":"2024-05-08T18:10:35.439969+0000","last_clean":"2024-05-08T18:10:35.439969+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:10:35.439969+0000","last_undegraded":"2024-05-08T18:10:35.439969+0000","last_fullsized":"2024-05-08T18:10:35.439969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32780,"num_write":38,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"120'2","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.174282+0000","last_change":"2024-05-08T18:10:45.174342+0000","last_active":"2024-05-08T18:10:45.174282+0000","last_peered":"2024-05-08T18:10:45.174282+0000","last_clean":"2024-05-08T18:10:45.174282+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:10:45.174282+0000","last_undegraded":"2024-05-08T18:10:45.174282+0000","last_fullsized":"2024-05-08T18:10:45.174282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'2","last_scrub_stamp":"2024-05-08T18:10:45.174091+0000","last_deep_scrub":"120'2","last_deep_scrub_stamp":"2024-05-08T18:10:45.174091+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.174091+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:56.006926+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"120'21","reported_seq":237,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:41.755514+0000","last_change":"2024-05-08T18:10:41.755596+0000","last_active":"2024-05-08T18:10:41.755514+0000","last_peered":"2024-05-08T18:10:41.755514+0000","last_clean":"2024-05-08T18:10:41.755514+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:10:41.755514+0000","last_undegraded":"2024-05-08T18:10:41.755514+0000","last_fullsized":"2024-05-08T18:10:41.755514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'21","last_scrub_stamp":"2024-05-08T18:10:41.755316+0000","last_deep_scrub":"120'21","last_deep_scrub_stamp":"2024-05-08T18:10:41.755316+0000","last_clean_scrub_stamp":"2024-05-08T18:10:41.755316+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:03.119066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":40,"num_write":20,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.013186+0000","last_change":"2024-05-08T18:07:23.567722+0000","last_active":"2024-05-08T18:10:23.013186+0000","last_peered":"2024-05-08T18:10:23.013186+0000","last_clean":"2024-05-08T18:10:23.013186+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:10:23.013186+0000","last_undegraded":"2024-05-08T18:10:23.013186+0000","last_fullsized":"2024-05-08T18:10:23.013186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:22.514100+0000","last_clean_scrub_stamp":"2024-05-08T18:07:22.514100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.751175+0000","last_change":"2024-05-08T18:07:25.568932+0000","last_active":"2024-05-08T18:10:23.751175+0000","last_peered":"2024-05-08T18:10:23.751175+0000","last_clean":"2024-05-08T18:10:23.751175+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:10:23.751175+0000","last_undegraded":"2024-05-08T18:10:23.751175+0000","last_fullsized":"2024-05-08T18:10:23.751175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:24.521088+0000","last_clean_scrub_stamp":"2024-05-08T18:07:24.521088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"101'36","reported_seq":253,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:44.148326+0000","last_change":"2024-05-08T18:10:44.148421+0000","last_active":"2024-05-08T18:10:44.148326+0000","last_peered":"2024-05-08T18:10:44.148326+0000","last_clean":"2024-05-08T18:10:44.148326+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:10:44.148326+0000","last_undegraded":"2024-05-08T18:10:44.148326+0000","last_fullsized":"2024-05-08T18:10:44.148326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'36","last_scrub_stamp":"2024-05-08T18:10:44.148101+0000","last_deep_scrub":"101'36","last_deep_scrub_stamp":"2024-05-08T18:10:44.148101+0000","last_clean_scrub_stamp":"2024-05-08T18:10:44.148101+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:58:32.403083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":91,"num_write":52,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"120'26","reported_seq":250,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.536229+0000","last_change":"2024-05-08T18:07:15.503221+0000","last_active":"2024-05-08T18:10:35.536229+0000","last_peered":"2024-05-08T18:10:35.536229+0000","last_clean":"2024-05-08T18:10:35.536229+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:10:35.536229+0000","last_undegraded":"2024-05-08T18:10:35.536229+0000","last_fullsized":"2024-05-08T18:10:35.536229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":47134,"num_write":76,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.146209+0000","last_change":"2024-05-08T18:10:46.146269+0000","last_active":"2024-05-08T18:10:46.146209+0000","last_peered":"2024-05-08T18:10:46.146209+0000","last_clean":"2024-05-08T18:10:46.146209+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:10:46.146209+0000","last_undegraded":"2024-05-08T18:10:46.146209+0000","last_fullsized":"2024-05-08T18:10:46.146209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:46.145992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:46.145992+0000","last_clean_scrub_stamp":"2024-05-08T18:10:46.145992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:13.399524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"120'16","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:44.113697+0000","last_change":"2024-05-08T18:10:44.113764+0000","last_active":"2024-05-08T18:10:44.113697+0000","last_peered":"2024-05-08T18:10:44.113697+0000","last_clean":"2024-05-08T18:10:44.113697+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:10:44.113697+0000","last_undegraded":"2024-05-08T18:10:44.113697+0000","last_fullsized":"2024-05-08T18:10:44.113697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:10:44.113466+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:10:44.113466+0000","last_clean_scrub_stamp":"2024-05-08T18:10:44.113466+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:54.594473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":26630,"num_write":26,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.010319+0000","last_change":"2024-05-08T18:10:47.010395+0000","last_active":"2024-05-08T18:10:47.010319+0000","last_peered":"2024-05-08T18:10:47.010319+0000","last_clean":"2024-05-08T18:10:47.010319+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:10:47.010319+0000","last_undegraded":"2024-05-08T18:10:47.010319+0000","last_fullsized":"2024-05-08T18:10:47.010319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:47.010102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:47.010102+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.010102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:16.856570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"120'18","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.532380+0000","last_change":"2024-05-08T18:07:15.475806+0000","last_active":"2024-05-08T18:10:35.532380+0000","last_peered":"2024-05-08T18:10:35.532380+0000","last_clean":"2024-05-08T18:10:35.532380+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:10:35.532380+0000","last_undegraded":"2024-05-08T18:10:35.532380+0000","last_fullsized":"2024-05-08T18:10:35.532380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32780,"num_write":38,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:40.281489+0000","last_change":"2024-05-08T18:10:40.281509+0000","last_active":"2024-05-08T18:10:40.281489+0000","last_peered":"2024-05-08T18:10:40.281489+0000","last_clean":"2024-05-08T18:10:40.281489+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:10:40.281489+0000","last_undegraded":"2024-05-08T18:10:40.281489+0000","last_fullsized":"2024-05-08T18:10:40.281489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:40.281421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:40.281421+0000","last_clean_scrub_stamp":"2024-05-08T18:10:40.281421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:47.592229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"120'8","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.144074+0000","last_change":"2024-05-08T18:07:15.492688+0000","last_active":"2024-05-08T18:10:35.144074+0000","last_peered":"2024-05-08T18:10:35.144074+0000","last_clean":"2024-05-08T18:10:35.144074+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:10:35.144074+0000","last_undegraded":"2024-05-08T18:10:35.144074+0000","last_fullsized":"2024-05-08T18:10:35.144074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":16390,"num_write":18,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:52.586178+0000","last_change":"2024-05-08T18:10:52.586307+0000","last_active":"2024-05-08T18:10:52.586178+0000","last_peered":"2024-05-08T18:10:52.586178+0000","last_clean":"2024-05-08T18:10:52.586178+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:10:52.586178+0000","last_undegraded":"2024-05-08T18:10:52.586178+0000","last_fullsized":"2024-05-08T18:10:52.586178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:52.585952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:52.585952+0000","last_clean_scrub_stamp":"2024-05-08T18:10:52.585952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:09.810615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"120'18","reported_seq":239,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.372071+0000","last_change":"2024-05-08T18:07:15.484381+0000","last_active":"2024-05-08T18:10:35.372071+0000","last_peered":"2024-05-08T18:10:35.372071+0000","last_clean":"2024-05-08T18:10:35.372071+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:10:35.372071+0000","last_undegraded":"2024-05-08T18:10:35.372071+0000","last_fullsized":"2024-05-08T18:10:35.372071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32780,"num_write":38,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.744869+0000","last_change":"2024-05-08T18:10:51.744927+0000","last_active":"2024-05-08T18:10:51.744869+0000","last_peered":"2024-05-08T18:10:51.744869+0000","last_clean":"2024-05-08T18:10:51.744869+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:10:51.744869+0000","last_undegraded":"2024-05-08T18:10:51.744869+0000","last_fullsized":"2024-05-08T18:10:51.744869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:51.744656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:51.744656+0000","last_clean_scrub_stamp":"2024-05-08T18:10:51.744656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:52.754119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"120'16","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:58.055707+0000","last_change":"2024-05-08T18:10:58.055765+0000","last_active":"2024-05-08T18:10:58.055707+0000","last_peered":"2024-05-08T18:10:58.055707+0000","last_clean":"2024-05-08T18:10:58.055707+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:10:58.055707+0000","last_undegraded":"2024-05-08T18:10:58.055707+0000","last_fullsized":"2024-05-08T18:10:58.055707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:10:58.055514+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:10:58.055514+0000","last_clean_scrub_stamp":"2024-05-08T18:10:58.055514+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:57.892871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":32786,"num_write":46,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"101'40","reported_seq":252,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:23.009456+0000","last_change":"2024-05-08T18:07:17.500828+0000","last_active":"2024-05-08T18:10:23.009456+0000","last_peered":"2024-05-08T18:10:23.009456+0000","last_clean":"2024-05-08T18:10:23.009456+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:10:23.009456+0000","last_undegraded":"2024-05-08T18:10:23.009456+0000","last_fullsized":"2024-05-08T18:10:23.009456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:16.470262+0000","last_clean_scrub_stamp":"2024-05-08T18:07:16.470262+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":102,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"120'16","reported_seq":239,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.289242+0000","last_change":"2024-05-08T18:10:56.289301+0000","last_active":"2024-05-08T18:10:56.289242+0000","last_peered":"2024-05-08T18:10:56.289242+0000","last_clean":"2024-05-08T18:10:56.289242+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:10:56.289242+0000","last_undegraded":"2024-05-08T18:10:56.289242+0000","last_fullsized":"2024-05-08T18:10:56.289242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:10:56.289046+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:10:56.289046+0000","last_clean_scrub_stamp":"2024-05-08T18:10:56.289046+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:52.730586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"90'12","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:44.278962+0000","last_change":"2024-05-08T18:10:44.279069+0000","last_active":"2024-05-08T18:10:44.278962+0000","last_peered":"2024-05-08T18:10:44.278962+0000","last_clean":"2024-05-08T18:10:44.278962+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:10:44.278962+0000","last_undegraded":"2024-05-08T18:10:44.278962+0000","last_fullsized":"2024-05-08T18:10:44.278962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'12","last_scrub_stamp":"2024-05-08T18:10:44.278753+0000","last_deep_scrub":"90'12","last_deep_scrub_stamp":"2024-05-08T18:10:44.278753+0000","last_clean_scrub_stamp":"2024-05-08T18:10:44.278753+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:52.815029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"120'6","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.500206+0000","last_change":"2024-05-08T18:07:15.486208+0000","last_active":"2024-05-08T18:10:35.500206+0000","last_peered":"2024-05-08T18:10:35.500206+0000","last_clean":"2024-05-08T18:10:35.500206+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:10:35.500206+0000","last_undegraded":"2024-05-08T18:10:35.500206+0000","last_fullsized":"2024-05-08T18:10:35.500206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:55.552167+0000","last_change":"2024-05-08T18:10:55.552285+0000","last_active":"2024-05-08T18:10:55.552167+0000","last_peered":"2024-05-08T18:10:55.552167+0000","last_clean":"2024-05-08T18:10:55.552167+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:10:55.552167+0000","last_undegraded":"2024-05-08T18:10:55.552167+0000","last_fullsized":"2024-05-08T18:10:55.552167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:55.551956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:55.551956+0000","last_clean_scrub_stamp":"2024-05-08T18:10:55.551956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:46.047485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"120'30","reported_seq":255,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.543292+0000","last_change":"2024-05-08T18:07:15.479390+0000","last_active":"2024-05-08T18:10:35.543292+0000","last_peered":"2024-05-08T18:10:35.543292+0000","last_clean":"2024-05-08T18:10:35.543292+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:10:35.543292+0000","last_undegraded":"2024-05-08T18:10:35.543292+0000","last_fullsized":"2024-05-08T18:10:35.543292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":55314,"num_write":60,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.678613+0000","last_change":"2024-05-08T18:10:56.678670+0000","last_active":"2024-05-08T18:10:56.678613+0000","last_peered":"2024-05-08T18:10:56.678613+0000","last_clean":"2024-05-08T18:10:56.678613+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:10:56.678613+0000","last_undegraded":"2024-05-08T18:10:56.678613+0000","last_fullsized":"2024-05-08T18:10:56.678613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:56.678412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:56.678412+0000","last_clean_scrub_stamp":"2024-05-08T18:10:56.678412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:53.188576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"120'12","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.487620+0000","last_change":"2024-05-08T18:07:15.486718+0000","last_active":"2024-05-08T18:10:35.487620+0000","last_peered":"2024-05-08T18:10:35.487620+0000","last_clean":"2024-05-08T18:10:35.487620+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:10:35.487620+0000","last_undegraded":"2024-05-08T18:10:35.487620+0000","last_fullsized":"2024-05-08T18:10:35.487620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24588,"num_write":32,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:48.085520+0000","last_change":"2024-05-08T18:10:48.085579+0000","last_active":"2024-05-08T18:10:48.085520+0000","last_peered":"2024-05-08T18:10:48.085520+0000","last_clean":"2024-05-08T18:10:48.085520+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:10:48.085520+0000","last_undegraded":"2024-05-08T18:10:48.085520+0000","last_fullsized":"2024-05-08T18:10:48.085520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:48.085315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:48.085315+0000","last_clean_scrub_stamp":"2024-05-08T18:10:48.085315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:48.230853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"120'14","reported_seq":184,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.907835+0000","last_change":"2024-05-08T18:10:57.907944+0000","last_active":"2024-05-08T18:10:57.907835+0000","last_peered":"2024-05-08T18:10:57.907835+0000","last_clean":"2024-05-08T18:10:57.907835+0000","last_became_active":"2024-05-08T18:07:55.444935+0000","last_became_peered":"2024-05-08T18:07:55.444935+0000","last_unstale":"2024-05-08T18:10:57.907835+0000","last_undegraded":"2024-05-08T18:10:57.907835+0000","last_fullsized":"2024-05-08T18:10:57.907835+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'14","last_scrub_stamp":"2024-05-08T18:10:57.907559+0000","last_deep_scrub":"120'14","last_deep_scrub_stamp":"2024-05-08T18:10:57.907559+0000","last_clean_scrub_stamp":"2024-05-08T18:10:57.907559+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:25.803368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":22528,"num_write":14,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.719220+0000","last_change":"2024-05-08T18:10:45.719272+0000","last_active":"2024-05-08T18:10:45.719220+0000","last_peered":"2024-05-08T18:10:45.719220+0000","last_clean":"2024-05-08T18:10:45.719220+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:10:45.719220+0000","last_undegraded":"2024-05-08T18:10:45.719220+0000","last_fullsized":"2024-05-08T18:10:45.719220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:45.719029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:45.719029+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.719029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:39.246234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"120'10","reported_seq":223,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.412002+0000","last_change":"2024-05-08T18:07:15.512904+0000","last_active":"2024-05-08T18:10:35.412002+0000","last_peered":"2024-05-08T18:10:35.412002+0000","last_clean":"2024-05-08T18:10:35.412002+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:10:35.412002+0000","last_undegraded":"2024-05-08T18:10:35.412002+0000","last_fullsized":"2024-05-08T18:10:35.412002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16390,"num_write":20,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.862704+0000","last_change":"2024-05-08T18:10:46.862759+0000","last_active":"2024-05-08T18:10:46.862704+0000","last_peered":"2024-05-08T18:10:46.862704+0000","last_clean":"2024-05-08T18:10:46.862704+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:10:46.862704+0000","last_undegraded":"2024-05-08T18:10:46.862704+0000","last_fullsized":"2024-05-08T18:10:46.862704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:46.862498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:46.862498+0000","last_clean_scrub_stamp":"2024-05-08T18:10:46.862498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:05.816145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"120'16","reported_seq":239,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:54.270940+0000","last_change":"2024-05-08T18:10:54.271005+0000","last_active":"2024-05-08T18:10:54.270940+0000","last_peered":"2024-05-08T18:10:54.270940+0000","last_clean":"2024-05-08T18:10:54.270940+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:10:54.270940+0000","last_undegraded":"2024-05-08T18:10:54.270940+0000","last_fullsized":"2024-05-08T18:10:54.270940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:10:54.270748+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:10:54.270748+0000","last_clean_scrub_stamp":"2024-05-08T18:10:54.270748+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:21.524281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.631813+0000","last_change":"2024-05-08T18:10:49.631918+0000","last_active":"2024-05-08T18:10:49.631813+0000","last_peered":"2024-05-08T18:10:49.631813+0000","last_clean":"2024-05-08T18:10:49.631813+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:10:49.631813+0000","last_undegraded":"2024-05-08T18:10:49.631813+0000","last_fullsized":"2024-05-08T18:10:49.631813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:49.631594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:49.631594+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.631594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:49.468950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"120'14","reported_seq":235,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.341483+0000","last_change":"2024-05-08T18:07:15.512737+0000","last_active":"2024-05-08T18:10:35.341483+0000","last_peered":"2024-05-08T18:10:35.341483+0000","last_clean":"2024-05-08T18:10:35.341483+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:10:35.341483+0000","last_undegraded":"2024-05-08T18:10:35.341483+0000","last_fullsized":"2024-05-08T18:10:35.341483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26648,"num_write":54,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"101'46","reported_seq":263,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:53.609651+0000","last_change":"2024-05-08T18:10:53.609711+0000","last_active":"2024-05-08T18:10:53.609651+0000","last_peered":"2024-05-08T18:10:53.609651+0000","last_clean":"2024-05-08T18:10:53.609651+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:10:53.609651+0000","last_undegraded":"2024-05-08T18:10:53.609651+0000","last_fullsized":"2024-05-08T18:10:53.609651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'46","last_scrub_stamp":"2024-05-08T18:10:53.609456+0000","last_deep_scrub":"101'46","last_deep_scrub_stamp":"2024-05-08T18:10:53.609456+0000","last_clean_scrub_stamp":"2024-05-08T18:10:53.609456+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:17.176689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"120'22","reported_seq":250,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.151868+0000","last_change":"2024-05-08T18:10:45.152025+0000","last_active":"2024-05-08T18:10:45.151868+0000","last_peered":"2024-05-08T18:10:45.151868+0000","last_clean":"2024-05-08T18:10:45.151868+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:10:45.151868+0000","last_undegraded":"2024-05-08T18:10:45.151868+0000","last_fullsized":"2024-05-08T18:10:45.151868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'22","last_scrub_stamp":"2024-05-08T18:10:45.151585+0000","last_deep_scrub":"120'22","last_deep_scrub_stamp":"2024-05-08T18:10:45.151585+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.151585+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:51:24.792412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":45056,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:48.867544+0000","last_change":"2024-05-08T18:10:48.867609+0000","last_active":"2024-05-08T18:10:48.867544+0000","last_peered":"2024-05-08T18:10:48.867544+0000","last_clean":"2024-05-08T18:10:48.867544+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:10:48.867544+0000","last_undegraded":"2024-05-08T18:10:48.867544+0000","last_fullsized":"2024-05-08T18:10:48.867544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:48.867350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:48.867350+0000","last_clean_scrub_stamp":"2024-05-08T18:10:48.867350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:13:19.338378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"120'16","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:53.944342+0000","last_change":"2024-05-08T18:10:53.944516+0000","last_active":"2024-05-08T18:10:53.944342+0000","last_peered":"2024-05-08T18:10:53.944342+0000","last_clean":"2024-05-08T18:10:53.944342+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:10:53.944342+0000","last_undegraded":"2024-05-08T18:10:53.944342+0000","last_fullsized":"2024-05-08T18:10:53.944342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:10:53.944118+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:10:53.944118+0000","last_clean_scrub_stamp":"2024-05-08T18:10:53.944118+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:53.781474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":26630,"num_write":26,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"120'26","reported_seq":247,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:35.589696+0000","last_change":"2024-05-08T18:07:15.492270+0000","last_active":"2024-05-08T18:10:35.589696+0000","last_peered":"2024-05-08T18:10:35.589696+0000","last_clean":"2024-05-08T18:10:35.589696+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:10:35.589696+0000","last_undegraded":"2024-05-08T18:10:35.589696+0000","last_fullsized":"2024-05-08T18:10:35.589696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:07:14.438327+0000","last_clean_scrub_stamp":"2024-05-08T18:07:14.438327+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":43014,"num_write":36,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:53.595991+0000","last_change":"2024-05-08T18:10:53.596044+0000","last_active":"2024-05-08T18:10:53.595991+0000","last_peered":"2024-05-08T18:10:53.595991+0000","last_clean":"2024-05-08T18:10:53.595991+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:10:53.595991+0000","last_undegraded":"2024-05-08T18:10:53.595991+0000","last_fullsized":"2024-05-08T18:10:53.595991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:53.595795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:53.595795+0000","last_clean_scrub_stamp":"2024-05-08T18:10:53.595795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:17.293274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"120'22","reported_seq":249,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.103471+0000","last_change":"2024-05-08T18:11:01.103530+0000","last_active":"2024-05-08T18:11:01.103471+0000","last_peered":"2024-05-08T18:11:01.103471+0000","last_clean":"2024-05-08T18:11:01.103471+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:11:01.103471+0000","last_undegraded":"2024-05-08T18:11:01.103471+0000","last_fullsized":"2024-05-08T18:11:01.103471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'22","last_scrub_stamp":"2024-05-08T18:11:01.103290+0000","last_deep_scrub":"120'22","last_deep_scrub_stamp":"2024-05-08T18:11:01.103290+0000","last_clean_scrub_stamp":"2024-05-08T18:11:01.103290+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:57.613454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40966,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.987192+0000","last_change":"2024-05-08T18:10:51.987244+0000","last_active":"2024-05-08T18:10:51.987192+0000","last_peered":"2024-05-08T18:10:51.987192+0000","last_clean":"2024-05-08T18:10:51.987192+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:10:51.987192+0000","last_undegraded":"2024-05-08T18:10:51.987192+0000","last_fullsized":"2024-05-08T18:10:51.987192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:51.986981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:51.986981+0000","last_clean_scrub_stamp":"2024-05-08T18:10:51.986981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:42.938258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":131254,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":1218,"num_read_kb":1595,"num_write":779,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1712,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":809,"ondisk_log_size":809,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1540,"num_read_kb":2048660,"num_write":2200,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2084864,"data_stored":1439914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1462272,"data_stored":848450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1511424,"data_stored":850271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1454080,"data_stored":848941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1478656,"data_stored":848846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1449984,"data_stored":848012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1478656,"data_stored":848700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2064384,"data_stored":1439320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:11:02.592 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.592 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.592 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.592 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.592 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.593 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.593 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.593 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.593 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.593 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.593 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.593 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.594 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.594 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.594 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.594 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.594 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.594 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.594 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.594 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.594 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.595 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.595 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.595 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.595 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.595 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.595 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.595 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.596 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.596 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.596 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.596 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.596 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.596 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.596 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.597 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.597 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.597 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.597 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.597 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.597 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.597 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.597 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.597 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.598 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.598 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.598 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.598 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T18:07:01.799268+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=1, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.598 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T18:07:08.398607+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.598 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.598 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.599 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.599 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T18:07:08.398607+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.599 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.599 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.599 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.599 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T18:07:08.398607+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.599 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.600 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.600 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.600 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.600 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.600 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.600 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.600 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T18:07:08.398607+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.601 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.601 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.601 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.601 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.601 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.601 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.601 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.602 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.602 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.602 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.602 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.602 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.602 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.602 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.602 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.602 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.603 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.603 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.603 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.603 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.603 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.603 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.603 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.603 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.604 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.604 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.604 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.604 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.604 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.604 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.604 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.604 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.604 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.605 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.605 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.605 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.605 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.605 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.605 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-08T18:07:20.507998+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=20, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.605 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.605 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.605 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.606 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-08T18:07:18.502027+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.606 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.606 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.606 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.606 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-08T18:07:22.514100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=22, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.606 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T18:07:24.521088+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.606 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.606 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.607 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.607 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.607 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-08T18:07:16.470262+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=16, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.607 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.607 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.607 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.607 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.607 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.608 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T18:07:14.438327+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=7, tm_sec=14, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=10, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:11:02.608 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:11:22.609 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:11:22.934 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T18:11:22.939 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T18:11:22.951 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2024-05-08T18:11:21.754040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":723235,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":4566,"num_read_kb":2051631,"num_write":3838,"num_write_kb":2050326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2006,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2700,"ondisk_log_size":2700,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262088,"kb_used_data":12680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712632,"statfs":{"total":773094113280,"available":772825735168,"internally_reserved":0,"allocated":12984320,"data_stored":7972454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006059"},"pg_stats":[{"pgid":"3.3f","version":"120'20","reported_seq":249,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:05.961055+0000","last_change":"2024-05-08T18:11:05.961205+0000","last_active":"2024-05-08T18:11:05.961055+0000","last_peered":"2024-05-08T18:11:05.961055+0000","last_clean":"2024-05-08T18:11:05.961055+0000","last_became_active":"2024-05-08T18:07:15.507731+0000","last_became_peered":"2024-05-08T18:07:15.507731+0000","last_unstale":"2024-05-08T18:11:05.961055+0000","last_undegraded":"2024-05-08T18:11:05.961055+0000","last_fullsized":"2024-05-08T18:11:05.961055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'20","last_scrub_stamp":"2024-05-08T18:11:05.960819+0000","last_deep_scrub":"120'20","last_deep_scrub_stamp":"2024-05-08T18:11:05.960819+0000","last_clean_scrub_stamp":"2024-05-08T18:11:05.960819+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:10:23.147478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":34822,"num_write":30,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.981764+0000","last_change":"2024-05-08T18:10:45.981823+0000","last_active":"2024-05-08T18:10:45.981764+0000","last_peered":"2024-05-08T18:10:45.981764+0000","last_clean":"2024-05-08T18:10:45.981764+0000","last_became_active":"2024-05-08T18:07:17.519378+0000","last_became_peered":"2024-05-08T18:07:17.519378+0000","last_unstale":"2024-05-08T18:10:45.981764+0000","last_undegraded":"2024-05-08T18:10:45.981764+0000","last_fullsized":"2024-05-08T18:10:45.981764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:45.981566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:45.981566+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.981566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:39.508771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"120'12","reported_seq":234,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:02.098966+0000","last_change":"2024-05-08T18:11:02.099023+0000","last_active":"2024-05-08T18:11:02.098966+0000","last_peered":"2024-05-08T18:11:02.098966+0000","last_clean":"2024-05-08T18:11:02.098966+0000","last_became_active":"2024-05-08T18:07:15.497074+0000","last_became_peered":"2024-05-08T18:07:15.497074+0000","last_unstale":"2024-05-08T18:11:02.098966+0000","last_undegraded":"2024-05-08T18:11:02.098966+0000","last_fullsized":"2024-05-08T18:11:02.098966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'12","last_scrub_stamp":"2024-05-08T18:11:02.098776+0000","last_deep_scrub":"120'12","last_deep_scrub_stamp":"2024-05-08T18:11:02.098776+0000","last_clean_scrub_stamp":"2024-05-08T18:11:02.098776+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:25.796254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20486,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:44.820900+0000","last_change":"2024-05-08T18:10:44.821038+0000","last_active":"2024-05-08T18:10:44.820900+0000","last_peered":"2024-05-08T18:10:44.820900+0000","last_clean":"2024-05-08T18:10:44.820900+0000","last_became_active":"2024-05-08T18:07:17.533175+0000","last_became_peered":"2024-05-08T18:07:17.533175+0000","last_unstale":"2024-05-08T18:10:44.820900+0000","last_undegraded":"2024-05-08T18:10:44.820900+0000","last_fullsized":"2024-05-08T18:10:44.820900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:44.820657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:44.820657+0000","last_clean_scrub_stamp":"2024-05-08T18:10:44.820657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:06.184408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"120'26","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:02.568084+0000","last_change":"2024-05-08T18:11:02.568109+0000","last_active":"2024-05-08T18:11:02.568084+0000","last_peered":"2024-05-08T18:11:02.568084+0000","last_clean":"2024-05-08T18:11:02.568084+0000","last_became_active":"2024-05-08T18:07:15.478411+0000","last_became_peered":"2024-05-08T18:07:15.478411+0000","last_unstale":"2024-05-08T18:11:02.568084+0000","last_undegraded":"2024-05-08T18:11:02.568084+0000","last_fullsized":"2024-05-08T18:11:02.568084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'26","last_scrub_stamp":"2024-05-08T18:11:02.567989+0000","last_deep_scrub":"120'26","last_deep_scrub_stamp":"2024-05-08T18:11:02.567989+0000","last_clean_scrub_stamp":"2024-05-08T18:11:02.567989+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:00:50.892776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":47116,"num_write":46,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:48.811156+0000","last_change":"2024-05-08T18:10:48.811210+0000","last_active":"2024-05-08T18:10:48.811156+0000","last_peered":"2024-05-08T18:10:48.811156+0000","last_clean":"2024-05-08T18:10:48.811156+0000","last_became_active":"2024-05-08T18:07:17.509588+0000","last_became_peered":"2024-05-08T18:07:17.509588+0000","last_unstale":"2024-05-08T18:10:48.811156+0000","last_undegraded":"2024-05-08T18:10:48.811156+0000","last_fullsized":"2024-05-08T18:10:48.811156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:48.810969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:48.810969+0000","last_clean_scrub_stamp":"2024-05-08T18:10:48.810969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:55:35.811928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"120'22","reported_seq":251,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.697689+0000","last_change":"2024-05-08T18:11:06.697689+0000","last_active":"2024-05-08T18:11:06.697689+0000","last_peered":"2024-05-08T18:11:06.697689+0000","last_clean":"2024-05-08T18:11:06.697689+0000","last_became_active":"2024-05-08T18:07:15.477277+0000","last_became_peered":"2024-05-08T18:07:15.477277+0000","last_unstale":"2024-05-08T18:11:06.697689+0000","last_undegraded":"2024-05-08T18:11:06.697689+0000","last_fullsized":"2024-05-08T18:11:06.697689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'22","last_scrub_stamp":"2024-05-08T18:11:06.697413+0000","last_deep_scrub":"120'22","last_deep_scrub_stamp":"2024-05-08T18:11:06.697413+0000","last_clean_scrub_stamp":"2024-05-08T18:11:06.697413+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:00:55.022200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":40972,"num_write":42,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.528073+0000","last_change":"2024-05-08T18:10:57.528136+0000","last_active":"2024-05-08T18:10:57.528073+0000","last_peered":"2024-05-08T18:10:57.528073+0000","last_clean":"2024-05-08T18:10:57.528073+0000","last_became_active":"2024-05-08T18:07:17.511437+0000","last_became_peered":"2024-05-08T18:07:17.511437+0000","last_unstale":"2024-05-08T18:10:57.528073+0000","last_undegraded":"2024-05-08T18:10:57.528073+0000","last_fullsized":"2024-05-08T18:10:57.528073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:57.527877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:57.527877+0000","last_clean_scrub_stamp":"2024-05-08T18:10:57.527877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:50.288701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"120'8","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:03.958908+0000","last_change":"2024-05-08T18:11:03.958967+0000","last_active":"2024-05-08T18:11:03.958908+0000","last_peered":"2024-05-08T18:11:03.958908+0000","last_clean":"2024-05-08T18:11:03.958908+0000","last_became_active":"2024-05-08T18:07:15.507128+0000","last_became_peered":"2024-05-08T18:07:15.507128+0000","last_unstale":"2024-05-08T18:11:03.958908+0000","last_undegraded":"2024-05-08T18:11:03.958908+0000","last_fullsized":"2024-05-08T18:11:03.958908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'8","last_scrub_stamp":"2024-05-08T18:11:03.958714+0000","last_deep_scrub":"120'8","last_deep_scrub_stamp":"2024-05-08T18:11:03.958714+0000","last_clean_scrub_stamp":"2024-05-08T18:11:03.958714+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:27.525947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14342,"num_write":18,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.283752+0000","last_change":"2024-05-08T18:10:50.283752+0000","last_active":"2024-05-08T18:10:50.283752+0000","last_peered":"2024-05-08T18:10:50.283752+0000","last_clean":"2024-05-08T18:10:50.283752+0000","last_became_active":"2024-05-08T18:07:17.513479+0000","last_became_peered":"2024-05-08T18:07:17.513479+0000","last_unstale":"2024-05-08T18:10:50.283752+0000","last_undegraded":"2024-05-08T18:10:50.283752+0000","last_fullsized":"2024-05-08T18:10:50.283752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:50.283416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:50.283416+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.283416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:53:48.547244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"120'14","reported_seq":186,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.874975+0000","last_change":"2024-05-08T18:10:56.875043+0000","last_active":"2024-05-08T18:10:56.874975+0000","last_peered":"2024-05-08T18:10:56.874975+0000","last_clean":"2024-05-08T18:10:56.874975+0000","last_became_active":"2024-05-08T18:07:55.439578+0000","last_became_peered":"2024-05-08T18:07:55.439578+0000","last_unstale":"2024-05-08T18:10:56.874975+0000","last_undegraded":"2024-05-08T18:10:56.874975+0000","last_fullsized":"2024-05-08T18:10:56.874975+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'14","last_scrub_stamp":"2024-05-08T18:10:56.874767+0000","last_deep_scrub":"120'14","last_deep_scrub_stamp":"2024-05-08T18:10:56.874767+0000","last_clean_scrub_stamp":"2024-05-08T18:10:56.874767+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:06:26.203470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22540,"num_write":34,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"101'86","reported_seq":308,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:52.721895+0000","last_change":"2024-05-08T18:10:52.721958+0000","last_active":"2024-05-08T18:10:52.721895+0000","last_peered":"2024-05-08T18:10:52.721895+0000","last_clean":"2024-05-08T18:10:52.721895+0000","last_became_active":"2024-05-08T18:07:17.509491+0000","last_became_peered":"2024-05-08T18:07:17.509491+0000","last_unstale":"2024-05-08T18:10:52.721895+0000","last_undegraded":"2024-05-08T18:10:52.721895+0000","last_fullsized":"2024-05-08T18:10:52.721895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'86","last_scrub_stamp":"2024-05-08T18:10:52.721690+0000","last_deep_scrub":"101'86","last_deep_scrub_stamp":"2024-05-08T18:10:52.721690+0000","last_clean_scrub_stamp":"2024-05-08T18:10:52.721690+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:27:41.726212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":219,"num_write":126,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"120'16","reported_seq":243,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:02.929546+0000","last_change":"2024-05-08T18:11:02.929703+0000","last_active":"2024-05-08T18:11:02.929546+0000","last_peered":"2024-05-08T18:11:02.929546+0000","last_clean":"2024-05-08T18:11:02.929546+0000","last_became_active":"2024-05-08T18:07:15.507188+0000","last_became_peered":"2024-05-08T18:07:15.507188+0000","last_unstale":"2024-05-08T18:11:02.929546+0000","last_undegraded":"2024-05-08T18:11:02.929546+0000","last_fullsized":"2024-05-08T18:11:02.929546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:11:02.929312+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:11:02.929312+0000","last_clean_scrub_stamp":"2024-05-08T18:11:02.929312+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:20.153975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32774,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.995033+0000","last_change":"2024-05-08T18:10:47.995086+0000","last_active":"2024-05-08T18:10:47.995033+0000","last_peered":"2024-05-08T18:10:47.995033+0000","last_clean":"2024-05-08T18:10:47.995033+0000","last_became_active":"2024-05-08T18:07:17.516640+0000","last_became_peered":"2024-05-08T18:07:17.516640+0000","last_unstale":"2024-05-08T18:10:47.995033+0000","last_undegraded":"2024-05-08T18:10:47.995033+0000","last_fullsized":"2024-05-08T18:10:47.995033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:47.994837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:47.994837+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.994837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:27.685008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"120'22","reported_seq":254,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.515818+0000","last_change":"2024-05-08T18:11:11.515884+0000","last_active":"2024-05-08T18:11:11.515818+0000","last_peered":"2024-05-08T18:11:11.515818+0000","last_clean":"2024-05-08T18:11:11.515818+0000","last_became_active":"2024-05-08T18:07:15.491862+0000","last_became_peered":"2024-05-08T18:07:15.491862+0000","last_unstale":"2024-05-08T18:11:11.515818+0000","last_undegraded":"2024-05-08T18:11:11.515818+0000","last_fullsized":"2024-05-08T18:11:11.515818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'22","last_scrub_stamp":"2024-05-08T18:11:11.515612+0000","last_deep_scrub":"120'22","last_deep_scrub_stamp":"2024-05-08T18:11:11.515612+0000","last_clean_scrub_stamp":"2024-05-08T18:11:11.515612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:41.660458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":43026,"num_write":52,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":176,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:19.650060+0000","last_change":"2024-05-08T18:11:19.650117+0000","last_active":"2024-05-08T18:11:19.650060+0000","last_peered":"2024-05-08T18:11:19.650060+0000","last_clean":"2024-05-08T18:11:19.650060+0000","last_became_active":"2024-05-08T18:07:47.006744+0000","last_became_peered":"2024-05-08T18:07:47.006744+0000","last_unstale":"2024-05-08T18:11:19.650060+0000","last_undegraded":"2024-05-08T18:11:19.650060+0000","last_fullsized":"2024-05-08T18:11:19.650060+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:19.649848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:19.649848+0000","last_clean_scrub_stamp":"2024-05-08T18:11:19.649848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:42.658377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.771058+0000","last_change":"2024-05-08T18:10:50.771120+0000","last_active":"2024-05-08T18:10:50.771058+0000","last_peered":"2024-05-08T18:10:50.771058+0000","last_clean":"2024-05-08T18:10:50.771058+0000","last_became_active":"2024-05-08T18:07:17.512378+0000","last_became_peered":"2024-05-08T18:07:17.512378+0000","last_unstale":"2024-05-08T18:10:50.771058+0000","last_undegraded":"2024-05-08T18:10:50.771058+0000","last_fullsized":"2024-05-08T18:10:50.771058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:50.770876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:50.770876+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.770876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:50.517866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"120'26","reported_seq":261,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:54.969676+0000","last_change":"2024-05-08T18:10:54.969853+0000","last_active":"2024-05-08T18:10:54.969676+0000","last_peered":"2024-05-08T18:10:54.969676+0000","last_clean":"2024-05-08T18:10:54.969676+0000","last_became_active":"2024-05-08T18:07:15.511342+0000","last_became_peered":"2024-05-08T18:07:15.511342+0000","last_unstale":"2024-05-08T18:10:54.969676+0000","last_undegraded":"2024-05-08T18:10:54.969676+0000","last_fullsized":"2024-05-08T18:10:54.969676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'26","last_scrub_stamp":"2024-05-08T18:10:54.969433+0000","last_deep_scrub":"120'26","last_deep_scrub_stamp":"2024-05-08T18:10:54.969433+0000","last_clean_scrub_stamp":"2024-05-08T18:10:54.969433+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:45.920711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":49176,"num_write":66,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:43.816924+0000","last_change":"2024-05-08T18:10:43.817027+0000","last_active":"2024-05-08T18:10:43.816924+0000","last_peered":"2024-05-08T18:10:43.816924+0000","last_clean":"2024-05-08T18:10:43.816924+0000","last_became_active":"2024-05-08T18:07:17.533263+0000","last_became_peered":"2024-05-08T18:07:17.533263+0000","last_unstale":"2024-05-08T18:10:43.816924+0000","last_undegraded":"2024-05-08T18:10:43.816924+0000","last_fullsized":"2024-05-08T18:10:43.816924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:43.816653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:43.816653+0000","last_clean_scrub_stamp":"2024-05-08T18:10:43.816653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:54.649488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"120'20","reported_seq":244,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:52.308930+0000","last_change":"2024-05-08T18:10:52.309059+0000","last_active":"2024-05-08T18:10:52.308930+0000","last_peered":"2024-05-08T18:10:52.308930+0000","last_clean":"2024-05-08T18:10:52.308930+0000","last_became_active":"2024-05-08T18:07:15.486223+0000","last_became_peered":"2024-05-08T18:07:15.486223+0000","last_unstale":"2024-05-08T18:10:52.308930+0000","last_undegraded":"2024-05-08T18:10:52.308930+0000","last_fullsized":"2024-05-08T18:10:52.308930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'20","last_scrub_stamp":"2024-05-08T18:10:52.308664+0000","last_deep_scrub":"120'20","last_deep_scrub_stamp":"2024-05-08T18:10:52.308664+0000","last_clean_scrub_stamp":"2024-05-08T18:10:52.308664+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:58:40.563646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32768,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"101'48","reported_seq":265,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.025237+0000","last_change":"2024-05-08T18:10:45.025302+0000","last_active":"2024-05-08T18:10:45.025237+0000","last_peered":"2024-05-08T18:10:45.025237+0000","last_clean":"2024-05-08T18:10:45.025237+0000","last_became_active":"2024-05-08T18:07:17.519596+0000","last_became_peered":"2024-05-08T18:07:17.519596+0000","last_unstale":"2024-05-08T18:10:45.025237+0000","last_undegraded":"2024-05-08T18:10:45.025237+0000","last_fullsized":"2024-05-08T18:10:45.025237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'48","last_scrub_stamp":"2024-05-08T18:10:45.025035+0000","last_deep_scrub":"101'48","last_deep_scrub_stamp":"2024-05-08T18:10:45.025035+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.025035+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:32:10.710960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":122,"num_write":70,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"120'10","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:53.319042+0000","last_change":"2024-05-08T18:10:53.319108+0000","last_active":"2024-05-08T18:10:53.319042+0000","last_peered":"2024-05-08T18:10:53.319042+0000","last_clean":"2024-05-08T18:10:53.319042+0000","last_became_active":"2024-05-08T18:07:15.485764+0000","last_became_peered":"2024-05-08T18:07:15.485764+0000","last_unstale":"2024-05-08T18:10:53.319042+0000","last_undegraded":"2024-05-08T18:10:53.319042+0000","last_fullsized":"2024-05-08T18:10:53.319042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'10","last_scrub_stamp":"2024-05-08T18:10:53.318839+0000","last_deep_scrub":"120'10","last_deep_scrub_stamp":"2024-05-08T18:10:53.318839+0000","last_clean_scrub_stamp":"2024-05-08T18:10:53.318839+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:04.151674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.118954+0000","last_change":"2024-05-08T18:10:46.119012+0000","last_active":"2024-05-08T18:10:46.118954+0000","last_peered":"2024-05-08T18:10:46.118954+0000","last_clean":"2024-05-08T18:10:46.118954+0000","last_became_active":"2024-05-08T18:07:17.507626+0000","last_became_peered":"2024-05-08T18:07:17.507626+0000","last_unstale":"2024-05-08T18:10:46.118954+0000","last_undegraded":"2024-05-08T18:10:46.118954+0000","last_fullsized":"2024-05-08T18:10:46.118954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:46.118746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:46.118746+0000","last_clean_scrub_stamp":"2024-05-08T18:10:46.118746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:56.649641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"120'16","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:03.682322+0000","last_change":"2024-05-08T18:11:03.682476+0000","last_active":"2024-05-08T18:11:03.682322+0000","last_peered":"2024-05-08T18:11:03.682322+0000","last_clean":"2024-05-08T18:11:03.682322+0000","last_became_active":"2024-05-08T18:07:15.495109+0000","last_became_peered":"2024-05-08T18:07:15.495109+0000","last_unstale":"2024-05-08T18:11:03.682322+0000","last_undegraded":"2024-05-08T18:11:03.682322+0000","last_fullsized":"2024-05-08T18:11:03.682322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:11:03.682058+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:11:03.682058+0000","last_clean_scrub_stamp":"2024-05-08T18:11:03.682058+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:01.992880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.057538+0000","last_change":"2024-05-08T18:10:49.057593+0000","last_active":"2024-05-08T18:10:49.057538+0000","last_peered":"2024-05-08T18:10:49.057538+0000","last_clean":"2024-05-08T18:10:49.057538+0000","last_became_active":"2024-05-08T18:07:17.518715+0000","last_became_peered":"2024-05-08T18:07:17.518715+0000","last_unstale":"2024-05-08T18:10:49.057538+0000","last_undegraded":"2024-05-08T18:10:49.057538+0000","last_fullsized":"2024-05-08T18:10:49.057538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:49.057339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:49.057339+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.057339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:53.618091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"120'10","reported_seq":251,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.635500+0000","last_change":"2024-05-08T18:11:21.635644+0000","last_active":"2024-05-08T18:11:21.635500+0000","last_peered":"2024-05-08T18:11:21.635500+0000","last_clean":"2024-05-08T18:11:21.635500+0000","last_became_active":"2024-05-08T18:09:38.182438+0000","last_became_peered":"2024-05-08T18:09:38.182438+0000","last_unstale":"2024-05-08T18:11:21.635500+0000","last_undegraded":"2024-05-08T18:11:21.635500+0000","last_fullsized":"2024-05-08T18:11:21.635500+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'10","last_scrub_stamp":"2024-05-08T18:11:21.635194+0000","last_deep_scrub":"120'10","last_deep_scrub_stamp":"2024-05-08T18:11:21.635194+0000","last_clean_scrub_stamp":"2024-05-08T18:11:21.635194+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:57.254713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:08.706188+0000","last_change":"2024-05-08T18:11:08.706253+0000","last_active":"2024-05-08T18:11:08.706188+0000","last_peered":"2024-05-08T18:11:08.706188+0000","last_clean":"2024-05-08T18:11:08.706188+0000","last_became_active":"2024-05-08T18:07:17.497503+0000","last_became_peered":"2024-05-08T18:07:17.497503+0000","last_unstale":"2024-05-08T18:11:08.706188+0000","last_undegraded":"2024-05-08T18:11:08.706188+0000","last_fullsized":"2024-05-08T18:11:08.706188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:08.705991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:08.705991+0000","last_clean_scrub_stamp":"2024-05-08T18:11:08.705991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:18.069262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"120'16","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:03.555583+0000","last_change":"2024-05-08T18:11:03.555645+0000","last_active":"2024-05-08T18:11:03.555583+0000","last_peered":"2024-05-08T18:11:03.555583+0000","last_clean":"2024-05-08T18:11:03.555583+0000","last_became_active":"2024-05-08T18:07:15.486765+0000","last_became_peered":"2024-05-08T18:07:15.486765+0000","last_unstale":"2024-05-08T18:11:03.555583+0000","last_undegraded":"2024-05-08T18:11:03.555583+0000","last_fullsized":"2024-05-08T18:11:03.555583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:11:03.555382+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:11:03.555382+0000","last_clean_scrub_stamp":"2024-05-08T18:11:03.555382+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:44.379501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":28678,"num_write":26,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:12.639126+0000","last_change":"2024-05-08T18:11:12.639189+0000","last_active":"2024-05-08T18:11:12.639126+0000","last_peered":"2024-05-08T18:11:12.639126+0000","last_clean":"2024-05-08T18:11:12.639126+0000","last_became_active":"2024-05-08T18:07:25.549046+0000","last_became_peered":"2024-05-08T18:07:25.549046+0000","last_unstale":"2024-05-08T18:11:12.639126+0000","last_undegraded":"2024-05-08T18:11:12.639126+0000","last_fullsized":"2024-05-08T18:11:12.639126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:12.638933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:12.638933+0000","last_clean_scrub_stamp":"2024-05-08T18:11:12.638933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:00.935879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:03.536675+0000","last_change":"2024-05-08T18:11:03.536766+0000","last_active":"2024-05-08T18:11:03.536675+0000","last_peered":"2024-05-08T18:11:03.536675+0000","last_clean":"2024-05-08T18:11:03.536675+0000","last_became_active":"2024-05-08T18:07:17.497724+0000","last_became_peered":"2024-05-08T18:07:17.497724+0000","last_unstale":"2024-05-08T18:11:03.536675+0000","last_undegraded":"2024-05-08T18:11:03.536675+0000","last_fullsized":"2024-05-08T18:11:03.536675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:03.536422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:03.536422+0000","last_clean_scrub_stamp":"2024-05-08T18:11:03.536422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:36.928602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"120'20","reported_seq":250,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.973610+0000","last_change":"2024-05-08T18:11:06.973683+0000","last_active":"2024-05-08T18:11:06.973610+0000","last_peered":"2024-05-08T18:11:06.973610+0000","last_clean":"2024-05-08T18:11:06.973610+0000","last_became_active":"2024-05-08T18:07:15.511193+0000","last_became_peered":"2024-05-08T18:07:15.511193+0000","last_unstale":"2024-05-08T18:11:06.973610+0000","last_undegraded":"2024-05-08T18:11:06.973610+0000","last_fullsized":"2024-05-08T18:11:06.973610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'20","last_scrub_stamp":"2024-05-08T18:11:06.973398+0000","last_deep_scrub":"120'20","last_deep_scrub_stamp":"2024-05-08T18:11:06.973398+0000","last_clean_scrub_stamp":"2024-05-08T18:11:06.973398+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:13.645677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":36876,"num_write":40,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.959121+0000","last_change":"2024-05-08T18:10:50.959177+0000","last_active":"2024-05-08T18:10:50.959121+0000","last_peered":"2024-05-08T18:10:50.959121+0000","last_clean":"2024-05-08T18:10:50.959121+0000","last_became_active":"2024-05-08T18:07:19.526912+0000","last_became_peered":"2024-05-08T18:07:19.526912+0000","last_unstale":"2024-05-08T18:10:50.959121+0000","last_undegraded":"2024-05-08T18:10:50.959121+0000","last_fullsized":"2024-05-08T18:10:50.959121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:50.958927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:50.958927+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.958927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:50.705916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"120'19","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.644181+0000","last_change":"2024-05-08T18:10:45.644279+0000","last_active":"2024-05-08T18:10:45.644181+0000","last_peered":"2024-05-08T18:10:45.644181+0000","last_clean":"2024-05-08T18:10:45.644181+0000","last_became_active":"2024-05-08T18:07:21.553833+0000","last_became_peered":"2024-05-08T18:07:21.553833+0000","last_unstale":"2024-05-08T18:10:45.644181+0000","last_undegraded":"2024-05-08T18:10:45.644181+0000","last_fullsized":"2024-05-08T18:10:45.644181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'19","last_scrub_stamp":"2024-05-08T18:10:45.644007+0000","last_deep_scrub":"120'19","last_deep_scrub_stamp":"2024-05-08T18:10:45.644007+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.644007+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:26.768150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:08.968760+0000","last_change":"2024-05-08T18:11:08.968868+0000","last_active":"2024-05-08T18:11:08.968760+0000","last_peered":"2024-05-08T18:11:08.968760+0000","last_clean":"2024-05-08T18:11:08.968760+0000","last_became_active":"2024-05-08T18:07:23.549730+0000","last_became_peered":"2024-05-08T18:07:23.549730+0000","last_unstale":"2024-05-08T18:11:08.968760+0000","last_undegraded":"2024-05-08T18:11:08.968760+0000","last_fullsized":"2024-05-08T18:11:08.968760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:08.968531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:08.968531+0000","last_clean_scrub_stamp":"2024-05-08T18:11:08.968531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:08.288795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:13.740241+0000","last_change":"2024-05-08T18:11:13.740298+0000","last_active":"2024-05-08T18:11:13.740241+0000","last_peered":"2024-05-08T18:11:13.740241+0000","last_clean":"2024-05-08T18:11:13.740241+0000","last_became_active":"2024-05-08T18:07:25.574666+0000","last_became_peered":"2024-05-08T18:07:25.574666+0000","last_unstale":"2024-05-08T18:11:13.740241+0000","last_undegraded":"2024-05-08T18:11:13.740241+0000","last_fullsized":"2024-05-08T18:11:13.740241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:13.740008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:13.740008+0000","last_clean_scrub_stamp":"2024-05-08T18:11:13.740008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:25.604187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.038103+0000","last_change":"2024-05-08T18:10:49.038158+0000","last_active":"2024-05-08T18:10:49.038103+0000","last_peered":"2024-05-08T18:10:49.038103+0000","last_clean":"2024-05-08T18:10:49.038103+0000","last_became_active":"2024-05-08T18:07:17.534240+0000","last_became_peered":"2024-05-08T18:07:17.534240+0000","last_unstale":"2024-05-08T18:10:49.038103+0000","last_undegraded":"2024-05-08T18:10:49.038103+0000","last_fullsized":"2024-05-08T18:10:49.038103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:49.037910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:49.037910+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.037910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:55:36.038869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"120'16","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.598610+0000","last_change":"2024-05-08T18:11:01.598676+0000","last_active":"2024-05-08T18:11:01.598610+0000","last_peered":"2024-05-08T18:11:01.598610+0000","last_clean":"2024-05-08T18:11:01.598610+0000","last_became_active":"2024-05-08T18:07:15.508021+0000","last_became_peered":"2024-05-08T18:07:15.508021+0000","last_unstale":"2024-05-08T18:11:01.598610+0000","last_undegraded":"2024-05-08T18:11:01.598610+0000","last_fullsized":"2024-05-08T18:11:01.598610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:11:01.598418+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:11:01.598418+0000","last_clean_scrub_stamp":"2024-05-08T18:11:01.598418+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:56.114251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":30738,"num_write":46,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:00.581873+0000","last_change":"2024-05-08T18:11:00.581927+0000","last_active":"2024-05-08T18:11:00.581873+0000","last_peered":"2024-05-08T18:11:00.581873+0000","last_clean":"2024-05-08T18:11:00.581873+0000","last_became_active":"2024-05-08T18:07:19.538256+0000","last_became_peered":"2024-05-08T18:07:19.538256+0000","last_unstale":"2024-05-08T18:11:00.581873+0000","last_undegraded":"2024-05-08T18:11:00.581873+0000","last_fullsized":"2024-05-08T18:11:00.581873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:00.581687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:00.581687+0000","last_clean_scrub_stamp":"2024-05-08T18:11:00.581687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:33.802038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"120'10","reported_seq":218,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:44.677418+0000","last_change":"2024-05-08T18:10:44.677500+0000","last_active":"2024-05-08T18:10:44.677418+0000","last_peered":"2024-05-08T18:10:44.677418+0000","last_clean":"2024-05-08T18:10:44.677418+0000","last_became_active":"2024-05-08T18:07:21.547838+0000","last_became_peered":"2024-05-08T18:07:21.547838+0000","last_unstale":"2024-05-08T18:10:44.677418+0000","last_undegraded":"2024-05-08T18:10:44.677418+0000","last_fullsized":"2024-05-08T18:10:44.677418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'10","last_scrub_stamp":"2024-05-08T18:10:44.677200+0000","last_deep_scrub":"120'10","last_deep_scrub_stamp":"2024-05-08T18:10:44.677200+0000","last_clean_scrub_stamp":"2024-05-08T18:10:44.677200+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:32:10.363124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:43.709104+0000","last_change":"2024-05-08T18:10:43.709210+0000","last_active":"2024-05-08T18:10:43.709104+0000","last_peered":"2024-05-08T18:10:43.709104+0000","last_clean":"2024-05-08T18:10:43.709104+0000","last_became_active":"2024-05-08T18:07:23.543835+0000","last_became_peered":"2024-05-08T18:07:23.543835+0000","last_unstale":"2024-05-08T18:10:43.709104+0000","last_undegraded":"2024-05-08T18:10:43.709104+0000","last_fullsized":"2024-05-08T18:10:43.709104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:43.708804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:43.708804+0000","last_clean_scrub_stamp":"2024-05-08T18:10:43.708804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:02.662451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:14.527653+0000","last_change":"2024-05-08T18:11:14.527708+0000","last_active":"2024-05-08T18:11:14.527653+0000","last_peered":"2024-05-08T18:11:14.527653+0000","last_clean":"2024-05-08T18:11:14.527653+0000","last_became_active":"2024-05-08T18:07:25.571550+0000","last_became_peered":"2024-05-08T18:07:25.571550+0000","last_unstale":"2024-05-08T18:11:14.527653+0000","last_undegraded":"2024-05-08T18:11:14.527653+0000","last_fullsized":"2024-05-08T18:11:14.527653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:14.527446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:14.527446+0000","last_clean_scrub_stamp":"2024-05-08T18:11:14.527446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:24.941740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"90'6","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.615953+0000","last_change":"2024-05-08T18:10:51.616010+0000","last_active":"2024-05-08T18:10:51.615953+0000","last_peered":"2024-05-08T18:10:51.615953+0000","last_clean":"2024-05-08T18:10:51.615953+0000","last_became_active":"2024-05-08T18:07:17.512018+0000","last_became_peered":"2024-05-08T18:07:17.512018+0000","last_unstale":"2024-05-08T18:10:51.615953+0000","last_undegraded":"2024-05-08T18:10:51.615953+0000","last_fullsized":"2024-05-08T18:10:51.615953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-05-08T18:10:51.615751+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-05-08T18:10:51.615751+0000","last_clean_scrub_stamp":"2024-05-08T18:10:51.615751+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:29.172267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"120'14","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.019151+0000","last_change":"2024-05-08T18:10:59.019212+0000","last_active":"2024-05-08T18:10:59.019151+0000","last_peered":"2024-05-08T18:10:59.019151+0000","last_clean":"2024-05-08T18:10:59.019151+0000","last_became_active":"2024-05-08T18:07:15.511424+0000","last_became_peered":"2024-05-08T18:07:15.511424+0000","last_unstale":"2024-05-08T18:10:59.019151+0000","last_undegraded":"2024-05-08T18:10:59.019151+0000","last_fullsized":"2024-05-08T18:10:59.019151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'14","last_scrub_stamp":"2024-05-08T18:10:59.018959+0000","last_deep_scrub":"120'14","last_deep_scrub_stamp":"2024-05-08T18:10:59.018959+0000","last_clean_scrub_stamp":"2024-05-08T18:10:59.018959+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:36.575476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":28684,"num_write":34,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.662300+0000","last_change":"2024-05-08T18:10:56.662353+0000","last_active":"2024-05-08T18:10:56.662300+0000","last_peered":"2024-05-08T18:10:56.662300+0000","last_clean":"2024-05-08T18:10:56.662300+0000","last_became_active":"2024-05-08T18:07:19.528031+0000","last_became_peered":"2024-05-08T18:07:19.528031+0000","last_unstale":"2024-05-08T18:10:56.662300+0000","last_undegraded":"2024-05-08T18:10:56.662300+0000","last_fullsized":"2024-05-08T18:10:56.662300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:56.662113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:56.662113+0000","last_clean_scrub_stamp":"2024-05-08T18:10:56.662113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:03.334393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"120'15","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:52.955163+0000","last_change":"2024-05-08T18:10:52.955241+0000","last_active":"2024-05-08T18:10:52.955163+0000","last_peered":"2024-05-08T18:10:52.955163+0000","last_clean":"2024-05-08T18:10:52.955163+0000","last_became_active":"2024-05-08T18:07:21.551600+0000","last_became_peered":"2024-05-08T18:07:21.551600+0000","last_unstale":"2024-05-08T18:10:52.955163+0000","last_undegraded":"2024-05-08T18:10:52.955163+0000","last_fullsized":"2024-05-08T18:10:52.955163+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'15","last_scrub_stamp":"2024-05-08T18:10:52.954959+0000","last_deep_scrub":"120'15","last_deep_scrub_stamp":"2024-05-08T18:10:52.954959+0000","last_clean_scrub_stamp":"2024-05-08T18:10:52.954959+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:00.265767+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"120'19","reported_seq":270,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.895130+0000","last_change":"2024-05-08T18:11:11.895217+0000","last_active":"2024-05-08T18:11:11.895130+0000","last_peered":"2024-05-08T18:11:11.895130+0000","last_clean":"2024-05-08T18:11:11.895130+0000","last_became_active":"2024-05-08T18:07:23.562982+0000","last_became_peered":"2024-05-08T18:07:23.562982+0000","last_unstale":"2024-05-08T18:11:11.895130+0000","last_undegraded":"2024-05-08T18:11:11.895130+0000","last_fullsized":"2024-05-08T18:11:11.895130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'19","last_scrub_stamp":"2024-05-08T18:11:11.894911+0000","last_deep_scrub":"120'19","last_deep_scrub_stamp":"2024-05-08T18:11:11.894911+0000","last_clean_scrub_stamp":"2024-05-08T18:11:11.894911+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:52.719030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"101'4","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:15.546471+0000","last_change":"2024-05-08T18:11:15.546540+0000","last_active":"2024-05-08T18:11:15.546471+0000","last_peered":"2024-05-08T18:11:15.546471+0000","last_clean":"2024-05-08T18:11:15.546471+0000","last_became_active":"2024-05-08T18:07:25.656431+0000","last_became_peered":"2024-05-08T18:07:25.656431+0000","last_unstale":"2024-05-08T18:11:15.546471+0000","last_undegraded":"2024-05-08T18:11:15.546471+0000","last_fullsized":"2024-05-08T18:11:15.546471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'4","last_scrub_stamp":"2024-05-08T18:11:15.546239+0000","last_deep_scrub":"101'4","last_deep_scrub_stamp":"2024-05-08T18:11:15.546239+0000","last_clean_scrub_stamp":"2024-05-08T18:11:15.546239+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:45.838533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.655445+0000","last_change":"2024-05-08T18:10:50.655498+0000","last_active":"2024-05-08T18:10:50.655445+0000","last_peered":"2024-05-08T18:10:50.655445+0000","last_clean":"2024-05-08T18:10:50.655445+0000","last_became_active":"2024-05-08T18:07:17.522296+0000","last_became_peered":"2024-05-08T18:07:17.522296+0000","last_unstale":"2024-05-08T18:10:50.655445+0000","last_undegraded":"2024-05-08T18:10:50.655445+0000","last_fullsized":"2024-05-08T18:10:50.655445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:50.655250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:50.655250+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.655250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:45.330675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"120'12","reported_seq":234,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:58.281858+0000","last_change":"2024-05-08T18:10:58.281917+0000","last_active":"2024-05-08T18:10:58.281858+0000","last_peered":"2024-05-08T18:10:58.281858+0000","last_clean":"2024-05-08T18:10:58.281858+0000","last_became_active":"2024-05-08T18:07:15.503185+0000","last_became_peered":"2024-05-08T18:07:15.503185+0000","last_unstale":"2024-05-08T18:10:58.281858+0000","last_undegraded":"2024-05-08T18:10:58.281858+0000","last_fullsized":"2024-05-08T18:10:58.281858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'12","last_scrub_stamp":"2024-05-08T18:10:58.281641+0000","last_deep_scrub":"120'12","last_deep_scrub_stamp":"2024-05-08T18:10:58.281641+0000","last_clean_scrub_stamp":"2024-05-08T18:10:58.281641+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:51.808846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24588,"num_write":32,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:52.957359+0000","last_change":"2024-05-08T18:10:52.957436+0000","last_active":"2024-05-08T18:10:52.957359+0000","last_peered":"2024-05-08T18:10:52.957359+0000","last_clean":"2024-05-08T18:10:52.957359+0000","last_became_active":"2024-05-08T18:07:19.532418+0000","last_became_peered":"2024-05-08T18:07:19.532418+0000","last_unstale":"2024-05-08T18:10:52.957359+0000","last_undegraded":"2024-05-08T18:10:52.957359+0000","last_fullsized":"2024-05-08T18:10:52.957359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:52.957157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:52.957157+0000","last_clean_scrub_stamp":"2024-05-08T18:10:52.957157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:32.163416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"120'19","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.988364+0000","last_change":"2024-05-08T18:10:57.988443+0000","last_active":"2024-05-08T18:10:57.988364+0000","last_peered":"2024-05-08T18:10:57.988364+0000","last_clean":"2024-05-08T18:10:57.988364+0000","last_became_active":"2024-05-08T18:07:21.552194+0000","last_became_peered":"2024-05-08T18:07:21.552194+0000","last_unstale":"2024-05-08T18:10:57.988364+0000","last_undegraded":"2024-05-08T18:10:57.988364+0000","last_fullsized":"2024-05-08T18:10:57.988364+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'19","last_scrub_stamp":"2024-05-08T18:10:57.988166+0000","last_deep_scrub":"120'19","last_deep_scrub_stamp":"2024-05-08T18:10:57.988166+0000","last_clean_scrub_stamp":"2024-05-08T18:10:57.988166+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:05.090233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"120'18","reported_seq":257,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:41.760172+0000","last_change":"2024-05-08T18:10:41.760234+0000","last_active":"2024-05-08T18:10:41.760172+0000","last_peered":"2024-05-08T18:10:41.760172+0000","last_clean":"2024-05-08T18:10:41.760172+0000","last_became_active":"2024-05-08T18:07:23.551276+0000","last_became_peered":"2024-05-08T18:07:23.551276+0000","last_unstale":"2024-05-08T18:10:41.760172+0000","last_undegraded":"2024-05-08T18:10:41.760172+0000","last_fullsized":"2024-05-08T18:10:41.760172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:10:41.759986+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:10:41.759986+0000","last_clean_scrub_stamp":"2024-05-08T18:10:41.759986+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:55:28.760945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.989045+0000","last_change":"2024-05-08T18:10:49.989102+0000","last_active":"2024-05-08T18:10:49.989045+0000","last_peered":"2024-05-08T18:10:49.989045+0000","last_clean":"2024-05-08T18:10:49.989045+0000","last_became_active":"2024-05-08T18:07:17.515827+0000","last_became_peered":"2024-05-08T18:07:17.515827+0000","last_unstale":"2024-05-08T18:10:49.989045+0000","last_undegraded":"2024-05-08T18:10:49.989045+0000","last_fullsized":"2024-05-08T18:10:49.989045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:49.988838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:49.988838+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.988838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:38.233002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"120'28","reported_seq":208,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:55.902640+0000","last_change":"2024-05-08T18:10:55.902706+0000","last_active":"2024-05-08T18:10:55.902640+0000","last_peered":"2024-05-08T18:10:55.902640+0000","last_clean":"2024-05-08T18:10:55.902640+0000","last_became_active":"2024-05-08T18:07:55.357205+0000","last_became_peered":"2024-05-08T18:07:55.357205+0000","last_unstale":"2024-05-08T18:10:55.902640+0000","last_undegraded":"2024-05-08T18:10:55.902640+0000","last_fullsized":"2024-05-08T18:10:55.902640+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'28","last_scrub_stamp":"2024-05-08T18:10:55.902329+0000","last_deep_scrub":"120'28","last_deep_scrub_stamp":"2024-05-08T18:10:55.902329+0000","last_clean_scrub_stamp":"2024-05-08T18:10:55.902329+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:14.750024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":51218,"num_write":58,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.829231+0000","last_change":"2024-05-08T18:10:47.829290+0000","last_active":"2024-05-08T18:10:47.829231+0000","last_peered":"2024-05-08T18:10:47.829231+0000","last_clean":"2024-05-08T18:10:47.829231+0000","last_became_active":"2024-05-08T18:07:19.548116+0000","last_became_peered":"2024-05-08T18:07:19.548116+0000","last_unstale":"2024-05-08T18:10:47.829231+0000","last_undegraded":"2024-05-08T18:10:47.829231+0000","last_fullsized":"2024-05-08T18:10:47.829231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:47.829028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:47.829028+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.829028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:52.806824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"120'36","reported_seq":255,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:44.066705+0000","last_change":"2024-05-08T18:10:44.066787+0000","last_active":"2024-05-08T18:10:44.066705+0000","last_peered":"2024-05-08T18:10:44.066705+0000","last_clean":"2024-05-08T18:10:44.066705+0000","last_became_active":"2024-05-08T18:07:21.541874+0000","last_became_peered":"2024-05-08T18:07:21.541874+0000","last_unstale":"2024-05-08T18:10:44.066705+0000","last_undegraded":"2024-05-08T18:10:44.066705+0000","last_fullsized":"2024-05-08T18:10:44.066705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'36","last_scrub_stamp":"2024-05-08T18:10:44.066497+0000","last_deep_scrub":"120'36","last_deep_scrub_stamp":"2024-05-08T18:10:44.066497+0000","last_clean_scrub_stamp":"2024-05-08T18:10:44.066497+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:03.020144+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":47,"num_read_kb":50,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:53.084261+0000","last_change":"2024-05-08T18:10:53.084318+0000","last_active":"2024-05-08T18:10:53.084261+0000","last_peered":"2024-05-08T18:10:53.084261+0000","last_clean":"2024-05-08T18:10:53.084261+0000","last_became_active":"2024-05-08T18:07:23.550074+0000","last_became_peered":"2024-05-08T18:07:23.550074+0000","last_unstale":"2024-05-08T18:10:53.084261+0000","last_undegraded":"2024-05-08T18:10:53.084261+0000","last_fullsized":"2024-05-08T18:10:53.084261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:53.084044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:53.084044+0000","last_clean_scrub_stamp":"2024-05-08T18:10:53.084044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:02:04.140806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:10.721091+0000","last_change":"2024-05-08T18:11:10.721145+0000","last_active":"2024-05-08T18:11:10.721091+0000","last_peered":"2024-05-08T18:11:10.721091+0000","last_clean":"2024-05-08T18:11:10.721091+0000","last_became_active":"2024-05-08T18:07:25.565958+0000","last_became_peered":"2024-05-08T18:07:25.565958+0000","last_unstale":"2024-05-08T18:11:10.721091+0000","last_undegraded":"2024-05-08T18:11:10.721091+0000","last_fullsized":"2024-05-08T18:11:10.721091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:10.720862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:10.720862+0000","last_clean_scrub_stamp":"2024-05-08T18:11:10.720862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:49:38.788467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"90'2","reported_seq":218,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:00.736297+0000","last_change":"2024-05-08T18:11:00.736368+0000","last_active":"2024-05-08T18:11:00.736297+0000","last_peered":"2024-05-08T18:11:00.736297+0000","last_clean":"2024-05-08T18:11:00.736297+0000","last_became_active":"2024-05-08T18:07:17.503237+0000","last_became_peered":"2024-05-08T18:07:17.503237+0000","last_unstale":"2024-05-08T18:11:00.736297+0000","last_undegraded":"2024-05-08T18:11:00.736297+0000","last_fullsized":"2024-05-08T18:11:00.736297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'2","last_scrub_stamp":"2024-05-08T18:11:00.736088+0000","last_deep_scrub":"90'2","last_deep_scrub_stamp":"2024-05-08T18:11:00.736088+0000","last_clean_scrub_stamp":"2024-05-08T18:11:00.736088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:30.921808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"120'16","reported_seq":246,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:52.937718+0000","last_change":"2024-05-08T18:10:52.937780+0000","last_active":"2024-05-08T18:10:52.937718+0000","last_peered":"2024-05-08T18:10:52.937718+0000","last_clean":"2024-05-08T18:10:52.937718+0000","last_became_active":"2024-05-08T18:07:15.514660+0000","last_became_peered":"2024-05-08T18:07:15.514660+0000","last_unstale":"2024-05-08T18:10:52.937718+0000","last_undegraded":"2024-05-08T18:10:52.937718+0000","last_fullsized":"2024-05-08T18:10:52.937718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:10:52.937521+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:10:52.937521+0000","last_clean_scrub_stamp":"2024-05-08T18:10:52.937521+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:41.181685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32792,"num_write":56,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.035324+0000","last_change":"2024-05-08T18:10:50.035382+0000","last_active":"2024-05-08T18:10:50.035324+0000","last_peered":"2024-05-08T18:10:50.035324+0000","last_clean":"2024-05-08T18:10:50.035324+0000","last_became_active":"2024-05-08T18:07:19.533915+0000","last_became_peered":"2024-05-08T18:07:19.533915+0000","last_unstale":"2024-05-08T18:10:50.035324+0000","last_undegraded":"2024-05-08T18:10:50.035324+0000","last_fullsized":"2024-05-08T18:10:50.035324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:50.035116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:50.035116+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.035116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:56.991745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"120'20","reported_seq":237,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.637112+0000","last_change":"2024-05-08T18:10:46.637181+0000","last_active":"2024-05-08T18:10:46.637112+0000","last_peered":"2024-05-08T18:10:46.637112+0000","last_clean":"2024-05-08T18:10:46.637112+0000","last_became_active":"2024-05-08T18:07:21.557177+0000","last_became_peered":"2024-05-08T18:07:21.557177+0000","last_unstale":"2024-05-08T18:10:46.637112+0000","last_undegraded":"2024-05-08T18:10:46.637112+0000","last_fullsized":"2024-05-08T18:10:46.637112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'20","last_scrub_stamp":"2024-05-08T18:10:46.636931+0000","last_deep_scrub":"120'20","last_deep_scrub_stamp":"2024-05-08T18:10:46.636931+0000","last_clean_scrub_stamp":"2024-05-08T18:10:46.636931+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:21.321322+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:43.693133+0000","last_change":"2024-05-08T18:10:43.693189+0000","last_active":"2024-05-08T18:10:43.693133+0000","last_peered":"2024-05-08T18:10:43.693133+0000","last_clean":"2024-05-08T18:10:43.693133+0000","last_became_active":"2024-05-08T18:07:23.549797+0000","last_became_peered":"2024-05-08T18:07:23.549797+0000","last_unstale":"2024-05-08T18:10:43.693133+0000","last_undegraded":"2024-05-08T18:10:43.693133+0000","last_fullsized":"2024-05-08T18:10:43.693133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:43.692927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:43.692927+0000","last_clean_scrub_stamp":"2024-05-08T18:10:43.692927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:30.200920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":194,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:04.178008+0000","last_change":"2024-05-08T18:11:04.178142+0000","last_active":"2024-05-08T18:11:04.178008+0000","last_peered":"2024-05-08T18:11:04.178008+0000","last_clean":"2024-05-08T18:11:04.178008+0000","last_became_active":"2024-05-08T18:07:25.567602+0000","last_became_peered":"2024-05-08T18:07:25.567602+0000","last_unstale":"2024-05-08T18:11:04.178008+0000","last_undegraded":"2024-05-08T18:11:04.178008+0000","last_fullsized":"2024-05-08T18:11:04.178008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:04.177769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:04.177769+0000","last_clean_scrub_stamp":"2024-05-08T18:11:04.177769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:09.533477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"101'34","reported_seq":247,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:48.301182+0000","last_change":"2024-05-08T18:10:48.301243+0000","last_active":"2024-05-08T18:10:48.301182+0000","last_peered":"2024-05-08T18:10:48.301182+0000","last_clean":"2024-05-08T18:10:48.301182+0000","last_became_active":"2024-05-08T18:07:17.515925+0000","last_became_peered":"2024-05-08T18:07:17.515925+0000","last_unstale":"2024-05-08T18:10:48.301182+0000","last_undegraded":"2024-05-08T18:10:48.301182+0000","last_fullsized":"2024-05-08T18:10:48.301182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'34","last_scrub_stamp":"2024-05-08T18:10:48.300972+0000","last_deep_scrub":"101'34","last_deep_scrub_stamp":"2024-05-08T18:10:48.300972+0000","last_clean_scrub_stamp":"2024-05-08T18:10:48.300972+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:36.096578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"120'8","reported_seq":232,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.847344+0000","last_change":"2024-05-08T18:10:50.847482+0000","last_active":"2024-05-08T18:10:50.847344+0000","last_peered":"2024-05-08T18:10:50.847344+0000","last_clean":"2024-05-08T18:10:50.847344+0000","last_became_active":"2024-05-08T18:07:15.514989+0000","last_became_peered":"2024-05-08T18:07:15.514989+0000","last_unstale":"2024-05-08T18:10:50.847344+0000","last_undegraded":"2024-05-08T18:10:50.847344+0000","last_fullsized":"2024-05-08T18:10:50.847344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'8","last_scrub_stamp":"2024-05-08T18:10:50.847067+0000","last_deep_scrub":"120'8","last_deep_scrub_stamp":"2024-05-08T18:10:50.847067+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.847067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.108222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16396,"num_write":28,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:40.169012+0000","last_change":"2024-05-08T18:10:40.169046+0000","last_active":"2024-05-08T18:10:40.169012+0000","last_peered":"2024-05-08T18:10:40.169012+0000","last_clean":"2024-05-08T18:10:40.169012+0000","last_became_active":"2024-05-08T18:07:19.536861+0000","last_became_peered":"2024-05-08T18:07:19.536861+0000","last_unstale":"2024-05-08T18:10:40.169012+0000","last_undegraded":"2024-05-08T18:10:40.169012+0000","last_fullsized":"2024-05-08T18:10:40.169012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:40.168913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:40.168913+0000","last_clean_scrub_stamp":"2024-05-08T18:10:40.168913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:34.549853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"120'29","reported_seq":249,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:07.976625+0000","last_change":"2024-05-08T18:11:07.976717+0000","last_active":"2024-05-08T18:11:07.976625+0000","last_peered":"2024-05-08T18:11:07.976625+0000","last_clean":"2024-05-08T18:11:07.976625+0000","last_became_active":"2024-05-08T18:07:21.556175+0000","last_became_peered":"2024-05-08T18:07:21.556175+0000","last_unstale":"2024-05-08T18:11:07.976625+0000","last_undegraded":"2024-05-08T18:11:07.976625+0000","last_fullsized":"2024-05-08T18:11:07.976625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'29","last_scrub_stamp":"2024-05-08T18:11:07.976433+0000","last_deep_scrub":"120'29","last_deep_scrub_stamp":"2024-05-08T18:11:07.976433+0000","last_clean_scrub_stamp":"2024-05-08T18:11:07.976433+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:19:11.540969+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"120'18","reported_seq":254,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:44.675627+0000","last_change":"2024-05-08T18:10:44.675780+0000","last_active":"2024-05-08T18:10:44.675627+0000","last_peered":"2024-05-08T18:10:44.675627+0000","last_clean":"2024-05-08T18:10:44.675627+0000","last_became_active":"2024-05-08T18:07:23.555842+0000","last_became_peered":"2024-05-08T18:07:23.555842+0000","last_unstale":"2024-05-08T18:10:44.675627+0000","last_undegraded":"2024-05-08T18:10:44.675627+0000","last_fullsized":"2024-05-08T18:10:44.675627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:10:44.675336+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:10:44.675336+0000","last_clean_scrub_stamp":"2024-05-08T18:10:44.675336+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:55.732097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"101'2","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:15.538246+0000","last_change":"2024-05-08T18:11:15.538306+0000","last_active":"2024-05-08T18:11:15.538246+0000","last_peered":"2024-05-08T18:11:15.538246+0000","last_clean":"2024-05-08T18:11:15.538246+0000","last_became_active":"2024-05-08T18:07:25.571840+0000","last_became_peered":"2024-05-08T18:07:25.571840+0000","last_unstale":"2024-05-08T18:11:15.538246+0000","last_undegraded":"2024-05-08T18:11:15.538246+0000","last_fullsized":"2024-05-08T18:11:15.538246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'2","last_scrub_stamp":"2024-05-08T18:11:15.538020+0000","last_deep_scrub":"101'2","last_deep_scrub_stamp":"2024-05-08T18:11:15.538020+0000","last_clean_scrub_stamp":"2024-05-08T18:11:15.538020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:54:44.218825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.605550+0000","last_change":"2024-05-08T18:10:46.605605+0000","last_active":"2024-05-08T18:10:46.605550+0000","last_peered":"2024-05-08T18:10:46.605550+0000","last_clean":"2024-05-08T18:10:46.605550+0000","last_became_active":"2024-05-08T18:07:17.513639+0000","last_became_peered":"2024-05-08T18:07:17.513639+0000","last_unstale":"2024-05-08T18:10:46.605550+0000","last_undegraded":"2024-05-08T18:10:46.605550+0000","last_fullsized":"2024-05-08T18:10:46.605550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:46.605317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:46.605317+0000","last_clean_scrub_stamp":"2024-05-08T18:10:46.605317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:33.113309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"120'28","reported_seq":261,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:02.767660+0000","last_change":"2024-05-08T18:11:02.767725+0000","last_active":"2024-05-08T18:11:02.767660+0000","last_peered":"2024-05-08T18:11:02.767660+0000","last_clean":"2024-05-08T18:11:02.767660+0000","last_became_active":"2024-05-08T18:07:15.474819+0000","last_became_peered":"2024-05-08T18:07:15.474819+0000","last_unstale":"2024-05-08T18:11:02.767660+0000","last_undegraded":"2024-05-08T18:11:02.767660+0000","last_fullsized":"2024-05-08T18:11:02.767660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'28","last_scrub_stamp":"2024-05-08T18:11:02.767476+0000","last_deep_scrub":"120'28","last_deep_scrub_stamp":"2024-05-08T18:11:02.767476+0000","last_clean_scrub_stamp":"2024-05-08T18:11:02.767476+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:06.585042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":55320,"num_write":68,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:42.142094+0000","last_change":"2024-05-08T18:10:42.142154+0000","last_active":"2024-05-08T18:10:42.142094+0000","last_peered":"2024-05-08T18:10:42.142094+0000","last_clean":"2024-05-08T18:10:42.142094+0000","last_became_active":"2024-05-08T18:07:19.534843+0000","last_became_peered":"2024-05-08T18:07:19.534843+0000","last_unstale":"2024-05-08T18:10:42.142094+0000","last_undegraded":"2024-05-08T18:10:42.142094+0000","last_fullsized":"2024-05-08T18:10:42.142094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:42.141887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:42.141887+0000","last_clean_scrub_stamp":"2024-05-08T18:10:42.141887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:47.022471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"120'33","reported_seq":255,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:43.669807+0000","last_change":"2024-05-08T18:10:43.669983+0000","last_active":"2024-05-08T18:10:43.669807+0000","last_peered":"2024-05-08T18:10:43.669807+0000","last_clean":"2024-05-08T18:10:43.669807+0000","last_became_active":"2024-05-08T18:07:21.553491+0000","last_became_peered":"2024-05-08T18:07:21.553491+0000","last_unstale":"2024-05-08T18:10:43.669807+0000","last_undegraded":"2024-05-08T18:10:43.669807+0000","last_fullsized":"2024-05-08T18:10:43.669807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'33","last_scrub_stamp":"2024-05-08T18:10:43.669562+0000","last_deep_scrub":"120'33","last_deep_scrub_stamp":"2024-05-08T18:10:43.669562+0000","last_clean_scrub_stamp":"2024-05-08T18:10:43.669562+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:38.530464+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":74,"num_write":34,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:54.929509+0000","last_change":"2024-05-08T18:10:54.929567+0000","last_active":"2024-05-08T18:10:54.929509+0000","last_peered":"2024-05-08T18:10:54.929509+0000","last_clean":"2024-05-08T18:10:54.929509+0000","last_became_active":"2024-05-08T18:07:23.558988+0000","last_became_peered":"2024-05-08T18:07:23.558988+0000","last_unstale":"2024-05-08T18:10:54.929509+0000","last_undegraded":"2024-05-08T18:10:54.929509+0000","last_fullsized":"2024-05-08T18:10:54.929509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:54.929291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:54.929291+0000","last_clean_scrub_stamp":"2024-05-08T18:10:54.929291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:14.814611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:05.088968+0000","last_change":"2024-05-08T18:11:05.089023+0000","last_active":"2024-05-08T18:11:05.088968+0000","last_peered":"2024-05-08T18:11:05.088968+0000","last_clean":"2024-05-08T18:11:05.088968+0000","last_became_active":"2024-05-08T18:07:25.551690+0000","last_became_peered":"2024-05-08T18:07:25.551690+0000","last_unstale":"2024-05-08T18:11:05.088968+0000","last_undegraded":"2024-05-08T18:11:05.088968+0000","last_fullsized":"2024-05-08T18:11:05.088968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:05.088760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:05.088760+0000","last_clean_scrub_stamp":"2024-05-08T18:11:05.088760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:28.655994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":218,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.518900+0000","last_change":"2024-05-08T18:11:16.518958+0000","last_active":"2024-05-08T18:11:16.518900+0000","last_peered":"2024-05-08T18:11:16.518900+0000","last_clean":"2024-05-08T18:11:16.518900+0000","last_became_active":"2024-05-08T18:07:55.355948+0000","last_became_peered":"2024-05-08T18:07:55.355948+0000","last_unstale":"2024-05-08T18:11:16.518900+0000","last_undegraded":"2024-05-08T18:11:16.518900+0000","last_fullsized":"2024-05-08T18:11:16.518900+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:16.518674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:16.518674+0000","last_clean_scrub_stamp":"2024-05-08T18:11:16.518674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:10.317560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"120'18","reported_seq":245,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:13.554868+0000","last_change":"2024-05-08T18:11:13.554970+0000","last_active":"2024-05-08T18:11:13.554868+0000","last_peered":"2024-05-08T18:11:13.554868+0000","last_clean":"2024-05-08T18:11:13.554868+0000","last_became_active":"2024-05-08T18:07:15.499413+0000","last_became_peered":"2024-05-08T18:07:15.499413+0000","last_unstale":"2024-05-08T18:11:13.554868+0000","last_undegraded":"2024-05-08T18:11:13.554868+0000","last_fullsized":"2024-05-08T18:11:13.554868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:11:13.554628+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:11:13.554628+0000","last_clean_scrub_stamp":"2024-05-08T18:11:13.554628+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:39.155934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32768,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:41.153697+0000","last_change":"2024-05-08T18:10:41.153748+0000","last_active":"2024-05-08T18:10:41.153697+0000","last_peered":"2024-05-08T18:10:41.153697+0000","last_clean":"2024-05-08T18:10:41.153697+0000","last_became_active":"2024-05-08T18:07:19.539769+0000","last_became_peered":"2024-05-08T18:07:19.539769+0000","last_unstale":"2024-05-08T18:10:41.153697+0000","last_undegraded":"2024-05-08T18:10:41.153697+0000","last_fullsized":"2024-05-08T18:10:41.153697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:41.153512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:41.153512+0000","last_clean_scrub_stamp":"2024-05-08T18:10:41.153512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:27.965929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"120'26","reported_seq":243,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:42.710247+0000","last_change":"2024-05-08T18:10:42.710330+0000","last_active":"2024-05-08T18:10:42.710247+0000","last_peered":"2024-05-08T18:10:42.710247+0000","last_clean":"2024-05-08T18:10:42.710247+0000","last_became_active":"2024-05-08T18:07:21.547221+0000","last_became_peered":"2024-05-08T18:07:21.547221+0000","last_unstale":"2024-05-08T18:10:42.710247+0000","last_undegraded":"2024-05-08T18:10:42.710247+0000","last_fullsized":"2024-05-08T18:10:42.710247+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'26","last_scrub_stamp":"2024-05-08T18:10:42.710059+0000","last_deep_scrub":"120'26","last_deep_scrub_stamp":"2024-05-08T18:10:42.710059+0000","last_clean_scrub_stamp":"2024-05-08T18:10:42.710059+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:39.006061+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":51,"num_write":28,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":856,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:38.717184+0000","last_change":"2024-05-08T18:10:38.717208+0000","last_active":"2024-05-08T18:10:38.717184+0000","last_peered":"2024-05-08T18:10:38.717184+0000","last_clean":"2024-05-08T18:10:38.717184+0000","last_became_active":"2024-05-08T18:07:23.546040+0000","last_became_peered":"2024-05-08T18:07:23.546040+0000","last_unstale":"2024-05-08T18:10:38.717184+0000","last_undegraded":"2024-05-08T18:10:38.717184+0000","last_fullsized":"2024-05-08T18:10:38.717184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:38.717080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:38.717080+0000","last_clean_scrub_stamp":"2024-05-08T18:10:38.717080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:10:15.527527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"90'2","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:15.609721+0000","last_change":"2024-05-08T18:11:15.609783+0000","last_active":"2024-05-08T18:11:15.609721+0000","last_peered":"2024-05-08T18:11:15.609721+0000","last_clean":"2024-05-08T18:11:15.609721+0000","last_became_active":"2024-05-08T18:07:25.568377+0000","last_became_peered":"2024-05-08T18:07:25.568377+0000","last_unstale":"2024-05-08T18:11:15.609721+0000","last_undegraded":"2024-05-08T18:11:15.609721+0000","last_fullsized":"2024-05-08T18:11:15.609721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'2","last_scrub_stamp":"2024-05-08T18:11:15.609500+0000","last_deep_scrub":"90'2","last_deep_scrub_stamp":"2024-05-08T18:11:15.609500+0000","last_clean_scrub_stamp":"2024-05-08T18:11:15.609500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:52.668891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:58.717938+0000","last_change":"2024-05-08T18:10:58.717991+0000","last_active":"2024-05-08T18:10:58.717938+0000","last_peered":"2024-05-08T18:10:58.717938+0000","last_clean":"2024-05-08T18:10:58.717938+0000","last_became_active":"2024-05-08T18:07:17.505730+0000","last_became_peered":"2024-05-08T18:07:17.505730+0000","last_unstale":"2024-05-08T18:10:58.717938+0000","last_undegraded":"2024-05-08T18:10:58.717938+0000","last_fullsized":"2024-05-08T18:10:58.717938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:58.717728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:58.717728+0000","last_clean_scrub_stamp":"2024-05-08T18:10:58.717728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:58.370950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"120'10","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:55.288786+0000","last_change":"2024-05-08T18:10:55.288853+0000","last_active":"2024-05-08T18:10:55.288786+0000","last_peered":"2024-05-08T18:10:55.288786+0000","last_clean":"2024-05-08T18:10:55.288786+0000","last_became_active":"2024-05-08T18:07:15.486588+0000","last_became_peered":"2024-05-08T18:07:15.486588+0000","last_unstale":"2024-05-08T18:10:55.288786+0000","last_undegraded":"2024-05-08T18:10:55.288786+0000","last_fullsized":"2024-05-08T18:10:55.288786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'10","last_scrub_stamp":"2024-05-08T18:10:55.288580+0000","last_deep_scrub":"120'10","last_deep_scrub_stamp":"2024-05-08T18:10:55.288580+0000","last_clean_scrub_stamp":"2024-05-08T18:10:55.288580+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:51.584582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16390,"num_write":20,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:41.236373+0000","last_change":"2024-05-08T18:10:41.236424+0000","last_active":"2024-05-08T18:10:41.236373+0000","last_peered":"2024-05-08T18:10:41.236373+0000","last_clean":"2024-05-08T18:10:41.236373+0000","last_became_active":"2024-05-08T18:07:19.526851+0000","last_became_peered":"2024-05-08T18:07:19.526851+0000","last_unstale":"2024-05-08T18:10:41.236373+0000","last_undegraded":"2024-05-08T18:10:41.236373+0000","last_fullsized":"2024-05-08T18:10:41.236373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:41.236170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:41.236170+0000","last_clean_scrub_stamp":"2024-05-08T18:10:41.236170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:45:34.619434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"120'29","reported_seq":248,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.952107+0000","last_change":"2024-05-08T18:10:51.952197+0000","last_active":"2024-05-08T18:10:51.952107+0000","last_peered":"2024-05-08T18:10:51.952107+0000","last_clean":"2024-05-08T18:10:51.952107+0000","last_became_active":"2024-05-08T18:07:21.540759+0000","last_became_peered":"2024-05-08T18:07:21.540759+0000","last_unstale":"2024-05-08T18:10:51.952107+0000","last_undegraded":"2024-05-08T18:10:51.952107+0000","last_fullsized":"2024-05-08T18:10:51.952107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'29","last_scrub_stamp":"2024-05-08T18:10:51.951907+0000","last_deep_scrub":"120'29","last_deep_scrub_stamp":"2024-05-08T18:10:51.951907+0000","last_clean_scrub_stamp":"2024-05-08T18:10:51.951907+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:45.366594+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"120'18","reported_seq":262,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:53.971401+0000","last_change":"2024-05-08T18:10:53.971467+0000","last_active":"2024-05-08T18:10:53.971401+0000","last_peered":"2024-05-08T18:10:53.971401+0000","last_clean":"2024-05-08T18:10:53.971401+0000","last_became_active":"2024-05-08T18:07:23.550174+0000","last_became_peered":"2024-05-08T18:07:23.550174+0000","last_unstale":"2024-05-08T18:10:53.971401+0000","last_undegraded":"2024-05-08T18:10:53.971401+0000","last_fullsized":"2024-05-08T18:10:53.971401+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:10:53.971204+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:10:53.971204+0000","last_clean_scrub_stamp":"2024-05-08T18:10:53.971204+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:48.094409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.048367+0000","last_change":"2024-05-08T18:11:06.048424+0000","last_active":"2024-05-08T18:11:06.048367+0000","last_peered":"2024-05-08T18:11:06.048367+0000","last_clean":"2024-05-08T18:11:06.048367+0000","last_became_active":"2024-05-08T18:07:25.567259+0000","last_became_peered":"2024-05-08T18:07:25.567259+0000","last_unstale":"2024-05-08T18:11:06.048367+0000","last_undegraded":"2024-05-08T18:11:06.048367+0000","last_fullsized":"2024-05-08T18:11:06.048367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:06.048129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:06.048129+0000","last_clean_scrub_stamp":"2024-05-08T18:11:06.048129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:58.808953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"101'42","reported_seq":258,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.763976+0000","last_change":"2024-05-08T18:10:46.764148+0000","last_active":"2024-05-08T18:10:46.763976+0000","last_peered":"2024-05-08T18:10:46.763976+0000","last_clean":"2024-05-08T18:10:46.763976+0000","last_became_active":"2024-05-08T18:07:17.517387+0000","last_became_peered":"2024-05-08T18:07:17.517387+0000","last_unstale":"2024-05-08T18:10:46.763976+0000","last_undegraded":"2024-05-08T18:10:46.763976+0000","last_fullsized":"2024-05-08T18:10:46.763976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'42","last_scrub_stamp":"2024-05-08T18:10:46.763716+0000","last_deep_scrub":"101'42","last_deep_scrub_stamp":"2024-05-08T18:10:46.763716+0000","last_clean_scrub_stamp":"2024-05-08T18:10:46.763716+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:16.610184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"120'20","reported_seq":248,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:02.732105+0000","last_change":"2024-05-08T18:11:02.732171+0000","last_active":"2024-05-08T18:11:02.732105+0000","last_peered":"2024-05-08T18:11:02.732105+0000","last_clean":"2024-05-08T18:11:02.732105+0000","last_became_active":"2024-05-08T18:07:15.481206+0000","last_became_peered":"2024-05-08T18:07:15.481206+0000","last_unstale":"2024-05-08T18:11:02.732105+0000","last_undegraded":"2024-05-08T18:11:02.732105+0000","last_fullsized":"2024-05-08T18:11:02.732105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'20","last_scrub_stamp":"2024-05-08T18:11:02.731919+0000","last_deep_scrub":"120'20","last_deep_scrub_stamp":"2024-05-08T18:11:02.731919+0000","last_clean_scrub_stamp":"2024-05-08T18:11:02.731919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:06.549484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":34822,"num_write":30,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"120'4","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.906665+0000","last_change":"2024-05-08T18:10:56.906739+0000","last_active":"2024-05-08T18:10:56.906665+0000","last_peered":"2024-05-08T18:10:56.906665+0000","last_clean":"2024-05-08T18:10:56.906665+0000","last_became_active":"2024-05-08T18:07:19.534551+0000","last_became_peered":"2024-05-08T18:07:19.534551+0000","last_unstale":"2024-05-08T18:10:56.906665+0000","last_undegraded":"2024-05-08T18:10:56.906665+0000","last_fullsized":"2024-05-08T18:10:56.906665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'4","last_scrub_stamp":"2024-05-08T18:10:56.906487+0000","last_deep_scrub":"120'4","last_deep_scrub_stamp":"2024-05-08T18:10:56.906487+0000","last_clean_scrub_stamp":"2024-05-08T18:10:56.906487+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:53.416651+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"120'15","reported_seq":110,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:10.125331+0000","last_change":"2024-05-08T18:11:10.125331+0000","last_active":"2024-05-08T18:11:10.125331+0000","last_peered":"2024-05-08T18:11:10.125331+0000","last_clean":"2024-05-08T18:11:10.125331+0000","last_became_active":"2024-05-08T18:09:06.380401+0000","last_became_peered":"2024-05-08T18:09:06.380401+0000","last_unstale":"2024-05-08T18:11:10.125331+0000","last_undegraded":"2024-05-08T18:11:10.125331+0000","last_fullsized":"2024-05-08T18:11:10.125331+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'15","last_scrub_stamp":"2024-05-08T18:11:10.125079+0000","last_deep_scrub":"120'15","last_deep_scrub_stamp":"2024-05-08T18:11:10.125079+0000","last_clean_scrub_stamp":"2024-05-08T18:11:10.125079+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:04.640912+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"120'18","reported_seq":259,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:03.227471+0000","last_change":"2024-05-08T18:11:03.227535+0000","last_active":"2024-05-08T18:11:03.227471+0000","last_peered":"2024-05-08T18:11:03.227471+0000","last_clean":"2024-05-08T18:11:03.227471+0000","last_became_active":"2024-05-08T18:07:23.566361+0000","last_became_peered":"2024-05-08T18:07:23.566361+0000","last_unstale":"2024-05-08T18:11:03.227471+0000","last_undegraded":"2024-05-08T18:11:03.227471+0000","last_fullsized":"2024-05-08T18:11:03.227471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:11:03.227280+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:11:03.227280+0000","last_clean_scrub_stamp":"2024-05-08T18:11:03.227280+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:49.735272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:14.592102+0000","last_change":"2024-05-08T18:11:14.592158+0000","last_active":"2024-05-08T18:11:14.592102+0000","last_peered":"2024-05-08T18:11:14.592102+0000","last_clean":"2024-05-08T18:11:14.592102+0000","last_became_active":"2024-05-08T18:07:25.568490+0000","last_became_peered":"2024-05-08T18:07:25.568490+0000","last_unstale":"2024-05-08T18:11:14.592102+0000","last_undegraded":"2024-05-08T18:11:14.592102+0000","last_fullsized":"2024-05-08T18:11:14.592102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:14.591901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:14.591901+0000","last_clean_scrub_stamp":"2024-05-08T18:11:14.591901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:10.188450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:54.131810+0000","last_change":"2024-05-08T18:10:54.131873+0000","last_active":"2024-05-08T18:10:54.131810+0000","last_peered":"2024-05-08T18:10:54.131810+0000","last_clean":"2024-05-08T18:10:54.131810+0000","last_became_active":"2024-05-08T18:07:17.495296+0000","last_became_peered":"2024-05-08T18:07:17.495296+0000","last_unstale":"2024-05-08T18:10:54.131810+0000","last_undegraded":"2024-05-08T18:10:54.131810+0000","last_fullsized":"2024-05-08T18:10:54.131810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:54.131615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:54.131615+0000","last_clean_scrub_stamp":"2024-05-08T18:10:54.131615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:35.255758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"120'24","reported_seq":255,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.579423+0000","last_change":"2024-05-08T18:11:06.579491+0000","last_active":"2024-05-08T18:11:06.579423+0000","last_peered":"2024-05-08T18:11:06.579423+0000","last_clean":"2024-05-08T18:11:06.579423+0000","last_became_active":"2024-05-08T18:07:15.475057+0000","last_became_peered":"2024-05-08T18:07:15.475057+0000","last_unstale":"2024-05-08T18:11:06.579423+0000","last_undegraded":"2024-05-08T18:11:06.579423+0000","last_fullsized":"2024-05-08T18:11:06.579423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'24","last_scrub_stamp":"2024-05-08T18:11:06.579195+0000","last_deep_scrub":"120'24","last_deep_scrub_stamp":"2024-05-08T18:11:06.579195+0000","last_clean_scrub_stamp":"2024-05-08T18:11:06.579195+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:43:31.990025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":47110,"num_write":34,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"120'2","reported_seq":222,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.692771+0000","last_change":"2024-05-08T18:10:57.692839+0000","last_active":"2024-05-08T18:10:57.692771+0000","last_peered":"2024-05-08T18:10:57.692771+0000","last_clean":"2024-05-08T18:10:57.692771+0000","last_became_active":"2024-05-08T18:07:19.530823+0000","last_became_peered":"2024-05-08T18:07:19.530823+0000","last_unstale":"2024-05-08T18:10:57.692771+0000","last_undegraded":"2024-05-08T18:10:57.692771+0000","last_fullsized":"2024-05-08T18:10:57.692771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'2","last_scrub_stamp":"2024-05-08T18:10:57.692532+0000","last_deep_scrub":"120'2","last_deep_scrub_stamp":"2024-05-08T18:10:57.692532+0000","last_clean_scrub_stamp":"2024-05-08T18:10:57.692532+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:21.390010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"120'32","reported_seq":250,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:41.132848+0000","last_change":"2024-05-08T18:10:41.133011+0000","last_active":"2024-05-08T18:10:41.132848+0000","last_peered":"2024-05-08T18:10:41.132848+0000","last_clean":"2024-05-08T18:10:41.132848+0000","last_became_active":"2024-05-08T18:07:21.545822+0000","last_became_peered":"2024-05-08T18:07:21.545822+0000","last_unstale":"2024-05-08T18:10:41.132848+0000","last_undegraded":"2024-05-08T18:10:41.132848+0000","last_fullsized":"2024-05-08T18:10:41.132848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'32","last_scrub_stamp":"2024-05-08T18:10:41.132626+0000","last_deep_scrub":"120'32","last_deep_scrub_stamp":"2024-05-08T18:10:41.132626+0000","last_clean_scrub_stamp":"2024-05-08T18:10:41.132626+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:09.028435+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":42,"num_read_kb":53,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.232511+0000","last_change":"2024-05-08T18:10:59.232572+0000","last_active":"2024-05-08T18:10:59.232511+0000","last_peered":"2024-05-08T18:10:59.232511+0000","last_clean":"2024-05-08T18:10:59.232511+0000","last_became_active":"2024-05-08T18:07:23.553429+0000","last_became_peered":"2024-05-08T18:07:23.553429+0000","last_unstale":"2024-05-08T18:10:59.232511+0000","last_undegraded":"2024-05-08T18:10:59.232511+0000","last_fullsized":"2024-05-08T18:10:59.232511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:59.232296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:59.232296+0000","last_clean_scrub_stamp":"2024-05-08T18:10:59.232296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:38.922467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:07.063874+0000","last_change":"2024-05-08T18:11:07.063929+0000","last_active":"2024-05-08T18:11:07.063874+0000","last_peered":"2024-05-08T18:11:07.063874+0000","last_clean":"2024-05-08T18:11:07.063874+0000","last_became_active":"2024-05-08T18:07:25.573789+0000","last_became_peered":"2024-05-08T18:07:25.573789+0000","last_unstale":"2024-05-08T18:11:07.063874+0000","last_undegraded":"2024-05-08T18:11:07.063874+0000","last_fullsized":"2024-05-08T18:11:07.063874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:07.063655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:07.063655+0000","last_clean_scrub_stamp":"2024-05-08T18:11:07.063655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:10.881220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:42.348086+0000","last_change":"2024-05-08T18:10:42.348154+0000","last_active":"2024-05-08T18:10:42.348086+0000","last_peered":"2024-05-08T18:10:42.348086+0000","last_clean":"2024-05-08T18:10:42.348086+0000","last_became_active":"2024-05-08T18:07:17.528572+0000","last_became_peered":"2024-05-08T18:07:17.528572+0000","last_unstale":"2024-05-08T18:10:42.348086+0000","last_undegraded":"2024-05-08T18:10:42.348086+0000","last_fullsized":"2024-05-08T18:10:42.348086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:42.347898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:42.347898+0000","last_clean_scrub_stamp":"2024-05-08T18:10:42.347898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:57.794595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"120'74","reported_seq":323,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:00.036208+0000","last_change":"2024-05-08T18:11:00.036208+0000","last_active":"2024-05-08T18:11:00.036208+0000","last_peered":"2024-05-08T18:11:00.036208+0000","last_clean":"2024-05-08T18:11:00.036208+0000","last_became_active":"2024-05-08T18:07:02.970744+0000","last_became_peered":"2024-05-08T18:07:02.970744+0000","last_unstale":"2024-05-08T18:11:00.036208+0000","last_undegraded":"2024-05-08T18:11:00.036208+0000","last_fullsized":"2024-05-08T18:11:00.036208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'74","last_scrub_stamp":"2024-05-08T18:11:00.035935+0000","last_deep_scrub":"120'74","last_deep_scrub_stamp":"2024-05-08T18:11:00.035935+0000","last_clean_scrub_stamp":"2024-05-08T18:11:00.035935+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:58.047489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.760257+0000","last_change":"2024-05-08T18:11:01.760315+0000","last_active":"2024-05-08T18:11:01.760257+0000","last_peered":"2024-05-08T18:11:01.760257+0000","last_clean":"2024-05-08T18:11:01.760257+0000","last_became_active":"2024-05-08T18:07:09.430915+0000","last_became_peered":"2024-05-08T18:07:09.430915+0000","last_unstale":"2024-05-08T18:11:01.760257+0000","last_undegraded":"2024-05-08T18:11:01.760257+0000","last_fullsized":"2024-05-08T18:11:01.760257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:01.760064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:01.760064+0000","last_clean_scrub_stamp":"2024-05-08T18:11:01.760064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:54.520889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"120'16","reported_seq":244,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:12.532368+0000","last_change":"2024-05-08T18:11:12.532429+0000","last_active":"2024-05-08T18:11:12.532368+0000","last_peered":"2024-05-08T18:11:12.532368+0000","last_clean":"2024-05-08T18:11:12.532368+0000","last_became_active":"2024-05-08T18:07:15.494584+0000","last_became_peered":"2024-05-08T18:07:15.494584+0000","last_unstale":"2024-05-08T18:11:12.532368+0000","last_undegraded":"2024-05-08T18:11:12.532368+0000","last_fullsized":"2024-05-08T18:11:12.532368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:11:12.532116+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:11:12.532116+0000","last_clean_scrub_stamp":"2024-05-08T18:11:12.532116+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:54:41.212922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32780,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.840399+0000","last_change":"2024-05-08T18:10:45.840454+0000","last_active":"2024-05-08T18:10:45.840399+0000","last_peered":"2024-05-08T18:10:45.840399+0000","last_clean":"2024-05-08T18:10:45.840399+0000","last_became_active":"2024-05-08T18:07:19.543213+0000","last_became_peered":"2024-05-08T18:07:19.543213+0000","last_unstale":"2024-05-08T18:10:45.840399+0000","last_undegraded":"2024-05-08T18:10:45.840399+0000","last_fullsized":"2024-05-08T18:10:45.840399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:45.840208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:45.840208+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.840208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:42.136210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"120'41","reported_seq":270,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:08.750032+0000","last_change":"2024-05-08T18:11:08.750118+0000","last_active":"2024-05-08T18:11:08.750032+0000","last_peered":"2024-05-08T18:11:08.750032+0000","last_clean":"2024-05-08T18:11:08.750032+0000","last_became_active":"2024-05-08T18:07:21.537940+0000","last_became_peered":"2024-05-08T18:07:21.537940+0000","last_unstale":"2024-05-08T18:11:08.750032+0000","last_undegraded":"2024-05-08T18:11:08.750032+0000","last_fullsized":"2024-05-08T18:11:08.750032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'41","last_scrub_stamp":"2024-05-08T18:11:08.749847+0000","last_deep_scrub":"120'41","last_deep_scrub_stamp":"2024-05-08T18:11:08.749847+0000","last_clean_scrub_stamp":"2024-05-08T18:11:08.749847+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:18.113117+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":84,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:39.694970+0000","last_change":"2024-05-08T18:10:39.694996+0000","last_active":"2024-05-08T18:10:39.694970+0000","last_peered":"2024-05-08T18:10:39.694970+0000","last_clean":"2024-05-08T18:10:39.694970+0000","last_became_active":"2024-05-08T18:07:23.546916+0000","last_became_peered":"2024-05-08T18:07:23.546916+0000","last_unstale":"2024-05-08T18:10:39.694970+0000","last_undegraded":"2024-05-08T18:10:39.694970+0000","last_fullsized":"2024-05-08T18:10:39.694970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:39.694876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:39.694876+0000","last_clean_scrub_stamp":"2024-05-08T18:10:39.694876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:36.136416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":194,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.089410+0000","last_change":"2024-05-08T18:11:06.089464+0000","last_active":"2024-05-08T18:11:06.089410+0000","last_peered":"2024-05-08T18:11:06.089410+0000","last_clean":"2024-05-08T18:11:06.089410+0000","last_became_active":"2024-05-08T18:07:25.581729+0000","last_became_peered":"2024-05-08T18:07:25.581729+0000","last_unstale":"2024-05-08T18:11:06.089410+0000","last_undegraded":"2024-05-08T18:11:06.089410+0000","last_fullsized":"2024-05-08T18:11:06.089410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:06.089212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:06.089212+0000","last_clean_scrub_stamp":"2024-05-08T18:11:06.089212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:05.926568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.634056+0000","last_change":"2024-05-08T18:10:50.634110+0000","last_active":"2024-05-08T18:10:50.634056+0000","last_peered":"2024-05-08T18:10:50.634056+0000","last_clean":"2024-05-08T18:10:50.634056+0000","last_became_active":"2024-05-08T18:07:17.514136+0000","last_became_peered":"2024-05-08T18:07:17.514136+0000","last_unstale":"2024-05-08T18:10:50.634056+0000","last_undegraded":"2024-05-08T18:10:50.634056+0000","last_fullsized":"2024-05-08T18:10:50.634056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:50.633857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:50.633857+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.633857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:52.571780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.020887+0000","last_change":"2024-05-08T18:11:01.020887+0000","last_active":"2024-05-08T18:11:01.020887+0000","last_peered":"2024-05-08T18:11:01.020887+0000","last_clean":"2024-05-08T18:11:01.020887+0000","last_became_active":"2024-05-08T18:07:09.430338+0000","last_became_peered":"2024-05-08T18:07:09.430338+0000","last_unstale":"2024-05-08T18:11:01.020887+0000","last_undegraded":"2024-05-08T18:11:01.020887+0000","last_fullsized":"2024-05-08T18:11:01.020887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:01.020623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:01.020623+0000","last_clean_scrub_stamp":"2024-05-08T18:11:01.020623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:55.696048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"120'18","reported_seq":245,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:04.599759+0000","last_change":"2024-05-08T18:11:04.599821+0000","last_active":"2024-05-08T18:11:04.599759+0000","last_peered":"2024-05-08T18:11:04.599759+0000","last_clean":"2024-05-08T18:11:04.599759+0000","last_became_active":"2024-05-08T18:07:15.490375+0000","last_became_peered":"2024-05-08T18:07:15.490375+0000","last_unstale":"2024-05-08T18:11:04.599759+0000","last_undegraded":"2024-05-08T18:11:04.599759+0000","last_fullsized":"2024-05-08T18:11:04.599759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:11:04.599570+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:11:04.599570+0000","last_clean_scrub_stamp":"2024-05-08T18:11:04.599570+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:13.962840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":34834,"num_write":48,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:54.903726+0000","last_change":"2024-05-08T18:10:54.903784+0000","last_active":"2024-05-08T18:10:54.903726+0000","last_peered":"2024-05-08T18:10:54.903726+0000","last_clean":"2024-05-08T18:10:54.903726+0000","last_became_active":"2024-05-08T18:07:19.533515+0000","last_became_peered":"2024-05-08T18:07:19.533515+0000","last_unstale":"2024-05-08T18:10:54.903726+0000","last_undegraded":"2024-05-08T18:10:54.903726+0000","last_fullsized":"2024-05-08T18:10:54.903726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:54.903506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:54.903506+0000","last_clean_scrub_stamp":"2024-05-08T18:10:54.903506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:56.841429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"120'81","reported_seq":356,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.112502+0000","last_change":"2024-05-08T18:10:51.112665+0000","last_active":"2024-05-08T18:10:51.112502+0000","last_peered":"2024-05-08T18:10:51.112502+0000","last_clean":"2024-05-08T18:10:51.112502+0000","last_became_active":"2024-05-08T18:07:21.539406+0000","last_became_peered":"2024-05-08T18:07:21.539406+0000","last_unstale":"2024-05-08T18:10:51.112502+0000","last_undegraded":"2024-05-08T18:10:51.112502+0000","last_fullsized":"2024-05-08T18:10:51.112502+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'81","last_scrub_stamp":"2024-05-08T18:10:51.112295+0000","last_deep_scrub":"120'81","last_deep_scrub_stamp":"2024-05-08T18:10:51.112295+0000","last_clean_scrub_stamp":"2024-05-08T18:10:51.112295+0000","objects_scrubbed":10,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:30.802466+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":130,"num_read_kb":233,"num_write":84,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:09.927205+0000","last_change":"2024-05-08T18:11:09.927260+0000","last_active":"2024-05-08T18:11:09.927205+0000","last_peered":"2024-05-08T18:11:09.927205+0000","last_clean":"2024-05-08T18:11:09.927205+0000","last_became_active":"2024-05-08T18:07:23.553129+0000","last_became_peered":"2024-05-08T18:07:23.553129+0000","last_unstale":"2024-05-08T18:11:09.927205+0000","last_undegraded":"2024-05-08T18:11:09.927205+0000","last_fullsized":"2024-05-08T18:11:09.927205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:09.927008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:09.927008+0000","last_clean_scrub_stamp":"2024-05-08T18:11:09.927008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:00:58.251795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:08.107891+0000","last_change":"2024-05-08T18:11:08.107944+0000","last_active":"2024-05-08T18:11:08.107891+0000","last_peered":"2024-05-08T18:11:08.107891+0000","last_clean":"2024-05-08T18:11:08.107891+0000","last_became_active":"2024-05-08T18:07:25.653580+0000","last_became_peered":"2024-05-08T18:07:25.653580+0000","last_unstale":"2024-05-08T18:11:08.107891+0000","last_undegraded":"2024-05-08T18:11:08.107891+0000","last_fullsized":"2024-05-08T18:11:08.107891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:08.107692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:08.107692+0000","last_clean_scrub_stamp":"2024-05-08T18:11:08.107692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:06.418514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"101'34","reported_seq":248,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.140672+0000","last_change":"2024-05-08T18:10:50.140737+0000","last_active":"2024-05-08T18:10:50.140672+0000","last_peered":"2024-05-08T18:10:50.140672+0000","last_clean":"2024-05-08T18:10:50.140672+0000","last_became_active":"2024-05-08T18:07:17.510815+0000","last_became_peered":"2024-05-08T18:07:17.510815+0000","last_unstale":"2024-05-08T18:10:50.140672+0000","last_undegraded":"2024-05-08T18:10:50.140672+0000","last_fullsized":"2024-05-08T18:10:50.140672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'34","last_scrub_stamp":"2024-05-08T18:10:50.140470+0000","last_deep_scrub":"101'34","last_deep_scrub_stamp":"2024-05-08T18:10:50.140470+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.140470+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:43.667675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:43.138289+0000","last_change":"2024-05-08T18:10:43.138289+0000","last_active":"2024-05-08T18:10:43.138289+0000","last_peered":"2024-05-08T18:10:43.138289+0000","last_clean":"2024-05-08T18:10:43.138289+0000","last_became_active":"2024-05-08T18:07:09.429430+0000","last_became_peered":"2024-05-08T18:07:09.429430+0000","last_unstale":"2024-05-08T18:10:43.138289+0000","last_undegraded":"2024-05-08T18:10:43.138289+0000","last_fullsized":"2024-05-08T18:10:43.138289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:43.138023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:43.138023+0000","last_clean_scrub_stamp":"2024-05-08T18:10:43.138023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:03.721891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"120'18","reported_seq":244,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:00.084257+0000","last_change":"2024-05-08T18:11:00.084257+0000","last_active":"2024-05-08T18:11:00.084257+0000","last_peered":"2024-05-08T18:11:00.084257+0000","last_clean":"2024-05-08T18:11:00.084257+0000","last_became_active":"2024-05-08T18:07:15.476055+0000","last_became_peered":"2024-05-08T18:07:15.476055+0000","last_unstale":"2024-05-08T18:11:00.084257+0000","last_undegraded":"2024-05-08T18:11:00.084257+0000","last_fullsized":"2024-05-08T18:11:00.084257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:11:00.083982+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:11:00.083982+0000","last_clean_scrub_stamp":"2024-05-08T18:11:00.083982+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:37.640499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":28678,"num_write":28,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"120'2","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:50.992993+0000","last_change":"2024-05-08T18:10:50.993068+0000","last_active":"2024-05-08T18:10:50.992993+0000","last_peered":"2024-05-08T18:10:50.992993+0000","last_clean":"2024-05-08T18:10:50.992993+0000","last_became_active":"2024-05-08T18:07:19.540531+0000","last_became_peered":"2024-05-08T18:07:19.540531+0000","last_unstale":"2024-05-08T18:10:50.992993+0000","last_undegraded":"2024-05-08T18:10:50.992993+0000","last_fullsized":"2024-05-08T18:10:50.992993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'2","last_scrub_stamp":"2024-05-08T18:10:50.992795+0000","last_deep_scrub":"120'2","last_deep_scrub_stamp":"2024-05-08T18:10:50.992795+0000","last_clean_scrub_stamp":"2024-05-08T18:10:50.992795+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:11:03.808140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"120'23","reported_seq":272,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:55.953009+0000","last_change":"2024-05-08T18:10:55.953097+0000","last_active":"2024-05-08T18:10:55.953009+0000","last_peered":"2024-05-08T18:10:55.953009+0000","last_clean":"2024-05-08T18:10:55.953009+0000","last_became_active":"2024-05-08T18:07:21.552121+0000","last_became_peered":"2024-05-08T18:07:21.552121+0000","last_unstale":"2024-05-08T18:10:55.953009+0000","last_undegraded":"2024-05-08T18:10:55.953009+0000","last_fullsized":"2024-05-08T18:10:55.953009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'23","last_scrub_stamp":"2024-05-08T18:10:55.952816+0000","last_deep_scrub":"120'23","last_deep_scrub_stamp":"2024-05-08T18:10:55.952816+0000","last_clean_scrub_stamp":"2024-05-08T18:10:55.952816+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:27:44.957338+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:41.697919+0000","last_change":"2024-05-08T18:10:41.697959+0000","last_active":"2024-05-08T18:10:41.697919+0000","last_peered":"2024-05-08T18:10:41.697919+0000","last_clean":"2024-05-08T18:10:41.697919+0000","last_became_active":"2024-05-08T18:07:23.543352+0000","last_became_peered":"2024-05-08T18:07:23.543352+0000","last_unstale":"2024-05-08T18:10:41.697919+0000","last_undegraded":"2024-05-08T18:10:41.697919+0000","last_fullsized":"2024-05-08T18:10:41.697919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:41.697770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:41.697770+0000","last_clean_scrub_stamp":"2024-05-08T18:10:41.697770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.224976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:44.647296+0000","last_change":"2024-05-08T18:10:44.647461+0000","last_active":"2024-05-08T18:10:44.647296+0000","last_peered":"2024-05-08T18:10:44.647296+0000","last_clean":"2024-05-08T18:10:44.647296+0000","last_became_active":"2024-05-08T18:07:25.552900+0000","last_became_peered":"2024-05-08T18:07:25.552900+0000","last_unstale":"2024-05-08T18:10:44.647296+0000","last_undegraded":"2024-05-08T18:10:44.647296+0000","last_fullsized":"2024-05-08T18:10:44.647296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:44.647052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:44.647052+0000","last_clean_scrub_stamp":"2024-05-08T18:10:44.647052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:35.598330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"90'6","reported_seq":220,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:48.108424+0000","last_change":"2024-05-08T18:10:48.108484+0000","last_active":"2024-05-08T18:10:48.108424+0000","last_peered":"2024-05-08T18:10:48.108424+0000","last_clean":"2024-05-08T18:10:48.108424+0000","last_became_active":"2024-05-08T18:07:17.510483+0000","last_became_peered":"2024-05-08T18:07:17.510483+0000","last_unstale":"2024-05-08T18:10:48.108424+0000","last_undegraded":"2024-05-08T18:10:48.108424+0000","last_fullsized":"2024-05-08T18:10:48.108424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-05-08T18:10:48.108173+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-05-08T18:10:48.108173+0000","last_clean_scrub_stamp":"2024-05-08T18:10:48.108173+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:44.549713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:00.753525+0000","last_change":"2024-05-08T18:11:00.753579+0000","last_active":"2024-05-08T18:11:00.753525+0000","last_peered":"2024-05-08T18:11:00.753525+0000","last_clean":"2024-05-08T18:11:00.753525+0000","last_became_active":"2024-05-08T18:07:09.428408+0000","last_became_peered":"2024-05-08T18:07:09.428408+0000","last_unstale":"2024-05-08T18:11:00.753525+0000","last_undegraded":"2024-05-08T18:11:00.753525+0000","last_fullsized":"2024-05-08T18:11:00.753525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:00.753334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:00.753334+0000","last_clean_scrub_stamp":"2024-05-08T18:11:00.753334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:24.320567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"120'28","reported_seq":262,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:04.726453+0000","last_change":"2024-05-08T18:11:04.726513+0000","last_active":"2024-05-08T18:11:04.726453+0000","last_peered":"2024-05-08T18:11:04.726453+0000","last_clean":"2024-05-08T18:11:04.726453+0000","last_became_active":"2024-05-08T18:07:15.499953+0000","last_became_peered":"2024-05-08T18:07:15.499953+0000","last_unstale":"2024-05-08T18:11:04.726453+0000","last_undegraded":"2024-05-08T18:11:04.726453+0000","last_fullsized":"2024-05-08T18:11:04.726453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'28","last_scrub_stamp":"2024-05-08T18:11:04.726237+0000","last_deep_scrub":"120'28","last_deep_scrub_stamp":"2024-05-08T18:11:04.726237+0000","last_clean_scrub_stamp":"2024-05-08T18:11:04.726237+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:04.046501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":55314,"num_write":58,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:52.620824+0000","last_change":"2024-05-08T18:10:52.620876+0000","last_active":"2024-05-08T18:10:52.620824+0000","last_peered":"2024-05-08T18:10:52.620824+0000","last_clean":"2024-05-08T18:10:52.620824+0000","last_became_active":"2024-05-08T18:07:19.534113+0000","last_became_peered":"2024-05-08T18:07:19.534113+0000","last_unstale":"2024-05-08T18:10:52.620824+0000","last_undegraded":"2024-05-08T18:10:52.620824+0000","last_fullsized":"2024-05-08T18:10:52.620824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:52.620633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:52.620633+0000","last_clean_scrub_stamp":"2024-05-08T18:10:52.620633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:49.130797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"120'18","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.673713+0000","last_change":"2024-05-08T18:10:49.673808+0000","last_active":"2024-05-08T18:10:49.673713+0000","last_peered":"2024-05-08T18:10:49.673713+0000","last_clean":"2024-05-08T18:10:49.673713+0000","last_became_active":"2024-05-08T18:07:21.550134+0000","last_became_peered":"2024-05-08T18:07:21.550134+0000","last_unstale":"2024-05-08T18:10:49.673713+0000","last_undegraded":"2024-05-08T18:10:49.673713+0000","last_fullsized":"2024-05-08T18:10:49.673713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:10:49.673510+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:10:49.673510+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.673510+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:47.685064+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.225012+0000","last_change":"2024-05-08T18:11:01.225064+0000","last_active":"2024-05-08T18:11:01.225012+0000","last_peered":"2024-05-08T18:11:01.225012+0000","last_clean":"2024-05-08T18:11:01.225012+0000","last_became_active":"2024-05-08T18:07:23.562334+0000","last_became_peered":"2024-05-08T18:07:23.562334+0000","last_unstale":"2024-05-08T18:11:01.225012+0000","last_undegraded":"2024-05-08T18:11:01.225012+0000","last_fullsized":"2024-05-08T18:11:01.225012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:01.224781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:01.224781+0000","last_clean_scrub_stamp":"2024-05-08T18:11:01.224781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:02:12.281543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.740833+0000","last_change":"2024-05-08T18:11:11.740895+0000","last_active":"2024-05-08T18:11:11.740833+0000","last_peered":"2024-05-08T18:11:11.740833+0000","last_clean":"2024-05-08T18:11:11.740833+0000","last_became_active":"2024-05-08T18:07:25.573266+0000","last_became_peered":"2024-05-08T18:07:25.573266+0000","last_unstale":"2024-05-08T18:11:11.740833+0000","last_undegraded":"2024-05-08T18:11:11.740833+0000","last_fullsized":"2024-05-08T18:11:11.740833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:11.740634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:11.740634+0000","last_clean_scrub_stamp":"2024-05-08T18:11:11.740634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:46.655934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"90'10","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:52.124026+0000","last_change":"2024-05-08T18:10:52.124191+0000","last_active":"2024-05-08T18:10:52.124026+0000","last_peered":"2024-05-08T18:10:52.124026+0000","last_clean":"2024-05-08T18:10:52.124026+0000","last_became_active":"2024-05-08T18:07:17.510050+0000","last_became_peered":"2024-05-08T18:07:17.510050+0000","last_unstale":"2024-05-08T18:10:52.124026+0000","last_undegraded":"2024-05-08T18:10:52.124026+0000","last_fullsized":"2024-05-08T18:10:52.124026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'10","last_scrub_stamp":"2024-05-08T18:10:52.123792+0000","last_deep_scrub":"90'10","last_deep_scrub_stamp":"2024-05-08T18:10:52.123792+0000","last_clean_scrub_stamp":"2024-05-08T18:10:52.123792+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:46.984693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"120'14","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:04.692386+0000","last_change":"2024-05-08T18:11:04.692452+0000","last_active":"2024-05-08T18:11:04.692386+0000","last_peered":"2024-05-08T18:11:04.692386+0000","last_clean":"2024-05-08T18:11:04.692386+0000","last_became_active":"2024-05-08T18:07:15.476821+0000","last_became_peered":"2024-05-08T18:07:15.476821+0000","last_unstale":"2024-05-08T18:11:04.692386+0000","last_undegraded":"2024-05-08T18:11:04.692386+0000","last_fullsized":"2024-05-08T18:11:04.692386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'14","last_scrub_stamp":"2024-05-08T18:11:04.692161+0000","last_deep_scrub":"120'14","last_deep_scrub_stamp":"2024-05-08T18:11:04.692161+0000","last_clean_scrub_stamp":"2024-05-08T18:11:04.692161+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:57.872433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":22528,"num_write":14,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":222,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.119757+0000","last_change":"2024-05-08T18:10:56.119757+0000","last_active":"2024-05-08T18:10:56.119757+0000","last_peered":"2024-05-08T18:10:56.119757+0000","last_clean":"2024-05-08T18:10:56.119757+0000","last_became_active":"2024-05-08T18:07:09.435169+0000","last_became_peered":"2024-05-08T18:07:09.435169+0000","last_unstale":"2024-05-08T18:10:56.119757+0000","last_undegraded":"2024-05-08T18:10:56.119757+0000","last_fullsized":"2024-05-08T18:10:56.119757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:56.119502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:56.119502+0000","last_clean_scrub_stamp":"2024-05-08T18:10:56.119502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:47.070779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.552272+0000","last_change":"2024-05-08T18:10:56.552364+0000","last_active":"2024-05-08T18:10:56.552272+0000","last_peered":"2024-05-08T18:10:56.552272+0000","last_clean":"2024-05-08T18:10:56.552272+0000","last_became_active":"2024-05-08T18:07:19.547380+0000","last_became_peered":"2024-05-08T18:07:19.547380+0000","last_unstale":"2024-05-08T18:10:56.552272+0000","last_undegraded":"2024-05-08T18:10:56.552272+0000","last_fullsized":"2024-05-08T18:10:56.552272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:56.552062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:56.552062+0000","last_clean_scrub_stamp":"2024-05-08T18:10:56.552062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:20.119295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"120'46","reported_seq":272,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:58.587597+0000","last_change":"2024-05-08T18:10:58.587597+0000","last_active":"2024-05-08T18:10:58.587597+0000","last_peered":"2024-05-08T18:10:58.587597+0000","last_clean":"2024-05-08T18:10:58.587597+0000","last_became_active":"2024-05-08T18:07:21.544688+0000","last_became_peered":"2024-05-08T18:07:21.544688+0000","last_unstale":"2024-05-08T18:10:58.587597+0000","last_undegraded":"2024-05-08T18:10:58.587597+0000","last_fullsized":"2024-05-08T18:10:58.587597+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'46","last_scrub_stamp":"2024-05-08T18:10:58.587330+0000","last_deep_scrub":"120'46","last_deep_scrub_stamp":"2024-05-08T18:10:58.587330+0000","last_clean_scrub_stamp":"2024-05-08T18:10:58.587330+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:02.404896+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":72,"num_read_kb":104,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:10.686749+0000","last_change":"2024-05-08T18:11:10.686804+0000","last_active":"2024-05-08T18:11:10.686749+0000","last_peered":"2024-05-08T18:11:10.686749+0000","last_clean":"2024-05-08T18:11:10.686749+0000","last_became_active":"2024-05-08T18:07:23.545852+0000","last_became_peered":"2024-05-08T18:07:23.545852+0000","last_unstale":"2024-05-08T18:11:10.686749+0000","last_undegraded":"2024-05-08T18:11:10.686749+0000","last_fullsized":"2024-05-08T18:11:10.686749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:10.686523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:10.686523+0000","last_clean_scrub_stamp":"2024-05-08T18:11:10.686523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:25.577302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"90'2","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:17.571824+0000","last_change":"2024-05-08T18:11:17.571999+0000","last_active":"2024-05-08T18:11:17.571824+0000","last_peered":"2024-05-08T18:11:17.571824+0000","last_clean":"2024-05-08T18:11:17.571824+0000","last_became_active":"2024-05-08T18:07:25.657480+0000","last_became_peered":"2024-05-08T18:07:25.657480+0000","last_unstale":"2024-05-08T18:11:17.571824+0000","last_undegraded":"2024-05-08T18:11:17.571824+0000","last_fullsized":"2024-05-08T18:11:17.571824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'2","last_scrub_stamp":"2024-05-08T18:11:17.571536+0000","last_deep_scrub":"90'2","last_deep_scrub_stamp":"2024-05-08T18:11:17.571536+0000","last_clean_scrub_stamp":"2024-05-08T18:11:17.571536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:04.472782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"101'42","reported_seq":256,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:48.610164+0000","last_change":"2024-05-08T18:10:48.610229+0000","last_active":"2024-05-08T18:10:48.610164+0000","last_peered":"2024-05-08T18:10:48.610164+0000","last_clean":"2024-05-08T18:10:48.610164+0000","last_became_active":"2024-05-08T18:07:17.514212+0000","last_became_peered":"2024-05-08T18:07:17.514212+0000","last_unstale":"2024-05-08T18:10:48.610164+0000","last_undegraded":"2024-05-08T18:10:48.610164+0000","last_fullsized":"2024-05-08T18:10:48.610164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'42","last_scrub_stamp":"2024-05-08T18:10:48.609963+0000","last_deep_scrub":"101'42","last_deep_scrub_stamp":"2024-05-08T18:10:48.609963+0000","last_clean_scrub_stamp":"2024-05-08T18:10:48.609963+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:27.816221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"120'18","reported_seq":244,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.034924+0000","last_change":"2024-05-08T18:10:59.034994+0000","last_active":"2024-05-08T18:10:59.034924+0000","last_peered":"2024-05-08T18:10:59.034924+0000","last_clean":"2024-05-08T18:10:59.034924+0000","last_became_active":"2024-05-08T18:07:15.474523+0000","last_became_peered":"2024-05-08T18:07:15.474523+0000","last_unstale":"2024-05-08T18:10:59.034924+0000","last_undegraded":"2024-05-08T18:10:59.034924+0000","last_fullsized":"2024-05-08T18:10:59.034924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:10:59.034708+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:10:59.034708+0000","last_clean_scrub_stamp":"2024-05-08T18:10:59.034708+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:00.972632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.975737+0000","last_change":"2024-05-08T18:11:01.975737+0000","last_active":"2024-05-08T18:11:01.975737+0000","last_peered":"2024-05-08T18:11:01.975737+0000","last_clean":"2024-05-08T18:11:01.975737+0000","last_became_active":"2024-05-08T18:07:09.434809+0000","last_became_peered":"2024-05-08T18:07:09.434809+0000","last_unstale":"2024-05-08T18:11:01.975737+0000","last_undegraded":"2024-05-08T18:11:01.975737+0000","last_fullsized":"2024-05-08T18:11:01.975737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:01.975351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:01.975351+0000","last_clean_scrub_stamp":"2024-05-08T18:11:01.975351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:21.999873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":206,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:43.304395+0000","last_change":"2024-05-08T18:10:43.304449+0000","last_active":"2024-05-08T18:10:43.304395+0000","last_peered":"2024-05-08T18:10:43.304395+0000","last_clean":"2024-05-08T18:10:43.304395+0000","last_became_active":"2024-05-08T18:07:19.541039+0000","last_became_peered":"2024-05-08T18:07:19.541039+0000","last_unstale":"2024-05-08T18:10:43.304395+0000","last_undegraded":"2024-05-08T18:10:43.304395+0000","last_fullsized":"2024-05-08T18:10:43.304395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:43.304196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:43.304196+0000","last_clean_scrub_stamp":"2024-05-08T18:10:43.304196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:32.179673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"120'21","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.165427+0000","last_change":"2024-05-08T18:10:47.165506+0000","last_active":"2024-05-08T18:10:47.165427+0000","last_peered":"2024-05-08T18:10:47.165427+0000","last_clean":"2024-05-08T18:10:47.165427+0000","last_became_active":"2024-05-08T18:07:21.526873+0000","last_became_peered":"2024-05-08T18:07:21.526873+0000","last_unstale":"2024-05-08T18:10:47.165427+0000","last_undegraded":"2024-05-08T18:10:47.165427+0000","last_fullsized":"2024-05-08T18:10:47.165427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'21","last_scrub_stamp":"2024-05-08T18:10:47.165223+0000","last_deep_scrub":"120'21","last_deep_scrub_stamp":"2024-05-08T18:10:47.165223+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.165223+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:43.461225+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"120'19","reported_seq":255,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:09.730216+0000","last_change":"2024-05-08T18:11:09.730286+0000","last_active":"2024-05-08T18:11:09.730216+0000","last_peered":"2024-05-08T18:11:09.730216+0000","last_clean":"2024-05-08T18:11:09.730216+0000","last_became_active":"2024-05-08T18:07:23.548975+0000","last_became_peered":"2024-05-08T18:07:23.548975+0000","last_unstale":"2024-05-08T18:11:09.730216+0000","last_undegraded":"2024-05-08T18:11:09.730216+0000","last_fullsized":"2024-05-08T18:11:09.730216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'19","last_scrub_stamp":"2024-05-08T18:11:09.730030+0000","last_deep_scrub":"120'19","last_deep_scrub_stamp":"2024-05-08T18:11:09.730030+0000","last_clean_scrub_stamp":"2024-05-08T18:11:09.730030+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:17.104855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"101'4","reported_seq":204,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:17.655845+0000","last_change":"2024-05-08T18:11:17.655910+0000","last_active":"2024-05-08T18:11:17.655845+0000","last_peered":"2024-05-08T18:11:17.655845+0000","last_clean":"2024-05-08T18:11:17.655845+0000","last_became_active":"2024-05-08T18:07:25.653019+0000","last_became_peered":"2024-05-08T18:07:25.653019+0000","last_unstale":"2024-05-08T18:11:17.655845+0000","last_undegraded":"2024-05-08T18:11:17.655845+0000","last_fullsized":"2024-05-08T18:11:17.655845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'4","last_scrub_stamp":"2024-05-08T18:11:17.655624+0000","last_deep_scrub":"101'4","last_deep_scrub_stamp":"2024-05-08T18:11:17.655624+0000","last_clean_scrub_stamp":"2024-05-08T18:11:17.655624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:56.174800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":215,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:55.622539+0000","last_change":"2024-05-08T18:10:55.622539+0000","last_active":"2024-05-08T18:10:55.622539+0000","last_peered":"2024-05-08T18:10:55.622539+0000","last_clean":"2024-05-08T18:10:55.622539+0000","last_became_active":"2024-05-08T18:07:17.509771+0000","last_became_peered":"2024-05-08T18:07:17.509771+0000","last_unstale":"2024-05-08T18:10:55.622539+0000","last_undegraded":"2024-05-08T18:10:55.622539+0000","last_fullsized":"2024-05-08T18:10:55.622539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:55.622289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:55.622289+0000","last_clean_scrub_stamp":"2024-05-08T18:10:55.622289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:10:12.808947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"120'18","reported_seq":246,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:05.539331+0000","last_change":"2024-05-08T18:11:05.539450+0000","last_active":"2024-05-08T18:11:05.539331+0000","last_peered":"2024-05-08T18:11:05.539331+0000","last_clean":"2024-05-08T18:11:05.539331+0000","last_became_active":"2024-05-08T18:07:15.508138+0000","last_became_peered":"2024-05-08T18:07:15.508138+0000","last_unstale":"2024-05-08T18:11:05.539331+0000","last_undegraded":"2024-05-08T18:11:05.539331+0000","last_fullsized":"2024-05-08T18:11:05.539331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:11:05.539037+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:11:05.539037+0000","last_clean_scrub_stamp":"2024-05-08T18:11:05.539037+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:40.454337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32774,"num_write":28,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:55.133292+0000","last_change":"2024-05-08T18:10:55.133344+0000","last_active":"2024-05-08T18:10:55.133292+0000","last_peered":"2024-05-08T18:10:55.133292+0000","last_clean":"2024-05-08T18:10:55.133292+0000","last_became_active":"2024-05-08T18:07:09.432151+0000","last_became_peered":"2024-05-08T18:07:09.432151+0000","last_unstale":"2024-05-08T18:10:55.133292+0000","last_undegraded":"2024-05-08T18:10:55.133292+0000","last_fullsized":"2024-05-08T18:10:55.133292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:55.133101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:55.133101+0000","last_clean_scrub_stamp":"2024-05-08T18:10:55.133101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:41.641093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:53.752564+0000","last_change":"2024-05-08T18:10:53.752668+0000","last_active":"2024-05-08T18:10:53.752564+0000","last_peered":"2024-05-08T18:10:53.752564+0000","last_clean":"2024-05-08T18:10:53.752564+0000","last_became_active":"2024-05-08T18:07:19.523829+0000","last_became_peered":"2024-05-08T18:07:19.523829+0000","last_unstale":"2024-05-08T18:10:53.752564+0000","last_undegraded":"2024-05-08T18:10:53.752564+0000","last_fullsized":"2024-05-08T18:10:53.752564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:53.752242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:53.752242+0000","last_clean_scrub_stamp":"2024-05-08T18:10:53.752242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:53.589599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"120'15","reported_seq":225,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:09.687522+0000","last_change":"2024-05-08T18:11:09.687598+0000","last_active":"2024-05-08T18:11:09.687522+0000","last_peered":"2024-05-08T18:11:09.687522+0000","last_clean":"2024-05-08T18:11:09.687522+0000","last_became_active":"2024-05-08T18:07:21.547327+0000","last_became_peered":"2024-05-08T18:07:21.547327+0000","last_unstale":"2024-05-08T18:11:09.687522+0000","last_undegraded":"2024-05-08T18:11:09.687522+0000","last_fullsized":"2024-05-08T18:11:09.687522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'15","last_scrub_stamp":"2024-05-08T18:11:09.687343+0000","last_deep_scrub":"120'15","last_deep_scrub_stamp":"2024-05-08T18:11:09.687343+0000","last_clean_scrub_stamp":"2024-05-08T18:11:09.687343+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:43.079523+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"120'18","reported_seq":273,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:40.714243+0000","last_change":"2024-05-08T18:10:40.714283+0000","last_active":"2024-05-08T18:10:40.714243+0000","last_peered":"2024-05-08T18:10:40.714243+0000","last_clean":"2024-05-08T18:10:40.714243+0000","last_became_active":"2024-05-08T18:07:23.554228+0000","last_became_peered":"2024-05-08T18:07:23.554228+0000","last_unstale":"2024-05-08T18:10:40.714243+0000","last_undegraded":"2024-05-08T18:10:40.714243+0000","last_fullsized":"2024-05-08T18:10:40.714243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:10:40.714154+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:10:40.714154+0000","last_clean_scrub_stamp":"2024-05-08T18:10:40.714154+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:03.975309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:13.482039+0000","last_change":"2024-05-08T18:11:13.482100+0000","last_active":"2024-05-08T18:11:13.482039+0000","last_peered":"2024-05-08T18:11:13.482039+0000","last_clean":"2024-05-08T18:11:13.482039+0000","last_became_active":"2024-05-08T18:07:25.565690+0000","last_became_peered":"2024-05-08T18:07:25.565690+0000","last_unstale":"2024-05-08T18:11:13.482039+0000","last_undegraded":"2024-05-08T18:11:13.482039+0000","last_fullsized":"2024-05-08T18:11:13.482039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:13.481801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:13.481801+0000","last_clean_scrub_stamp":"2024-05-08T18:11:13.481801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:32:24.575830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:54.716189+0000","last_change":"2024-05-08T18:10:54.716247+0000","last_active":"2024-05-08T18:10:54.716189+0000","last_peered":"2024-05-08T18:10:54.716189+0000","last_clean":"2024-05-08T18:10:54.716189+0000","last_became_active":"2024-05-08T18:07:17.508027+0000","last_became_peered":"2024-05-08T18:07:17.508027+0000","last_unstale":"2024-05-08T18:10:54.716189+0000","last_undegraded":"2024-05-08T18:10:54.716189+0000","last_fullsized":"2024-05-08T18:10:54.716189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:54.715997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:54.715997+0000","last_clean_scrub_stamp":"2024-05-08T18:10:54.715997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:56.653920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"120'22","reported_seq":254,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:09.567087+0000","last_change":"2024-05-08T18:11:09.567150+0000","last_active":"2024-05-08T18:11:09.567087+0000","last_peered":"2024-05-08T18:11:09.567087+0000","last_clean":"2024-05-08T18:11:09.567087+0000","last_became_active":"2024-05-08T18:07:15.498699+0000","last_became_peered":"2024-05-08T18:07:15.498699+0000","last_unstale":"2024-05-08T18:11:09.567087+0000","last_undegraded":"2024-05-08T18:11:09.567087+0000","last_fullsized":"2024-05-08T18:11:09.567087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'22","last_scrub_stamp":"2024-05-08T18:11:09.566902+0000","last_deep_scrub":"120'22","last_deep_scrub_stamp":"2024-05-08T18:11:09.566902+0000","last_clean_scrub_stamp":"2024-05-08T18:11:09.566902+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:06.787398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":40996,"num_write":82,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.301961+0000","last_change":"2024-05-08T18:10:51.302073+0000","last_active":"2024-05-08T18:10:51.301961+0000","last_peered":"2024-05-08T18:10:51.301961+0000","last_clean":"2024-05-08T18:10:51.301961+0000","last_became_active":"2024-05-08T18:07:09.433775+0000","last_became_peered":"2024-05-08T18:07:09.433775+0000","last_unstale":"2024-05-08T18:10:51.301961+0000","last_undegraded":"2024-05-08T18:10:51.301961+0000","last_fullsized":"2024-05-08T18:10:51.301961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:51.301730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:51.301730+0000","last_clean_scrub_stamp":"2024-05-08T18:10:51.301730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:42.506018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:54.658560+0000","last_change":"2024-05-08T18:10:54.658560+0000","last_active":"2024-05-08T18:10:54.658560+0000","last_peered":"2024-05-08T18:10:54.658560+0000","last_clean":"2024-05-08T18:10:54.658560+0000","last_became_active":"2024-05-08T18:07:19.525267+0000","last_became_peered":"2024-05-08T18:07:19.525267+0000","last_unstale":"2024-05-08T18:10:54.658560+0000","last_undegraded":"2024-05-08T18:10:54.658560+0000","last_fullsized":"2024-05-08T18:10:54.658560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:54.658256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:54.658256+0000","last_clean_scrub_stamp":"2024-05-08T18:10:54.658256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:47.419080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"120'59","reported_seq":294,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:42.811402+0000","last_change":"2024-05-08T18:10:42.811545+0000","last_active":"2024-05-08T18:10:42.811402+0000","last_peered":"2024-05-08T18:10:42.811402+0000","last_clean":"2024-05-08T18:10:42.811402+0000","last_became_active":"2024-05-08T18:07:21.556330+0000","last_became_peered":"2024-05-08T18:07:21.556330+0000","last_unstale":"2024-05-08T18:10:42.811402+0000","last_undegraded":"2024-05-08T18:10:42.811402+0000","last_fullsized":"2024-05-08T18:10:42.811402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'59","last_scrub_stamp":"2024-05-08T18:10:42.811173+0000","last_deep_scrub":"120'59","last_deep_scrub_stamp":"2024-05-08T18:10:42.811173+0000","last_clean_scrub_stamp":"2024-05-08T18:10:42.811173+0000","objects_scrubbed":8,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:58:31.066154+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":100,"num_read_kb":182,"num_write":68,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.628667+0000","last_change":"2024-05-08T18:10:45.628728+0000","last_active":"2024-05-08T18:10:45.628667+0000","last_peered":"2024-05-08T18:10:45.628667+0000","last_clean":"2024-05-08T18:10:45.628667+0000","last_became_active":"2024-05-08T18:07:23.545340+0000","last_became_peered":"2024-05-08T18:07:23.545340+0000","last_unstale":"2024-05-08T18:10:45.628667+0000","last_undegraded":"2024-05-08T18:10:45.628667+0000","last_fullsized":"2024-05-08T18:10:45.628667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:45.628470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:45.628470+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.628470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:27:34.632992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:14.711186+0000","last_change":"2024-05-08T18:11:14.711239+0000","last_active":"2024-05-08T18:11:14.711186+0000","last_peered":"2024-05-08T18:11:14.711186+0000","last_clean":"2024-05-08T18:11:14.711186+0000","last_became_active":"2024-05-08T18:07:25.579789+0000","last_became_peered":"2024-05-08T18:07:25.579789+0000","last_unstale":"2024-05-08T18:11:14.711186+0000","last_undegraded":"2024-05-08T18:11:14.711186+0000","last_fullsized":"2024-05-08T18:11:14.711186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:14.710995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:14.710995+0000","last_clean_scrub_stamp":"2024-05-08T18:11:14.710995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:04.692335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.540749+0000","last_change":"2024-05-08T18:11:16.540804+0000","last_active":"2024-05-08T18:11:16.540749+0000","last_peered":"2024-05-08T18:11:16.540749+0000","last_clean":"2024-05-08T18:11:16.540749+0000","last_became_active":"2024-05-08T18:07:25.581343+0000","last_became_peered":"2024-05-08T18:07:25.581343+0000","last_unstale":"2024-05-08T18:11:16.540749+0000","last_undegraded":"2024-05-08T18:11:16.540749+0000","last_fullsized":"2024-05-08T18:11:16.540749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:16.540561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:16.540561+0000","last_clean_scrub_stamp":"2024-05-08T18:11:16.540561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.141867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"101'34","reported_seq":250,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.802940+0000","last_change":"2024-05-08T18:10:47.803077+0000","last_active":"2024-05-08T18:10:47.802940+0000","last_peered":"2024-05-08T18:10:47.802940+0000","last_clean":"2024-05-08T18:10:47.802940+0000","last_became_active":"2024-05-08T18:07:17.523185+0000","last_became_peered":"2024-05-08T18:07:17.523185+0000","last_unstale":"2024-05-08T18:10:47.802940+0000","last_undegraded":"2024-05-08T18:10:47.802940+0000","last_fullsized":"2024-05-08T18:10:47.802940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'34","last_scrub_stamp":"2024-05-08T18:10:47.802675+0000","last_deep_scrub":"101'34","last_deep_scrub_stamp":"2024-05-08T18:10:47.802675+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.802675+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:27.492846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"120'10","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:05.739469+0000","last_change":"2024-05-08T18:11:05.739529+0000","last_active":"2024-05-08T18:11:05.739469+0000","last_peered":"2024-05-08T18:11:05.739469+0000","last_clean":"2024-05-08T18:11:05.739469+0000","last_became_active":"2024-05-08T18:07:15.512835+0000","last_became_peered":"2024-05-08T18:07:15.512835+0000","last_unstale":"2024-05-08T18:11:05.739469+0000","last_undegraded":"2024-05-08T18:11:05.739469+0000","last_fullsized":"2024-05-08T18:11:05.739469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'10","last_scrub_stamp":"2024-05-08T18:11:05.739283+0000","last_deep_scrub":"120'10","last_deep_scrub_stamp":"2024-05-08T18:11:05.739283+0000","last_clean_scrub_stamp":"2024-05-08T18:11:05.739283+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:04.275244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":18438,"num_write":20,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:43.189403+0000","last_change":"2024-05-08T18:10:43.189513+0000","last_active":"2024-05-08T18:10:43.189403+0000","last_peered":"2024-05-08T18:10:43.189403+0000","last_clean":"2024-05-08T18:10:43.189403+0000","last_became_active":"2024-05-08T18:07:19.529748+0000","last_became_peered":"2024-05-08T18:07:19.529748+0000","last_unstale":"2024-05-08T18:10:43.189403+0000","last_undegraded":"2024-05-08T18:10:43.189403+0000","last_fullsized":"2024-05-08T18:10:43.189403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:43.189176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:43.189176+0000","last_clean_scrub_stamp":"2024-05-08T18:10:43.189176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:34.393464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"120'26","reported_seq":244,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:04.511362+0000","last_change":"2024-05-08T18:11:04.511437+0000","last_active":"2024-05-08T18:11:04.511362+0000","last_peered":"2024-05-08T18:11:04.511362+0000","last_clean":"2024-05-08T18:11:04.511362+0000","last_became_active":"2024-05-08T18:07:21.541505+0000","last_became_peered":"2024-05-08T18:07:21.541505+0000","last_unstale":"2024-05-08T18:11:04.511362+0000","last_undegraded":"2024-05-08T18:11:04.511362+0000","last_fullsized":"2024-05-08T18:11:04.511362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'26","last_scrub_stamp":"2024-05-08T18:11:04.511145+0000","last_deep_scrub":"120'26","last_deep_scrub_stamp":"2024-05-08T18:11:04.511145+0000","last_clean_scrub_stamp":"2024-05-08T18:11:04.511145+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:49:32.578750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":64,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:42.737564+0000","last_change":"2024-05-08T18:10:42.737622+0000","last_active":"2024-05-08T18:10:42.737564+0000","last_peered":"2024-05-08T18:10:42.737564+0000","last_clean":"2024-05-08T18:10:42.737564+0000","last_became_active":"2024-05-08T18:07:23.549783+0000","last_became_peered":"2024-05-08T18:07:23.549783+0000","last_unstale":"2024-05-08T18:10:42.737564+0000","last_undegraded":"2024-05-08T18:10:42.737564+0000","last_fullsized":"2024-05-08T18:10:42.737564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:42.737373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:42.737373+0000","last_clean_scrub_stamp":"2024-05-08T18:10:42.737373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:30.981538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:48.617400+0000","last_change":"2024-05-08T18:10:48.617458+0000","last_active":"2024-05-08T18:10:48.617400+0000","last_peered":"2024-05-08T18:10:48.617400+0000","last_clean":"2024-05-08T18:10:48.617400+0000","last_became_active":"2024-05-08T18:07:25.564178+0000","last_became_peered":"2024-05-08T18:07:25.564178+0000","last_unstale":"2024-05-08T18:10:48.617400+0000","last_undegraded":"2024-05-08T18:10:48.617400+0000","last_fullsized":"2024-05-08T18:10:48.617400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:48.617200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:48.617200+0000","last_clean_scrub_stamp":"2024-05-08T18:10:48.617200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:09.818307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:42.198774+0000","last_change":"2024-05-08T18:10:42.198795+0000","last_active":"2024-05-08T18:10:42.198774+0000","last_peered":"2024-05-08T18:10:42.198774+0000","last_clean":"2024-05-08T18:10:42.198774+0000","last_became_active":"2024-05-08T18:07:17.517802+0000","last_became_peered":"2024-05-08T18:07:17.517802+0000","last_unstale":"2024-05-08T18:10:42.198774+0000","last_undegraded":"2024-05-08T18:10:42.198774+0000","last_fullsized":"2024-05-08T18:10:42.198774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:42.198695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:42.198695+0000","last_clean_scrub_stamp":"2024-05-08T18:10:42.198695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:53:40.462523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"120'24","reported_seq":258,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:04.993921+0000","last_change":"2024-05-08T18:11:04.994046+0000","last_active":"2024-05-08T18:11:04.993921+0000","last_peered":"2024-05-08T18:11:04.993921+0000","last_clean":"2024-05-08T18:11:04.993921+0000","last_became_active":"2024-05-08T18:07:15.507494+0000","last_became_peered":"2024-05-08T18:07:15.507494+0000","last_unstale":"2024-05-08T18:11:04.993921+0000","last_undegraded":"2024-05-08T18:11:04.993921+0000","last_fullsized":"2024-05-08T18:11:04.993921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'24","last_scrub_stamp":"2024-05-08T18:11:04.993723+0000","last_deep_scrub":"120'24","last_deep_scrub_stamp":"2024-05-08T18:11:04.993723+0000","last_clean_scrub_stamp":"2024-05-08T18:11:04.993723+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:57.754548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":47128,"num_write":64,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:58.576743+0000","last_change":"2024-05-08T18:10:58.576855+0000","last_active":"2024-05-08T18:10:58.576743+0000","last_peered":"2024-05-08T18:10:58.576743+0000","last_clean":"2024-05-08T18:10:58.576743+0000","last_became_active":"2024-05-08T18:07:19.537972+0000","last_became_peered":"2024-05-08T18:07:19.537972+0000","last_unstale":"2024-05-08T18:10:58.576743+0000","last_undegraded":"2024-05-08T18:10:58.576743+0000","last_fullsized":"2024-05-08T18:10:58.576743+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:58.576486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:58.576486+0000","last_clean_scrub_stamp":"2024-05-08T18:10:58.576486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:43:57.896751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"120'8","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:00.557445+0000","last_change":"2024-05-08T18:11:00.557532+0000","last_active":"2024-05-08T18:11:00.557445+0000","last_peered":"2024-05-08T18:11:00.557445+0000","last_clean":"2024-05-08T18:11:00.557445+0000","last_became_active":"2024-05-08T18:07:21.546832+0000","last_became_peered":"2024-05-08T18:07:21.546832+0000","last_unstale":"2024-05-08T18:11:00.557445+0000","last_undegraded":"2024-05-08T18:11:00.557445+0000","last_fullsized":"2024-05-08T18:11:00.557445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'8","last_scrub_stamp":"2024-05-08T18:11:00.557304+0000","last_deep_scrub":"120'8","last_deep_scrub_stamp":"2024-05-08T18:11:00.557304+0000","last_clean_scrub_stamp":"2024-05-08T18:11:00.557304+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:53.737576+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":202,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:10.878303+0000","last_change":"2024-05-08T18:11:10.878357+0000","last_active":"2024-05-08T18:11:10.878303+0000","last_peered":"2024-05-08T18:11:10.878303+0000","last_clean":"2024-05-08T18:11:10.878303+0000","last_became_active":"2024-05-08T18:07:23.557429+0000","last_became_peered":"2024-05-08T18:07:23.557429+0000","last_unstale":"2024-05-08T18:11:10.878303+0000","last_undegraded":"2024-05-08T18:11:10.878303+0000","last_fullsized":"2024-05-08T18:11:10.878303+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:10.878106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:10.878106+0000","last_clean_scrub_stamp":"2024-05-08T18:11:10.878106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:44.098457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"90'2","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:12.519442+0000","last_change":"2024-05-08T18:11:12.519504+0000","last_active":"2024-05-08T18:11:12.519442+0000","last_peered":"2024-05-08T18:11:12.519442+0000","last_clean":"2024-05-08T18:11:12.519442+0000","last_became_active":"2024-05-08T18:07:25.562985+0000","last_became_peered":"2024-05-08T18:07:25.562985+0000","last_unstale":"2024-05-08T18:11:12.519442+0000","last_undegraded":"2024-05-08T18:11:12.519442+0000","last_fullsized":"2024-05-08T18:11:12.519442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'2","last_scrub_stamp":"2024-05-08T18:11:12.519185+0000","last_deep_scrub":"90'2","last_deep_scrub_stamp":"2024-05-08T18:11:12.519185+0000","last_clean_scrub_stamp":"2024-05-08T18:11:12.519185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:06.318071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.621439+0000","last_change":"2024-05-08T18:10:51.621494+0000","last_active":"2024-05-08T18:10:51.621439+0000","last_peered":"2024-05-08T18:10:51.621439+0000","last_clean":"2024-05-08T18:10:51.621439+0000","last_became_active":"2024-05-08T18:07:17.512424+0000","last_became_peered":"2024-05-08T18:07:17.512424+0000","last_unstale":"2024-05-08T18:10:51.621439+0000","last_undegraded":"2024-05-08T18:10:51.621439+0000","last_fullsized":"2024-05-08T18:10:51.621439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:51.621249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:51.621249+0000","last_clean_scrub_stamp":"2024-05-08T18:10:51.621249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:11.645771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"120'24","reported_seq":254,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:55.909564+0000","last_change":"2024-05-08T18:10:55.909625+0000","last_active":"2024-05-08T18:10:55.909564+0000","last_peered":"2024-05-08T18:10:55.909564+0000","last_clean":"2024-05-08T18:10:55.909564+0000","last_became_active":"2024-05-08T18:07:15.499885+0000","last_became_peered":"2024-05-08T18:07:15.499885+0000","last_unstale":"2024-05-08T18:10:55.909564+0000","last_undegraded":"2024-05-08T18:10:55.909564+0000","last_fullsized":"2024-05-08T18:10:55.909564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'24","last_scrub_stamp":"2024-05-08T18:10:55.909373+0000","last_deep_scrub":"120'24","last_deep_scrub_stamp":"2024-05-08T18:10:55.909373+0000","last_clean_scrub_stamp":"2024-05-08T18:10:55.909373+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:33.465890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":47122,"num_write":54,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.881814+0000","last_change":"2024-05-08T18:10:49.881874+0000","last_active":"2024-05-08T18:10:49.881814+0000","last_peered":"2024-05-08T18:10:49.881814+0000","last_clean":"2024-05-08T18:10:49.881814+0000","last_became_active":"2024-05-08T18:07:19.549144+0000","last_became_peered":"2024-05-08T18:07:19.549144+0000","last_unstale":"2024-05-08T18:10:49.881814+0000","last_undegraded":"2024-05-08T18:10:49.881814+0000","last_fullsized":"2024-05-08T18:10:49.881814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:49.881604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:49.881604+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.881604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:56.224174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"120'25","reported_seq":243,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:14.610215+0000","last_change":"2024-05-08T18:11:14.610300+0000","last_active":"2024-05-08T18:11:14.610215+0000","last_peered":"2024-05-08T18:11:14.610215+0000","last_clean":"2024-05-08T18:11:14.610215+0000","last_became_active":"2024-05-08T18:07:21.542789+0000","last_became_peered":"2024-05-08T18:07:21.542789+0000","last_unstale":"2024-05-08T18:11:14.610215+0000","last_undegraded":"2024-05-08T18:11:14.610215+0000","last_fullsized":"2024-05-08T18:11:14.610215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'25","last_scrub_stamp":"2024-05-08T18:11:14.610016+0000","last_deep_scrub":"120'25","last_deep_scrub_stamp":"2024-05-08T18:11:14.610016+0000","last_clean_scrub_stamp":"2024-05-08T18:11:14.610016+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:01.511261+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":42,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:00.257392+0000","last_change":"2024-05-08T18:11:00.257444+0000","last_active":"2024-05-08T18:11:00.257392+0000","last_peered":"2024-05-08T18:11:00.257392+0000","last_clean":"2024-05-08T18:11:00.257392+0000","last_became_active":"2024-05-08T18:07:23.557171+0000","last_became_peered":"2024-05-08T18:07:23.557171+0000","last_unstale":"2024-05-08T18:11:00.257392+0000","last_undegraded":"2024-05-08T18:11:00.257392+0000","last_fullsized":"2024-05-08T18:11:00.257392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:00.257192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:00.257192+0000","last_clean_scrub_stamp":"2024-05-08T18:11:00.257192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:55.118093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:15.687273+0000","last_change":"2024-05-08T18:11:15.687326+0000","last_active":"2024-05-08T18:11:15.687273+0000","last_peered":"2024-05-08T18:11:15.687273+0000","last_clean":"2024-05-08T18:11:15.687273+0000","last_became_active":"2024-05-08T18:07:25.580584+0000","last_became_peered":"2024-05-08T18:07:25.580584+0000","last_unstale":"2024-05-08T18:11:15.687273+0000","last_undegraded":"2024-05-08T18:11:15.687273+0000","last_fullsized":"2024-05-08T18:11:15.687273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:15.687076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:15.687076+0000","last_clean_scrub_stamp":"2024-05-08T18:11:15.687076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:28.470284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":219,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:20.656456+0000","last_change":"2024-05-08T18:11:20.656511+0000","last_active":"2024-05-08T18:11:20.656456+0000","last_peered":"2024-05-08T18:11:20.656456+0000","last_clean":"2024-05-08T18:11:20.656456+0000","last_became_active":"2024-05-08T18:07:55.358047+0000","last_became_peered":"2024-05-08T18:07:55.358047+0000","last_unstale":"2024-05-08T18:11:20.656456+0000","last_undegraded":"2024-05-08T18:11:20.656456+0000","last_fullsized":"2024-05-08T18:11:20.656456+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:20.656186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:20.656186+0000","last_clean_scrub_stamp":"2024-05-08T18:11:20.656186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:55:24.116684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"120'18","reported_seq":244,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:08.584217+0000","last_change":"2024-05-08T18:11:08.584326+0000","last_active":"2024-05-08T18:11:08.584217+0000","last_peered":"2024-05-08T18:11:08.584217+0000","last_clean":"2024-05-08T18:11:08.584217+0000","last_became_active":"2024-05-08T18:07:15.497334+0000","last_became_peered":"2024-05-08T18:07:15.497334+0000","last_unstale":"2024-05-08T18:11:08.584217+0000","last_undegraded":"2024-05-08T18:11:08.584217+0000","last_fullsized":"2024-05-08T18:11:08.584217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:11:08.584020+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:11:08.584020+0000","last_clean_scrub_stamp":"2024-05-08T18:11:08.584020+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:56.880966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32780,"num_write":38,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":206,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.263084+0000","last_change":"2024-05-08T18:10:45.263141+0000","last_active":"2024-05-08T18:10:45.263084+0000","last_peered":"2024-05-08T18:10:45.263084+0000","last_clean":"2024-05-08T18:10:45.263084+0000","last_became_active":"2024-05-08T18:07:19.541357+0000","last_became_peered":"2024-05-08T18:07:19.541357+0000","last_unstale":"2024-05-08T18:10:45.263084+0000","last_undegraded":"2024-05-08T18:10:45.263084+0000","last_fullsized":"2024-05-08T18:10:45.263084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:45.262891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:45.262891+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.262891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:52.219520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"120'22","reported_seq":239,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:53.953520+0000","last_change":"2024-05-08T18:10:53.953594+0000","last_active":"2024-05-08T18:10:53.953520+0000","last_peered":"2024-05-08T18:10:53.953520+0000","last_clean":"2024-05-08T18:10:53.953520+0000","last_became_active":"2024-05-08T18:07:21.551975+0000","last_became_peered":"2024-05-08T18:07:21.551975+0000","last_unstale":"2024-05-08T18:10:53.953520+0000","last_undegraded":"2024-05-08T18:10:53.953520+0000","last_fullsized":"2024-05-08T18:10:53.953520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'22","last_scrub_stamp":"2024-05-08T18:10:53.953336+0000","last_deep_scrub":"120'22","last_deep_scrub_stamp":"2024-05-08T18:10:53.953336+0000","last_clean_scrub_stamp":"2024-05-08T18:10:53.953336+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:40.461328+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":57,"num_write":22,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:42.681449+0000","last_change":"2024-05-08T18:10:42.681510+0000","last_active":"2024-05-08T18:10:42.681449+0000","last_peered":"2024-05-08T18:10:42.681449+0000","last_clean":"2024-05-08T18:10:42.681449+0000","last_became_active":"2024-05-08T18:07:23.544350+0000","last_became_peered":"2024-05-08T18:07:23.544350+0000","last_unstale":"2024-05-08T18:10:42.681449+0000","last_undegraded":"2024-05-08T18:10:42.681449+0000","last_fullsized":"2024-05-08T18:10:42.681449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:42.681220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:42.681220+0000","last_clean_scrub_stamp":"2024-05-08T18:10:42.681220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:22.371391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.295388+0000","last_change":"2024-05-08T18:10:46.295488+0000","last_active":"2024-05-08T18:10:46.295388+0000","last_peered":"2024-05-08T18:10:46.295388+0000","last_clean":"2024-05-08T18:10:46.295388+0000","last_became_active":"2024-05-08T18:07:17.516382+0000","last_became_peered":"2024-05-08T18:07:17.516382+0000","last_unstale":"2024-05-08T18:10:46.295388+0000","last_undegraded":"2024-05-08T18:10:46.295388+0000","last_fullsized":"2024-05-08T18:10:46.295388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:46.295155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:46.295155+0000","last_clean_scrub_stamp":"2024-05-08T18:10:46.295155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:10:59.110500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"120'18","reported_seq":247,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:10.557124+0000","last_change":"2024-05-08T18:11:10.557190+0000","last_active":"2024-05-08T18:11:10.557124+0000","last_peered":"2024-05-08T18:11:10.557124+0000","last_clean":"2024-05-08T18:11:10.557124+0000","last_became_active":"2024-05-08T18:07:15.490627+0000","last_became_peered":"2024-05-08T18:07:15.490627+0000","last_unstale":"2024-05-08T18:11:10.557124+0000","last_undegraded":"2024-05-08T18:11:10.557124+0000","last_fullsized":"2024-05-08T18:11:10.557124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:11:10.556900+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:11:10.556900+0000","last_clean_scrub_stamp":"2024-05-08T18:11:10.556900+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:47.521473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"120'2","reported_seq":221,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:54.578340+0000","last_change":"2024-05-08T18:10:54.578340+0000","last_active":"2024-05-08T18:10:54.578340+0000","last_peered":"2024-05-08T18:10:54.578340+0000","last_clean":"2024-05-08T18:10:54.578340+0000","last_became_active":"2024-05-08T18:07:19.540127+0000","last_became_peered":"2024-05-08T18:07:19.540127+0000","last_unstale":"2024-05-08T18:10:54.578340+0000","last_undegraded":"2024-05-08T18:10:54.578340+0000","last_fullsized":"2024-05-08T18:10:54.578340+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'2","last_scrub_stamp":"2024-05-08T18:10:54.578075+0000","last_deep_scrub":"120'2","last_deep_scrub_stamp":"2024-05-08T18:10:54.578075+0000","last_clean_scrub_stamp":"2024-05-08T18:10:54.578075+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:54.231297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"120'35","reported_seq":257,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.147306+0000","last_change":"2024-05-08T18:10:49.147382+0000","last_active":"2024-05-08T18:10:49.147306+0000","last_peered":"2024-05-08T18:10:49.147306+0000","last_clean":"2024-05-08T18:10:49.147306+0000","last_became_active":"2024-05-08T18:07:21.539065+0000","last_became_peered":"2024-05-08T18:07:21.539065+0000","last_unstale":"2024-05-08T18:10:49.147306+0000","last_undegraded":"2024-05-08T18:10:49.147306+0000","last_fullsized":"2024-05-08T18:10:49.147306+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'35","last_scrub_stamp":"2024-05-08T18:10:49.147125+0000","last_deep_scrub":"120'35","last_deep_scrub_stamp":"2024-05-08T18:10:49.147125+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.147125+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:28:12.661503+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":59,"num_read_kb":88,"num_write":38,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:43.051970+0000","last_change":"2024-05-08T18:10:43.052027+0000","last_active":"2024-05-08T18:10:43.051970+0000","last_peered":"2024-05-08T18:10:43.051970+0000","last_clean":"2024-05-08T18:10:43.051970+0000","last_became_active":"2024-05-08T18:07:23.549124+0000","last_became_peered":"2024-05-08T18:07:23.549124+0000","last_unstale":"2024-05-08T18:10:43.051970+0000","last_undegraded":"2024-05-08T18:10:43.051970+0000","last_fullsized":"2024-05-08T18:10:43.051970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:43.051770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:43.051770+0000","last_clean_scrub_stamp":"2024-05-08T18:10:43.051770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:39.347772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.641570+0000","last_change":"2024-05-08T18:11:16.641625+0000","last_active":"2024-05-08T18:11:16.641570+0000","last_peered":"2024-05-08T18:11:16.641570+0000","last_clean":"2024-05-08T18:11:16.641570+0000","last_became_active":"2024-05-08T18:07:25.652945+0000","last_became_peered":"2024-05-08T18:07:25.652945+0000","last_unstale":"2024-05-08T18:11:16.641570+0000","last_undegraded":"2024-05-08T18:11:16.641570+0000","last_fullsized":"2024-05-08T18:11:16.641570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:16.641369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:16.641369+0000","last_clean_scrub_stamp":"2024-05-08T18:11:16.641369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:52:20.280669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":212,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.574130+0000","last_change":"2024-05-08T18:10:47.574130+0000","last_active":"2024-05-08T18:10:47.574130+0000","last_peered":"2024-05-08T18:10:47.574130+0000","last_clean":"2024-05-08T18:10:47.574130+0000","last_became_active":"2024-05-08T18:07:17.513561+0000","last_became_peered":"2024-05-08T18:07:17.513561+0000","last_unstale":"2024-05-08T18:10:47.574130+0000","last_undegraded":"2024-05-08T18:10:47.574130+0000","last_fullsized":"2024-05-08T18:10:47.574130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:47.573733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:47.573733+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.573733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:38.525011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"120'6","reported_seq":224,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.092911+0000","last_change":"2024-05-08T18:10:57.092978+0000","last_active":"2024-05-08T18:10:57.092911+0000","last_peered":"2024-05-08T18:10:57.092911+0000","last_clean":"2024-05-08T18:10:57.092911+0000","last_became_active":"2024-05-08T18:07:15.471126+0000","last_became_peered":"2024-05-08T18:07:15.471126+0000","last_unstale":"2024-05-08T18:10:57.092911+0000","last_undegraded":"2024-05-08T18:10:57.092911+0000","last_fullsized":"2024-05-08T18:10:57.092911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'6","last_scrub_stamp":"2024-05-08T18:10:57.092694+0000","last_deep_scrub":"120'6","last_deep_scrub_stamp":"2024-05-08T18:10:57.092694+0000","last_clean_scrub_stamp":"2024-05-08T18:10:57.092694+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:36.298953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":205,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.299953+0000","last_change":"2024-05-08T18:10:47.300006+0000","last_active":"2024-05-08T18:10:47.299953+0000","last_peered":"2024-05-08T18:10:47.299953+0000","last_clean":"2024-05-08T18:10:47.299953+0000","last_became_active":"2024-05-08T18:07:19.543093+0000","last_became_peered":"2024-05-08T18:07:19.543093+0000","last_unstale":"2024-05-08T18:10:47.299953+0000","last_undegraded":"2024-05-08T18:10:47.299953+0000","last_fullsized":"2024-05-08T18:10:47.299953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:47.299766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:47.299766+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.299766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:40.714453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"120'28","reported_seq":248,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:41.858994+0000","last_change":"2024-05-08T18:10:41.859077+0000","last_active":"2024-05-08T18:10:41.858994+0000","last_peered":"2024-05-08T18:10:41.858994+0000","last_clean":"2024-05-08T18:10:41.858994+0000","last_became_active":"2024-05-08T18:07:21.555849+0000","last_became_peered":"2024-05-08T18:07:21.555849+0000","last_unstale":"2024-05-08T18:10:41.858994+0000","last_undegraded":"2024-05-08T18:10:41.858994+0000","last_fullsized":"2024-05-08T18:10:41.858994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'28","last_scrub_stamp":"2024-05-08T18:10:41.858807+0000","last_deep_scrub":"120'28","last_deep_scrub_stamp":"2024-05-08T18:10:41.858807+0000","last_clean_scrub_stamp":"2024-05-08T18:10:41.858807+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:00.706502+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:04.071488+0000","last_change":"2024-05-08T18:11:04.071546+0000","last_active":"2024-05-08T18:11:04.071488+0000","last_peered":"2024-05-08T18:11:04.071488+0000","last_clean":"2024-05-08T18:11:04.071488+0000","last_became_active":"2024-05-08T18:07:23.563095+0000","last_became_peered":"2024-05-08T18:07:23.563095+0000","last_unstale":"2024-05-08T18:11:04.071488+0000","last_undegraded":"2024-05-08T18:11:04.071488+0000","last_fullsized":"2024-05-08T18:11:04.071488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:04.071274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:04.071274+0000","last_clean_scrub_stamp":"2024-05-08T18:11:04.071274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:54.566803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":194,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:05.131085+0000","last_change":"2024-05-08T18:11:05.131143+0000","last_active":"2024-05-08T18:11:05.131085+0000","last_peered":"2024-05-08T18:11:05.131085+0000","last_clean":"2024-05-08T18:11:05.131085+0000","last_became_active":"2024-05-08T18:07:25.567654+0000","last_became_peered":"2024-05-08T18:07:25.567654+0000","last_unstale":"2024-05-08T18:11:05.131085+0000","last_undegraded":"2024-05-08T18:11:05.131085+0000","last_fullsized":"2024-05-08T18:11:05.131085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:05.130885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:05.130885+0000","last_clean_scrub_stamp":"2024-05-08T18:11:05.130885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:44.337144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.557820+0000","last_change":"2024-05-08T18:11:01.557875+0000","last_active":"2024-05-08T18:11:01.557820+0000","last_peered":"2024-05-08T18:11:01.557820+0000","last_clean":"2024-05-08T18:11:01.557820+0000","last_became_active":"2024-05-08T18:07:17.499483+0000","last_became_peered":"2024-05-08T18:07:17.499483+0000","last_unstale":"2024-05-08T18:11:01.557820+0000","last_undegraded":"2024-05-08T18:11:01.557820+0000","last_fullsized":"2024-05-08T18:11:01.557820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:01.557619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:01.557619+0000","last_clean_scrub_stamp":"2024-05-08T18:11:01.557619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:42.381738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"120'10","reported_seq":233,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.717626+0000","last_change":"2024-05-08T18:11:01.717705+0000","last_active":"2024-05-08T18:11:01.717626+0000","last_peered":"2024-05-08T18:11:01.717626+0000","last_clean":"2024-05-08T18:11:01.717626+0000","last_became_active":"2024-05-08T18:07:15.473982+0000","last_became_peered":"2024-05-08T18:07:15.473982+0000","last_unstale":"2024-05-08T18:11:01.717626+0000","last_undegraded":"2024-05-08T18:11:01.717626+0000","last_fullsized":"2024-05-08T18:11:01.717626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'10","last_scrub_stamp":"2024-05-08T18:11:01.717407+0000","last_deep_scrub":"120'10","last_deep_scrub_stamp":"2024-05-08T18:11:01.717407+0000","last_clean_scrub_stamp":"2024-05-08T18:11:01.717407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:32:20.145522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":18438,"num_write":20,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:55.709148+0000","last_change":"2024-05-08T18:10:55.709206+0000","last_active":"2024-05-08T18:10:55.709148+0000","last_peered":"2024-05-08T18:10:55.709148+0000","last_clean":"2024-05-08T18:10:55.709148+0000","last_became_active":"2024-05-08T18:07:19.525402+0000","last_became_peered":"2024-05-08T18:07:19.525402+0000","last_unstale":"2024-05-08T18:10:55.709148+0000","last_undegraded":"2024-05-08T18:10:55.709148+0000","last_fullsized":"2024-05-08T18:10:55.709148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:55.708944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:55.708944+0000","last_clean_scrub_stamp":"2024-05-08T18:10:55.708944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:53.942850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"120'23","reported_seq":241,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:02.587442+0000","last_change":"2024-05-08T18:11:02.587484+0000","last_active":"2024-05-08T18:11:02.587442+0000","last_peered":"2024-05-08T18:11:02.587442+0000","last_clean":"2024-05-08T18:11:02.587442+0000","last_became_active":"2024-05-08T18:07:21.535752+0000","last_became_peered":"2024-05-08T18:07:21.535752+0000","last_unstale":"2024-05-08T18:11:02.587442+0000","last_undegraded":"2024-05-08T18:11:02.587442+0000","last_fullsized":"2024-05-08T18:11:02.587442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'23","last_scrub_stamp":"2024-05-08T18:11:02.587343+0000","last_deep_scrub":"120'23","last_deep_scrub_stamp":"2024-05-08T18:11:02.587343+0000","last_clean_scrub_stamp":"2024-05-08T18:11:02.587343+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:11.950613+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":37,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:03.073701+0000","last_change":"2024-05-08T18:11:03.073753+0000","last_active":"2024-05-08T18:11:03.073701+0000","last_peered":"2024-05-08T18:11:03.073701+0000","last_clean":"2024-05-08T18:11:03.073701+0000","last_became_active":"2024-05-08T18:07:23.550214+0000","last_became_peered":"2024-05-08T18:07:23.550214+0000","last_unstale":"2024-05-08T18:11:03.073701+0000","last_undegraded":"2024-05-08T18:11:03.073701+0000","last_fullsized":"2024-05-08T18:11:03.073701+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:03.073511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:03.073511+0000","last_clean_scrub_stamp":"2024-05-08T18:11:03.073511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:02.726733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":195,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:12.712073+0000","last_change":"2024-05-08T18:11:12.712135+0000","last_active":"2024-05-08T18:11:12.712073+0000","last_peered":"2024-05-08T18:11:12.712073+0000","last_clean":"2024-05-08T18:11:12.712073+0000","last_became_active":"2024-05-08T18:07:25.566111+0000","last_became_peered":"2024-05-08T18:07:25.566111+0000","last_unstale":"2024-05-08T18:11:12.712073+0000","last_undegraded":"2024-05-08T18:11:12.712073+0000","last_fullsized":"2024-05-08T18:11:12.712073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:12.711860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:12.711860+0000","last_clean_scrub_stamp":"2024-05-08T18:11:12.711860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:01.008806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"90'6","reported_seq":222,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.117205+0000","last_change":"2024-05-08T18:10:47.117265+0000","last_active":"2024-05-08T18:10:47.117205+0000","last_peered":"2024-05-08T18:10:47.117205+0000","last_clean":"2024-05-08T18:10:47.117205+0000","last_became_active":"2024-05-08T18:07:17.516264+0000","last_became_peered":"2024-05-08T18:07:17.516264+0000","last_unstale":"2024-05-08T18:10:47.117205+0000","last_undegraded":"2024-05-08T18:10:47.117205+0000","last_fullsized":"2024-05-08T18:10:47.117205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'6","last_scrub_stamp":"2024-05-08T18:10:47.116999+0000","last_deep_scrub":"90'6","last_deep_scrub_stamp":"2024-05-08T18:10:47.116999+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.116999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:16.159448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"120'22","reported_seq":248,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.597240+0000","last_change":"2024-05-08T18:11:06.597299+0000","last_active":"2024-05-08T18:11:06.597240+0000","last_peered":"2024-05-08T18:11:06.597240+0000","last_clean":"2024-05-08T18:11:06.597240+0000","last_became_active":"2024-05-08T18:07:15.491905+0000","last_became_peered":"2024-05-08T18:07:15.491905+0000","last_unstale":"2024-05-08T18:11:06.597240+0000","last_undegraded":"2024-05-08T18:11:06.597240+0000","last_fullsized":"2024-05-08T18:11:06.597240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'22","last_scrub_stamp":"2024-05-08T18:11:06.597011+0000","last_deep_scrub":"120'22","last_deep_scrub_stamp":"2024-05-08T18:11:06.597011+0000","last_clean_scrub_stamp":"2024-05-08T18:11:06.597011+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:21.487790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":38912,"num_write":22,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:39.234077+0000","last_change":"2024-05-08T18:10:39.234129+0000","last_active":"2024-05-08T18:10:39.234077+0000","last_peered":"2024-05-08T18:10:39.234077+0000","last_clean":"2024-05-08T18:10:39.234077+0000","last_became_active":"2024-05-08T18:07:19.525688+0000","last_became_peered":"2024-05-08T18:07:19.525688+0000","last_unstale":"2024-05-08T18:10:39.234077+0000","last_undegraded":"2024-05-08T18:10:39.234077+0000","last_fullsized":"2024-05-08T18:10:39.234077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:39.233967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:39.233967+0000","last_clean_scrub_stamp":"2024-05-08T18:10:39.233967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:32.648654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"120'17","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:40.778524+0000","last_change":"2024-05-08T18:10:40.778610+0000","last_active":"2024-05-08T18:10:40.778524+0000","last_peered":"2024-05-08T18:10:40.778524+0000","last_clean":"2024-05-08T18:10:40.778524+0000","last_became_active":"2024-05-08T18:07:21.550312+0000","last_became_peered":"2024-05-08T18:07:21.550312+0000","last_unstale":"2024-05-08T18:10:40.778524+0000","last_undegraded":"2024-05-08T18:10:40.778524+0000","last_fullsized":"2024-05-08T18:10:40.778524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'17","last_scrub_stamp":"2024-05-08T18:10:40.778316+0000","last_deep_scrub":"120'17","last_deep_scrub_stamp":"2024-05-08T18:10:40.778316+0000","last_clean_scrub_stamp":"2024-05-08T18:10:40.778316+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:08.674124+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":12,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":856,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"120'18","reported_seq":263,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:02.203462+0000","last_change":"2024-05-08T18:11:02.203527+0000","last_active":"2024-05-08T18:11:02.203462+0000","last_peered":"2024-05-08T18:11:02.203462+0000","last_clean":"2024-05-08T18:11:02.203462+0000","last_became_active":"2024-05-08T18:07:23.563258+0000","last_became_peered":"2024-05-08T18:07:23.563258+0000","last_unstale":"2024-05-08T18:11:02.203462+0000","last_undegraded":"2024-05-08T18:11:02.203462+0000","last_fullsized":"2024-05-08T18:11:02.203462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:11:02.203273+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:11:02.203273+0000","last_clean_scrub_stamp":"2024-05-08T18:11:02.203273+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:43.327416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"101'6","reported_seq":206,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:14.816011+0000","last_change":"2024-05-08T18:11:14.816078+0000","last_active":"2024-05-08T18:11:14.816011+0000","last_peered":"2024-05-08T18:11:14.816011+0000","last_clean":"2024-05-08T18:11:14.816011+0000","last_became_active":"2024-05-08T18:07:25.580777+0000","last_became_peered":"2024-05-08T18:07:25.580777+0000","last_unstale":"2024-05-08T18:11:14.816011+0000","last_undegraded":"2024-05-08T18:11:14.816011+0000","last_fullsized":"2024-05-08T18:11:14.816011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'6","last_scrub_stamp":"2024-05-08T18:11:14.815804+0000","last_deep_scrub":"101'6","last_deep_scrub_stamp":"2024-05-08T18:11:14.815804+0000","last_clean_scrub_stamp":"2024-05-08T18:11:14.815804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:49:42.883409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:07.700504+0000","last_change":"2024-05-08T18:11:07.700558+0000","last_active":"2024-05-08T18:11:07.700504+0000","last_peered":"2024-05-08T18:11:07.700504+0000","last_clean":"2024-05-08T18:11:07.700504+0000","last_became_active":"2024-05-08T18:07:17.494839+0000","last_became_peered":"2024-05-08T18:07:17.494839+0000","last_unstale":"2024-05-08T18:11:07.700504+0000","last_undegraded":"2024-05-08T18:11:07.700504+0000","last_fullsized":"2024-05-08T18:11:07.700504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:07.700302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:07.700302+0000","last_clean_scrub_stamp":"2024-05-08T18:11:07.700302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:48.524421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"120'12","reported_seq":236,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.788117+0000","last_change":"2024-05-08T18:10:59.788246+0000","last_active":"2024-05-08T18:10:59.788117+0000","last_peered":"2024-05-08T18:10:59.788117+0000","last_clean":"2024-05-08T18:10:59.788117+0000","last_became_active":"2024-05-08T18:07:15.482842+0000","last_became_peered":"2024-05-08T18:07:15.482842+0000","last_unstale":"2024-05-08T18:10:59.788117+0000","last_undegraded":"2024-05-08T18:10:59.788117+0000","last_fullsized":"2024-05-08T18:10:59.788117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'12","last_scrub_stamp":"2024-05-08T18:10:59.787857+0000","last_deep_scrub":"120'12","last_deep_scrub_stamp":"2024-05-08T18:10:59.787857+0000","last_clean_scrub_stamp":"2024-05-08T18:10:59.787857+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:50.283386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24594,"num_write":42,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":210,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.887569+0000","last_change":"2024-05-08T18:10:51.887625+0000","last_active":"2024-05-08T18:10:51.887569+0000","last_peered":"2024-05-08T18:10:51.887569+0000","last_clean":"2024-05-08T18:10:51.887569+0000","last_became_active":"2024-05-08T18:07:19.551336+0000","last_became_peered":"2024-05-08T18:07:19.551336+0000","last_unstale":"2024-05-08T18:10:51.887569+0000","last_undegraded":"2024-05-08T18:10:51.887569+0000","last_fullsized":"2024-05-08T18:10:51.887569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:51.887380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:51.887380+0000","last_clean_scrub_stamp":"2024-05-08T18:10:51.887380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:55:38.888339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"120'29","reported_seq":246,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:42.102013+0000","last_change":"2024-05-08T18:10:42.102101+0000","last_active":"2024-05-08T18:10:42.102013+0000","last_peered":"2024-05-08T18:10:42.102013+0000","last_clean":"2024-05-08T18:10:42.102013+0000","last_became_active":"2024-05-08T18:07:21.545499+0000","last_became_peered":"2024-05-08T18:07:21.545499+0000","last_unstale":"2024-05-08T18:10:42.102013+0000","last_undegraded":"2024-05-08T18:10:42.102013+0000","last_fullsized":"2024-05-08T18:10:42.102013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'29","last_scrub_stamp":"2024-05-08T18:10:42.101817+0000","last_deep_scrub":"120'29","last_deep_scrub_stamp":"2024-05-08T18:10:42.101817+0000","last_clean_scrub_stamp":"2024-05-08T18:10:42.101817+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:03.465567+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:40.722792+0000","last_change":"2024-05-08T18:10:40.722887+0000","last_active":"2024-05-08T18:10:40.722792+0000","last_peered":"2024-05-08T18:10:40.722792+0000","last_clean":"2024-05-08T18:10:40.722792+0000","last_became_active":"2024-05-08T18:07:23.553026+0000","last_became_peered":"2024-05-08T18:07:23.553026+0000","last_unstale":"2024-05-08T18:10:40.722792+0000","last_undegraded":"2024-05-08T18:10:40.722792+0000","last_fullsized":"2024-05-08T18:10:40.722792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:40.722565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:40.722565+0000","last_clean_scrub_stamp":"2024-05-08T18:10:40.722565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:28:04.236944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"101'2","reported_seq":200,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:13.846981+0000","last_change":"2024-05-08T18:11:13.847105+0000","last_active":"2024-05-08T18:11:13.846981+0000","last_peered":"2024-05-08T18:11:13.846981+0000","last_clean":"2024-05-08T18:11:13.846981+0000","last_became_active":"2024-05-08T18:07:25.570645+0000","last_became_peered":"2024-05-08T18:07:25.570645+0000","last_unstale":"2024-05-08T18:11:13.846981+0000","last_undegraded":"2024-05-08T18:11:13.846981+0000","last_fullsized":"2024-05-08T18:11:13.846981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'2","last_scrub_stamp":"2024-05-08T18:11:13.846681+0000","last_deep_scrub":"101'2","last_deep_scrub_stamp":"2024-05-08T18:11:13.846681+0000","last_clean_scrub_stamp":"2024-05-08T18:11:13.846681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:47.238861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.739830+0000","last_change":"2024-05-08T18:11:06.739896+0000","last_active":"2024-05-08T18:11:06.739830+0000","last_peered":"2024-05-08T18:11:06.739830+0000","last_clean":"2024-05-08T18:11:06.739830+0000","last_became_active":"2024-05-08T18:07:17.494192+0000","last_became_peered":"2024-05-08T18:07:17.494192+0000","last_unstale":"2024-05-08T18:11:06.739830+0000","last_undegraded":"2024-05-08T18:11:06.739830+0000","last_fullsized":"2024-05-08T18:11:06.739830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:06.739630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:06.739630+0000","last_clean_scrub_stamp":"2024-05-08T18:11:06.739630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:40.461702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"120'8","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:07.722252+0000","last_change":"2024-05-08T18:11:07.722314+0000","last_active":"2024-05-08T18:11:07.722252+0000","last_peered":"2024-05-08T18:11:07.722252+0000","last_clean":"2024-05-08T18:11:07.722252+0000","last_became_active":"2024-05-08T18:07:15.479173+0000","last_became_peered":"2024-05-08T18:07:15.479173+0000","last_unstale":"2024-05-08T18:11:07.722252+0000","last_undegraded":"2024-05-08T18:11:07.722252+0000","last_fullsized":"2024-05-08T18:11:07.722252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'8","last_scrub_stamp":"2024-05-08T18:11:07.722035+0000","last_deep_scrub":"120'8","last_deep_scrub_stamp":"2024-05-08T18:11:07.722035+0000","last_clean_scrub_stamp":"2024-05-08T18:11:07.722035+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:40.942386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":207,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:58.810944+0000","last_change":"2024-05-08T18:10:58.810999+0000","last_active":"2024-05-08T18:10:58.810944+0000","last_peered":"2024-05-08T18:10:58.810944+0000","last_clean":"2024-05-08T18:10:58.810944+0000","last_became_active":"2024-05-08T18:07:19.541378+0000","last_became_peered":"2024-05-08T18:07:19.541378+0000","last_unstale":"2024-05-08T18:10:58.810944+0000","last_undegraded":"2024-05-08T18:10:58.810944+0000","last_fullsized":"2024-05-08T18:10:58.810944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:58.810751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:58.810751+0000","last_clean_scrub_stamp":"2024-05-08T18:10:58.810751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:58.463973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"120'24","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:10.584660+0000","last_change":"2024-05-08T18:11:10.584734+0000","last_active":"2024-05-08T18:11:10.584660+0000","last_peered":"2024-05-08T18:11:10.584660+0000","last_clean":"2024-05-08T18:11:10.584660+0000","last_became_active":"2024-05-08T18:07:21.549435+0000","last_became_peered":"2024-05-08T18:07:21.549435+0000","last_unstale":"2024-05-08T18:11:10.584660+0000","last_undegraded":"2024-05-08T18:11:10.584660+0000","last_fullsized":"2024-05-08T18:11:10.584660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'24","last_scrub_stamp":"2024-05-08T18:11:10.584460+0000","last_deep_scrub":"120'24","last_deep_scrub_stamp":"2024-05-08T18:11:10.584460+0000","last_clean_scrub_stamp":"2024-05-08T18:11:10.584460+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:06.181010+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":57,"num_write":22,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.307202+0000","last_change":"2024-05-08T18:10:49.307259+0000","last_active":"2024-05-08T18:10:49.307202+0000","last_peered":"2024-05-08T18:10:49.307202+0000","last_clean":"2024-05-08T18:10:49.307202+0000","last_became_active":"2024-05-08T18:07:23.552080+0000","last_became_peered":"2024-05-08T18:07:23.552080+0000","last_unstale":"2024-05-08T18:10:49.307202+0000","last_undegraded":"2024-05-08T18:10:49.307202+0000","last_fullsized":"2024-05-08T18:10:49.307202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:49.306956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:49.306956+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.306956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:43.430160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:18.651762+0000","last_change":"2024-05-08T18:11:18.651820+0000","last_active":"2024-05-08T18:11:18.651762+0000","last_peered":"2024-05-08T18:11:18.651762+0000","last_clean":"2024-05-08T18:11:18.651762+0000","last_became_active":"2024-05-08T18:07:25.657570+0000","last_became_peered":"2024-05-08T18:07:25.657570+0000","last_unstale":"2024-05-08T18:11:18.651762+0000","last_undegraded":"2024-05-08T18:11:18.651762+0000","last_fullsized":"2024-05-08T18:11:18.651762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:18.651537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:18.651537+0000","last_clean_scrub_stamp":"2024-05-08T18:11:18.651537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:33.263677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.618647+0000","last_change":"2024-05-08T18:10:57.618715+0000","last_active":"2024-05-08T18:10:57.618647+0000","last_peered":"2024-05-08T18:10:57.618647+0000","last_clean":"2024-05-08T18:10:57.618647+0000","last_became_active":"2024-05-08T18:07:17.503117+0000","last_became_peered":"2024-05-08T18:07:17.503117+0000","last_unstale":"2024-05-08T18:10:57.618647+0000","last_undegraded":"2024-05-08T18:10:57.618647+0000","last_fullsized":"2024-05-08T18:10:57.618647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:57.618433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:57.618433+0000","last_clean_scrub_stamp":"2024-05-08T18:10:57.618433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:19:01.182969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"120'20","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:09.095291+0000","last_change":"2024-05-08T18:11:09.095357+0000","last_active":"2024-05-08T18:11:09.095291+0000","last_peered":"2024-05-08T18:11:09.095291+0000","last_clean":"2024-05-08T18:11:09.095291+0000","last_became_active":"2024-05-08T18:07:55.439188+0000","last_became_peered":"2024-05-08T18:07:55.439188+0000","last_unstale":"2024-05-08T18:11:09.095291+0000","last_undegraded":"2024-05-08T18:11:09.095291+0000","last_fullsized":"2024-05-08T18:11:09.095291+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'20","last_scrub_stamp":"2024-05-08T18:11:09.095094+0000","last_deep_scrub":"120'20","last_deep_scrub_stamp":"2024-05-08T18:11:09.095094+0000","last_clean_scrub_stamp":"2024-05-08T18:11:09.095094+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:02.275366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":36864,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.760975+0000","last_change":"2024-05-08T18:10:59.761030+0000","last_active":"2024-05-08T18:10:59.760975+0000","last_peered":"2024-05-08T18:10:59.760975+0000","last_clean":"2024-05-08T18:10:59.760975+0000","last_became_active":"2024-05-08T18:07:19.545869+0000","last_became_peered":"2024-05-08T18:07:19.545869+0000","last_unstale":"2024-05-08T18:10:59.760975+0000","last_undegraded":"2024-05-08T18:10:59.760975+0000","last_fullsized":"2024-05-08T18:10:59.760975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:59.760773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:59.760773+0000","last_clean_scrub_stamp":"2024-05-08T18:10:59.760773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:50.256302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"120'15","reported_seq":230,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.616293+0000","last_change":"2024-05-08T18:10:47.616363+0000","last_active":"2024-05-08T18:10:47.616293+0000","last_peered":"2024-05-08T18:10:47.616293+0000","last_clean":"2024-05-08T18:10:47.616293+0000","last_became_active":"2024-05-08T18:07:21.551644+0000","last_became_peered":"2024-05-08T18:07:21.551644+0000","last_unstale":"2024-05-08T18:10:47.616293+0000","last_undegraded":"2024-05-08T18:10:47.616293+0000","last_fullsized":"2024-05-08T18:10:47.616293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'15","last_scrub_stamp":"2024-05-08T18:10:47.616077+0000","last_deep_scrub":"120'15","last_deep_scrub_stamp":"2024-05-08T18:10:47.616077+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.616077+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:54.718144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":46,"num_write":16,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":201,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.682126+0000","last_change":"2024-05-08T18:11:11.682190+0000","last_active":"2024-05-08T18:11:11.682126+0000","last_peered":"2024-05-08T18:11:11.682126+0000","last_clean":"2024-05-08T18:11:11.682126+0000","last_became_active":"2024-05-08T18:07:23.559940+0000","last_became_peered":"2024-05-08T18:07:23.559940+0000","last_unstale":"2024-05-08T18:11:11.682126+0000","last_undegraded":"2024-05-08T18:11:11.682126+0000","last_fullsized":"2024-05-08T18:11:11.682126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:11.681877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:11.681877+0000","last_clean_scrub_stamp":"2024-05-08T18:11:11.681877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:42.754160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":198,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:12.882184+0000","last_change":"2024-05-08T18:11:12.882318+0000","last_active":"2024-05-08T18:11:12.882184+0000","last_peered":"2024-05-08T18:11:12.882184+0000","last_clean":"2024-05-08T18:11:12.882184+0000","last_became_active":"2024-05-08T18:07:25.563333+0000","last_became_peered":"2024-05-08T18:07:25.563333+0000","last_unstale":"2024-05-08T18:11:12.882184+0000","last_undegraded":"2024-05-08T18:11:12.882184+0000","last_fullsized":"2024-05-08T18:11:12.882184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:12.881951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:12.881951+0000","last_clean_scrub_stamp":"2024-05-08T18:11:12.881951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:22.245221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.789112+0000","last_change":"2024-05-08T18:10:49.789175+0000","last_active":"2024-05-08T18:10:49.789112+0000","last_peered":"2024-05-08T18:10:49.789112+0000","last_clean":"2024-05-08T18:10:49.789112+0000","last_became_active":"2024-05-08T18:07:17.525882+0000","last_became_peered":"2024-05-08T18:07:17.525882+0000","last_unstale":"2024-05-08T18:10:49.789112+0000","last_undegraded":"2024-05-08T18:10:49.789112+0000","last_fullsized":"2024-05-08T18:10:49.789112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:49.788910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:49.788910+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.788910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:38.033075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"120'18","reported_seq":244,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:07.573046+0000","last_change":"2024-05-08T18:11:07.573106+0000","last_active":"2024-05-08T18:11:07.573046+0000","last_peered":"2024-05-08T18:11:07.573046+0000","last_clean":"2024-05-08T18:11:07.573046+0000","last_became_active":"2024-05-08T18:07:15.497151+0000","last_became_peered":"2024-05-08T18:07:15.497151+0000","last_unstale":"2024-05-08T18:11:07.573046+0000","last_undegraded":"2024-05-08T18:11:07.573046+0000","last_fullsized":"2024-05-08T18:11:07.573046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:11:07.572807+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:11:07.572807+0000","last_clean_scrub_stamp":"2024-05-08T18:11:07.572807+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:38.645090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32780,"num_write":38,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"120'2","reported_seq":209,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.174282+0000","last_change":"2024-05-08T18:10:45.174342+0000","last_active":"2024-05-08T18:10:45.174282+0000","last_peered":"2024-05-08T18:10:45.174282+0000","last_clean":"2024-05-08T18:10:45.174282+0000","last_became_active":"2024-05-08T18:07:19.535105+0000","last_became_peered":"2024-05-08T18:07:19.535105+0000","last_unstale":"2024-05-08T18:10:45.174282+0000","last_undegraded":"2024-05-08T18:10:45.174282+0000","last_fullsized":"2024-05-08T18:10:45.174282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'2","last_scrub_stamp":"2024-05-08T18:10:45.174091+0000","last_deep_scrub":"120'2","last_deep_scrub_stamp":"2024-05-08T18:10:45.174091+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.174091+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:56.006926+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"120'21","reported_seq":237,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:41.755514+0000","last_change":"2024-05-08T18:10:41.755596+0000","last_active":"2024-05-08T18:10:41.755514+0000","last_peered":"2024-05-08T18:10:41.755514+0000","last_clean":"2024-05-08T18:10:41.755514+0000","last_became_active":"2024-05-08T18:07:21.547444+0000","last_became_peered":"2024-05-08T18:07:21.547444+0000","last_unstale":"2024-05-08T18:10:41.755514+0000","last_undegraded":"2024-05-08T18:10:41.755514+0000","last_fullsized":"2024-05-08T18:10:41.755514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'21","last_scrub_stamp":"2024-05-08T18:10:41.755316+0000","last_deep_scrub":"120'21","last_deep_scrub_stamp":"2024-05-08T18:10:41.755316+0000","last_clean_scrub_stamp":"2024-05-08T18:10:41.755316+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:03.119066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":40,"num_write":20,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":199,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.559771+0000","last_change":"2024-05-08T18:11:11.559824+0000","last_active":"2024-05-08T18:11:11.559771+0000","last_peered":"2024-05-08T18:11:11.559771+0000","last_clean":"2024-05-08T18:11:11.559771+0000","last_became_active":"2024-05-08T18:07:23.566996+0000","last_became_peered":"2024-05-08T18:07:23.566996+0000","last_unstale":"2024-05-08T18:11:11.559771+0000","last_undegraded":"2024-05-08T18:11:11.559771+0000","last_fullsized":"2024-05-08T18:11:11.559771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:11.559576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:11.559576+0000","last_clean_scrub_stamp":"2024-05-08T18:11:11.559576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:41.851870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":197,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:13.612255+0000","last_change":"2024-05-08T18:11:13.612313+0000","last_active":"2024-05-08T18:11:13.612255+0000","last_peered":"2024-05-08T18:11:13.612255+0000","last_clean":"2024-05-08T18:11:13.612255+0000","last_became_active":"2024-05-08T18:07:25.568213+0000","last_became_peered":"2024-05-08T18:07:25.568213+0000","last_unstale":"2024-05-08T18:11:13.612255+0000","last_undegraded":"2024-05-08T18:11:13.612255+0000","last_fullsized":"2024-05-08T18:11:13.612255+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:11:13.612052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:11:13.612052+0000","last_clean_scrub_stamp":"2024-05-08T18:11:13.612052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:10.832548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"101'36","reported_seq":253,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:44.148326+0000","last_change":"2024-05-08T18:10:44.148421+0000","last_active":"2024-05-08T18:10:44.148326+0000","last_peered":"2024-05-08T18:10:44.148326+0000","last_clean":"2024-05-08T18:10:44.148326+0000","last_became_active":"2024-05-08T18:07:17.515638+0000","last_became_peered":"2024-05-08T18:07:17.515638+0000","last_unstale":"2024-05-08T18:10:44.148326+0000","last_undegraded":"2024-05-08T18:10:44.148326+0000","last_fullsized":"2024-05-08T18:10:44.148326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'36","last_scrub_stamp":"2024-05-08T18:10:44.148101+0000","last_deep_scrub":"101'36","last_deep_scrub_stamp":"2024-05-08T18:10:44.148101+0000","last_clean_scrub_stamp":"2024-05-08T18:10:44.148101+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:58:32.403083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":91,"num_write":52,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"120'26","reported_seq":258,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.306795+0000","last_change":"2024-05-08T18:10:57.306949+0000","last_active":"2024-05-08T18:10:57.306795+0000","last_peered":"2024-05-08T18:10:57.306795+0000","last_clean":"2024-05-08T18:10:57.306795+0000","last_became_active":"2024-05-08T18:07:15.502207+0000","last_became_peered":"2024-05-08T18:07:15.502207+0000","last_unstale":"2024-05-08T18:10:57.306795+0000","last_undegraded":"2024-05-08T18:10:57.306795+0000","last_fullsized":"2024-05-08T18:10:57.306795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'26","last_scrub_stamp":"2024-05-08T18:10:57.306568+0000","last_deep_scrub":"120'26","last_deep_scrub_stamp":"2024-05-08T18:10:57.306568+0000","last_clean_scrub_stamp":"2024-05-08T18:10:57.306568+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:28:20.820946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":47134,"num_write":76,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.146209+0000","last_change":"2024-05-08T18:10:46.146269+0000","last_active":"2024-05-08T18:10:46.146209+0000","last_peered":"2024-05-08T18:10:46.146209+0000","last_clean":"2024-05-08T18:10:46.146209+0000","last_became_active":"2024-05-08T18:07:17.513463+0000","last_became_peered":"2024-05-08T18:07:17.513463+0000","last_unstale":"2024-05-08T18:10:46.146209+0000","last_undegraded":"2024-05-08T18:10:46.146209+0000","last_fullsized":"2024-05-08T18:10:46.146209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:46.145992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:46.145992+0000","last_clean_scrub_stamp":"2024-05-08T18:10:46.145992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:13.399524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"120'16","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:44.113697+0000","last_change":"2024-05-08T18:10:44.113764+0000","last_active":"2024-05-08T18:10:44.113697+0000","last_peered":"2024-05-08T18:10:44.113697+0000","last_clean":"2024-05-08T18:10:44.113697+0000","last_became_active":"2024-05-08T18:07:15.474555+0000","last_became_peered":"2024-05-08T18:07:15.474555+0000","last_unstale":"2024-05-08T18:10:44.113697+0000","last_undegraded":"2024-05-08T18:10:44.113697+0000","last_fullsized":"2024-05-08T18:10:44.113697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:10:44.113466+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:10:44.113466+0000","last_clean_scrub_stamp":"2024-05-08T18:10:44.113466+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:54.594473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":26630,"num_write":26,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:47.010319+0000","last_change":"2024-05-08T18:10:47.010395+0000","last_active":"2024-05-08T18:10:47.010319+0000","last_peered":"2024-05-08T18:10:47.010319+0000","last_clean":"2024-05-08T18:10:47.010319+0000","last_became_active":"2024-05-08T18:07:17.534187+0000","last_became_peered":"2024-05-08T18:07:17.534187+0000","last_unstale":"2024-05-08T18:10:47.010319+0000","last_undegraded":"2024-05-08T18:10:47.010319+0000","last_fullsized":"2024-05-08T18:10:47.010319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:47.010102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:47.010102+0000","last_clean_scrub_stamp":"2024-05-08T18:10:47.010102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:16.856570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"120'18","reported_seq":244,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:03.729846+0000","last_change":"2024-05-08T18:11:03.729914+0000","last_active":"2024-05-08T18:11:03.729846+0000","last_peered":"2024-05-08T18:11:03.729846+0000","last_clean":"2024-05-08T18:11:03.729846+0000","last_became_active":"2024-05-08T18:07:15.475073+0000","last_became_peered":"2024-05-08T18:07:15.475073+0000","last_unstale":"2024-05-08T18:11:03.729846+0000","last_undegraded":"2024-05-08T18:11:03.729846+0000","last_fullsized":"2024-05-08T18:11:03.729846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:11:03.729652+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:11:03.729652+0000","last_clean_scrub_stamp":"2024-05-08T18:11:03.729652+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:02.040473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32780,"num_write":38,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:40.281489+0000","last_change":"2024-05-08T18:10:40.281509+0000","last_active":"2024-05-08T18:10:40.281489+0000","last_peered":"2024-05-08T18:10:40.281489+0000","last_clean":"2024-05-08T18:10:40.281489+0000","last_became_active":"2024-05-08T18:07:17.526463+0000","last_became_peered":"2024-05-08T18:07:17.526463+0000","last_unstale":"2024-05-08T18:10:40.281489+0000","last_undegraded":"2024-05-08T18:10:40.281489+0000","last_fullsized":"2024-05-08T18:10:40.281489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:40.281421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:40.281421+0000","last_clean_scrub_stamp":"2024-05-08T18:10:40.281421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:47.592229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"120'8","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:05.575264+0000","last_change":"2024-05-08T18:11:05.575326+0000","last_active":"2024-05-08T18:11:05.575264+0000","last_peered":"2024-05-08T18:11:05.575264+0000","last_clean":"2024-05-08T18:11:05.575264+0000","last_became_active":"2024-05-08T18:07:15.490924+0000","last_became_peered":"2024-05-08T18:07:15.490924+0000","last_unstale":"2024-05-08T18:11:05.575264+0000","last_undegraded":"2024-05-08T18:11:05.575264+0000","last_fullsized":"2024-05-08T18:11:05.575264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'8","last_scrub_stamp":"2024-05-08T18:11:05.575075+0000","last_deep_scrub":"120'8","last_deep_scrub_stamp":"2024-05-08T18:11:05.575075+0000","last_clean_scrub_stamp":"2024-05-08T18:11:05.575075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:38.967255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":16390,"num_write":18,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:52.586178+0000","last_change":"2024-05-08T18:10:52.586307+0000","last_active":"2024-05-08T18:10:52.586178+0000","last_peered":"2024-05-08T18:10:52.586178+0000","last_clean":"2024-05-08T18:10:52.586178+0000","last_became_active":"2024-05-08T18:07:17.531273+0000","last_became_peered":"2024-05-08T18:07:17.531273+0000","last_unstale":"2024-05-08T18:10:52.586178+0000","last_undegraded":"2024-05-08T18:10:52.586178+0000","last_fullsized":"2024-05-08T18:10:52.586178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:52.585952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:52.585952+0000","last_clean_scrub_stamp":"2024-05-08T18:10:52.585952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:09.810615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"120'18","reported_seq":247,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:07.547307+0000","last_change":"2024-05-08T18:11:07.547371+0000","last_active":"2024-05-08T18:11:07.547307+0000","last_peered":"2024-05-08T18:11:07.547307+0000","last_clean":"2024-05-08T18:11:07.547307+0000","last_became_active":"2024-05-08T18:07:15.483705+0000","last_became_peered":"2024-05-08T18:07:15.483705+0000","last_unstale":"2024-05-08T18:11:07.547307+0000","last_undegraded":"2024-05-08T18:11:07.547307+0000","last_fullsized":"2024-05-08T18:11:07.547307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'18","last_scrub_stamp":"2024-05-08T18:11:07.547112+0000","last_deep_scrub":"120'18","last_deep_scrub_stamp":"2024-05-08T18:11:07.547112+0000","last_clean_scrub_stamp":"2024-05-08T18:11:07.547112+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:19.411291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32780,"num_write":38,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.744869+0000","last_change":"2024-05-08T18:10:51.744927+0000","last_active":"2024-05-08T18:10:51.744869+0000","last_peered":"2024-05-08T18:10:51.744869+0000","last_clean":"2024-05-08T18:10:51.744869+0000","last_became_active":"2024-05-08T18:07:17.526249+0000","last_became_peered":"2024-05-08T18:07:17.526249+0000","last_unstale":"2024-05-08T18:10:51.744869+0000","last_undegraded":"2024-05-08T18:10:51.744869+0000","last_fullsized":"2024-05-08T18:10:51.744869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:51.744656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:51.744656+0000","last_clean_scrub_stamp":"2024-05-08T18:10:51.744656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:52.754119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"120'16","reported_seq":242,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:58.055707+0000","last_change":"2024-05-08T18:10:58.055765+0000","last_active":"2024-05-08T18:10:58.055707+0000","last_peered":"2024-05-08T18:10:58.055707+0000","last_clean":"2024-05-08T18:10:58.055707+0000","last_became_active":"2024-05-08T18:07:15.470593+0000","last_became_peered":"2024-05-08T18:07:15.470593+0000","last_unstale":"2024-05-08T18:10:58.055707+0000","last_undegraded":"2024-05-08T18:10:58.055707+0000","last_fullsized":"2024-05-08T18:10:58.055707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:10:58.055514+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:10:58.055514+0000","last_clean_scrub_stamp":"2024-05-08T18:10:58.055514+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:57.892871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":32786,"num_write":46,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"101'40","reported_seq":260,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.547776+0000","last_change":"2024-05-08T18:10:59.547838+0000","last_active":"2024-05-08T18:10:59.547776+0000","last_peered":"2024-05-08T18:10:59.547776+0000","last_clean":"2024-05-08T18:10:59.547776+0000","last_became_active":"2024-05-08T18:07:17.500521+0000","last_became_peered":"2024-05-08T18:07:17.500521+0000","last_unstale":"2024-05-08T18:10:59.547776+0000","last_undegraded":"2024-05-08T18:10:59.547776+0000","last_fullsized":"2024-05-08T18:10:59.547776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'40","last_scrub_stamp":"2024-05-08T18:10:59.547579+0000","last_deep_scrub":"101'40","last_deep_scrub_stamp":"2024-05-08T18:10:59.547579+0000","last_clean_scrub_stamp":"2024-05-08T18:10:59.547579+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:00:47.872366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":102,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"120'16","reported_seq":239,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.289242+0000","last_change":"2024-05-08T18:10:56.289301+0000","last_active":"2024-05-08T18:10:56.289242+0000","last_peered":"2024-05-08T18:10:56.289242+0000","last_clean":"2024-05-08T18:10:56.289242+0000","last_became_active":"2024-05-08T18:07:15.492438+0000","last_became_peered":"2024-05-08T18:07:15.492438+0000","last_unstale":"2024-05-08T18:10:56.289242+0000","last_undegraded":"2024-05-08T18:10:56.289242+0000","last_fullsized":"2024-05-08T18:10:56.289242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:10:56.289046+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:10:56.289046+0000","last_clean_scrub_stamp":"2024-05-08T18:10:56.289046+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:52.730586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"90'12","reported_seq":228,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:44.278962+0000","last_change":"2024-05-08T18:10:44.279069+0000","last_active":"2024-05-08T18:10:44.278962+0000","last_peered":"2024-05-08T18:10:44.278962+0000","last_clean":"2024-05-08T18:10:44.278962+0000","last_became_active":"2024-05-08T18:07:17.516110+0000","last_became_peered":"2024-05-08T18:07:17.516110+0000","last_unstale":"2024-05-08T18:10:44.278962+0000","last_undegraded":"2024-05-08T18:10:44.278962+0000","last_fullsized":"2024-05-08T18:10:44.278962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'12","last_scrub_stamp":"2024-05-08T18:10:44.278753+0000","last_deep_scrub":"90'12","last_deep_scrub_stamp":"2024-05-08T18:10:44.278753+0000","last_clean_scrub_stamp":"2024-05-08T18:10:44.278753+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:52.815029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"120'6","reported_seq":227,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:08.591903+0000","last_change":"2024-05-08T18:11:08.591969+0000","last_active":"2024-05-08T18:11:08.591903+0000","last_peered":"2024-05-08T18:11:08.591903+0000","last_clean":"2024-05-08T18:11:08.591903+0000","last_became_active":"2024-05-08T18:07:15.485878+0000","last_became_peered":"2024-05-08T18:07:15.485878+0000","last_unstale":"2024-05-08T18:11:08.591903+0000","last_undegraded":"2024-05-08T18:11:08.591903+0000","last_fullsized":"2024-05-08T18:11:08.591903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'6","last_scrub_stamp":"2024-05-08T18:11:08.591721+0000","last_deep_scrub":"120'6","last_deep_scrub_stamp":"2024-05-08T18:11:08.591721+0000","last_clean_scrub_stamp":"2024-05-08T18:11:08.591721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:58.573062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:55.552167+0000","last_change":"2024-05-08T18:10:55.552285+0000","last_active":"2024-05-08T18:10:55.552167+0000","last_peered":"2024-05-08T18:10:55.552167+0000","last_clean":"2024-05-08T18:10:55.552167+0000","last_became_active":"2024-05-08T18:07:17.511500+0000","last_became_peered":"2024-05-08T18:07:17.511500+0000","last_unstale":"2024-05-08T18:10:55.552167+0000","last_undegraded":"2024-05-08T18:10:55.552167+0000","last_fullsized":"2024-05-08T18:10:55.552167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:55.551956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:55.551956+0000","last_clean_scrub_stamp":"2024-05-08T18:10:55.551956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:46.047485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"120'30","reported_seq":263,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:05.719276+0000","last_change":"2024-05-08T18:11:05.719340+0000","last_active":"2024-05-08T18:11:05.719276+0000","last_peered":"2024-05-08T18:11:05.719276+0000","last_clean":"2024-05-08T18:11:05.719276+0000","last_became_active":"2024-05-08T18:07:15.478637+0000","last_became_peered":"2024-05-08T18:07:15.478637+0000","last_unstale":"2024-05-08T18:11:05.719276+0000","last_undegraded":"2024-05-08T18:11:05.719276+0000","last_fullsized":"2024-05-08T18:11:05.719276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'30","last_scrub_stamp":"2024-05-08T18:11:05.719088+0000","last_deep_scrub":"120'30","last_deep_scrub_stamp":"2024-05-08T18:11:05.719088+0000","last_clean_scrub_stamp":"2024-05-08T18:11:05.719088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:00.234921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":55314,"num_write":60,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.678613+0000","last_change":"2024-05-08T18:10:56.678670+0000","last_active":"2024-05-08T18:10:56.678613+0000","last_peered":"2024-05-08T18:10:56.678613+0000","last_clean":"2024-05-08T18:10:56.678613+0000","last_became_active":"2024-05-08T18:07:17.506075+0000","last_became_peered":"2024-05-08T18:07:17.506075+0000","last_unstale":"2024-05-08T18:10:56.678613+0000","last_undegraded":"2024-05-08T18:10:56.678613+0000","last_fullsized":"2024-05-08T18:10:56.678613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:56.678412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:56.678412+0000","last_clean_scrub_stamp":"2024-05-08T18:10:56.678412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:53.188576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"120'12","reported_seq":238,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:09.563319+0000","last_change":"2024-05-08T18:11:09.563380+0000","last_active":"2024-05-08T18:11:09.563319+0000","last_peered":"2024-05-08T18:11:09.563319+0000","last_clean":"2024-05-08T18:11:09.563319+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:11:09.563319+0000","last_undegraded":"2024-05-08T18:11:09.563319+0000","last_fullsized":"2024-05-08T18:11:09.563319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'12","last_scrub_stamp":"2024-05-08T18:11:09.563120+0000","last_deep_scrub":"120'12","last_deep_scrub_stamp":"2024-05-08T18:11:09.563120+0000","last_clean_scrub_stamp":"2024-05-08T18:11:09.563120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:22.346328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24588,"num_write":32,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:48.085520+0000","last_change":"2024-05-08T18:10:48.085579+0000","last_active":"2024-05-08T18:10:48.085520+0000","last_peered":"2024-05-08T18:10:48.085520+0000","last_clean":"2024-05-08T18:10:48.085520+0000","last_became_active":"2024-05-08T18:07:17.518255+0000","last_became_peered":"2024-05-08T18:07:17.518255+0000","last_unstale":"2024-05-08T18:10:48.085520+0000","last_undegraded":"2024-05-08T18:10:48.085520+0000","last_fullsized":"2024-05-08T18:10:48.085520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:48.085315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:48.085315+0000","last_clean_scrub_stamp":"2024-05-08T18:10:48.085315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:48.230853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"120'14","reported_seq":184,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.907835+0000","last_change":"2024-05-08T18:10:57.907944+0000","last_active":"2024-05-08T18:10:57.907835+0000","last_peered":"2024-05-08T18:10:57.907835+0000","last_clean":"2024-05-08T18:10:57.907835+0000","last_became_active":"2024-05-08T18:07:55.444935+0000","last_became_peered":"2024-05-08T18:07:55.444935+0000","last_unstale":"2024-05-08T18:10:57.907835+0000","last_undegraded":"2024-05-08T18:10:57.907835+0000","last_fullsized":"2024-05-08T18:10:57.907835+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'14","last_scrub_stamp":"2024-05-08T18:10:57.907559+0000","last_deep_scrub":"120'14","last_deep_scrub_stamp":"2024-05-08T18:10:57.907559+0000","last_clean_scrub_stamp":"2024-05-08T18:10:57.907559+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:25.803368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":22528,"num_write":14,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.719220+0000","last_change":"2024-05-08T18:10:45.719272+0000","last_active":"2024-05-08T18:10:45.719220+0000","last_peered":"2024-05-08T18:10:45.719220+0000","last_clean":"2024-05-08T18:10:45.719220+0000","last_became_active":"2024-05-08T18:07:17.518630+0000","last_became_peered":"2024-05-08T18:07:17.518630+0000","last_unstale":"2024-05-08T18:10:45.719220+0000","last_undegraded":"2024-05-08T18:10:45.719220+0000","last_fullsized":"2024-05-08T18:10:45.719220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:45.719029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:45.719029+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.719029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:39.246234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"120'10","reported_seq":231,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.545852+0000","last_change":"2024-05-08T18:10:59.545922+0000","last_active":"2024-05-08T18:10:59.545852+0000","last_peered":"2024-05-08T18:10:59.545852+0000","last_clean":"2024-05-08T18:10:59.545852+0000","last_became_active":"2024-05-08T18:07:15.512258+0000","last_became_peered":"2024-05-08T18:07:15.512258+0000","last_unstale":"2024-05-08T18:10:59.545852+0000","last_undegraded":"2024-05-08T18:10:59.545852+0000","last_fullsized":"2024-05-08T18:10:59.545852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'10","last_scrub_stamp":"2024-05-08T18:10:59.545637+0000","last_deep_scrub":"120'10","last_deep_scrub_stamp":"2024-05-08T18:10:59.545637+0000","last_clean_scrub_stamp":"2024-05-08T18:10:59.545637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:57.856458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16390,"num_write":20,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.862704+0000","last_change":"2024-05-08T18:10:46.862759+0000","last_active":"2024-05-08T18:10:46.862704+0000","last_peered":"2024-05-08T18:10:46.862704+0000","last_clean":"2024-05-08T18:10:46.862704+0000","last_became_active":"2024-05-08T18:07:17.530890+0000","last_became_peered":"2024-05-08T18:07:17.530890+0000","last_unstale":"2024-05-08T18:10:46.862704+0000","last_undegraded":"2024-05-08T18:10:46.862704+0000","last_fullsized":"2024-05-08T18:10:46.862704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:46.862498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:46.862498+0000","last_clean_scrub_stamp":"2024-05-08T18:10:46.862498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:05.816145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"120'16","reported_seq":239,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:54.270940+0000","last_change":"2024-05-08T18:10:54.271005+0000","last_active":"2024-05-08T18:10:54.270940+0000","last_peered":"2024-05-08T18:10:54.270940+0000","last_clean":"2024-05-08T18:10:54.270940+0000","last_became_active":"2024-05-08T18:07:15.486434+0000","last_became_peered":"2024-05-08T18:07:15.486434+0000","last_unstale":"2024-05-08T18:10:54.270940+0000","last_undegraded":"2024-05-08T18:10:54.270940+0000","last_fullsized":"2024-05-08T18:10:54.270940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:10:54.270748+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:10:54.270748+0000","last_clean_scrub_stamp":"2024-05-08T18:10:54.270748+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:21.524281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:49.631813+0000","last_change":"2024-05-08T18:10:49.631918+0000","last_active":"2024-05-08T18:10:49.631813+0000","last_peered":"2024-05-08T18:10:49.631813+0000","last_clean":"2024-05-08T18:10:49.631813+0000","last_became_active":"2024-05-08T18:07:17.513689+0000","last_became_peered":"2024-05-08T18:07:17.513689+0000","last_unstale":"2024-05-08T18:10:49.631813+0000","last_undegraded":"2024-05-08T18:10:49.631813+0000","last_fullsized":"2024-05-08T18:10:49.631813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:49.631594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:49.631594+0000","last_clean_scrub_stamp":"2024-05-08T18:10:49.631594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:49.468950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"120'14","reported_seq":243,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.961653+0000","last_change":"2024-05-08T18:10:56.961802+0000","last_active":"2024-05-08T18:10:56.961653+0000","last_peered":"2024-05-08T18:10:56.961653+0000","last_clean":"2024-05-08T18:10:56.961653+0000","last_became_active":"2024-05-08T18:07:15.511908+0000","last_became_peered":"2024-05-08T18:07:15.511908+0000","last_unstale":"2024-05-08T18:10:56.961653+0000","last_undegraded":"2024-05-08T18:10:56.961653+0000","last_fullsized":"2024-05-08T18:10:56.961653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'14","last_scrub_stamp":"2024-05-08T18:10:56.961419+0000","last_deep_scrub":"120'14","last_deep_scrub_stamp":"2024-05-08T18:10:56.961419+0000","last_clean_scrub_stamp":"2024-05-08T18:10:56.961419+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:31.645810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26648,"num_write":54,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"101'46","reported_seq":263,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:53.609651+0000","last_change":"2024-05-08T18:10:53.609711+0000","last_active":"2024-05-08T18:10:53.609651+0000","last_peered":"2024-05-08T18:10:53.609651+0000","last_clean":"2024-05-08T18:10:53.609651+0000","last_became_active":"2024-05-08T18:07:17.511225+0000","last_became_peered":"2024-05-08T18:07:17.511225+0000","last_unstale":"2024-05-08T18:10:53.609651+0000","last_undegraded":"2024-05-08T18:10:53.609651+0000","last_fullsized":"2024-05-08T18:10:53.609651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'46","last_scrub_stamp":"2024-05-08T18:10:53.609456+0000","last_deep_scrub":"101'46","last_deep_scrub_stamp":"2024-05-08T18:10:53.609456+0000","last_clean_scrub_stamp":"2024-05-08T18:10:53.609456+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:17.176689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"120'22","reported_seq":250,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:45.151868+0000","last_change":"2024-05-08T18:10:45.152025+0000","last_active":"2024-05-08T18:10:45.151868+0000","last_peered":"2024-05-08T18:10:45.151868+0000","last_clean":"2024-05-08T18:10:45.151868+0000","last_became_active":"2024-05-08T18:07:15.488034+0000","last_became_peered":"2024-05-08T18:07:15.488034+0000","last_unstale":"2024-05-08T18:10:45.151868+0000","last_undegraded":"2024-05-08T18:10:45.151868+0000","last_fullsized":"2024-05-08T18:10:45.151868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'22","last_scrub_stamp":"2024-05-08T18:10:45.151585+0000","last_deep_scrub":"120'22","last_deep_scrub_stamp":"2024-05-08T18:10:45.151585+0000","last_clean_scrub_stamp":"2024-05-08T18:10:45.151585+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:51:24.792412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":45056,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":214,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:48.867544+0000","last_change":"2024-05-08T18:10:48.867609+0000","last_active":"2024-05-08T18:10:48.867544+0000","last_peered":"2024-05-08T18:10:48.867544+0000","last_clean":"2024-05-08T18:10:48.867544+0000","last_became_active":"2024-05-08T18:07:17.530752+0000","last_became_peered":"2024-05-08T18:07:17.530752+0000","last_unstale":"2024-05-08T18:10:48.867544+0000","last_undegraded":"2024-05-08T18:10:48.867544+0000","last_fullsized":"2024-05-08T18:10:48.867544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:48.867350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:48.867350+0000","last_clean_scrub_stamp":"2024-05-08T18:10:48.867350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:13:19.338378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"120'16","reported_seq":240,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:53.944342+0000","last_change":"2024-05-08T18:10:53.944516+0000","last_active":"2024-05-08T18:10:53.944342+0000","last_peered":"2024-05-08T18:10:53.944342+0000","last_clean":"2024-05-08T18:10:53.944342+0000","last_became_active":"2024-05-08T18:07:15.508885+0000","last_became_peered":"2024-05-08T18:07:15.508885+0000","last_unstale":"2024-05-08T18:10:53.944342+0000","last_undegraded":"2024-05-08T18:10:53.944342+0000","last_fullsized":"2024-05-08T18:10:53.944342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'16","last_scrub_stamp":"2024-05-08T18:10:53.944118+0000","last_deep_scrub":"120'16","last_deep_scrub_stamp":"2024-05-08T18:10:53.944118+0000","last_clean_scrub_stamp":"2024-05-08T18:10:53.944118+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:53.781474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":26630,"num_write":26,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"120'26","reported_seq":255,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.858800+0000","last_change":"2024-05-08T18:10:57.858862+0000","last_active":"2024-05-08T18:10:57.858800+0000","last_peered":"2024-05-08T18:10:57.858800+0000","last_clean":"2024-05-08T18:10:57.858800+0000","last_became_active":"2024-05-08T18:07:15.491474+0000","last_became_peered":"2024-05-08T18:07:15.491474+0000","last_unstale":"2024-05-08T18:10:57.858800+0000","last_undegraded":"2024-05-08T18:10:57.858800+0000","last_fullsized":"2024-05-08T18:10:57.858800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'26","last_scrub_stamp":"2024-05-08T18:10:57.858604+0000","last_deep_scrub":"120'26","last_deep_scrub_stamp":"2024-05-08T18:10:57.858604+0000","last_clean_scrub_stamp":"2024-05-08T18:10:57.858604+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:21.556083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":43014,"num_write":36,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:53.595991+0000","last_change":"2024-05-08T18:10:53.596044+0000","last_active":"2024-05-08T18:10:53.595991+0000","last_peered":"2024-05-08T18:10:53.595991+0000","last_clean":"2024-05-08T18:10:53.595991+0000","last_became_active":"2024-05-08T18:07:17.511359+0000","last_became_peered":"2024-05-08T18:07:17.511359+0000","last_unstale":"2024-05-08T18:10:53.595991+0000","last_undegraded":"2024-05-08T18:10:53.595991+0000","last_fullsized":"2024-05-08T18:10:53.595991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:53.595795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:53.595795+0000","last_clean_scrub_stamp":"2024-05-08T18:10:53.595795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:17.293274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"120'22","reported_seq":249,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.103471+0000","last_change":"2024-05-08T18:11:01.103530+0000","last_active":"2024-05-08T18:11:01.103471+0000","last_peered":"2024-05-08T18:11:01.103471+0000","last_clean":"2024-05-08T18:11:01.103471+0000","last_became_active":"2024-05-08T18:07:15.481109+0000","last_became_peered":"2024-05-08T18:07:15.481109+0000","last_unstale":"2024-05-08T18:11:01.103471+0000","last_undegraded":"2024-05-08T18:11:01.103471+0000","last_fullsized":"2024-05-08T18:11:01.103471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'22","last_scrub_stamp":"2024-05-08T18:11:01.103290+0000","last_deep_scrub":"120'22","last_deep_scrub_stamp":"2024-05-08T18:11:01.103290+0000","last_clean_scrub_stamp":"2024-05-08T18:11:01.103290+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:57.613454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40966,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.987192+0000","last_change":"2024-05-08T18:10:51.987244+0000","last_active":"2024-05-08T18:10:51.987192+0000","last_peered":"2024-05-08T18:10:51.987192+0000","last_clean":"2024-05-08T18:10:51.987192+0000","last_became_active":"2024-05-08T18:07:17.511195+0000","last_became_peered":"2024-05-08T18:07:17.511195+0000","last_unstale":"2024-05-08T18:10:51.987192+0000","last_undegraded":"2024-05-08T18:10:51.987192+0000","last_fullsized":"2024-05-08T18:10:51.987192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:10:51.986981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:10:51.986981+0000","last_clean_scrub_stamp":"2024-05-08T18:10:51.986981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:42.938258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":131254,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":1218,"num_read_kb":1595,"num_write":779,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2006,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":860,"ondisk_log_size":860,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1540,"num_read_kb":2048660,"num_write":2200,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2084864,"data_stored":1439914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1462272,"data_stored":848450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1511424,"data_stored":850271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1454080,"data_stored":848941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1478656,"data_stored":848846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1449984,"data_stored":848012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1478656,"data_stored":848700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2064384,"data_stored":1439320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:11:22.966 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-08T18:11:23.324 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-08T18:11:23.325 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-08T18:11:23.325 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-08T18:11:23.325 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:11:23.405 INFO:tasks.ceph.osd.0:Stopped 2024-05-08T18:11:23.405 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-08T18:11:23.405 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:11:23.475 INFO:tasks.ceph.osd.1:Stopped 2024-05-08T18:11:23.475 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-08T18:11:23.475 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:11:23.556 INFO:tasks.ceph.osd.2:Stopped 2024-05-08T18:11:23.556 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-08T18:11:23.556 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:11:23.646 INFO:tasks.ceph.osd.3:Stopped 2024-05-08T18:11:23.646 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-08T18:11:23.646 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:11:23.741 INFO:tasks.ceph.osd.4:Stopped 2024-05-08T18:11:23.742 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-08T18:11:23.742 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:11:23.831 INFO:tasks.ceph.osd.5:Stopped 2024-05-08T18:11:23.831 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-08T18:11:23.831 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:11:23.917 INFO:tasks.ceph.osd.6:Stopped 2024-05-08T18:11:23.917 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-08T18:11:23.918 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:11:24.010 INFO:tasks.ceph.osd.7:Stopped 2024-05-08T18:11:24.010 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-08T18:11:24.011 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-08T18:11:24.011 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:11:24.047 INFO:tasks.ceph.mgr.y:Stopped 2024-05-08T18:11:24.048 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-08T18:11:24.048 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:11:24.077 INFO:tasks.ceph.mgr.x:Stopped 2024-05-08T18:11:24.077 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-08T18:11:24.078 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T18:11:24.078 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:11:24.102 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T18:11:24.102 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T18:11:24.103 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:11:24.164 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T18:11:24.165 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T18:11:24.165 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:11:24.189 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T18:11:24.190 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-08T18:11:24.190 DEBUG:teuthology.orchestra.run.smithi080:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-05-08T18:11:24.222 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T18:11:24.222 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-08T18:11:24.563 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T18:11:24.563 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-08T18:11:24.791 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T18:11:24.791 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-08T18:11:24.985 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T18:11:24.985 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-08T18:11:25.176 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T18:11:25.177 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-08T18:11:25.445 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T18:11:25.445 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-08T18:11:25.626 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T18:11:25.626 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-08T18:11:25.758 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T18:11:25.758 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-08T18:11:25.869 INFO:tasks.ceph:Archiving mon data... 2024-05-08T18:11:25.870 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697867/data/mon.a.tgz 2024-05-08T18:11:25.870 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-05-08T18:11:25.876 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.LDeKKURkUi 2024-05-08T18:11:25.876 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.LDeKKURkUi 2024-05-08T18:11:26.041 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.LDeKKURkUi 2024-05-08T18:11:26.105 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.LDeKKURkUi is 548KB 2024-05-08T18:11:26.169 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.LDeKKURkUi 2024-05-08T18:11:26.175 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697867/data/mon.c.tgz 2024-05-08T18:11:26.175 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-05-08T18:11:26.222 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.6rxAn3hCjN 2024-05-08T18:11:26.222 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.6rxAn3hCjN 2024-05-08T18:11:26.429 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.6rxAn3hCjN 2024-05-08T18:11:26.493 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.6rxAn3hCjN is 716KB 2024-05-08T18:11:26.555 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.6rxAn3hCjN 2024-05-08T18:11:26.561 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697867/data/mon.b.tgz 2024-05-08T18:11:26.561 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-05-08T18:11:26.566 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.viCP7wgBMe 2024-05-08T18:11:26.567 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.viCP7wgBMe 2024-05-08T18:11:26.780 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.viCP7wgBMe 2024-05-08T18:11:26.843 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.viCP7wgBMe is 716KB 2024-05-08T18:11:26.909 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.viCP7wgBMe 2024-05-08T18:11:26.915 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-08T18:11:26.915 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T18:11:26.918 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T18:11:26.978 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T18:11:27.019 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T18:11:27.020 INFO:tasks.ceph:Archiving crash dumps... 2024-05-08T18:11:27.048 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/crash to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697867/remote/smithi080/crash 2024-05-08T18:11:27.054 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T18:11:27.068 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/crash to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697867/remote/smithi115/crash 2024-05-08T18:11:27.068 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T18:11:27.082 INFO:tasks.ceph:Compressing logs... 2024-05-08T18:11:27.082 DEBUG:teuthology.orchestra.run.smithi080:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T18:11:27.117 DEBUG:teuthology.orchestra.run.smithi115:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T18:11:27.146 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25310.log 2024-05-08T18:11:27.147 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32477.log 2024-05-08T18:11:27.147 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.25310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41323.log 2024-05-08T18:11:27.147 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25310.log.gz 2024-05-08T18:11:27.147 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.32477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35299.log 2024-05-08T18:11:27.147 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32477.log.gz 2024-05-08T18:11:27.159 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25170.log 2024-05-08T18:11:27.159 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25242.log 2024-05-08T18:11:27.159 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-08T18:11:27.159 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.25170.log: /var/log/ceph/ceph-client.admin.25242.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.25170.log.gz /var/log/ceph/ceph-osd.6.log 2024-05-08T18:11:27.160 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-05-08T18:11:27.160 INFO:teuthology.orchestra.run.smithi115.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25242.log.gz 2024-05-08T18:11:27.160 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-08T18:11:27.160 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25218.log 2024-05-08T18:11:27.160 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25058.log 2024-05-08T18:11:27.160 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.25218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25146.log 2024-05-08T18:11:27.160 INFO:teuthology.orchestra.run.smithi115.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25218.log.gz 2024-05-08T18:11:27.160 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log/var/log/ceph/ceph-client.admin.25058.log: 2024-05-08T18:11:27.160 INFO:teuthology.orchestra.run.smithi115.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25058.log.gz 2024-05-08T18:11:27.161 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.25146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25146.log.gz 2024-05-08T18:11:27.161 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25194.log 2024-05-08T18:11:27.161 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-08T18:11:27.161 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.25194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25194.log.gz 2024-05-08T18:11:27.161 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25098.log 2024-05-08T18:11:27.161 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-08T18:11:27.161 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.25098.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-08T18:11:27.161 INFO:teuthology.orchestra.run.smithi115.stderr: -- replaced with /var/log/ceph/ceph-client.admin.25098.log.gz 2024-05-08T18:11:27.161 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-08T18:11:27.161 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25122.log 2024-05-08T18:11:27.161 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.4.log: 86.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-08T18:11:27.162 INFO:teuthology.orchestra.run.smithi115.stderr: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-08T18:11:27.162 INFO:teuthology.orchestra.run.smithi115.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-08T18:11:27.162 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.25122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25122.log.gz 2024-05-08T18:11:27.217 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41323.log.gz 2024-05-08T18:11:27.217 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-05-08T18:11:27.217 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35719.log 2024-05-08T18:11:27.217 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35015.log 2024-05-08T18:11:27.218 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35299.log: /var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.admin.35719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35299.log.gz 2024-05-08T18:11:27.218 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43558.log 2024-05-08T18:11:27.218 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35719.log.gz 2024-05-08T18:11:27.218 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35015.log.gz 2024-05-08T18:11:27.218 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-08T18:11:27.218 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31550.log 2024-05-08T18:11:27.218 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43558.log.gz 2024-05-08T18:11:27.218 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43324.log 2024-05-08T18:11:27.218 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32481.log 2024-05-08T18:11:27.218 INFO:teuthology.orchestra.run.smithi080.stderr: 91.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-05-08T18:11:27.218 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31550.log.gz 2024-05-08T18:11:27.218 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37886.log 2024-05-08T18:11:27.219 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43324.log.gz 2024-05-08T18:11:27.219 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.32481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43246.log 2024-05-08T18:11:27.219 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32481.log.gz 2024-05-08T18:11:27.219 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.37886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41161.log 2024-05-08T18:11:27.219 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37886.log.gz 2024-05-08T18:11:27.219 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35612.log 2024-05-08T18:11:27.219 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43246.log.gz 2024-05-08T18:11:27.219 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.41161.log: /var/log/ceph/ceph-client.admin.34495.log 2024-05-08T18:11:27.219 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41161.log.gz 2024-05-08T18:11:27.219 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30646.log 2024-05-08T18:11:27.219 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35612.log.gz 2024-05-08T18:11:27.219 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40423.log 2024-05-08T18:11:27.219 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34495.log.gz 2024-05-08T18:11:27.220 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.30646.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.30646.log.gz 2024-05-08T18:11:27.220 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-08T18:11:27.220 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36401.log 2024-05-08T18:11:27.220 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40423.log.gz 2024-05-08T18:11:27.220 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32959.log 2024-05-08T18:11:27.220 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31110.log 2024-05-08T18:11:27.220 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36401.log.gz 2024-05-08T18:11:27.220 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.32959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34690.log 2024-05-08T18:11:27.220 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32959.log.gz 2024-05-08T18:11:27.220 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31110.log.gz 2024-05-08T18:11:27.220 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31600.log 2024-05-08T18:11:27.220 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36742.log 2024-05-08T18:11:27.220 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34690.log.gz 2024-05-08T18:11:27.220 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31600.log.gz 2024-05-08T18:11:27.220 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41928.log 2024-05-08T18:11:27.221 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31302.log 2024-05-08T18:11:27.221 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36742.log.gz 2024-05-08T18:11:27.221 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41928.log.gz 2024-05-08T18:11:27.221 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36548.log 2024-05-08T18:11:27.221 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31318.log 2024-05-08T18:11:27.221 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31302.log.gz 2024-05-08T18:11:27.221 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36548.log.gz 2024-05-08T18:11:27.221 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30902.log 2024-05-08T18:11:27.221 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31318.log.gz 2024-05-08T18:11:27.221 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39836.log 2024-05-08T18:11:27.222 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.30902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30796.log 2024-05-08T18:11:27.222 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30902.log.gz 2024-05-08T18:11:27.222 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.39836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40370.log 2024-05-08T18:11:27.222 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39836.log.gz 2024-05-08T18:11:27.222 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.30796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30796.log.gz 2024-05-08T18:11:27.222 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31317.log 2024-05-08T18:11:27.222 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36188.log 2024-05-08T18:11:27.222 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40370.log.gz 2024-05-08T18:11:27.222 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31317.log.gz 2024-05-08T18:11:27.222 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42417.log 2024-05-08T18:11:27.223 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43480.log 2024-05-08T18:11:27.223 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36188.log.gz 2024-05-08T18:11:27.223 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42417.log.gz 2024-05-08T18:11:27.223 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33453.log 2024-05-08T18:11:27.223 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41942.log 2024-05-08T18:11:27.223 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43480.log.gz 2024-05-08T18:11:27.223 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33453.log.gz 2024-05-08T18:11:27.223 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36554.log 2024-05-08T18:11:27.223 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43064.log 2024-05-08T18:11:27.223 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41942.log.gz 2024-05-08T18:11:27.223 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36554.log.gz 2024-05-08T18:11:27.223 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43168.log 2024-05-08T18:11:27.224 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34955.log 2024-05-08T18:11:27.224 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43064.log.gz 2024-05-08T18:11:27.224 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43168.log.gz 2024-05-08T18:11:27.224 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42150.log 2024-05-08T18:11:27.224 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34955.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-08T18:11:27.224 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34955.log.gz 2024-05-08T18:11:27.224 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42150.log.gz 2024-05-08T18:11:27.224 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41214.log 2024-05-08T18:11:27.224 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39745.log 2024-05-08T18:11:27.224 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41214.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.41214.log.gz 2024-05-08T18:11:27.224 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37721.log 2024-05-08T18:11:27.225 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.39745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39745.log.gz 2024-05-08T18:11:27.225 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41453.log 2024-05-08T18:11:27.225 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34931.log 2024-05-08T18:11:27.225 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.37721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37721.log.gz 2024-05-08T18:11:27.225 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40291.log 2024-05-08T18:11:27.225 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41453.log.gz 2024-05-08T18:11:27.225 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34931.log.gz 2024-05-08T18:11:27.225 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41742.log 2024-05-08T18:11:27.225 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32329.log 2024-05-08T18:11:27.225 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40291.log.gz 2024-05-08T18:11:27.225 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39473.log 2024-05-08T18:11:27.225 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41742.log.gz 2024-05-08T18:11:27.225 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.32329.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32329.log.gz -5 2024-05-08T18:11:27.225 INFO:teuthology.orchestra.run.smithi080.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37590.log 2024-05-08T18:11:27.226 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41731.log 2024-05-08T18:11:27.226 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.39473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39473.log.gz 2024-05-08T18:11:27.226 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.37590.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-08T18:11:27.226 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37590.log.gz 2024-05-08T18:11:27.226 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41731.log.gz 2024-05-08T18:11:27.226 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42339.log 2024-05-08T18:11:27.226 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33086.log 2024-05-08T18:11:27.226 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.42339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33026.log 2024-05-08T18:11:27.226 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42339.log.gz 2024-05-08T18:11:27.226 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33086.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33086.log.gz -5 2024-05-08T18:11:27.227 INFO:teuthology.orchestra.run.smithi080.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38767.log 2024-05-08T18:11:27.227 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39604.log 2024-05-08T18:11:27.227 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33026.log.gz 2024-05-08T18:11:27.227 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.38767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34218.log 2024-05-08T18:11:27.227 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38767.log.gz 2024-05-08T18:11:27.227 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.39604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40016.log 2024-05-08T18:11:27.227 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39604.log.gz 2024-05-08T18:11:27.227 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34767.log 2024-05-08T18:11:27.227 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34218.log.gz 2024-05-08T18:11:27.227 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40016.log.gz 2024-05-08T18:11:27.227 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41950.log 2024-05-08T18:11:27.227 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36158.log 2024-05-08T18:11:27.227 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34767.log.gz 2024-05-08T18:11:27.228 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41950.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.41950.log.gz --verbose 2024-05-08T18:11:27.228 INFO:teuthology.orchestra.run.smithi080.stderr: -- /var/log/ceph/ceph-client.admin.30822.log 2024-05-08T18:11:27.228 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33378.log 2024-05-08T18:11:27.228 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36158.log.gz 2024-05-08T18:11:27.228 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.30822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38030.log 2024-05-08T18:11:27.228 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30822.log.gz 2024-05-08T18:11:27.228 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32407.log 2024-05-08T18:11:27.228 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33378.log.gz 2024-05-08T18:11:27.228 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38119.log 2024-05-08T18:11:27.228 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.38030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38030.log.gz 2024-05-08T18:11:27.228 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.32407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41349.log 2024-05-08T18:11:27.228 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32407.log.gz 2024-05-08T18:11:27.228 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.38119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36688.log 2024-05-08T18:11:27.228 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38119.log.gz 2024-05-08T18:11:27.228 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41738.log 2024-05-08T18:11:27.229 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41349.log.gz 2024-05-08T18:11:27.229 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31290.log 2024-05-08T18:11:27.229 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36688.log.gz 2024-05-08T18:11:27.229 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41609.log 2024-05-08T18:11:27.229 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41738.log.gz 2024-05-08T18:11:27.229 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34884.log 2024-05-08T18:11:27.229 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31290.log.gz 2024-05-08T18:11:27.229 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35409.log 2024-05-08T18:11:27.229 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41609.log.gz 2024-05-08T18:11:27.229 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33521.log 2024-05-08T18:11:27.229 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34884.log.gz 2024-05-08T18:11:27.229 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35409.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.35409.log.gz 2024-05-08T18:11:27.229 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34165.log 2024-05-08T18:11:27.230 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33765.log 2024-05-08T18:11:27.230 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33521.log.gz 2024-05-08T18:11:27.230 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43194.log 2024-05-08T18:11:27.230 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34165.log.gz 2024-05-08T18:11:27.230 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42149.log 2024-05-08T18:11:27.230 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33765.log.gz 2024-05-08T18:11:27.230 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34622.log 2024-05-08T18:11:27.230 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43194.log.gz 2024-05-08T18:11:27.230 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42149.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.41505.log -- replaced with /var/log/ceph/ceph-client.admin.42149.log.gz 2024-05-08T18:11:27.230 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-08T18:11:27.230 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36504.log 2024-05-08T18:11:27.231 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34622.log.gz 2024-05-08T18:11:27.231 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33807.log 2024-05-08T18:11:27.231 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41505.log.gz 2024-05-08T18:11:27.231 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36504.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.36654.log 2024-05-08T18:11:27.231 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36504.log.gz 2024-05-08T18:11:27.231 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32766.log 2024-05-08T18:11:27.231 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33807.log.gz 2024-05-08T18:11:27.231 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36654.log.gz 2024-05-08T18:11:27.231 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31090.log 2024-05-08T18:11:27.231 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43660.log 2024-05-08T18:11:27.231 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.32766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32766.log.gz 2024-05-08T18:11:27.231 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31310.log 2024-05-08T18:11:27.232 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31090.log.gz 2024-05-08T18:11:27.232 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34451.log 2024-05-08T18:11:27.232 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43660.log.gz 2024-05-08T18:11:27.232 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41937.log 2024-05-08T18:11:27.232 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31310.log.gz 2024-05-08T18:11:27.232 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34451.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.34451.log.gz /var/log/ceph/ceph-client.admin.43428.log 2024-05-08T18:11:27.232 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-08T18:11:27.232 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41531.log 2024-05-08T18:11:27.232 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41937.log.gz 2024-05-08T18:11:27.232 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36343.log 2024-05-08T18:11:27.232 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43428.log.gz 2024-05-08T18:11:27.232 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41531.log.gz 2024-05-08T18:11:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35996.log 2024-05-08T18:11:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32381.log 2024-05-08T18:11:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36343.log.gz 2024-05-08T18:11:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35996.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20275.log 2024-05-08T18:11:27.233 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35996.log.gz 2024-05-08T18:11:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41741.log 2024-05-08T18:11:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.32381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32381.log.gz 2024-05-08T18:11:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph.tmp-client.admin.20275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40267.log 2024-05-08T18:11:27.233 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20275.log.gz 2024-05-08T18:11:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41741.log.gz 2024-05-08T18:11:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-08T18:11:27.233 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42391.log 2024-05-08T18:11:27.234 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40267.log: /var/log/ceph/ceph-osd.3.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40267.log.gz 2024-05-08T18:11:27.234 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33638.log 2024-05-08T18:11:27.234 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43142.log 2024-05-08T18:11:27.234 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42391.log.gz 2024-05-08T18:11:27.234 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43454.log 2024-05-08T18:11:27.234 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33638.log.gz 2024-05-08T18:11:27.234 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33114.log 2024-05-08T18:11:27.234 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43142.log: /var/log/ceph/ceph-client.admin.43454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37691.log 2024-05-08T18:11:27.234 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43142.log.gz 2024-05-08T18:11:27.234 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43454.log.gz 2024-05-08T18:11:27.235 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33114.log.gz 2024-05-08T18:11:27.235 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39525.log 2024-05-08T18:11:27.235 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.37691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39968.log 2024-05-08T18:11:27.235 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37691.log.gz 2024-05-08T18:11:27.235 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.39525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33271.log 2024-05-08T18:11:27.235 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39525.log.gz 2024-05-08T18:11:27.235 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42471.log 2024-05-08T18:11:27.235 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.39968.log: /var/log/ceph/ceph-client.admin.33271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36470.log 2024-05-08T18:11:27.235 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39968.log.gz 2024-05-08T18:11:27.236 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33271.log.gz 2024-05-08T18:11:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.0.42471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42471.log.gz 2024-05-08T18:11:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31109.log 2024-05-08T18:11:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35464.log 2024-05-08T18:11:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36470.log: /var/log/ceph/ceph-client.admin.31109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41187.log 2024-05-08T18:11:27.236 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31109.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36470.log.gz 2024-05-08T18:11:27.236 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-08T18:11:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35464.log.gz 2024-05-08T18:11:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43298.log 2024-05-08T18:11:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35114.log 2024-05-08T18:11:27.236 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41187.log: /var/log/ceph/ceph-client.admin.43298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42174.log 2024-05-08T18:11:27.237 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41187.log.gz 2024-05-08T18:11:27.237 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43298.log.gz 2024-05-08T18:11:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30897.log 2024-05-08T18:11:27.237 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35114.log.gz 2024-05-08T18:11:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31574.log 2024-05-08T18:11:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42174.log: /var/log/ceph/ceph-client.admin.30897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35571.log 2024-05-08T18:11:27.237 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42174.log.gz 2024-05-08T18:11:27.237 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30897.log.gz 2024-05-08T18:11:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31574.log.gz 2024-05-08T18:11:27.237 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32704.log 2024-05-08T18:11:27.238 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31307.log 2024-05-08T18:11:27.238 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35571.log: /var/log/ceph/ceph-client.admin.32704.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-08T18:11:27.238 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35571.log.gz 2024-05-08T18:11:27.238 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32704.log.gz 2024-05-08T18:11:27.238 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31307.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.31307.log.gz 2024-05-08T18:11:27.238 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33187.log 2024-05-08T18:11:27.238 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39647.log 2024-05-08T18:11:27.238 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.33187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40204.log 2024-05-08T18:11:27.238 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33187.log.gz 2024-05-08T18:11:27.238 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.39647.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41107.log 2024-05-08T18:11:27.238 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39647.log.gz 2024-05-08T18:11:27.238 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40204.log.gz 2024-05-08T18:11:27.238 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34880.log 2024-05-08T18:11:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41733.log 2024-05-08T18:11:27.239 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41107.log.gz 2024-05-08T18:11:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34880.log.gz 2024-05-08T18:11:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31096.log 2024-05-08T18:11:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41479.log 2024-05-08T18:11:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41733.log: /var/log/ceph/ceph-client.admin.31096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41733.log.gz 2024-05-08T18:11:27.239 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31096.log.gz 2024-05-08T18:11:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31308.log 2024-05-08T18:11:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30719.log 2024-05-08T18:11:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41479.log: /var/log/ceph/ceph-client.admin.31308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41479.log.gz 2024-05-08T18:11:27.239 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31308.log.gz 2024-05-08T18:11:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36116.log 2024-05-08T18:11:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32672.log 2024-05-08T18:11:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.30719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30719.log.gz 2024-05-08T18:11:27.239 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36116.log.gz 2024-05-08T18:11:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43090.log 2024-05-08T18:11:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.32672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32672.log.gz 2024-05-08T18:11:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35041.log 2024-05-08T18:11:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30891.log 2024-05-08T18:11:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43090.log.gz 2024-05-08T18:11:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35041.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43376.log 2024-05-08T18:11:27.240 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-08T18:11:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.30891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30891.log.gz 2024-05-08T18:11:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42148.log 2024-05-08T18:11:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33427.log 2024-05-08T18:11:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43376.log: /var/log/ceph/ceph-client.admin.42148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43376.log.gz 2024-05-08T18:11:27.240 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42148.log.gz 2024-05-08T18:11:27.240 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37616.log 2024-05-08T18:11:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36053.log 2024-05-08T18:11:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33427.log: /var/log/ceph/ceph-client.admin.37616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33427.log.gz 2024-05-08T18:11:27.241 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37616.log.gz 2024-05-08T18:11:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34313.log 2024-05-08T18:11:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36264.log 2024-05-08T18:11:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36053.log: /var/log/ceph/ceph-client.admin.34313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36053.log.gz 2024-05-08T18:11:27.241 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34313.log.gz 2024-05-08T18:11:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34354.log 2024-05-08T18:11:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41743.log 2024-05-08T18:11:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36264.log: /var/log/ceph/ceph-client.admin.34354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36264.log.gz 2024-05-08T18:11:27.241 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34354.log.gz 2024-05-08T18:11:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31087.log 2024-05-08T18:11:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39936.log 2024-05-08T18:11:27.241 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41743.log: /var/log/ceph/ceph-client.admin.31087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41743.log.gz 2024-05-08T18:11:27.242 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31087.log.gz 2024-05-08T18:11:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36716.log 2024-05-08T18:11:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43532.log 2024-05-08T18:11:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.39936.log: /var/log/ceph/ceph-client.admin.36716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39936.log.gz 2024-05-08T18:11:27.242 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36716.log.gz 2024-05-08T18:11:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43402.log 2024-05-08T18:11:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43532.log.gz 2024-05-08T18:11:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35752.log 2024-05-08T18:11:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-08T18:11:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43402.log.gz 2024-05-08T18:11:27.242 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35752.log.gz 2024-05-08T18:11:27.243 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40449.log 2024-05-08T18:11:27.296 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph.log: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-08T18:11:27.296 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36855.log 2024-05-08T18:11:27.296 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34244.log 2024-05-08T18:11:27.296 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40449.log.gz 2024-05-08T18:11:27.296 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32482.log 2024-05-08T18:11:27.296 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36855.log.gz 2024-05-08T18:11:27.296 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34244.log.gz 2024-05-08T18:11:27.296 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36377.log 2024-05-08T18:11:27.297 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33906.log 2024-05-08T18:11:27.297 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.32482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32482.log.gz 2024-05-08T18:11:27.297 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36377.log.gz 2024-05-08T18:11:27.297 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32639.log 2024-05-08T18:11:27.297 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33609.log 2024-05-08T18:11:27.297 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33906.log.gz 2024-05-08T18:11:27.297 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.32639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42131.log 2024-05-08T18:11:27.297 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32639.log.gz 2024-05-08T18:11:27.297 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33609.log.gz 2024-05-08T18:11:27.297 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41951.log 2024-05-08T18:11:27.297 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40077.log 2024-05-08T18:11:27.298 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42131.log.gz 2024-05-08T18:11:27.298 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41951.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42135.log 2024-05-08T18:11:27.298 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-08T18:11:27.298 INFO:teuthology.orchestra.run.smithi080.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-08T18:11:27.298 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.40077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40077.log.gz 2024-05-08T18:11:27.298 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37935.log 2024-05-08T18:11:27.298 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31650.log 2024-05-08T18:11:27.298 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42135.log.gz 2024-05-08T18:11:27.298 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.37935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30895.log 2024-05-08T18:11:27.298 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37935.log.gz 2024-05-08T18:11:27.298 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36579.log 2024-05-08T18:11:27.299 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31650.log: /var/log/ceph/ceph-client.admin.30895.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-08T18:11:27.299 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31650.log.gz 2024-05-08T18:11:27.299 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30895.log.gz/var/log/ceph/ceph-client.admin.36579.log: 2024-05-08T18:11:27.299 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36579.log.gz 2024-05-08T18:11:27.299 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40452.log 2024-05-08T18:11:27.299 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39708.log 2024-05-08T18:11:27.299 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.40452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34573.log 2024-05-08T18:11:27.299 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40452.log.gz 2024-05-08T18:11:27.299 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.39708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39708.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32437.log 2024-05-08T18:11:27.299 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-08T18:11:27.299 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34573.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.34573.log.gz 2024-05-08T18:11:27.299 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34691.log 2024-05-08T18:11:27.300 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.32437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32437.log.gz 2024-05-08T18:11:27.300 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39428.log 2024-05-08T18:11:27.300 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43584.log 2024-05-08T18:11:27.300 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34691.log: /var/log/ceph/ceph-client.admin.39428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34691.log.gz 2024-05-08T18:11:27.300 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39428.log.gz 2024-05-08T18:11:27.300 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41922.log 2024-05-08T18:11:27.300 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43220.log 2024-05-08T18:11:27.300 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43584.log: /var/log/ceph/ceph-client.admin.41922.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43584.log.gz 2024-05-08T18:11:27.300 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41922.log.gz 2024-05-08T18:11:27.300 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35834.log 2024-05-08T18:11:27.300 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41689.log 2024-05-08T18:11:27.300 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43220.log: /var/log/ceph/ceph-client.admin.35834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43220.log.gz 2024-05-08T18:11:27.301 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35834.log.gz 2024-05-08T18:11:27.301 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37531.log 2024-05-08T18:11:27.301 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35155.log 2024-05-08T18:11:27.301 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41689.log: /var/log/ceph/ceph-client.admin.37531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41689.log.gz 2024-05-08T18:11:27.301 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37531.log.gz 2024-05-08T18:11:27.301 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32355.log 2024-05-08T18:11:27.301 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42151.log 2024-05-08T18:11:27.301 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35155.log: /var/log/ceph/ceph-client.admin.32355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35155.log.gz 2024-05-08T18:11:27.301 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32355.log.gz 2024-05-08T18:11:27.301 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32899.log 2024-05-08T18:11:27.301 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30770.log 2024-05-08T18:11:27.301 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42151.log: /var/log/ceph/ceph-client.admin.32899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42151.log.gz 2024-05-08T18:11:27.302 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32899.log.gz 2024-05-08T18:11:27.302 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-05-08T18:11:27.302 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32984.log 2024-05-08T18:11:27.302 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.30770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30770.log.gz 2024-05-08T18:11:27.302 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41663.log 2024-05-08T18:11:27.302 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.32984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32984.log.gz 2024-05-08T18:11:27.302 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41728.log 2024-05-08T18:11:27.302 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41663.log.gz 2024-05-08T18:11:27.302 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41297.log 2024-05-08T18:11:27.302 INFO:teuthology.orchestra.run.smithi080.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-05-08T18:11:27.302 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41728.log.gz 2024-05-08T18:11:27.302 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41735.log 2024-05-08T18:11:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42343.log 2024-05-08T18:11:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41297.log.gz 2024-05-08T18:11:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41735.log.gz 2024-05-08T18:11:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-08T18:11:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42343.log.gz 2024-05-08T18:11:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34093.log 2024-05-08T18:11:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31099.log 2024-05-08T18:11:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.34093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34093.log.gz 2024-05-08T18:11:27.303 INFO:teuthology.orchestra.run.smithi080.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-08T18:11:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36807.log 2024-05-08T18:11:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30899.log 2024-05-08T18:11:27.303 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31099.log: /var/log/ceph/ceph-client.admin.36807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31099.log.gz 2024-05-08T18:11:27.303 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36807.log.gz 2024-05-08T18:11:27.304 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30744.log 2024-05-08T18:11:27.304 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41637.log 2024-05-08T18:11:27.304 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.30899.log: /var/log/ceph/ceph-client.admin.30744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30899.log.gz 2024-05-08T18:11:27.304 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30744.log.gz 2024-05-08T18:11:27.304 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34830.log 2024-05-08T18:11:27.304 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34062.log 2024-05-08T18:11:27.304 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41637.log: /var/log/ceph/ceph-client.admin.34830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41637.log.gz 2024-05-08T18:11:27.304 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34830.log.gz 2024-05-08T18:11:27.304 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41375.log 2024-05-08T18:11:27.304 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43116.log 2024-05-08T18:11:27.304 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34062.log: /var/log/ceph/ceph-client.admin.41375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34062.log.gz 2024-05-08T18:11:27.304 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41375.log.gz 2024-05-08T18:11:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31624.log 2024-05-08T18:11:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41401.log 2024-05-08T18:11:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43116.log: /var/log/ceph/ceph-client.admin.31624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43116.log.gz 2024-05-08T18:11:27.305 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31624.log.gz 2024-05-08T18:11:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36192.log 2024-05-08T18:11:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35909.log 2024-05-08T18:11:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41401.log: /var/log/ceph/ceph-client.admin.36192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41401.log.gz 2024-05-08T18:11:27.305 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36192.log.gz 2024-05-08T18:11:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30896.log 2024-05-08T18:11:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31083.log 2024-05-08T18:11:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35909.log: /var/log/ceph/ceph-client.admin.30896.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35909.log.gz 2024-05-08T18:11:27.305 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30896.log.gz 2024-05-08T18:11:27.305 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33996.log 2024-05-08T18:11:27.306 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39869.log 2024-05-08T18:11:27.306 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31083.log.gz 2024-05-08T18:11:27.306 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33996.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.33996.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.43506.log 2024-05-08T18:11:27.306 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-08T18:11:27.306 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.39869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39869.log.gz 2024-05-08T18:11:27.306 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36090.log 2024-05-08T18:11:27.306 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31309.log 2024-05-08T18:11:27.306 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43506.log: /var/log/ceph/ceph-client.admin.36090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43506.log.gz 2024-05-08T18:11:27.306 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36090.log.gz 2024-05-08T18:11:27.306 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41557.log 2024-05-08T18:11:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31524.log 2024-05-08T18:11:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31309.log.gz 2024-05-08T18:11:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41557.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33959.log 2024-05-08T18:11:27.307 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41557.log.gz 2024-05-08T18:11:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31524.log.gz 2024-05-08T18:11:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25051.log 2024-05-08T18:11:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41583.log 2024-05-08T18:11:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33959.log: /var/log/ceph/ceph-client.admin.25051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33959.log.gz 2024-05-08T18:11:27.307 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25051.log.gz 2024-05-08T18:11:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43272.log 2024-05-08T18:11:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34400.log 2024-05-08T18:11:27.307 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41583.log.gz 2024-05-08T18:11:27.308 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43272.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42177.log 2024-05-08T18:11:27.308 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43272.log.gz 2024-05-08T18:11:27.308 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34400.log.gz 2024-05-08T18:11:27.308 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34623.log 2024-05-08T18:11:27.308 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37783.log 2024-05-08T18:11:27.308 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42177.log: /var/log/ceph/ceph-client.admin.34623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42177.log.gz 2024-05-08T18:11:27.308 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34623.log.gz 2024-05-08T18:11:27.308 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33568.log 2024-05-08T18:11:27.308 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32587.log 2024-05-08T18:11:27.308 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.37783.log: /var/log/ceph/ceph-client.admin.33568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37783.log.gz 2024-05-08T18:11:27.308 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33568.log.gz 2024-05-08T18:11:27.308 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33145.log 2024-05-08T18:11:27.309 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32898.log 2024-05-08T18:11:27.309 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.32587.log: /var/log/ceph/ceph-client.admin.33145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32587.log.gz 2024-05-08T18:11:27.309 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33145.log.gz 2024-05-08T18:11:27.309 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33179.log 2024-05-08T18:11:27.309 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41943.log 2024-05-08T18:11:27.309 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.32898.log: /var/log/ceph/ceph-client.admin.33179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32898.log.gz 2024-05-08T18:11:27.309 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33179.log.gz 2024-05-08T18:11:27.309 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43636.log 2024-05-08T18:11:27.309 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33871.log 2024-05-08T18:11:27.309 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41943.log.gz 2024-05-08T18:11:27.309 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43636.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30885.log 2024-05-08T18:11:27.310 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43636.log.gz 2024-05-08T18:11:27.310 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33871.log.gz 2024-05-08T18:11:27.310 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33724.log 2024-05-08T18:11:27.310 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25205.log 2024-05-08T18:11:27.310 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.30885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30885.log.gz 2024-05-08T18:11:27.310 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33724.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35270.log 2024-05-08T18:11:27.310 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33724.log.gz 2024-05-08T18:11:27.310 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.25205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25205.log.gz 2024-05-08T18:11:27.310 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40160.log 2024-05-08T18:11:27.310 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41427.log 2024-05-08T18:11:27.310 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35270.log: /var/log/ceph/ceph-client.admin.40160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35270.log.gz 2024-05-08T18:11:27.311 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40160.log.gz 2024-05-08T18:11:27.311 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35213.log 2024-05-08T18:11:27.311 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36934.log 2024-05-08T18:11:27.311 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41427.log: /var/log/ceph/ceph-client.admin.35213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41427.log.gz 2024-05-08T18:11:27.311 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35213.log.gz 2024-05-08T18:11:27.311 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32698.log 2024-05-08T18:11:27.311 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38075.log 2024-05-08T18:11:27.311 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36934.log: /var/log/ceph/ceph-client.admin.32698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36934.log.gz 2024-05-08T18:11:27.311 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32698.log.gz 2024-05-08T18:11:27.311 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35946.log 2024-05-08T18:11:27.311 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33052.log 2024-05-08T18:11:27.311 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.38075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38075.log.gz 2024-05-08T18:11:27.311 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35946.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32804.log 2024-05-08T18:11:27.312 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-08T18:11:27.312 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33052.log.gz 2024-05-08T18:11:27.312 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31498.log 2024-05-08T18:11:27.312 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37961.log 2024-05-08T18:11:27.312 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.32804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32804.log.gz 2024-05-08T18:11:27.312 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31498.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38117.log 2024-05-08T18:11:27.312 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31498.log.gz 2024-05-08T18:11:27.312 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.37961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37961.log.gz 2024-05-08T18:11:27.312 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42443.log 2024-05-08T18:11:27.312 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32832.log 2024-05-08T18:11:27.312 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.38117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38117.log.gz 2024-05-08T18:11:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.42443.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35508.log 2024-05-08T18:11:27.313 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42443.log.gz 2024-05-08T18:11:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.32832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32832.log.gz 2024-05-08T18:11:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34426.log 2024-05-08T18:11:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43350.log 2024-05-08T18:11:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35508.log: /var/log/ceph/ceph-client.admin.34426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35508.log.gz 2024-05-08T18:11:27.313 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34426.log.gz 2024-05-08T18:11:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36426.log 2024-05-08T18:11:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30848.log 2024-05-08T18:11:27.313 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43350.log: /var/log/ceph/ceph-client.admin.36426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43350.log.gz 2024-05-08T18:11:27.313 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36426.log.gz 2024-05-08T18:11:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33295.log 2024-05-08T18:11:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34739.log 2024-05-08T18:11:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.30848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30848.log.gz 2024-05-08T18:11:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.33295.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41936.log 2024-05-08T18:11:27.314 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33295.log.gz 2024-05-08T18:11:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34739.log.gz 2024-05-08T18:11:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37779.log 2024-05-08T18:11:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41271.log 2024-05-08T18:11:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41936.log: /var/log/ceph/ceph-client.admin.37779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41936.log.gz 2024-05-08T18:11:27.314 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37779.log.gz 2024-05-08T18:11:27.314 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35379.log 2024-05-08T18:11:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43610.log 2024-05-08T18:11:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41271.log.gz 2024-05-08T18:11:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35379.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39905.log 2024-05-08T18:11:27.315 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-08T18:11:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43610.log.gz 2024-05-08T18:11:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40111.log 2024-05-08T18:11:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35654.log 2024-05-08T18:11:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.39905.log: /var/log/ceph/ceph-client.admin.40111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39905.log.gz 2024-05-08T18:11:27.315 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40111.log.gz 2024-05-08T18:11:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31102.log 2024-05-08T18:11:27.315 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41245.log 2024-05-08T18:11:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.35654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35654.log.gz 2024-05-08T18:11:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.31102.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.31102.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.34501.log 2024-05-08T18:11:27.316 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-08T18:11:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.41245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41245.log.gz 2024-05-08T18:11:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35806.log 2024-05-08T18:11:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36263.log 2024-05-08T18:11:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.34501.log: /var/log/ceph/ceph-client.admin.35806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34501.log.gz 2024-05-08T18:11:27.316 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35806.log.gz 2024-05-08T18:11:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30900.log 2024-05-08T18:11:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.36263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36263.log.gz 2024-05-08T18:11:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38734.log 2024-05-08T18:11:27.316 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.30900.log: 0.0%/var/log/ceph/ceph-client.admin.38734.log: -- replaced with /var/log/ceph/ceph-client.admin.30900.log.gz 2024-05-08T18:11:27.317 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38734.log.gz 2024-05-08T18:11:27.317 INFO:teuthology.orchestra.run.smithi115.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-08T18:11:27.401 INFO:teuthology.orchestra.run.smithi080.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-08T18:11:27.557 INFO:teuthology.orchestra.run.smithi080.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-08T18:11:27.608 INFO:teuthology.orchestra.run.smithi115.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-08T18:11:27.741 INFO:teuthology.orchestra.run.smithi080.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-08T18:11:27.770 INFO:teuthology.orchestra.run.smithi115.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-08T18:11:27.773 INFO:teuthology.orchestra.run.smithi115.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-08T18:11:27.789 INFO:teuthology.orchestra.run.smithi115.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-08T18:11:27.790 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-05-08T18:11:27.791 INFO:teuthology.orchestra.run.smithi115.stderr:real 0m0.660s 2024-05-08T18:11:27.791 INFO:teuthology.orchestra.run.smithi115.stderr:user 0m2.449s 2024-05-08T18:11:27.791 INFO:teuthology.orchestra.run.smithi115.stderr:sys 0m0.096s 2024-05-08T18:11:27.883 INFO:teuthology.orchestra.run.smithi080.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-08T18:11:27.895 INFO:teuthology.orchestra.run.smithi080.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-08T18:11:27.908 INFO:teuthology.orchestra.run.smithi080.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-08T18:11:27.909 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-08T18:11:27.909 INFO:teuthology.orchestra.run.smithi080.stderr:real 0m0.790s 2024-05-08T18:11:27.910 INFO:teuthology.orchestra.run.smithi080.stderr:user 0m3.504s 2024-05-08T18:11:27.910 INFO:teuthology.orchestra.run.smithi080.stderr:sys 0m0.152s 2024-05-08T18:11:27.910 INFO:tasks.ceph:Archiving logs... 2024-05-08T18:11:27.910 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/log/ceph to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697867/remote/smithi080/log 2024-05-08T18:11:27.911 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T18:11:28.522 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/log/ceph to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697867/remote/smithi115/log 2024-05-08T18:11:28.523 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T18:11:28.805 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T18:11:28.814 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T18:11:28.815 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T18:11:28.818 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T18:11:28.890 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T18:11:28.899 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T18:11:28.899 DEBUG:teuthology.orchestra.run.smithi080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:11:28.902 DEBUG:teuthology.orchestra.run.smithi115:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:11:28.913 INFO:teuthology.orchestra.run.smithi080.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T18:11:28.913 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================== 2024-05-08T18:11:28.913 INFO:teuthology.orchestra.run.smithi080.stdout:+hv01.front.sepi 138.236.128.36 3 u 57 64 177 0.075 -1.502 2.365 2024-05-08T18:11:28.913 INFO:teuthology.orchestra.run.smithi080.stdout:+hv02.front.sepi 63.231.80.2 3 u 52 64 177 0.076 -4.905 1.960 2024-05-08T18:11:28.913 INFO:teuthology.orchestra.run.smithi080.stdout:*hv03.front.sepi 74.6.168.72 3 u 51 64 177 0.076 -4.225 2.538 2024-05-08T18:11:28.913 INFO:teuthology.orchestra.run.smithi080.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:11:28.914 INFO:teuthology.orchestra.run.smithi115.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T18:11:28.914 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================== 2024-05-08T18:11:28.915 INFO:teuthology.orchestra.run.smithi115.stdout:+hv01.front.sepi 138.236.128.36 3 u 52 64 177 0.089 +2.561 1.165 2024-05-08T18:11:28.915 INFO:teuthology.orchestra.run.smithi115.stdout:*hv02.front.sepi 63.231.80.2 3 u 51 64 177 0.091 -2.958 0.865 2024-05-08T18:11:28.915 INFO:teuthology.orchestra.run.smithi115.stdout:+hv03.front.sepi 74.6.168.72 3 u 51 64 177 0.108 -0.788 0.948 2024-05-08T18:11:28.915 INFO:teuthology.orchestra.run.smithi115.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:11:28.915 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T18:11:28.923 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T18:11:28.924 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T18:11:28.933 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T18:11:28.942 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T18:11:28.950 INFO:teuthology.task.internal:Duration was 957.454413 seconds 2024-05-08T18:11:28.950 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T18:11:28.959 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T18:11:28.959 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T18:11:28.962 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T18:11:28.997 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T18:11:28.997 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T18:11:28.997 DEBUG:teuthology.orchestra.run.smithi080:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T18:11:29.050 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi115.front.sepia.ceph.com 2024-05-08T18:11:29.050 DEBUG:teuthology.orchestra.run.smithi115:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T18:11:29.060 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T18:11:29.061 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T18:11:29.094 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T18:11:29.131 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T18:11:29.132 DEBUG:teuthology.orchestra.run.smithi080:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T18:11:29.162 DEBUG:teuthology.orchestra.run.smithi115:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T18:11:29.235 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T18:11:29.245 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T18:11:29.245 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T18:11:29.257 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T18:11:29.269 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T18:11:29.279 DEBUG:teuthology.orchestra.run.smithi080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:11:29.302 DEBUG:teuthology.orchestra.run.smithi115:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:11:29.311 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = core 2024-05-08T18:11:29.320 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = core 2024-05-08T18:11:29.417 DEBUG:teuthology.orchestra.run.smithi080:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:11:29.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:11:29.422 DEBUG:teuthology.orchestra.run.smithi115:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:11:29.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:11:29.463 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T18:11:29.472 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T18:11:29.473 DEBUG:teuthology.misc:Transferring archived files from smithi080:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697867/remote/smithi080 2024-05-08T18:11:29.473 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T18:11:29.494 DEBUG:teuthology.misc:Transferring archived files from smithi115:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697867/remote/smithi115 2024-05-08T18:11:29.494 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T18:11:29.526 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T18:11:29.526 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T18:11:29.539 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T18:11:29.575 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T18:11:29.586 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T18:11:29.586 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T18:11:29.596 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T18:11:29.597 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T18:11:29.599 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T18:11:29.602 INFO:teuthology.orchestra.run.smithi080.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 18:11 /home/ubuntu/cephtest 2024-05-08T18:11:29.623 INFO:teuthology.orchestra.run.smithi115.stdout: 658636 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 18:11 /home/ubuntu/cephtest 2024-05-08T18:11:29.624 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T18:11:29.635 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T18:11:29.657 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} duration: 957.4544126987457 flavor: default owner: scheduled_ivancich@teuthology success: true 2024-05-08T18:11:29.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T18:11:29.741 INFO:teuthology.run:pass